Aug 03 08:22:46 devstack cinder-volume[77411]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Aug 03 08:22:46 devstack cinder-volume[77411]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Aug 03 08:22:46 devstack cinder-volume[77411]: we strongly recommend against using it for new projects. Aug 03 08:22:46 devstack cinder-volume[77411]: If you are already using Eventlet, we recommend migrating to a different Aug 03 08:22:46 devstack cinder-volume[77411]: framework. For more detail see Aug 03 08:22:46 devstack cinder-volume[77411]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Aug 03 08:22:46 devstack cinder-volume[77411]: import eventlet # noqa Aug 03 08:22:48 devstack cinder-volume[77411]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=77411) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Aug 03 08:22:48 devstack cinder-volume[77411]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=77411) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Aug 03 08:22:48 devstack cinder-volume[77411]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=77411) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Aug 03 08:22:49 devstack cinder-volume[77411]: INFO dbcounter [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] Registered counter for database cinder Aug 03 08:22:49 devstack cinder-volume[77411]: DEBUG oslo_db.sqlalchemy.engines [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=77411) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 03 08:22:50 devstack cinder-volume[77411]: DEBUG dbcounter [-] [77411] Writer thread running {{(pid=77411) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Aug 03 08:22:50 devstack cinder-volume[77411]: INFO cinder.rpc [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Aug 03 08:22:50 devstack cinder-volume[77411]: INFO cinder.rpc [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Aug 03 08:22:50 devstack cinder-volume[77411]: DEBUG oslo_db.sqlalchemy.engines [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=77411) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 03 08:22:50 devstack cinder-volume[77411]: INFO cinder.volume.manager [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] Determined volume DB was empty at startup. Aug 03 08:22:50 devstack cinder-volume[77411]: DEBUG cinder.volume.manager [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=77411) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Aug 03 08:22:50 devstack cinder-volume[77411]: INFO cinder.volume.manager [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] Service not found for updating active_backend_id, assuming default for driver init. Aug 03 08:22:50 devstack cinder-volume[77411]: WARNING stevedore.named [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Aug 03 08:22:50 devstack cinder-volume[77411]: WARNING castellan.key_manager [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Aug 03 08:22:50 devstack cinder-volume[77411]: WARNING cinder.keymgr.conf_key_mgr [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Aug 03 08:22:50 devstack cinder-volume[77411]: DEBUG cinder.volume.drivers.lvm [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=77411) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:109}} Aug 03 08:22:50 devstack cinder-volume[77411]: DEBUG oslo_concurrency.processutils [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=77411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:22:50 devstack cinder-volume[77411]: DEBUG oslo_concurrency.processutils [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] CMD "cinder-rtstool verify" returned: 0 in 0.408s {{(pid=77411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:22:50 devstack cinder-volume[77411]: DEBUG oslo_db.sqlalchemy.engines [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=77411) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 03 08:22:50 devstack cinder-volume[77411]: INFO cinder.rpc [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Aug 03 08:22:50 devstack cinder-volume[77411]: INFO cinder.rpc [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Aug 03 08:22:50 devstack cinder-volume[77411]: WARNING stevedore.named [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Aug 03 08:22:50 devstack cinder-volume[77411]: WARNING castellan.key_manager [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Aug 03 08:22:50 devstack cinder-volume[77411]: INFO cinder.volume.manager [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] Image-volume cache enabled for host devstack@lvmdriver-1. Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_db.sqlalchemy.engines [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=77411) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 03 08:22:51 devstack cinder-volume[77411]: INFO oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] Starting 1 workers Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] Started child 77572 {{(pid=77411) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] Full set of CONF: {{(pid=77411) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] ******************************************************************************** {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] Configuration options gathered from: {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] ================================================================================ {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] allow_availability_zone_fallback = False {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] allow_compression_on_image_upload = False {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:22:51 devstack cinder-volume[77572]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] allowed_direct_url_schemes = [] {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] api_rate_limit = True {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] auth_strategy = keystone {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] az_cache_duration = 3600 {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] backend_availability_zone = None {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] backend_host = None {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] backend_name = None {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] backend_stats_polling_interval = 60 {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] backup_api_class = cinder.backup.api.API {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] backup_name_template = backup-%s {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] backup_use_same_host = False {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] backup_use_temp_snapshot = False {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] chap_password = **** {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] chap_username = {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] cinder_internal_tenant_project_id = a9c7a894fc7a45e8bd418eaaef586b5d {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] cinder_internal_tenant_user_id = 2af68c9d2740481681db96f147575d58 {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] cloned_volume_same_az = True {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] cluster = None {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] compression_format = gzip {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] compute_api_class = cinder.compute.nova.API {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] config_dir = [] {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] config_source = [] {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] control_exchange = openstack {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] debug = True {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] default_availability_zone = None {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] default_group_type = None {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] default_volume_type = lvmdriver-1 {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] disk_geometry = None {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] driver_client_cert = None {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] driver_client_cert_key = None {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] driver_data_namespace = None {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] driver_ssl_cert_path = None {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] driver_ssl_cert_verify = False {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] driver_use_ssl = False {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] enable_force_upload = False {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] enable_new_services = True {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] enable_unsupported_driver = False {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] enabled_backends = ['lvmdriver-1'] {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] enforce_multipath_for_image_xfer = False {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] filter_function = None {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] glance_api_insecure = False {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] glance_api_servers = ['http://192.168.122.55/image'] {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] glance_api_ssl_compression = False {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] glance_ca_certificates_file = None {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] glance_catalog_info = image:glance:publicURL {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] glance_certfile = None {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] glance_keyfile = None {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] glance_num_retries = 3 {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] glance_request_timeout = None {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] goodness_function = None {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] graceful_shutdown_timeout = 5 {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] group_api_class = cinder.group.api.API {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] host = devstack {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] image_compress_on_upload = True {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] image_conversion_address_space_limit = 1 {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] image_conversion_cpu_limit = 60 {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] image_conversion_disable = False {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] image_upload_use_cinder_backend = False {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] image_upload_use_internal_tenant = False {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] image_volume_cache_enabled = False {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] image_volume_cache_max_count = 0 {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] image_volume_cache_max_size_gb = 0 {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] init_host_max_objects_retrieval = 0 {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] instance_format = [instance: %(uuid)s] {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] iscsi_target_flags = {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] iscsi_write_cache = on {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] iser_helper = tgtadm {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] iser_ip_address = 192.168.122.55 {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] iser_port = 3260 {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] log_color = False {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] log_config_append = None {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] log_dir = None {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] log_file = None {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] log_options = True {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] log_rotate_interval = 1 {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] log_rotate_interval_type = days {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] log_rotation_type = none {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] max_age = 0 {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] max_logfile_count = 30 {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] max_logfile_size_mb = 200 {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] max_over_subscription_ratio = 20.0 {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] message_reap_interval = 86400 {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] message_ttl = 2592000 {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] migration_create_volume_timeout_secs = 300 {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] monkey_patch = False {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] monkey_patch_modules = [] {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] my_ip = 192.168.122.55 {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] no_snapshot_gb_quota = False {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] num_iser_scan_tries = 3 {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] num_shell_tries = 3 {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] num_volume_device_scan_tries = 3 {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:22:51 devstack cinder-volume[77572]: INFO cinder.volume.manager [None req-0b5a966b-e442-4fd3-b700-cc6c2390590a None None] Starting volume driver LVMVolumeDriver (3.0.0) Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] nvmeof_conn_info_version = 1 {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] nvmet_ns_id = 10 {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:22:51 devstack cinder-volume[77572]: DEBUG oslo_concurrency.processutils [None req-0b5a966b-e442-4fd3-b700-cc6c2390590a None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=77572) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] nvmet_port_id = 1 {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] osapi_max_limit = 1000 {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] osapi_volume_ext_list = [] {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] osapi_volume_listen = 0.0.0.0 {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] osapi_volume_listen_port = 8776 {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] osapi_volume_use_ssl = False {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] osapi_volume_workers = None {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] per_volume_size_limit = -1 {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] periodic_fuzzy_delay = 60 {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] periodic_interval = 60 {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] project_id_regex = [0-9a-f\-]+ {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] public_endpoint = None {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] publish_errors = False {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] quota_backup_gigabytes = 1000 {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] quota_backups = 10 {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] quota_gigabytes = 1000 {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] quota_groups = 10 {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] quota_snapshots = 10 {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] quota_volumes = 10 {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] rate_limit_burst = 0 {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] rate_limit_except_level = CRITICAL {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] rate_limit_interval = 0 {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] reinit_driver_count = 3 {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] replication_device = **** {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] report_discard_supported = False {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] report_interval = 120 {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] reservation_clean_interval = 86400 {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] reservation_expire = 86400 {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] reserved_image_namespaces = [] {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] reserved_percentage = 0 {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] rpc_response_timeout = 120 {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] run_external_periodic_tasks = True {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] scst_target_driver = iscsi {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] scst_target_iqn_name = None {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] service_down_time = 720 {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] shell_completion = None {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] snapshot_name_template = snapshot-%s {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] snapshot_same_host = True {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] split_loggers = False {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] state_path = /opt/stack/data/cinder {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] storage_availability_zone = nova {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] storage_protocol = iSCSI {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] syslog_log_facility = LOG_USER {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] target_helper = lioadm {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] target_ip_address = 192.168.122.55 {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] target_port = 3260 {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] target_protocol = iscsi {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] target_secondary_ip_addresses = [] {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] trace_flags = None {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] transfer_api_class = cinder.transfer.api.API {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] transport_url = **** {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] until_refresh = 0 {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] use_chap_auth = False {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] use_default_quota_class = True {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] use_journal = False {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] use_json = False {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] use_multipath_for_image_xfer = False {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] use_stderr = False {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] use_syslog = False {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] verify_glance_signatures = enabled {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] volume_api_class = cinder.volume.api.API {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] volume_backend_name = None {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] volume_clear = zero {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] volume_clear_ionice = None {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] volume_clear_size = 0 {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] volume_copy_bps_limit = 0 {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] volume_dd_blocksize = 1M {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] volume_name_template = volume-%s {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] volume_service_inithost_offload = False {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] volume_usage_audit_period = month {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] zoning_mode = None {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] oslo_concurrency.disable_process_locking = False {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] keystone_authtoken.auth_section = None {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] keystone_authtoken.auth_type = password {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] keystone_authtoken.auth_version = None {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] keystone_authtoken.cache = None {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] keystone_authtoken.certfile = None {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] keystone_authtoken.delay_auth_decision = False {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] keystone_authtoken.http_connect_timeout = None {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] keystone_authtoken.include_service_catalog = True {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] keystone_authtoken.insecure = False {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] keystone_authtoken.interface = public {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] keystone_authtoken.keyfile = None {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:22:51 devstack cinder-volume[77572]: DEBUG oslo_concurrency.processutils [None req-0b5a966b-e442-4fd3-b700-cc6c2390590a None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.037s {{(pid=77572) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] keystone_authtoken.memcache_password = {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] keystone_authtoken.memcache_username = {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] keystone_authtoken.region_name = None {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:22:51 devstack cinder-volume[77572]: DEBUG oslo_concurrency.processutils [None req-0b5a966b-e442-4fd3-b700-cc6c2390590a None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=77572) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] keystone_authtoken.service_token_roles_required = True {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] keystone_authtoken.service_type = None {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] keystone_authtoken.token_cache_time = 300 {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.55/identity {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] cache.backend = dogpile.cache.null {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] cache.backend_argument = **** {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] cache.backend_expiration_time = None {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] cache.config_prefix = cache.oslo {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] cache.debug_cache_backend = False {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] cache.enable_retry_client = False {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] cache.enable_socket_keepalive = False {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] cache.enabled = False {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] cache.expiration_time = 600 {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] cache.hashclient_retry_attempts = 2 {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] cache.memcache_dead_retry = 300 {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] cache.memcache_pool_maxsize = 10 {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] cache.memcache_sasl_enabled = False {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] cache.password = **** {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] cache.proxies = [] {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] cache.redis_db = 0 {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] cache.redis_sentinel_service_name = mymaster {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] cache.redis_server = localhost:6379 {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] cache.retry_attempts = 2 {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] cache.retry_delay = 0.0 {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] cache.socket_keepalive_count = 1 {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] cache.socket_keepalive_idle = 1 {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] cache.socket_keepalive_interval = 1 {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] cache.socket_timeout = 1.0 {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] cache.tls_allowed_ciphers = None {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] cache.tls_cafile = None {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] cache.tls_certfile = None {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] cache.tls_enabled = False {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] cache.tls_keyfile = None {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] cache.username = None {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] coordination.backend_url = **** {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] database.asyncio_connection = **** {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] database.asyncio_slave_connection = **** {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] database.backend = sqlalchemy {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] database.connection = **** {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] database.connection_debug = 0 {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] database.connection_parameters = {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] database.connection_recycle_time = 3600 {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] database.connection_trace = False {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] database.db_inc_retry_interval = True {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] database.db_max_retries = 20 {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] database.db_max_retry_interval = 10 {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] database.db_retry_interval = 1 {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] database.max_overflow = 50 {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] database.max_pool_size = 5 {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] database.max_retries = 10 {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] database.mysql_wsrep_sync_wait = None {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] database.pool_timeout = None {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] database.retry_interval = 10 {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] database.slave_connection = **** {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] database.sqlite_synchronous = True {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] database.synchronous_reader = True {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] database.use_db_reconnect = False {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] profiler.connection_string = messaging:// {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] profiler.enabled = False {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] profiler.es_doc_type = notification {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] profiler.es_scroll_size = 10000 {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] profiler.es_scroll_time = 2m {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] profiler.filter_error_trace = False {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] profiler.hmac_keys = **** {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] profiler.sentinel_service_name = mymaster {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] profiler.socket_timeout = 0.1 {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] profiler.trace_requests = False {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] profiler.trace_sqlalchemy = False {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] profiler_jaeger.process_tags = {} {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] profiler_jaeger.service_name_prefix = None {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] profiler_otlp.service_name_prefix = None {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] oslo_policy.enforce_new_defaults = True {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] oslo_policy.policy_default_rule = default {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:22:51 devstack cinder-volume[77572]: DEBUG oslo_concurrency.processutils [None req-0b5a966b-e442-4fd3-b700-cc6c2390590a None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.030s {{(pid=77572) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] oslo_policy.policy_file = policy.yaml {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:22:51 devstack cinder-volume[77572]: DEBUG oslo_concurrency.processutils [None req-0b5a966b-e442-4fd3-b700-cc6c2390590a None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=77572) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] oslo_policy.remote_timeout = 60.0 {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] privsep_osbrick.group = None {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] privsep_osbrick.helper_command = None {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] privsep_osbrick.user = None {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] cinder_sys_admin.group = None {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] cinder_sys_admin.helper_command = None {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] cinder_sys_admin.user = None {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] service_user.auth_section = None {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] service_user.auth_type = password {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] service_user.cafile = None {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] service_user.certfile = None {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] service_user.collect_timing = False {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] service_user.insecure = False {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] service_user.keyfile = None {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] service_user.send_service_user_token = True {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] service_user.split_loggers = False {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] service_user.timeout = None {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] glance.auth_section = None {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] glance.auth_type = password {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] glance.certfile = None {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] glance.collect_timing = False {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] glance.insecure = False {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] glance.keyfile = None {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] glance.region_name = None {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] glance.split_loggers = False {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] glance.timeout = None {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] backend_defaults.backend_availability_zone = None {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] backend_defaults.chap_password = **** {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] backend_defaults.chap_username = {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] backend_defaults.disk_geometry = None {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] backend_defaults.driver_client_cert = None {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] backend_defaults.driver_client_cert_key = None {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] backend_defaults.driver_data_namespace = None {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:22:51 devstack sudo[77576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] backend_defaults.driver_use_ssl = False {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] backend_defaults.enable_unsupported_driver = False {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] backend_defaults.extra_capabilities = {} {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] backend_defaults.filter_function = None {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] backend_defaults.goodness_function = None {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:22:51 devstack sudo[77576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] backend_defaults.iscsi_target_flags = {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] backend_defaults.iscsi_write_cache = on {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] backend_defaults.iser_helper = tgtadm {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] backend_defaults.iser_ip_address = 192.168.122.55 {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] backend_defaults.iser_port = 3260 {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] backend_defaults.lvm_mirrors = 0 {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] backend_defaults.lvm_share_target = False {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] backend_defaults.lvm_type = auto {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] backend_defaults.num_shell_tries = 3 {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] backend_defaults.nvmet_port_id = 1 {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] backend_defaults.replication_device = **** {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] backend_defaults.report_discard_supported = False {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] backend_defaults.reserved_percentage = 0 {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] backend_defaults.scst_target_driver = iscsi {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] backend_defaults.scst_target_iqn_name = None {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] backend_defaults.storage_protocol = iSCSI {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] backend_defaults.target_helper = tgtadm {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] backend_defaults.target_ip_address = 192.168.122.55 {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] backend_defaults.target_port = 3260 {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:22:51 devstack cinder-volume[77572]: DEBUG oslo_concurrency.processutils [None req-0b5a966b-e442-4fd3-b700-cc6c2390590a None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.050s {{(pid=77572) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] backend_defaults.target_protocol = iscsi {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:22:51 devstack cinder-volume[77572]: DEBUG oslo_concurrency.processutils [None req-0b5a966b-e442-4fd3-b700-cc6c2390590a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=77572) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] backend_defaults.trace_flags = None {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] backend_defaults.unique_fqdn_network = True {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] backend_defaults.use_chap_auth = False {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] backend_defaults.volume_backend_name = None {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] backend_defaults.volume_clear = zero {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] backend_defaults.volume_clear_ionice = None {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] backend_defaults.volume_clear_size = 0 {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] backend_defaults.volume_group = cinder-volumes {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] oslo_reports.file_event_handler = None {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] oslo_reports.log_dir = None {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] lvmdriver-1.backend_availability_zone = None {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] lvmdriver-1.backend_host = None {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] lvmdriver-1.chap_password = **** {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] lvmdriver-1.chap_username = None {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] lvmdriver-1.chiscsi_conf = None {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] lvmdriver-1.disk_geometry = None {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] lvmdriver-1.driver_client_cert = None {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] lvmdriver-1.driver_client_cert_key = None {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] lvmdriver-1.driver_data_namespace = None {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] lvmdriver-1.driver_use_ssl = None {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] lvmdriver-1.extra_capabilities = None {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] lvmdriver-1.filter_function = None {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] lvmdriver-1.goodness_function = None {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] lvmdriver-1.iscsi_target_flags = None {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] lvmdriver-1.iscsi_write_cache = None {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] lvmdriver-1.iser_helper = None {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] lvmdriver-1.iser_ip_address = None {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] lvmdriver-1.iser_port = None {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] lvmdriver-1.iser_target_prefix = None {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] lvmdriver-1.lvm_conf_file = None {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] lvmdriver-1.lvm_mirrors = None {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] lvmdriver-1.lvm_share_target = None {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] lvmdriver-1.lvm_type = auto {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] lvmdriver-1.num_shell_tries = None {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] lvmdriver-1.nvmet_ns_id = None {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] lvmdriver-1.nvmet_port_id = None {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] lvmdriver-1.replication_device = **** {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] lvmdriver-1.report_discard_supported = None {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] lvmdriver-1.reserved_percentage = None {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] lvmdriver-1.scst_target_driver = None {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] lvmdriver-1.storage_protocol = None {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] lvmdriver-1.target_helper = lioadm {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] lvmdriver-1.target_ip_address = None {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] lvmdriver-1.target_port = 3260 {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] lvmdriver-1.target_protocol = iscsi {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] lvmdriver-1.trace_flags = None {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] lvmdriver-1.unique_fqdn_network = None {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] lvmdriver-1.use_chap_auth = None {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] lvmdriver-1.volume_clear = zero {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] lvmdriver-1.volume_clear_ionice = None {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] lvmdriver-1.volume_clear_size = None {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] lvmdriver-1.volumes_dir = None {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] oslo_messaging_rabbit.ssl = False {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] oslo_messaging_rabbit.ssl_version = {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] oslo_messaging_notifications.driver = [] {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] oslo_messaging_notifications.retry = -1 {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] oslo_messaging_notifications.transport_url = **** {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] key_manager.fixed_key = **** {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] barbican.barbican_api_version = None {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] barbican.barbican_endpoint = None {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] barbican.barbican_endpoint_type = public {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] barbican.barbican_region_name = None {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] barbican.cafile = None {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] barbican.certfile = None {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] barbican.collect_timing = False {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] barbican.insecure = False {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] barbican.keyfile = None {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] barbican.number_of_retries = 60 {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] barbican.retry_delay = 1 {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] barbican.send_service_user_token = False {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] barbican.split_loggers = False {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] barbican.timeout = None {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] barbican.verify_ssl = True {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] barbican.verify_ssl_path = None {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] barbican_service_user.auth_section = None {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] barbican_service_user.auth_type = None {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] barbican_service_user.cafile = None {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] barbican_service_user.certfile = None {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] barbican_service_user.collect_timing = False {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] barbican_service_user.insecure = False {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] barbican_service_user.keyfile = None {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] barbican_service_user.split_loggers = False {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] barbican_service_user.timeout = None {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] vault.approle_role_id = **** {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] vault.approle_secret_id = **** {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] vault.auth_method = approle {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] vault.auth_path = None {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] vault.kv_mountpoint = secret {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] vault.kv_path = None {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] vault.kv_version = 2 {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] vault.namespace = None {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] vault.root_token_id = **** {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] vault.ssl_ca_crt_file = None {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] vault.timeout = 60.0 {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] vault.token_file = None {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] vault.token_role = None {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] vault.use_ssl = False {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:22:51 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] ******************************************************************************** {{(pid=77411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Aug 03 08:22:51 devstack sudo[77576]: pam_unix(sudo:session): session closed for user root Aug 03 08:22:51 devstack cinder-volume[77572]: DEBUG oslo_concurrency.processutils [None req-0b5a966b-e442-4fd3-b700-cc6c2390590a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.416s {{(pid=77572) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:22:51 devstack cinder-volume[77572]: DEBUG oslo_concurrency.processutils [None req-0b5a966b-e442-4fd3-b700-cc6c2390590a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77572) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:22:51 devstack sudo[77691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 03 08:22:51 devstack sudo[77691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:22:51 devstack sudo[77691]: pam_unix(sudo:session): session closed for user root Aug 03 08:22:51 devstack cinder-volume[77572]: DEBUG oslo_concurrency.processutils [None req-0b5a966b-e442-4fd3-b700-cc6c2390590a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.258s {{(pid=77572) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:22:51 devstack cinder-volume[77572]: DEBUG oslo_concurrency.processutils [None req-0b5a966b-e442-4fd3-b700-cc6c2390590a None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=77572) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 03 08:22:51 devstack cinder-volume[77572]: INFO cinder.brick.local_dev.lvm [None req-0b5a966b-e442-4fd3-b700-cc6c2390590a None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Aug 03 08:22:51 devstack cinder-volume[77572]: DEBUG oslo_concurrency.processutils [None req-0b5a966b-e442-4fd3-b700-cc6c2390590a None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=77572) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:22:51 devstack cinder-volume[77572]: DEBUG oslo_concurrency.processutils [None req-0b5a966b-e442-4fd3-b700-cc6c2390590a None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.017s {{(pid=77572) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:22:51 devstack cinder-volume[77572]: DEBUG oslo_concurrency.processutils [None req-0b5a966b-e442-4fd3-b700-cc6c2390590a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=77572) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:22:51 devstack sudo[77796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Aug 03 08:22:51 devstack sudo[77796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:22:52 devstack sudo[77796]: pam_unix(sudo:session): session closed for user root Aug 03 08:22:52 devstack cinder-volume[77572]: DEBUG oslo_concurrency.processutils [None req-0b5a966b-e442-4fd3-b700-cc6c2390590a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.259s {{(pid=77572) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:22:52 devstack cinder-volume[77572]: DEBUG cinder.brick.local_dev.lvm [None req-0b5a966b-e442-4fd3-b700-cc6c2390590a None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=77572) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:567}} Aug 03 08:22:52 devstack cinder-volume[77572]: DEBUG oslo_concurrency.processutils [None req-0b5a966b-e442-4fd3-b700-cc6c2390590a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77572) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:22:52 devstack sudo[77881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 03 08:22:52 devstack sudo[77881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:22:52 devstack sudo[77881]: pam_unix(sudo:session): session closed for user root Aug 03 08:22:52 devstack cinder-volume[77572]: DEBUG oslo_concurrency.processutils [None req-0b5a966b-e442-4fd3-b700-cc6c2390590a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.507s {{(pid=77572) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:22:52 devstack cinder-volume[77572]: DEBUG oslo_concurrency.processutils [None req-0b5a966b-e442-4fd3-b700-cc6c2390590a None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=77572) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:22:52 devstack cinder-volume[77572]: DEBUG oslo_concurrency.processutils [None req-0b5a966b-e442-4fd3-b700-cc6c2390590a None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.020s {{(pid=77572) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:22:52 devstack cinder-volume[77572]: DEBUG oslo_concurrency.processutils [None req-0b5a966b-e442-4fd3-b700-cc6c2390590a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77572) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:22:52 devstack sudo[78079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 03 08:22:52 devstack sudo[78079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:22:53 devstack sudo[78079]: pam_unix(sudo:session): session closed for user root Aug 03 08:22:53 devstack cinder-volume[77572]: DEBUG oslo_concurrency.processutils [None req-0b5a966b-e442-4fd3-b700-cc6c2390590a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.328s {{(pid=77572) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:22:53 devstack cinder-volume[77572]: DEBUG oslo_concurrency.processutils [None req-0b5a966b-e442-4fd3-b700-cc6c2390590a None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=77572) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:22:53 devstack cinder-volume[77572]: DEBUG oslo_concurrency.processutils [None req-0b5a966b-e442-4fd3-b700-cc6c2390590a None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.020s {{(pid=77572) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:22:53 devstack cinder-volume[77572]: DEBUG oslo_concurrency.processutils [None req-0b5a966b-e442-4fd3-b700-cc6c2390590a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=77572) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:22:53 devstack sudo[78188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Aug 03 08:22:53 devstack sudo[78188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:22:53 devstack sudo[78188]: pam_unix(sudo:session): session closed for user root Aug 03 08:22:53 devstack cinder-volume[77572]: DEBUG oslo_concurrency.processutils [None req-0b5a966b-e442-4fd3-b700-cc6c2390590a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.266s {{(pid=77572) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:22:53 devstack cinder-volume[77572]: DEBUG oslo_concurrency.processutils [None req-0b5a966b-e442-4fd3-b700-cc6c2390590a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=77572) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:22:53 devstack sudo[78191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Aug 03 08:22:53 devstack sudo[78191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:22:53 devstack sudo[78191]: pam_unix(sudo:session): session closed for user root Aug 03 08:22:53 devstack cinder-volume[77572]: DEBUG oslo_concurrency.processutils [None req-0b5a966b-e442-4fd3-b700-cc6c2390590a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.362s {{(pid=77572) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:22:53 devstack cinder-volume[77572]: DEBUG oslo_concurrency.processutils [None req-0b5a966b-e442-4fd3-b700-cc6c2390590a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=77572) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:22:53 devstack sudo[78275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Aug 03 08:22:53 devstack sudo[78275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:22:54 devstack sudo[78275]: pam_unix(sudo:session): session closed for user root Aug 03 08:22:54 devstack cinder-volume[77572]: DEBUG oslo_concurrency.processutils [None req-0b5a966b-e442-4fd3-b700-cc6c2390590a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.272s {{(pid=77572) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:22:54 devstack cinder-volume[77572]: DEBUG oslo_concurrency.processutils [None req-0b5a966b-e442-4fd3-b700-cc6c2390590a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77572) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:22:54 devstack sudo[78278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 03 08:22:54 devstack sudo[78278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:22:54 devstack sudo[78278]: pam_unix(sudo:session): session closed for user root Aug 03 08:22:54 devstack cinder-volume[77572]: DEBUG oslo_concurrency.processutils [None req-0b5a966b-e442-4fd3-b700-cc6c2390590a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.354s {{(pid=77572) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:22:54 devstack cinder-volume[77572]: DEBUG oslo_concurrency.processutils [None req-0b5a966b-e442-4fd3-b700-cc6c2390590a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77572) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:22:54 devstack sudo[78349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 03 08:22:54 devstack sudo[78349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:22:54 devstack sudo[78349]: pam_unix(sudo:session): session closed for user root Aug 03 08:22:54 devstack cinder-volume[77572]: DEBUG oslo_concurrency.processutils [None req-0b5a966b-e442-4fd3-b700-cc6c2390590a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.273s {{(pid=77572) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:22:54 devstack cinder-volume[77572]: DEBUG oslo_concurrency.processutils [None req-0b5a966b-e442-4fd3-b700-cc6c2390590a None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=77572) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:22:54 devstack cinder-volume[77572]: DEBUG oslo_concurrency.processutils [None req-0b5a966b-e442-4fd3-b700-cc6c2390590a None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.018s {{(pid=77572) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:22:54 devstack cinder-volume[77572]: DEBUG oslo_concurrency.processutils [None req-0b5a966b-e442-4fd3-b700-cc6c2390590a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77572) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:22:54 devstack sudo[78371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 03 08:22:54 devstack sudo[78371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:22:54 devstack sudo[78371]: pam_unix(sudo:session): session closed for user root Aug 03 08:22:54 devstack cinder-volume[77572]: DEBUG oslo_concurrency.processutils [None req-0b5a966b-e442-4fd3-b700-cc6c2390590a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.242s {{(pid=77572) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:22:54 devstack cinder-volume[77572]: INFO cinder.volume.drivers.lvm [None req-0b5a966b-e442-4fd3-b700-cc6c2390590a None None] Enabling LVM thin provisioning by default because a thin pool exists. Aug 03 08:22:54 devstack cinder-volume[77572]: DEBUG oslo_concurrency.processutils [None req-0b5a966b-e442-4fd3-b700-cc6c2390590a None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=77572) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:22:54 devstack cinder-volume[77572]: DEBUG oslo_concurrency.processutils [None req-0b5a966b-e442-4fd3-b700-cc6c2390590a None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.019s {{(pid=77572) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:22:54 devstack cinder-volume[77572]: DEBUG oslo_concurrency.processutils [None req-0b5a966b-e442-4fd3-b700-cc6c2390590a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77572) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:22:54 devstack sudo[78375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 03 08:22:54 devstack sudo[78375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:22:55 devstack sudo[78375]: pam_unix(sudo:session): session closed for user root Aug 03 08:22:55 devstack cinder-volume[77572]: DEBUG oslo_concurrency.processutils [None req-0b5a966b-e442-4fd3-b700-cc6c2390590a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.295s {{(pid=77572) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:22:55 devstack cinder-volume[77572]: DEBUG cinder.volume.drivers.lvm [None req-0b5a966b-e442-4fd3-b700-cc6c2390590a None None] Updating volume stats {{(pid=77572) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Aug 03 08:22:55 devstack cinder-volume[77572]: DEBUG oslo_concurrency.processutils [None req-0b5a966b-e442-4fd3-b700-cc6c2390590a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=77572) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:22:55 devstack sudo[78378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Aug 03 08:22:55 devstack sudo[78378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:22:55 devstack sudo[78378]: pam_unix(sudo:session): session closed for user root Aug 03 08:22:55 devstack cinder-volume[77572]: DEBUG oslo_concurrency.processutils [None req-0b5a966b-e442-4fd3-b700-cc6c2390590a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.256s {{(pid=77572) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:22:55 devstack cinder-volume[77572]: DEBUG oslo_concurrency.processutils [None req-0b5a966b-e442-4fd3-b700-cc6c2390590a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77572) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:22:55 devstack sudo[78381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 03 08:22:55 devstack sudo[78381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:22:55 devstack sudo[78381]: pam_unix(sudo:session): session closed for user root Aug 03 08:22:55 devstack cinder-volume[77572]: DEBUG oslo_concurrency.processutils [None req-0b5a966b-e442-4fd3-b700-cc6c2390590a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.275s {{(pid=77572) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:22:55 devstack cinder-volume[77572]: DEBUG oslo_concurrency.processutils [None req-0b5a966b-e442-4fd3-b700-cc6c2390590a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77572) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:22:55 devstack sudo[78390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 03 08:22:55 devstack sudo[78390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:22:56 devstack sudo[78390]: pam_unix(sudo:session): session closed for user root Aug 03 08:22:56 devstack cinder-volume[77572]: DEBUG oslo_concurrency.processutils [None req-0b5a966b-e442-4fd3-b700-cc6c2390590a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.246s {{(pid=77572) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:22:56 devstack cinder-volume[77572]: DEBUG oslo_concurrency.processutils [None req-0b5a966b-e442-4fd3-b700-cc6c2390590a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77572) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:22:56 devstack sudo[78393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 03 08:22:56 devstack sudo[78393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:22:56 devstack sudo[78393]: pam_unix(sudo:session): session closed for user root Aug 03 08:22:56 devstack cinder-volume[77572]: DEBUG oslo_concurrency.processutils [None req-0b5a966b-e442-4fd3-b700-cc6c2390590a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.262s {{(pid=77572) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:22:56 devstack cinder-volume[77572]: INFO cinder.volume.driver [None req-0b5a966b-e442-4fd3-b700-cc6c2390590a None None] Driver hasn't implemented _init_vendor_properties() Aug 03 08:22:56 devstack cinder-volume[77572]: DEBUG cinder.volume.driver [None req-0b5a966b-e442-4fd3-b700-cc6c2390590a None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=77572) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Aug 03 08:22:56 devstack cinder-volume[77572]: DEBUG oslo_db.sqlalchemy.engines [None req-0b5a966b-e442-4fd3-b700-cc6c2390590a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=77572) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 03 08:22:56 devstack cinder-volume[77572]: DEBUG dbcounter [-] [77572] Writer thread running {{(pid=77572) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Aug 03 08:22:56 devstack cinder-volume[77572]: DEBUG cinder.db.api [None req-0b5a966b-e442-4fd3-b700-cc6c2390590a None None] Building query based on filter {{(pid=77572) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Aug 03 08:22:56 devstack cinder-volume[77572]: DEBUG cinder.image.image_utils [None req-0b5a966b-e442-4fd3-b700-cc6c2390590a None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=77572) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Aug 03 08:22:56 devstack cinder-volume[77572]: INFO cinder.keymgr.migration [None req-61a48d62-d3af-4622-982c-6907584fae43 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Aug 03 08:22:56 devstack cinder-volume[77572]: DEBUG cinder.volume.drivers.lvm [None req-0b5a966b-e442-4fd3-b700-cc6c2390590a None None] Updating volume stats {{(pid=77572) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Aug 03 08:22:56 devstack cinder-volume[77572]: DEBUG oslo_concurrency.processutils [None req-0b5a966b-e442-4fd3-b700-cc6c2390590a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=77572) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:22:56 devstack sudo[78396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Aug 03 08:22:56 devstack sudo[78396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:22:56 devstack sudo[78396]: pam_unix(sudo:session): session closed for user root Aug 03 08:22:56 devstack cinder-volume[77572]: DEBUG oslo_concurrency.processutils [None req-0b5a966b-e442-4fd3-b700-cc6c2390590a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.264s {{(pid=77572) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:22:56 devstack cinder-volume[77572]: DEBUG oslo_concurrency.processutils [None req-0b5a966b-e442-4fd3-b700-cc6c2390590a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77572) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:22:56 devstack sudo[78402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 03 08:22:56 devstack sudo[78402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:22:56 devstack sudo[78402]: pam_unix(sudo:session): session closed for user root Aug 03 08:22:56 devstack cinder-volume[77572]: DEBUG oslo_concurrency.processutils [None req-0b5a966b-e442-4fd3-b700-cc6c2390590a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.263s {{(pid=77572) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:22:56 devstack cinder-volume[77572]: DEBUG oslo_concurrency.processutils [None req-0b5a966b-e442-4fd3-b700-cc6c2390590a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77572) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:22:56 devstack sudo[78406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 03 08:22:56 devstack sudo[78406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:22:57 devstack sudo[78406]: pam_unix(sudo:session): session closed for user root Aug 03 08:22:57 devstack cinder-volume[77572]: DEBUG oslo_concurrency.processutils [None req-0b5a966b-e442-4fd3-b700-cc6c2390590a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.299s {{(pid=77572) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:22:57 devstack cinder-volume[77572]: DEBUG oslo_concurrency.processutils [None req-0b5a966b-e442-4fd3-b700-cc6c2390590a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77572) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:22:57 devstack sudo[78409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 03 08:22:57 devstack sudo[78409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:22:57 devstack sudo[78409]: pam_unix(sudo:session): session closed for user root Aug 03 08:22:57 devstack cinder-volume[77572]: DEBUG oslo_concurrency.processutils [None req-0b5a966b-e442-4fd3-b700-cc6c2390590a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.262s {{(pid=77572) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:22:57 devstack cinder-volume[77572]: DEBUG cinder.manager [None req-0b5a966b-e442-4fd3-b700-cc6c2390590a None None] Notifying Schedulers of capabilities ... {{(pid=77572) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 08:22:57 devstack cinder-volume[77572]: INFO cinder.volume.manager [None req-0b5a966b-e442-4fd3-b700-cc6c2390590a None None] Driver initialization completed successfully. Aug 03 08:22:57 devstack cinder-volume[77572]: INFO cinder.manager [None req-0b5a966b-e442-4fd3-b700-cc6c2390590a None None] Initiating service 2 cleanup Aug 03 08:22:57 devstack cinder-volume[77572]: INFO cinder.manager [None req-0b5a966b-e442-4fd3-b700-cc6c2390590a None None] Service 2 cleanup completed. Aug 03 08:22:57 devstack cinder-volume[77572]: DEBUG cinder.service [None req-0b5a966b-e442-4fd3-b700-cc6c2390590a None None] Creating RPC server for service cinder-volume {{(pid=77572) start /opt/stack/cinder/cinder/service.py:231}} Aug 03 08:22:57 devstack cinder-volume[77572]: DEBUG cinder.service [None req-0b5a966b-e442-4fd3-b700-cc6c2390590a None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=77572) start /opt/stack/cinder/cinder/service.py:237}} Aug 03 08:22:57 devstack cinder-volume[77572]: INFO cinder.volume.manager [None req-0b5a966b-e442-4fd3-b700-cc6c2390590a None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Aug 03 08:22:57 devstack cinder-volume[77572]: DEBUG cinder.volume.drivers.lvm [None req-0b5a966b-e442-4fd3-b700-cc6c2390590a None None] Updating volume stats {{(pid=77572) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Aug 03 08:22:57 devstack cinder-volume[77572]: DEBUG oslo_concurrency.processutils [None req-0b5a966b-e442-4fd3-b700-cc6c2390590a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=77572) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:22:57 devstack sudo[78414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Aug 03 08:22:57 devstack sudo[78414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:22:57 devstack sudo[78414]: pam_unix(sudo:session): session closed for user root Aug 03 08:22:57 devstack cinder-volume[77572]: DEBUG oslo_concurrency.processutils [None req-0b5a966b-e442-4fd3-b700-cc6c2390590a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.280s {{(pid=77572) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:22:57 devstack cinder-volume[77572]: DEBUG oslo_concurrency.processutils [None req-0b5a966b-e442-4fd3-b700-cc6c2390590a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77572) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:22:58 devstack sudo[78417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 03 08:22:58 devstack sudo[78417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:22:58 devstack sudo[78417]: pam_unix(sudo:session): session closed for user root Aug 03 08:22:58 devstack cinder-volume[77572]: DEBUG oslo_concurrency.processutils [None req-0b5a966b-e442-4fd3-b700-cc6c2390590a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.279s {{(pid=77572) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:22:58 devstack cinder-volume[77572]: DEBUG oslo_concurrency.processutils [None req-0b5a966b-e442-4fd3-b700-cc6c2390590a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77572) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:22:58 devstack sudo[78420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 03 08:22:58 devstack sudo[78420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:22:58 devstack sudo[78420]: pam_unix(sudo:session): session closed for user root Aug 03 08:22:58 devstack cinder-volume[77572]: DEBUG oslo_concurrency.processutils [None req-0b5a966b-e442-4fd3-b700-cc6c2390590a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.262s {{(pid=77572) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:22:58 devstack cinder-volume[77572]: DEBUG oslo_concurrency.processutils [None req-0b5a966b-e442-4fd3-b700-cc6c2390590a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77572) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:22:58 devstack sudo[78423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 03 08:22:58 devstack sudo[78423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:22:58 devstack sudo[78423]: pam_unix(sudo:session): session closed for user root Aug 03 08:22:58 devstack cinder-volume[77572]: DEBUG oslo_concurrency.processutils [None req-0b5a966b-e442-4fd3-b700-cc6c2390590a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.251s {{(pid=77572) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:22:58 devstack cinder-volume[77572]: INFO cinder.volume.manager [None req-0b5a966b-e442-4fd3-b700-cc6c2390590a None None] Driver post RPC initialization completed successfully. Aug 03 08:23:01 devstack cinder-volume[77411]: DEBUG dbcounter [-] [77411] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=77411) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 03 08:23:01 devstack cinder-volume[77572]: DEBUG oslo_service.periodic_task [None req-b722a15c-4d77-411d-94cb-712d6a1a6c55 None None] Running periodic task VolumeManager._thread_info {{(pid=77572) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 03 08:23:01 devstack cinder-volume[77572]: DEBUG cinder.volume.manager [None req-b722a15c-4d77-411d-94cb-712d6a1a6c55 None None] thread count: 6 {{(pid=77572) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 03 08:23:01 devstack cinder-volume[77572]: DEBUG cinder.volume.manager [None req-b722a15c-4d77-411d-94cb-712d6a1a6c55 None None] thread info: [<_MainThread(MainThread, started 125153227104384)>, , , , , ] {{(pid=77572) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 03 08:23:08 devstack cinder-volume[77572]: DEBUG dbcounter [-] [77572] Writing DB stats cinder:SELECT=3 {{(pid=77572) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 03 08:23:08 devstack cinder-volume[77572]: DEBUG dbcounter [-] [77572] Writing DB stats cinder:SELECT=11,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=77572) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 03 08:24:01 devstack cinder-volume[77572]: DEBUG oslo_service.periodic_task [None req-b722a15c-4d77-411d-94cb-712d6a1a6c55 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=77572) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 03 08:24:01 devstack cinder-volume[77572]: DEBUG cinder.volume.drivers.lvm [None req-b722a15c-4d77-411d-94cb-712d6a1a6c55 None None] Updating volume stats {{(pid=77572) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Aug 03 08:24:01 devstack cinder-volume[77572]: DEBUG oslo_concurrency.processutils [None req-b722a15c-4d77-411d-94cb-712d6a1a6c55 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=77572) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:24:01 devstack sudo[80449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Aug 03 08:24:01 devstack sudo[80449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:24:02 devstack sudo[80449]: pam_unix(sudo:session): session closed for user root Aug 03 08:24:02 devstack cinder-volume[77572]: DEBUG oslo_concurrency.processutils [None req-b722a15c-4d77-411d-94cb-712d6a1a6c55 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.261s {{(pid=77572) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:24:02 devstack cinder-volume[77572]: DEBUG oslo_concurrency.processutils [None req-b722a15c-4d77-411d-94cb-712d6a1a6c55 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77572) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:24:02 devstack sudo[80452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 03 08:24:02 devstack sudo[80452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:24:02 devstack sudo[80452]: pam_unix(sudo:session): session closed for user root Aug 03 08:24:02 devstack cinder-volume[77572]: DEBUG oslo_concurrency.processutils [None req-b722a15c-4d77-411d-94cb-712d6a1a6c55 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.262s {{(pid=77572) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:24:02 devstack cinder-volume[77572]: DEBUG oslo_concurrency.processutils [None req-b722a15c-4d77-411d-94cb-712d6a1a6c55 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77572) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:24:02 devstack sudo[80455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 03 08:24:02 devstack sudo[80455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:24:02 devstack sudo[80455]: pam_unix(sudo:session): session closed for user root Aug 03 08:24:02 devstack cinder-volume[77572]: DEBUG oslo_concurrency.processutils [None req-b722a15c-4d77-411d-94cb-712d6a1a6c55 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.260s {{(pid=77572) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:24:02 devstack cinder-volume[77572]: DEBUG oslo_concurrency.processutils [None req-b722a15c-4d77-411d-94cb-712d6a1a6c55 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77572) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:24:02 devstack sudo[80458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 03 08:24:02 devstack sudo[80458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:24:02 devstack sudo[80458]: pam_unix(sudo:session): session closed for user root Aug 03 08:24:02 devstack cinder-volume[77572]: DEBUG oslo_concurrency.processutils [None req-b722a15c-4d77-411d-94cb-712d6a1a6c55 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.260s {{(pid=77572) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:24:02 devstack cinder-volume[77572]: DEBUG cinder.manager [None req-b722a15c-4d77-411d-94cb-712d6a1a6c55 None None] Notifying Schedulers of capabilities ... {{(pid=77572) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 08:24:02 devstack cinder-volume[77572]: DEBUG oslo_service.periodic_task [None req-b722a15c-4d77-411d-94cb-712d6a1a6c55 None None] Running periodic task VolumeManager._thread_info {{(pid=77572) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 03 08:24:02 devstack cinder-volume[77572]: DEBUG cinder.volume.manager [None req-b722a15c-4d77-411d-94cb-712d6a1a6c55 None None] thread count: 6 {{(pid=77572) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 03 08:24:02 devstack cinder-volume[77572]: DEBUG cinder.volume.manager [None req-b722a15c-4d77-411d-94cb-712d6a1a6c55 None None] thread info: [<_MainThread(MainThread, started 125153227104384)>, , , , , ] {{(pid=77572) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 03 08:25:01 devstack cinder-volume[77572]: DEBUG oslo_service.periodic_task [None req-b722a15c-4d77-411d-94cb-712d6a1a6c55 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=77572) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 03 08:25:01 devstack cinder-volume[77572]: DEBUG cinder.volume.drivers.lvm [None req-b722a15c-4d77-411d-94cb-712d6a1a6c55 None None] Updating volume stats {{(pid=77572) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Aug 03 08:25:01 devstack cinder-volume[77572]: DEBUG oslo_concurrency.processutils [None req-b722a15c-4d77-411d-94cb-712d6a1a6c55 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=77572) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:25:01 devstack sudo[83833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Aug 03 08:25:01 devstack sudo[83833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:25:02 devstack sudo[83833]: pam_unix(sudo:session): session closed for user root Aug 03 08:25:02 devstack cinder-volume[77572]: DEBUG oslo_concurrency.processutils [None req-b722a15c-4d77-411d-94cb-712d6a1a6c55 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.242s {{(pid=77572) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:25:02 devstack cinder-volume[77572]: DEBUG oslo_concurrency.processutils [None req-b722a15c-4d77-411d-94cb-712d6a1a6c55 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77572) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:25:02 devstack sudo[83836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 03 08:25:02 devstack sudo[83836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:25:02 devstack sudo[83836]: pam_unix(sudo:session): session closed for user root Aug 03 08:25:02 devstack cinder-volume[77572]: DEBUG oslo_concurrency.processutils [None req-b722a15c-4d77-411d-94cb-712d6a1a6c55 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.254s {{(pid=77572) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:25:02 devstack cinder-volume[77572]: DEBUG oslo_concurrency.processutils [None req-b722a15c-4d77-411d-94cb-712d6a1a6c55 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77572) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:25:02 devstack sudo[83840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 03 08:25:02 devstack sudo[83840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:25:02 devstack sudo[83840]: pam_unix(sudo:session): session closed for user root Aug 03 08:25:02 devstack cinder-volume[77572]: DEBUG oslo_concurrency.processutils [None req-b722a15c-4d77-411d-94cb-712d6a1a6c55 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.242s {{(pid=77572) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:25:02 devstack cinder-volume[77572]: DEBUG oslo_concurrency.processutils [None req-b722a15c-4d77-411d-94cb-712d6a1a6c55 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77572) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:25:02 devstack sudo[83843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 03 08:25:02 devstack sudo[83843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:25:02 devstack sudo[83843]: pam_unix(sudo:session): session closed for user root Aug 03 08:25:02 devstack cinder-volume[77572]: DEBUG oslo_concurrency.processutils [None req-b722a15c-4d77-411d-94cb-712d6a1a6c55 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.251s {{(pid=77572) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:25:02 devstack cinder-volume[77572]: DEBUG cinder.manager [None req-b722a15c-4d77-411d-94cb-712d6a1a6c55 None None] Notifying Schedulers of capabilities ... {{(pid=77572) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 08:25:02 devstack cinder-volume[77572]: DEBUG oslo_service.periodic_task [None req-b722a15c-4d77-411d-94cb-712d6a1a6c55 None None] Running periodic task VolumeManager._thread_info {{(pid=77572) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 03 08:25:02 devstack cinder-volume[77572]: DEBUG cinder.volume.manager [None req-b722a15c-4d77-411d-94cb-712d6a1a6c55 None None] thread count: 6 {{(pid=77572) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 03 08:25:02 devstack cinder-volume[77572]: DEBUG cinder.volume.manager [None req-b722a15c-4d77-411d-94cb-712d6a1a6c55 None None] thread info: [<_MainThread(MainThread, started 125153227104384)>, , , , , ] {{(pid=77572) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 03 08:25:08 devstack cinder-volume[77572]: DEBUG dbcounter [-] [77572] Writing DB stats cinder:SELECT=1 {{(pid=77572) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 03 08:25:08 devstack cinder-volume[77572]: DEBUG dbcounter [-] [77572] Writing DB stats cinder:UPDATE=1 {{(pid=77572) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 03 08:26:01 devstack cinder-volume[77572]: DEBUG oslo_service.periodic_task [None req-b722a15c-4d77-411d-94cb-712d6a1a6c55 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=77572) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 03 08:26:01 devstack cinder-volume[77572]: DEBUG cinder.volume.drivers.lvm [None req-b722a15c-4d77-411d-94cb-712d6a1a6c55 None None] Updating volume stats {{(pid=77572) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Aug 03 08:26:01 devstack cinder-volume[77572]: DEBUG oslo_concurrency.processutils [None req-b722a15c-4d77-411d-94cb-712d6a1a6c55 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=77572) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:26:01 devstack sudo[86279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Aug 03 08:26:01 devstack sudo[86279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:26:02 devstack sudo[86279]: pam_unix(sudo:session): session closed for user root Aug 03 08:26:02 devstack cinder-volume[77572]: DEBUG oslo_concurrency.processutils [None req-b722a15c-4d77-411d-94cb-712d6a1a6c55 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.294s {{(pid=77572) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:26:02 devstack cinder-volume[77572]: DEBUG oslo_concurrency.processutils [None req-b722a15c-4d77-411d-94cb-712d6a1a6c55 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77572) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:26:02 devstack sudo[86305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 03 08:26:02 devstack sudo[86305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:26:02 devstack sudo[86305]: pam_unix(sudo:session): session closed for user root Aug 03 08:26:02 devstack cinder-volume[77572]: DEBUG oslo_concurrency.processutils [None req-b722a15c-4d77-411d-94cb-712d6a1a6c55 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.257s {{(pid=77572) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:26:02 devstack cinder-volume[77572]: DEBUG oslo_concurrency.processutils [None req-b722a15c-4d77-411d-94cb-712d6a1a6c55 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77572) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:26:02 devstack sudo[86308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 03 08:26:02 devstack sudo[86308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:26:02 devstack sudo[86308]: pam_unix(sudo:session): session closed for user root Aug 03 08:26:02 devstack cinder-volume[77572]: DEBUG oslo_concurrency.processutils [None req-b722a15c-4d77-411d-94cb-712d6a1a6c55 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.259s {{(pid=77572) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:26:02 devstack cinder-volume[77572]: DEBUG oslo_concurrency.processutils [None req-b722a15c-4d77-411d-94cb-712d6a1a6c55 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77572) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:26:02 devstack sudo[86314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 03 08:26:02 devstack sudo[86314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:26:02 devstack sudo[86314]: pam_unix(sudo:session): session closed for user root Aug 03 08:26:02 devstack cinder-volume[77572]: DEBUG oslo_concurrency.processutils [None req-b722a15c-4d77-411d-94cb-712d6a1a6c55 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.252s {{(pid=77572) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:26:02 devstack cinder-volume[77572]: DEBUG cinder.manager [None req-b722a15c-4d77-411d-94cb-712d6a1a6c55 None None] Notifying Schedulers of capabilities ... {{(pid=77572) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 08:26:02 devstack cinder-volume[77572]: DEBUG oslo_service.periodic_task [None req-b722a15c-4d77-411d-94cb-712d6a1a6c55 None None] Running periodic task VolumeManager._thread_info {{(pid=77572) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 03 08:26:02 devstack cinder-volume[77572]: DEBUG cinder.volume.manager [None req-b722a15c-4d77-411d-94cb-712d6a1a6c55 None None] thread count: 6 {{(pid=77572) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 03 08:26:02 devstack cinder-volume[77572]: DEBUG cinder.volume.manager [None req-b722a15c-4d77-411d-94cb-712d6a1a6c55 None None] thread info: [<_MainThread(MainThread, started 125153227104384)>, , , , , ] {{(pid=77572) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 03 08:27:01 devstack cinder-volume[77572]: DEBUG oslo_service.periodic_task [None req-b722a15c-4d77-411d-94cb-712d6a1a6c55 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=77572) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 03 08:27:01 devstack cinder-volume[77572]: DEBUG cinder.volume.drivers.lvm [None req-b722a15c-4d77-411d-94cb-712d6a1a6c55 None None] Updating volume stats {{(pid=77572) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Aug 03 08:27:01 devstack cinder-volume[77572]: DEBUG oslo_concurrency.processutils [None req-b722a15c-4d77-411d-94cb-712d6a1a6c55 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=77572) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:27:01 devstack sudo[87621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Aug 03 08:27:01 devstack sudo[87621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:27:02 devstack sudo[87621]: pam_unix(sudo:session): session closed for user root Aug 03 08:27:02 devstack cinder-volume[77572]: DEBUG oslo_concurrency.processutils [None req-b722a15c-4d77-411d-94cb-712d6a1a6c55 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.262s {{(pid=77572) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:27:02 devstack cinder-volume[77572]: DEBUG oslo_concurrency.processutils [None req-b722a15c-4d77-411d-94cb-712d6a1a6c55 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77572) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:27:02 devstack sudo[87625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 03 08:27:02 devstack sudo[87625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:27:02 devstack sudo[87625]: pam_unix(sudo:session): session closed for user root Aug 03 08:27:02 devstack cinder-volume[77572]: DEBUG oslo_concurrency.processutils [None req-b722a15c-4d77-411d-94cb-712d6a1a6c55 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.263s {{(pid=77572) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:27:02 devstack cinder-volume[77572]: DEBUG oslo_concurrency.processutils [None req-b722a15c-4d77-411d-94cb-712d6a1a6c55 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77572) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:27:02 devstack sudo[87628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 03 08:27:02 devstack sudo[87628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:27:02 devstack sudo[87628]: pam_unix(sudo:session): session closed for user root Aug 03 08:27:02 devstack cinder-volume[77572]: DEBUG oslo_concurrency.processutils [None req-b722a15c-4d77-411d-94cb-712d6a1a6c55 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.244s {{(pid=77572) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:27:02 devstack cinder-volume[77572]: DEBUG oslo_concurrency.processutils [None req-b722a15c-4d77-411d-94cb-712d6a1a6c55 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77572) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:27:02 devstack sudo[87642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 03 08:27:02 devstack sudo[87642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:27:02 devstack sudo[87642]: pam_unix(sudo:session): session closed for user root Aug 03 08:27:02 devstack cinder-volume[77572]: DEBUG oslo_concurrency.processutils [None req-b722a15c-4d77-411d-94cb-712d6a1a6c55 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.268s {{(pid=77572) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:27:02 devstack cinder-volume[77572]: DEBUG cinder.manager [None req-b722a15c-4d77-411d-94cb-712d6a1a6c55 None None] Notifying Schedulers of capabilities ... {{(pid=77572) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 08:27:08 devstack cinder-volume[77572]: DEBUG dbcounter [-] [77572] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=77572) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 03 08:27:18 devstack cinder-volume[77411]: INFO oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] Caught SIGTERM, stopping children Aug 03 08:27:18 devstack cinder-volume[77411]: DEBUG oslo_concurrency.lockutils [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] Acquiring lock "singleton_lock" {{(pid=77411) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Aug 03 08:27:18 devstack cinder-volume[77411]: DEBUG oslo_concurrency.lockutils [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] Acquired lock "singleton_lock" {{(pid=77411) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Aug 03 08:27:18 devstack cinder-volume[77411]: DEBUG oslo_concurrency.lockutils [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] Releasing lock "singleton_lock" {{(pid=77411) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Aug 03 08:27:18 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] Stop services. {{(pid=77411) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Aug 03 08:27:18 devstack cinder-volume[77411]: DEBUG oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] Killing children. {{(pid=77411) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Aug 03 08:27:18 devstack cinder-volume[77411]: INFO oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] Waiting on 1 children to exit Aug 03 08:27:22 devstack cinder-volume[77572]: DEBUG oslo_concurrency.lockutils [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] Acquiring lock "singleton_lock" {{(pid=77572) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Aug 03 08:27:22 devstack cinder-volume[77572]: DEBUG oslo_concurrency.lockutils [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] Acquired lock "singleton_lock" {{(pid=77572) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Aug 03 08:27:22 devstack cinder-volume[77572]: DEBUG oslo_concurrency.lockutils [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] Releasing lock "singleton_lock" {{(pid=77572) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Aug 03 08:27:22 devstack cinder-volume[77572]: WARNING amqp [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] Received method (60, 30) during closing channel 1. This method will be ignored Aug 03 08:27:22 devstack cinder-volume[77572]: WARNING amqp [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] Received method (60, 30) during closing channel 1. This method will be ignored Aug 03 08:27:22 devstack cinder-volume[77411]: INFO oslo_service.backend._eventlet.service [None req-5d55b25d-e302-47f7-bef7-c3399991e115 None None] Child 77572 exited with status 0 Aug 03 08:27:23 devstack cinder-volume[88098]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Aug 03 08:27:23 devstack cinder-volume[88098]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Aug 03 08:27:23 devstack cinder-volume[88098]: we strongly recommend against using it for new projects. Aug 03 08:27:23 devstack cinder-volume[88098]: If you are already using Eventlet, we recommend migrating to a different Aug 03 08:27:23 devstack cinder-volume[88098]: framework. For more detail see Aug 03 08:27:23 devstack cinder-volume[88098]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Aug 03 08:27:23 devstack cinder-volume[88098]: import eventlet # noqa Aug 03 08:27:25 devstack cinder-volume[88098]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=88098) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Aug 03 08:27:25 devstack cinder-volume[88098]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=88098) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Aug 03 08:27:25 devstack cinder-volume[88098]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=88098) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Aug 03 08:27:25 devstack cinder-volume[88098]: INFO dbcounter [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] Registered counter for database cinder Aug 03 08:27:25 devstack cinder-volume[88098]: DEBUG oslo_db.sqlalchemy.engines [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=88098) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 03 08:27:26 devstack cinder-volume[88098]: DEBUG dbcounter [-] [88098] Writer thread running {{(pid=88098) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Aug 03 08:27:26 devstack cinder-volume[88098]: INFO cinder.rpc [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Aug 03 08:27:26 devstack cinder-volume[88098]: INFO cinder.rpc [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Aug 03 08:27:26 devstack cinder-volume[88098]: DEBUG oslo_db.sqlalchemy.engines [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=88098) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 03 08:27:26 devstack cinder-volume[88098]: INFO cinder.volume.manager [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] Determined volume DB was empty at startup. Aug 03 08:27:26 devstack cinder-volume[88098]: DEBUG cinder.volume.manager [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=88098) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Aug 03 08:27:26 devstack cinder-volume[88098]: INFO cinder.volume.manager [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] Service not found for updating active_backend_id, assuming default for driver init. Aug 03 08:27:26 devstack cinder-volume[88098]: WARNING stevedore.named [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Aug 03 08:27:26 devstack cinder-volume[88098]: WARNING castellan.key_manager [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Aug 03 08:27:26 devstack cinder-volume[88098]: WARNING cinder.keymgr.conf_key_mgr [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Aug 03 08:27:26 devstack cinder-volume[88098]: INFO cinder.volume.manager [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] Image-volume cache disabled for host devstack@QuobyteHD. Aug 03 08:27:26 devstack cinder-volume[88098]: DEBUG oslo_db.sqlalchemy.engines [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=88098) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 03 08:27:26 devstack cinder-volume[88098]: INFO oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] Starting 1 workers Aug 03 08:27:26 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] Started child 88312 {{(pid=88098) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Aug 03 08:27:26 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] Full set of CONF: {{(pid=88098) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Aug 03 08:27:26 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] ******************************************************************************** {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Aug 03 08:27:26 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] Configuration options gathered from: {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Aug 03 08:27:26 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Aug 03 08:27:26 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Aug 03 08:27:26 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] ================================================================================ {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Aug 03 08:27:26 devstack cinder-volume[88312]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Aug 03 08:27:26 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] allow_availability_zone_fallback = False {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:27:26 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] allow_compression_on_image_upload = False {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:27:26 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] allowed_direct_url_schemes = [] {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:27:26 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] api_rate_limit = True {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:27:26 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] auth_strategy = keystone {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:27:26 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] backend_availability_zone = None {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:27:26 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] backend_host = None {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:27:26 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] backend_name = None {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:27:26 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] backend_stats_polling_interval = 60 {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:27:26 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] backup_api_class = cinder.backup.api.API {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:27:26 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:27:26 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] backup_name_template = backup-%s {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:27:26 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] backup_use_same_host = False {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:27:26 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] backup_use_temp_snapshot = False {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:27:26 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] chap_password = **** {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:27:26 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] chap_username = {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:27:26 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:27:26 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] cinder_internal_tenant_project_id = a9c7a894fc7a45e8bd418eaaef586b5d {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:27:26 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] cinder_internal_tenant_user_id = 2af68c9d2740481681db96f147575d58 {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:27:26 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] cluster = None {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:27:26 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] compression_format = gzip {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:27:26 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] compute_api_class = cinder.compute.nova.API {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:27:26 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] config_dir = [] {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:27:26 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:27:26 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] config_source = [] {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:27:26 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:27:26 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] control_exchange = openstack {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:27:26 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] debug = True {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:27:26 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] default_availability_zone = None {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:27:26 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] default_group_type = None {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:27:26 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:27:26 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] default_volume_type = QuobyteHD {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:27:26 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] disk_geometry = None {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:27:26 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] driver_client_cert = None {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:27:26 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] driver_client_cert_key = None {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:27:26 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] driver_data_namespace = None {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:27:26 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] driver_ssl_cert_path = None {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:27:26 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] driver_ssl_cert_verify = False {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:27:26 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] driver_use_ssl = False {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:27:26 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] enable_new_services = True {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:27:26 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] enable_unsupported_driver = False {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:27:26 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] enabled_backends = ['QuobyteHD'] {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:27:26 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] enforce_multipath_for_image_xfer = False {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:27:26 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] filter_function = None {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:27:26 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] glance_api_insecure = False {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:27:26 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] glance_api_servers = ['http://192.168.122.55/image'] {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:27:26 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] glance_api_ssl_compression = False {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:27:26 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] glance_ca_certificates_file = None {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:27:26 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] glance_catalog_info = image:glance:publicURL {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:27:26 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] glance_certfile = None {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:27:26 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:27:26 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] glance_keyfile = None {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:27:26 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] glance_num_retries = 3 {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:27:26 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] glance_request_timeout = None {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:27:26 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] goodness_function = None {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:27:26 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] graceful_shutdown_timeout = 5 {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:27:26 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] group_api_class = cinder.group.api.API {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:27:26 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] host = devstack {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:27:26 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] image_compress_on_upload = True {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:27:26 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] image_conversion_address_space_limit = 1 {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:27:26 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] image_conversion_cpu_limit = 60 {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:27:26 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:27:26 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] image_conversion_disable = False {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:27:26 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] image_upload_use_cinder_backend = False {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:27:26 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] image_upload_use_internal_tenant = False {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:27:26 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] image_volume_cache_enabled = False {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:27:26 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] image_volume_cache_max_count = 0 {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:27:26 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] image_volume_cache_max_size_gb = 0 {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:27:26 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] init_host_max_objects_retrieval = 0 {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:27:26 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] instance_format = [instance: %(uuid)s] {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:27:26 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:27:26 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] iscsi_target_flags = {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:27:26 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] iscsi_write_cache = on {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:27:26 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] iser_helper = tgtadm {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:27:26 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] iser_ip_address = 192.168.122.55 {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:27:26 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] iser_port = 3260 {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:27:26 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:27:26 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] log_color = False {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:27:26 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] log_config_append = None {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:27:26 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:27:26 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] log_dir = None {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:27:26 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] log_file = None {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:27:26 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] log_options = True {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:27:26 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] log_rotate_interval = 1 {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:27:26 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] log_rotate_interval_type = days {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:27:26 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] log_rotation_type = none {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:27:26 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:27:26 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:27:26 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:27:26 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:27:26 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:27:26 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] max_age = 0 {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:27:26 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] max_logfile_count = 30 {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:27:26 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] max_logfile_size_mb = 200 {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:27:26 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] max_over_subscription_ratio = 20.0 {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:27:26 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] message_reap_interval = 86400 {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:27:26 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] message_ttl = 2592000 {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:27:26 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] migration_create_volume_timeout_secs = 300 {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:27:26 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] monkey_patch = False {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:27:26 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] monkey_patch_modules = [] {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:27:26 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] my_ip = 192.168.122.55 {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:27:26 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] no_snapshot_gb_quota = False {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:27:26 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] num_iser_scan_tries = 3 {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:27:26 devstack cinder-volume[88312]: INFO cinder.volume.manager [None req-e5f50f48-49ca-4b17-b863-28bebc1776d7 None None] Starting volume driver QuobyteDriver (1.2) Aug 03 08:27:26 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] num_shell_tries = 3 {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:27:26 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] num_volume_device_scan_tries = 3 {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:27:26 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] nvmeof_conn_info_version = 1 {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:27:26 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] nvmet_ns_id = 10 {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:27:26 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] nvmet_port_id = 1 {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:27:26 devstack cinder-volume[88312]: DEBUG cinder.volume.drivers.remotefs [None req-e5f50f48-49ca-4b17-b863-28bebc1776d7 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=88312) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Aug 03 08:27:26 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] osapi_max_limit = 1000 {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:27:26 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] osapi_volume_ext_list = [] {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:27:26 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:27:26 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] osapi_volume_listen = 0.0.0.0 {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:27:26 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] osapi_volume_listen_port = 8776 {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:27:26 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] osapi_volume_use_ssl = False {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:27:26 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] osapi_volume_workers = None {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:27:26 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] per_volume_size_limit = -1 {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:27:26 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] periodic_fuzzy_delay = 60 {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:27:26 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] periodic_interval = 60 {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:27:26 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] project_id_regex = [0-9a-f\-]+ {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:27:26 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] public_endpoint = None {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:27:26 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] publish_errors = False {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:27:26 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] quota_backup_gigabytes = 1000 {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:27:26 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] quota_backups = 10 {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:27:26 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:27:26 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] quota_gigabytes = 1000 {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:27:26 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] quota_groups = 10 {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:27:26 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] quota_snapshots = 10 {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:27:26 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] quota_volumes = 10 {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:27:26 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] rate_limit_burst = 0 {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:27:26 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] rate_limit_except_level = CRITICAL {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:27:26 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] rate_limit_interval = 0 {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:27:26 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] reinit_driver_count = 3 {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:27:26 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] replication_device = **** {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:27:26 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] report_discard_supported = False {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:27:26 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] report_interval = 120 {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:27:26 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] reservation_clean_interval = 86400 {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:27:26 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] reservation_expire = 86400 {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:27:26 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] reserved_image_namespaces = [] {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:27:26 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] reserved_percentage = 0 {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:27:26 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:27:26 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:27:26 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] rpc_response_timeout = 120 {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:27:26 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] run_external_periodic_tasks = True {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:27:26 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:27:26 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] scst_target_driver = iscsi {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:27:26 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] scst_target_iqn_name = None {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:27:26 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] service_down_time = 720 {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:27:26 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] shell_completion = None {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:27:26 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] snapshot_name_template = snapshot-%s {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:27:26 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] split_loggers = False {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:27:26 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] state_path = /opt/stack/data/cinder {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:27:26 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] storage_availability_zone = nova {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:27:26 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] storage_protocol = iSCSI {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:27:26 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] syslog_log_facility = LOG_USER {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:27:26 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] target_helper = lioadm {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:27:26 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] target_ip_address = 192.168.122.55 {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:27:26 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] target_port = 3260 {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:27:26 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:27:26 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] target_protocol = iscsi {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:27:26 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] target_secondary_ip_addresses = [] {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:27:26 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] trace_flags = None {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:27:26 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] transfer_api_class = cinder.transfer.api.API {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:27:26 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] transport_url = **** {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:27:26 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] until_refresh = 0 {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:27:26 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] use_chap_auth = False {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:27:26 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] use_default_quota_class = True {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:27:26 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] use_journal = False {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:27:26 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] use_json = False {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:27:26 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] use_multipath_for_image_xfer = False {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:27:26 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] use_stderr = False {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:27:26 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] use_syslog = False {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:27:26 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] verify_glance_signatures = enabled {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:27:26 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:27:26 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] volume_api_class = cinder.volume.api.API {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:27:26 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] volume_backend_name = None {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:27:26 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] volume_clear = zero {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:27:26 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] volume_clear_ionice = None {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:27:26 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] volume_clear_size = 0 {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:27:26 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:27:26 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] volume_copy_bps_limit = 0 {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:27:26 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] volume_dd_blocksize = 1M {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:27:26 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:27:26 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] volume_name_template = volume-%s {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:27:26 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] volume_service_inithost_offload = False {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:27:26 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] volume_usage_audit_period = month {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:27:26 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:27:26 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] zoning_mode = None {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:27:26 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] oslo_concurrency.disable_process_locking = False {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:26 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:26 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:26 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:26 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:26 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:26 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:26 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:26 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:26 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:26 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] keystone_authtoken.auth_section = None {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:26 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] keystone_authtoken.auth_type = password {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:26 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] keystone_authtoken.auth_version = None {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:26 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] keystone_authtoken.cache = None {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:26 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:26 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] keystone_authtoken.certfile = None {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:26 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] keystone_authtoken.delay_auth_decision = False {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:26 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:26 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] keystone_authtoken.http_connect_timeout = None {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:26 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:26 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] keystone_authtoken.include_service_catalog = True {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:26 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] keystone_authtoken.insecure = False {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:26 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] keystone_authtoken.interface = public {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:26 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] keystone_authtoken.keyfile = None {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:26 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] keystone_authtoken.memcache_password = {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:26 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:26 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:26 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:26 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:26 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:26 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:26 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:26 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:26 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:26 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:26 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:26 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:26 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:26 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:26 devstack cinder-volume[88312]: DEBUG cinder.volume.drivers.quobyte [None req-e5f50f48-49ca-4b17-b863-28bebc1776d7 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=88312) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:307}} Aug 03 08:27:26 devstack cinder-volume[88312]: WARNING cinder.volume.drivers.quobyte [None req-e5f50f48-49ca-4b17-b863-28bebc1776d7 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Aug 03 08:27:26 devstack cinder-volume[88312]: WARNING cinder.volume.drivers.quobyte [None req-e5f50f48-49ca-4b17-b863-28bebc1776d7 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Aug 03 08:27:26 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] keystone_authtoken.memcache_username = {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:26 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:26 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] keystone_authtoken.region_name = None {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:26 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:26 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] keystone_authtoken.service_token_roles_required = True {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:26 devstack cinder-volume[88312]: DEBUG oslo_concurrency.processutils [None req-e5f50f48-49ca-4b17-b863-28bebc1776d7 None None] Running cmd (subprocess): mount.quobyte {{(pid=88312) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:27:26 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] keystone_authtoken.service_type = None {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:26 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] keystone_authtoken.token_cache_time = 300 {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:26 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.55/identity {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:26 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] cache.backend = dogpile.cache.null {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:26 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] cache.backend_argument = **** {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:26 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] cache.backend_expiration_time = None {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:26 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] cache.config_prefix = cache.oslo {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:26 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] cache.debug_cache_backend = False {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:26 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] cache.enable_retry_client = False {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:26 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] cache.enable_socket_keepalive = False {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:26 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] cache.enabled = False {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:26 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] cache.expiration_time = 600 {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:26 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:26 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] cache.hashclient_retry_attempts = 2 {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:26 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:26 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] cache.memcache_dead_retry = 300 {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:26 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:26 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:26 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] cache.memcache_pool_maxsize = 10 {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:26 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:26 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] cache.memcache_sasl_enabled = False {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:26 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:26 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] cache.password = **** {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:26 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] cache.proxies = [] {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:26 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] cache.redis_db = 0 {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:26 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] cache.redis_sentinel_service_name = mymaster {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:26 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:26 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] cache.redis_server = localhost:6379 {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:26 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] cache.retry_attempts = 2 {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:26 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] cache.retry_delay = 0.0 {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:26 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] cache.socket_keepalive_count = 1 {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:26 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] cache.socket_keepalive_idle = 1 {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:26 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] cache.socket_keepalive_interval = 1 {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:26 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] cache.socket_timeout = 1.0 {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:26 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] cache.tls_allowed_ciphers = None {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:26 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] cache.tls_cafile = None {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:26 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] cache.tls_certfile = None {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:26 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] cache.tls_enabled = False {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:26 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] cache.tls_keyfile = None {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:26 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] cache.username = None {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:26 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] coordination.backend_url = **** {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:26 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] database.asyncio_connection = **** {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:26 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] database.asyncio_slave_connection = **** {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:26 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] database.backend = sqlalchemy {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:26 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] database.connection = **** {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:26 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] database.connection_debug = 0 {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:26 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] database.connection_parameters = {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:26 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] database.connection_recycle_time = 3600 {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:26 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] database.connection_trace = False {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:26 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] database.db_inc_retry_interval = True {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:26 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] database.db_max_retries = 20 {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:26 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] database.db_max_retry_interval = 10 {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:26 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] database.db_retry_interval = 1 {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:26 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] database.max_overflow = 50 {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:26 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] database.max_pool_size = 5 {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:26 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] database.max_retries = 10 {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:26 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:26 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] database.mysql_wsrep_sync_wait = None {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:26 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] database.pool_timeout = None {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:26 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] database.retry_interval = 10 {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:26 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] database.slave_connection = **** {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:26 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] database.sqlite_synchronous = True {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:26 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] database.synchronous_reader = True {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:26 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] database.use_db_reconnect = False {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:26 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:26 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:26 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:26 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:26 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:26 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] profiler.connection_string = messaging:// {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:26 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] profiler.enabled = False {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:26 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] profiler.es_doc_type = notification {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:26 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] profiler.es_scroll_size = 10000 {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:26 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] profiler.es_scroll_time = 2m {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:26 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] profiler.filter_error_trace = False {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:26 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] profiler.hmac_keys = **** {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:26 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] profiler.sentinel_service_name = mymaster {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:26 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] profiler.socket_timeout = 0.1 {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:26 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] profiler.trace_requests = False {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:26 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] profiler.trace_sqlalchemy = False {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:26 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] profiler_jaeger.process_tags = {} {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:26 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] profiler_jaeger.service_name_prefix = None {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:26 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] profiler_otlp.service_name_prefix = None {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:26 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] oslo_policy.enforce_new_defaults = True {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:26 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] oslo_policy.policy_default_rule = default {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:26 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:26 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] oslo_policy.policy_file = policy.yaml {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:26 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:26 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:26 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:26 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:26 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:26 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] oslo_policy.remote_timeout = 60.0 {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:26 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:26 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] privsep_osbrick.group = None {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:26 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] privsep_osbrick.helper_command = None {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:26 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:26 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:26 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:26 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] privsep_osbrick.user = None {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:26 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:26 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] cinder_sys_admin.group = None {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:26 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] cinder_sys_admin.helper_command = None {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:26 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:26 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:26 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:26 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] cinder_sys_admin.user = None {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:26 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] service_user.auth_section = None {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:26 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] service_user.auth_type = password {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:26 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] service_user.cafile = None {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:26 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] service_user.certfile = None {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:26 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] service_user.collect_timing = False {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:26 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] service_user.insecure = False {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:26 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] service_user.keyfile = None {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:26 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] service_user.send_service_user_token = True {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:26 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] service_user.split_loggers = False {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:26 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] service_user.timeout = None {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:26 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] glance.auth_section = None {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:26 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] glance.auth_type = password {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:26 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:26 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] glance.certfile = None {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:26 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] glance.collect_timing = False {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:26 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] glance.insecure = False {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:26 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] glance.keyfile = None {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:26 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] glance.region_name = None {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:26 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] glance.split_loggers = False {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:26 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] glance.timeout = None {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:26 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] backend_defaults.backend_availability_zone = None {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:26 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:26 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:26 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] backend_defaults.chap_password = **** {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:26 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] backend_defaults.chap_username = {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:26 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:26 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] backend_defaults.disk_geometry = None {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:26 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] backend_defaults.driver_client_cert = None {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:26 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] backend_defaults.driver_client_cert_key = None {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:26 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] backend_defaults.driver_data_namespace = None {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:26 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:26 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:26 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] backend_defaults.driver_use_ssl = False {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:26 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] backend_defaults.enable_unsupported_driver = False {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:26 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:26 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] backend_defaults.extra_capabilities = {} {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:26 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] backend_defaults.filter_function = None {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:26 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] backend_defaults.goodness_function = None {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:26 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:26 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:26 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:26 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:26 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:26 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] backend_defaults.iscsi_target_flags = {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:26 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] backend_defaults.iscsi_write_cache = on {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:26 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] backend_defaults.iser_helper = tgtadm {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:26 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] backend_defaults.iser_ip_address = 192.168.122.55 {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:27 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] backend_defaults.iser_port = 3260 {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:27 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:27 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:27 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] backend_defaults.nas_host = {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:27 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] backend_defaults.nas_login = admin {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:27 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] backend_defaults.nas_mount_options = None {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:27 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] backend_defaults.nas_password = **** {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:27 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] backend_defaults.nas_private_key = {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:27 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:27 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:27 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] backend_defaults.nas_share_path = {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:27 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] backend_defaults.nas_ssh_port = 22 {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:27 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:27 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:27 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] backend_defaults.num_shell_tries = 3 {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:27 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:27 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:27 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:27 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] backend_defaults.nvmet_port_id = 1 {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:27 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] backend_defaults.quobyte_client_cfg = None {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:27 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:27 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:27 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:27 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:27 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:27 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] backend_defaults.quobyte_volume_url = None {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:27 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] backend_defaults.replication_device = **** {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:27 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] backend_defaults.report_discard_supported = False {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:27 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] backend_defaults.reserved_percentage = 0 {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:27 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] backend_defaults.scst_target_driver = iscsi {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:27 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] backend_defaults.scst_target_iqn_name = None {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:27 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] backend_defaults.storage_protocol = iSCSI {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:27 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:27 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] backend_defaults.target_helper = tgtadm {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:27 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] backend_defaults.target_ip_address = 192.168.122.55 {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:27 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] backend_defaults.target_port = 3260 {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:27 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:27 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] backend_defaults.target_protocol = iscsi {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:27 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:27 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] backend_defaults.trace_flags = None {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:27 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] backend_defaults.unique_fqdn_network = True {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:27 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] backend_defaults.use_chap_auth = False {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:27 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:27 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] backend_defaults.volume_backend_name = None {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:27 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] backend_defaults.volume_clear = zero {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:27 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] backend_defaults.volume_clear_ionice = None {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:27 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] backend_defaults.volume_clear_size = 0 {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:27 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:27 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:27 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:27 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:27 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:27 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] oslo_reports.file_event_handler = None {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:27 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:27 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] oslo_reports.log_dir = None {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:27 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] QuobyteHD.backend_availability_zone = None {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:27 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] QuobyteHD.backend_host = None {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:27 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:27 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:27 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] QuobyteHD.chap_password = **** {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:27 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] QuobyteHD.chap_username = None {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:27 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] QuobyteHD.chiscsi_conf = None {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:27 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] QuobyteHD.disk_geometry = None {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:27 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] QuobyteHD.driver_client_cert = None {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:27 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] QuobyteHD.driver_client_cert_key = None {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:27 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] QuobyteHD.driver_data_namespace = None {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:27 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:27 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:27 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] QuobyteHD.driver_use_ssl = None {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:27 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:27 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:27 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] QuobyteHD.extra_capabilities = None {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:27 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] QuobyteHD.filter_function = None {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:27 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] QuobyteHD.goodness_function = None {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:27 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:27 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:27 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:27 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:27 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:27 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] QuobyteHD.iscsi_target_flags = None {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:27 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] QuobyteHD.iscsi_write_cache = None {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:27 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] QuobyteHD.iser_helper = None {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:27 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] QuobyteHD.iser_ip_address = None {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:27 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] QuobyteHD.iser_port = None {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:27 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] QuobyteHD.iser_target_prefix = None {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:27 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:27 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] QuobyteHD.nas_host = None {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:27 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] QuobyteHD.nas_login = None {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:27 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] QuobyteHD.nas_mount_options = None {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:27 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] QuobyteHD.nas_password = **** {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:27 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] QuobyteHD.nas_private_key = None {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:27 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:27 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:27 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] QuobyteHD.nas_share_path = None {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:27 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] QuobyteHD.nas_ssh_port = None {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:27 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:27 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:27 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] QuobyteHD.num_shell_tries = None {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:27 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:27 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:27 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] QuobyteHD.nvmet_ns_id = None {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:27 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] QuobyteHD.nvmet_port_id = None {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:27 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:27 devstack quobyte-client[88318]: Reading configuration file: /etc/quobyte/client.cfg Aug 03 08:27:27 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:27 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:27 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:27 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:27 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:27 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385 {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:27 devstack quobyte-client[88318]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Aug 03 08:27:27 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] QuobyteHD.replication_device = **** {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:27 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] QuobyteHD.report_discard_supported = None {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:27 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] QuobyteHD.reserved_percentage = None {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:27 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] QuobyteHD.scst_target_driver = None {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:27 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:27 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] QuobyteHD.storage_protocol = None {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:27 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:27 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] QuobyteHD.target_helper = None {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:27 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] QuobyteHD.target_ip_address = None {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:27 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] QuobyteHD.target_port = None {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:27 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] QuobyteHD.target_prefix = None {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:27 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] QuobyteHD.target_protocol = None {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:27 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:27 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] QuobyteHD.trace_flags = None {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:27 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] QuobyteHD.unique_fqdn_network = None {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:27 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] QuobyteHD.use_chap_auth = None {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:27 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:27 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:27 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] QuobyteHD.volume_clear = None {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:27 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] QuobyteHD.volume_clear_ionice = None {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:27 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] QuobyteHD.volume_clear_size = None {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:27 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:27 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:27 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:27 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:27 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] QuobyteHD.volumes_dir = None {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:27 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:27 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:27 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:27 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:27 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:27 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:27 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:27 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:27 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:27 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:27 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:27 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:27 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:27 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:27 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:27 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:27 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:27 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:27 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:27 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:27 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:27 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:27 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:27 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:27 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:27 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:27 devstack cinder-volume[88312]: DEBUG oslo_concurrency.processutils [None req-e5f50f48-49ca-4b17-b863-28bebc1776d7 None None] CMD "mount.quobyte" returned: 1 in 0.133s {{(pid=88312) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:27:27 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:27 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:27 devstack cinder-volume[88312]: DEBUG oslo_concurrency.lockutils [None req-e5f50f48-49ca-4b17-b863-28bebc1776d7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88312) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:27:27 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:27 devstack cinder-volume[88312]: DEBUG oslo_concurrency.lockutils [None req-e5f50f48-49ca-4b17-b863-28bebc1776d7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88312) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:27:27 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] oslo_messaging_rabbit.ssl = False {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:27 devstack cinder-volume[88312]: DEBUG cinder.volume.drivers.quobyte [None req-e5f50f48-49ca-4b17-b863-28bebc1776d7 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88312) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:27:27 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:27 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:27 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:27 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:27 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:27 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] oslo_messaging_rabbit.ssl_version = {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:27 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:27 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] oslo_messaging_notifications.driver = [] {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:27 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] oslo_messaging_notifications.retry = -1 {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:27 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:27 devstack cinder-volume[88312]: INFO cinder.volume.drivers.quobyte [None req-e5f50f48-49ca-4b17-b863-28bebc1776d7 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385 ... Aug 03 08:27:27 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] oslo_messaging_notifications.transport_url = **** {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:27 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:27 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] key_manager.fixed_key = **** {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:27 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:27 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] barbican.barbican_api_version = None {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:27 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] barbican.barbican_endpoint = None {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:27 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] barbican.barbican_endpoint_type = public {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:27 devstack cinder-volume[88312]: DEBUG oslo_concurrency.processutils [None req-e5f50f48-49ca-4b17-b863-28bebc1776d7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a -c /etc/quobyte/client-cinder.cfg {{(pid=88312) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:27:27 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] barbican.barbican_region_name = None {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:27 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] barbican.cafile = None {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:27 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] barbican.certfile = None {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:27 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] barbican.collect_timing = False {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:27 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] barbican.insecure = False {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:27 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] barbican.keyfile = None {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:27 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] barbican.number_of_retries = 60 {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:27 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] barbican.retry_delay = 1 {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:27 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] barbican.send_service_user_token = False {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:27 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] barbican.split_loggers = False {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:27 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] barbican.timeout = None {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:27 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] barbican.verify_ssl = True {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:27 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] barbican.verify_ssl_path = None {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:27 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] barbican_service_user.auth_section = None {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:27 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] barbican_service_user.auth_type = None {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:27 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] barbican_service_user.cafile = None {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:27 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] barbican_service_user.certfile = None {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:27 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] barbican_service_user.collect_timing = False {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:27 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] barbican_service_user.insecure = False {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:27 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] barbican_service_user.keyfile = None {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:27 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] barbican_service_user.split_loggers = False {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:27 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] barbican_service_user.timeout = None {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:27 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] vault.approle_role_id = **** {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:27 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] vault.approle_secret_id = **** {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:27 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] vault.auth_method = approle {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:27 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] vault.auth_path = None {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:27 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] vault.kv_mountpoint = secret {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:27 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] vault.kv_path = None {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:27 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] vault.kv_version = 2 {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:27 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] vault.namespace = None {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:27 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] vault.root_token_id = **** {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:27 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] vault.ssl_ca_crt_file = None {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:27 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] vault.timeout = 60.0 {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:27 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] vault.token_file = None {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:27 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] vault.token_role = None {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:27 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] vault.use_ssl = False {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:27 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:27 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] ******************************************************************************** {{(pid=88098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Aug 03 08:27:27 devstack sudo[88319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a -c /etc/quobyte/client-cinder.cfg Aug 03 08:27:27 devstack sudo[88319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:27:27 devstack sudo[88319]: pam_unix(sudo:session): session closed for user root Aug 03 08:27:27 devstack cinder-volume[88312]: DEBUG oslo_concurrency.processutils [None req-e5f50f48-49ca-4b17-b863-28bebc1776d7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.382s {{(pid=88312) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:27:27 devstack cinder-volume[88312]: INFO cinder.volume.drivers.quobyte [None req-e5f50f48-49ca-4b17-b863-28bebc1776d7 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385 succeeded Aug 03 08:27:27 devstack cinder-volume[88312]: DEBUG cinder.volume.drivers.quobyte [None req-e5f50f48-49ca-4b17-b863-28bebc1776d7 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88312) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:27:27 devstack cinder-volume[88312]: DEBUG oslo_concurrency.lockutils [None req-e5f50f48-49ca-4b17-b863-28bebc1776d7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.395s {{(pid=88312) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:27:27 devstack cinder-volume[88312]: DEBUG oslo_concurrency.processutils [None req-e5f50f48-49ca-4b17-b863-28bebc1776d7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a {{(pid=88312) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:27:27 devstack sudo[88388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a Aug 03 08:27:27 devstack sudo[88388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:27:27 devstack sudo[88388]: pam_unix(sudo:session): session closed for user root Aug 03 08:27:27 devstack cinder-volume[88312]: DEBUG oslo_concurrency.processutils [None req-e5f50f48-49ca-4b17-b863-28bebc1776d7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a" returned: 0 in 0.256s {{(pid=88312) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:27:27 devstack cinder-volume[88312]: INFO cinder.volume.driver [None req-e5f50f48-49ca-4b17-b863-28bebc1776d7 None None] Driver hasn't implemented _init_vendor_properties() Aug 03 08:27:27 devstack cinder-volume[88312]: DEBUG cinder.volume.driver [None req-e5f50f48-49ca-4b17-b863-28bebc1776d7 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7576713562012, 'free_capacity_gb': 1775.7576713562012, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=88312) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Aug 03 08:27:27 devstack cinder-volume[88312]: DEBUG oslo_db.sqlalchemy.engines [None req-e5f50f48-49ca-4b17-b863-28bebc1776d7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=88312) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 03 08:27:27 devstack cinder-volume[88312]: DEBUG dbcounter [-] [88312] Writer thread running {{(pid=88312) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Aug 03 08:27:27 devstack cinder-volume[88312]: DEBUG cinder.db.api [None req-e5f50f48-49ca-4b17-b863-28bebc1776d7 None None] Building query based on filter {{(pid=88312) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Aug 03 08:27:27 devstack cinder-volume[88312]: DEBUG cinder.image.image_utils [None req-e5f50f48-49ca-4b17-b863-28bebc1776d7 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=88312) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Aug 03 08:27:27 devstack cinder-volume[88312]: INFO cinder.keymgr.migration [None req-3553d7ac-1b73-4b68-a826-136b5e909a19 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Aug 03 08:27:27 devstack cinder-volume[88312]: DEBUG oslo_concurrency.lockutils [None req-e5f50f48-49ca-4b17-b863-28bebc1776d7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88312) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:27:27 devstack cinder-volume[88312]: DEBUG oslo_concurrency.lockutils [None req-e5f50f48-49ca-4b17-b863-28bebc1776d7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88312) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:27:27 devstack cinder-volume[88312]: DEBUG cinder.volume.drivers.quobyte [None req-e5f50f48-49ca-4b17-b863-28bebc1776d7 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88312) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:27:27 devstack cinder-volume[88312]: DEBUG cinder.volume.drivers.quobyte [None req-e5f50f48-49ca-4b17-b863-28bebc1776d7 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88312) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:27:27 devstack cinder-volume[88312]: DEBUG oslo_concurrency.lockutils [None req-e5f50f48-49ca-4b17-b863-28bebc1776d7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88312) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:27:27 devstack cinder-volume[88312]: DEBUG oslo_concurrency.processutils [None req-e5f50f48-49ca-4b17-b863-28bebc1776d7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a {{(pid=88312) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:27:27 devstack sudo[88391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a Aug 03 08:27:27 devstack sudo[88391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:27:28 devstack sudo[88391]: pam_unix(sudo:session): session closed for user root Aug 03 08:27:28 devstack cinder-volume[88312]: DEBUG oslo_concurrency.processutils [None req-e5f50f48-49ca-4b17-b863-28bebc1776d7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a" returned: 0 in 0.238s {{(pid=88312) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:27:28 devstack cinder-volume[88312]: DEBUG cinder.manager [None req-e5f50f48-49ca-4b17-b863-28bebc1776d7 None None] Notifying Schedulers of capabilities ... {{(pid=88312) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 08:27:28 devstack cinder-volume[88312]: INFO cinder.volume.manager [None req-e5f50f48-49ca-4b17-b863-28bebc1776d7 None None] Driver initialization completed successfully. Aug 03 08:27:28 devstack cinder-volume[88312]: INFO cinder.manager [None req-e5f50f48-49ca-4b17-b863-28bebc1776d7 None None] Initiating service 3 cleanup Aug 03 08:27:28 devstack cinder-volume[88312]: INFO cinder.manager [None req-e5f50f48-49ca-4b17-b863-28bebc1776d7 None None] Service 3 cleanup completed. Aug 03 08:27:28 devstack cinder-volume[88312]: DEBUG cinder.service [None req-e5f50f48-49ca-4b17-b863-28bebc1776d7 None None] Creating RPC server for service cinder-volume {{(pid=88312) start /opt/stack/cinder/cinder/service.py:231}} Aug 03 08:27:28 devstack cinder-volume[88312]: DEBUG cinder.service [None req-e5f50f48-49ca-4b17-b863-28bebc1776d7 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=88312) start /opt/stack/cinder/cinder/service.py:237}} Aug 03 08:27:28 devstack cinder-volume[88312]: INFO cinder.volume.manager [None req-e5f50f48-49ca-4b17-b863-28bebc1776d7 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2) Aug 03 08:27:28 devstack cinder-volume[88312]: DEBUG oslo_concurrency.lockutils [None req-e5f50f48-49ca-4b17-b863-28bebc1776d7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88312) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:27:28 devstack cinder-volume[88312]: DEBUG oslo_concurrency.lockutils [None req-e5f50f48-49ca-4b17-b863-28bebc1776d7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88312) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:27:28 devstack cinder-volume[88312]: DEBUG cinder.volume.drivers.quobyte [None req-e5f50f48-49ca-4b17-b863-28bebc1776d7 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88312) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:27:28 devstack cinder-volume[88312]: DEBUG cinder.volume.drivers.quobyte [None req-e5f50f48-49ca-4b17-b863-28bebc1776d7 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88312) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:27:28 devstack cinder-volume[88312]: DEBUG oslo_concurrency.lockutils [None req-e5f50f48-49ca-4b17-b863-28bebc1776d7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88312) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:27:28 devstack cinder-volume[88312]: DEBUG oslo_concurrency.processutils [None req-e5f50f48-49ca-4b17-b863-28bebc1776d7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a {{(pid=88312) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:27:28 devstack sudo[88394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a Aug 03 08:27:28 devstack sudo[88394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:27:28 devstack sudo[88394]: pam_unix(sudo:session): session closed for user root Aug 03 08:27:28 devstack cinder-volume[88312]: DEBUG oslo_concurrency.processutils [None req-e5f50f48-49ca-4b17-b863-28bebc1776d7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a" returned: 0 in 0.250s {{(pid=88312) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:27:28 devstack cinder-volume[88312]: INFO cinder.volume.manager [None req-e5f50f48-49ca-4b17-b863-28bebc1776d7 None None] Driver post RPC initialization completed successfully. Aug 03 08:27:32 devstack cinder-volume[88098]: INFO oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] Caught SIGTERM, stopping children Aug 03 08:27:32 devstack cinder-volume[88098]: DEBUG oslo_concurrency.lockutils [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] Acquiring lock "singleton_lock" {{(pid=88098) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Aug 03 08:27:32 devstack cinder-volume[88098]: DEBUG oslo_concurrency.lockutils [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] Acquired lock "singleton_lock" {{(pid=88098) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Aug 03 08:27:32 devstack cinder-volume[88098]: DEBUG oslo_concurrency.lockutils [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] Releasing lock "singleton_lock" {{(pid=88098) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Aug 03 08:27:32 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] Stop services. {{(pid=88098) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Aug 03 08:27:32 devstack cinder-volume[88098]: DEBUG oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] Killing children. {{(pid=88098) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Aug 03 08:27:32 devstack cinder-volume[88098]: INFO oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] Waiting on 1 children to exit Aug 03 08:27:36 devstack cinder-volume[88312]: DEBUG oslo_concurrency.lockutils [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] Acquiring lock "singleton_lock" {{(pid=88312) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Aug 03 08:27:36 devstack cinder-volume[88312]: DEBUG oslo_concurrency.lockutils [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] Acquired lock "singleton_lock" {{(pid=88312) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Aug 03 08:27:36 devstack cinder-volume[88312]: DEBUG oslo_concurrency.lockutils [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] Releasing lock "singleton_lock" {{(pid=88312) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Aug 03 08:27:36 devstack cinder-volume[88312]: WARNING amqp [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] Received method (60, 30) during closing channel 1. This method will be ignored Aug 03 08:27:36 devstack cinder-volume[88312]: WARNING amqp [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] Received method (60, 30) during closing channel 1. This method will be ignored Aug 03 08:27:36 devstack cinder-volume[88098]: INFO oslo_service.backend._eventlet.service [None req-4ade8a7f-c803-412a-bf84-377382afa026 None None] Child 88312 exited with status 0 Aug 03 08:27:37 devstack cinder-volume[88599]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Aug 03 08:27:37 devstack cinder-volume[88599]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Aug 03 08:27:37 devstack cinder-volume[88599]: we strongly recommend against using it for new projects. Aug 03 08:27:37 devstack cinder-volume[88599]: If you are already using Eventlet, we recommend migrating to a different Aug 03 08:27:37 devstack cinder-volume[88599]: framework. For more detail see Aug 03 08:27:37 devstack cinder-volume[88599]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Aug 03 08:27:37 devstack cinder-volume[88599]: import eventlet # noqa Aug 03 08:27:40 devstack cinder-volume[88599]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=88599) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Aug 03 08:27:40 devstack cinder-volume[88599]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=88599) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Aug 03 08:27:40 devstack cinder-volume[88599]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=88599) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Aug 03 08:27:40 devstack cinder-volume[88599]: INFO dbcounter [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] Registered counter for database cinder Aug 03 08:27:40 devstack cinder-volume[88599]: DEBUG oslo_db.sqlalchemy.engines [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=88599) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG dbcounter [-] [88599] Writer thread running {{(pid=88599) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Aug 03 08:27:41 devstack cinder-volume[88599]: INFO cinder.rpc [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Aug 03 08:27:41 devstack cinder-volume[88599]: INFO cinder.rpc [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_db.sqlalchemy.engines [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=88599) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 03 08:27:41 devstack cinder-volume[88599]: INFO cinder.volume.manager [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] Determined volume DB was empty at startup. Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG cinder.volume.manager [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=88599) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Aug 03 08:27:41 devstack cinder-volume[88599]: WARNING stevedore.named [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Aug 03 08:27:41 devstack cinder-volume[88599]: WARNING castellan.key_manager [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Aug 03 08:27:41 devstack cinder-volume[88599]: WARNING cinder.keymgr.conf_key_mgr [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Aug 03 08:27:41 devstack cinder-volume[88599]: INFO cinder.volume.manager [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] Image-volume cache disabled for host devstack@QuobyteHD. Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_db.sqlalchemy.engines [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=88599) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 03 08:27:41 devstack cinder-volume[88599]: INFO oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] Starting 1 workers Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] Started child 88899 {{(pid=88599) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] Full set of CONF: {{(pid=88599) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Aug 03 08:27:41 devstack cinder-volume[88899]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] ******************************************************************************** {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] Configuration options gathered from: {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] ================================================================================ {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] allow_availability_zone_fallback = False {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] allow_compression_on_image_upload = False {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] allowed_direct_url_schemes = [] {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] api_rate_limit = True {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] auth_strategy = keystone {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] backend_availability_zone = None {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] backend_host = None {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] backend_name = None {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] backend_stats_polling_interval = 60 {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] backup_api_class = cinder.backup.api.API {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] backup_name_template = backup-%s {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] backup_use_same_host = False {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] backup_use_temp_snapshot = False {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] chap_password = **** {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] chap_username = {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] cinder_internal_tenant_project_id = a9c7a894fc7a45e8bd418eaaef586b5d {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] cinder_internal_tenant_user_id = 2af68c9d2740481681db96f147575d58 {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] cluster = None {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] compression_format = gzip {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] compute_api_class = cinder.compute.nova.API {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] config_dir = [] {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] config_source = [] {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] control_exchange = openstack {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] debug = True {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] default_availability_zone = None {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] default_group_type = None {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] default_volume_type = QuobyteHD {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] disk_geometry = None {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] driver_client_cert = None {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] driver_client_cert_key = None {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] driver_data_namespace = None {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] driver_ssl_cert_path = None {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] driver_ssl_cert_verify = False {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] driver_use_ssl = False {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] enable_new_services = True {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] enable_unsupported_driver = False {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] enabled_backends = ['QuobyteHD'] {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] enforce_multipath_for_image_xfer = False {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] filter_function = None {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] glance_api_insecure = False {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] glance_api_servers = ['http://192.168.122.55/image'] {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] glance_api_ssl_compression = False {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] glance_ca_certificates_file = None {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] glance_catalog_info = image:glance:publicURL {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] glance_certfile = None {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] glance_keyfile = None {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] glance_num_retries = 3 {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] glance_request_timeout = None {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] goodness_function = None {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] graceful_shutdown_timeout = 5 {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] group_api_class = cinder.group.api.API {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] host = devstack {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] image_compress_on_upload = True {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] image_conversion_address_space_limit = 1 {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] image_conversion_cpu_limit = 60 {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] image_conversion_disable = False {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] image_upload_use_cinder_backend = False {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] image_upload_use_internal_tenant = False {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] image_volume_cache_enabled = False {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] image_volume_cache_max_count = 0 {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] image_volume_cache_max_size_gb = 0 {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] init_host_max_objects_retrieval = 0 {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] instance_format = [instance: %(uuid)s] {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] iscsi_target_flags = {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] iscsi_write_cache = on {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] iser_helper = tgtadm {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] iser_ip_address = 192.168.122.55 {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] iser_port = 3260 {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] log_color = False {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] log_config_append = None {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] log_dir = None {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] log_file = None {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] log_options = True {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] log_rotate_interval = 1 {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] log_rotate_interval_type = days {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] log_rotation_type = none {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] max_age = 0 {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] max_logfile_count = 30 {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] max_logfile_size_mb = 200 {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] max_over_subscription_ratio = 20.0 {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] message_reap_interval = 86400 {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] message_ttl = 2592000 {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] migration_create_volume_timeout_secs = 300 {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] monkey_patch = False {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] monkey_patch_modules = [] {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] my_ip = 192.168.122.55 {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] no_snapshot_gb_quota = False {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:27:41 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-e5c3a3e7-dbba-4e44-860e-5bc566f8b42d None None] Starting volume driver QuobyteDriver (1.2) Aug 03 08:27:41 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-e5c3a3e7-dbba-4e44-860e-5bc566f8b42d None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=88899) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] num_iser_scan_tries = 3 {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] num_shell_tries = 3 {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] num_volume_device_scan_tries = 3 {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] nvmeof_conn_info_version = 1 {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] nvmet_ns_id = 10 {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] nvmet_port_id = 1 {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] osapi_max_limit = 1000 {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] osapi_volume_ext_list = [] {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] osapi_volume_listen = 0.0.0.0 {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] osapi_volume_listen_port = 8776 {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] osapi_volume_use_ssl = False {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] osapi_volume_workers = None {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] per_volume_size_limit = -1 {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] periodic_fuzzy_delay = 60 {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] periodic_interval = 60 {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] project_id_regex = [0-9a-f\-]+ {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] public_endpoint = None {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] publish_errors = False {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] quota_backup_gigabytes = 1000 {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] quota_backups = 10 {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] quota_gigabytes = 1000 {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] quota_groups = 10 {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] quota_snapshots = 10 {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] quota_volumes = 10 {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] rate_limit_burst = 0 {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] rate_limit_except_level = CRITICAL {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] rate_limit_interval = 0 {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] reinit_driver_count = 3 {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] replication_device = **** {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] report_discard_supported = False {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] report_interval = 120 {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] reservation_clean_interval = 86400 {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] reservation_expire = 86400 {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] reserved_image_namespaces = [] {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] reserved_percentage = 0 {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] rpc_response_timeout = 120 {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] run_external_periodic_tasks = True {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] scst_target_driver = iscsi {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] scst_target_iqn_name = None {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] service_down_time = 720 {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] shell_completion = None {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] snapshot_name_template = snapshot-%s {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] split_loggers = False {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] state_path = /opt/stack/data/cinder {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] storage_availability_zone = nova {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] storage_protocol = iSCSI {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] syslog_log_facility = LOG_USER {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] target_helper = lioadm {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] target_ip_address = 192.168.122.55 {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] target_port = 3260 {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] target_protocol = iscsi {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] target_secondary_ip_addresses = [] {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] trace_flags = None {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] transfer_api_class = cinder.transfer.api.API {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] transport_url = **** {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] until_refresh = 0 {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] use_chap_auth = False {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] use_default_quota_class = True {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] use_journal = False {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] use_json = False {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] use_multipath_for_image_xfer = False {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] use_stderr = False {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] use_syslog = False {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] verify_glance_signatures = enabled {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] volume_api_class = cinder.volume.api.API {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] volume_backend_name = None {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] volume_clear = zero {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] volume_clear_ionice = None {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] volume_clear_size = 0 {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] volume_copy_bps_limit = 0 {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] volume_dd_blocksize = 1M {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] volume_name_template = volume-%s {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] volume_service_inithost_offload = False {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] volume_usage_audit_period = month {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] zoning_mode = None {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] oslo_concurrency.disable_process_locking = False {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] keystone_authtoken.auth_section = None {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] keystone_authtoken.auth_type = password {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] keystone_authtoken.auth_version = None {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] keystone_authtoken.cache = None {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] keystone_authtoken.certfile = None {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] keystone_authtoken.delay_auth_decision = False {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] keystone_authtoken.http_connect_timeout = None {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] keystone_authtoken.include_service_catalog = True {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] keystone_authtoken.insecure = False {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] keystone_authtoken.interface = public {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] keystone_authtoken.keyfile = None {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] keystone_authtoken.memcache_password = {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] keystone_authtoken.memcache_username = {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] keystone_authtoken.region_name = None {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] keystone_authtoken.service_token_roles_required = True {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] keystone_authtoken.service_type = None {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] keystone_authtoken.token_cache_time = 300 {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.55/identity {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] cache.backend = dogpile.cache.null {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] cache.backend_argument = **** {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] cache.backend_expiration_time = None {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] cache.config_prefix = cache.oslo {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] cache.debug_cache_backend = False {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] cache.enable_retry_client = False {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] cache.enable_socket_keepalive = False {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] cache.enabled = False {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] cache.expiration_time = 600 {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] cache.hashclient_retry_attempts = 2 {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] cache.memcache_dead_retry = 300 {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] cache.memcache_pool_maxsize = 10 {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] cache.memcache_sasl_enabled = False {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] cache.password = **** {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] cache.proxies = [] {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] cache.redis_db = 0 {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] cache.redis_sentinel_service_name = mymaster {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] cache.redis_server = localhost:6379 {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] cache.retry_attempts = 2 {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] cache.retry_delay = 0.0 {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] cache.socket_keepalive_count = 1 {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] cache.socket_keepalive_idle = 1 {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] cache.socket_keepalive_interval = 1 {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] cache.socket_timeout = 1.0 {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] cache.tls_allowed_ciphers = None {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] cache.tls_cafile = None {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] cache.tls_certfile = None {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] cache.tls_enabled = False {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] cache.tls_keyfile = None {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] cache.username = None {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] coordination.backend_url = **** {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] database.asyncio_connection = **** {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] database.asyncio_slave_connection = **** {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] database.backend = sqlalchemy {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] database.connection = **** {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] database.connection_debug = 0 {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] database.connection_parameters = {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] database.connection_recycle_time = 3600 {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] database.connection_trace = False {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] database.db_inc_retry_interval = True {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] database.db_max_retries = 20 {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] database.db_max_retry_interval = 10 {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] database.db_retry_interval = 1 {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] database.max_overflow = 50 {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] database.max_pool_size = 5 {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] database.max_retries = 10 {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] database.mysql_wsrep_sync_wait = None {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] database.pool_timeout = None {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] database.retry_interval = 10 {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] database.slave_connection = **** {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] database.sqlite_synchronous = True {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] database.synchronous_reader = True {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] database.use_db_reconnect = False {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] profiler.connection_string = messaging:// {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] profiler.enabled = False {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] profiler.es_doc_type = notification {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] profiler.es_scroll_size = 10000 {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] profiler.es_scroll_time = 2m {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] profiler.filter_error_trace = False {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] profiler.hmac_keys = **** {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] profiler.sentinel_service_name = mymaster {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] profiler.socket_timeout = 0.1 {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] profiler.trace_requests = False {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] profiler.trace_sqlalchemy = False {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] profiler_jaeger.process_tags = {} {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] profiler_jaeger.service_name_prefix = None {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] profiler_otlp.service_name_prefix = None {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] oslo_policy.enforce_new_defaults = True {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] oslo_policy.policy_default_rule = default {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] oslo_policy.policy_file = policy.yaml {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] oslo_policy.remote_timeout = 60.0 {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] privsep_osbrick.group = None {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] privsep_osbrick.helper_command = None {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] privsep_osbrick.user = None {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] cinder_sys_admin.group = None {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] cinder_sys_admin.helper_command = None {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] cinder_sys_admin.user = None {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] service_user.auth_section = None {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] service_user.auth_type = password {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] service_user.cafile = None {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] service_user.certfile = None {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] service_user.collect_timing = False {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] service_user.insecure = False {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] service_user.keyfile = None {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] service_user.send_service_user_token = True {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] service_user.split_loggers = False {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] service_user.timeout = None {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] glance.auth_section = None {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] glance.auth_type = password {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] glance.certfile = None {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] glance.collect_timing = False {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] glance.insecure = False {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] glance.keyfile = None {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] glance.region_name = None {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] glance.split_loggers = False {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] glance.timeout = None {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] backend_defaults.backend_availability_zone = None {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] backend_defaults.chap_password = **** {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] backend_defaults.chap_username = {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:41 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-e5c3a3e7-dbba-4e44-860e-5bc566f8b42d None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=88899) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:307}} Aug 03 08:27:41 devstack cinder-volume[88899]: WARNING cinder.volume.drivers.quobyte [None req-e5c3a3e7-dbba-4e44-860e-5bc566f8b42d None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] backend_defaults.disk_geometry = None {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] backend_defaults.driver_client_cert = None {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] backend_defaults.driver_client_cert_key = None {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] backend_defaults.driver_data_namespace = None {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] backend_defaults.driver_use_ssl = False {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:41 devstack cinder-volume[88899]: WARNING cinder.volume.drivers.quobyte [None req-e5c3a3e7-dbba-4e44-860e-5bc566f8b42d None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] backend_defaults.enable_unsupported_driver = False {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] backend_defaults.extra_capabilities = {} {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] backend_defaults.filter_function = None {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:41 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-e5c3a3e7-dbba-4e44-860e-5bc566f8b42d None None] Running cmd (subprocess): mount.quobyte {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] backend_defaults.goodness_function = None {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] backend_defaults.iscsi_target_flags = {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] backend_defaults.iscsi_write_cache = on {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] backend_defaults.iser_helper = tgtadm {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] backend_defaults.iser_ip_address = 192.168.122.55 {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] backend_defaults.iser_port = 3260 {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] backend_defaults.nas_host = {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] backend_defaults.nas_login = admin {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] backend_defaults.nas_mount_options = None {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] backend_defaults.nas_password = **** {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] backend_defaults.nas_private_key = {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] backend_defaults.nas_share_path = {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] backend_defaults.nas_ssh_port = 22 {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] backend_defaults.num_shell_tries = 3 {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] backend_defaults.nvmet_port_id = 1 {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] backend_defaults.quobyte_client_cfg = None {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] backend_defaults.quobyte_volume_url = None {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] backend_defaults.replication_device = **** {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] backend_defaults.report_discard_supported = False {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] backend_defaults.reserved_percentage = 0 {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] backend_defaults.scst_target_driver = iscsi {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] backend_defaults.scst_target_iqn_name = None {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] backend_defaults.storage_protocol = iSCSI {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] backend_defaults.target_helper = tgtadm {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] backend_defaults.target_ip_address = 192.168.122.55 {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] backend_defaults.target_port = 3260 {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] backend_defaults.target_protocol = iscsi {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] backend_defaults.trace_flags = None {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] backend_defaults.unique_fqdn_network = True {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] backend_defaults.use_chap_auth = False {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] backend_defaults.volume_backend_name = None {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] backend_defaults.volume_clear = zero {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] backend_defaults.volume_clear_ionice = None {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] backend_defaults.volume_clear_size = 0 {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] oslo_reports.file_event_handler = None {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] oslo_reports.log_dir = None {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] QuobyteHD.backend_availability_zone = None {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] QuobyteHD.backend_host = None {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] QuobyteHD.chap_password = **** {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] QuobyteHD.chap_username = None {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] QuobyteHD.chiscsi_conf = None {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] QuobyteHD.disk_geometry = None {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] QuobyteHD.driver_client_cert = None {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] QuobyteHD.driver_client_cert_key = None {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] QuobyteHD.driver_data_namespace = None {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] QuobyteHD.driver_use_ssl = None {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] QuobyteHD.extra_capabilities = None {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] QuobyteHD.filter_function = None {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] QuobyteHD.goodness_function = None {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] QuobyteHD.iscsi_target_flags = None {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] QuobyteHD.iscsi_write_cache = None {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] QuobyteHD.iser_helper = None {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] QuobyteHD.iser_ip_address = None {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] QuobyteHD.iser_port = None {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] QuobyteHD.iser_target_prefix = None {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] QuobyteHD.nas_host = None {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] QuobyteHD.nas_login = None {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] QuobyteHD.nas_mount_options = None {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] QuobyteHD.nas_password = **** {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] QuobyteHD.nas_private_key = None {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] QuobyteHD.nas_share_path = None {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] QuobyteHD.nas_ssh_port = None {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] QuobyteHD.num_shell_tries = None {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] QuobyteHD.nvmet_ns_id = None {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] QuobyteHD.nvmet_port_id = None {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385 {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] QuobyteHD.replication_device = **** {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] QuobyteHD.report_discard_supported = None {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] QuobyteHD.reserved_percentage = None {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] QuobyteHD.scst_target_driver = None {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] QuobyteHD.storage_protocol = None {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] QuobyteHD.target_helper = None {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] QuobyteHD.target_ip_address = None {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] QuobyteHD.target_port = None {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] QuobyteHD.target_prefix = None {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] QuobyteHD.target_protocol = None {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] QuobyteHD.trace_flags = None {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] QuobyteHD.unique_fqdn_network = None {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] QuobyteHD.use_chap_auth = None {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] QuobyteHD.volume_clear = None {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] QuobyteHD.volume_clear_ionice = None {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] QuobyteHD.volume_clear_size = None {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] QuobyteHD.volumes_dir = None {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] oslo_messaging_rabbit.ssl = False {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] oslo_messaging_rabbit.ssl_version = {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] oslo_messaging_notifications.driver = [] {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] oslo_messaging_notifications.retry = -1 {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] oslo_messaging_notifications.transport_url = **** {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:41 devstack quobyte-client[88908]: Reading configuration file: /etc/quobyte/client.cfg Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] key_manager.fixed_key = **** {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] barbican.barbican_api_version = None {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] barbican.barbican_endpoint = None {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] barbican.barbican_endpoint_type = public {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] barbican.barbican_region_name = None {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] barbican.cafile = None {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:41 devstack quobyte-client[88908]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] barbican.certfile = None {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] barbican.collect_timing = False {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] barbican.insecure = False {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] barbican.keyfile = None {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] barbican.number_of_retries = 60 {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] barbican.retry_delay = 1 {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] barbican.send_service_user_token = False {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:41 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-e5c3a3e7-dbba-4e44-860e-5bc566f8b42d None None] CMD "mount.quobyte" returned: 1 in 0.086s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] barbican.split_loggers = False {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] barbican.timeout = None {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:41 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-e5c3a3e7-dbba-4e44-860e-5bc566f8b42d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] barbican.verify_ssl = True {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:41 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-e5c3a3e7-dbba-4e44-860e-5bc566f8b42d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] barbican.verify_ssl_path = None {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] barbican_service_user.auth_section = None {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] barbican_service_user.auth_type = None {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] barbican_service_user.cafile = None {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] barbican_service_user.certfile = None {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:41 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-e5c3a3e7-dbba-4e44-860e-5bc566f8b42d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] barbican_service_user.collect_timing = False {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] barbican_service_user.insecure = False {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] barbican_service_user.keyfile = None {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] barbican_service_user.split_loggers = False {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] barbican_service_user.timeout = None {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] vault.approle_role_id = **** {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] vault.approle_secret_id = **** {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] vault.auth_method = approle {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] vault.auth_path = None {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] vault.kv_mountpoint = secret {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] vault.kv_path = None {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] vault.kv_version = 2 {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] vault.namespace = None {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] vault.root_token_id = **** {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] vault.ssl_ca_crt_file = None {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] vault.timeout = 60.0 {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] vault.token_file = None {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] vault.token_role = None {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] vault.use_ssl = False {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:27:41 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-e5c3a3e7-dbba-4e44-860e-5bc566f8b42d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:27:41 devstack cinder-volume[88599]: DEBUG oslo_service.backend._eventlet.service [None req-f47c4be5-b829-4814-a81a-94d4b1e136c4 None None] ******************************************************************************** {{(pid=88599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Aug 03 08:27:41 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-e5c3a3e7-dbba-4e44-860e-5bc566f8b42d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:27:41 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-e5c3a3e7-dbba-4e44-860e-5bc566f8b42d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:27:41 devstack sudo[88909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a Aug 03 08:27:41 devstack sudo[88909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:27:41 devstack sudo[88909]: pam_unix(sudo:session): session closed for user root Aug 03 08:27:41 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-e5c3a3e7-dbba-4e44-860e-5bc566f8b42d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a" returned: 0 in 0.230s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:27:41 devstack cinder-volume[88899]: INFO cinder.volume.driver [None req-e5c3a3e7-dbba-4e44-860e-5bc566f8b42d None None] Driver hasn't implemented _init_vendor_properties() Aug 03 08:27:41 devstack cinder-volume[88899]: DEBUG cinder.volume.driver [None req-e5c3a3e7-dbba-4e44-860e-5bc566f8b42d None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.755386352539, 'free_capacity_gb': 1775.755386352539, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=88899) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Aug 03 08:27:42 devstack cinder-volume[88899]: DEBUG oslo_db.sqlalchemy.engines [None req-e5c3a3e7-dbba-4e44-860e-5bc566f8b42d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=88899) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 03 08:27:42 devstack cinder-volume[88899]: DEBUG dbcounter [-] [88899] Writer thread running {{(pid=88899) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Aug 03 08:27:42 devstack cinder-volume[88899]: DEBUG cinder.db.api [None req-e5c3a3e7-dbba-4e44-860e-5bc566f8b42d None None] Building query based on filter {{(pid=88899) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Aug 03 08:27:42 devstack cinder-volume[88899]: DEBUG cinder.image.image_utils [None req-e5c3a3e7-dbba-4e44-860e-5bc566f8b42d None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=88899) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Aug 03 08:27:42 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-e5c3a3e7-dbba-4e44-860e-5bc566f8b42d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:27:42 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-e5c3a3e7-dbba-4e44-860e-5bc566f8b42d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:27:42 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-e5c3a3e7-dbba-4e44-860e-5bc566f8b42d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:27:42 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-e5c3a3e7-dbba-4e44-860e-5bc566f8b42d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:27:42 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-e5c3a3e7-dbba-4e44-860e-5bc566f8b42d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:27:42 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-e5c3a3e7-dbba-4e44-860e-5bc566f8b42d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:27:42 devstack cinder-volume[88899]: INFO cinder.keymgr.migration [None req-5e4bd963-426e-4373-b632-315d2de039ad None None] Not migrating encryption keys because the ConfKeyManager is still in use. Aug 03 08:27:42 devstack sudo[88920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a Aug 03 08:27:42 devstack sudo[88920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:27:42 devstack sudo[88920]: pam_unix(sudo:session): session closed for user root Aug 03 08:27:42 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-e5c3a3e7-dbba-4e44-860e-5bc566f8b42d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a" returned: 0 in 0.255s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:27:42 devstack cinder-volume[88899]: DEBUG cinder.manager [None req-e5c3a3e7-dbba-4e44-860e-5bc566f8b42d None None] Notifying Schedulers of capabilities ... {{(pid=88899) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 08:27:42 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-e5c3a3e7-dbba-4e44-860e-5bc566f8b42d None None] Driver initialization completed successfully. Aug 03 08:27:42 devstack cinder-volume[88899]: INFO cinder.manager [None req-e5c3a3e7-dbba-4e44-860e-5bc566f8b42d None None] Initiating service 3 cleanup Aug 03 08:27:42 devstack cinder-volume[88899]: INFO cinder.manager [None req-e5c3a3e7-dbba-4e44-860e-5bc566f8b42d None None] Service 3 cleanup completed. Aug 03 08:27:42 devstack cinder-volume[88899]: DEBUG cinder.service [None req-e5c3a3e7-dbba-4e44-860e-5bc566f8b42d None None] Creating RPC server for service cinder-volume {{(pid=88899) start /opt/stack/cinder/cinder/service.py:231}} Aug 03 08:27:42 devstack cinder-volume[88899]: DEBUG cinder.service [None req-e5c3a3e7-dbba-4e44-860e-5bc566f8b42d None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=88899) start /opt/stack/cinder/cinder/service.py:237}} Aug 03 08:27:42 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-e5c3a3e7-dbba-4e44-860e-5bc566f8b42d None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2) Aug 03 08:27:42 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-e5c3a3e7-dbba-4e44-860e-5bc566f8b42d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:27:42 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-e5c3a3e7-dbba-4e44-860e-5bc566f8b42d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:27:42 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-e5c3a3e7-dbba-4e44-860e-5bc566f8b42d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:27:42 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-e5c3a3e7-dbba-4e44-860e-5bc566f8b42d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:27:42 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-e5c3a3e7-dbba-4e44-860e-5bc566f8b42d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:27:42 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-e5c3a3e7-dbba-4e44-860e-5bc566f8b42d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:27:42 devstack sudo[88934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a Aug 03 08:27:42 devstack sudo[88934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:27:42 devstack sudo[88934]: pam_unix(sudo:session): session closed for user root Aug 03 08:27:42 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-e5c3a3e7-dbba-4e44-860e-5bc566f8b42d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a" returned: 0 in 0.250s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:27:42 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-e5c3a3e7-dbba-4e44-860e-5bc566f8b42d None None] Driver post RPC initialization completed successfully. Aug 03 08:27:51 devstack cinder-volume[88599]: DEBUG dbcounter [-] [88599] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=88599) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 03 08:27:51 devstack cinder-volume[88899]: DEBUG oslo_service.periodic_task [None req-f948fb4a-c4d7-499f-b1bd-8d6be3de0b53 None None] Running periodic task VolumeManager._thread_info {{(pid=88899) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 03 08:27:51 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-f948fb4a-c4d7-499f-b1bd-8d6be3de0b53 None None] thread count: 6 {{(pid=88899) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 03 08:27:51 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-f948fb4a-c4d7-499f-b1bd-8d6be3de0b53 None None] thread info: [<_MainThread(MainThread, started 132234320248960)>, , , , , ] {{(pid=88899) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 03 08:27:52 devstack cinder-volume[88899]: DEBUG dbcounter [-] [88899] Writing DB stats cinder:SELECT=2 {{(pid=88899) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 03 08:27:52 devstack cinder-volume[88899]: DEBUG dbcounter [-] [88899] Writing DB stats cinder:SELECT=8,cinder:UPDATE=1 {{(pid=88899) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 03 08:28:51 devstack cinder-volume[88899]: DEBUG oslo_service.periodic_task [None req-f948fb4a-c4d7-499f-b1bd-8d6be3de0b53 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88899) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 03 08:28:51 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-f948fb4a-c4d7-499f-b1bd-8d6be3de0b53 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:28:51 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-f948fb4a-c4d7-499f-b1bd-8d6be3de0b53 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:28:51 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-f948fb4a-c4d7-499f-b1bd-8d6be3de0b53 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:28:51 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-f948fb4a-c4d7-499f-b1bd-8d6be3de0b53 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:28:51 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-f948fb4a-c4d7-499f-b1bd-8d6be3de0b53 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.039s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:28:51 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-f948fb4a-c4d7-499f-b1bd-8d6be3de0b53 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:28:51 devstack sudo[89563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a Aug 03 08:28:51 devstack sudo[89563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:28:52 devstack sudo[89563]: pam_unix(sudo:session): session closed for user root Aug 03 08:28:52 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-f948fb4a-c4d7-499f-b1bd-8d6be3de0b53 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a" returned: 0 in 0.651s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:28:52 devstack cinder-volume[88899]: DEBUG cinder.manager [None req-f948fb4a-c4d7-499f-b1bd-8d6be3de0b53 None None] Notifying Schedulers of capabilities ... {{(pid=88899) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 08:28:52 devstack cinder-volume[88899]: DEBUG oslo_service.periodic_task [None req-f948fb4a-c4d7-499f-b1bd-8d6be3de0b53 None None] Running periodic task VolumeManager._thread_info {{(pid=88899) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 03 08:28:52 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-f948fb4a-c4d7-499f-b1bd-8d6be3de0b53 None None] thread count: 6 {{(pid=88899) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 03 08:28:52 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-f948fb4a-c4d7-499f-b1bd-8d6be3de0b53 None None] thread info: [<_MainThread(MainThread, started 132234320248960)>, , , , , ] {{(pid=88899) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 03 08:28:58 devstack cinder-volume[88899]: DEBUG cinder.volume.flows.manager.create_volume [None req-61aa3214-f503-4918-ae93-1da7044beaf2 tempest-DeleteServersTestJSON-824640053 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88899) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 08:28:58 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-61aa3214-f503-4918-ae93-1da7044beaf2 tempest-DeleteServersTestJSON-824640053 None] Flow 'volume_create_manager' (09585f68-da86-40ba-93c7-1ed084ad75b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:28:58 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-61aa3214-f503-4918-ae93-1da7044beaf2 tempest-DeleteServersTestJSON-824640053 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2601f2f7-5042-4b56-af5a-210495d056ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:28:58 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-61aa3214-f503-4918-ae93-1da7044beaf2 tempest-DeleteServersTestJSON-824640053 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2601f2f7-5042-4b56-af5a-210495d056ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:28:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-971349421',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c2afe4f4-5621-4034-85db-32c64b552000,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='624c3289caae439eb49e6f8e6210fa90',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:28:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:28:58Z,use_quota=True,user_id='404fac8af67742baaecfdef63bcd8ba5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8bde7129-1dc4-42ab-b852-ab32c61b4921),volume_type_id=8bde7129-1dc4-42ab-b852-ab32c61b4921)' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:28:58 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-61aa3214-f503-4918-ae93-1da7044beaf2 tempest-DeleteServersTestJSON-824640053 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bbf3e162-e48d-4a52-a94f-74f3b934839c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:28:58 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-61aa3214-f503-4918-ae93-1da7044beaf2 tempest-DeleteServersTestJSON-824640053 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bbf3e162-e48d-4a52-a94f-74f3b934839c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:28:58 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-61aa3214-f503-4918-ae93-1da7044beaf2 tempest-DeleteServersTestJSON-824640053 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db60ebe5-09c4-4eab-8c42-7e68a6b45741) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:28:58 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-61aa3214-f503-4918-ae93-1da7044beaf2 tempest-DeleteServersTestJSON-824640053 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db60ebe5-09c4-4eab-8c42-7e68a6b45741) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c2afe4f4-5621-4034-85db-32c64b552000', 'volume_name': 'volume-c2afe4f4-5621-4034-85db-32c64b552000', 'volume_size': 1}' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:28:58 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-61aa3214-f503-4918-ae93-1da7044beaf2 tempest-DeleteServersTestJSON-824640053 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (603c978f-4141-4589-b812-bf82d3b1a6d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:28:58 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-61aa3214-f503-4918-ae93-1da7044beaf2 tempest-DeleteServersTestJSON-824640053 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (603c978f-4141-4589-b812-bf82d3b1a6d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:28:58 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-61aa3214-f503-4918-ae93-1da7044beaf2 tempest-DeleteServersTestJSON-824640053 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c68aa352-77c2-4c94-90f1-83eb7d3cf487) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:28:58 devstack cinder-volume[88899]: INFO cinder.volume.flows.manager.create_volume [None req-61aa3214-f503-4918-ae93-1da7044beaf2 tempest-DeleteServersTestJSON-824640053 None] Volume c2afe4f4-5621-4034-85db-32c64b552000: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c2afe4f4-5621-4034-85db-32c64b552000', 'volume_size': 1} Aug 03 08:28:58 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-61aa3214-f503-4918-ae93-1da7044beaf2 tempest-DeleteServersTestJSON-824640053 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:28:58 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-61aa3214-f503-4918-ae93-1da7044beaf2 tempest-DeleteServersTestJSON-824640053 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:28:58 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-61aa3214-f503-4918-ae93-1da7044beaf2 tempest-DeleteServersTestJSON-824640053 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:28:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-971349421',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c2afe4f4-5621-4034-85db-32c64b552000,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='624c3289caae439eb49e6f8e6210fa90',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:28:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:28:58Z,use_quota=True,user_id='404fac8af67742baaecfdef63bcd8ba5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8bde7129-1dc4-42ab-b852-ab32c61b4921),volume_type_id=8bde7129-1dc4-42ab-b852-ab32c61b4921)}" {{(pid=88899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 08:28:58 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-61aa3214-f503-4918-ae93-1da7044beaf2 tempest-DeleteServersTestJSON-824640053 None] Creating volume c2afe4f4-5621-4034-85db-32c64b552000 {{(pid=88899) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 08:28:58 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-61aa3214-f503-4918-ae93-1da7044beaf2 tempest-DeleteServersTestJSON-824640053 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:28:58 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-61aa3214-f503-4918-ae93-1da7044beaf2 tempest-DeleteServersTestJSON-824640053 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:28:58 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-61aa3214-f503-4918-ae93-1da7044beaf2 tempest-DeleteServersTestJSON-824640053 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:28:58 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-61aa3214-f503-4918-ae93-1da7044beaf2 tempest-DeleteServersTestJSON-824640053 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:28:58 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-61aa3214-f503-4918-ae93-1da7044beaf2 tempest-DeleteServersTestJSON-824640053 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:28:58 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-61aa3214-f503-4918-ae93-1da7044beaf2 tempest-DeleteServersTestJSON-824640053 None] Selected osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385 as target Quobyte volume. {{(pid=88899) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 08:28:58 devstack cinder-volume[88899]: INFO cinder.volume.drivers.remotefs [None req-61aa3214-f503-4918-ae93-1da7044beaf2 tempest-DeleteServersTestJSON-824640053 None] casted to osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385 Aug 03 08:28:58 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-61aa3214-f503-4918-ae93-1da7044beaf2 tempest-DeleteServersTestJSON-824640053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c2afe4f4-5621-4034-85db-32c64b552000 1073741824 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:28:58 devstack sudo[89668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c2afe4f4-5621-4034-85db-32c64b552000 1073741824 Aug 03 08:28:58 devstack sudo[89668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:28:59 devstack sudo[89668]: pam_unix(sudo:session): session closed for user root Aug 03 08:28:59 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-61aa3214-f503-4918-ae93-1da7044beaf2 tempest-DeleteServersTestJSON-824640053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c2afe4f4-5621-4034-85db-32c64b552000 1073741824" returned: 0 in 1.145s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:29:00 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-61aa3214-f503-4918-ae93-1da7044beaf2 tempest-DeleteServersTestJSON-824640053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c2afe4f4-5621-4034-85db-32c64b552000 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:29:00 devstack sudo[89988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c2afe4f4-5621-4034-85db-32c64b552000 Aug 03 08:29:00 devstack sudo[89988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:29:00 devstack sudo[89988]: pam_unix(sudo:session): session closed for user root Aug 03 08:29:00 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-61aa3214-f503-4918-ae93-1da7044beaf2 tempest-DeleteServersTestJSON-824640053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c2afe4f4-5621-4034-85db-32c64b552000" returned: 0 in 0.506s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:29:00 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-61aa3214-f503-4918-ae93-1da7044beaf2 tempest-DeleteServersTestJSON-824640053 None] <== create_volume: return (1758ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'} {{(pid=88899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 08:29:00 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-61aa3214-f503-4918-ae93-1da7044beaf2 tempest-DeleteServersTestJSON-824640053 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.766s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:29:00 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-61aa3214-f503-4918-ae93-1da7044beaf2 tempest-DeleteServersTestJSON-824640053 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c68aa352-77c2-4c94-90f1-83eb7d3cf487) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c2afe4f4-5621-4034-85db-32c64b552000', 'volume_size': 1}' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:29:00 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-61aa3214-f503-4918-ae93-1da7044beaf2 tempest-DeleteServersTestJSON-824640053 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e065dd8e-4c01-44d6-93d8-85b2e52284c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:29:00 devstack cinder-volume[88899]: INFO cinder.volume.flows.manager.create_volume [None req-61aa3214-f503-4918-ae93-1da7044beaf2 tempest-DeleteServersTestJSON-824640053 None] Volume volume-c2afe4f4-5621-4034-85db-32c64b552000 (c2afe4f4-5621-4034-85db-32c64b552000): created successfully Aug 03 08:29:00 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-61aa3214-f503-4918-ae93-1da7044beaf2 tempest-DeleteServersTestJSON-824640053 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e065dd8e-4c01-44d6-93d8-85b2e52284c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:29:00 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-61aa3214-f503-4918-ae93-1da7044beaf2 tempest-DeleteServersTestJSON-824640053 None] Flow 'volume_create_manager' (09585f68-da86-40ba-93c7-1ed084ad75b6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:29:00 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-61aa3214-f503-4918-ae93-1da7044beaf2 tempest-DeleteServersTestJSON-824640053 None] Created volume successfully. Aug 03 08:29:08 devstack cinder-volume[88899]: WARNING py.warnings [req-d153715b-b7f3-4b9e-af9c-096f02312ebf req-21dfdeaa-7fa1-41d7-a094-44aaed74d1f3 tempest-DeleteServersTestJSON-824640053 None] /opt/stack/cinder/cinder/db/api.py:2468: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes" and FROM element "volumes_1". Apply join condition(s) between each element to resolve. Aug 03 08:29:08 devstack cinder-volume[88899]: .first() Aug 03 08:29:08 devstack cinder-volume[88899]: Aug 03 08:29:08 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [req-d153715b-b7f3-4b9e-af9c-096f02312ebf req-21dfdeaa-7fa1-41d7-a094-44aaed74d1f3 tempest-DeleteServersTestJSON-824640053 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:29:08 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [req-d153715b-b7f3-4b9e-af9c-096f02312ebf req-21dfdeaa-7fa1-41d7-a094-44aaed74d1f3 tempest-DeleteServersTestJSON-824640053 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:29:08 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [req-d153715b-b7f3-4b9e-af9c-096f02312ebf req-21dfdeaa-7fa1-41d7-a094-44aaed74d1f3 tempest-DeleteServersTestJSON-824640053 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.075s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:29:08 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [req-d153715b-b7f3-4b9e-af9c-096f02312ebf req-21dfdeaa-7fa1-41d7-a094-44aaed74d1f3 tempest-DeleteServersTestJSON-824640053 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385', 'name': 'volume-c2afe4f4-5621-4034-85db-32c64b552000', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'fe51b5f7-a559-47bd-8445-209cc4aec419', 'enforce_multipath': True} {{(pid=88899) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 03 08:29:08 devstack cinder-volume[88899]: INFO cinder.volume.manager [req-d153715b-b7f3-4b9e-af9c-096f02312ebf req-21dfdeaa-7fa1-41d7-a094-44aaed74d1f3 tempest-DeleteServersTestJSON-824640053 None] attachment_update completed successfully. Aug 03 08:29:10 devstack cinder-volume[88899]: DEBUG cinder.volume.flows.manager.create_volume [None req-8c3d3e31-22af-4851-885c-1cb856d5acda tempest-VolumesAdminNegativeTest-1981679971 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88899) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 08:29:10 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-8c3d3e31-22af-4851-885c-1cb856d5acda tempest-VolumesAdminNegativeTest-1981679971 None] Flow 'volume_create_manager' (4270e402-fc02-49aa-9b8e-9fd1be346638) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:29:10 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-8c3d3e31-22af-4851-885c-1cb856d5acda tempest-VolumesAdminNegativeTest-1981679971 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9fb5384-4488-43e3-969f-c3093a6a8460) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:29:10 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-8c3d3e31-22af-4851-885c-1cb856d5acda tempest-VolumesAdminNegativeTest-1981679971 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9fb5384-4488-43e3-969f-c3093a6a8460) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:29:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1415449296',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ac14f718-36ee-4638-8f06-aaaebec7d677,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e6f2aeffbcbc432087a7bfa63121765d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:29:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:29:11Z,use_quota=True,user_id='b0165e181e8e4de88ba91f26a168e596',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8bde7129-1dc4-42ab-b852-ab32c61b4921),volume_type_id=8bde7129-1dc4-42ab-b852-ab32c61b4921)' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:29:10 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-8c3d3e31-22af-4851-885c-1cb856d5acda tempest-VolumesAdminNegativeTest-1981679971 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (74c58c9d-e76f-442e-9324-f75ebd4f0b02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:29:10 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-8c3d3e31-22af-4851-885c-1cb856d5acda tempest-VolumesAdminNegativeTest-1981679971 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (74c58c9d-e76f-442e-9324-f75ebd4f0b02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:29:10 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-8c3d3e31-22af-4851-885c-1cb856d5acda tempest-VolumesAdminNegativeTest-1981679971 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7afd1cdd-d2be-4ba7-899b-b208180a72b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:29:10 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-8c3d3e31-22af-4851-885c-1cb856d5acda tempest-VolumesAdminNegativeTest-1981679971 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7afd1cdd-d2be-4ba7-899b-b208180a72b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ac14f718-36ee-4638-8f06-aaaebec7d677', 'volume_name': 'volume-ac14f718-36ee-4638-8f06-aaaebec7d677', 'volume_size': 1}' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:29:10 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-8c3d3e31-22af-4851-885c-1cb856d5acda tempest-VolumesAdminNegativeTest-1981679971 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f56d8423-5776-424e-9db7-e31b249489fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:29:10 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-8c3d3e31-22af-4851-885c-1cb856d5acda tempest-VolumesAdminNegativeTest-1981679971 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f56d8423-5776-424e-9db7-e31b249489fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:29:10 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-8c3d3e31-22af-4851-885c-1cb856d5acda tempest-VolumesAdminNegativeTest-1981679971 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b27416a-e2b0-4860-89d3-421283cb4a20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:29:10 devstack cinder-volume[88899]: INFO cinder.volume.flows.manager.create_volume [None req-8c3d3e31-22af-4851-885c-1cb856d5acda tempest-VolumesAdminNegativeTest-1981679971 None] Volume ac14f718-36ee-4638-8f06-aaaebec7d677: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ac14f718-36ee-4638-8f06-aaaebec7d677', 'volume_size': 1} Aug 03 08:29:10 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-8c3d3e31-22af-4851-885c-1cb856d5acda tempest-VolumesAdminNegativeTest-1981679971 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:29:10 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-8c3d3e31-22af-4851-885c-1cb856d5acda tempest-VolumesAdminNegativeTest-1981679971 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:29:10 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-8c3d3e31-22af-4851-885c-1cb856d5acda tempest-VolumesAdminNegativeTest-1981679971 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:29:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1415449296',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ac14f718-36ee-4638-8f06-aaaebec7d677,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e6f2aeffbcbc432087a7bfa63121765d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:29:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:29:11Z,use_quota=True,user_id='b0165e181e8e4de88ba91f26a168e596',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8bde7129-1dc4-42ab-b852-ab32c61b4921),volume_type_id=8bde7129-1dc4-42ab-b852-ab32c61b4921)}" {{(pid=88899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 08:29:10 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-8c3d3e31-22af-4851-885c-1cb856d5acda tempest-VolumesAdminNegativeTest-1981679971 None] Creating volume ac14f718-36ee-4638-8f06-aaaebec7d677 {{(pid=88899) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 08:29:10 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-8c3d3e31-22af-4851-885c-1cb856d5acda tempest-VolumesAdminNegativeTest-1981679971 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:29:10 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-8c3d3e31-22af-4851-885c-1cb856d5acda tempest-VolumesAdminNegativeTest-1981679971 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:29:10 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-8c3d3e31-22af-4851-885c-1cb856d5acda tempest-VolumesAdminNegativeTest-1981679971 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:29:10 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-8c3d3e31-22af-4851-885c-1cb856d5acda tempest-VolumesAdminNegativeTest-1981679971 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:29:10 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-8c3d3e31-22af-4851-885c-1cb856d5acda tempest-VolumesAdminNegativeTest-1981679971 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:29:10 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-8c3d3e31-22af-4851-885c-1cb856d5acda tempest-VolumesAdminNegativeTest-1981679971 None] Selected osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385 as target Quobyte volume. {{(pid=88899) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 08:29:10 devstack cinder-volume[88899]: INFO cinder.volume.drivers.remotefs [None req-8c3d3e31-22af-4851-885c-1cb856d5acda tempest-VolumesAdminNegativeTest-1981679971 None] casted to osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385 Aug 03 08:29:10 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-8c3d3e31-22af-4851-885c-1cb856d5acda tempest-VolumesAdminNegativeTest-1981679971 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-ac14f718-36ee-4638-8f06-aaaebec7d677 1073741824 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:29:10 devstack sudo[90567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-ac14f718-36ee-4638-8f06-aaaebec7d677 1073741824 Aug 03 08:29:10 devstack sudo[90567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:29:11 devstack sudo[90567]: pam_unix(sudo:session): session closed for user root Aug 03 08:29:11 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-8c3d3e31-22af-4851-885c-1cb856d5acda tempest-VolumesAdminNegativeTest-1981679971 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-ac14f718-36ee-4638-8f06-aaaebec7d677 1073741824" returned: 0 in 0.791s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:29:11 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-8c3d3e31-22af-4851-885c-1cb856d5acda tempest-VolumesAdminNegativeTest-1981679971 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-ac14f718-36ee-4638-8f06-aaaebec7d677 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:29:11 devstack sudo[90585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-ac14f718-36ee-4638-8f06-aaaebec7d677 Aug 03 08:29:11 devstack sudo[90585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:29:12 devstack sudo[90585]: pam_unix(sudo:session): session closed for user root Aug 03 08:29:12 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-8c3d3e31-22af-4851-885c-1cb856d5acda tempest-VolumesAdminNegativeTest-1981679971 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-ac14f718-36ee-4638-8f06-aaaebec7d677" returned: 0 in 0.526s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:29:12 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-8c3d3e31-22af-4851-885c-1cb856d5acda tempest-VolumesAdminNegativeTest-1981679971 None] <== create_volume: return (1399ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'} {{(pid=88899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 08:29:12 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-8c3d3e31-22af-4851-885c-1cb856d5acda tempest-VolumesAdminNegativeTest-1981679971 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.402s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:29:12 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-8c3d3e31-22af-4851-885c-1cb856d5acda tempest-VolumesAdminNegativeTest-1981679971 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b27416a-e2b0-4860-89d3-421283cb4a20) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ac14f718-36ee-4638-8f06-aaaebec7d677', 'volume_size': 1}' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:29:12 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-8c3d3e31-22af-4851-885c-1cb856d5acda tempest-VolumesAdminNegativeTest-1981679971 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c612e3b8-c22b-4d2a-bb7c-6ce35900c513) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:29:12 devstack cinder-volume[88899]: INFO cinder.volume.flows.manager.create_volume [None req-8c3d3e31-22af-4851-885c-1cb856d5acda tempest-VolumesAdminNegativeTest-1981679971 None] Volume volume-ac14f718-36ee-4638-8f06-aaaebec7d677 (ac14f718-36ee-4638-8f06-aaaebec7d677): created successfully Aug 03 08:29:12 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-8c3d3e31-22af-4851-885c-1cb856d5acda tempest-VolumesAdminNegativeTest-1981679971 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c612e3b8-c22b-4d2a-bb7c-6ce35900c513) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:29:12 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-8c3d3e31-22af-4851-885c-1cb856d5acda tempest-VolumesAdminNegativeTest-1981679971 None] Flow 'volume_create_manager' (4270e402-fc02-49aa-9b8e-9fd1be346638) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:29:12 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-8c3d3e31-22af-4851-885c-1cb856d5acda tempest-VolumesAdminNegativeTest-1981679971 None] Created volume successfully. Aug 03 08:29:13 devstack cinder-volume[88899]: INFO cinder.volume.manager [req-6d5b55d8-7785-4f8c-a84e-55e35db056ec req-53225627-ad71-4eff-9b7d-e52767308281 tempest-DeleteServersTestJSON-824640053 None] Terminate volume connection completed successfully. Aug 03 08:29:13 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [req-6d5b55d8-7785-4f8c-a84e-55e35db056ec req-53225627-ad71-4eff-9b7d-e52767308281 tempest-DeleteServersTestJSON-824640053 None] Deleting attachment fe51b5f7-a559-47bd-8445-209cc4aec419. {{(pid=88899) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 03 08:29:13 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-b943b8bc-1a09-489d-b67b-56c462274fa3 tempest-VolumesAdminNegativeTest-1981679971 None] Acquiring lock "cinder-ac14f718-36ee-4638-8f06-aaaebec7d677-delete_volume" by "delete_volume" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:29:13 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-b943b8bc-1a09-489d-b67b-56c462274fa3 tempest-VolumesAdminNegativeTest-1981679971 None] Lock "cinder-ac14f718-36ee-4638-8f06-aaaebec7d677-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:29:13 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-b943b8bc-1a09-489d-b67b-56c462274fa3 tempest-VolumesAdminNegativeTest-1981679971 None] Acquiring lock "cinder-quobyte-ac14f718-36ee-4638-8f06-aaaebec7d677" by "delete_volume" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:29:13 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-b943b8bc-1a09-489d-b67b-56c462274fa3 tempest-VolumesAdminNegativeTest-1981679971 None] Lock "cinder-quobyte-ac14f718-36ee-4638-8f06-aaaebec7d677" acquired by "delete_volume" :: waited 0.031s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:29:13 devstack cinder-volume[88899]: INFO oslo.privsep.daemon [None req-b943b8bc-1a09-489d-b67b-56c462274fa3 tempest-VolumesAdminNegativeTest-1981679971 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmp6t1q2um8/privsep.sock'] Aug 03 08:29:14 devstack sudo[90629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmp6t1q2um8/privsep.sock Aug 03 08:29:14 devstack sudo[90629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:29:15 devstack cinder-volume[88899]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:105: EventletDeprecationWarning: Aug 03 08:29:15 devstack cinder-volume[88899]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Aug 03 08:29:15 devstack cinder-volume[88899]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Aug 03 08:29:15 devstack cinder-volume[88899]: WARNING oslo.privsep.daemon [-] privsep log: Aug 03 08:29:15 devstack cinder-volume[88899]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Aug 03 08:29:15 devstack cinder-volume[88899]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Aug 03 08:29:15 devstack cinder-volume[88899]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Aug 03 08:29:15 devstack cinder-volume[88899]: WARNING oslo.privsep.daemon [-] privsep log: Aug 03 08:29:15 devstack cinder-volume[88899]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet Aug 03 08:29:15 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-5c0b6fd7-9f3e-457a-903e-03d8f0fcd088 tempest-DeleteServersTestJSON-824640053 None] Acquiring lock "cinder-c2afe4f4-5621-4034-85db-32c64b552000-delete_volume" by "delete_volume" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:29:15 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-5c0b6fd7-9f3e-457a-903e-03d8f0fcd088 tempest-DeleteServersTestJSON-824640053 None] Lock "cinder-c2afe4f4-5621-4034-85db-32c64b552000-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:29:15 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-5c0b6fd7-9f3e-457a-903e-03d8f0fcd088 tempest-DeleteServersTestJSON-824640053 None] Acquiring lock "cinder-quobyte-c2afe4f4-5621-4034-85db-32c64b552000" by "delete_volume" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:29:15 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-5c0b6fd7-9f3e-457a-903e-03d8f0fcd088 tempest-DeleteServersTestJSON-824640053 None] Lock "cinder-quobyte-c2afe4f4-5621-4034-85db-32c64b552000" acquired by "delete_volume" :: waited 0.024s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:29:16 devstack sudo[90629]: pam_unix(sudo:session): session closed for user root Aug 03 08:29:16 devstack cinder-volume[88899]: INFO oslo.privsep.daemon [None req-b943b8bc-1a09-489d-b67b-56c462274fa3 tempest-VolumesAdminNegativeTest-1981679971 None] Spawned new privsep daemon via rootwrap Aug 03 08:29:16 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [None req-b943b8bc-1a09-489d-b67b-56c462274fa3 tempest-VolumesAdminNegativeTest-1981679971 None] Accepted privsep connection to /tmp/tmp6t1q2um8/privsep.sock {{(pid=88899) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}} Aug 03 08:29:16 devstack cinder-volume[88899]: INFO oslo.privsep.daemon [-] privsep daemon starting Aug 03 08:29:16 devstack cinder-volume[88899]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Aug 03 08:29:16 devstack cinder-volume[88899]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Aug 03 08:29:16 devstack cinder-volume[88899]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 90633 Aug 03 08:29:16 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc42d2de-7b6d-41f9-ac8c-a1d21d62e6c5]: (2,) {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:29:16 devstack cinder-volume[88899]: WARNING oslo_privsep.priv_context [None req-5c0b6fd7-9f3e-457a-903e-03d8f0fcd088 tempest-DeleteServersTestJSON-824640053 None] privsep daemon already running Aug 03 08:29:16 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6bec15b-5cff-482e-bbcd-32ada08a82ae]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:29:16 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[a67180b4-8258-4a8b-bc1b-4816a0e51ddf]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:29:16 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-b943b8bc-1a09-489d-b67b-56c462274fa3 tempest-VolumesAdminNegativeTest-1981679971 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-ac14f718-36ee-4638-8f06-aaaebec7d677 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:29:16 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-5c0b6fd7-9f3e-457a-903e-03d8f0fcd088 tempest-DeleteServersTestJSON-824640053 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c2afe4f4-5621-4034-85db-32c64b552000 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:29:16 devstack sudo[90637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c2afe4f4-5621-4034-85db-32c64b552000 Aug 03 08:29:16 devstack sudo[90636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-ac14f718-36ee-4638-8f06-aaaebec7d677 Aug 03 08:29:16 devstack sudo[90637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:29:16 devstack sudo[90636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:29:16 devstack sudo[90636]: pam_unix(sudo:session): session closed for user root Aug 03 08:29:17 devstack sudo[90637]: pam_unix(sudo:session): session closed for user root Aug 03 08:29:17 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-b943b8bc-1a09-489d-b67b-56c462274fa3 tempest-VolumesAdminNegativeTest-1981679971 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-ac14f718-36ee-4638-8f06-aaaebec7d677" returned: 0 in 0.749s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:29:17 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-b943b8bc-1a09-489d-b67b-56c462274fa3 tempest-VolumesAdminNegativeTest-1981679971 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-ac14f718-36ee-4638-8f06-aaaebec7d677 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:29:17 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-5c0b6fd7-9f3e-457a-903e-03d8f0fcd088 tempest-DeleteServersTestJSON-824640053 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c2afe4f4-5621-4034-85db-32c64b552000" returned: 0 in 0.781s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:29:17 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-5c0b6fd7-9f3e-457a-903e-03d8f0fcd088 tempest-DeleteServersTestJSON-824640053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c2afe4f4-5621-4034-85db-32c64b552000 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:29:17 devstack sudo[90647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-ac14f718-36ee-4638-8f06-aaaebec7d677 Aug 03 08:29:17 devstack sudo[90647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:29:17 devstack sudo[90650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c2afe4f4-5621-4034-85db-32c64b552000 Aug 03 08:29:17 devstack sudo[90650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:29:17 devstack sudo[90647]: pam_unix(sudo:session): session closed for user root Aug 03 08:29:17 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-b943b8bc-1a09-489d-b67b-56c462274fa3 tempest-VolumesAdminNegativeTest-1981679971 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-ac14f718-36ee-4638-8f06-aaaebec7d677" returned: 0 in 0.397s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:29:17 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-b943b8bc-1a09-489d-b67b-56c462274fa3 tempest-VolumesAdminNegativeTest-1981679971 None] Lock "cinder-quobyte-ac14f718-36ee-4638-8f06-aaaebec7d677" released by "delete_volume" :: held 3.489s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:29:17 devstack cinder-volume[88899]: WARNING cinder.quota [None req-b943b8bc-1a09-489d-b67b-56c462274fa3 tempest-VolumesAdminNegativeTest-1981679971 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Aug 03 08:29:17 devstack cinder-volume[88899]: WARNING cinder.quota [None req-b943b8bc-1a09-489d-b67b-56c462274fa3 tempest-VolumesAdminNegativeTest-1981679971 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Aug 03 08:29:17 devstack cinder-volume[88899]: DEBUG cinder.quota [None req-b943b8bc-1a09-489d-b67b-56c462274fa3 tempest-VolumesAdminNegativeTest-1981679971 None] Created reservations ['89d1cd74-fcaa-474f-809c-d891b18b44e8', '240fc315-45b1-4a0b-a6a4-6b528b2d8ac6', '289e9548-e0a7-4917-8be4-6421c0625bf8', 'd1270996-d3e2-4149-97b8-45111a0de42f'] {{(pid=88899) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 08:29:17 devstack sudo[90650]: pam_unix(sudo:session): session closed for user root Aug 03 08:29:17 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-5c0b6fd7-9f3e-457a-903e-03d8f0fcd088 tempest-DeleteServersTestJSON-824640053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c2afe4f4-5621-4034-85db-32c64b552000" returned: 0 in 0.550s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:29:17 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-5c0b6fd7-9f3e-457a-903e-03d8f0fcd088 tempest-DeleteServersTestJSON-824640053 None] Lock "cinder-quobyte-c2afe4f4-5621-4034-85db-32c64b552000" released by "delete_volume" :: held 1.661s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:29:17 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-b943b8bc-1a09-489d-b67b-56c462274fa3 tempest-VolumesAdminNegativeTest-1981679971 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:29:17 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-b943b8bc-1a09-489d-b67b-56c462274fa3 tempest-VolumesAdminNegativeTest-1981679971 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:29:17 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-b943b8bc-1a09-489d-b67b-56c462274fa3 tempest-VolumesAdminNegativeTest-1981679971 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:29:17 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-b943b8bc-1a09-489d-b67b-56c462274fa3 tempest-VolumesAdminNegativeTest-1981679971 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:29:17 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-b943b8bc-1a09-489d-b67b-56c462274fa3 tempest-VolumesAdminNegativeTest-1981679971 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:29:17 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-b943b8bc-1a09-489d-b67b-56c462274fa3 tempest-VolumesAdminNegativeTest-1981679971 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:29:17 devstack sudo[90655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a Aug 03 08:29:17 devstack sudo[90655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:29:17 devstack cinder-volume[88899]: DEBUG cinder.quota [None req-5c0b6fd7-9f3e-457a-903e-03d8f0fcd088 tempest-DeleteServersTestJSON-824640053 None] Created reservations ['479a0da5-9eb6-4bdd-b88f-1c5a82b7cb60', 'f1649920-a996-4184-ae42-2a8ac1a5a936', 'e5cff900-4a22-499b-b52b-3e3db35e42f5', 'b2f09b23-55b7-4b56-b6af-af067907d700'] {{(pid=88899) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 08:29:17 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-5c0b6fd7-9f3e-457a-903e-03d8f0fcd088 tempest-DeleteServersTestJSON-824640053 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:29:17 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-5c0b6fd7-9f3e-457a-903e-03d8f0fcd088 tempest-DeleteServersTestJSON-824640053 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:29:17 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-5c0b6fd7-9f3e-457a-903e-03d8f0fcd088 tempest-DeleteServersTestJSON-824640053 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:29:17 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-5c0b6fd7-9f3e-457a-903e-03d8f0fcd088 tempest-DeleteServersTestJSON-824640053 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:29:17 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-5c0b6fd7-9f3e-457a-903e-03d8f0fcd088 tempest-DeleteServersTestJSON-824640053 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:29:17 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-5c0b6fd7-9f3e-457a-903e-03d8f0fcd088 tempest-DeleteServersTestJSON-824640053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:29:17 devstack sudo[90657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a Aug 03 08:29:17 devstack sudo[90657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:29:18 devstack sudo[90655]: pam_unix(sudo:session): session closed for user root Aug 03 08:29:18 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-b943b8bc-1a09-489d-b67b-56c462274fa3 tempest-VolumesAdminNegativeTest-1981679971 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a" returned: 0 in 0.317s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:29:18 devstack cinder-volume[88899]: DEBUG cinder.manager [None req-b943b8bc-1a09-489d-b67b-56c462274fa3 tempest-VolumesAdminNegativeTest-1981679971 None] Notifying Schedulers of capabilities ... {{(pid=88899) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 08:29:18 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-b943b8bc-1a09-489d-b67b-56c462274fa3 tempest-VolumesAdminNegativeTest-1981679971 None] Deleted volume successfully. Aug 03 08:29:18 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-b943b8bc-1a09-489d-b67b-56c462274fa3 tempest-VolumesAdminNegativeTest-1981679971 None] Lock "cinder-ac14f718-36ee-4638-8f06-aaaebec7d677-delete_volume" released by "delete_volume" :: held 4.294s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:29:18 devstack sudo[90657]: pam_unix(sudo:session): session closed for user root Aug 03 08:29:18 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-5c0b6fd7-9f3e-457a-903e-03d8f0fcd088 tempest-DeleteServersTestJSON-824640053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a" returned: 0 in 0.341s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:29:18 devstack cinder-volume[88899]: DEBUG cinder.manager [None req-5c0b6fd7-9f3e-457a-903e-03d8f0fcd088 tempest-DeleteServersTestJSON-824640053 None] Notifying Schedulers of capabilities ... {{(pid=88899) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 08:29:18 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-5c0b6fd7-9f3e-457a-903e-03d8f0fcd088 tempest-DeleteServersTestJSON-824640053 None] Deleted volume successfully. Aug 03 08:29:18 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-5c0b6fd7-9f3e-457a-903e-03d8f0fcd088 tempest-DeleteServersTestJSON-824640053 None] Lock "cinder-c2afe4f4-5621-4034-85db-32c64b552000-delete_volume" released by "delete_volume" :: held 2.479s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:29:22 devstack cinder-volume[88899]: DEBUG cinder.volume.flows.manager.create_volume [None req-918ee65b-cddb-4184-ab5e-c6d3b74909e0 tempest-AttachVolumeShelveTestJSON-48913958 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88899) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 08:29:22 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-918ee65b-cddb-4184-ab5e-c6d3b74909e0 tempest-AttachVolumeShelveTestJSON-48913958 None] Flow 'volume_create_manager' (56420627-08c1-4667-9101-884057f37f01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:29:22 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-918ee65b-cddb-4184-ab5e-c6d3b74909e0 tempest-AttachVolumeShelveTestJSON-48913958 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6bea306f-7c87-4daf-9f4d-f885c9666a16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:29:22 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-918ee65b-cddb-4184-ab5e-c6d3b74909e0 tempest-AttachVolumeShelveTestJSON-48913958 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6bea306f-7c87-4daf-9f4d-f885c9666a16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:29:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-985452771',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=09c1954c-5379-4e47-bd92-ef81d4485d53,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='25a552754f3a4a23bf44f25648aa0645',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:29:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:29:22Z,use_quota=True,user_id='37136377c9ce4f6e831a4247625333f7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8bde7129-1dc4-42ab-b852-ab32c61b4921),volume_type_id=8bde7129-1dc4-42ab-b852-ab32c61b4921)' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:29:22 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-918ee65b-cddb-4184-ab5e-c6d3b74909e0 tempest-AttachVolumeShelveTestJSON-48913958 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f8200ee-0e66-40e0-8a88-f2fbf1f53573) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:29:22 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-918ee65b-cddb-4184-ab5e-c6d3b74909e0 tempest-AttachVolumeShelveTestJSON-48913958 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f8200ee-0e66-40e0-8a88-f2fbf1f53573) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:29:22 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-918ee65b-cddb-4184-ab5e-c6d3b74909e0 tempest-AttachVolumeShelveTestJSON-48913958 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04a43764-01ee-42b4-bc15-c156a777935f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:29:22 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-918ee65b-cddb-4184-ab5e-c6d3b74909e0 tempest-AttachVolumeShelveTestJSON-48913958 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04a43764-01ee-42b4-bc15-c156a777935f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '09c1954c-5379-4e47-bd92-ef81d4485d53', 'volume_name': 'volume-09c1954c-5379-4e47-bd92-ef81d4485d53', 'volume_size': 1}' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:29:22 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-918ee65b-cddb-4184-ab5e-c6d3b74909e0 tempest-AttachVolumeShelveTestJSON-48913958 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a6b0f2e7-0c24-4983-8dfa-2aca775bbb9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:29:22 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-918ee65b-cddb-4184-ab5e-c6d3b74909e0 tempest-AttachVolumeShelveTestJSON-48913958 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a6b0f2e7-0c24-4983-8dfa-2aca775bbb9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:29:22 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-918ee65b-cddb-4184-ab5e-c6d3b74909e0 tempest-AttachVolumeShelveTestJSON-48913958 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (56816ed1-125f-421a-afd3-f40345a0f0fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:29:22 devstack cinder-volume[88899]: INFO cinder.volume.flows.manager.create_volume [None req-918ee65b-cddb-4184-ab5e-c6d3b74909e0 tempest-AttachVolumeShelveTestJSON-48913958 None] Volume 09c1954c-5379-4e47-bd92-ef81d4485d53: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-09c1954c-5379-4e47-bd92-ef81d4485d53', 'volume_size': 1} Aug 03 08:29:22 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-918ee65b-cddb-4184-ab5e-c6d3b74909e0 tempest-AttachVolumeShelveTestJSON-48913958 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:29:22 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-918ee65b-cddb-4184-ab5e-c6d3b74909e0 tempest-AttachVolumeShelveTestJSON-48913958 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:29:22 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-918ee65b-cddb-4184-ab5e-c6d3b74909e0 tempest-AttachVolumeShelveTestJSON-48913958 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:29:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-985452771',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=09c1954c-5379-4e47-bd92-ef81d4485d53,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='25a552754f3a4a23bf44f25648aa0645',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:29:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:29:22Z,use_quota=True,user_id='37136377c9ce4f6e831a4247625333f7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8bde7129-1dc4-42ab-b852-ab32c61b4921),volume_type_id=8bde7129-1dc4-42ab-b852-ab32c61b4921)}" {{(pid=88899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 08:29:22 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-918ee65b-cddb-4184-ab5e-c6d3b74909e0 tempest-AttachVolumeShelveTestJSON-48913958 None] Creating volume 09c1954c-5379-4e47-bd92-ef81d4485d53 {{(pid=88899) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 08:29:22 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-918ee65b-cddb-4184-ab5e-c6d3b74909e0 tempest-AttachVolumeShelveTestJSON-48913958 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:29:22 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-918ee65b-cddb-4184-ab5e-c6d3b74909e0 tempest-AttachVolumeShelveTestJSON-48913958 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:29:22 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-918ee65b-cddb-4184-ab5e-c6d3b74909e0 tempest-AttachVolumeShelveTestJSON-48913958 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:29:22 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-918ee65b-cddb-4184-ab5e-c6d3b74909e0 tempest-AttachVolumeShelveTestJSON-48913958 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:29:22 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-918ee65b-cddb-4184-ab5e-c6d3b74909e0 tempest-AttachVolumeShelveTestJSON-48913958 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:29:22 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-918ee65b-cddb-4184-ab5e-c6d3b74909e0 tempest-AttachVolumeShelveTestJSON-48913958 None] Selected osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385 as target Quobyte volume. {{(pid=88899) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 08:29:22 devstack cinder-volume[88899]: INFO cinder.volume.drivers.remotefs [None req-918ee65b-cddb-4184-ab5e-c6d3b74909e0 tempest-AttachVolumeShelveTestJSON-48913958 None] casted to osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385 Aug 03 08:29:22 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-918ee65b-cddb-4184-ab5e-c6d3b74909e0 tempest-AttachVolumeShelveTestJSON-48913958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-09c1954c-5379-4e47-bd92-ef81d4485d53 1073741824 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:29:22 devstack sudo[90692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-09c1954c-5379-4e47-bd92-ef81d4485d53 1073741824 Aug 03 08:29:22 devstack sudo[90692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:29:22 devstack sudo[90692]: pam_unix(sudo:session): session closed for user root Aug 03 08:29:22 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-918ee65b-cddb-4184-ab5e-c6d3b74909e0 tempest-AttachVolumeShelveTestJSON-48913958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-09c1954c-5379-4e47-bd92-ef81d4485d53 1073741824" returned: 0 in 0.545s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:29:22 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-918ee65b-cddb-4184-ab5e-c6d3b74909e0 tempest-AttachVolumeShelveTestJSON-48913958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-09c1954c-5379-4e47-bd92-ef81d4485d53 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:29:22 devstack sudo[90698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-09c1954c-5379-4e47-bd92-ef81d4485d53 Aug 03 08:29:22 devstack sudo[90698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:29:23 devstack sudo[90698]: pam_unix(sudo:session): session closed for user root Aug 03 08:29:23 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-918ee65b-cddb-4184-ab5e-c6d3b74909e0 tempest-AttachVolumeShelveTestJSON-48913958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-09c1954c-5379-4e47-bd92-ef81d4485d53" returned: 0 in 0.383s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:29:23 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-918ee65b-cddb-4184-ab5e-c6d3b74909e0 tempest-AttachVolumeShelveTestJSON-48913958 None] <== create_volume: return (976ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'} {{(pid=88899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 08:29:23 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-918ee65b-cddb-4184-ab5e-c6d3b74909e0 tempest-AttachVolumeShelveTestJSON-48913958 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.981s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:29:23 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-918ee65b-cddb-4184-ab5e-c6d3b74909e0 tempest-AttachVolumeShelveTestJSON-48913958 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (56816ed1-125f-421a-afd3-f40345a0f0fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-09c1954c-5379-4e47-bd92-ef81d4485d53', 'volume_size': 1}' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:29:23 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-918ee65b-cddb-4184-ab5e-c6d3b74909e0 tempest-AttachVolumeShelveTestJSON-48913958 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51465774-8ff7-4547-a338-f029ca280696) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:29:23 devstack cinder-volume[88899]: INFO cinder.volume.flows.manager.create_volume [None req-918ee65b-cddb-4184-ab5e-c6d3b74909e0 tempest-AttachVolumeShelveTestJSON-48913958 None] Volume volume-09c1954c-5379-4e47-bd92-ef81d4485d53 (09c1954c-5379-4e47-bd92-ef81d4485d53): created successfully Aug 03 08:29:23 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-918ee65b-cddb-4184-ab5e-c6d3b74909e0 tempest-AttachVolumeShelveTestJSON-48913958 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51465774-8ff7-4547-a338-f029ca280696) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:29:23 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-918ee65b-cddb-4184-ab5e-c6d3b74909e0 tempest-AttachVolumeShelveTestJSON-48913958 None] Flow 'volume_create_manager' (56420627-08c1-4667-9101-884057f37f01) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:29:23 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-918ee65b-cddb-4184-ab5e-c6d3b74909e0 tempest-AttachVolumeShelveTestJSON-48913958 None] Created volume successfully. Aug 03 08:29:33 devstack cinder-volume[88899]: DEBUG dbcounter [-] [88899] Writing DB stats cinder:SELECT=27,cinder:UPDATE=24,cinder:DELETE=2,cinder:INSERT=4 {{(pid=88899) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 03 08:29:33 devstack cinder-volume[88899]: DEBUG dbcounter [-] [88899] Writing DB stats cinder:SELECT=20,cinder:INSERT=7,cinder:UPDATE=29,cinder:DELETE=3 {{(pid=88899) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 03 08:29:51 devstack cinder-volume[88899]: DEBUG oslo_service.periodic_task [None req-f948fb4a-c4d7-499f-b1bd-8d6be3de0b53 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88899) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 03 08:29:51 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-f948fb4a-c4d7-499f-b1bd-8d6be3de0b53 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:29:51 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-f948fb4a-c4d7-499f-b1bd-8d6be3de0b53 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:29:51 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-f948fb4a-c4d7-499f-b1bd-8d6be3de0b53 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:29:51 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-f948fb4a-c4d7-499f-b1bd-8d6be3de0b53 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:29:51 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-f948fb4a-c4d7-499f-b1bd-8d6be3de0b53 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:29:51 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-f948fb4a-c4d7-499f-b1bd-8d6be3de0b53 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:29:51 devstack sudo[90807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a Aug 03 08:29:51 devstack sudo[90807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:29:52 devstack cinder-volume[88899]: DEBUG cinder.volume.flows.manager.create_volume [None req-d65073f7-ad6d-4200-bad1-2b37265d8159 tempest-TaggedAttachmentsTest-1331297186 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88899) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 08:29:52 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-d65073f7-ad6d-4200-bad1-2b37265d8159 tempest-TaggedAttachmentsTest-1331297186 None] Flow 'volume_create_manager' (8735993f-4431-448e-9e5e-a06b156a9dca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:29:52 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-d65073f7-ad6d-4200-bad1-2b37265d8159 tempest-TaggedAttachmentsTest-1331297186 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7a368ed-acf0-4231-a35d-2b303b3ffb72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:29:52 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-d65073f7-ad6d-4200-bad1-2b37265d8159 tempest-TaggedAttachmentsTest-1331297186 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7a368ed-acf0-4231-a35d-2b303b3ffb72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:29:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-771690611',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=702286d7-ae7e-4589-98b9-a0cb9cb735bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd583b6273954b20b307ab08db97c986',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:29:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:29:52Z,use_quota=True,user_id='eb4f703bd6c94f84bef8d92b4266350d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8bde7129-1dc4-42ab-b852-ab32c61b4921),volume_type_id=8bde7129-1dc4-42ab-b852-ab32c61b4921)' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:29:52 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-d65073f7-ad6d-4200-bad1-2b37265d8159 tempest-TaggedAttachmentsTest-1331297186 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4559c10f-60c5-4602-8f51-8c181e0072eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:29:52 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-d65073f7-ad6d-4200-bad1-2b37265d8159 tempest-TaggedAttachmentsTest-1331297186 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4559c10f-60c5-4602-8f51-8c181e0072eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:29:52 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-d65073f7-ad6d-4200-bad1-2b37265d8159 tempest-TaggedAttachmentsTest-1331297186 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18428e85-0cbc-4de6-9257-ed5abe5f89ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:29:52 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-d65073f7-ad6d-4200-bad1-2b37265d8159 tempest-TaggedAttachmentsTest-1331297186 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18428e85-0cbc-4de6-9257-ed5abe5f89ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '702286d7-ae7e-4589-98b9-a0cb9cb735bf', 'volume_name': 'volume-702286d7-ae7e-4589-98b9-a0cb9cb735bf', 'volume_size': 1}' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:29:52 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-d65073f7-ad6d-4200-bad1-2b37265d8159 tempest-TaggedAttachmentsTest-1331297186 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (88583a76-e31b-40cd-80af-b9dd0ac1a85f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:29:52 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-d65073f7-ad6d-4200-bad1-2b37265d8159 tempest-TaggedAttachmentsTest-1331297186 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (88583a76-e31b-40cd-80af-b9dd0ac1a85f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:29:52 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-d65073f7-ad6d-4200-bad1-2b37265d8159 tempest-TaggedAttachmentsTest-1331297186 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d04605e9-9a8c-43b4-9280-ef3528f76ae3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:29:52 devstack cinder-volume[88899]: INFO cinder.volume.flows.manager.create_volume [None req-d65073f7-ad6d-4200-bad1-2b37265d8159 tempest-TaggedAttachmentsTest-1331297186 None] Volume 702286d7-ae7e-4589-98b9-a0cb9cb735bf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-702286d7-ae7e-4589-98b9-a0cb9cb735bf', 'volume_size': 1} Aug 03 08:29:52 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-d65073f7-ad6d-4200-bad1-2b37265d8159 tempest-TaggedAttachmentsTest-1331297186 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:29:52 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-d65073f7-ad6d-4200-bad1-2b37265d8159 tempest-TaggedAttachmentsTest-1331297186 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:29:52 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-d65073f7-ad6d-4200-bad1-2b37265d8159 tempest-TaggedAttachmentsTest-1331297186 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:29:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-771690611',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=702286d7-ae7e-4589-98b9-a0cb9cb735bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd583b6273954b20b307ab08db97c986',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:29:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:29:52Z,use_quota=True,user_id='eb4f703bd6c94f84bef8d92b4266350d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8bde7129-1dc4-42ab-b852-ab32c61b4921),volume_type_id=8bde7129-1dc4-42ab-b852-ab32c61b4921)}" {{(pid=88899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 08:29:52 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-d65073f7-ad6d-4200-bad1-2b37265d8159 tempest-TaggedAttachmentsTest-1331297186 None] Creating volume 702286d7-ae7e-4589-98b9-a0cb9cb735bf {{(pid=88899) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 08:29:52 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-d65073f7-ad6d-4200-bad1-2b37265d8159 tempest-TaggedAttachmentsTest-1331297186 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:29:52 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-d65073f7-ad6d-4200-bad1-2b37265d8159 tempest-TaggedAttachmentsTest-1331297186 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:29:52 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-d65073f7-ad6d-4200-bad1-2b37265d8159 tempest-TaggedAttachmentsTest-1331297186 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:29:52 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-d65073f7-ad6d-4200-bad1-2b37265d8159 tempest-TaggedAttachmentsTest-1331297186 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:29:52 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-d65073f7-ad6d-4200-bad1-2b37265d8159 tempest-TaggedAttachmentsTest-1331297186 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:29:52 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-d65073f7-ad6d-4200-bad1-2b37265d8159 tempest-TaggedAttachmentsTest-1331297186 None] Selected osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385 as target Quobyte volume. {{(pid=88899) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 08:29:52 devstack cinder-volume[88899]: INFO cinder.volume.drivers.remotefs [None req-d65073f7-ad6d-4200-bad1-2b37265d8159 tempest-TaggedAttachmentsTest-1331297186 None] casted to osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385 Aug 03 08:29:52 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-d65073f7-ad6d-4200-bad1-2b37265d8159 tempest-TaggedAttachmentsTest-1331297186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-702286d7-ae7e-4589-98b9-a0cb9cb735bf 1073741824 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:29:52 devstack sudo[90807]: pam_unix(sudo:session): session closed for user root Aug 03 08:29:52 devstack sudo[90813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-702286d7-ae7e-4589-98b9-a0cb9cb735bf 1073741824 Aug 03 08:29:52 devstack sudo[90813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:29:52 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-f948fb4a-c4d7-499f-b1bd-8d6be3de0b53 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a" returned: 0 in 0.659s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:29:52 devstack cinder-volume[88899]: DEBUG cinder.manager [None req-f948fb4a-c4d7-499f-b1bd-8d6be3de0b53 None None] Notifying Schedulers of capabilities ... {{(pid=88899) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 08:29:52 devstack cinder-volume[88899]: DEBUG oslo_service.periodic_task [None req-f948fb4a-c4d7-499f-b1bd-8d6be3de0b53 None None] Running periodic task VolumeManager._thread_info {{(pid=88899) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 03 08:29:52 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-f948fb4a-c4d7-499f-b1bd-8d6be3de0b53 None None] thread count: 8 {{(pid=88899) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 03 08:29:52 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-f948fb4a-c4d7-499f-b1bd-8d6be3de0b53 None None] thread info: [<_MainThread(MainThread, started 132234320248960)>, , , , , , , ] {{(pid=88899) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 03 08:29:53 devstack sudo[90813]: pam_unix(sudo:session): session closed for user root Aug 03 08:29:53 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-d65073f7-ad6d-4200-bad1-2b37265d8159 tempest-TaggedAttachmentsTest-1331297186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-702286d7-ae7e-4589-98b9-a0cb9cb735bf 1073741824" returned: 0 in 0.644s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:29:53 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-d65073f7-ad6d-4200-bad1-2b37265d8159 tempest-TaggedAttachmentsTest-1331297186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-702286d7-ae7e-4589-98b9-a0cb9cb735bf {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:29:53 devstack sudo[90823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-702286d7-ae7e-4589-98b9-a0cb9cb735bf Aug 03 08:29:53 devstack sudo[90823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:29:53 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [req-a106f7e6-4667-4375-90c9-87580f86f539 req-a3345269-8bd0-4c39-b547-a037f34dd5fe tempest-AttachVolumeShelveTestJSON-48913958 None] No connector for attachment 09caba04-af03-4313-a93c-4d9f511783b6; skipping storage backend terminate_connection call. {{(pid=88899) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}} Aug 03 08:29:53 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [req-a106f7e6-4667-4375-90c9-87580f86f539 req-a3345269-8bd0-4c39-b547-a037f34dd5fe tempest-AttachVolumeShelveTestJSON-48913958 None] Deleting attachment 09caba04-af03-4313-a93c-4d9f511783b6. {{(pid=88899) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 03 08:29:53 devstack sudo[90823]: pam_unix(sudo:session): session closed for user root Aug 03 08:29:53 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-d65073f7-ad6d-4200-bad1-2b37265d8159 tempest-TaggedAttachmentsTest-1331297186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-702286d7-ae7e-4589-98b9-a0cb9cb735bf" returned: 0 in 0.324s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:29:53 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-d65073f7-ad6d-4200-bad1-2b37265d8159 tempest-TaggedAttachmentsTest-1331297186 None] <== create_volume: return (1022ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'} {{(pid=88899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 08:29:53 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-d65073f7-ad6d-4200-bad1-2b37265d8159 tempest-TaggedAttachmentsTest-1331297186 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.025s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:29:53 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-d65073f7-ad6d-4200-bad1-2b37265d8159 tempest-TaggedAttachmentsTest-1331297186 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d04605e9-9a8c-43b4-9280-ef3528f76ae3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-702286d7-ae7e-4589-98b9-a0cb9cb735bf', 'volume_size': 1}' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:29:53 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-d65073f7-ad6d-4200-bad1-2b37265d8159 tempest-TaggedAttachmentsTest-1331297186 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ecd5fbe6-0845-4d4d-a952-dcc258280c1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:29:53 devstack cinder-volume[88899]: INFO cinder.volume.flows.manager.create_volume [None req-d65073f7-ad6d-4200-bad1-2b37265d8159 tempest-TaggedAttachmentsTest-1331297186 None] Volume volume-702286d7-ae7e-4589-98b9-a0cb9cb735bf (702286d7-ae7e-4589-98b9-a0cb9cb735bf): created successfully Aug 03 08:29:53 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-d65073f7-ad6d-4200-bad1-2b37265d8159 tempest-TaggedAttachmentsTest-1331297186 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ecd5fbe6-0845-4d4d-a952-dcc258280c1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:29:53 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-d65073f7-ad6d-4200-bad1-2b37265d8159 tempest-TaggedAttachmentsTest-1331297186 None] Flow 'volume_create_manager' (8735993f-4431-448e-9e5e-a06b156a9dca) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:29:53 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-d65073f7-ad6d-4200-bad1-2b37265d8159 tempest-TaggedAttachmentsTest-1331297186 None] Created volume successfully. Aug 03 08:29:56 devstack cinder-volume[88899]: DEBUG cinder.volume.flows.manager.create_volume [req-dd773347-c042-42f3-a091-c4f5a36f208c req-75e7f94c-1203-4a57-b2a5-2c16ccd63d86 tempest-VolumesSnapshotsTestJSON-717879426 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88899) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 08:29:56 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [req-dd773347-c042-42f3-a091-c4f5a36f208c req-75e7f94c-1203-4a57-b2a5-2c16ccd63d86 tempest-VolumesSnapshotsTestJSON-717879426 None] Flow 'volume_create_manager' (9c1a5ff7-8057-432b-8c7d-7f2d2876972c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:29:56 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [req-dd773347-c042-42f3-a091-c4f5a36f208c req-75e7f94c-1203-4a57-b2a5-2c16ccd63d86 tempest-VolumesSnapshotsTestJSON-717879426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f29747dc-811c-4101-b636-540fdb01eb2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:29:56 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [req-dd773347-c042-42f3-a091-c4f5a36f208c req-75e7f94c-1203-4a57-b2a5-2c16ccd63d86 tempest-VolumesSnapshotsTestJSON-717879426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f29747dc-811c-4101-b636-540fdb01eb2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:29:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1077169665',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a39d2dc8-1242-4859-aa68-28016d750196,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='622b97e92d2a4d86bc04f82e8c1d34cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:29:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:29:57Z,use_quota=True,user_id='83f6141796c044d9a11e2f9227067d93',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8bde7129-1dc4-42ab-b852-ab32c61b4921),volume_type_id=8bde7129-1dc4-42ab-b852-ab32c61b4921)' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:29:56 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [req-dd773347-c042-42f3-a091-c4f5a36f208c req-75e7f94c-1203-4a57-b2a5-2c16ccd63d86 tempest-VolumesSnapshotsTestJSON-717879426 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b605ba7-e855-4ef8-97e9-f545f0e6c499) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:29:56 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [req-dd773347-c042-42f3-a091-c4f5a36f208c req-75e7f94c-1203-4a57-b2a5-2c16ccd63d86 tempest-VolumesSnapshotsTestJSON-717879426 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b605ba7-e855-4ef8-97e9-f545f0e6c499) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:29:56 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [req-dd773347-c042-42f3-a091-c4f5a36f208c req-75e7f94c-1203-4a57-b2a5-2c16ccd63d86 tempest-VolumesSnapshotsTestJSON-717879426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5451f2a9-67c2-4e38-824c-381744d5d504) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:29:56 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [req-dd773347-c042-42f3-a091-c4f5a36f208c req-75e7f94c-1203-4a57-b2a5-2c16ccd63d86 tempest-VolumesSnapshotsTestJSON-717879426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5451f2a9-67c2-4e38-824c-381744d5d504) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a39d2dc8-1242-4859-aa68-28016d750196', 'volume_name': 'volume-a39d2dc8-1242-4859-aa68-28016d750196', 'volume_size': 1}' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:29:56 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [req-dd773347-c042-42f3-a091-c4f5a36f208c req-75e7f94c-1203-4a57-b2a5-2c16ccd63d86 tempest-VolumesSnapshotsTestJSON-717879426 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd58be98-878f-4834-ad17-0d4d06780328) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:29:56 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [req-dd773347-c042-42f3-a091-c4f5a36f208c req-75e7f94c-1203-4a57-b2a5-2c16ccd63d86 tempest-VolumesSnapshotsTestJSON-717879426 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd58be98-878f-4834-ad17-0d4d06780328) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:29:56 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [req-dd773347-c042-42f3-a091-c4f5a36f208c req-75e7f94c-1203-4a57-b2a5-2c16ccd63d86 tempest-VolumesSnapshotsTestJSON-717879426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9fbc485a-9a15-42a8-9481-d6c3be7a1e05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:29:56 devstack cinder-volume[88899]: INFO cinder.volume.flows.manager.create_volume [req-dd773347-c042-42f3-a091-c4f5a36f208c req-75e7f94c-1203-4a57-b2a5-2c16ccd63d86 tempest-VolumesSnapshotsTestJSON-717879426 None] Volume a39d2dc8-1242-4859-aa68-28016d750196: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a39d2dc8-1242-4859-aa68-28016d750196', 'volume_size': 1} Aug 03 08:29:56 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [req-dd773347-c042-42f3-a091-c4f5a36f208c req-75e7f94c-1203-4a57-b2a5-2c16ccd63d86 tempest-VolumesSnapshotsTestJSON-717879426 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:29:56 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [req-dd773347-c042-42f3-a091-c4f5a36f208c req-75e7f94c-1203-4a57-b2a5-2c16ccd63d86 tempest-VolumesSnapshotsTestJSON-717879426 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:29:56 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [req-dd773347-c042-42f3-a091-c4f5a36f208c req-75e7f94c-1203-4a57-b2a5-2c16ccd63d86 tempest-VolumesSnapshotsTestJSON-717879426 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:29:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1077169665',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a39d2dc8-1242-4859-aa68-28016d750196,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='622b97e92d2a4d86bc04f82e8c1d34cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:29:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:29:57Z,use_quota=True,user_id='83f6141796c044d9a11e2f9227067d93',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8bde7129-1dc4-42ab-b852-ab32c61b4921),volume_type_id=8bde7129-1dc4-42ab-b852-ab32c61b4921)}" {{(pid=88899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 08:29:56 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [req-dd773347-c042-42f3-a091-c4f5a36f208c req-75e7f94c-1203-4a57-b2a5-2c16ccd63d86 tempest-VolumesSnapshotsTestJSON-717879426 None] Creating volume a39d2dc8-1242-4859-aa68-28016d750196 {{(pid=88899) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 08:29:56 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [req-dd773347-c042-42f3-a091-c4f5a36f208c req-75e7f94c-1203-4a57-b2a5-2c16ccd63d86 tempest-VolumesSnapshotsTestJSON-717879426 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:29:56 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [req-dd773347-c042-42f3-a091-c4f5a36f208c req-75e7f94c-1203-4a57-b2a5-2c16ccd63d86 tempest-VolumesSnapshotsTestJSON-717879426 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:29:56 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [req-dd773347-c042-42f3-a091-c4f5a36f208c req-75e7f94c-1203-4a57-b2a5-2c16ccd63d86 tempest-VolumesSnapshotsTestJSON-717879426 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:29:56 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [req-dd773347-c042-42f3-a091-c4f5a36f208c req-75e7f94c-1203-4a57-b2a5-2c16ccd63d86 tempest-VolumesSnapshotsTestJSON-717879426 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:29:56 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [req-dd773347-c042-42f3-a091-c4f5a36f208c req-75e7f94c-1203-4a57-b2a5-2c16ccd63d86 tempest-VolumesSnapshotsTestJSON-717879426 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:29:56 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [req-dd773347-c042-42f3-a091-c4f5a36f208c req-75e7f94c-1203-4a57-b2a5-2c16ccd63d86 tempest-VolumesSnapshotsTestJSON-717879426 None] Selected osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385 as target Quobyte volume. {{(pid=88899) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 08:29:56 devstack cinder-volume[88899]: INFO cinder.volume.drivers.remotefs [req-dd773347-c042-42f3-a091-c4f5a36f208c req-75e7f94c-1203-4a57-b2a5-2c16ccd63d86 tempest-VolumesSnapshotsTestJSON-717879426 None] casted to osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385 Aug 03 08:29:56 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [req-dd773347-c042-42f3-a091-c4f5a36f208c req-75e7f94c-1203-4a57-b2a5-2c16ccd63d86 tempest-VolumesSnapshotsTestJSON-717879426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-a39d2dc8-1242-4859-aa68-28016d750196 1073741824 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:29:56 devstack sudo[90852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-a39d2dc8-1242-4859-aa68-28016d750196 1073741824 Aug 03 08:29:56 devstack sudo[90852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:29:57 devstack sudo[90852]: pam_unix(sudo:session): session closed for user root Aug 03 08:29:57 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [req-dd773347-c042-42f3-a091-c4f5a36f208c req-75e7f94c-1203-4a57-b2a5-2c16ccd63d86 tempest-VolumesSnapshotsTestJSON-717879426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-a39d2dc8-1242-4859-aa68-28016d750196 1073741824" returned: 0 in 0.558s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:29:57 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [req-dd773347-c042-42f3-a091-c4f5a36f208c req-75e7f94c-1203-4a57-b2a5-2c16ccd63d86 tempest-VolumesSnapshotsTestJSON-717879426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-a39d2dc8-1242-4859-aa68-28016d750196 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:29:57 devstack sudo[90859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-a39d2dc8-1242-4859-aa68-28016d750196 Aug 03 08:29:57 devstack sudo[90859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:29:57 devstack sudo[90859]: pam_unix(sudo:session): session closed for user root Aug 03 08:29:57 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [req-dd773347-c042-42f3-a091-c4f5a36f208c req-75e7f94c-1203-4a57-b2a5-2c16ccd63d86 tempest-VolumesSnapshotsTestJSON-717879426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-a39d2dc8-1242-4859-aa68-28016d750196" returned: 0 in 0.282s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:29:57 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [req-dd773347-c042-42f3-a091-c4f5a36f208c req-75e7f94c-1203-4a57-b2a5-2c16ccd63d86 tempest-VolumesSnapshotsTestJSON-717879426 None] <== create_volume: return (898ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'} {{(pid=88899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 08:29:57 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [req-dd773347-c042-42f3-a091-c4f5a36f208c req-75e7f94c-1203-4a57-b2a5-2c16ccd63d86 tempest-VolumesSnapshotsTestJSON-717879426 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.903s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:29:57 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [req-dd773347-c042-42f3-a091-c4f5a36f208c req-75e7f94c-1203-4a57-b2a5-2c16ccd63d86 tempest-VolumesSnapshotsTestJSON-717879426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9fbc485a-9a15-42a8-9481-d6c3be7a1e05) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a39d2dc8-1242-4859-aa68-28016d750196', 'volume_size': 1}' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:29:57 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [req-dd773347-c042-42f3-a091-c4f5a36f208c req-75e7f94c-1203-4a57-b2a5-2c16ccd63d86 tempest-VolumesSnapshotsTestJSON-717879426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ed8d56f-e82f-4ba8-a478-b703c144ae1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:29:57 devstack cinder-volume[88899]: INFO cinder.volume.flows.manager.create_volume [req-dd773347-c042-42f3-a091-c4f5a36f208c req-75e7f94c-1203-4a57-b2a5-2c16ccd63d86 tempest-VolumesSnapshotsTestJSON-717879426 None] Volume volume-a39d2dc8-1242-4859-aa68-28016d750196 (a39d2dc8-1242-4859-aa68-28016d750196): created successfully Aug 03 08:29:57 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [req-dd773347-c042-42f3-a091-c4f5a36f208c req-75e7f94c-1203-4a57-b2a5-2c16ccd63d86 tempest-VolumesSnapshotsTestJSON-717879426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ed8d56f-e82f-4ba8-a478-b703c144ae1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:29:57 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [req-dd773347-c042-42f3-a091-c4f5a36f208c req-75e7f94c-1203-4a57-b2a5-2c16ccd63d86 tempest-VolumesSnapshotsTestJSON-717879426 None] Flow 'volume_create_manager' (9c1a5ff7-8057-432b-8c7d-7f2d2876972c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:29:57 devstack cinder-volume[88899]: INFO cinder.volume.manager [req-dd773347-c042-42f3-a091-c4f5a36f208c req-75e7f94c-1203-4a57-b2a5-2c16ccd63d86 tempest-VolumesSnapshotsTestJSON-717879426 None] Created volume successfully. Aug 03 08:30:00 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [req-3dcbff63-ba20-4d29-82d7-cf0bd63465f9 req-ae32b923-09f7-4599-abf9-89ba7d30f57e tempest-VolumesSnapshotsTestJSON-717879426 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:30:00 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [req-3dcbff63-ba20-4d29-82d7-cf0bd63465f9 req-ae32b923-09f7-4599-abf9-89ba7d30f57e tempest-VolumesSnapshotsTestJSON-717879426 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:30:00 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [req-3dcbff63-ba20-4d29-82d7-cf0bd63465f9 req-ae32b923-09f7-4599-abf9-89ba7d30f57e tempest-VolumesSnapshotsTestJSON-717879426 None] Creating offline snapshot 370aca0d-b5f7-4326-893b-7f12937b8db9 of volume a39d2dc8-1242-4859-aa68-28016d750196 {{(pid=88899) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 03 08:30:00 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ab384c7-9faa-4247-bdb1-730d0e0795ba]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:30:00 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [req-3dcbff63-ba20-4d29-82d7-cf0bd63465f9 req-ae32b923-09f7-4599-abf9-89ba7d30f57e tempest-VolumesSnapshotsTestJSON-717879426 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-a39d2dc8-1242-4859-aa68-28016d750196 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:30:00 devstack sudo[90951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-a39d2dc8-1242-4859-aa68-28016d750196 Aug 03 08:30:00 devstack sudo[90951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:30:01 devstack sudo[90951]: pam_unix(sudo:session): session closed for user root Aug 03 08:30:01 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [req-3dcbff63-ba20-4d29-82d7-cf0bd63465f9 req-ae32b923-09f7-4599-abf9-89ba7d30f57e tempest-VolumesSnapshotsTestJSON-717879426 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-a39d2dc8-1242-4859-aa68-28016d750196" returned: 0 in 0.805s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:30:01 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [req-3dcbff63-ba20-4d29-82d7-cf0bd63465f9 req-ae32b923-09f7-4599-abf9-89ba7d30f57e tempest-VolumesSnapshotsTestJSON-717879426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-a39d2dc8-1242-4859-aa68-28016d750196,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-a39d2dc8-1242-4859-aa68-28016d750196.370aca0d-b5f7-4326-893b-7f12937b8db9 1G {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:30:01 devstack sudo[90960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-a39d2dc8-1242-4859-aa68-28016d750196,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-a39d2dc8-1242-4859-aa68-28016d750196.370aca0d-b5f7-4326-893b-7f12937b8db9 1G Aug 03 08:30:01 devstack sudo[90960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:30:02 devstack sudo[90960]: pam_unix(sudo:session): session closed for user root Aug 03 08:30:02 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [req-3dcbff63-ba20-4d29-82d7-cf0bd63465f9 req-ae32b923-09f7-4599-abf9-89ba7d30f57e tempest-VolumesSnapshotsTestJSON-717879426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-a39d2dc8-1242-4859-aa68-28016d750196,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-a39d2dc8-1242-4859-aa68-28016d750196.370aca0d-b5f7-4326-893b-7f12937b8db9 1G" returned: 0 in 0.953s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:30:02 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [req-3dcbff63-ba20-4d29-82d7-cf0bd63465f9 req-ae32b923-09f7-4599-abf9-89ba7d30f57e tempest-VolumesSnapshotsTestJSON-717879426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a39d2dc8-1242-4859-aa68-28016d750196 -F qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-a39d2dc8-1242-4859-aa68-28016d750196.370aca0d-b5f7-4326-893b-7f12937b8db9 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:30:02 devstack sudo[90971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a39d2dc8-1242-4859-aa68-28016d750196 -F qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-a39d2dc8-1242-4859-aa68-28016d750196.370aca0d-b5f7-4326-893b-7f12937b8db9 Aug 03 08:30:02 devstack sudo[90971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:30:03 devstack sudo[90971]: pam_unix(sudo:session): session closed for user root Aug 03 08:30:03 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [req-3dcbff63-ba20-4d29-82d7-cf0bd63465f9 req-ae32b923-09f7-4599-abf9-89ba7d30f57e tempest-VolumesSnapshotsTestJSON-717879426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a39d2dc8-1242-4859-aa68-28016d750196 -F qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-a39d2dc8-1242-4859-aa68-28016d750196.370aca0d-b5f7-4326-893b-7f12937b8db9" returned: 0 in 0.479s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:30:03 devstack cinder-volume[88899]: WARNING cinder.volume.drivers.remotefs [req-3dcbff63-ba20-4d29-82d7-cf0bd63465f9 req-ae32b923-09f7-4599-abf9-89ba7d30f57e tempest-VolumesSnapshotsTestJSON-717879426 None] /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-a39d2dc8-1242-4859-aa68-28016d750196.370aca0d-b5f7-4326-893b-7f12937b8db9 is being set with open permissions: ugo+rw Aug 03 08:30:03 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [req-3dcbff63-ba20-4d29-82d7-cf0bd63465f9 req-ae32b923-09f7-4599-abf9-89ba7d30f57e tempest-VolumesSnapshotsTestJSON-717879426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-a39d2dc8-1242-4859-aa68-28016d750196.370aca0d-b5f7-4326-893b-7f12937b8db9 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:30:03 devstack sudo[90977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-a39d2dc8-1242-4859-aa68-28016d750196.370aca0d-b5f7-4326-893b-7f12937b8db9 Aug 03 08:30:03 devstack sudo[90977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:30:03 devstack sudo[90977]: pam_unix(sudo:session): session closed for user root Aug 03 08:30:03 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [req-3dcbff63-ba20-4d29-82d7-cf0bd63465f9 req-ae32b923-09f7-4599-abf9-89ba7d30f57e tempest-VolumesSnapshotsTestJSON-717879426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-a39d2dc8-1242-4859-aa68-28016d750196.370aca0d-b5f7-4326-893b-7f12937b8db9" returned: 0 in 0.539s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:30:03 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [req-3dcbff63-ba20-4d29-82d7-cf0bd63465f9 req-ae32b923-09f7-4599-abf9-89ba7d30f57e tempest-VolumesSnapshotsTestJSON-717879426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-a39d2dc8-1242-4859-aa68-28016d750196.info {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:30:03 devstack sudo[90984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-a39d2dc8-1242-4859-aa68-28016d750196.info Aug 03 08:30:03 devstack sudo[90984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:30:04 devstack sudo[90984]: pam_unix(sudo:session): session closed for user root Aug 03 08:30:04 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [req-3dcbff63-ba20-4d29-82d7-cf0bd63465f9 req-ae32b923-09f7-4599-abf9-89ba7d30f57e tempest-VolumesSnapshotsTestJSON-717879426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-a39d2dc8-1242-4859-aa68-28016d750196.info" returned: 0 in 0.513s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:30:04 devstack cinder-volume[88899]: WARNING cinder.volume.drivers.remotefs [req-3dcbff63-ba20-4d29-82d7-cf0bd63465f9 req-ae32b923-09f7-4599-abf9-89ba7d30f57e tempest-VolumesSnapshotsTestJSON-717879426 None] /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-a39d2dc8-1242-4859-aa68-28016d750196.info is being set with open permissions: ugo+rw Aug 03 08:30:04 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [req-3dcbff63-ba20-4d29-82d7-cf0bd63465f9 req-ae32b923-09f7-4599-abf9-89ba7d30f57e tempest-VolumesSnapshotsTestJSON-717879426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-a39d2dc8-1242-4859-aa68-28016d750196.info {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:30:04 devstack sudo[90999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-a39d2dc8-1242-4859-aa68-28016d750196.info Aug 03 08:30:04 devstack sudo[90999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:30:04 devstack sudo[90999]: pam_unix(sudo:session): session closed for user root Aug 03 08:30:04 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [req-3dcbff63-ba20-4d29-82d7-cf0bd63465f9 req-ae32b923-09f7-4599-abf9-89ba7d30f57e tempest-VolumesSnapshotsTestJSON-717879426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-a39d2dc8-1242-4859-aa68-28016d750196.info" returned: 0 in 0.377s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:30:04 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [req-3dcbff63-ba20-4d29-82d7-cf0bd63465f9 req-ae32b923-09f7-4599-abf9-89ba7d30f57e tempest-VolumesSnapshotsTestJSON-717879426 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.851s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:30:04 devstack cinder-volume[88899]: INFO cinder.volume.manager [req-3dcbff63-ba20-4d29-82d7-cf0bd63465f9 req-ae32b923-09f7-4599-abf9-89ba7d30f57e tempest-VolumesSnapshotsTestJSON-717879426 None] Create snapshot completed successfully Aug 03 08:30:05 devstack cinder-volume[88899]: DEBUG cinder.coordination [req-93744128-2e6a-440c-8b67-ee0195d95897 req-2063b2bb-d582-4084-8d22-1b0e8e7792ec tempest-VolumesSnapshotsTestJSON-717879426 None] Acquiring lock "cinder-370aca0d-b5f7-4326-893b-7f12937b8db9-delete_snapshot" by "delete_snapshot" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:30:05 devstack cinder-volume[88899]: DEBUG cinder.coordination [req-93744128-2e6a-440c-8b67-ee0195d95897 req-2063b2bb-d582-4084-8d22-1b0e8e7792ec tempest-VolumesSnapshotsTestJSON-717879426 None] Lock "cinder-370aca0d-b5f7-4326-893b-7f12937b8db9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.066s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:30:05 devstack cinder-volume[88899]: DEBUG cinder.coordination [req-93744128-2e6a-440c-8b67-ee0195d95897 req-2063b2bb-d582-4084-8d22-1b0e8e7792ec tempest-VolumesSnapshotsTestJSON-717879426 None] Acquiring lock "cinder-quobyte-a39d2dc8-1242-4859-aa68-28016d750196" by "delete_snapshot" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:30:05 devstack cinder-volume[88899]: DEBUG cinder.coordination [req-93744128-2e6a-440c-8b67-ee0195d95897 req-2063b2bb-d582-4084-8d22-1b0e8e7792ec tempest-VolumesSnapshotsTestJSON-717879426 None] Lock "cinder-quobyte-a39d2dc8-1242-4859-aa68-28016d750196" acquired by "delete_snapshot" :: waited 0.052s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:30:05 devstack cinder-volume[88899]: DEBUG cinder.coordination [req-93744128-2e6a-440c-8b67-ee0195d95897 req-2063b2bb-d582-4084-8d22-1b0e8e7792ec tempest-VolumesSnapshotsTestJSON-717879426 None] Acquiring lock "cinder-quobyte-370aca0d-b5f7-4326-893b-7f12937b8db9" by "_delete_snapshot" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:30:05 devstack cinder-volume[88899]: DEBUG cinder.coordination [req-93744128-2e6a-440c-8b67-ee0195d95897 req-2063b2bb-d582-4084-8d22-1b0e8e7792ec tempest-VolumesSnapshotsTestJSON-717879426 None] Lock "cinder-quobyte-370aca0d-b5f7-4326-893b-7f12937b8db9" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:30:05 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [req-93744128-2e6a-440c-8b67-ee0195d95897 req-2063b2bb-d582-4084-8d22-1b0e8e7792ec tempest-VolumesSnapshotsTestJSON-717879426 None] Deleting offline snapshot 370aca0d-b5f7-4326-893b-7f12937b8db9 of volume a39d2dc8-1242-4859-aa68-28016d750196 {{(pid=88899) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 03 08:30:05 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [req-93744128-2e6a-440c-8b67-ee0195d95897 req-2063b2bb-d582-4084-8d22-1b0e8e7792ec tempest-VolumesSnapshotsTestJSON-717879426 None] snapshot_file for this snap is: volume-a39d2dc8-1242-4859-aa68-28016d750196.370aca0d-b5f7-4326-893b-7f12937b8db9 {{(pid=88899) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 03 08:30:05 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[a79e8992-d39f-405d-a72b-1ebe4b5457df]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:30:05 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [req-93744128-2e6a-440c-8b67-ee0195d95897 req-2063b2bb-d582-4084-8d22-1b0e8e7792ec tempest-VolumesSnapshotsTestJSON-717879426 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-a39d2dc8-1242-4859-aa68-28016d750196.370aca0d-b5f7-4326-893b-7f12937b8db9 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:30:05 devstack sudo[91042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-a39d2dc8-1242-4859-aa68-28016d750196.370aca0d-b5f7-4326-893b-7f12937b8db9 Aug 03 08:30:05 devstack sudo[91042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:30:06 devstack sudo[91042]: pam_unix(sudo:session): session closed for user root Aug 03 08:30:06 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [req-93744128-2e6a-440c-8b67-ee0195d95897 req-2063b2bb-d582-4084-8d22-1b0e8e7792ec tempest-VolumesSnapshotsTestJSON-717879426 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-a39d2dc8-1242-4859-aa68-28016d750196.370aca0d-b5f7-4326-893b-7f12937b8db9" returned: 0 in 0.813s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:30:06 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [req-93744128-2e6a-440c-8b67-ee0195d95897 req-2063b2bb-d582-4084-8d22-1b0e8e7792ec tempest-VolumesSnapshotsTestJSON-717879426 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a39d2dc8-1242-4859-aa68-28016d750196(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88899) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 03 08:30:06 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[d61bb050-d884-4572-9995-4c464cbe2c27]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:30:06 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [req-93744128-2e6a-440c-8b67-ee0195d95897 req-2063b2bb-d582-4084-8d22-1b0e8e7792ec tempest-VolumesSnapshotsTestJSON-717879426 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-a39d2dc8-1242-4859-aa68-28016d750196 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:30:06 devstack sudo[91051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-a39d2dc8-1242-4859-aa68-28016d750196 Aug 03 08:30:06 devstack sudo[91051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:30:07 devstack sudo[91051]: pam_unix(sudo:session): session closed for user root Aug 03 08:30:07 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [req-93744128-2e6a-440c-8b67-ee0195d95897 req-2063b2bb-d582-4084-8d22-1b0e8e7792ec tempest-VolumesSnapshotsTestJSON-717879426 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-a39d2dc8-1242-4859-aa68-28016d750196" returned: 0 in 0.598s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:30:07 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [req-93744128-2e6a-440c-8b67-ee0195d95897 req-2063b2bb-d582-4084-8d22-1b0e8e7792ec tempest-VolumesSnapshotsTestJSON-717879426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-a39d2dc8-1242-4859-aa68-28016d750196.370aca0d-b5f7-4326-893b-7f12937b8db9 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:30:07 devstack sudo[91058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-a39d2dc8-1242-4859-aa68-28016d750196.370aca0d-b5f7-4326-893b-7f12937b8db9 Aug 03 08:30:07 devstack sudo[91058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:30:07 devstack sudo[91058]: pam_unix(sudo:session): session closed for user root Aug 03 08:30:07 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [req-93744128-2e6a-440c-8b67-ee0195d95897 req-2063b2bb-d582-4084-8d22-1b0e8e7792ec tempest-VolumesSnapshotsTestJSON-717879426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-a39d2dc8-1242-4859-aa68-28016d750196.370aca0d-b5f7-4326-893b-7f12937b8db9" returned: 0 in 0.782s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:30:07 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [req-93744128-2e6a-440c-8b67-ee0195d95897 req-2063b2bb-d582-4084-8d22-1b0e8e7792ec tempest-VolumesSnapshotsTestJSON-717879426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-a39d2dc8-1242-4859-aa68-28016d750196.370aca0d-b5f7-4326-893b-7f12937b8db9 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:30:07 devstack sudo[91094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-a39d2dc8-1242-4859-aa68-28016d750196.370aca0d-b5f7-4326-893b-7f12937b8db9 Aug 03 08:30:07 devstack sudo[91094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:30:08 devstack sudo[91094]: pam_unix(sudo:session): session closed for user root Aug 03 08:30:08 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [req-93744128-2e6a-440c-8b67-ee0195d95897 req-2063b2bb-d582-4084-8d22-1b0e8e7792ec tempest-VolumesSnapshotsTestJSON-717879426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-a39d2dc8-1242-4859-aa68-28016d750196.370aca0d-b5f7-4326-893b-7f12937b8db9" returned: 0 in 0.351s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:30:08 devstack cinder-volume[88899]: DEBUG cinder.coordination [req-93744128-2e6a-440c-8b67-ee0195d95897 req-2063b2bb-d582-4084-8d22-1b0e8e7792ec tempest-VolumesSnapshotsTestJSON-717879426 None] Lock "cinder-quobyte-370aca0d-b5f7-4326-893b-7f12937b8db9" released by "_delete_snapshot" :: held 2.758s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:30:08 devstack cinder-volume[88899]: DEBUG cinder.coordination [req-93744128-2e6a-440c-8b67-ee0195d95897 req-2063b2bb-d582-4084-8d22-1b0e8e7792ec tempest-VolumesSnapshotsTestJSON-717879426 None] Lock "cinder-quobyte-a39d2dc8-1242-4859-aa68-28016d750196" released by "delete_snapshot" :: held 2.804s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:30:08 devstack cinder-volume[88899]: WARNING cinder.quota [req-93744128-2e6a-440c-8b67-ee0195d95897 req-2063b2bb-d582-4084-8d22-1b0e8e7792ec tempest-VolumesSnapshotsTestJSON-717879426 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Aug 03 08:30:08 devstack cinder-volume[88899]: DEBUG cinder.quota [req-93744128-2e6a-440c-8b67-ee0195d95897 req-2063b2bb-d582-4084-8d22-1b0e8e7792ec tempest-VolumesSnapshotsTestJSON-717879426 None] Created reservations ['34c39598-08a7-4414-8d11-efd3cb8c67b9', 'ba0f4606-cfd4-4202-87a7-65ae4f0cfd74', 'f0cfcdea-d977-4bd9-b3a9-d7f07502c418', '334a2eed-d6af-4628-880e-4b5536a4deb3'] {{(pid=88899) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 08:30:08 devstack cinder-volume[88899]: INFO cinder.volume.manager [req-93744128-2e6a-440c-8b67-ee0195d95897 req-2063b2bb-d582-4084-8d22-1b0e8e7792ec tempest-VolumesSnapshotsTestJSON-717879426 None] Delete snapshot completed successfully. Aug 03 08:30:08 devstack cinder-volume[88899]: DEBUG cinder.coordination [req-93744128-2e6a-440c-8b67-ee0195d95897 req-2063b2bb-d582-4084-8d22-1b0e8e7792ec tempest-VolumesSnapshotsTestJSON-717879426 None] Lock "cinder-370aca0d-b5f7-4326-893b-7f12937b8db9-delete_snapshot" released by "delete_snapshot" :: held 3.337s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:30:10 devstack cinder-volume[88899]: DEBUG cinder.coordination [req-b6243f30-3c85-49b8-a8d2-428926dc5aab req-a2f83550-d8f9-41fd-9e24-223bdd5bd61e tempest-VolumesSnapshotsTestJSON-717879426 None] Acquiring lock "cinder-a39d2dc8-1242-4859-aa68-28016d750196-delete_volume" by "delete_volume" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:30:10 devstack cinder-volume[88899]: DEBUG cinder.coordination [req-b6243f30-3c85-49b8-a8d2-428926dc5aab req-a2f83550-d8f9-41fd-9e24-223bdd5bd61e tempest-VolumesSnapshotsTestJSON-717879426 None] Lock "cinder-a39d2dc8-1242-4859-aa68-28016d750196-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:30:10 devstack cinder-volume[88899]: DEBUG cinder.coordination [req-b6243f30-3c85-49b8-a8d2-428926dc5aab req-a2f83550-d8f9-41fd-9e24-223bdd5bd61e tempest-VolumesSnapshotsTestJSON-717879426 None] Acquiring lock "cinder-quobyte-a39d2dc8-1242-4859-aa68-28016d750196" by "delete_volume" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:30:10 devstack cinder-volume[88899]: DEBUG cinder.coordination [req-b6243f30-3c85-49b8-a8d2-428926dc5aab req-a2f83550-d8f9-41fd-9e24-223bdd5bd61e tempest-VolumesSnapshotsTestJSON-717879426 None] Lock "cinder-quobyte-a39d2dc8-1242-4859-aa68-28016d750196" acquired by "delete_volume" :: waited 0.046s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:30:10 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b8f5e56-4c89-48b5-a016-a29f6fdd99a6]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:30:10 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [req-b6243f30-3c85-49b8-a8d2-428926dc5aab req-a2f83550-d8f9-41fd-9e24-223bdd5bd61e tempest-VolumesSnapshotsTestJSON-717879426 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-a39d2dc8-1242-4859-aa68-28016d750196 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:30:10 devstack sudo[91186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-a39d2dc8-1242-4859-aa68-28016d750196 Aug 03 08:30:10 devstack sudo[91186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:30:11 devstack sudo[91186]: pam_unix(sudo:session): session closed for user root Aug 03 08:30:11 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [req-b6243f30-3c85-49b8-a8d2-428926dc5aab req-a2f83550-d8f9-41fd-9e24-223bdd5bd61e tempest-VolumesSnapshotsTestJSON-717879426 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-a39d2dc8-1242-4859-aa68-28016d750196" returned: 0 in 0.692s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:30:11 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [req-b6243f30-3c85-49b8-a8d2-428926dc5aab req-a2f83550-d8f9-41fd-9e24-223bdd5bd61e tempest-VolumesSnapshotsTestJSON-717879426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-a39d2dc8-1242-4859-aa68-28016d750196 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:30:11 devstack sudo[91222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-a39d2dc8-1242-4859-aa68-28016d750196 Aug 03 08:30:11 devstack sudo[91222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:30:11 devstack sudo[91222]: pam_unix(sudo:session): session closed for user root Aug 03 08:30:11 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [req-b6243f30-3c85-49b8-a8d2-428926dc5aab req-a2f83550-d8f9-41fd-9e24-223bdd5bd61e tempest-VolumesSnapshotsTestJSON-717879426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-a39d2dc8-1242-4859-aa68-28016d750196" returned: 0 in 0.454s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:30:11 devstack cinder-volume[88899]: DEBUG cinder.coordination [req-b6243f30-3c85-49b8-a8d2-428926dc5aab req-a2f83550-d8f9-41fd-9e24-223bdd5bd61e tempest-VolumesSnapshotsTestJSON-717879426 None] Lock "cinder-quobyte-a39d2dc8-1242-4859-aa68-28016d750196" released by "delete_volume" :: held 1.274s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:30:11 devstack cinder-volume[88899]: DEBUG cinder.quota [req-b6243f30-3c85-49b8-a8d2-428926dc5aab req-a2f83550-d8f9-41fd-9e24-223bdd5bd61e tempest-VolumesSnapshotsTestJSON-717879426 None] Created reservations ['a2189ce6-d12b-48d6-ad4a-821d5584040e', '4e1386ff-c42a-4bab-a43b-1296f5a266b1', '1d7e1e8d-874f-4cd0-8d3a-8b4f683bc2a5', '24ada985-ff15-4012-8236-9c64239258b6'] {{(pid=88899) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 08:30:11 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [req-b6243f30-3c85-49b8-a8d2-428926dc5aab req-a2f83550-d8f9-41fd-9e24-223bdd5bd61e tempest-VolumesSnapshotsTestJSON-717879426 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:30:11 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [req-b6243f30-3c85-49b8-a8d2-428926dc5aab req-a2f83550-d8f9-41fd-9e24-223bdd5bd61e tempest-VolumesSnapshotsTestJSON-717879426 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:30:11 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [req-b6243f30-3c85-49b8-a8d2-428926dc5aab req-a2f83550-d8f9-41fd-9e24-223bdd5bd61e tempest-VolumesSnapshotsTestJSON-717879426 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:30:11 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [req-b6243f30-3c85-49b8-a8d2-428926dc5aab req-a2f83550-d8f9-41fd-9e24-223bdd5bd61e tempest-VolumesSnapshotsTestJSON-717879426 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:30:11 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [req-b6243f30-3c85-49b8-a8d2-428926dc5aab req-a2f83550-d8f9-41fd-9e24-223bdd5bd61e tempest-VolumesSnapshotsTestJSON-717879426 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:30:11 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [req-b6243f30-3c85-49b8-a8d2-428926dc5aab req-a2f83550-d8f9-41fd-9e24-223bdd5bd61e tempest-VolumesSnapshotsTestJSON-717879426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:30:11 devstack sudo[91240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a Aug 03 08:30:11 devstack sudo[91240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:30:12 devstack sudo[91240]: pam_unix(sudo:session): session closed for user root Aug 03 08:30:12 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [req-b6243f30-3c85-49b8-a8d2-428926dc5aab req-a2f83550-d8f9-41fd-9e24-223bdd5bd61e tempest-VolumesSnapshotsTestJSON-717879426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a" returned: 0 in 0.275s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:30:12 devstack cinder-volume[88899]: DEBUG cinder.manager [req-b6243f30-3c85-49b8-a8d2-428926dc5aab req-a2f83550-d8f9-41fd-9e24-223bdd5bd61e tempest-VolumesSnapshotsTestJSON-717879426 None] Notifying Schedulers of capabilities ... {{(pid=88899) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 08:30:12 devstack cinder-volume[88899]: INFO cinder.volume.manager [req-b6243f30-3c85-49b8-a8d2-428926dc5aab req-a2f83550-d8f9-41fd-9e24-223bdd5bd61e tempest-VolumesSnapshotsTestJSON-717879426 None] Deleted volume successfully. Aug 03 08:30:12 devstack cinder-volume[88899]: DEBUG cinder.coordination [req-b6243f30-3c85-49b8-a8d2-428926dc5aab req-a2f83550-d8f9-41fd-9e24-223bdd5bd61e tempest-VolumesSnapshotsTestJSON-717879426 None] Lock "cinder-a39d2dc8-1242-4859-aa68-28016d750196-delete_volume" released by "delete_volume" :: held 1.864s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:30:18 devstack cinder-volume[88899]: DEBUG cinder.volume.flows.manager.create_volume [None req-e979cdde-4acf-42bf-b3ba-3760cfd01dc7 tempest-VolumesTestJSON-1101774118 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88899) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 08:30:18 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-e979cdde-4acf-42bf-b3ba-3760cfd01dc7 tempest-VolumesTestJSON-1101774118 None] Flow 'volume_create_manager' (b7b7bd2a-cbe5-4f95-b54e-5c5abbb9ee8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:30:18 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-e979cdde-4acf-42bf-b3ba-3760cfd01dc7 tempest-VolumesTestJSON-1101774118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4daf1e3c-0cc8-44b8-8c2c-488a1731a774) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:30:18 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-e979cdde-4acf-42bf-b3ba-3760cfd01dc7 tempest-VolumesTestJSON-1101774118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4daf1e3c-0cc8-44b8-8c2c-488a1731a774) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:30:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-410653435',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=82b0c993-fc2b-4469-a3b6-5eefb94a836b,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='fb708dbf04e448118f38809f0abd8206',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:30:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:30:18Z,use_quota=True,user_id='1fa23ad68248466b9e1ae100ca733e57',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8bde7129-1dc4-42ab-b852-ab32c61b4921),volume_type_id=8bde7129-1dc4-42ab-b852-ab32c61b4921)' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:30:18 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-e979cdde-4acf-42bf-b3ba-3760cfd01dc7 tempest-VolumesTestJSON-1101774118 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (432b7c89-0fbd-44da-9d16-f56ac5830778) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:30:18 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-e979cdde-4acf-42bf-b3ba-3760cfd01dc7 tempest-VolumesTestJSON-1101774118 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (432b7c89-0fbd-44da-9d16-f56ac5830778) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:30:18 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-e979cdde-4acf-42bf-b3ba-3760cfd01dc7 tempest-VolumesTestJSON-1101774118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0cd748d5-4cc3-46d3-955b-526a1570459a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:30:18 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-e979cdde-4acf-42bf-b3ba-3760cfd01dc7 tempest-VolumesTestJSON-1101774118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0cd748d5-4cc3-46d3-955b-526a1570459a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '82b0c993-fc2b-4469-a3b6-5eefb94a836b', 'volume_name': 'volume-82b0c993-fc2b-4469-a3b6-5eefb94a836b', 'volume_size': 1}' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:30:18 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-e979cdde-4acf-42bf-b3ba-3760cfd01dc7 tempest-VolumesTestJSON-1101774118 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a93d145-e3aa-4436-81a7-c9b9a1c314fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:30:18 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-e979cdde-4acf-42bf-b3ba-3760cfd01dc7 tempest-VolumesTestJSON-1101774118 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a93d145-e3aa-4436-81a7-c9b9a1c314fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:30:18 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-e979cdde-4acf-42bf-b3ba-3760cfd01dc7 tempest-VolumesTestJSON-1101774118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (08b41109-41d0-436a-af5d-49c07c4a1ed1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:30:18 devstack cinder-volume[88899]: INFO cinder.volume.flows.manager.create_volume [None req-e979cdde-4acf-42bf-b3ba-3760cfd01dc7 tempest-VolumesTestJSON-1101774118 None] Volume 82b0c993-fc2b-4469-a3b6-5eefb94a836b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-82b0c993-fc2b-4469-a3b6-5eefb94a836b', 'volume_size': 1} Aug 03 08:30:18 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-e979cdde-4acf-42bf-b3ba-3760cfd01dc7 tempest-VolumesTestJSON-1101774118 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:30:18 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-e979cdde-4acf-42bf-b3ba-3760cfd01dc7 tempest-VolumesTestJSON-1101774118 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:30:18 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-e979cdde-4acf-42bf-b3ba-3760cfd01dc7 tempest-VolumesTestJSON-1101774118 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:30:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-410653435',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=82b0c993-fc2b-4469-a3b6-5eefb94a836b,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='fb708dbf04e448118f38809f0abd8206',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:30:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:30:18Z,use_quota=True,user_id='1fa23ad68248466b9e1ae100ca733e57',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8bde7129-1dc4-42ab-b852-ab32c61b4921),volume_type_id=8bde7129-1dc4-42ab-b852-ab32c61b4921)}" {{(pid=88899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 08:30:18 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-e979cdde-4acf-42bf-b3ba-3760cfd01dc7 tempest-VolumesTestJSON-1101774118 None] Creating volume 82b0c993-fc2b-4469-a3b6-5eefb94a836b {{(pid=88899) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 08:30:18 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-e979cdde-4acf-42bf-b3ba-3760cfd01dc7 tempest-VolumesTestJSON-1101774118 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:30:18 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-e979cdde-4acf-42bf-b3ba-3760cfd01dc7 tempest-VolumesTestJSON-1101774118 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:30:18 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-e979cdde-4acf-42bf-b3ba-3760cfd01dc7 tempest-VolumesTestJSON-1101774118 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:30:18 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-e979cdde-4acf-42bf-b3ba-3760cfd01dc7 tempest-VolumesTestJSON-1101774118 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:30:18 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-e979cdde-4acf-42bf-b3ba-3760cfd01dc7 tempest-VolumesTestJSON-1101774118 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:30:18 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-e979cdde-4acf-42bf-b3ba-3760cfd01dc7 tempest-VolumesTestJSON-1101774118 None] Selected osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385 as target Quobyte volume. {{(pid=88899) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 08:30:18 devstack cinder-volume[88899]: INFO cinder.volume.drivers.remotefs [None req-e979cdde-4acf-42bf-b3ba-3760cfd01dc7 tempest-VolumesTestJSON-1101774118 None] casted to osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385 Aug 03 08:30:18 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-e979cdde-4acf-42bf-b3ba-3760cfd01dc7 tempest-VolumesTestJSON-1101774118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-82b0c993-fc2b-4469-a3b6-5eefb94a836b 1073741824 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:30:18 devstack sudo[91272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-82b0c993-fc2b-4469-a3b6-5eefb94a836b 1073741824 Aug 03 08:30:18 devstack sudo[91272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:30:18 devstack sudo[91272]: pam_unix(sudo:session): session closed for user root Aug 03 08:30:18 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-e979cdde-4acf-42bf-b3ba-3760cfd01dc7 tempest-VolumesTestJSON-1101774118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-82b0c993-fc2b-4469-a3b6-5eefb94a836b 1073741824" returned: 0 in 0.430s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:30:19 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-e979cdde-4acf-42bf-b3ba-3760cfd01dc7 tempest-VolumesTestJSON-1101774118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-82b0c993-fc2b-4469-a3b6-5eefb94a836b {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:30:19 devstack sudo[91277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-82b0c993-fc2b-4469-a3b6-5eefb94a836b Aug 03 08:30:19 devstack sudo[91277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:30:19 devstack sudo[91277]: pam_unix(sudo:session): session closed for user root Aug 03 08:30:19 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-e979cdde-4acf-42bf-b3ba-3760cfd01dc7 tempest-VolumesTestJSON-1101774118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-82b0c993-fc2b-4469-a3b6-5eefb94a836b" returned: 0 in 0.265s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:30:19 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-e979cdde-4acf-42bf-b3ba-3760cfd01dc7 tempest-VolumesTestJSON-1101774118 None] <== create_volume: return (738ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'} {{(pid=88899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 08:30:19 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-e979cdde-4acf-42bf-b3ba-3760cfd01dc7 tempest-VolumesTestJSON-1101774118 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.741s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:30:19 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-e979cdde-4acf-42bf-b3ba-3760cfd01dc7 tempest-VolumesTestJSON-1101774118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (08b41109-41d0-436a-af5d-49c07c4a1ed1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-82b0c993-fc2b-4469-a3b6-5eefb94a836b', 'volume_size': 1}' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:30:19 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-e979cdde-4acf-42bf-b3ba-3760cfd01dc7 tempest-VolumesTestJSON-1101774118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec1b4240-f276-48a4-a0a8-b7d0753ce48a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:30:19 devstack cinder-volume[88899]: INFO cinder.volume.flows.manager.create_volume [None req-e979cdde-4acf-42bf-b3ba-3760cfd01dc7 tempest-VolumesTestJSON-1101774118 None] Volume volume-82b0c993-fc2b-4469-a3b6-5eefb94a836b (82b0c993-fc2b-4469-a3b6-5eefb94a836b): created successfully Aug 03 08:30:19 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-e979cdde-4acf-42bf-b3ba-3760cfd01dc7 tempest-VolumesTestJSON-1101774118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec1b4240-f276-48a4-a0a8-b7d0753ce48a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:30:19 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-e979cdde-4acf-42bf-b3ba-3760cfd01dc7 tempest-VolumesTestJSON-1101774118 None] Flow 'volume_create_manager' (b7b7bd2a-cbe5-4f95-b54e-5c5abbb9ee8e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:30:19 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-e979cdde-4acf-42bf-b3ba-3760cfd01dc7 tempest-VolumesTestJSON-1101774118 None] Created volume successfully. Aug 03 08:30:20 devstack cinder-volume[88899]: DEBUG cinder.volume.flows.manager.create_volume [None req-92a695de-0600-4333-989a-a52f91cc2a78 tempest-VolumesTestJSON-1101774118 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88899) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 08:30:20 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-92a695de-0600-4333-989a-a52f91cc2a78 tempest-VolumesTestJSON-1101774118 None] Flow 'volume_create_manager' (d37cb0a3-9356-4e61-963f-a9afed1013a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:30:20 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-92a695de-0600-4333-989a-a52f91cc2a78 tempest-VolumesTestJSON-1101774118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (22270857-ab30-460f-b80c-b072d804f18b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:30:20 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-92a695de-0600-4333-989a-a52f91cc2a78 tempest-VolumesTestJSON-1101774118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (22270857-ab30-460f-b80c-b072d804f18b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:30:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1965088340',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c1ac31a1-366e-4dcd-802a-4a3f7bbc578d,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='fb708dbf04e448118f38809f0abd8206',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:30:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:30:20Z,use_quota=True,user_id='1fa23ad68248466b9e1ae100ca733e57',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8bde7129-1dc4-42ab-b852-ab32c61b4921),volume_type_id=8bde7129-1dc4-42ab-b852-ab32c61b4921)' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:30:20 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-92a695de-0600-4333-989a-a52f91cc2a78 tempest-VolumesTestJSON-1101774118 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9d19de2-2f4a-4544-a0fd-9bed78bc82cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:30:20 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-92a695de-0600-4333-989a-a52f91cc2a78 tempest-VolumesTestJSON-1101774118 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9d19de2-2f4a-4544-a0fd-9bed78bc82cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:30:20 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-92a695de-0600-4333-989a-a52f91cc2a78 tempest-VolumesTestJSON-1101774118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b8e839f-d784-4301-a5a3-deedb9d1384c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:30:20 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-92a695de-0600-4333-989a-a52f91cc2a78 tempest-VolumesTestJSON-1101774118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b8e839f-d784-4301-a5a3-deedb9d1384c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c1ac31a1-366e-4dcd-802a-4a3f7bbc578d', 'volume_name': 'volume-c1ac31a1-366e-4dcd-802a-4a3f7bbc578d', 'volume_size': 1}' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:30:20 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-92a695de-0600-4333-989a-a52f91cc2a78 tempest-VolumesTestJSON-1101774118 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (baa26fda-4907-4517-b326-dc4ac353e8a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:30:20 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-92a695de-0600-4333-989a-a52f91cc2a78 tempest-VolumesTestJSON-1101774118 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (baa26fda-4907-4517-b326-dc4ac353e8a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:30:20 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-92a695de-0600-4333-989a-a52f91cc2a78 tempest-VolumesTestJSON-1101774118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6fc58b82-6e7e-4d09-b7de-56e2a3b98417) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:30:20 devstack cinder-volume[88899]: INFO cinder.volume.flows.manager.create_volume [None req-92a695de-0600-4333-989a-a52f91cc2a78 tempest-VolumesTestJSON-1101774118 None] Volume c1ac31a1-366e-4dcd-802a-4a3f7bbc578d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c1ac31a1-366e-4dcd-802a-4a3f7bbc578d', 'volume_size': 1} Aug 03 08:30:20 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-92a695de-0600-4333-989a-a52f91cc2a78 tempest-VolumesTestJSON-1101774118 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:30:20 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-92a695de-0600-4333-989a-a52f91cc2a78 tempest-VolumesTestJSON-1101774118 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:30:20 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-92a695de-0600-4333-989a-a52f91cc2a78 tempest-VolumesTestJSON-1101774118 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:30:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1965088340',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c1ac31a1-366e-4dcd-802a-4a3f7bbc578d,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='fb708dbf04e448118f38809f0abd8206',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:30:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:30:20Z,use_quota=True,user_id='1fa23ad68248466b9e1ae100ca733e57',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8bde7129-1dc4-42ab-b852-ab32c61b4921),volume_type_id=8bde7129-1dc4-42ab-b852-ab32c61b4921)}" {{(pid=88899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 08:30:20 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-92a695de-0600-4333-989a-a52f91cc2a78 tempest-VolumesTestJSON-1101774118 None] Creating volume c1ac31a1-366e-4dcd-802a-4a3f7bbc578d {{(pid=88899) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 08:30:20 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-92a695de-0600-4333-989a-a52f91cc2a78 tempest-VolumesTestJSON-1101774118 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:30:20 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-92a695de-0600-4333-989a-a52f91cc2a78 tempest-VolumesTestJSON-1101774118 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:30:20 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-92a695de-0600-4333-989a-a52f91cc2a78 tempest-VolumesTestJSON-1101774118 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:30:20 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-92a695de-0600-4333-989a-a52f91cc2a78 tempest-VolumesTestJSON-1101774118 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:30:20 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-92a695de-0600-4333-989a-a52f91cc2a78 tempest-VolumesTestJSON-1101774118 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:30:20 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-92a695de-0600-4333-989a-a52f91cc2a78 tempest-VolumesTestJSON-1101774118 None] Selected osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385 as target Quobyte volume. {{(pid=88899) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 08:30:20 devstack cinder-volume[88899]: INFO cinder.volume.drivers.remotefs [None req-92a695de-0600-4333-989a-a52f91cc2a78 tempest-VolumesTestJSON-1101774118 None] casted to osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385 Aug 03 08:30:20 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-92a695de-0600-4333-989a-a52f91cc2a78 tempest-VolumesTestJSON-1101774118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c1ac31a1-366e-4dcd-802a-4a3f7bbc578d 1073741824 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:30:20 devstack sudo[91280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c1ac31a1-366e-4dcd-802a-4a3f7bbc578d 1073741824 Aug 03 08:30:20 devstack sudo[91280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:30:20 devstack sudo[91280]: pam_unix(sudo:session): session closed for user root Aug 03 08:30:20 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-92a695de-0600-4333-989a-a52f91cc2a78 tempest-VolumesTestJSON-1101774118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c1ac31a1-366e-4dcd-802a-4a3f7bbc578d 1073741824" returned: 0 in 0.485s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:30:20 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-92a695de-0600-4333-989a-a52f91cc2a78 tempest-VolumesTestJSON-1101774118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c1ac31a1-366e-4dcd-802a-4a3f7bbc578d {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:30:20 devstack sudo[91286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c1ac31a1-366e-4dcd-802a-4a3f7bbc578d Aug 03 08:30:20 devstack sudo[91286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:30:21 devstack sudo[91286]: pam_unix(sudo:session): session closed for user root Aug 03 08:30:21 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-92a695de-0600-4333-989a-a52f91cc2a78 tempest-VolumesTestJSON-1101774118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c1ac31a1-366e-4dcd-802a-4a3f7bbc578d" returned: 0 in 0.340s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:30:21 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-92a695de-0600-4333-989a-a52f91cc2a78 tempest-VolumesTestJSON-1101774118 None] <== create_volume: return (891ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'} {{(pid=88899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 08:30:21 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-92a695de-0600-4333-989a-a52f91cc2a78 tempest-VolumesTestJSON-1101774118 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.895s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:30:21 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-92a695de-0600-4333-989a-a52f91cc2a78 tempest-VolumesTestJSON-1101774118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6fc58b82-6e7e-4d09-b7de-56e2a3b98417) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c1ac31a1-366e-4dcd-802a-4a3f7bbc578d', 'volume_size': 1}' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:30:21 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-92a695de-0600-4333-989a-a52f91cc2a78 tempest-VolumesTestJSON-1101774118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93d7f740-f036-4c29-99cd-f6a5607d6308) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:30:21 devstack cinder-volume[88899]: INFO cinder.volume.flows.manager.create_volume [None req-92a695de-0600-4333-989a-a52f91cc2a78 tempest-VolumesTestJSON-1101774118 None] Volume volume-c1ac31a1-366e-4dcd-802a-4a3f7bbc578d (c1ac31a1-366e-4dcd-802a-4a3f7bbc578d): created successfully Aug 03 08:30:21 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-92a695de-0600-4333-989a-a52f91cc2a78 tempest-VolumesTestJSON-1101774118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93d7f740-f036-4c29-99cd-f6a5607d6308) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:30:21 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-92a695de-0600-4333-989a-a52f91cc2a78 tempest-VolumesTestJSON-1101774118 None] Flow 'volume_create_manager' (d37cb0a3-9356-4e61-963f-a9afed1013a7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:30:21 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-92a695de-0600-4333-989a-a52f91cc2a78 tempest-VolumesTestJSON-1101774118 None] Created volume successfully. Aug 03 08:30:21 devstack cinder-volume[88899]: DEBUG cinder.volume.flows.manager.create_volume [None req-3438912d-958e-4baf-8c75-e5694ccfd3b3 tempest-VolumesTestJSON-1101774118 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88899) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 08:30:21 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-3438912d-958e-4baf-8c75-e5694ccfd3b3 tempest-VolumesTestJSON-1101774118 None] Flow 'volume_create_manager' (a4ab03e8-fa6f-405b-a047-387d81fe9171) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:30:21 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-3438912d-958e-4baf-8c75-e5694ccfd3b3 tempest-VolumesTestJSON-1101774118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5aa46753-d9e1-44f3-a72d-46eef19703bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:30:21 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-3438912d-958e-4baf-8c75-e5694ccfd3b3 tempest-VolumesTestJSON-1101774118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5aa46753-d9e1-44f3-a72d-46eef19703bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:30:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-506373524',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36d53af2-05cc-48e6-96c4-33b2d4a1119a,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='fb708dbf04e448118f38809f0abd8206',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:30:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:30:22Z,use_quota=True,user_id='1fa23ad68248466b9e1ae100ca733e57',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8bde7129-1dc4-42ab-b852-ab32c61b4921),volume_type_id=8bde7129-1dc4-42ab-b852-ab32c61b4921)' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:30:22 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-3438912d-958e-4baf-8c75-e5694ccfd3b3 tempest-VolumesTestJSON-1101774118 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc2b61d4-1932-42f3-8cb0-306af4a9aeba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:30:22 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-3438912d-958e-4baf-8c75-e5694ccfd3b3 tempest-VolumesTestJSON-1101774118 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc2b61d4-1932-42f3-8cb0-306af4a9aeba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:30:22 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-3438912d-958e-4baf-8c75-e5694ccfd3b3 tempest-VolumesTestJSON-1101774118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (823d9f5c-f902-4f64-a196-08375cfcd344) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:30:22 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-3438912d-958e-4baf-8c75-e5694ccfd3b3 tempest-VolumesTestJSON-1101774118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (823d9f5c-f902-4f64-a196-08375cfcd344) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '36d53af2-05cc-48e6-96c4-33b2d4a1119a', 'volume_name': 'volume-36d53af2-05cc-48e6-96c4-33b2d4a1119a', 'volume_size': 1}' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:30:22 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-3438912d-958e-4baf-8c75-e5694ccfd3b3 tempest-VolumesTestJSON-1101774118 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (882acdfe-e6e2-46b2-be32-487aa98bf8fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:30:22 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-3438912d-958e-4baf-8c75-e5694ccfd3b3 tempest-VolumesTestJSON-1101774118 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (882acdfe-e6e2-46b2-be32-487aa98bf8fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:30:22 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-3438912d-958e-4baf-8c75-e5694ccfd3b3 tempest-VolumesTestJSON-1101774118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9bbb57fe-c98e-4001-a2ec-8e2f95eddacd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:30:22 devstack cinder-volume[88899]: INFO cinder.volume.flows.manager.create_volume [None req-3438912d-958e-4baf-8c75-e5694ccfd3b3 tempest-VolumesTestJSON-1101774118 None] Volume 36d53af2-05cc-48e6-96c4-33b2d4a1119a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-36d53af2-05cc-48e6-96c4-33b2d4a1119a', 'volume_size': 1} Aug 03 08:30:22 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-3438912d-958e-4baf-8c75-e5694ccfd3b3 tempest-VolumesTestJSON-1101774118 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:30:22 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-3438912d-958e-4baf-8c75-e5694ccfd3b3 tempest-VolumesTestJSON-1101774118 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:30:22 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-3438912d-958e-4baf-8c75-e5694ccfd3b3 tempest-VolumesTestJSON-1101774118 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:30:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-506373524',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36d53af2-05cc-48e6-96c4-33b2d4a1119a,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='fb708dbf04e448118f38809f0abd8206',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:30:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:30:22Z,use_quota=True,user_id='1fa23ad68248466b9e1ae100ca733e57',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8bde7129-1dc4-42ab-b852-ab32c61b4921),volume_type_id=8bde7129-1dc4-42ab-b852-ab32c61b4921)}" {{(pid=88899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 08:30:22 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-3438912d-958e-4baf-8c75-e5694ccfd3b3 tempest-VolumesTestJSON-1101774118 None] Creating volume 36d53af2-05cc-48e6-96c4-33b2d4a1119a {{(pid=88899) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 08:30:22 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-3438912d-958e-4baf-8c75-e5694ccfd3b3 tempest-VolumesTestJSON-1101774118 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:30:22 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-3438912d-958e-4baf-8c75-e5694ccfd3b3 tempest-VolumesTestJSON-1101774118 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:30:22 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-3438912d-958e-4baf-8c75-e5694ccfd3b3 tempest-VolumesTestJSON-1101774118 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:30:22 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-3438912d-958e-4baf-8c75-e5694ccfd3b3 tempest-VolumesTestJSON-1101774118 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:30:22 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-3438912d-958e-4baf-8c75-e5694ccfd3b3 tempest-VolumesTestJSON-1101774118 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:30:22 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-3438912d-958e-4baf-8c75-e5694ccfd3b3 tempest-VolumesTestJSON-1101774118 None] Selected osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385 as target Quobyte volume. {{(pid=88899) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 08:30:22 devstack cinder-volume[88899]: INFO cinder.volume.drivers.remotefs [None req-3438912d-958e-4baf-8c75-e5694ccfd3b3 tempest-VolumesTestJSON-1101774118 None] casted to osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385 Aug 03 08:30:22 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-3438912d-958e-4baf-8c75-e5694ccfd3b3 tempest-VolumesTestJSON-1101774118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-36d53af2-05cc-48e6-96c4-33b2d4a1119a 1073741824 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:30:22 devstack sudo[91289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-36d53af2-05cc-48e6-96c4-33b2d4a1119a 1073741824 Aug 03 08:30:22 devstack sudo[91289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:30:22 devstack sudo[91289]: pam_unix(sudo:session): session closed for user root Aug 03 08:30:22 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-3438912d-958e-4baf-8c75-e5694ccfd3b3 tempest-VolumesTestJSON-1101774118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-36d53af2-05cc-48e6-96c4-33b2d4a1119a 1073741824" returned: 0 in 0.469s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:30:22 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-3438912d-958e-4baf-8c75-e5694ccfd3b3 tempest-VolumesTestJSON-1101774118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-36d53af2-05cc-48e6-96c4-33b2d4a1119a {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:30:22 devstack sudo[91295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-36d53af2-05cc-48e6-96c4-33b2d4a1119a Aug 03 08:30:22 devstack sudo[91295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:30:22 devstack sudo[91295]: pam_unix(sudo:session): session closed for user root Aug 03 08:30:22 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-3438912d-958e-4baf-8c75-e5694ccfd3b3 tempest-VolumesTestJSON-1101774118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-36d53af2-05cc-48e6-96c4-33b2d4a1119a" returned: 0 in 0.368s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:30:22 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-3438912d-958e-4baf-8c75-e5694ccfd3b3 tempest-VolumesTestJSON-1101774118 None] <== create_volume: return (891ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'} {{(pid=88899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 08:30:22 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-3438912d-958e-4baf-8c75-e5694ccfd3b3 tempest-VolumesTestJSON-1101774118 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.894s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:30:22 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-3438912d-958e-4baf-8c75-e5694ccfd3b3 tempest-VolumesTestJSON-1101774118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9bbb57fe-c98e-4001-a2ec-8e2f95eddacd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-36d53af2-05cc-48e6-96c4-33b2d4a1119a', 'volume_size': 1}' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:30:22 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-3438912d-958e-4baf-8c75-e5694ccfd3b3 tempest-VolumesTestJSON-1101774118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e08c318-bff5-4491-a3d7-360f7dbbbaf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:30:22 devstack cinder-volume[88899]: INFO cinder.volume.flows.manager.create_volume [None req-3438912d-958e-4baf-8c75-e5694ccfd3b3 tempest-VolumesTestJSON-1101774118 None] Volume volume-36d53af2-05cc-48e6-96c4-33b2d4a1119a (36d53af2-05cc-48e6-96c4-33b2d4a1119a): created successfully Aug 03 08:30:22 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-3438912d-958e-4baf-8c75-e5694ccfd3b3 tempest-VolumesTestJSON-1101774118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e08c318-bff5-4491-a3d7-360f7dbbbaf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:30:22 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-3438912d-958e-4baf-8c75-e5694ccfd3b3 tempest-VolumesTestJSON-1101774118 None] Flow 'volume_create_manager' (a4ab03e8-fa6f-405b-a047-387d81fe9171) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:30:22 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-3438912d-958e-4baf-8c75-e5694ccfd3b3 tempest-VolumesTestJSON-1101774118 None] Created volume successfully. Aug 03 08:30:25 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-f887a9fe-281b-4b7b-9323-be77f0232d63 tempest-VolumesTestJSON-1101774118 None] Acquiring lock "cinder-36d53af2-05cc-48e6-96c4-33b2d4a1119a-delete_volume" by "delete_volume" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:30:25 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-f887a9fe-281b-4b7b-9323-be77f0232d63 tempest-VolumesTestJSON-1101774118 None] Lock "cinder-36d53af2-05cc-48e6-96c4-33b2d4a1119a-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:30:25 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-f887a9fe-281b-4b7b-9323-be77f0232d63 tempest-VolumesTestJSON-1101774118 None] Acquiring lock "cinder-quobyte-36d53af2-05cc-48e6-96c4-33b2d4a1119a" by "delete_volume" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:30:25 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-f887a9fe-281b-4b7b-9323-be77f0232d63 tempest-VolumesTestJSON-1101774118 None] Lock "cinder-quobyte-36d53af2-05cc-48e6-96c4-33b2d4a1119a" acquired by "delete_volume" :: waited 0.026s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:30:25 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[1feefb34-e11e-45c6-a551-a420e74c595b]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:30:25 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-f887a9fe-281b-4b7b-9323-be77f0232d63 tempest-VolumesTestJSON-1101774118 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-36d53af2-05cc-48e6-96c4-33b2d4a1119a {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:30:25 devstack sudo[91304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-36d53af2-05cc-48e6-96c4-33b2d4a1119a Aug 03 08:30:25 devstack sudo[91304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:30:25 devstack cinder-volume[88899]: DEBUG cinder.volume.flows.manager.create_volume [None req-f3b68b85-9b3b-4229-8c80-08337c70d9d6 tempest-AttachVolumeTestJSON-774804622 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88899) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 08:30:25 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-f3b68b85-9b3b-4229-8c80-08337c70d9d6 tempest-AttachVolumeTestJSON-774804622 None] Flow 'volume_create_manager' (28aa68c2-6bc5-4438-8d4b-6efefc297260) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:30:25 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-f3b68b85-9b3b-4229-8c80-08337c70d9d6 tempest-AttachVolumeTestJSON-774804622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9608856f-2267-4f8c-9ea0-30c7c91ea6f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:30:25 devstack sudo[91304]: pam_unix(sudo:session): session closed for user root Aug 03 08:30:25 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-f3b68b85-9b3b-4229-8c80-08337c70d9d6 tempest-AttachVolumeTestJSON-774804622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9608856f-2267-4f8c-9ea0-30c7c91ea6f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:30:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-557183560',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=27ad7c1f-d740-4d19-b5ef-e0f8f84745ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9bf4090138434ab497d39b037bbd3123',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:30:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:30:26Z,use_quota=True,user_id='e0bd98856b2a4c5d947e8c7c7337e770',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8bde7129-1dc4-42ab-b852-ab32c61b4921),volume_type_id=8bde7129-1dc4-42ab-b852-ab32c61b4921)' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:30:25 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-f3b68b85-9b3b-4229-8c80-08337c70d9d6 tempest-AttachVolumeTestJSON-774804622 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (569e92bc-a644-4aa6-9b7c-8855c314e434) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:30:25 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-f3b68b85-9b3b-4229-8c80-08337c70d9d6 tempest-AttachVolumeTestJSON-774804622 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (569e92bc-a644-4aa6-9b7c-8855c314e434) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:30:25 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-f3b68b85-9b3b-4229-8c80-08337c70d9d6 tempest-AttachVolumeTestJSON-774804622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44ae6b5b-79f4-4291-93b9-929541cde815) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:30:25 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-f3b68b85-9b3b-4229-8c80-08337c70d9d6 tempest-AttachVolumeTestJSON-774804622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44ae6b5b-79f4-4291-93b9-929541cde815) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '27ad7c1f-d740-4d19-b5ef-e0f8f84745ba', 'volume_name': 'volume-27ad7c1f-d740-4d19-b5ef-e0f8f84745ba', 'volume_size': 1}' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:30:25 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-f3b68b85-9b3b-4229-8c80-08337c70d9d6 tempest-AttachVolumeTestJSON-774804622 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bfb91486-39ab-4c50-851f-b3fb84556457) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:30:25 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-f3b68b85-9b3b-4229-8c80-08337c70d9d6 tempest-AttachVolumeTestJSON-774804622 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bfb91486-39ab-4c50-851f-b3fb84556457) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:30:25 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-f3b68b85-9b3b-4229-8c80-08337c70d9d6 tempest-AttachVolumeTestJSON-774804622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (00cf5524-708e-4bd9-bfff-ea2b822d99ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:30:25 devstack cinder-volume[88899]: INFO cinder.volume.flows.manager.create_volume [None req-f3b68b85-9b3b-4229-8c80-08337c70d9d6 tempest-AttachVolumeTestJSON-774804622 None] Volume 27ad7c1f-d740-4d19-b5ef-e0f8f84745ba: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-27ad7c1f-d740-4d19-b5ef-e0f8f84745ba', 'volume_size': 1} Aug 03 08:30:25 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-f3b68b85-9b3b-4229-8c80-08337c70d9d6 tempest-AttachVolumeTestJSON-774804622 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:30:25 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-f3b68b85-9b3b-4229-8c80-08337c70d9d6 tempest-AttachVolumeTestJSON-774804622 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:30:25 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-f3b68b85-9b3b-4229-8c80-08337c70d9d6 tempest-AttachVolumeTestJSON-774804622 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:30:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-557183560',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=27ad7c1f-d740-4d19-b5ef-e0f8f84745ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9bf4090138434ab497d39b037bbd3123',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:30:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:30:26Z,use_quota=True,user_id='e0bd98856b2a4c5d947e8c7c7337e770',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8bde7129-1dc4-42ab-b852-ab32c61b4921),volume_type_id=8bde7129-1dc4-42ab-b852-ab32c61b4921)}" {{(pid=88899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 08:30:25 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-f3b68b85-9b3b-4229-8c80-08337c70d9d6 tempest-AttachVolumeTestJSON-774804622 None] Creating volume 27ad7c1f-d740-4d19-b5ef-e0f8f84745ba {{(pid=88899) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 08:30:25 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-f3b68b85-9b3b-4229-8c80-08337c70d9d6 tempest-AttachVolumeTestJSON-774804622 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:30:25 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-f3b68b85-9b3b-4229-8c80-08337c70d9d6 tempest-AttachVolumeTestJSON-774804622 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:30:25 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-f3b68b85-9b3b-4229-8c80-08337c70d9d6 tempest-AttachVolumeTestJSON-774804622 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:30:25 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-f3b68b85-9b3b-4229-8c80-08337c70d9d6 tempest-AttachVolumeTestJSON-774804622 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:30:25 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-f3b68b85-9b3b-4229-8c80-08337c70d9d6 tempest-AttachVolumeTestJSON-774804622 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:30:25 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-f3b68b85-9b3b-4229-8c80-08337c70d9d6 tempest-AttachVolumeTestJSON-774804622 None] Selected osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385 as target Quobyte volume. {{(pid=88899) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 08:30:25 devstack cinder-volume[88899]: INFO cinder.volume.drivers.remotefs [None req-f3b68b85-9b3b-4229-8c80-08337c70d9d6 tempest-AttachVolumeTestJSON-774804622 None] casted to osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385 Aug 03 08:30:25 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-f3b68b85-9b3b-4229-8c80-08337c70d9d6 tempest-AttachVolumeTestJSON-774804622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-27ad7c1f-d740-4d19-b5ef-e0f8f84745ba 1073741824 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:30:25 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-f887a9fe-281b-4b7b-9323-be77f0232d63 tempest-VolumesTestJSON-1101774118 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-36d53af2-05cc-48e6-96c4-33b2d4a1119a" returned: 0 in 0.536s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:30:25 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-f887a9fe-281b-4b7b-9323-be77f0232d63 tempest-VolumesTestJSON-1101774118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-36d53af2-05cc-48e6-96c4-33b2d4a1119a {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:30:25 devstack sudo[91309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-27ad7c1f-d740-4d19-b5ef-e0f8f84745ba 1073741824 Aug 03 08:30:25 devstack sudo[91309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:30:25 devstack sudo[91310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-36d53af2-05cc-48e6-96c4-33b2d4a1119a Aug 03 08:30:25 devstack sudo[91310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:30:26 devstack sudo[91310]: pam_unix(sudo:session): session closed for user root Aug 03 08:30:26 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-f887a9fe-281b-4b7b-9323-be77f0232d63 tempest-VolumesTestJSON-1101774118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-36d53af2-05cc-48e6-96c4-33b2d4a1119a" returned: 0 in 0.376s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:30:26 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-f887a9fe-281b-4b7b-9323-be77f0232d63 tempest-VolumesTestJSON-1101774118 None] Lock "cinder-quobyte-36d53af2-05cc-48e6-96c4-33b2d4a1119a" released by "delete_volume" :: held 0.979s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:30:26 devstack cinder-volume[88899]: DEBUG cinder.quota [None req-f887a9fe-281b-4b7b-9323-be77f0232d63 tempest-VolumesTestJSON-1101774118 None] Created reservations ['c21e7483-4539-499a-a049-2149a057904f', 'd7d1cd1e-c3ea-46fc-b01b-426ec5489227', '2925c9c4-bcf7-452f-8e15-591b36665fb5', '2e4bdc69-9824-46e2-8893-1c5e4289d12b'] {{(pid=88899) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 08:30:26 devstack sudo[91309]: pam_unix(sudo:session): session closed for user root Aug 03 08:30:26 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-f3b68b85-9b3b-4229-8c80-08337c70d9d6 tempest-AttachVolumeTestJSON-774804622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-27ad7c1f-d740-4d19-b5ef-e0f8f84745ba 1073741824" returned: 0 in 0.549s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:30:26 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-f3b68b85-9b3b-4229-8c80-08337c70d9d6 tempest-AttachVolumeTestJSON-774804622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-27ad7c1f-d740-4d19-b5ef-e0f8f84745ba {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:30:26 devstack sudo[91318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-27ad7c1f-d740-4d19-b5ef-e0f8f84745ba Aug 03 08:30:26 devstack sudo[91318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:30:26 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-f887a9fe-281b-4b7b-9323-be77f0232d63 tempest-VolumesTestJSON-1101774118 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:30:26 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-f887a9fe-281b-4b7b-9323-be77f0232d63 tempest-VolumesTestJSON-1101774118 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:30:26 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-f887a9fe-281b-4b7b-9323-be77f0232d63 tempest-VolumesTestJSON-1101774118 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:30:26 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-f887a9fe-281b-4b7b-9323-be77f0232d63 tempest-VolumesTestJSON-1101774118 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:30:26 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-f887a9fe-281b-4b7b-9323-be77f0232d63 tempest-VolumesTestJSON-1101774118 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:30:26 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-f887a9fe-281b-4b7b-9323-be77f0232d63 tempest-VolumesTestJSON-1101774118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:30:26 devstack sudo[91320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a Aug 03 08:30:26 devstack sudo[91320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:30:26 devstack sudo[91320]: pam_unix(sudo:session): session closed for user root Aug 03 08:30:26 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-f887a9fe-281b-4b7b-9323-be77f0232d63 tempest-VolumesTestJSON-1101774118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a" returned: 0 in 0.329s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:30:26 devstack cinder-volume[88899]: DEBUG cinder.manager [None req-f887a9fe-281b-4b7b-9323-be77f0232d63 tempest-VolumesTestJSON-1101774118 None] Notifying Schedulers of capabilities ... {{(pid=88899) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 08:30:26 devstack sudo[91318]: pam_unix(sudo:session): session closed for user root Aug 03 08:30:26 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-f887a9fe-281b-4b7b-9323-be77f0232d63 tempest-VolumesTestJSON-1101774118 None] Deleted volume successfully. Aug 03 08:30:26 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-f3b68b85-9b3b-4229-8c80-08337c70d9d6 tempest-AttachVolumeTestJSON-774804622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-27ad7c1f-d740-4d19-b5ef-e0f8f84745ba" returned: 0 in 0.409s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:30:26 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-f3b68b85-9b3b-4229-8c80-08337c70d9d6 tempest-AttachVolumeTestJSON-774804622 None] <== create_volume: return (1015ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'} {{(pid=88899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 08:30:26 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-f3b68b85-9b3b-4229-8c80-08337c70d9d6 tempest-AttachVolumeTestJSON-774804622 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.018s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:30:26 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-f3b68b85-9b3b-4229-8c80-08337c70d9d6 tempest-AttachVolumeTestJSON-774804622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (00cf5524-708e-4bd9-bfff-ea2b822d99ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-27ad7c1f-d740-4d19-b5ef-e0f8f84745ba', 'volume_size': 1}' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:30:26 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-f3b68b85-9b3b-4229-8c80-08337c70d9d6 tempest-AttachVolumeTestJSON-774804622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8c60ef0-2639-4e13-9b39-4243f88befe8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:30:26 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-f887a9fe-281b-4b7b-9323-be77f0232d63 tempest-VolumesTestJSON-1101774118 None] Lock "cinder-36d53af2-05cc-48e6-96c4-33b2d4a1119a-delete_volume" released by "delete_volume" :: held 1.695s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:30:26 devstack cinder-volume[88899]: INFO cinder.volume.flows.manager.create_volume [None req-f3b68b85-9b3b-4229-8c80-08337c70d9d6 tempest-AttachVolumeTestJSON-774804622 None] Volume volume-27ad7c1f-d740-4d19-b5ef-e0f8f84745ba (27ad7c1f-d740-4d19-b5ef-e0f8f84745ba): created successfully Aug 03 08:30:26 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-f3b68b85-9b3b-4229-8c80-08337c70d9d6 tempest-AttachVolumeTestJSON-774804622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8c60ef0-2639-4e13-9b39-4243f88befe8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:30:26 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-f3b68b85-9b3b-4229-8c80-08337c70d9d6 tempest-AttachVolumeTestJSON-774804622 None] Flow 'volume_create_manager' (28aa68c2-6bc5-4438-8d4b-6efefc297260) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:30:26 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-f3b68b85-9b3b-4229-8c80-08337c70d9d6 tempest-AttachVolumeTestJSON-774804622 None] Created volume successfully. Aug 03 08:30:27 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-cb0a5a1d-b0da-4ac6-bff8-c827763dfc62 tempest-VolumesTestJSON-1101774118 None] Acquiring lock "cinder-c1ac31a1-366e-4dcd-802a-4a3f7bbc578d-delete_volume" by "delete_volume" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:30:27 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-cb0a5a1d-b0da-4ac6-bff8-c827763dfc62 tempest-VolumesTestJSON-1101774118 None] Lock "cinder-c1ac31a1-366e-4dcd-802a-4a3f7bbc578d-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:30:27 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-cb0a5a1d-b0da-4ac6-bff8-c827763dfc62 tempest-VolumesTestJSON-1101774118 None] Acquiring lock "cinder-quobyte-c1ac31a1-366e-4dcd-802a-4a3f7bbc578d" by "delete_volume" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:30:27 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-cb0a5a1d-b0da-4ac6-bff8-c827763dfc62 tempest-VolumesTestJSON-1101774118 None] Lock "cinder-quobyte-c1ac31a1-366e-4dcd-802a-4a3f7bbc578d" acquired by "delete_volume" :: waited 0.022s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:30:27 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[8db41a2f-d818-447a-b5ca-a69194e13118]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:30:27 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-cb0a5a1d-b0da-4ac6-bff8-c827763dfc62 tempest-VolumesTestJSON-1101774118 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c1ac31a1-366e-4dcd-802a-4a3f7bbc578d {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:30:27 devstack sudo[91326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c1ac31a1-366e-4dcd-802a-4a3f7bbc578d Aug 03 08:30:27 devstack sudo[91326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:30:28 devstack sudo[91326]: pam_unix(sudo:session): session closed for user root Aug 03 08:30:28 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-cb0a5a1d-b0da-4ac6-bff8-c827763dfc62 tempest-VolumesTestJSON-1101774118 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c1ac31a1-366e-4dcd-802a-4a3f7bbc578d" returned: 0 in 0.519s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:30:28 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-cb0a5a1d-b0da-4ac6-bff8-c827763dfc62 tempest-VolumesTestJSON-1101774118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c1ac31a1-366e-4dcd-802a-4a3f7bbc578d {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:30:28 devstack sudo[91336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c1ac31a1-366e-4dcd-802a-4a3f7bbc578d Aug 03 08:30:28 devstack sudo[91336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:30:28 devstack sudo[91336]: pam_unix(sudo:session): session closed for user root Aug 03 08:30:28 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-cb0a5a1d-b0da-4ac6-bff8-c827763dfc62 tempest-VolumesTestJSON-1101774118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c1ac31a1-366e-4dcd-802a-4a3f7bbc578d" returned: 0 in 0.356s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:30:28 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-cb0a5a1d-b0da-4ac6-bff8-c827763dfc62 tempest-VolumesTestJSON-1101774118 None] Lock "cinder-quobyte-c1ac31a1-366e-4dcd-802a-4a3f7bbc578d" released by "delete_volume" :: held 0.930s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:30:28 devstack cinder-volume[88899]: DEBUG cinder.quota [None req-cb0a5a1d-b0da-4ac6-bff8-c827763dfc62 tempest-VolumesTestJSON-1101774118 None] Created reservations ['f84782de-2d41-46e8-9ffa-5fd40d1de3a2', 'ef8da63f-2529-42bf-a378-34f2a3fea7e2', 'f9120a79-9cab-4486-a390-175050dffed1', 'f4e1c399-cb44-4078-b220-01e4a1311876'] {{(pid=88899) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 08:30:28 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-cb0a5a1d-b0da-4ac6-bff8-c827763dfc62 tempest-VolumesTestJSON-1101774118 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:30:28 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-cb0a5a1d-b0da-4ac6-bff8-c827763dfc62 tempest-VolumesTestJSON-1101774118 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:30:28 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-cb0a5a1d-b0da-4ac6-bff8-c827763dfc62 tempest-VolumesTestJSON-1101774118 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:30:28 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-cb0a5a1d-b0da-4ac6-bff8-c827763dfc62 tempest-VolumesTestJSON-1101774118 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:30:28 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-cb0a5a1d-b0da-4ac6-bff8-c827763dfc62 tempest-VolumesTestJSON-1101774118 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:30:28 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-cb0a5a1d-b0da-4ac6-bff8-c827763dfc62 tempest-VolumesTestJSON-1101774118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:30:28 devstack sudo[91373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a Aug 03 08:30:28 devstack sudo[91373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:30:28 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [req-73c96c37-9db0-4b14-83f8-616fcd6ffd22 req-34e90d99-7415-4657-bcab-4fe995598961 tempest-AttachVolumeTestJSON-774804622 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:30:28 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [req-73c96c37-9db0-4b14-83f8-616fcd6ffd22 req-34e90d99-7415-4657-bcab-4fe995598961 tempest-AttachVolumeTestJSON-774804622 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:30:28 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [req-73c96c37-9db0-4b14-83f8-616fcd6ffd22 req-34e90d99-7415-4657-bcab-4fe995598961 tempest-AttachVolumeTestJSON-774804622 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.018s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:30:28 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-64c20662-be90-4912-923d-29540793a84e tempest-VolumesTestJSON-1101774118 None] Acquiring lock "cinder-82b0c993-fc2b-4469-a3b6-5eefb94a836b-delete_volume" by "delete_volume" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:30:28 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-64c20662-be90-4912-923d-29540793a84e tempest-VolumesTestJSON-1101774118 None] Lock "cinder-82b0c993-fc2b-4469-a3b6-5eefb94a836b-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:30:28 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [req-73c96c37-9db0-4b14-83f8-616fcd6ffd22 req-34e90d99-7415-4657-bcab-4fe995598961 tempest-AttachVolumeTestJSON-774804622 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385', 'name': 'volume-27ad7c1f-d740-4d19-b5ef-e0f8f84745ba', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '0c52f5f6-5812-447b-9a10-00436cde5139', 'enforce_multipath': True} {{(pid=88899) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 03 08:30:28 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-64c20662-be90-4912-923d-29540793a84e tempest-VolumesTestJSON-1101774118 None] Acquiring lock "cinder-quobyte-82b0c993-fc2b-4469-a3b6-5eefb94a836b" by "delete_volume" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:30:28 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-64c20662-be90-4912-923d-29540793a84e tempest-VolumesTestJSON-1101774118 None] Lock "cinder-quobyte-82b0c993-fc2b-4469-a3b6-5eefb94a836b" acquired by "delete_volume" :: waited 0.040s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:30:29 devstack cinder-volume[88899]: INFO cinder.volume.manager [req-73c96c37-9db0-4b14-83f8-616fcd6ffd22 req-34e90d99-7415-4657-bcab-4fe995598961 tempest-AttachVolumeTestJSON-774804622 None] attachment_update completed successfully. Aug 03 08:30:29 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[5279826d-7ec7-4cd0-8b62-993f78d222ea]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:30:29 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-64c20662-be90-4912-923d-29540793a84e tempest-VolumesTestJSON-1101774118 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-82b0c993-fc2b-4469-a3b6-5eefb94a836b {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:30:29 devstack sudo[91373]: pam_unix(sudo:session): session closed for user root Aug 03 08:30:29 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-cb0a5a1d-b0da-4ac6-bff8-c827763dfc62 tempest-VolumesTestJSON-1101774118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a" returned: 0 in 0.357s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:30:29 devstack cinder-volume[88899]: DEBUG cinder.manager [None req-cb0a5a1d-b0da-4ac6-bff8-c827763dfc62 tempest-VolumesTestJSON-1101774118 None] Notifying Schedulers of capabilities ... {{(pid=88899) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 08:30:29 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-cb0a5a1d-b0da-4ac6-bff8-c827763dfc62 tempest-VolumesTestJSON-1101774118 None] Deleted volume successfully. Aug 03 08:30:29 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-cb0a5a1d-b0da-4ac6-bff8-c827763dfc62 tempest-VolumesTestJSON-1101774118 None] Lock "cinder-c1ac31a1-366e-4dcd-802a-4a3f7bbc578d-delete_volume" released by "delete_volume" :: held 1.626s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:30:29 devstack sudo[91376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-82b0c993-fc2b-4469-a3b6-5eefb94a836b Aug 03 08:30:29 devstack sudo[91376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:30:29 devstack sudo[91376]: pam_unix(sudo:session): session closed for user root Aug 03 08:30:29 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-64c20662-be90-4912-923d-29540793a84e tempest-VolumesTestJSON-1101774118 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-82b0c993-fc2b-4469-a3b6-5eefb94a836b" returned: 0 in 0.442s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:30:29 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-64c20662-be90-4912-923d-29540793a84e tempest-VolumesTestJSON-1101774118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-82b0c993-fc2b-4469-a3b6-5eefb94a836b {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:30:29 devstack sudo[91765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-82b0c993-fc2b-4469-a3b6-5eefb94a836b Aug 03 08:30:29 devstack sudo[91765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:30:29 devstack sudo[91765]: pam_unix(sudo:session): session closed for user root Aug 03 08:30:29 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-64c20662-be90-4912-923d-29540793a84e tempest-VolumesTestJSON-1101774118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-82b0c993-fc2b-4469-a3b6-5eefb94a836b" returned: 0 in 0.266s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:30:29 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-64c20662-be90-4912-923d-29540793a84e tempest-VolumesTestJSON-1101774118 None] Lock "cinder-quobyte-82b0c993-fc2b-4469-a3b6-5eefb94a836b" released by "delete_volume" :: held 0.762s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:30:29 devstack cinder-volume[88899]: DEBUG cinder.quota [None req-64c20662-be90-4912-923d-29540793a84e tempest-VolumesTestJSON-1101774118 None] Created reservations ['80a7fd44-2592-4d07-b210-9e8d0b2f2ff2', '7cff27ad-1a08-4da9-ae96-e5e670b39e3e', '8cc53049-4394-4d36-92a2-b221f28bc423', 'b34b68a9-50ac-4a4b-8776-7e06ee8c69da'] {{(pid=88899) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 08:30:29 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-64c20662-be90-4912-923d-29540793a84e tempest-VolumesTestJSON-1101774118 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:30:29 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-64c20662-be90-4912-923d-29540793a84e tempest-VolumesTestJSON-1101774118 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:30:29 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-64c20662-be90-4912-923d-29540793a84e tempest-VolumesTestJSON-1101774118 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:30:29 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-64c20662-be90-4912-923d-29540793a84e tempest-VolumesTestJSON-1101774118 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:30:29 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-64c20662-be90-4912-923d-29540793a84e tempest-VolumesTestJSON-1101774118 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:30:29 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-64c20662-be90-4912-923d-29540793a84e tempest-VolumesTestJSON-1101774118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:30:29 devstack sudo[91769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a Aug 03 08:30:29 devstack sudo[91769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:30:30 devstack sudo[91769]: pam_unix(sudo:session): session closed for user root Aug 03 08:30:30 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-64c20662-be90-4912-923d-29540793a84e tempest-VolumesTestJSON-1101774118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a" returned: 0 in 0.289s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:30:30 devstack cinder-volume[88899]: DEBUG cinder.manager [None req-64c20662-be90-4912-923d-29540793a84e tempest-VolumesTestJSON-1101774118 None] Notifying Schedulers of capabilities ... {{(pid=88899) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 08:30:30 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-64c20662-be90-4912-923d-29540793a84e tempest-VolumesTestJSON-1101774118 None] Deleted volume successfully. Aug 03 08:30:30 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-64c20662-be90-4912-923d-29540793a84e tempest-VolumesTestJSON-1101774118 None] Lock "cinder-82b0c993-fc2b-4469-a3b6-5eefb94a836b-delete_volume" released by "delete_volume" :: held 1.353s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:30:39 devstack cinder-volume[88899]: DEBUG dbcounter [-] [88899] Writing DB stats cinder:SELECT=46,cinder:UPDATE=60,cinder:INSERT=13,cinder:DELETE=7 {{(pid=88899) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 03 08:30:40 devstack cinder-volume[88899]: DEBUG dbcounter [-] [88899] Writing DB stats cinder:UPDATE=58,cinder:SELECT=52,cinder:INSERT=14,cinder:DELETE=4 {{(pid=88899) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 03 08:30:42 devstack cinder-volume[88899]: DEBUG cinder.volume.flows.manager.create_volume [None req-35b12989-b00f-4187-b639-80e3b760a6af tempest-VolumeRetypeWithoutMigrationTest-283475328 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88899) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 08:30:42 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-35b12989-b00f-4187-b639-80e3b760a6af tempest-VolumeRetypeWithoutMigrationTest-283475328 None] Flow 'volume_create_manager' (05ffc25d-c673-479f-927f-3e9e0c701b75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:30:42 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-35b12989-b00f-4187-b639-80e3b760a6af tempest-VolumeRetypeWithoutMigrationTest-283475328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4af7fd34-122d-4d84-af92-92cf27a2a016) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:30:42 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-35b12989-b00f-4187-b639-80e3b760a6af tempest-VolumeRetypeWithoutMigrationTest-283475328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4af7fd34-122d-4d84-af92-92cf27a2a016) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:30:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-528919872',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=13ebe967-4d51-4c21-9c45-0e3908441690,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2890390b67644c5fb34dfc383a9046c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:30:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:30:43Z,use_quota=True,user_id='735f1aa13bd54c91a69218464e63175a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d91a068f-06f5-4831-ab15-c857f0209f5e),volume_type_id=d91a068f-06f5-4831-ab15-c857f0209f5e)' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:30:42 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-35b12989-b00f-4187-b639-80e3b760a6af tempest-VolumeRetypeWithoutMigrationTest-283475328 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51b3f77c-25ec-4f57-be70-3a9cfb772a7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:30:42 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-35b12989-b00f-4187-b639-80e3b760a6af tempest-VolumeRetypeWithoutMigrationTest-283475328 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51b3f77c-25ec-4f57-be70-3a9cfb772a7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:30:42 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-35b12989-b00f-4187-b639-80e3b760a6af tempest-VolumeRetypeWithoutMigrationTest-283475328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (98b07cf7-dcc2-4473-b8a5-1cd406ca3586) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:30:42 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-35b12989-b00f-4187-b639-80e3b760a6af tempest-VolumeRetypeWithoutMigrationTest-283475328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (98b07cf7-dcc2-4473-b8a5-1cd406ca3586) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '13ebe967-4d51-4c21-9c45-0e3908441690', 'volume_name': 'volume-13ebe967-4d51-4c21-9c45-0e3908441690', 'volume_size': 1}' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:30:42 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-35b12989-b00f-4187-b639-80e3b760a6af tempest-VolumeRetypeWithoutMigrationTest-283475328 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f844adef-2966-4587-bf9f-8f06d7b55577) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:30:42 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-35b12989-b00f-4187-b639-80e3b760a6af tempest-VolumeRetypeWithoutMigrationTest-283475328 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f844adef-2966-4587-bf9f-8f06d7b55577) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:30:42 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-35b12989-b00f-4187-b639-80e3b760a6af tempest-VolumeRetypeWithoutMigrationTest-283475328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (28b954a7-49e3-413a-b4fd-95d712570432) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:30:42 devstack cinder-volume[88899]: INFO cinder.volume.flows.manager.create_volume [None req-35b12989-b00f-4187-b639-80e3b760a6af tempest-VolumeRetypeWithoutMigrationTest-283475328 None] Volume 13ebe967-4d51-4c21-9c45-0e3908441690: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-13ebe967-4d51-4c21-9c45-0e3908441690', 'volume_size': 1} Aug 03 08:30:42 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-35b12989-b00f-4187-b639-80e3b760a6af tempest-VolumeRetypeWithoutMigrationTest-283475328 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:30:42 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-35b12989-b00f-4187-b639-80e3b760a6af tempest-VolumeRetypeWithoutMigrationTest-283475328 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:30:42 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-35b12989-b00f-4187-b639-80e3b760a6af tempest-VolumeRetypeWithoutMigrationTest-283475328 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:30:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-528919872',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=13ebe967-4d51-4c21-9c45-0e3908441690,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2890390b67644c5fb34dfc383a9046c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:30:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:30:43Z,use_quota=True,user_id='735f1aa13bd54c91a69218464e63175a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d91a068f-06f5-4831-ab15-c857f0209f5e),volume_type_id=d91a068f-06f5-4831-ab15-c857f0209f5e)}" {{(pid=88899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 08:30:42 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-35b12989-b00f-4187-b639-80e3b760a6af tempest-VolumeRetypeWithoutMigrationTest-283475328 None] Creating volume 13ebe967-4d51-4c21-9c45-0e3908441690 {{(pid=88899) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 08:30:42 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-35b12989-b00f-4187-b639-80e3b760a6af tempest-VolumeRetypeWithoutMigrationTest-283475328 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:30:42 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-35b12989-b00f-4187-b639-80e3b760a6af tempest-VolumeRetypeWithoutMigrationTest-283475328 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:30:42 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-35b12989-b00f-4187-b639-80e3b760a6af tempest-VolumeRetypeWithoutMigrationTest-283475328 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:30:42 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-35b12989-b00f-4187-b639-80e3b760a6af tempest-VolumeRetypeWithoutMigrationTest-283475328 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:30:42 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-35b12989-b00f-4187-b639-80e3b760a6af tempest-VolumeRetypeWithoutMigrationTest-283475328 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:30:42 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-35b12989-b00f-4187-b639-80e3b760a6af tempest-VolumeRetypeWithoutMigrationTest-283475328 None] Selected osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385 as target Quobyte volume. {{(pid=88899) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 08:30:42 devstack cinder-volume[88899]: INFO cinder.volume.drivers.remotefs [None req-35b12989-b00f-4187-b639-80e3b760a6af tempest-VolumeRetypeWithoutMigrationTest-283475328 None] casted to osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385 Aug 03 08:30:42 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-35b12989-b00f-4187-b639-80e3b760a6af tempest-VolumeRetypeWithoutMigrationTest-283475328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-13ebe967-4d51-4c21-9c45-0e3908441690 1073741824 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:30:42 devstack sudo[92338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-13ebe967-4d51-4c21-9c45-0e3908441690 1073741824 Aug 03 08:30:42 devstack sudo[92338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:30:44 devstack sudo[92338]: pam_unix(sudo:session): session closed for user root Aug 03 08:30:44 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-35b12989-b00f-4187-b639-80e3b760a6af tempest-VolumeRetypeWithoutMigrationTest-283475328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-13ebe967-4d51-4c21-9c45-0e3908441690 1073741824" returned: 0 in 1.155s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:30:44 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-35b12989-b00f-4187-b639-80e3b760a6af tempest-VolumeRetypeWithoutMigrationTest-283475328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-13ebe967-4d51-4c21-9c45-0e3908441690 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:30:44 devstack sudo[92393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-13ebe967-4d51-4c21-9c45-0e3908441690 Aug 03 08:30:44 devstack sudo[92393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:30:44 devstack sudo[92393]: pam_unix(sudo:session): session closed for user root Aug 03 08:30:44 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-35b12989-b00f-4187-b639-80e3b760a6af tempest-VolumeRetypeWithoutMigrationTest-283475328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-13ebe967-4d51-4c21-9c45-0e3908441690" returned: 0 in 0.368s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:30:44 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-35b12989-b00f-4187-b639-80e3b760a6af tempest-VolumeRetypeWithoutMigrationTest-283475328 None] <== create_volume: return (1628ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'} {{(pid=88899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 08:30:44 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-35b12989-b00f-4187-b639-80e3b760a6af tempest-VolumeRetypeWithoutMigrationTest-283475328 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.631s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:30:44 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-35b12989-b00f-4187-b639-80e3b760a6af tempest-VolumeRetypeWithoutMigrationTest-283475328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (28b954a7-49e3-413a-b4fd-95d712570432) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-13ebe967-4d51-4c21-9c45-0e3908441690', 'volume_size': 1}' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:30:44 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-35b12989-b00f-4187-b639-80e3b760a6af tempest-VolumeRetypeWithoutMigrationTest-283475328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9056c04-aabc-4a9b-b8e5-63363949268a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:30:44 devstack cinder-volume[88899]: INFO cinder.volume.flows.manager.create_volume [None req-35b12989-b00f-4187-b639-80e3b760a6af tempest-VolumeRetypeWithoutMigrationTest-283475328 None] Volume volume-13ebe967-4d51-4c21-9c45-0e3908441690 (13ebe967-4d51-4c21-9c45-0e3908441690): created successfully Aug 03 08:30:44 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-35b12989-b00f-4187-b639-80e3b760a6af tempest-VolumeRetypeWithoutMigrationTest-283475328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9056c04-aabc-4a9b-b8e5-63363949268a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:30:44 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-35b12989-b00f-4187-b639-80e3b760a6af tempest-VolumeRetypeWithoutMigrationTest-283475328 None] Flow 'volume_create_manager' (05ffc25d-c673-479f-927f-3e9e0c701b75) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:30:44 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-35b12989-b00f-4187-b639-80e3b760a6af tempest-VolumeRetypeWithoutMigrationTest-283475328 None] Created volume successfully. Aug 03 08:30:45 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-5fa7220d-9214-42b1-a25b-342bfd1e0642 tempest-VolumeRetypeWithoutMigrationTest-283475328 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:30:45 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-5fa7220d-9214-42b1-a25b-342bfd1e0642 tempest-VolumeRetypeWithoutMigrationTest-283475328 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:30:45 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-5fa7220d-9214-42b1-a25b-342bfd1e0642 tempest-VolumeRetypeWithoutMigrationTest-283475328 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:30:45 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-5fa7220d-9214-42b1-a25b-342bfd1e0642 tempest-VolumeRetypeWithoutMigrationTest-283475328 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:30:45 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-5fa7220d-9214-42b1-a25b-342bfd1e0642 tempest-VolumeRetypeWithoutMigrationTest-283475328 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:30:45 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-5fa7220d-9214-42b1-a25b-342bfd1e0642 tempest-VolumeRetypeWithoutMigrationTest-283475328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:30:45 devstack sudo[92414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a Aug 03 08:30:45 devstack sudo[92414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:30:45 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [req-a773a67e-9f3a-4dd8-b829-03451ee2e6cf req-7ee3ed18-186a-4d03-8b2c-416876b5bb74 tempest-TaggedAttachmentsTest-1331297186 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:30:45 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [req-a773a67e-9f3a-4dd8-b829-03451ee2e6cf req-7ee3ed18-186a-4d03-8b2c-416876b5bb74 tempest-TaggedAttachmentsTest-1331297186 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:30:45 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [req-a773a67e-9f3a-4dd8-b829-03451ee2e6cf req-7ee3ed18-186a-4d03-8b2c-416876b5bb74 tempest-TaggedAttachmentsTest-1331297186 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.018s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:30:45 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [req-a773a67e-9f3a-4dd8-b829-03451ee2e6cf req-7ee3ed18-186a-4d03-8b2c-416876b5bb74 tempest-TaggedAttachmentsTest-1331297186 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385', 'name': 'volume-702286d7-ae7e-4589-98b9-a0cb9cb735bf', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '5727b8d4-9784-4b24-b145-5a88177e9b8c', 'enforce_multipath': True} {{(pid=88899) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 03 08:30:45 devstack cinder-volume[88899]: INFO cinder.volume.manager [req-a773a67e-9f3a-4dd8-b829-03451ee2e6cf req-7ee3ed18-186a-4d03-8b2c-416876b5bb74 tempest-TaggedAttachmentsTest-1331297186 None] attachment_update completed successfully. Aug 03 08:30:45 devstack sudo[92414]: pam_unix(sudo:session): session closed for user root Aug 03 08:30:45 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-5fa7220d-9214-42b1-a25b-342bfd1e0642 tempest-VolumeRetypeWithoutMigrationTest-283475328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a" returned: 0 in 0.289s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:30:45 devstack cinder-volume[88899]: DEBUG cinder.manager [None req-5fa7220d-9214-42b1-a25b-342bfd1e0642 tempest-VolumeRetypeWithoutMigrationTest-283475328 None] Notifying Schedulers of capabilities ... {{(pid=88899) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 08:30:45 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-5fa7220d-9214-42b1-a25b-342bfd1e0642 tempest-VolumeRetypeWithoutMigrationTest-283475328 None] Retype volume completed successfully. Aug 03 08:30:46 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-e74e0c6d-656a-44c5-b341-69f7b67274e2 tempest-VolumeRetypeWithoutMigrationTest-283475328 None] Acquiring lock "cinder-13ebe967-4d51-4c21-9c45-0e3908441690-delete_volume" by "delete_volume" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:30:46 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-e74e0c6d-656a-44c5-b341-69f7b67274e2 tempest-VolumeRetypeWithoutMigrationTest-283475328 None] Lock "cinder-13ebe967-4d51-4c21-9c45-0e3908441690-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:30:46 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-e74e0c6d-656a-44c5-b341-69f7b67274e2 tempest-VolumeRetypeWithoutMigrationTest-283475328 None] Acquiring lock "cinder-quobyte-13ebe967-4d51-4c21-9c45-0e3908441690" by "delete_volume" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:30:46 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-e74e0c6d-656a-44c5-b341-69f7b67274e2 tempest-VolumeRetypeWithoutMigrationTest-283475328 None] Lock "cinder-quobyte-13ebe967-4d51-4c21-9c45-0e3908441690" acquired by "delete_volume" :: waited 0.017s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:30:46 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[6956d3a9-3950-441d-a03e-57bd7fdd8b6e]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:30:46 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-e74e0c6d-656a-44c5-b341-69f7b67274e2 tempest-VolumeRetypeWithoutMigrationTest-283475328 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-13ebe967-4d51-4c21-9c45-0e3908441690 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:30:47 devstack sudo[92423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-13ebe967-4d51-4c21-9c45-0e3908441690 Aug 03 08:30:47 devstack sudo[92423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:30:47 devstack sudo[92423]: pam_unix(sudo:session): session closed for user root Aug 03 08:30:47 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-e74e0c6d-656a-44c5-b341-69f7b67274e2 tempest-VolumeRetypeWithoutMigrationTest-283475328 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-13ebe967-4d51-4c21-9c45-0e3908441690" returned: 0 in 0.365s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:30:47 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-e74e0c6d-656a-44c5-b341-69f7b67274e2 tempest-VolumeRetypeWithoutMigrationTest-283475328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-13ebe967-4d51-4c21-9c45-0e3908441690 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:30:47 devstack sudo[92429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-13ebe967-4d51-4c21-9c45-0e3908441690 Aug 03 08:30:47 devstack sudo[92429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:30:47 devstack sudo[92429]: pam_unix(sudo:session): session closed for user root Aug 03 08:30:47 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-e74e0c6d-656a-44c5-b341-69f7b67274e2 tempest-VolumeRetypeWithoutMigrationTest-283475328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-13ebe967-4d51-4c21-9c45-0e3908441690" returned: 0 in 0.273s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:30:47 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-e74e0c6d-656a-44c5-b341-69f7b67274e2 tempest-VolumeRetypeWithoutMigrationTest-283475328 None] Lock "cinder-quobyte-13ebe967-4d51-4c21-9c45-0e3908441690" released by "delete_volume" :: held 0.678s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:30:47 devstack cinder-volume[88899]: WARNING cinder.quota [None req-e74e0c6d-656a-44c5-b341-69f7b67274e2 tempest-VolumeRetypeWithoutMigrationTest-283475328 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Aug 03 08:30:47 devstack cinder-volume[88899]: WARNING cinder.quota [None req-e74e0c6d-656a-44c5-b341-69f7b67274e2 tempest-VolumeRetypeWithoutMigrationTest-283475328 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Aug 03 08:30:47 devstack cinder-volume[88899]: DEBUG cinder.quota [None req-e74e0c6d-656a-44c5-b341-69f7b67274e2 tempest-VolumeRetypeWithoutMigrationTest-283475328 None] Created reservations ['9a42e96b-fbfb-40eb-bf4e-3dfa9d43b97d', '821233ff-3804-44b7-98a7-aac31eb2df8a', '27a5ba57-f867-424d-aee5-03c8f377dc8d', '6bc20eee-0255-47cb-86b8-ec7cd81dfc5d'] {{(pid=88899) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 08:30:47 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-e74e0c6d-656a-44c5-b341-69f7b67274e2 tempest-VolumeRetypeWithoutMigrationTest-283475328 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:30:47 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-e74e0c6d-656a-44c5-b341-69f7b67274e2 tempest-VolumeRetypeWithoutMigrationTest-283475328 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:30:47 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-e74e0c6d-656a-44c5-b341-69f7b67274e2 tempest-VolumeRetypeWithoutMigrationTest-283475328 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:30:47 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-e74e0c6d-656a-44c5-b341-69f7b67274e2 tempest-VolumeRetypeWithoutMigrationTest-283475328 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:30:47 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-e74e0c6d-656a-44c5-b341-69f7b67274e2 tempest-VolumeRetypeWithoutMigrationTest-283475328 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:30:47 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-e74e0c6d-656a-44c5-b341-69f7b67274e2 tempest-VolumeRetypeWithoutMigrationTest-283475328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:30:47 devstack sudo[92436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a Aug 03 08:30:47 devstack sudo[92436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:30:47 devstack sudo[92436]: pam_unix(sudo:session): session closed for user root Aug 03 08:30:47 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-e74e0c6d-656a-44c5-b341-69f7b67274e2 tempest-VolumeRetypeWithoutMigrationTest-283475328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a" returned: 0 in 0.275s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:30:47 devstack cinder-volume[88899]: DEBUG cinder.manager [None req-e74e0c6d-656a-44c5-b341-69f7b67274e2 tempest-VolumeRetypeWithoutMigrationTest-283475328 None] Notifying Schedulers of capabilities ... {{(pid=88899) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 08:30:47 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-e74e0c6d-656a-44c5-b341-69f7b67274e2 tempest-VolumeRetypeWithoutMigrationTest-283475328 None] Deleted volume successfully. Aug 03 08:30:48 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-e74e0c6d-656a-44c5-b341-69f7b67274e2 tempest-VolumeRetypeWithoutMigrationTest-283475328 None] Lock "cinder-13ebe967-4d51-4c21-9c45-0e3908441690-delete_volume" released by "delete_volume" :: held 1.186s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:30:49 devstack cinder-volume[88899]: INFO cinder.volume.manager [req-bddd14c6-8566-4a9d-a747-a7e3222acacb req-856f4dd1-043a-4d85-a8ad-34f0a7aaec6b tempest-TaggedAttachmentsTest-1331297186 None] Terminate volume connection completed successfully. Aug 03 08:30:49 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [req-bddd14c6-8566-4a9d-a747-a7e3222acacb req-856f4dd1-043a-4d85-a8ad-34f0a7aaec6b tempest-TaggedAttachmentsTest-1331297186 None] Deleting attachment 5727b8d4-9784-4b24-b145-5a88177e9b8c. {{(pid=88899) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 03 08:30:51 devstack cinder-volume[88899]: DEBUG oslo_service.periodic_task [None req-f948fb4a-c4d7-499f-b1bd-8d6be3de0b53 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88899) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 03 08:30:51 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-f948fb4a-c4d7-499f-b1bd-8d6be3de0b53 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:30:51 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-f948fb4a-c4d7-499f-b1bd-8d6be3de0b53 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:30:51 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-f948fb4a-c4d7-499f-b1bd-8d6be3de0b53 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:30:51 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-f948fb4a-c4d7-499f-b1bd-8d6be3de0b53 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:30:51 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-f948fb4a-c4d7-499f-b1bd-8d6be3de0b53 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:30:51 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-f948fb4a-c4d7-499f-b1bd-8d6be3de0b53 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:30:51 devstack sudo[92527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a Aug 03 08:30:51 devstack sudo[92527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:30:52 devstack sudo[92527]: pam_unix(sudo:session): session closed for user root Aug 03 08:30:52 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-f948fb4a-c4d7-499f-b1bd-8d6be3de0b53 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a" returned: 0 in 0.486s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:30:52 devstack cinder-volume[88899]: DEBUG cinder.manager [None req-f948fb4a-c4d7-499f-b1bd-8d6be3de0b53 None None] Notifying Schedulers of capabilities ... {{(pid=88899) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 08:30:55 devstack cinder-volume[88899]: DEBUG cinder.volume.flows.manager.create_volume [None req-d7e880f2-6400-4c3c-a1da-81a004ac14a0 tempest-VolumesServicesTestJSON-1422780633 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88899) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 08:30:55 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-d7e880f2-6400-4c3c-a1da-81a004ac14a0 tempest-VolumesServicesTestJSON-1422780633 None] Flow 'volume_create_manager' (ecd9100f-cc1b-4246-bec5-a9ecd7ce4cb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:30:55 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-d7e880f2-6400-4c3c-a1da-81a004ac14a0 tempest-VolumesServicesTestJSON-1422780633 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62d479be-a4c7-4a9f-ad3b-165c20472cfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:30:55 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-d7e880f2-6400-4c3c-a1da-81a004ac14a0 tempest-VolumesServicesTestJSON-1422780633 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62d479be-a4c7-4a9f-ad3b-165c20472cfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:30:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1131823417',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=88408c13-a1c9-4762-8f19-96d886f9c76e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4cead5073311452d864f8cc0fe3d9d3b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:30:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:30:55Z,use_quota=True,user_id='d00f3d66ed5e462a9e36b3e349103fed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8bde7129-1dc4-42ab-b852-ab32c61b4921),volume_type_id=8bde7129-1dc4-42ab-b852-ab32c61b4921)' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:30:55 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-d7e880f2-6400-4c3c-a1da-81a004ac14a0 tempest-VolumesServicesTestJSON-1422780633 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67402003-d0cf-4065-878a-537542f97e28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:30:55 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-d7e880f2-6400-4c3c-a1da-81a004ac14a0 tempest-VolumesServicesTestJSON-1422780633 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67402003-d0cf-4065-878a-537542f97e28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:30:55 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-d7e880f2-6400-4c3c-a1da-81a004ac14a0 tempest-VolumesServicesTestJSON-1422780633 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (81e96d0f-e82d-4e7b-85a1-dfa7fa6c1d62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:30:55 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-d7e880f2-6400-4c3c-a1da-81a004ac14a0 tempest-VolumesServicesTestJSON-1422780633 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (81e96d0f-e82d-4e7b-85a1-dfa7fa6c1d62) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '88408c13-a1c9-4762-8f19-96d886f9c76e', 'volume_name': 'volume-88408c13-a1c9-4762-8f19-96d886f9c76e', 'volume_size': 1}' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:30:55 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-d7e880f2-6400-4c3c-a1da-81a004ac14a0 tempest-VolumesServicesTestJSON-1422780633 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74ab4c0d-d4c5-4461-bec1-37fd3eb0a8fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:30:55 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-d7e880f2-6400-4c3c-a1da-81a004ac14a0 tempest-VolumesServicesTestJSON-1422780633 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74ab4c0d-d4c5-4461-bec1-37fd3eb0a8fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:30:55 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-d7e880f2-6400-4c3c-a1da-81a004ac14a0 tempest-VolumesServicesTestJSON-1422780633 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3e30b8d-c386-4f5b-a270-a360dfc2eae9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:30:55 devstack cinder-volume[88899]: INFO cinder.volume.flows.manager.create_volume [None req-d7e880f2-6400-4c3c-a1da-81a004ac14a0 tempest-VolumesServicesTestJSON-1422780633 None] Volume 88408c13-a1c9-4762-8f19-96d886f9c76e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-88408c13-a1c9-4762-8f19-96d886f9c76e', 'volume_size': 1} Aug 03 08:30:55 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-d7e880f2-6400-4c3c-a1da-81a004ac14a0 tempest-VolumesServicesTestJSON-1422780633 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:30:55 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-d7e880f2-6400-4c3c-a1da-81a004ac14a0 tempest-VolumesServicesTestJSON-1422780633 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:30:55 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-d7e880f2-6400-4c3c-a1da-81a004ac14a0 tempest-VolumesServicesTestJSON-1422780633 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:30:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1131823417',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=88408c13-a1c9-4762-8f19-96d886f9c76e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4cead5073311452d864f8cc0fe3d9d3b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:30:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:30:55Z,use_quota=True,user_id='d00f3d66ed5e462a9e36b3e349103fed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8bde7129-1dc4-42ab-b852-ab32c61b4921),volume_type_id=8bde7129-1dc4-42ab-b852-ab32c61b4921)}" {{(pid=88899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 08:30:55 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-d7e880f2-6400-4c3c-a1da-81a004ac14a0 tempest-VolumesServicesTestJSON-1422780633 None] Creating volume 88408c13-a1c9-4762-8f19-96d886f9c76e {{(pid=88899) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 08:30:55 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-d7e880f2-6400-4c3c-a1da-81a004ac14a0 tempest-VolumesServicesTestJSON-1422780633 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:30:55 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-d7e880f2-6400-4c3c-a1da-81a004ac14a0 tempest-VolumesServicesTestJSON-1422780633 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:30:55 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-d7e880f2-6400-4c3c-a1da-81a004ac14a0 tempest-VolumesServicesTestJSON-1422780633 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:30:55 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-d7e880f2-6400-4c3c-a1da-81a004ac14a0 tempest-VolumesServicesTestJSON-1422780633 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:30:55 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-d7e880f2-6400-4c3c-a1da-81a004ac14a0 tempest-VolumesServicesTestJSON-1422780633 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:30:55 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-d7e880f2-6400-4c3c-a1da-81a004ac14a0 tempest-VolumesServicesTestJSON-1422780633 None] Selected osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385 as target Quobyte volume. {{(pid=88899) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 08:30:55 devstack cinder-volume[88899]: INFO cinder.volume.drivers.remotefs [None req-d7e880f2-6400-4c3c-a1da-81a004ac14a0 tempest-VolumesServicesTestJSON-1422780633 None] casted to osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385 Aug 03 08:30:55 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-d7e880f2-6400-4c3c-a1da-81a004ac14a0 tempest-VolumesServicesTestJSON-1422780633 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-88408c13-a1c9-4762-8f19-96d886f9c76e 1073741824 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:30:55 devstack sudo[92607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-88408c13-a1c9-4762-8f19-96d886f9c76e 1073741824 Aug 03 08:30:55 devstack sudo[92607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:30:56 devstack sudo[92607]: pam_unix(sudo:session): session closed for user root Aug 03 08:30:56 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-d7e880f2-6400-4c3c-a1da-81a004ac14a0 tempest-VolumesServicesTestJSON-1422780633 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-88408c13-a1c9-4762-8f19-96d886f9c76e 1073741824" returned: 0 in 0.628s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:30:56 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-d7e880f2-6400-4c3c-a1da-81a004ac14a0 tempest-VolumesServicesTestJSON-1422780633 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-88408c13-a1c9-4762-8f19-96d886f9c76e {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:30:56 devstack sudo[92616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-88408c13-a1c9-4762-8f19-96d886f9c76e Aug 03 08:30:56 devstack sudo[92616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:30:56 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-5fa84481-1ff1-4c55-b64a-8161b2894eaf tempest-AttachVolumeShelveTestJSON-48913958 None] Acquiring lock "cinder-09c1954c-5379-4e47-bd92-ef81d4485d53-delete_volume" by "delete_volume" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:30:56 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-5fa84481-1ff1-4c55-b64a-8161b2894eaf tempest-AttachVolumeShelveTestJSON-48913958 None] Lock "cinder-09c1954c-5379-4e47-bd92-ef81d4485d53-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:30:56 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-5fa84481-1ff1-4c55-b64a-8161b2894eaf tempest-AttachVolumeShelveTestJSON-48913958 None] Acquiring lock "cinder-quobyte-09c1954c-5379-4e47-bd92-ef81d4485d53" by "delete_volume" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:30:56 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-5fa84481-1ff1-4c55-b64a-8161b2894eaf tempest-AttachVolumeShelveTestJSON-48913958 None] Lock "cinder-quobyte-09c1954c-5379-4e47-bd92-ef81d4485d53" acquired by "delete_volume" :: waited 0.026s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:30:56 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[3adf9877-4038-4b79-b243-9c11c7afc7a6]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:30:56 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-5fa84481-1ff1-4c55-b64a-8161b2894eaf tempest-AttachVolumeShelveTestJSON-48913958 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-09c1954c-5379-4e47-bd92-ef81d4485d53 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:30:56 devstack sudo[92616]: pam_unix(sudo:session): session closed for user root Aug 03 08:30:56 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-d7e880f2-6400-4c3c-a1da-81a004ac14a0 tempest-VolumesServicesTestJSON-1422780633 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-88408c13-a1c9-4762-8f19-96d886f9c76e" returned: 0 in 0.302s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:30:56 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-d7e880f2-6400-4c3c-a1da-81a004ac14a0 tempest-VolumesServicesTestJSON-1422780633 None] <== create_volume: return (1013ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'} {{(pid=88899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 08:30:56 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-d7e880f2-6400-4c3c-a1da-81a004ac14a0 tempest-VolumesServicesTestJSON-1422780633 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.016s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:30:56 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-d7e880f2-6400-4c3c-a1da-81a004ac14a0 tempest-VolumesServicesTestJSON-1422780633 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3e30b8d-c386-4f5b-a270-a360dfc2eae9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-88408c13-a1c9-4762-8f19-96d886f9c76e', 'volume_size': 1}' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:30:56 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-d7e880f2-6400-4c3c-a1da-81a004ac14a0 tempest-VolumesServicesTestJSON-1422780633 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c118181-8faa-4df1-9234-be0afd683a8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:30:56 devstack cinder-volume[88899]: INFO cinder.volume.flows.manager.create_volume [None req-d7e880f2-6400-4c3c-a1da-81a004ac14a0 tempest-VolumesServicesTestJSON-1422780633 None] Volume volume-88408c13-a1c9-4762-8f19-96d886f9c76e (88408c13-a1c9-4762-8f19-96d886f9c76e): created successfully Aug 03 08:30:56 devstack sudo[92618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-09c1954c-5379-4e47-bd92-ef81d4485d53 Aug 03 08:30:56 devstack sudo[92618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:30:56 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-d7e880f2-6400-4c3c-a1da-81a004ac14a0 tempest-VolumesServicesTestJSON-1422780633 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c118181-8faa-4df1-9234-be0afd683a8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:30:56 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-d7e880f2-6400-4c3c-a1da-81a004ac14a0 tempest-VolumesServicesTestJSON-1422780633 None] Flow 'volume_create_manager' (ecd9100f-cc1b-4246-bec5-a9ecd7ce4cb1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:30:56 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-d7e880f2-6400-4c3c-a1da-81a004ac14a0 tempest-VolumesServicesTestJSON-1422780633 None] Created volume successfully. Aug 03 08:30:56 devstack sudo[92618]: pam_unix(sudo:session): session closed for user root Aug 03 08:30:56 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-5fa84481-1ff1-4c55-b64a-8161b2894eaf tempest-AttachVolumeShelveTestJSON-48913958 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-09c1954c-5379-4e47-bd92-ef81d4485d53" returned: 0 in 0.378s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:30:56 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-5fa84481-1ff1-4c55-b64a-8161b2894eaf tempest-AttachVolumeShelveTestJSON-48913958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-09c1954c-5379-4e47-bd92-ef81d4485d53 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:30:56 devstack sudo[92625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-09c1954c-5379-4e47-bd92-ef81d4485d53 Aug 03 08:30:56 devstack sudo[92625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:30:57 devstack sudo[92625]: pam_unix(sudo:session): session closed for user root Aug 03 08:30:57 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-5fa84481-1ff1-4c55-b64a-8161b2894eaf tempest-AttachVolumeShelveTestJSON-48913958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-09c1954c-5379-4e47-bd92-ef81d4485d53" returned: 0 in 0.238s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:30:57 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-5fa84481-1ff1-4c55-b64a-8161b2894eaf tempest-AttachVolumeShelveTestJSON-48913958 None] Lock "cinder-quobyte-09c1954c-5379-4e47-bd92-ef81d4485d53" released by "delete_volume" :: held 0.669s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:30:57 devstack cinder-volume[88899]: DEBUG cinder.quota [None req-5fa84481-1ff1-4c55-b64a-8161b2894eaf tempest-AttachVolumeShelveTestJSON-48913958 None] Created reservations ['b6e61224-faff-4abb-a383-0835c2805322', 'b8f59c80-0437-45b5-818b-187903343086', '6f39a91a-aabf-4ce8-9753-662b6ff11541', '9ab09d0d-4e38-4951-a854-894cec004695'] {{(pid=88899) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 08:30:57 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-5fa84481-1ff1-4c55-b64a-8161b2894eaf tempest-AttachVolumeShelveTestJSON-48913958 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:30:57 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-5fa84481-1ff1-4c55-b64a-8161b2894eaf tempest-AttachVolumeShelveTestJSON-48913958 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:30:57 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-5fa84481-1ff1-4c55-b64a-8161b2894eaf tempest-AttachVolumeShelveTestJSON-48913958 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:30:57 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-5fa84481-1ff1-4c55-b64a-8161b2894eaf tempest-AttachVolumeShelveTestJSON-48913958 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:30:57 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-5fa84481-1ff1-4c55-b64a-8161b2894eaf tempest-AttachVolumeShelveTestJSON-48913958 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:30:57 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-5fa84481-1ff1-4c55-b64a-8161b2894eaf tempest-AttachVolumeShelveTestJSON-48913958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:30:57 devstack sudo[92630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a Aug 03 08:30:57 devstack sudo[92630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:30:57 devstack sudo[92630]: pam_unix(sudo:session): session closed for user root Aug 03 08:30:57 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-5fa84481-1ff1-4c55-b64a-8161b2894eaf tempest-AttachVolumeShelveTestJSON-48913958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a" returned: 0 in 0.341s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:30:57 devstack cinder-volume[88899]: DEBUG cinder.manager [None req-5fa84481-1ff1-4c55-b64a-8161b2894eaf tempest-AttachVolumeShelveTestJSON-48913958 None] Notifying Schedulers of capabilities ... {{(pid=88899) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 08:30:57 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-5fa84481-1ff1-4c55-b64a-8161b2894eaf tempest-AttachVolumeShelveTestJSON-48913958 None] Deleted volume successfully. Aug 03 08:30:57 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-5fa84481-1ff1-4c55-b64a-8161b2894eaf tempest-AttachVolumeShelveTestJSON-48913958 None] Lock "cinder-09c1954c-5379-4e47-bd92-ef81d4485d53-delete_volume" released by "delete_volume" :: held 1.307s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:30:57 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-4216f170-d1d1-4370-865c-ffe4f16449f6 tempest-VolumesServicesTestJSON-1422780633 None] Acquiring lock "cinder-88408c13-a1c9-4762-8f19-96d886f9c76e-delete_volume" by "delete_volume" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:30:57 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-4216f170-d1d1-4370-865c-ffe4f16449f6 tempest-VolumesServicesTestJSON-1422780633 None] Lock "cinder-88408c13-a1c9-4762-8f19-96d886f9c76e-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:30:58 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-4216f170-d1d1-4370-865c-ffe4f16449f6 tempest-VolumesServicesTestJSON-1422780633 None] Acquiring lock "cinder-quobyte-88408c13-a1c9-4762-8f19-96d886f9c76e" by "delete_volume" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:30:58 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-4216f170-d1d1-4370-865c-ffe4f16449f6 tempest-VolumesServicesTestJSON-1422780633 None] Lock "cinder-quobyte-88408c13-a1c9-4762-8f19-96d886f9c76e" acquired by "delete_volume" :: waited 0.018s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:30:58 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[98837b48-567e-437f-a767-83a0a4cc7181]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:30:58 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-4216f170-d1d1-4370-865c-ffe4f16449f6 tempest-VolumesServicesTestJSON-1422780633 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-88408c13-a1c9-4762-8f19-96d886f9c76e {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:30:58 devstack sudo[92633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-88408c13-a1c9-4762-8f19-96d886f9c76e Aug 03 08:30:58 devstack sudo[92633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:30:58 devstack sudo[92633]: pam_unix(sudo:session): session closed for user root Aug 03 08:30:58 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-4216f170-d1d1-4370-865c-ffe4f16449f6 tempest-VolumesServicesTestJSON-1422780633 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-88408c13-a1c9-4762-8f19-96d886f9c76e" returned: 0 in 0.464s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:30:58 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-4216f170-d1d1-4370-865c-ffe4f16449f6 tempest-VolumesServicesTestJSON-1422780633 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-88408c13-a1c9-4762-8f19-96d886f9c76e {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:30:58 devstack sudo[92638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-88408c13-a1c9-4762-8f19-96d886f9c76e Aug 03 08:30:58 devstack sudo[92638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:30:58 devstack sudo[92638]: pam_unix(sudo:session): session closed for user root Aug 03 08:30:58 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-4216f170-d1d1-4370-865c-ffe4f16449f6 tempest-VolumesServicesTestJSON-1422780633 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-88408c13-a1c9-4762-8f19-96d886f9c76e" returned: 0 in 0.282s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:30:58 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-4216f170-d1d1-4370-865c-ffe4f16449f6 tempest-VolumesServicesTestJSON-1422780633 None] Lock "cinder-quobyte-88408c13-a1c9-4762-8f19-96d886f9c76e" released by "delete_volume" :: held 0.812s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:30:58 devstack cinder-volume[88899]: DEBUG cinder.quota [None req-4216f170-d1d1-4370-865c-ffe4f16449f6 tempest-VolumesServicesTestJSON-1422780633 None] Created reservations ['7c10881e-d7fb-4fdc-91c5-086ae5c8d717', '5e3dfe29-4c18-49f5-8522-ceac89e553be', 'ece1a359-7894-464d-a25e-7a8ed3629503', 'c440eb2c-64b6-4c03-93a3-fd3666356ddb'] {{(pid=88899) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 08:30:58 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-4216f170-d1d1-4370-865c-ffe4f16449f6 tempest-VolumesServicesTestJSON-1422780633 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:30:58 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-4216f170-d1d1-4370-865c-ffe4f16449f6 tempest-VolumesServicesTestJSON-1422780633 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:30:58 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-4216f170-d1d1-4370-865c-ffe4f16449f6 tempest-VolumesServicesTestJSON-1422780633 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:30:58 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-4216f170-d1d1-4370-865c-ffe4f16449f6 tempest-VolumesServicesTestJSON-1422780633 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:30:58 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-4216f170-d1d1-4370-865c-ffe4f16449f6 tempest-VolumesServicesTestJSON-1422780633 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:30:58 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-4216f170-d1d1-4370-865c-ffe4f16449f6 tempest-VolumesServicesTestJSON-1422780633 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:30:59 devstack sudo[92641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a Aug 03 08:30:59 devstack sudo[92641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:30:59 devstack sudo[92641]: pam_unix(sudo:session): session closed for user root Aug 03 08:30:59 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-4216f170-d1d1-4370-865c-ffe4f16449f6 tempest-VolumesServicesTestJSON-1422780633 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a" returned: 0 in 0.481s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:30:59 devstack cinder-volume[88899]: DEBUG cinder.manager [None req-4216f170-d1d1-4370-865c-ffe4f16449f6 tempest-VolumesServicesTestJSON-1422780633 None] Notifying Schedulers of capabilities ... {{(pid=88899) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 08:30:59 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-4216f170-d1d1-4370-865c-ffe4f16449f6 tempest-VolumesServicesTestJSON-1422780633 None] Deleted volume successfully. Aug 03 08:30:59 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-4216f170-d1d1-4370-865c-ffe4f16449f6 tempest-VolumesServicesTestJSON-1422780633 None] Lock "cinder-88408c13-a1c9-4762-8f19-96d886f9c76e-delete_volume" released by "delete_volume" :: held 1.635s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:31:00 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-0c5af04c-d0c1-4465-a5a5-ccdeed22aa9c tempest-TaggedAttachmentsTest-1331297186 None] Acquiring lock "cinder-702286d7-ae7e-4589-98b9-a0cb9cb735bf-delete_volume" by "delete_volume" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:31:00 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-0c5af04c-d0c1-4465-a5a5-ccdeed22aa9c tempest-TaggedAttachmentsTest-1331297186 None] Lock "cinder-702286d7-ae7e-4589-98b9-a0cb9cb735bf-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:31:00 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-0c5af04c-d0c1-4465-a5a5-ccdeed22aa9c tempest-TaggedAttachmentsTest-1331297186 None] Acquiring lock "cinder-quobyte-702286d7-ae7e-4589-98b9-a0cb9cb735bf" by "delete_volume" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:31:00 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-0c5af04c-d0c1-4465-a5a5-ccdeed22aa9c tempest-TaggedAttachmentsTest-1331297186 None] Lock "cinder-quobyte-702286d7-ae7e-4589-98b9-a0cb9cb735bf" acquired by "delete_volume" :: waited 0.026s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:31:00 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[517fac0d-9e8c-48f0-b0ed-e60b4c696858]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:31:00 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-0c5af04c-d0c1-4465-a5a5-ccdeed22aa9c tempest-TaggedAttachmentsTest-1331297186 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-702286d7-ae7e-4589-98b9-a0cb9cb735bf {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:31:00 devstack sudo[92648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-702286d7-ae7e-4589-98b9-a0cb9cb735bf Aug 03 08:31:00 devstack sudo[92648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:31:01 devstack sudo[92648]: pam_unix(sudo:session): session closed for user root Aug 03 08:31:01 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-0c5af04c-d0c1-4465-a5a5-ccdeed22aa9c tempest-TaggedAttachmentsTest-1331297186 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-702286d7-ae7e-4589-98b9-a0cb9cb735bf" returned: 0 in 0.499s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:31:01 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-0c5af04c-d0c1-4465-a5a5-ccdeed22aa9c tempest-TaggedAttachmentsTest-1331297186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-702286d7-ae7e-4589-98b9-a0cb9cb735bf {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:31:01 devstack sudo[92654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-702286d7-ae7e-4589-98b9-a0cb9cb735bf Aug 03 08:31:01 devstack sudo[92654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:31:01 devstack sudo[92654]: pam_unix(sudo:session): session closed for user root Aug 03 08:31:01 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-0c5af04c-d0c1-4465-a5a5-ccdeed22aa9c tempest-TaggedAttachmentsTest-1331297186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-702286d7-ae7e-4589-98b9-a0cb9cb735bf" returned: 0 in 0.369s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:31:01 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-0c5af04c-d0c1-4465-a5a5-ccdeed22aa9c tempest-TaggedAttachmentsTest-1331297186 None] Lock "cinder-quobyte-702286d7-ae7e-4589-98b9-a0cb9cb735bf" released by "delete_volume" :: held 0.945s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:31:01 devstack cinder-volume[88899]: DEBUG cinder.quota [None req-0c5af04c-d0c1-4465-a5a5-ccdeed22aa9c tempest-TaggedAttachmentsTest-1331297186 None] Created reservations ['6be50e3a-cd59-4112-9722-5499ba229cbf', '4eadf57a-afda-4a51-a90e-8c4092ec1a1c', '3d53a704-0057-4aca-9999-fa9b29c473ba', 'd2f3e299-bb9c-4dce-a0b5-085b56218778'] {{(pid=88899) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 08:31:01 devstack cinder-volume[88899]: INFO cinder.volume.manager [req-c9a04f51-ca18-4476-98b2-331892558827 req-a8e2a916-ef20-4d4f-98e8-af8ef8916769 tempest-AttachVolumeTestJSON-774804622 None] Terminate volume connection completed successfully. Aug 03 08:31:01 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [req-c9a04f51-ca18-4476-98b2-331892558827 req-a8e2a916-ef20-4d4f-98e8-af8ef8916769 tempest-AttachVolumeTestJSON-774804622 None] Deleting attachment 0c52f5f6-5812-447b-9a10-00436cde5139. {{(pid=88899) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 03 08:31:01 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-0c5af04c-d0c1-4465-a5a5-ccdeed22aa9c tempest-TaggedAttachmentsTest-1331297186 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:31:01 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-0c5af04c-d0c1-4465-a5a5-ccdeed22aa9c tempest-TaggedAttachmentsTest-1331297186 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:31:01 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-0c5af04c-d0c1-4465-a5a5-ccdeed22aa9c tempest-TaggedAttachmentsTest-1331297186 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:31:01 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-0c5af04c-d0c1-4465-a5a5-ccdeed22aa9c tempest-TaggedAttachmentsTest-1331297186 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:31:01 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-0c5af04c-d0c1-4465-a5a5-ccdeed22aa9c tempest-TaggedAttachmentsTest-1331297186 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:31:01 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-0c5af04c-d0c1-4465-a5a5-ccdeed22aa9c tempest-TaggedAttachmentsTest-1331297186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:31:01 devstack sudo[92663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a Aug 03 08:31:01 devstack sudo[92663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:31:02 devstack sudo[92663]: pam_unix(sudo:session): session closed for user root Aug 03 08:31:02 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-0c5af04c-d0c1-4465-a5a5-ccdeed22aa9c tempest-TaggedAttachmentsTest-1331297186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a" returned: 0 in 0.366s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:31:02 devstack cinder-volume[88899]: DEBUG cinder.manager [None req-0c5af04c-d0c1-4465-a5a5-ccdeed22aa9c tempest-TaggedAttachmentsTest-1331297186 None] Notifying Schedulers of capabilities ... {{(pid=88899) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 08:31:02 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-0c5af04c-d0c1-4465-a5a5-ccdeed22aa9c tempest-TaggedAttachmentsTest-1331297186 None] Deleted volume successfully. Aug 03 08:31:02 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-0c5af04c-d0c1-4465-a5a5-ccdeed22aa9c tempest-TaggedAttachmentsTest-1331297186 None] Lock "cinder-702286d7-ae7e-4589-98b9-a0cb9cb735bf-delete_volume" released by "delete_volume" :: held 1.780s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:31:08 devstack cinder-volume[88899]: DEBUG cinder.volume.flows.manager.create_volume [None req-36c143c0-1b56-4350-8139-c7654b276d0f tempest-VolumeSnapshotQuotasNegativeTestJSON-1402638162 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88899) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 08:31:08 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-36c143c0-1b56-4350-8139-c7654b276d0f tempest-VolumeSnapshotQuotasNegativeTestJSON-1402638162 None] Flow 'volume_create_manager' (438e6a0e-47bd-48ae-ae9d-92848db28cdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:31:08 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-36c143c0-1b56-4350-8139-c7654b276d0f tempest-VolumeSnapshotQuotasNegativeTestJSON-1402638162 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e8a215b-cafa-4bc9-b6cf-738229d57edd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:31:08 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-36c143c0-1b56-4350-8139-c7654b276d0f tempest-VolumeSnapshotQuotasNegativeTestJSON-1402638162 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e8a215b-cafa-4bc9-b6cf-738229d57edd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:31:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-364587982',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=61d8fa45-b9c2-4927-b538-f7e1c33a550b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9364a8c5940f4e59b199cec0ae59471b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:31:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:31:08Z,use_quota=True,user_id='bf03f038f29e4528a64c5260007b51e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8bde7129-1dc4-42ab-b852-ab32c61b4921),volume_type_id=8bde7129-1dc4-42ab-b852-ab32c61b4921)' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:31:08 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-36c143c0-1b56-4350-8139-c7654b276d0f tempest-VolumeSnapshotQuotasNegativeTestJSON-1402638162 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61eb7603-8ada-4946-83b6-0d2fc89699db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:31:08 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-36c143c0-1b56-4350-8139-c7654b276d0f tempest-VolumeSnapshotQuotasNegativeTestJSON-1402638162 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61eb7603-8ada-4946-83b6-0d2fc89699db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:31:08 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-36c143c0-1b56-4350-8139-c7654b276d0f tempest-VolumeSnapshotQuotasNegativeTestJSON-1402638162 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6367a69b-3698-45b2-a80e-97dba7a30046) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:31:08 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-36c143c0-1b56-4350-8139-c7654b276d0f tempest-VolumeSnapshotQuotasNegativeTestJSON-1402638162 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6367a69b-3698-45b2-a80e-97dba7a30046) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '61d8fa45-b9c2-4927-b538-f7e1c33a550b', 'volume_name': 'volume-61d8fa45-b9c2-4927-b538-f7e1c33a550b', 'volume_size': 1}' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:31:08 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-36c143c0-1b56-4350-8139-c7654b276d0f tempest-VolumeSnapshotQuotasNegativeTestJSON-1402638162 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54f9bacc-ba13-4116-b91f-7781188ccdc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:31:08 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-36c143c0-1b56-4350-8139-c7654b276d0f tempest-VolumeSnapshotQuotasNegativeTestJSON-1402638162 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54f9bacc-ba13-4116-b91f-7781188ccdc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:31:08 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-36c143c0-1b56-4350-8139-c7654b276d0f tempest-VolumeSnapshotQuotasNegativeTestJSON-1402638162 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84862fff-4dd1-434d-8165-29dfa51ff034) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:31:08 devstack cinder-volume[88899]: INFO cinder.volume.flows.manager.create_volume [None req-36c143c0-1b56-4350-8139-c7654b276d0f tempest-VolumeSnapshotQuotasNegativeTestJSON-1402638162 None] Volume 61d8fa45-b9c2-4927-b538-f7e1c33a550b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-61d8fa45-b9c2-4927-b538-f7e1c33a550b', 'volume_size': 1} Aug 03 08:31:08 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-36c143c0-1b56-4350-8139-c7654b276d0f tempest-VolumeSnapshotQuotasNegativeTestJSON-1402638162 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:31:08 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-36c143c0-1b56-4350-8139-c7654b276d0f tempest-VolumeSnapshotQuotasNegativeTestJSON-1402638162 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:31:08 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-36c143c0-1b56-4350-8139-c7654b276d0f tempest-VolumeSnapshotQuotasNegativeTestJSON-1402638162 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:31:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-364587982',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=61d8fa45-b9c2-4927-b538-f7e1c33a550b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9364a8c5940f4e59b199cec0ae59471b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:31:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:31:08Z,use_quota=True,user_id='bf03f038f29e4528a64c5260007b51e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8bde7129-1dc4-42ab-b852-ab32c61b4921),volume_type_id=8bde7129-1dc4-42ab-b852-ab32c61b4921)}" {{(pid=88899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 08:31:08 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-36c143c0-1b56-4350-8139-c7654b276d0f tempest-VolumeSnapshotQuotasNegativeTestJSON-1402638162 None] Creating volume 61d8fa45-b9c2-4927-b538-f7e1c33a550b {{(pid=88899) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 08:31:08 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-36c143c0-1b56-4350-8139-c7654b276d0f tempest-VolumeSnapshotQuotasNegativeTestJSON-1402638162 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:31:08 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-36c143c0-1b56-4350-8139-c7654b276d0f tempest-VolumeSnapshotQuotasNegativeTestJSON-1402638162 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:31:08 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-36c143c0-1b56-4350-8139-c7654b276d0f tempest-VolumeSnapshotQuotasNegativeTestJSON-1402638162 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:31:08 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-36c143c0-1b56-4350-8139-c7654b276d0f tempest-VolumeSnapshotQuotasNegativeTestJSON-1402638162 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:31:08 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-36c143c0-1b56-4350-8139-c7654b276d0f tempest-VolumeSnapshotQuotasNegativeTestJSON-1402638162 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:31:08 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-36c143c0-1b56-4350-8139-c7654b276d0f tempest-VolumeSnapshotQuotasNegativeTestJSON-1402638162 None] Selected osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385 as target Quobyte volume. {{(pid=88899) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 08:31:08 devstack cinder-volume[88899]: INFO cinder.volume.drivers.remotefs [None req-36c143c0-1b56-4350-8139-c7654b276d0f tempest-VolumeSnapshotQuotasNegativeTestJSON-1402638162 None] casted to osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385 Aug 03 08:31:08 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-36c143c0-1b56-4350-8139-c7654b276d0f tempest-VolumeSnapshotQuotasNegativeTestJSON-1402638162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-61d8fa45-b9c2-4927-b538-f7e1c33a550b 1073741824 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:31:08 devstack sudo[92785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-61d8fa45-b9c2-4927-b538-f7e1c33a550b 1073741824 Aug 03 08:31:08 devstack sudo[92785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:31:09 devstack sudo[92785]: pam_unix(sudo:session): session closed for user root Aug 03 08:31:09 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-36c143c0-1b56-4350-8139-c7654b276d0f tempest-VolumeSnapshotQuotasNegativeTestJSON-1402638162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-61d8fa45-b9c2-4927-b538-f7e1c33a550b 1073741824" returned: 0 in 0.824s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:31:09 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-36c143c0-1b56-4350-8139-c7654b276d0f tempest-VolumeSnapshotQuotasNegativeTestJSON-1402638162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-61d8fa45-b9c2-4927-b538-f7e1c33a550b {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:31:09 devstack sudo[92803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-61d8fa45-b9c2-4927-b538-f7e1c33a550b Aug 03 08:31:09 devstack sudo[92803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:31:09 devstack sudo[92803]: pam_unix(sudo:session): session closed for user root Aug 03 08:31:09 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-36c143c0-1b56-4350-8139-c7654b276d0f tempest-VolumeSnapshotQuotasNegativeTestJSON-1402638162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-61d8fa45-b9c2-4927-b538-f7e1c33a550b" returned: 0 in 0.395s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:31:09 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-36c143c0-1b56-4350-8139-c7654b276d0f tempest-VolumeSnapshotQuotasNegativeTestJSON-1402638162 None] <== create_volume: return (1302ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'} {{(pid=88899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 08:31:09 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-36c143c0-1b56-4350-8139-c7654b276d0f tempest-VolumeSnapshotQuotasNegativeTestJSON-1402638162 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.307s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:31:09 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-36c143c0-1b56-4350-8139-c7654b276d0f tempest-VolumeSnapshotQuotasNegativeTestJSON-1402638162 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84862fff-4dd1-434d-8165-29dfa51ff034) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-61d8fa45-b9c2-4927-b538-f7e1c33a550b', 'volume_size': 1}' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:31:09 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-36c143c0-1b56-4350-8139-c7654b276d0f tempest-VolumeSnapshotQuotasNegativeTestJSON-1402638162 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a54ae1eb-b61b-4536-9683-ac1c8137e9cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:31:09 devstack cinder-volume[88899]: INFO cinder.volume.flows.manager.create_volume [None req-36c143c0-1b56-4350-8139-c7654b276d0f tempest-VolumeSnapshotQuotasNegativeTestJSON-1402638162 None] Volume volume-61d8fa45-b9c2-4927-b538-f7e1c33a550b (61d8fa45-b9c2-4927-b538-f7e1c33a550b): created successfully Aug 03 08:31:10 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-36c143c0-1b56-4350-8139-c7654b276d0f tempest-VolumeSnapshotQuotasNegativeTestJSON-1402638162 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a54ae1eb-b61b-4536-9683-ac1c8137e9cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:31:10 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-36c143c0-1b56-4350-8139-c7654b276d0f tempest-VolumeSnapshotQuotasNegativeTestJSON-1402638162 None] Flow 'volume_create_manager' (438e6a0e-47bd-48ae-ae9d-92848db28cdf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:31:10 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-36c143c0-1b56-4350-8139-c7654b276d0f tempest-VolumeSnapshotQuotasNegativeTestJSON-1402638162 None] Created volume successfully. Aug 03 08:31:10 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-4d69c75d-6176-4552-aa72-990d43625617 tempest-VolumeSnapshotQuotasNegativeTestJSON-1402638162 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:31:10 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-4d69c75d-6176-4552-aa72-990d43625617 tempest-VolumeSnapshotQuotasNegativeTestJSON-1402638162 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:31:10 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-4d69c75d-6176-4552-aa72-990d43625617 tempest-VolumeSnapshotQuotasNegativeTestJSON-1402638162 None] Creating offline snapshot 2b365539-8c11-4836-9bc3-8724ff8dd83f of volume 61d8fa45-b9c2-4927-b538-f7e1c33a550b {{(pid=88899) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 03 08:31:11 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0e7a6bf-8aa1-40d6-8be5-1fe2417474a3]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:31:11 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-4d69c75d-6176-4552-aa72-990d43625617 tempest-VolumeSnapshotQuotasNegativeTestJSON-1402638162 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-61d8fa45-b9c2-4927-b538-f7e1c33a550b {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:31:11 devstack sudo[92813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-61d8fa45-b9c2-4927-b538-f7e1c33a550b Aug 03 08:31:11 devstack sudo[92813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:31:11 devstack sudo[92813]: pam_unix(sudo:session): session closed for user root Aug 03 08:31:11 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-4d69c75d-6176-4552-aa72-990d43625617 tempest-VolumeSnapshotQuotasNegativeTestJSON-1402638162 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-61d8fa45-b9c2-4927-b538-f7e1c33a550b" returned: 0 in 0.622s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:31:11 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-4d69c75d-6176-4552-aa72-990d43625617 tempest-VolumeSnapshotQuotasNegativeTestJSON-1402638162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-61d8fa45-b9c2-4927-b538-f7e1c33a550b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-61d8fa45-b9c2-4927-b538-f7e1c33a550b.2b365539-8c11-4836-9bc3-8724ff8dd83f 1G {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:31:11 devstack sudo[92819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-61d8fa45-b9c2-4927-b538-f7e1c33a550b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-61d8fa45-b9c2-4927-b538-f7e1c33a550b.2b365539-8c11-4836-9bc3-8724ff8dd83f 1G Aug 03 08:31:11 devstack sudo[92819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:31:12 devstack sudo[92819]: pam_unix(sudo:session): session closed for user root Aug 03 08:31:12 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-4d69c75d-6176-4552-aa72-990d43625617 tempest-VolumeSnapshotQuotasNegativeTestJSON-1402638162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-61d8fa45-b9c2-4927-b538-f7e1c33a550b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-61d8fa45-b9c2-4927-b538-f7e1c33a550b.2b365539-8c11-4836-9bc3-8724ff8dd83f 1G" returned: 0 in 0.681s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:31:12 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-4d69c75d-6176-4552-aa72-990d43625617 tempest-VolumeSnapshotQuotasNegativeTestJSON-1402638162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-61d8fa45-b9c2-4927-b538-f7e1c33a550b -F qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-61d8fa45-b9c2-4927-b538-f7e1c33a550b.2b365539-8c11-4836-9bc3-8724ff8dd83f {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:31:12 devstack sudo[92826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-61d8fa45-b9c2-4927-b538-f7e1c33a550b -F qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-61d8fa45-b9c2-4927-b538-f7e1c33a550b.2b365539-8c11-4836-9bc3-8724ff8dd83f Aug 03 08:31:12 devstack sudo[92826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:31:12 devstack sudo[92826]: pam_unix(sudo:session): session closed for user root Aug 03 08:31:12 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-4d69c75d-6176-4552-aa72-990d43625617 tempest-VolumeSnapshotQuotasNegativeTestJSON-1402638162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-61d8fa45-b9c2-4927-b538-f7e1c33a550b -F qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-61d8fa45-b9c2-4927-b538-f7e1c33a550b.2b365539-8c11-4836-9bc3-8724ff8dd83f" returned: 0 in 0.416s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:31:12 devstack cinder-volume[88899]: WARNING cinder.volume.drivers.remotefs [None req-4d69c75d-6176-4552-aa72-990d43625617 tempest-VolumeSnapshotQuotasNegativeTestJSON-1402638162 None] /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-61d8fa45-b9c2-4927-b538-f7e1c33a550b.2b365539-8c11-4836-9bc3-8724ff8dd83f is being set with open permissions: ugo+rw Aug 03 08:31:12 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-4d69c75d-6176-4552-aa72-990d43625617 tempest-VolumeSnapshotQuotasNegativeTestJSON-1402638162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-61d8fa45-b9c2-4927-b538-f7e1c33a550b.2b365539-8c11-4836-9bc3-8724ff8dd83f {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:31:12 devstack sudo[92832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-61d8fa45-b9c2-4927-b538-f7e1c33a550b.2b365539-8c11-4836-9bc3-8724ff8dd83f Aug 03 08:31:12 devstack sudo[92832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:31:13 devstack sudo[92832]: pam_unix(sudo:session): session closed for user root Aug 03 08:31:13 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-4d69c75d-6176-4552-aa72-990d43625617 tempest-VolumeSnapshotQuotasNegativeTestJSON-1402638162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-61d8fa45-b9c2-4927-b538-f7e1c33a550b.2b365539-8c11-4836-9bc3-8724ff8dd83f" returned: 0 in 0.385s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:31:13 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-4d69c75d-6176-4552-aa72-990d43625617 tempest-VolumeSnapshotQuotasNegativeTestJSON-1402638162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-61d8fa45-b9c2-4927-b538-f7e1c33a550b.info {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:31:13 devstack sudo[92835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-61d8fa45-b9c2-4927-b538-f7e1c33a550b.info Aug 03 08:31:13 devstack sudo[92835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:31:13 devstack sudo[92835]: pam_unix(sudo:session): session closed for user root Aug 03 08:31:13 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-4d69c75d-6176-4552-aa72-990d43625617 tempest-VolumeSnapshotQuotasNegativeTestJSON-1402638162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-61d8fa45-b9c2-4927-b538-f7e1c33a550b.info" returned: 0 in 0.334s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:31:13 devstack cinder-volume[88899]: WARNING cinder.volume.drivers.remotefs [None req-4d69c75d-6176-4552-aa72-990d43625617 tempest-VolumeSnapshotQuotasNegativeTestJSON-1402638162 None] /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-61d8fa45-b9c2-4927-b538-f7e1c33a550b.info is being set with open permissions: ugo+rw Aug 03 08:31:13 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-4d69c75d-6176-4552-aa72-990d43625617 tempest-VolumeSnapshotQuotasNegativeTestJSON-1402638162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-61d8fa45-b9c2-4927-b538-f7e1c33a550b.info {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:31:13 devstack sudo[92838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-61d8fa45-b9c2-4927-b538-f7e1c33a550b.info Aug 03 08:31:13 devstack sudo[92838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:31:13 devstack sudo[92838]: pam_unix(sudo:session): session closed for user root Aug 03 08:31:13 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-4d69c75d-6176-4552-aa72-990d43625617 tempest-VolumeSnapshotQuotasNegativeTestJSON-1402638162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-61d8fa45-b9c2-4927-b538-f7e1c33a550b.info" returned: 0 in 0.445s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:31:13 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-4d69c75d-6176-4552-aa72-990d43625617 tempest-VolumeSnapshotQuotasNegativeTestJSON-1402638162 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.001s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:31:14 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-4d69c75d-6176-4552-aa72-990d43625617 tempest-VolumeSnapshotQuotasNegativeTestJSON-1402638162 None] Create snapshot completed successfully Aug 03 08:31:14 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-4c44db28-e46d-4e55-b744-d4aea18fbfa2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1402638162 None] Acquiring lock "cinder-2b365539-8c11-4836-9bc3-8724ff8dd83f-delete_snapshot" by "delete_snapshot" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:31:14 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-4c44db28-e46d-4e55-b744-d4aea18fbfa2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1402638162 None] Lock "cinder-2b365539-8c11-4836-9bc3-8724ff8dd83f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.039s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:31:14 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-4c44db28-e46d-4e55-b744-d4aea18fbfa2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1402638162 None] Acquiring lock "cinder-quobyte-61d8fa45-b9c2-4927-b538-f7e1c33a550b" by "delete_snapshot" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:31:14 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-4c44db28-e46d-4e55-b744-d4aea18fbfa2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1402638162 None] Lock "cinder-quobyte-61d8fa45-b9c2-4927-b538-f7e1c33a550b" acquired by "delete_snapshot" :: waited 0.022s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:31:14 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-4c44db28-e46d-4e55-b744-d4aea18fbfa2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1402638162 None] Acquiring lock "cinder-quobyte-2b365539-8c11-4836-9bc3-8724ff8dd83f" by "_delete_snapshot" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:31:14 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-4c44db28-e46d-4e55-b744-d4aea18fbfa2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1402638162 None] Lock "cinder-quobyte-2b365539-8c11-4836-9bc3-8724ff8dd83f" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:31:14 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-4c44db28-e46d-4e55-b744-d4aea18fbfa2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1402638162 None] Deleting offline snapshot 2b365539-8c11-4836-9bc3-8724ff8dd83f of volume 61d8fa45-b9c2-4927-b538-f7e1c33a550b {{(pid=88899) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 03 08:31:14 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-4c44db28-e46d-4e55-b744-d4aea18fbfa2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1402638162 None] snapshot_file for this snap is: volume-61d8fa45-b9c2-4927-b538-f7e1c33a550b.2b365539-8c11-4836-9bc3-8724ff8dd83f {{(pid=88899) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 03 08:31:14 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fd5499d-d59f-4792-a963-4ffe0ee1591a]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:31:14 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-4c44db28-e46d-4e55-b744-d4aea18fbfa2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1402638162 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-61d8fa45-b9c2-4927-b538-f7e1c33a550b.2b365539-8c11-4836-9bc3-8724ff8dd83f {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:31:15 devstack sudo[92841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-61d8fa45-b9c2-4927-b538-f7e1c33a550b.2b365539-8c11-4836-9bc3-8724ff8dd83f Aug 03 08:31:15 devstack sudo[92841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:31:15 devstack sudo[92841]: pam_unix(sudo:session): session closed for user root Aug 03 08:31:15 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-4c44db28-e46d-4e55-b744-d4aea18fbfa2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1402638162 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-61d8fa45-b9c2-4927-b538-f7e1c33a550b.2b365539-8c11-4836-9bc3-8724ff8dd83f" returned: 0 in 0.516s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:31:15 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-4c44db28-e46d-4e55-b744-d4aea18fbfa2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1402638162 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-61d8fa45-b9c2-4927-b538-f7e1c33a550b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88899) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 03 08:31:15 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4445868-8e4a-4188-952b-29495d5dac06]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:31:15 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-4c44db28-e46d-4e55-b744-d4aea18fbfa2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1402638162 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-61d8fa45-b9c2-4927-b538-f7e1c33a550b {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:31:15 devstack sudo[92848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-61d8fa45-b9c2-4927-b538-f7e1c33a550b Aug 03 08:31:15 devstack sudo[92848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:31:16 devstack sudo[92848]: pam_unix(sudo:session): session closed for user root Aug 03 08:31:16 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-4c44db28-e46d-4e55-b744-d4aea18fbfa2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1402638162 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-61d8fa45-b9c2-4927-b538-f7e1c33a550b" returned: 0 in 0.611s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:31:16 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-4c44db28-e46d-4e55-b744-d4aea18fbfa2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1402638162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-61d8fa45-b9c2-4927-b538-f7e1c33a550b.2b365539-8c11-4836-9bc3-8724ff8dd83f {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:31:16 devstack sudo[92853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-61d8fa45-b9c2-4927-b538-f7e1c33a550b.2b365539-8c11-4836-9bc3-8724ff8dd83f Aug 03 08:31:16 devstack sudo[92853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:31:16 devstack sudo[92853]: pam_unix(sudo:session): session closed for user root Aug 03 08:31:16 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-4c44db28-e46d-4e55-b744-d4aea18fbfa2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1402638162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-61d8fa45-b9c2-4927-b538-f7e1c33a550b.2b365539-8c11-4836-9bc3-8724ff8dd83f" returned: 0 in 0.592s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:31:16 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-4c44db28-e46d-4e55-b744-d4aea18fbfa2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1402638162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-61d8fa45-b9c2-4927-b538-f7e1c33a550b.2b365539-8c11-4836-9bc3-8724ff8dd83f {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:31:16 devstack sudo[92859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-61d8fa45-b9c2-4927-b538-f7e1c33a550b.2b365539-8c11-4836-9bc3-8724ff8dd83f Aug 03 08:31:16 devstack sudo[92859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:31:17 devstack sudo[92859]: pam_unix(sudo:session): session closed for user root Aug 03 08:31:17 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-4c44db28-e46d-4e55-b744-d4aea18fbfa2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1402638162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-61d8fa45-b9c2-4927-b538-f7e1c33a550b.2b365539-8c11-4836-9bc3-8724ff8dd83f" returned: 0 in 0.377s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:31:17 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-4c44db28-e46d-4e55-b744-d4aea18fbfa2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1402638162 None] Lock "cinder-quobyte-2b365539-8c11-4836-9bc3-8724ff8dd83f" released by "_delete_snapshot" :: held 2.256s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:31:17 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-4c44db28-e46d-4e55-b744-d4aea18fbfa2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1402638162 None] Lock "cinder-quobyte-61d8fa45-b9c2-4927-b538-f7e1c33a550b" released by "delete_snapshot" :: held 2.296s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:31:17 devstack cinder-volume[88899]: DEBUG cinder.quota [None req-4c44db28-e46d-4e55-b744-d4aea18fbfa2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1402638162 None] Created reservations ['7f1c03ae-41dd-4de4-99fc-4de152b37490', 'efd0ceac-696d-490c-80b9-20460992d802', 'c0014426-5685-4870-a5fb-ab32121ec85c', 'dfa88dcb-102c-44b1-9528-8b89e21a9881'] {{(pid=88899) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 08:31:17 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-4c44db28-e46d-4e55-b744-d4aea18fbfa2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1402638162 None] Delete snapshot completed successfully. Aug 03 08:31:17 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-4c44db28-e46d-4e55-b744-d4aea18fbfa2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1402638162 None] Lock "cinder-2b365539-8c11-4836-9bc3-8724ff8dd83f-delete_snapshot" released by "delete_snapshot" :: held 2.533s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:31:18 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-c9f981dd-22c5-4ffb-ae05-8e4b86780b47 tempest-VolumeSnapshotQuotasNegativeTestJSON-1402638162 None] Acquiring lock "cinder-61d8fa45-b9c2-4927-b538-f7e1c33a550b-delete_volume" by "delete_volume" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:31:18 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-c9f981dd-22c5-4ffb-ae05-8e4b86780b47 tempest-VolumeSnapshotQuotasNegativeTestJSON-1402638162 None] Lock "cinder-61d8fa45-b9c2-4927-b538-f7e1c33a550b-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:31:18 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-c9f981dd-22c5-4ffb-ae05-8e4b86780b47 tempest-VolumeSnapshotQuotasNegativeTestJSON-1402638162 None] Acquiring lock "cinder-quobyte-61d8fa45-b9c2-4927-b538-f7e1c33a550b" by "delete_volume" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:31:18 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-c9f981dd-22c5-4ffb-ae05-8e4b86780b47 tempest-VolumeSnapshotQuotasNegativeTestJSON-1402638162 None] Lock "cinder-quobyte-61d8fa45-b9c2-4927-b538-f7e1c33a550b" acquired by "delete_volume" :: waited 0.024s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:31:18 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c29f290-ff51-4706-b5d7-21412d2b751d]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:31:18 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-c9f981dd-22c5-4ffb-ae05-8e4b86780b47 tempest-VolumeSnapshotQuotasNegativeTestJSON-1402638162 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-61d8fa45-b9c2-4927-b538-f7e1c33a550b {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:31:18 devstack sudo[92863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-61d8fa45-b9c2-4927-b538-f7e1c33a550b Aug 03 08:31:18 devstack sudo[92863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:31:19 devstack sudo[92863]: pam_unix(sudo:session): session closed for user root Aug 03 08:31:19 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-c9f981dd-22c5-4ffb-ae05-8e4b86780b47 tempest-VolumeSnapshotQuotasNegativeTestJSON-1402638162 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-61d8fa45-b9c2-4927-b538-f7e1c33a550b" returned: 0 in 0.558s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:31:19 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-c9f981dd-22c5-4ffb-ae05-8e4b86780b47 tempest-VolumeSnapshotQuotasNegativeTestJSON-1402638162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-61d8fa45-b9c2-4927-b538-f7e1c33a550b {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:31:19 devstack sudo[92868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-61d8fa45-b9c2-4927-b538-f7e1c33a550b Aug 03 08:31:19 devstack sudo[92868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:31:19 devstack sudo[92868]: pam_unix(sudo:session): session closed for user root Aug 03 08:31:19 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-c9f981dd-22c5-4ffb-ae05-8e4b86780b47 tempest-VolumeSnapshotQuotasNegativeTestJSON-1402638162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-61d8fa45-b9c2-4927-b538-f7e1c33a550b" returned: 0 in 0.390s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:31:19 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-c9f981dd-22c5-4ffb-ae05-8e4b86780b47 tempest-VolumeSnapshotQuotasNegativeTestJSON-1402638162 None] Lock "cinder-quobyte-61d8fa45-b9c2-4927-b538-f7e1c33a550b" released by "delete_volume" :: held 1.042s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:31:19 devstack cinder-volume[88899]: DEBUG cinder.quota [None req-c9f981dd-22c5-4ffb-ae05-8e4b86780b47 tempest-VolumeSnapshotQuotasNegativeTestJSON-1402638162 None] Created reservations ['949f7415-628b-4915-879f-1a329ed673bf', '31ae23fe-b70a-4eb9-a0c4-c6c6b97d7758', '05418b4d-c043-44e3-b75e-65f6af7c60ac', 'b015e71b-240a-4178-a00e-f9a9b080fa58'] {{(pid=88899) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 08:31:19 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-c9f981dd-22c5-4ffb-ae05-8e4b86780b47 tempest-VolumeSnapshotQuotasNegativeTestJSON-1402638162 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:31:19 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-c9f981dd-22c5-4ffb-ae05-8e4b86780b47 tempest-VolumeSnapshotQuotasNegativeTestJSON-1402638162 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:31:19 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-c9f981dd-22c5-4ffb-ae05-8e4b86780b47 tempest-VolumeSnapshotQuotasNegativeTestJSON-1402638162 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:31:19 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-c9f981dd-22c5-4ffb-ae05-8e4b86780b47 tempest-VolumeSnapshotQuotasNegativeTestJSON-1402638162 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:31:19 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-c9f981dd-22c5-4ffb-ae05-8e4b86780b47 tempest-VolumeSnapshotQuotasNegativeTestJSON-1402638162 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:31:19 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-c9f981dd-22c5-4ffb-ae05-8e4b86780b47 tempest-VolumeSnapshotQuotasNegativeTestJSON-1402638162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:31:19 devstack sudo[92871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a Aug 03 08:31:19 devstack sudo[92871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:31:19 devstack sudo[92871]: pam_unix(sudo:session): session closed for user root Aug 03 08:31:20 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-c9f981dd-22c5-4ffb-ae05-8e4b86780b47 tempest-VolumeSnapshotQuotasNegativeTestJSON-1402638162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a" returned: 0 in 0.335s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:31:20 devstack cinder-volume[88899]: DEBUG cinder.manager [None req-c9f981dd-22c5-4ffb-ae05-8e4b86780b47 tempest-VolumeSnapshotQuotasNegativeTestJSON-1402638162 None] Notifying Schedulers of capabilities ... {{(pid=88899) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 08:31:20 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-c9f981dd-22c5-4ffb-ae05-8e4b86780b47 tempest-VolumeSnapshotQuotasNegativeTestJSON-1402638162 None] Deleted volume successfully. Aug 03 08:31:20 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-c9f981dd-22c5-4ffb-ae05-8e4b86780b47 tempest-VolumeSnapshotQuotasNegativeTestJSON-1402638162 None] Lock "cinder-61d8fa45-b9c2-4927-b538-f7e1c33a550b-delete_volume" released by "delete_volume" :: held 1.673s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:31:29 devstack cinder-volume[88899]: DEBUG dbcounter [-] [88899] Writing DB stats cinder:SELECT=58,cinder:UPDATE=71,cinder:DELETE=5,cinder:INSERT=13 {{(pid=88899) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 03 08:31:30 devstack cinder-volume[88899]: DEBUG dbcounter [-] [88899] Writing DB stats cinder:UPDATE=53,cinder:SELECT=53,cinder:INSERT=15,cinder:DELETE=4 {{(pid=88899) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 03 08:31:51 devstack cinder-volume[88899]: DEBUG oslo_service.periodic_task [None req-f948fb4a-c4d7-499f-b1bd-8d6be3de0b53 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88899) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 03 08:31:51 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-f948fb4a-c4d7-499f-b1bd-8d6be3de0b53 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:31:51 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-f948fb4a-c4d7-499f-b1bd-8d6be3de0b53 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:31:51 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-f948fb4a-c4d7-499f-b1bd-8d6be3de0b53 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:31:51 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-f948fb4a-c4d7-499f-b1bd-8d6be3de0b53 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:31:51 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-f948fb4a-c4d7-499f-b1bd-8d6be3de0b53 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:31:51 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-f948fb4a-c4d7-499f-b1bd-8d6be3de0b53 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:31:51 devstack sudo[93201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a Aug 03 08:31:51 devstack sudo[93201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:31:52 devstack sudo[93201]: pam_unix(sudo:session): session closed for user root Aug 03 08:31:52 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-f948fb4a-c4d7-499f-b1bd-8d6be3de0b53 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a" returned: 0 in 0.749s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:31:52 devstack cinder-volume[88899]: DEBUG cinder.manager [None req-f948fb4a-c4d7-499f-b1bd-8d6be3de0b53 None None] Notifying Schedulers of capabilities ... {{(pid=88899) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 08:31:52 devstack cinder-volume[88899]: DEBUG oslo_service.periodic_task [None req-f948fb4a-c4d7-499f-b1bd-8d6be3de0b53 None None] Running periodic task VolumeManager._thread_info {{(pid=88899) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 03 08:31:52 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-f948fb4a-c4d7-499f-b1bd-8d6be3de0b53 None None] thread count: 8 {{(pid=88899) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 03 08:31:52 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-f948fb4a-c4d7-499f-b1bd-8d6be3de0b53 None None] thread info: [<_MainThread(MainThread, started 132234320248960)>, , , , , , , ] {{(pid=88899) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 03 08:31:52 devstack cinder-volume[88899]: DEBUG dbcounter [-] [88899] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=88899) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 03 08:31:58 devstack cinder-volume[88899]: DEBUG cinder.volume.flows.manager.create_volume [None req-257d0c40-6df9-4f80-8178-f04a039909f6 tempest-SnapshotMetadataTestJSON-36075746 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88899) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 08:31:59 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-257d0c40-6df9-4f80-8178-f04a039909f6 tempest-SnapshotMetadataTestJSON-36075746 None] Flow 'volume_create_manager' (9302fcfe-b4cc-49b0-b284-e33a80211c20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:31:59 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-257d0c40-6df9-4f80-8178-f04a039909f6 tempest-SnapshotMetadataTestJSON-36075746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2751017d-d10a-4d40-8c32-20d731a9efa0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:31:59 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-257d0c40-6df9-4f80-8178-f04a039909f6 tempest-SnapshotMetadataTestJSON-36075746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2751017d-d10a-4d40-8c32-20d731a9efa0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:31:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1654029041',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c62b3e75-f780-477c-bdc1-5f63a0eb35a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2fc1228734114e559979e89aa5964cd6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:31:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:31:59Z,use_quota=True,user_id='407e404576f746b0ace2288898137879',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8bde7129-1dc4-42ab-b852-ab32c61b4921),volume_type_id=8bde7129-1dc4-42ab-b852-ab32c61b4921)' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:31:59 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-257d0c40-6df9-4f80-8178-f04a039909f6 tempest-SnapshotMetadataTestJSON-36075746 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6213172-1886-4f16-a529-20cda70da4c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:31:59 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-257d0c40-6df9-4f80-8178-f04a039909f6 tempest-SnapshotMetadataTestJSON-36075746 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6213172-1886-4f16-a529-20cda70da4c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:31:59 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-257d0c40-6df9-4f80-8178-f04a039909f6 tempest-SnapshotMetadataTestJSON-36075746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d10d36ee-5f59-4c97-835b-e0b2fcf5c9e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:31:59 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-257d0c40-6df9-4f80-8178-f04a039909f6 tempest-SnapshotMetadataTestJSON-36075746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d10d36ee-5f59-4c97-835b-e0b2fcf5c9e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c62b3e75-f780-477c-bdc1-5f63a0eb35a9', 'volume_name': 'volume-c62b3e75-f780-477c-bdc1-5f63a0eb35a9', 'volume_size': 1}' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:31:59 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-257d0c40-6df9-4f80-8178-f04a039909f6 tempest-SnapshotMetadataTestJSON-36075746 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (faf7974c-c944-45eb-b54a-53824c36e99b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:31:59 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-257d0c40-6df9-4f80-8178-f04a039909f6 tempest-SnapshotMetadataTestJSON-36075746 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (faf7974c-c944-45eb-b54a-53824c36e99b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:31:59 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-257d0c40-6df9-4f80-8178-f04a039909f6 tempest-SnapshotMetadataTestJSON-36075746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (88724714-e0fb-4dd0-b9f8-5b69368cc7db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:31:59 devstack cinder-volume[88899]: INFO cinder.volume.flows.manager.create_volume [None req-257d0c40-6df9-4f80-8178-f04a039909f6 tempest-SnapshotMetadataTestJSON-36075746 None] Volume c62b3e75-f780-477c-bdc1-5f63a0eb35a9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c62b3e75-f780-477c-bdc1-5f63a0eb35a9', 'volume_size': 1} Aug 03 08:31:59 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-257d0c40-6df9-4f80-8178-f04a039909f6 tempest-SnapshotMetadataTestJSON-36075746 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:31:59 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-257d0c40-6df9-4f80-8178-f04a039909f6 tempest-SnapshotMetadataTestJSON-36075746 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:31:59 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-257d0c40-6df9-4f80-8178-f04a039909f6 tempest-SnapshotMetadataTestJSON-36075746 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:31:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1654029041',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c62b3e75-f780-477c-bdc1-5f63a0eb35a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2fc1228734114e559979e89aa5964cd6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:31:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:31:59Z,use_quota=True,user_id='407e404576f746b0ace2288898137879',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8bde7129-1dc4-42ab-b852-ab32c61b4921),volume_type_id=8bde7129-1dc4-42ab-b852-ab32c61b4921)}" {{(pid=88899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 08:31:59 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-257d0c40-6df9-4f80-8178-f04a039909f6 tempest-SnapshotMetadataTestJSON-36075746 None] Creating volume c62b3e75-f780-477c-bdc1-5f63a0eb35a9 {{(pid=88899) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 08:31:59 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-257d0c40-6df9-4f80-8178-f04a039909f6 tempest-SnapshotMetadataTestJSON-36075746 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:31:59 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-257d0c40-6df9-4f80-8178-f04a039909f6 tempest-SnapshotMetadataTestJSON-36075746 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:31:59 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-257d0c40-6df9-4f80-8178-f04a039909f6 tempest-SnapshotMetadataTestJSON-36075746 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:31:59 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-257d0c40-6df9-4f80-8178-f04a039909f6 tempest-SnapshotMetadataTestJSON-36075746 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:31:59 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-257d0c40-6df9-4f80-8178-f04a039909f6 tempest-SnapshotMetadataTestJSON-36075746 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:31:59 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-257d0c40-6df9-4f80-8178-f04a039909f6 tempest-SnapshotMetadataTestJSON-36075746 None] Selected osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385 as target Quobyte volume. {{(pid=88899) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 08:31:59 devstack cinder-volume[88899]: INFO cinder.volume.drivers.remotefs [None req-257d0c40-6df9-4f80-8178-f04a039909f6 tempest-SnapshotMetadataTestJSON-36075746 None] casted to osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385 Aug 03 08:31:59 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-257d0c40-6df9-4f80-8178-f04a039909f6 tempest-SnapshotMetadataTestJSON-36075746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c62b3e75-f780-477c-bdc1-5f63a0eb35a9 1073741824 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:31:59 devstack sudo[93322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c62b3e75-f780-477c-bdc1-5f63a0eb35a9 1073741824 Aug 03 08:31:59 devstack sudo[93322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:31:59 devstack sudo[93322]: pam_unix(sudo:session): session closed for user root Aug 03 08:31:59 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-257d0c40-6df9-4f80-8178-f04a039909f6 tempest-SnapshotMetadataTestJSON-36075746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c62b3e75-f780-477c-bdc1-5f63a0eb35a9 1073741824" returned: 0 in 0.612s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:31:59 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-257d0c40-6df9-4f80-8178-f04a039909f6 tempest-SnapshotMetadataTestJSON-36075746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c62b3e75-f780-477c-bdc1-5f63a0eb35a9 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:31:59 devstack sudo[93328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c62b3e75-f780-477c-bdc1-5f63a0eb35a9 Aug 03 08:31:59 devstack sudo[93328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:32:00 devstack sudo[93328]: pam_unix(sudo:session): session closed for user root Aug 03 08:32:00 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-257d0c40-6df9-4f80-8178-f04a039909f6 tempest-SnapshotMetadataTestJSON-36075746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c62b3e75-f780-477c-bdc1-5f63a0eb35a9" returned: 0 in 0.294s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:32:00 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-257d0c40-6df9-4f80-8178-f04a039909f6 tempest-SnapshotMetadataTestJSON-36075746 None] <== create_volume: return (981ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'} {{(pid=88899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 08:32:00 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-257d0c40-6df9-4f80-8178-f04a039909f6 tempest-SnapshotMetadataTestJSON-36075746 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.985s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:32:00 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-257d0c40-6df9-4f80-8178-f04a039909f6 tempest-SnapshotMetadataTestJSON-36075746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (88724714-e0fb-4dd0-b9f8-5b69368cc7db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c62b3e75-f780-477c-bdc1-5f63a0eb35a9', 'volume_size': 1}' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:32:00 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-257d0c40-6df9-4f80-8178-f04a039909f6 tempest-SnapshotMetadataTestJSON-36075746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16ae56c4-eaa7-4ae0-ab03-6a6f47aaabd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:32:00 devstack cinder-volume[88899]: INFO cinder.volume.flows.manager.create_volume [None req-257d0c40-6df9-4f80-8178-f04a039909f6 tempest-SnapshotMetadataTestJSON-36075746 None] Volume volume-c62b3e75-f780-477c-bdc1-5f63a0eb35a9 (c62b3e75-f780-477c-bdc1-5f63a0eb35a9): created successfully Aug 03 08:32:00 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-257d0c40-6df9-4f80-8178-f04a039909f6 tempest-SnapshotMetadataTestJSON-36075746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16ae56c4-eaa7-4ae0-ab03-6a6f47aaabd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:32:00 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-257d0c40-6df9-4f80-8178-f04a039909f6 tempest-SnapshotMetadataTestJSON-36075746 None] Flow 'volume_create_manager' (9302fcfe-b4cc-49b0-b284-e33a80211c20) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:32:00 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-257d0c40-6df9-4f80-8178-f04a039909f6 tempest-SnapshotMetadataTestJSON-36075746 None] Created volume successfully. Aug 03 08:32:01 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-727650ce-6ed6-41d9-9f43-e342a2276afb tempest-SnapshotMetadataTestJSON-36075746 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:32:01 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-727650ce-6ed6-41d9-9f43-e342a2276afb tempest-SnapshotMetadataTestJSON-36075746 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:32:01 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-727650ce-6ed6-41d9-9f43-e342a2276afb tempest-SnapshotMetadataTestJSON-36075746 None] Creating offline snapshot 39f619b5-16fa-41a8-84e1-662bb91eabd8 of volume c62b3e75-f780-477c-bdc1-5f63a0eb35a9 {{(pid=88899) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 03 08:32:01 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd545572-4003-43a4-a25f-2661abf3f359]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:32:01 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-727650ce-6ed6-41d9-9f43-e342a2276afb tempest-SnapshotMetadataTestJSON-36075746 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c62b3e75-f780-477c-bdc1-5f63a0eb35a9 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:32:01 devstack sudo[93331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c62b3e75-f780-477c-bdc1-5f63a0eb35a9 Aug 03 08:32:01 devstack sudo[93331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:32:02 devstack sudo[93331]: pam_unix(sudo:session): session closed for user root Aug 03 08:32:02 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-727650ce-6ed6-41d9-9f43-e342a2276afb tempest-SnapshotMetadataTestJSON-36075746 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c62b3e75-f780-477c-bdc1-5f63a0eb35a9" returned: 0 in 0.616s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:32:02 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-727650ce-6ed6-41d9-9f43-e342a2276afb tempest-SnapshotMetadataTestJSON-36075746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c62b3e75-f780-477c-bdc1-5f63a0eb35a9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c62b3e75-f780-477c-bdc1-5f63a0eb35a9.39f619b5-16fa-41a8-84e1-662bb91eabd8 1G {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:32:02 devstack sudo[93337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c62b3e75-f780-477c-bdc1-5f63a0eb35a9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c62b3e75-f780-477c-bdc1-5f63a0eb35a9.39f619b5-16fa-41a8-84e1-662bb91eabd8 1G Aug 03 08:32:02 devstack sudo[93337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:32:03 devstack sudo[93337]: pam_unix(sudo:session): session closed for user root Aug 03 08:32:03 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-727650ce-6ed6-41d9-9f43-e342a2276afb tempest-SnapshotMetadataTestJSON-36075746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c62b3e75-f780-477c-bdc1-5f63a0eb35a9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c62b3e75-f780-477c-bdc1-5f63a0eb35a9.39f619b5-16fa-41a8-84e1-662bb91eabd8 1G" returned: 0 in 0.813s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:32:03 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-727650ce-6ed6-41d9-9f43-e342a2276afb tempest-SnapshotMetadataTestJSON-36075746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c62b3e75-f780-477c-bdc1-5f63a0eb35a9 -F qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c62b3e75-f780-477c-bdc1-5f63a0eb35a9.39f619b5-16fa-41a8-84e1-662bb91eabd8 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:32:03 devstack sudo[93344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c62b3e75-f780-477c-bdc1-5f63a0eb35a9 -F qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c62b3e75-f780-477c-bdc1-5f63a0eb35a9.39f619b5-16fa-41a8-84e1-662bb91eabd8 Aug 03 08:32:03 devstack sudo[93344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:32:03 devstack sudo[93344]: pam_unix(sudo:session): session closed for user root Aug 03 08:32:03 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-727650ce-6ed6-41d9-9f43-e342a2276afb tempest-SnapshotMetadataTestJSON-36075746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c62b3e75-f780-477c-bdc1-5f63a0eb35a9 -F qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c62b3e75-f780-477c-bdc1-5f63a0eb35a9.39f619b5-16fa-41a8-84e1-662bb91eabd8" returned: 0 in 0.374s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:32:03 devstack cinder-volume[88899]: WARNING cinder.volume.drivers.remotefs [None req-727650ce-6ed6-41d9-9f43-e342a2276afb tempest-SnapshotMetadataTestJSON-36075746 None] /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c62b3e75-f780-477c-bdc1-5f63a0eb35a9.39f619b5-16fa-41a8-84e1-662bb91eabd8 is being set with open permissions: ugo+rw Aug 03 08:32:03 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-727650ce-6ed6-41d9-9f43-e342a2276afb tempest-SnapshotMetadataTestJSON-36075746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c62b3e75-f780-477c-bdc1-5f63a0eb35a9.39f619b5-16fa-41a8-84e1-662bb91eabd8 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:32:03 devstack sudo[93350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c62b3e75-f780-477c-bdc1-5f63a0eb35a9.39f619b5-16fa-41a8-84e1-662bb91eabd8 Aug 03 08:32:03 devstack sudo[93350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:32:03 devstack sudo[93350]: pam_unix(sudo:session): session closed for user root Aug 03 08:32:03 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-727650ce-6ed6-41d9-9f43-e342a2276afb tempest-SnapshotMetadataTestJSON-36075746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c62b3e75-f780-477c-bdc1-5f63a0eb35a9.39f619b5-16fa-41a8-84e1-662bb91eabd8" returned: 0 in 0.294s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:32:03 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-727650ce-6ed6-41d9-9f43-e342a2276afb tempest-SnapshotMetadataTestJSON-36075746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c62b3e75-f780-477c-bdc1-5f63a0eb35a9.info {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:32:03 devstack sudo[93353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c62b3e75-f780-477c-bdc1-5f63a0eb35a9.info Aug 03 08:32:03 devstack sudo[93353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:32:04 devstack sudo[93353]: pam_unix(sudo:session): session closed for user root Aug 03 08:32:04 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-727650ce-6ed6-41d9-9f43-e342a2276afb tempest-SnapshotMetadataTestJSON-36075746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c62b3e75-f780-477c-bdc1-5f63a0eb35a9.info" returned: 0 in 0.249s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:32:04 devstack cinder-volume[88899]: WARNING cinder.volume.drivers.remotefs [None req-727650ce-6ed6-41d9-9f43-e342a2276afb tempest-SnapshotMetadataTestJSON-36075746 None] /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c62b3e75-f780-477c-bdc1-5f63a0eb35a9.info is being set with open permissions: ugo+rw Aug 03 08:32:04 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-727650ce-6ed6-41d9-9f43-e342a2276afb tempest-SnapshotMetadataTestJSON-36075746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c62b3e75-f780-477c-bdc1-5f63a0eb35a9.info {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:32:04 devstack sudo[93356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c62b3e75-f780-477c-bdc1-5f63a0eb35a9.info Aug 03 08:32:04 devstack sudo[93356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:32:04 devstack sudo[93356]: pam_unix(sudo:session): session closed for user root Aug 03 08:32:04 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-727650ce-6ed6-41d9-9f43-e342a2276afb tempest-SnapshotMetadataTestJSON-36075746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c62b3e75-f780-477c-bdc1-5f63a0eb35a9.info" returned: 0 in 0.244s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:32:04 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-727650ce-6ed6-41d9-9f43-e342a2276afb tempest-SnapshotMetadataTestJSON-36075746 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.722s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:32:04 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-727650ce-6ed6-41d9-9f43-e342a2276afb tempest-SnapshotMetadataTestJSON-36075746 None] Create snapshot completed successfully Aug 03 08:32:05 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-8416ab0c-d096-4d6e-a4e3-450efda2c99d tempest-SnapshotMetadataTestJSON-36075746 None] Acquiring lock "cinder-39f619b5-16fa-41a8-84e1-662bb91eabd8-delete_snapshot" by "delete_snapshot" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:32:05 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-8416ab0c-d096-4d6e-a4e3-450efda2c99d tempest-SnapshotMetadataTestJSON-36075746 None] Lock "cinder-39f619b5-16fa-41a8-84e1-662bb91eabd8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:32:05 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-8416ab0c-d096-4d6e-a4e3-450efda2c99d tempest-SnapshotMetadataTestJSON-36075746 None] Acquiring lock "cinder-quobyte-c62b3e75-f780-477c-bdc1-5f63a0eb35a9" by "delete_snapshot" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:32:05 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-8416ab0c-d096-4d6e-a4e3-450efda2c99d tempest-SnapshotMetadataTestJSON-36075746 None] Lock "cinder-quobyte-c62b3e75-f780-477c-bdc1-5f63a0eb35a9" acquired by "delete_snapshot" :: waited 0.015s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:32:05 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-8416ab0c-d096-4d6e-a4e3-450efda2c99d tempest-SnapshotMetadataTestJSON-36075746 None] Acquiring lock "cinder-quobyte-39f619b5-16fa-41a8-84e1-662bb91eabd8" by "_delete_snapshot" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:32:05 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-8416ab0c-d096-4d6e-a4e3-450efda2c99d tempest-SnapshotMetadataTestJSON-36075746 None] Lock "cinder-quobyte-39f619b5-16fa-41a8-84e1-662bb91eabd8" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:32:05 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-8416ab0c-d096-4d6e-a4e3-450efda2c99d tempest-SnapshotMetadataTestJSON-36075746 None] Deleting offline snapshot 39f619b5-16fa-41a8-84e1-662bb91eabd8 of volume c62b3e75-f780-477c-bdc1-5f63a0eb35a9 {{(pid=88899) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 03 08:32:05 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-8416ab0c-d096-4d6e-a4e3-450efda2c99d tempest-SnapshotMetadataTestJSON-36075746 None] snapshot_file for this snap is: volume-c62b3e75-f780-477c-bdc1-5f63a0eb35a9.39f619b5-16fa-41a8-84e1-662bb91eabd8 {{(pid=88899) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 03 08:32:05 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[134c381e-c37f-4888-9c58-b4fe4a06b689]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:32:05 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-8416ab0c-d096-4d6e-a4e3-450efda2c99d tempest-SnapshotMetadataTestJSON-36075746 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c62b3e75-f780-477c-bdc1-5f63a0eb35a9.39f619b5-16fa-41a8-84e1-662bb91eabd8 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:32:05 devstack sudo[93375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c62b3e75-f780-477c-bdc1-5f63a0eb35a9.39f619b5-16fa-41a8-84e1-662bb91eabd8 Aug 03 08:32:05 devstack sudo[93375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:32:05 devstack sudo[93375]: pam_unix(sudo:session): session closed for user root Aug 03 08:32:05 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-8416ab0c-d096-4d6e-a4e3-450efda2c99d tempest-SnapshotMetadataTestJSON-36075746 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c62b3e75-f780-477c-bdc1-5f63a0eb35a9.39f619b5-16fa-41a8-84e1-662bb91eabd8" returned: 0 in 0.353s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:32:05 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-8416ab0c-d096-4d6e-a4e3-450efda2c99d tempest-SnapshotMetadataTestJSON-36075746 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c62b3e75-f780-477c-bdc1-5f63a0eb35a9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88899) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 03 08:32:05 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ec732b5-eff0-45a9-ba41-10a1bae41c84]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:32:05 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-8416ab0c-d096-4d6e-a4e3-450efda2c99d tempest-SnapshotMetadataTestJSON-36075746 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c62b3e75-f780-477c-bdc1-5f63a0eb35a9 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:32:06 devstack sudo[93382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c62b3e75-f780-477c-bdc1-5f63a0eb35a9 Aug 03 08:32:06 devstack sudo[93382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:32:06 devstack sudo[93382]: pam_unix(sudo:session): session closed for user root Aug 03 08:32:06 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-8416ab0c-d096-4d6e-a4e3-450efda2c99d tempest-SnapshotMetadataTestJSON-36075746 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c62b3e75-f780-477c-bdc1-5f63a0eb35a9" returned: 0 in 0.389s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:32:06 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-8416ab0c-d096-4d6e-a4e3-450efda2c99d tempest-SnapshotMetadataTestJSON-36075746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c62b3e75-f780-477c-bdc1-5f63a0eb35a9.39f619b5-16fa-41a8-84e1-662bb91eabd8 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:32:06 devstack sudo[93387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c62b3e75-f780-477c-bdc1-5f63a0eb35a9.39f619b5-16fa-41a8-84e1-662bb91eabd8 Aug 03 08:32:06 devstack sudo[93387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:32:06 devstack sudo[93387]: pam_unix(sudo:session): session closed for user root Aug 03 08:32:06 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-8416ab0c-d096-4d6e-a4e3-450efda2c99d tempest-SnapshotMetadataTestJSON-36075746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c62b3e75-f780-477c-bdc1-5f63a0eb35a9.39f619b5-16fa-41a8-84e1-662bb91eabd8" returned: 0 in 0.400s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:32:06 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-8416ab0c-d096-4d6e-a4e3-450efda2c99d tempest-SnapshotMetadataTestJSON-36075746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c62b3e75-f780-477c-bdc1-5f63a0eb35a9.39f619b5-16fa-41a8-84e1-662bb91eabd8 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:32:06 devstack sudo[93393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c62b3e75-f780-477c-bdc1-5f63a0eb35a9.39f619b5-16fa-41a8-84e1-662bb91eabd8 Aug 03 08:32:06 devstack sudo[93393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:32:06 devstack cinder-volume[88899]: DEBUG cinder.volume.flows.manager.create_volume [None req-25f8f912-91b2-449a-9155-dcd797c780e8 tempest-AttachVolumeNegativeTest-1279867800 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88899) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 08:32:06 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-25f8f912-91b2-449a-9155-dcd797c780e8 tempest-AttachVolumeNegativeTest-1279867800 None] Flow 'volume_create_manager' (3cde588e-019c-4cfc-b678-6d940c9f4860) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:32:06 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-25f8f912-91b2-449a-9155-dcd797c780e8 tempest-AttachVolumeNegativeTest-1279867800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb0830cb-6668-46b1-bb27-0f4149fb1402) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:32:06 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-25f8f912-91b2-449a-9155-dcd797c780e8 tempest-AttachVolumeNegativeTest-1279867800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb0830cb-6668-46b1-bb27-0f4149fb1402) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:32:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-164945171',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=11b89d28-fc04-4ac0-a715-dc24cec72734,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f06670c627043c9a605aa207b29fe32',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:32:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:32:07Z,use_quota=True,user_id='3e4a15ae37a34d638cd37c201b61c395',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8bde7129-1dc4-42ab-b852-ab32c61b4921),volume_type_id=8bde7129-1dc4-42ab-b852-ab32c61b4921)' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:32:06 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-25f8f912-91b2-449a-9155-dcd797c780e8 tempest-AttachVolumeNegativeTest-1279867800 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd3bc129-f243-4fd9-a114-88a6e0ef68de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:32:06 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-25f8f912-91b2-449a-9155-dcd797c780e8 tempest-AttachVolumeNegativeTest-1279867800 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd3bc129-f243-4fd9-a114-88a6e0ef68de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:32:06 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-25f8f912-91b2-449a-9155-dcd797c780e8 tempest-AttachVolumeNegativeTest-1279867800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45feb0b9-926f-483e-8e42-4597a69a82db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:32:06 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-25f8f912-91b2-449a-9155-dcd797c780e8 tempest-AttachVolumeNegativeTest-1279867800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45feb0b9-926f-483e-8e42-4597a69a82db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '11b89d28-fc04-4ac0-a715-dc24cec72734', 'volume_name': 'volume-11b89d28-fc04-4ac0-a715-dc24cec72734', 'volume_size': 1}' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:32:06 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-25f8f912-91b2-449a-9155-dcd797c780e8 tempest-AttachVolumeNegativeTest-1279867800 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9f7634d-2c85-4063-9c4f-9b12eaeaf22c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:32:06 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-25f8f912-91b2-449a-9155-dcd797c780e8 tempest-AttachVolumeNegativeTest-1279867800 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9f7634d-2c85-4063-9c4f-9b12eaeaf22c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:32:06 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-25f8f912-91b2-449a-9155-dcd797c780e8 tempest-AttachVolumeNegativeTest-1279867800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b5bb2ae-9ceb-487f-a642-333aa390b270) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:32:06 devstack cinder-volume[88899]: INFO cinder.volume.flows.manager.create_volume [None req-25f8f912-91b2-449a-9155-dcd797c780e8 tempest-AttachVolumeNegativeTest-1279867800 None] Volume 11b89d28-fc04-4ac0-a715-dc24cec72734: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-11b89d28-fc04-4ac0-a715-dc24cec72734', 'volume_size': 1} Aug 03 08:32:06 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-25f8f912-91b2-449a-9155-dcd797c780e8 tempest-AttachVolumeNegativeTest-1279867800 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:32:06 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-25f8f912-91b2-449a-9155-dcd797c780e8 tempest-AttachVolumeNegativeTest-1279867800 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:32:06 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-25f8f912-91b2-449a-9155-dcd797c780e8 tempest-AttachVolumeNegativeTest-1279867800 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:32:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-164945171',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=11b89d28-fc04-4ac0-a715-dc24cec72734,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f06670c627043c9a605aa207b29fe32',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:32:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:32:07Z,use_quota=True,user_id='3e4a15ae37a34d638cd37c201b61c395',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8bde7129-1dc4-42ab-b852-ab32c61b4921),volume_type_id=8bde7129-1dc4-42ab-b852-ab32c61b4921)}" {{(pid=88899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 08:32:06 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-25f8f912-91b2-449a-9155-dcd797c780e8 tempest-AttachVolumeNegativeTest-1279867800 None] Creating volume 11b89d28-fc04-4ac0-a715-dc24cec72734 {{(pid=88899) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 08:32:06 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-25f8f912-91b2-449a-9155-dcd797c780e8 tempest-AttachVolumeNegativeTest-1279867800 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:32:06 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-25f8f912-91b2-449a-9155-dcd797c780e8 tempest-AttachVolumeNegativeTest-1279867800 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:32:06 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-25f8f912-91b2-449a-9155-dcd797c780e8 tempest-AttachVolumeNegativeTest-1279867800 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:32:06 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-25f8f912-91b2-449a-9155-dcd797c780e8 tempest-AttachVolumeNegativeTest-1279867800 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:32:06 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-25f8f912-91b2-449a-9155-dcd797c780e8 tempest-AttachVolumeNegativeTest-1279867800 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:32:06 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-25f8f912-91b2-449a-9155-dcd797c780e8 tempest-AttachVolumeNegativeTest-1279867800 None] Selected osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385 as target Quobyte volume. {{(pid=88899) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 08:32:06 devstack cinder-volume[88899]: INFO cinder.volume.drivers.remotefs [None req-25f8f912-91b2-449a-9155-dcd797c780e8 tempest-AttachVolumeNegativeTest-1279867800 None] casted to osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385 Aug 03 08:32:06 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-25f8f912-91b2-449a-9155-dcd797c780e8 tempest-AttachVolumeNegativeTest-1279867800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-11b89d28-fc04-4ac0-a715-dc24cec72734 1073741824 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:32:06 devstack sudo[93395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-11b89d28-fc04-4ac0-a715-dc24cec72734 1073741824 Aug 03 08:32:06 devstack sudo[93395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:32:06 devstack sudo[93393]: pam_unix(sudo:session): session closed for user root Aug 03 08:32:06 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-8416ab0c-d096-4d6e-a4e3-450efda2c99d tempest-SnapshotMetadataTestJSON-36075746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c62b3e75-f780-477c-bdc1-5f63a0eb35a9.39f619b5-16fa-41a8-84e1-662bb91eabd8" returned: 0 in 0.264s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:32:07 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-8416ab0c-d096-4d6e-a4e3-450efda2c99d tempest-SnapshotMetadataTestJSON-36075746 None] Lock "cinder-quobyte-39f619b5-16fa-41a8-84e1-662bb91eabd8" released by "_delete_snapshot" :: held 1.507s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:32:07 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-8416ab0c-d096-4d6e-a4e3-450efda2c99d tempest-SnapshotMetadataTestJSON-36075746 None] Lock "cinder-quobyte-c62b3e75-f780-477c-bdc1-5f63a0eb35a9" released by "delete_snapshot" :: held 1.531s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:32:07 devstack cinder-volume[88899]: DEBUG cinder.quota [None req-8416ab0c-d096-4d6e-a4e3-450efda2c99d tempest-SnapshotMetadataTestJSON-36075746 None] Created reservations ['c671f7d7-0fce-4197-a13c-ba4bc46a717b', 'e13dea28-4589-40ef-88ff-52f5ec6a073b', '514e162b-3667-42de-9436-55c3b15e3936', '4613bb55-b138-4b1b-90a1-76a82452f63e'] {{(pid=88899) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 08:32:07 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-8416ab0c-d096-4d6e-a4e3-450efda2c99d tempest-SnapshotMetadataTestJSON-36075746 None] Delete snapshot completed successfully. Aug 03 08:32:07 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-8416ab0c-d096-4d6e-a4e3-450efda2c99d tempest-SnapshotMetadataTestJSON-36075746 None] Lock "cinder-39f619b5-16fa-41a8-84e1-662bb91eabd8-delete_snapshot" released by "delete_snapshot" :: held 1.679s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:32:07 devstack sudo[93395]: pam_unix(sudo:session): session closed for user root Aug 03 08:32:07 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-25f8f912-91b2-449a-9155-dcd797c780e8 tempest-AttachVolumeNegativeTest-1279867800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-11b89d28-fc04-4ac0-a715-dc24cec72734 1073741824" returned: 0 in 0.459s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:32:07 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-25f8f912-91b2-449a-9155-dcd797c780e8 tempest-AttachVolumeNegativeTest-1279867800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-11b89d28-fc04-4ac0-a715-dc24cec72734 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:32:07 devstack sudo[93402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-11b89d28-fc04-4ac0-a715-dc24cec72734 Aug 03 08:32:07 devstack sudo[93402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:32:07 devstack sudo[93402]: pam_unix(sudo:session): session closed for user root Aug 03 08:32:07 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-25f8f912-91b2-449a-9155-dcd797c780e8 tempest-AttachVolumeNegativeTest-1279867800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-11b89d28-fc04-4ac0-a715-dc24cec72734" returned: 0 in 0.251s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:32:07 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-25f8f912-91b2-449a-9155-dcd797c780e8 tempest-AttachVolumeNegativeTest-1279867800 None] <== create_volume: return (749ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'} {{(pid=88899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 08:32:07 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-25f8f912-91b2-449a-9155-dcd797c780e8 tempest-AttachVolumeNegativeTest-1279867800 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.751s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:32:07 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-25f8f912-91b2-449a-9155-dcd797c780e8 tempest-AttachVolumeNegativeTest-1279867800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b5bb2ae-9ceb-487f-a642-333aa390b270) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-11b89d28-fc04-4ac0-a715-dc24cec72734', 'volume_size': 1}' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:32:07 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-25f8f912-91b2-449a-9155-dcd797c780e8 tempest-AttachVolumeNegativeTest-1279867800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f944de2-2721-4dfd-ab3e-5169c4837419) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:32:07 devstack cinder-volume[88899]: INFO cinder.volume.flows.manager.create_volume [None req-25f8f912-91b2-449a-9155-dcd797c780e8 tempest-AttachVolumeNegativeTest-1279867800 None] Volume volume-11b89d28-fc04-4ac0-a715-dc24cec72734 (11b89d28-fc04-4ac0-a715-dc24cec72734): created successfully Aug 03 08:32:07 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-25f8f912-91b2-449a-9155-dcd797c780e8 tempest-AttachVolumeNegativeTest-1279867800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f944de2-2721-4dfd-ab3e-5169c4837419) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:32:07 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-25f8f912-91b2-449a-9155-dcd797c780e8 tempest-AttachVolumeNegativeTest-1279867800 None] Flow 'volume_create_manager' (3cde588e-019c-4cfc-b678-6d940c9f4860) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:32:07 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-25f8f912-91b2-449a-9155-dcd797c780e8 tempest-AttachVolumeNegativeTest-1279867800 None] Created volume successfully. Aug 03 08:32:07 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-1709ecc2-6b37-4bf5-8ae8-2317d4ef87a5 tempest-SnapshotMetadataTestJSON-36075746 None] Acquiring lock "cinder-c62b3e75-f780-477c-bdc1-5f63a0eb35a9-delete_volume" by "delete_volume" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:32:07 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-1709ecc2-6b37-4bf5-8ae8-2317d4ef87a5 tempest-SnapshotMetadataTestJSON-36075746 None] Lock "cinder-c62b3e75-f780-477c-bdc1-5f63a0eb35a9-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:32:07 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-1709ecc2-6b37-4bf5-8ae8-2317d4ef87a5 tempest-SnapshotMetadataTestJSON-36075746 None] Acquiring lock "cinder-quobyte-c62b3e75-f780-477c-bdc1-5f63a0eb35a9" by "delete_volume" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:32:07 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-1709ecc2-6b37-4bf5-8ae8-2317d4ef87a5 tempest-SnapshotMetadataTestJSON-36075746 None] Lock "cinder-quobyte-c62b3e75-f780-477c-bdc1-5f63a0eb35a9" acquired by "delete_volume" :: waited 0.022s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:32:07 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[b664221c-5ba6-4b26-9dca-af68e6e6a365]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:32:07 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-1709ecc2-6b37-4bf5-8ae8-2317d4ef87a5 tempest-SnapshotMetadataTestJSON-36075746 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c62b3e75-f780-477c-bdc1-5f63a0eb35a9 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:32:07 devstack sudo[93405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c62b3e75-f780-477c-bdc1-5f63a0eb35a9 Aug 03 08:32:07 devstack sudo[93405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:32:08 devstack sudo[93405]: pam_unix(sudo:session): session closed for user root Aug 03 08:32:08 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-1709ecc2-6b37-4bf5-8ae8-2317d4ef87a5 tempest-SnapshotMetadataTestJSON-36075746 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c62b3e75-f780-477c-bdc1-5f63a0eb35a9" returned: 0 in 0.376s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:32:08 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-1709ecc2-6b37-4bf5-8ae8-2317d4ef87a5 tempest-SnapshotMetadataTestJSON-36075746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c62b3e75-f780-477c-bdc1-5f63a0eb35a9 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:32:08 devstack sudo[93410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c62b3e75-f780-477c-bdc1-5f63a0eb35a9 Aug 03 08:32:08 devstack sudo[93410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:32:08 devstack sudo[93410]: pam_unix(sudo:session): session closed for user root Aug 03 08:32:08 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-1709ecc2-6b37-4bf5-8ae8-2317d4ef87a5 tempest-SnapshotMetadataTestJSON-36075746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c62b3e75-f780-477c-bdc1-5f63a0eb35a9" returned: 0 in 0.249s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:32:08 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-1709ecc2-6b37-4bf5-8ae8-2317d4ef87a5 tempest-SnapshotMetadataTestJSON-36075746 None] Lock "cinder-quobyte-c62b3e75-f780-477c-bdc1-5f63a0eb35a9" released by "delete_volume" :: held 0.679s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:32:08 devstack cinder-volume[88899]: DEBUG cinder.quota [None req-1709ecc2-6b37-4bf5-8ae8-2317d4ef87a5 tempest-SnapshotMetadataTestJSON-36075746 None] Created reservations ['ce823aa0-0b5b-4f4f-b016-87dd38ce72c0', '9ef72773-e907-4236-a819-6a5ed5da9c57', '846d0551-bca5-4382-86a0-80702dc94a9f', '493c5a12-6c0d-4bb6-9627-33feb67d96e4'] {{(pid=88899) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 08:32:08 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-1709ecc2-6b37-4bf5-8ae8-2317d4ef87a5 tempest-SnapshotMetadataTestJSON-36075746 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:32:08 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-1709ecc2-6b37-4bf5-8ae8-2317d4ef87a5 tempest-SnapshotMetadataTestJSON-36075746 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:32:08 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-1709ecc2-6b37-4bf5-8ae8-2317d4ef87a5 tempest-SnapshotMetadataTestJSON-36075746 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:32:08 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-1709ecc2-6b37-4bf5-8ae8-2317d4ef87a5 tempest-SnapshotMetadataTestJSON-36075746 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:32:08 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-1709ecc2-6b37-4bf5-8ae8-2317d4ef87a5 tempest-SnapshotMetadataTestJSON-36075746 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:32:08 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-1709ecc2-6b37-4bf5-8ae8-2317d4ef87a5 tempest-SnapshotMetadataTestJSON-36075746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:32:08 devstack sudo[93413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a Aug 03 08:32:08 devstack sudo[93413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:32:08 devstack sudo[93413]: pam_unix(sudo:session): session closed for user root Aug 03 08:32:08 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-1709ecc2-6b37-4bf5-8ae8-2317d4ef87a5 tempest-SnapshotMetadataTestJSON-36075746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a" returned: 0 in 0.249s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:32:08 devstack cinder-volume[88899]: DEBUG cinder.manager [None req-1709ecc2-6b37-4bf5-8ae8-2317d4ef87a5 tempest-SnapshotMetadataTestJSON-36075746 None] Notifying Schedulers of capabilities ... {{(pid=88899) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 08:32:08 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-1709ecc2-6b37-4bf5-8ae8-2317d4ef87a5 tempest-SnapshotMetadataTestJSON-36075746 None] Deleted volume successfully. Aug 03 08:32:08 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-1709ecc2-6b37-4bf5-8ae8-2317d4ef87a5 tempest-SnapshotMetadataTestJSON-36075746 None] Lock "cinder-c62b3e75-f780-477c-bdc1-5f63a0eb35a9-delete_volume" released by "delete_volume" :: held 1.169s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:32:09 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [req-921d880a-1d1b-4553-9469-b01a283de246 req-33d6ef5c-58b7-4323-a107-8e21c12cde23 tempest-AttachVolumeNegativeTest-1279867800 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:32:09 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [req-921d880a-1d1b-4553-9469-b01a283de246 req-33d6ef5c-58b7-4323-a107-8e21c12cde23 tempest-AttachVolumeNegativeTest-1279867800 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:32:09 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [req-921d880a-1d1b-4553-9469-b01a283de246 req-33d6ef5c-58b7-4323-a107-8e21c12cde23 tempest-AttachVolumeNegativeTest-1279867800 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.022s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:32:09 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [req-921d880a-1d1b-4553-9469-b01a283de246 req-33d6ef5c-58b7-4323-a107-8e21c12cde23 tempest-AttachVolumeNegativeTest-1279867800 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385', 'name': 'volume-11b89d28-fc04-4ac0-a715-dc24cec72734', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e6db599c-55fa-48d2-945f-bcae60ae5419', 'enforce_multipath': True} {{(pid=88899) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 03 08:32:09 devstack cinder-volume[88899]: INFO cinder.volume.manager [req-921d880a-1d1b-4553-9469-b01a283de246 req-33d6ef5c-58b7-4323-a107-8e21c12cde23 tempest-AttachVolumeNegativeTest-1279867800 None] attachment_update completed successfully. Aug 03 08:32:13 devstack cinder-volume[88899]: DEBUG cinder.volume.flows.manager.create_volume [None req-cf13d789-e0f6-4110-831d-6478c7687ac2 tempest-AbsoluteLimitsTests-2130744438 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88899) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 08:32:13 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-cf13d789-e0f6-4110-831d-6478c7687ac2 tempest-AbsoluteLimitsTests-2130744438 None] Flow 'volume_create_manager' (5b643386-4046-4a47-bf97-3e4d4abd0ea4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:32:13 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-cf13d789-e0f6-4110-831d-6478c7687ac2 tempest-AbsoluteLimitsTests-2130744438 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (02b2e42a-79b9-458c-9022-ce85ee927a09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:32:13 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-cf13d789-e0f6-4110-831d-6478c7687ac2 tempest-AbsoluteLimitsTests-2130744438 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (02b2e42a-79b9-458c-9022-ce85ee927a09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:32:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1922320701',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=07dc9dad-4369-444e-ad44-fba7355980bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='721df161bf184db9912b549cfcd60f88',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:32:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:32:14Z,use_quota=True,user_id='853d94e898424ba09fef223b2519cd8f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8bde7129-1dc4-42ab-b852-ab32c61b4921),volume_type_id=8bde7129-1dc4-42ab-b852-ab32c61b4921)' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:32:13 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-cf13d789-e0f6-4110-831d-6478c7687ac2 tempest-AbsoluteLimitsTests-2130744438 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (71958342-f767-4714-842f-8c117cc4a634) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:32:13 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-cf13d789-e0f6-4110-831d-6478c7687ac2 tempest-AbsoluteLimitsTests-2130744438 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (71958342-f767-4714-842f-8c117cc4a634) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:32:13 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-cf13d789-e0f6-4110-831d-6478c7687ac2 tempest-AbsoluteLimitsTests-2130744438 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fef43a6c-a151-4a95-86d1-db9c3d2bc042) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:32:13 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-cf13d789-e0f6-4110-831d-6478c7687ac2 tempest-AbsoluteLimitsTests-2130744438 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fef43a6c-a151-4a95-86d1-db9c3d2bc042) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '07dc9dad-4369-444e-ad44-fba7355980bf', 'volume_name': 'volume-07dc9dad-4369-444e-ad44-fba7355980bf', 'volume_size': 1}' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:32:13 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-cf13d789-e0f6-4110-831d-6478c7687ac2 tempest-AbsoluteLimitsTests-2130744438 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0598dfbb-3b74-4062-bea6-27d5280d101c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:32:13 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-cf13d789-e0f6-4110-831d-6478c7687ac2 tempest-AbsoluteLimitsTests-2130744438 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0598dfbb-3b74-4062-bea6-27d5280d101c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:32:13 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-cf13d789-e0f6-4110-831d-6478c7687ac2 tempest-AbsoluteLimitsTests-2130744438 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (62a7fa95-0be5-4f64-a9f4-37293f7ac91d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:32:13 devstack cinder-volume[88899]: INFO cinder.volume.flows.manager.create_volume [None req-cf13d789-e0f6-4110-831d-6478c7687ac2 tempest-AbsoluteLimitsTests-2130744438 None] Volume 07dc9dad-4369-444e-ad44-fba7355980bf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-07dc9dad-4369-444e-ad44-fba7355980bf', 'volume_size': 1} Aug 03 08:32:13 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-cf13d789-e0f6-4110-831d-6478c7687ac2 tempest-AbsoluteLimitsTests-2130744438 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:32:13 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-cf13d789-e0f6-4110-831d-6478c7687ac2 tempest-AbsoluteLimitsTests-2130744438 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:32:13 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-cf13d789-e0f6-4110-831d-6478c7687ac2 tempest-AbsoluteLimitsTests-2130744438 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:32:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1922320701',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=07dc9dad-4369-444e-ad44-fba7355980bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='721df161bf184db9912b549cfcd60f88',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:32:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:32:14Z,use_quota=True,user_id='853d94e898424ba09fef223b2519cd8f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8bde7129-1dc4-42ab-b852-ab32c61b4921),volume_type_id=8bde7129-1dc4-42ab-b852-ab32c61b4921)}" {{(pid=88899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 08:32:13 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-cf13d789-e0f6-4110-831d-6478c7687ac2 tempest-AbsoluteLimitsTests-2130744438 None] Creating volume 07dc9dad-4369-444e-ad44-fba7355980bf {{(pid=88899) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 08:32:13 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-cf13d789-e0f6-4110-831d-6478c7687ac2 tempest-AbsoluteLimitsTests-2130744438 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:32:13 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-cf13d789-e0f6-4110-831d-6478c7687ac2 tempest-AbsoluteLimitsTests-2130744438 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:32:13 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-cf13d789-e0f6-4110-831d-6478c7687ac2 tempest-AbsoluteLimitsTests-2130744438 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:32:13 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-cf13d789-e0f6-4110-831d-6478c7687ac2 tempest-AbsoluteLimitsTests-2130744438 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:32:13 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-cf13d789-e0f6-4110-831d-6478c7687ac2 tempest-AbsoluteLimitsTests-2130744438 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:32:13 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-cf13d789-e0f6-4110-831d-6478c7687ac2 tempest-AbsoluteLimitsTests-2130744438 None] Selected osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385 as target Quobyte volume. {{(pid=88899) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 08:32:13 devstack cinder-volume[88899]: INFO cinder.volume.drivers.remotefs [None req-cf13d789-e0f6-4110-831d-6478c7687ac2 tempest-AbsoluteLimitsTests-2130744438 None] casted to osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385 Aug 03 08:32:13 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-cf13d789-e0f6-4110-831d-6478c7687ac2 tempest-AbsoluteLimitsTests-2130744438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-07dc9dad-4369-444e-ad44-fba7355980bf 1073741824 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:32:13 devstack sudo[93836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-07dc9dad-4369-444e-ad44-fba7355980bf 1073741824 Aug 03 08:32:13 devstack sudo[93836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:32:14 devstack sudo[93836]: pam_unix(sudo:session): session closed for user root Aug 03 08:32:14 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-cf13d789-e0f6-4110-831d-6478c7687ac2 tempest-AbsoluteLimitsTests-2130744438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-07dc9dad-4369-444e-ad44-fba7355980bf 1073741824" returned: 0 in 0.482s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:32:14 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-cf13d789-e0f6-4110-831d-6478c7687ac2 tempest-AbsoluteLimitsTests-2130744438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-07dc9dad-4369-444e-ad44-fba7355980bf {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:32:14 devstack sudo[93842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-07dc9dad-4369-444e-ad44-fba7355980bf Aug 03 08:32:14 devstack sudo[93842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:32:14 devstack sudo[93842]: pam_unix(sudo:session): session closed for user root Aug 03 08:32:14 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-cf13d789-e0f6-4110-831d-6478c7687ac2 tempest-AbsoluteLimitsTests-2130744438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-07dc9dad-4369-444e-ad44-fba7355980bf" returned: 0 in 0.256s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:32:14 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-cf13d789-e0f6-4110-831d-6478c7687ac2 tempest-AbsoluteLimitsTests-2130744438 None] <== create_volume: return (780ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'} {{(pid=88899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 08:32:14 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-cf13d789-e0f6-4110-831d-6478c7687ac2 tempest-AbsoluteLimitsTests-2130744438 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.782s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:32:14 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-cf13d789-e0f6-4110-831d-6478c7687ac2 tempest-AbsoluteLimitsTests-2130744438 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (62a7fa95-0be5-4f64-a9f4-37293f7ac91d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-07dc9dad-4369-444e-ad44-fba7355980bf', 'volume_size': 1}' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:32:14 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-cf13d789-e0f6-4110-831d-6478c7687ac2 tempest-AbsoluteLimitsTests-2130744438 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f6c6980-946f-47b6-9ea2-4358f561a447) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:32:14 devstack cinder-volume[88899]: INFO cinder.volume.flows.manager.create_volume [None req-cf13d789-e0f6-4110-831d-6478c7687ac2 tempest-AbsoluteLimitsTests-2130744438 None] Volume volume-07dc9dad-4369-444e-ad44-fba7355980bf (07dc9dad-4369-444e-ad44-fba7355980bf): created successfully Aug 03 08:32:14 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-cf13d789-e0f6-4110-831d-6478c7687ac2 tempest-AbsoluteLimitsTests-2130744438 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f6c6980-946f-47b6-9ea2-4358f561a447) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:32:14 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-cf13d789-e0f6-4110-831d-6478c7687ac2 tempest-AbsoluteLimitsTests-2130744438 None] Flow 'volume_create_manager' (5b643386-4046-4a47-bf97-3e4d4abd0ea4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:32:14 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-cf13d789-e0f6-4110-831d-6478c7687ac2 tempest-AbsoluteLimitsTests-2130744438 None] Created volume successfully. Aug 03 08:32:15 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-f73fe282-5fe4-4d95-845c-5bfd58ee5d77 tempest-AbsoluteLimitsTests-2130744438 None] Acquiring lock "cinder-07dc9dad-4369-444e-ad44-fba7355980bf-delete_volume" by "delete_volume" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:32:15 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-f73fe282-5fe4-4d95-845c-5bfd58ee5d77 tempest-AbsoluteLimitsTests-2130744438 None] Lock "cinder-07dc9dad-4369-444e-ad44-fba7355980bf-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:32:15 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-f73fe282-5fe4-4d95-845c-5bfd58ee5d77 tempest-AbsoluteLimitsTests-2130744438 None] Acquiring lock "cinder-quobyte-07dc9dad-4369-444e-ad44-fba7355980bf" by "delete_volume" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:32:15 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-f73fe282-5fe4-4d95-845c-5bfd58ee5d77 tempest-AbsoluteLimitsTests-2130744438 None] Lock "cinder-quobyte-07dc9dad-4369-444e-ad44-fba7355980bf" acquired by "delete_volume" :: waited 0.020s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:32:15 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[aba6b863-735d-41ab-844f-bd05f1197c09]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:32:15 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-f73fe282-5fe4-4d95-845c-5bfd58ee5d77 tempest-AbsoluteLimitsTests-2130744438 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-07dc9dad-4369-444e-ad44-fba7355980bf {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:32:15 devstack sudo[93851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-07dc9dad-4369-444e-ad44-fba7355980bf Aug 03 08:32:15 devstack sudo[93851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:32:15 devstack sudo[93851]: pam_unix(sudo:session): session closed for user root Aug 03 08:32:15 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-f73fe282-5fe4-4d95-845c-5bfd58ee5d77 tempest-AbsoluteLimitsTests-2130744438 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-07dc9dad-4369-444e-ad44-fba7355980bf" returned: 0 in 0.460s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:32:15 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-f73fe282-5fe4-4d95-845c-5bfd58ee5d77 tempest-AbsoluteLimitsTests-2130744438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-07dc9dad-4369-444e-ad44-fba7355980bf {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:32:15 devstack sudo[93859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-07dc9dad-4369-444e-ad44-fba7355980bf Aug 03 08:32:15 devstack sudo[93859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:32:15 devstack sudo[93859]: pam_unix(sudo:session): session closed for user root Aug 03 08:32:15 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-f73fe282-5fe4-4d95-845c-5bfd58ee5d77 tempest-AbsoluteLimitsTests-2130744438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-07dc9dad-4369-444e-ad44-fba7355980bf" returned: 0 in 0.267s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:32:15 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-f73fe282-5fe4-4d95-845c-5bfd58ee5d77 tempest-AbsoluteLimitsTests-2130744438 None] Lock "cinder-quobyte-07dc9dad-4369-444e-ad44-fba7355980bf" released by "delete_volume" :: held 0.768s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:32:15 devstack cinder-volume[88899]: DEBUG cinder.quota [None req-f73fe282-5fe4-4d95-845c-5bfd58ee5d77 tempest-AbsoluteLimitsTests-2130744438 None] Created reservations ['d7e37891-8de0-4745-b71c-0a2fd217670f', 'ca16647d-3531-473f-981e-a7bec8fc262c', '6dbcbe74-dc60-4867-be64-00ca0a7d487d', 'd32f0267-1e9b-45cf-830e-5173f210553c'] {{(pid=88899) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 08:32:16 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-f73fe282-5fe4-4d95-845c-5bfd58ee5d77 tempest-AbsoluteLimitsTests-2130744438 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:32:16 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-f73fe282-5fe4-4d95-845c-5bfd58ee5d77 tempest-AbsoluteLimitsTests-2130744438 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:32:16 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-f73fe282-5fe4-4d95-845c-5bfd58ee5d77 tempest-AbsoluteLimitsTests-2130744438 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:32:16 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-f73fe282-5fe4-4d95-845c-5bfd58ee5d77 tempest-AbsoluteLimitsTests-2130744438 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:32:16 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-f73fe282-5fe4-4d95-845c-5bfd58ee5d77 tempest-AbsoluteLimitsTests-2130744438 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:32:16 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-f73fe282-5fe4-4d95-845c-5bfd58ee5d77 tempest-AbsoluteLimitsTests-2130744438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:32:16 devstack sudo[93862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a Aug 03 08:32:16 devstack sudo[93862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:32:16 devstack cinder-volume[88899]: DEBUG cinder.volume.flows.manager.create_volume [None req-2f8187c7-c63e-498b-b51c-dc2d68c3387d tempest-ServerActionsTestOtherA-826446422 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88899) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 08:32:16 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-2f8187c7-c63e-498b-b51c-dc2d68c3387d tempest-ServerActionsTestOtherA-826446422 None] Flow 'volume_create_manager' (4fa02822-8e3c-4156-b6e2-12713e62fe92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:32:16 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-2f8187c7-c63e-498b-b51c-dc2d68c3387d tempest-ServerActionsTestOtherA-826446422 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (57dd61bb-e591-43f7-8167-ff33a4bdbc73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:32:16 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-2f8187c7-c63e-498b-b51c-dc2d68c3387d tempest-ServerActionsTestOtherA-826446422 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (57dd61bb-e591-43f7-8167-ff33a4bdbc73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:32:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-990642539',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2052ceb3-4070-47e1-9ffc-7499996ccbca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d1b6fd66571345ff99d622246ebbb270',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:32:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:32:16Z,use_quota=True,user_id='87918a8b928c4bd1bc1147851e28ecf9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8bde7129-1dc4-42ab-b852-ab32c61b4921),volume_type_id=8bde7129-1dc4-42ab-b852-ab32c61b4921)' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:32:16 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-2f8187c7-c63e-498b-b51c-dc2d68c3387d tempest-ServerActionsTestOtherA-826446422 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ccf5de7-bde7-461b-ba12-055e7c6e70e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:32:16 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-2f8187c7-c63e-498b-b51c-dc2d68c3387d tempest-ServerActionsTestOtherA-826446422 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ccf5de7-bde7-461b-ba12-055e7c6e70e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:32:16 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-2f8187c7-c63e-498b-b51c-dc2d68c3387d tempest-ServerActionsTestOtherA-826446422 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bcc87390-da79-4a38-89e4-1c93effcd35b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:32:16 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-2f8187c7-c63e-498b-b51c-dc2d68c3387d tempest-ServerActionsTestOtherA-826446422 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bcc87390-da79-4a38-89e4-1c93effcd35b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2052ceb3-4070-47e1-9ffc-7499996ccbca', 'volume_name': 'volume-2052ceb3-4070-47e1-9ffc-7499996ccbca', 'volume_size': 1}' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:32:16 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-2f8187c7-c63e-498b-b51c-dc2d68c3387d tempest-ServerActionsTestOtherA-826446422 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (880ff3eb-0880-457b-b2ad-afb17b426db9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:32:16 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-2f8187c7-c63e-498b-b51c-dc2d68c3387d tempest-ServerActionsTestOtherA-826446422 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (880ff3eb-0880-457b-b2ad-afb17b426db9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:32:16 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-2f8187c7-c63e-498b-b51c-dc2d68c3387d tempest-ServerActionsTestOtherA-826446422 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (61af4ebf-9aff-4e26-aae2-6406fc41ad9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:32:16 devstack cinder-volume[88899]: INFO cinder.volume.flows.manager.create_volume [None req-2f8187c7-c63e-498b-b51c-dc2d68c3387d tempest-ServerActionsTestOtherA-826446422 None] Volume 2052ceb3-4070-47e1-9ffc-7499996ccbca: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2052ceb3-4070-47e1-9ffc-7499996ccbca', 'volume_size': 1} Aug 03 08:32:16 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-2f8187c7-c63e-498b-b51c-dc2d68c3387d tempest-ServerActionsTestOtherA-826446422 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:32:16 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-2f8187c7-c63e-498b-b51c-dc2d68c3387d tempest-ServerActionsTestOtherA-826446422 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:32:16 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-2f8187c7-c63e-498b-b51c-dc2d68c3387d tempest-ServerActionsTestOtherA-826446422 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:32:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-990642539',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2052ceb3-4070-47e1-9ffc-7499996ccbca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d1b6fd66571345ff99d622246ebbb270',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:32:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:32:16Z,use_quota=True,user_id='87918a8b928c4bd1bc1147851e28ecf9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8bde7129-1dc4-42ab-b852-ab32c61b4921),volume_type_id=8bde7129-1dc4-42ab-b852-ab32c61b4921)}" {{(pid=88899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 08:32:16 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-2f8187c7-c63e-498b-b51c-dc2d68c3387d tempest-ServerActionsTestOtherA-826446422 None] Creating volume 2052ceb3-4070-47e1-9ffc-7499996ccbca {{(pid=88899) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 08:32:16 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-2f8187c7-c63e-498b-b51c-dc2d68c3387d tempest-ServerActionsTestOtherA-826446422 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:32:16 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-2f8187c7-c63e-498b-b51c-dc2d68c3387d tempest-ServerActionsTestOtherA-826446422 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:32:16 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-2f8187c7-c63e-498b-b51c-dc2d68c3387d tempest-ServerActionsTestOtherA-826446422 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:32:16 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-2f8187c7-c63e-498b-b51c-dc2d68c3387d tempest-ServerActionsTestOtherA-826446422 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:32:16 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-2f8187c7-c63e-498b-b51c-dc2d68c3387d tempest-ServerActionsTestOtherA-826446422 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:32:16 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-2f8187c7-c63e-498b-b51c-dc2d68c3387d tempest-ServerActionsTestOtherA-826446422 None] Selected osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385 as target Quobyte volume. {{(pid=88899) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 08:32:16 devstack cinder-volume[88899]: INFO cinder.volume.drivers.remotefs [None req-2f8187c7-c63e-498b-b51c-dc2d68c3387d tempest-ServerActionsTestOtherA-826446422 None] casted to osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385 Aug 03 08:32:16 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-2f8187c7-c63e-498b-b51c-dc2d68c3387d tempest-ServerActionsTestOtherA-826446422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-2052ceb3-4070-47e1-9ffc-7499996ccbca 1073741824 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:32:16 devstack sudo[93864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-2052ceb3-4070-47e1-9ffc-7499996ccbca 1073741824 Aug 03 08:32:16 devstack sudo[93864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:32:16 devstack sudo[93862]: pam_unix(sudo:session): session closed for user root Aug 03 08:32:16 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-f73fe282-5fe4-4d95-845c-5bfd58ee5d77 tempest-AbsoluteLimitsTests-2130744438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a" returned: 0 in 0.522s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:32:16 devstack cinder-volume[88899]: DEBUG cinder.manager [None req-f73fe282-5fe4-4d95-845c-5bfd58ee5d77 tempest-AbsoluteLimitsTests-2130744438 None] Notifying Schedulers of capabilities ... {{(pid=88899) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 08:32:16 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-f73fe282-5fe4-4d95-845c-5bfd58ee5d77 tempest-AbsoluteLimitsTests-2130744438 None] Deleted volume successfully. Aug 03 08:32:16 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-f73fe282-5fe4-4d95-845c-5bfd58ee5d77 tempest-AbsoluteLimitsTests-2130744438 None] Lock "cinder-07dc9dad-4369-444e-ad44-fba7355980bf-delete_volume" released by "delete_volume" :: held 1.618s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:32:17 devstack sudo[93864]: pam_unix(sudo:session): session closed for user root Aug 03 08:32:17 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-2f8187c7-c63e-498b-b51c-dc2d68c3387d tempest-ServerActionsTestOtherA-826446422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-2052ceb3-4070-47e1-9ffc-7499996ccbca 1073741824" returned: 0 in 0.731s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:32:17 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-2f8187c7-c63e-498b-b51c-dc2d68c3387d tempest-ServerActionsTestOtherA-826446422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-2052ceb3-4070-47e1-9ffc-7499996ccbca {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:32:17 devstack sudo[93880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-2052ceb3-4070-47e1-9ffc-7499996ccbca Aug 03 08:32:17 devstack sudo[93880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:32:17 devstack sudo[93880]: pam_unix(sudo:session): session closed for user root Aug 03 08:32:17 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-2f8187c7-c63e-498b-b51c-dc2d68c3387d tempest-ServerActionsTestOtherA-826446422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-2052ceb3-4070-47e1-9ffc-7499996ccbca" returned: 0 in 0.456s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:32:17 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-2f8187c7-c63e-498b-b51c-dc2d68c3387d tempest-ServerActionsTestOtherA-826446422 None] <== create_volume: return (1269ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'} {{(pid=88899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 08:32:17 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-2f8187c7-c63e-498b-b51c-dc2d68c3387d tempest-ServerActionsTestOtherA-826446422 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.280s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:32:17 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-2f8187c7-c63e-498b-b51c-dc2d68c3387d tempest-ServerActionsTestOtherA-826446422 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (61af4ebf-9aff-4e26-aae2-6406fc41ad9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2052ceb3-4070-47e1-9ffc-7499996ccbca', 'volume_size': 1}' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:32:17 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-2f8187c7-c63e-498b-b51c-dc2d68c3387d tempest-ServerActionsTestOtherA-826446422 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae5a5e41-9db8-4d08-a3a0-3082c5b46162) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:32:17 devstack cinder-volume[88899]: INFO cinder.volume.flows.manager.create_volume [None req-2f8187c7-c63e-498b-b51c-dc2d68c3387d tempest-ServerActionsTestOtherA-826446422 None] Volume volume-2052ceb3-4070-47e1-9ffc-7499996ccbca (2052ceb3-4070-47e1-9ffc-7499996ccbca): created successfully Aug 03 08:32:17 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-2f8187c7-c63e-498b-b51c-dc2d68c3387d tempest-ServerActionsTestOtherA-826446422 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae5a5e41-9db8-4d08-a3a0-3082c5b46162) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:32:17 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-2f8187c7-c63e-498b-b51c-dc2d68c3387d tempest-ServerActionsTestOtherA-826446422 None] Flow 'volume_create_manager' (4fa02822-8e3c-4156-b6e2-12713e62fe92) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:32:17 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-2f8187c7-c63e-498b-b51c-dc2d68c3387d tempest-ServerActionsTestOtherA-826446422 None] Created volume successfully. Aug 03 08:32:23 devstack cinder-volume[88899]: DEBUG cinder.volume.flows.manager.create_volume [None req-5841efb1-e260-495c-bef7-11717c7366f5 tempest-AttachVolumeTestJSON-774804622 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88899) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 08:32:23 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-5841efb1-e260-495c-bef7-11717c7366f5 tempest-AttachVolumeTestJSON-774804622 None] Flow 'volume_create_manager' (23397769-46c2-414f-a29d-720916a62e68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:32:23 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-5841efb1-e260-495c-bef7-11717c7366f5 tempest-AttachVolumeTestJSON-774804622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (731254e9-ad41-4ab3-8692-f9fb1af2688d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:32:23 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-5841efb1-e260-495c-bef7-11717c7366f5 tempest-AttachVolumeTestJSON-774804622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (731254e9-ad41-4ab3-8692-f9fb1af2688d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:32:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-2086225869',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d35f484a-dcf6-4fc7-91aa-0c28ed75c028,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9bf4090138434ab497d39b037bbd3123',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:32:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:32:23Z,use_quota=True,user_id='e0bd98856b2a4c5d947e8c7c7337e770',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8bde7129-1dc4-42ab-b852-ab32c61b4921),volume_type_id=8bde7129-1dc4-42ab-b852-ab32c61b4921)' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:32:23 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-5841efb1-e260-495c-bef7-11717c7366f5 tempest-AttachVolumeTestJSON-774804622 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc510bd5-4208-4dcd-b9ea-ee6fb9f60394) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:32:23 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-5841efb1-e260-495c-bef7-11717c7366f5 tempest-AttachVolumeTestJSON-774804622 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc510bd5-4208-4dcd-b9ea-ee6fb9f60394) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:32:23 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-5841efb1-e260-495c-bef7-11717c7366f5 tempest-AttachVolumeTestJSON-774804622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dbaefd1e-6bb2-4c4a-951e-57110c02107f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:32:23 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-5841efb1-e260-495c-bef7-11717c7366f5 tempest-AttachVolumeTestJSON-774804622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dbaefd1e-6bb2-4c4a-951e-57110c02107f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd35f484a-dcf6-4fc7-91aa-0c28ed75c028', 'volume_name': 'volume-d35f484a-dcf6-4fc7-91aa-0c28ed75c028', 'volume_size': 1}' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:32:23 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-5841efb1-e260-495c-bef7-11717c7366f5 tempest-AttachVolumeTestJSON-774804622 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4a7d039-0884-4f00-baea-4b068b71bb3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:32:23 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-5841efb1-e260-495c-bef7-11717c7366f5 tempest-AttachVolumeTestJSON-774804622 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4a7d039-0884-4f00-baea-4b068b71bb3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:32:23 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-5841efb1-e260-495c-bef7-11717c7366f5 tempest-AttachVolumeTestJSON-774804622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6bca708-18ca-41b1-af92-87db80993a23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:32:23 devstack cinder-volume[88899]: INFO cinder.volume.flows.manager.create_volume [None req-5841efb1-e260-495c-bef7-11717c7366f5 tempest-AttachVolumeTestJSON-774804622 None] Volume d35f484a-dcf6-4fc7-91aa-0c28ed75c028: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d35f484a-dcf6-4fc7-91aa-0c28ed75c028', 'volume_size': 1} Aug 03 08:32:23 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-5841efb1-e260-495c-bef7-11717c7366f5 tempest-AttachVolumeTestJSON-774804622 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:32:23 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-5841efb1-e260-495c-bef7-11717c7366f5 tempest-AttachVolumeTestJSON-774804622 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:32:23 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-5841efb1-e260-495c-bef7-11717c7366f5 tempest-AttachVolumeTestJSON-774804622 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:32:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-2086225869',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d35f484a-dcf6-4fc7-91aa-0c28ed75c028,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9bf4090138434ab497d39b037bbd3123',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:32:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:32:23Z,use_quota=True,user_id='e0bd98856b2a4c5d947e8c7c7337e770',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8bde7129-1dc4-42ab-b852-ab32c61b4921),volume_type_id=8bde7129-1dc4-42ab-b852-ab32c61b4921)}" {{(pid=88899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 08:32:23 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-5841efb1-e260-495c-bef7-11717c7366f5 tempest-AttachVolumeTestJSON-774804622 None] Creating volume d35f484a-dcf6-4fc7-91aa-0c28ed75c028 {{(pid=88899) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 08:32:23 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-5841efb1-e260-495c-bef7-11717c7366f5 tempest-AttachVolumeTestJSON-774804622 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:32:23 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-5841efb1-e260-495c-bef7-11717c7366f5 tempest-AttachVolumeTestJSON-774804622 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:32:23 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-5841efb1-e260-495c-bef7-11717c7366f5 tempest-AttachVolumeTestJSON-774804622 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:32:23 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-5841efb1-e260-495c-bef7-11717c7366f5 tempest-AttachVolumeTestJSON-774804622 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:32:23 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-5841efb1-e260-495c-bef7-11717c7366f5 tempest-AttachVolumeTestJSON-774804622 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:32:23 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-5841efb1-e260-495c-bef7-11717c7366f5 tempest-AttachVolumeTestJSON-774804622 None] Selected osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385 as target Quobyte volume. {{(pid=88899) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 08:32:23 devstack cinder-volume[88899]: INFO cinder.volume.drivers.remotefs [None req-5841efb1-e260-495c-bef7-11717c7366f5 tempest-AttachVolumeTestJSON-774804622 None] casted to osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385 Aug 03 08:32:23 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-5841efb1-e260-495c-bef7-11717c7366f5 tempest-AttachVolumeTestJSON-774804622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-d35f484a-dcf6-4fc7-91aa-0c28ed75c028 1073741824 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:32:23 devstack sudo[93963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-d35f484a-dcf6-4fc7-91aa-0c28ed75c028 1073741824 Aug 03 08:32:23 devstack sudo[93963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:32:24 devstack sudo[93963]: pam_unix(sudo:session): session closed for user root Aug 03 08:32:24 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-5841efb1-e260-495c-bef7-11717c7366f5 tempest-AttachVolumeTestJSON-774804622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-d35f484a-dcf6-4fc7-91aa-0c28ed75c028 1073741824" returned: 0 in 1.063s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:32:24 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-5841efb1-e260-495c-bef7-11717c7366f5 tempest-AttachVolumeTestJSON-774804622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-d35f484a-dcf6-4fc7-91aa-0c28ed75c028 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:32:24 devstack sudo[93982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-d35f484a-dcf6-4fc7-91aa-0c28ed75c028 Aug 03 08:32:24 devstack sudo[93982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:32:25 devstack sudo[93982]: pam_unix(sudo:session): session closed for user root Aug 03 08:32:25 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-5841efb1-e260-495c-bef7-11717c7366f5 tempest-AttachVolumeTestJSON-774804622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-d35f484a-dcf6-4fc7-91aa-0c28ed75c028" returned: 0 in 0.515s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:32:25 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-5841efb1-e260-495c-bef7-11717c7366f5 tempest-AttachVolumeTestJSON-774804622 None] <== create_volume: return (1672ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'} {{(pid=88899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 08:32:25 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-5841efb1-e260-495c-bef7-11717c7366f5 tempest-AttachVolumeTestJSON-774804622 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.680s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:32:25 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-5841efb1-e260-495c-bef7-11717c7366f5 tempest-AttachVolumeTestJSON-774804622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6bca708-18ca-41b1-af92-87db80993a23) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d35f484a-dcf6-4fc7-91aa-0c28ed75c028', 'volume_size': 1}' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:32:25 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-5841efb1-e260-495c-bef7-11717c7366f5 tempest-AttachVolumeTestJSON-774804622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc55a05b-66d9-48a1-9774-b1bf582cb361) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:32:25 devstack cinder-volume[88899]: INFO cinder.volume.flows.manager.create_volume [None req-5841efb1-e260-495c-bef7-11717c7366f5 tempest-AttachVolumeTestJSON-774804622 None] Volume volume-d35f484a-dcf6-4fc7-91aa-0c28ed75c028 (d35f484a-dcf6-4fc7-91aa-0c28ed75c028): created successfully Aug 03 08:32:25 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-5841efb1-e260-495c-bef7-11717c7366f5 tempest-AttachVolumeTestJSON-774804622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc55a05b-66d9-48a1-9774-b1bf582cb361) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:32:25 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-5841efb1-e260-495c-bef7-11717c7366f5 tempest-AttachVolumeTestJSON-774804622 None] Flow 'volume_create_manager' (23397769-46c2-414f-a29d-720916a62e68) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:32:25 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-5841efb1-e260-495c-bef7-11717c7366f5 tempest-AttachVolumeTestJSON-774804622 None] Created volume successfully. Aug 03 08:32:27 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [req-5fd3a40d-d87d-464a-add8-3a6beffe6737 req-21b53344-87e7-4ac7-af15-47b8b0c424ce tempest-AttachVolumeTestJSON-774804622 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:32:27 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [req-5fd3a40d-d87d-464a-add8-3a6beffe6737 req-21b53344-87e7-4ac7-af15-47b8b0c424ce tempest-AttachVolumeTestJSON-774804622 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:32:27 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [req-5fd3a40d-d87d-464a-add8-3a6beffe6737 req-21b53344-87e7-4ac7-af15-47b8b0c424ce tempest-AttachVolumeTestJSON-774804622 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.026s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:32:27 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [req-5fd3a40d-d87d-464a-add8-3a6beffe6737 req-21b53344-87e7-4ac7-af15-47b8b0c424ce tempest-AttachVolumeTestJSON-774804622 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385', 'name': 'volume-d35f484a-dcf6-4fc7-91aa-0c28ed75c028', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '3d272287-68d0-45b7-8b80-b9157a3beb13', 'enforce_multipath': True} {{(pid=88899) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 03 08:32:27 devstack cinder-volume[88899]: INFO cinder.volume.manager [req-5fd3a40d-d87d-464a-add8-3a6beffe6737 req-21b53344-87e7-4ac7-af15-47b8b0c424ce tempest-AttachVolumeTestJSON-774804622 None] attachment_update completed successfully. Aug 03 08:32:27 devstack cinder-volume[88899]: DEBUG cinder.volume.flows.manager.create_volume [None req-953ee08a-ec68-40b8-83d5-6432e1872f1b tempest-VolumesTransfersV357Test-1343325150 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88899) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 08:32:27 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-953ee08a-ec68-40b8-83d5-6432e1872f1b tempest-VolumesTransfersV357Test-1343325150 None] Flow 'volume_create_manager' (db457d63-3782-4256-8867-4a1a212ee119) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:32:28 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-953ee08a-ec68-40b8-83d5-6432e1872f1b tempest-VolumesTransfersV357Test-1343325150 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e9db70d-3683-42b7-91c5-807aedbcda6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:32:28 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-953ee08a-ec68-40b8-83d5-6432e1872f1b tempest-VolumesTransfersV357Test-1343325150 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e9db70d-3683-42b7-91c5-807aedbcda6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:32:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1863333131',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab33e651-b8f9-48d4-a442-33d0aa2aa36b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='62ac6855788b4ca98d91573b45765113',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:32:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:32:28Z,use_quota=True,user_id='89aa9127f5c14eee9d0b59dcbd21caa1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8bde7129-1dc4-42ab-b852-ab32c61b4921),volume_type_id=8bde7129-1dc4-42ab-b852-ab32c61b4921)' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:32:28 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-953ee08a-ec68-40b8-83d5-6432e1872f1b tempest-VolumesTransfersV357Test-1343325150 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5bbef47e-a3c4-40d8-ab39-8b98b785ef0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:32:28 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-953ee08a-ec68-40b8-83d5-6432e1872f1b tempest-VolumesTransfersV357Test-1343325150 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5bbef47e-a3c4-40d8-ab39-8b98b785ef0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:32:28 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-953ee08a-ec68-40b8-83d5-6432e1872f1b tempest-VolumesTransfersV357Test-1343325150 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed50681c-7f65-4799-8849-3a261d862629) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:32:28 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-953ee08a-ec68-40b8-83d5-6432e1872f1b tempest-VolumesTransfersV357Test-1343325150 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed50681c-7f65-4799-8849-3a261d862629) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ab33e651-b8f9-48d4-a442-33d0aa2aa36b', 'volume_name': 'volume-ab33e651-b8f9-48d4-a442-33d0aa2aa36b', 'volume_size': 1}' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:32:28 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-953ee08a-ec68-40b8-83d5-6432e1872f1b tempest-VolumesTransfersV357Test-1343325150 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e71d9c99-8780-4d06-a6a8-faef0a5692f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:32:28 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-953ee08a-ec68-40b8-83d5-6432e1872f1b tempest-VolumesTransfersV357Test-1343325150 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e71d9c99-8780-4d06-a6a8-faef0a5692f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:32:28 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-953ee08a-ec68-40b8-83d5-6432e1872f1b tempest-VolumesTransfersV357Test-1343325150 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32d6e542-d2e1-45b8-824d-d06da2b73a6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:32:28 devstack cinder-volume[88899]: INFO cinder.volume.flows.manager.create_volume [None req-953ee08a-ec68-40b8-83d5-6432e1872f1b tempest-VolumesTransfersV357Test-1343325150 None] Volume ab33e651-b8f9-48d4-a442-33d0aa2aa36b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ab33e651-b8f9-48d4-a442-33d0aa2aa36b', 'volume_size': 1} Aug 03 08:32:28 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-953ee08a-ec68-40b8-83d5-6432e1872f1b tempest-VolumesTransfersV357Test-1343325150 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:32:28 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-953ee08a-ec68-40b8-83d5-6432e1872f1b tempest-VolumesTransfersV357Test-1343325150 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:32:28 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-953ee08a-ec68-40b8-83d5-6432e1872f1b tempest-VolumesTransfersV357Test-1343325150 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:32:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1863333131',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab33e651-b8f9-48d4-a442-33d0aa2aa36b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='62ac6855788b4ca98d91573b45765113',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:32:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:32:28Z,use_quota=True,user_id='89aa9127f5c14eee9d0b59dcbd21caa1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8bde7129-1dc4-42ab-b852-ab32c61b4921),volume_type_id=8bde7129-1dc4-42ab-b852-ab32c61b4921)}" {{(pid=88899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 08:32:28 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-953ee08a-ec68-40b8-83d5-6432e1872f1b tempest-VolumesTransfersV357Test-1343325150 None] Creating volume ab33e651-b8f9-48d4-a442-33d0aa2aa36b {{(pid=88899) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 08:32:28 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-953ee08a-ec68-40b8-83d5-6432e1872f1b tempest-VolumesTransfersV357Test-1343325150 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:32:28 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-953ee08a-ec68-40b8-83d5-6432e1872f1b tempest-VolumesTransfersV357Test-1343325150 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:32:28 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-953ee08a-ec68-40b8-83d5-6432e1872f1b tempest-VolumesTransfersV357Test-1343325150 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:32:28 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-953ee08a-ec68-40b8-83d5-6432e1872f1b tempest-VolumesTransfersV357Test-1343325150 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:32:28 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-953ee08a-ec68-40b8-83d5-6432e1872f1b tempest-VolumesTransfersV357Test-1343325150 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.040s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:32:28 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-953ee08a-ec68-40b8-83d5-6432e1872f1b tempest-VolumesTransfersV357Test-1343325150 None] Selected osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385 as target Quobyte volume. {{(pid=88899) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 08:32:28 devstack cinder-volume[88899]: INFO cinder.volume.drivers.remotefs [None req-953ee08a-ec68-40b8-83d5-6432e1872f1b tempest-VolumesTransfersV357Test-1343325150 None] casted to osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385 Aug 03 08:32:28 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-953ee08a-ec68-40b8-83d5-6432e1872f1b tempest-VolumesTransfersV357Test-1343325150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-ab33e651-b8f9-48d4-a442-33d0aa2aa36b 1073741824 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:32:28 devstack sudo[94013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-ab33e651-b8f9-48d4-a442-33d0aa2aa36b 1073741824 Aug 03 08:32:28 devstack sudo[94013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:32:29 devstack sudo[94013]: pam_unix(sudo:session): session closed for user root Aug 03 08:32:29 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-953ee08a-ec68-40b8-83d5-6432e1872f1b tempest-VolumesTransfersV357Test-1343325150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-ab33e651-b8f9-48d4-a442-33d0aa2aa36b 1073741824" returned: 0 in 0.993s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:32:29 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-953ee08a-ec68-40b8-83d5-6432e1872f1b tempest-VolumesTransfersV357Test-1343325150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-ab33e651-b8f9-48d4-a442-33d0aa2aa36b {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:32:29 devstack sudo[94047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-ab33e651-b8f9-48d4-a442-33d0aa2aa36b Aug 03 08:32:29 devstack sudo[94047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:32:29 devstack sudo[94047]: pam_unix(sudo:session): session closed for user root Aug 03 08:32:29 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-953ee08a-ec68-40b8-83d5-6432e1872f1b tempest-VolumesTransfersV357Test-1343325150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-ab33e651-b8f9-48d4-a442-33d0aa2aa36b" returned: 0 in 0.458s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:32:29 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-953ee08a-ec68-40b8-83d5-6432e1872f1b tempest-VolumesTransfersV357Test-1343325150 None] <== create_volume: return (1639ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'} {{(pid=88899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 08:32:29 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-953ee08a-ec68-40b8-83d5-6432e1872f1b tempest-VolumesTransfersV357Test-1343325150 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.648s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:32:29 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-953ee08a-ec68-40b8-83d5-6432e1872f1b tempest-VolumesTransfersV357Test-1343325150 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32d6e542-d2e1-45b8-824d-d06da2b73a6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ab33e651-b8f9-48d4-a442-33d0aa2aa36b', 'volume_size': 1}' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:32:29 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-953ee08a-ec68-40b8-83d5-6432e1872f1b tempest-VolumesTransfersV357Test-1343325150 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e30b8bf-98db-4325-a676-d1fab6d7655d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:32:29 devstack cinder-volume[88899]: INFO cinder.volume.flows.manager.create_volume [None req-953ee08a-ec68-40b8-83d5-6432e1872f1b tempest-VolumesTransfersV357Test-1343325150 None] Volume volume-ab33e651-b8f9-48d4-a442-33d0aa2aa36b (ab33e651-b8f9-48d4-a442-33d0aa2aa36b): created successfully Aug 03 08:32:29 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-953ee08a-ec68-40b8-83d5-6432e1872f1b tempest-VolumesTransfersV357Test-1343325150 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e30b8bf-98db-4325-a676-d1fab6d7655d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:32:29 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-953ee08a-ec68-40b8-83d5-6432e1872f1b tempest-VolumesTransfersV357Test-1343325150 None] Flow 'volume_create_manager' (db457d63-3782-4256-8867-4a1a212ee119) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:32:29 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-953ee08a-ec68-40b8-83d5-6432e1872f1b tempest-VolumesTransfersV357Test-1343325150 None] Created volume successfully. Aug 03 08:32:30 devstack cinder-volume[88899]: DEBUG cinder.volume.flows.manager.create_volume [None req-9453ad82-b2cc-4999-bbf8-41276741d542 tempest-AttachVolumeTestJSON-774804622 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88899) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 08:32:31 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-9453ad82-b2cc-4999-bbf8-41276741d542 tempest-AttachVolumeTestJSON-774804622 None] Flow 'volume_create_manager' (0e03d4f8-ec5d-4cbe-b5d3-b075d64b5c09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:32:31 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-9453ad82-b2cc-4999-bbf8-41276741d542 tempest-AttachVolumeTestJSON-774804622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db3bed12-d3a9-4b0e-ae89-b24635912fca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:32:31 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-9453ad82-b2cc-4999-bbf8-41276741d542 tempest-AttachVolumeTestJSON-774804622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db3bed12-d3a9-4b0e-ae89-b24635912fca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:32:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1972426216',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bbac0152-199f-4455-a58f-99b701050820,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9bf4090138434ab497d39b037bbd3123',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:32:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:32:31Z,use_quota=True,user_id='e0bd98856b2a4c5d947e8c7c7337e770',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8bde7129-1dc4-42ab-b852-ab32c61b4921),volume_type_id=8bde7129-1dc4-42ab-b852-ab32c61b4921)' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:32:31 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-9453ad82-b2cc-4999-bbf8-41276741d542 tempest-AttachVolumeTestJSON-774804622 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc7c68fc-89c8-4295-94da-9176aff72bb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:32:31 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-9453ad82-b2cc-4999-bbf8-41276741d542 tempest-AttachVolumeTestJSON-774804622 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc7c68fc-89c8-4295-94da-9176aff72bb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:32:31 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-9453ad82-b2cc-4999-bbf8-41276741d542 tempest-AttachVolumeTestJSON-774804622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f6d70e6-84c4-4c4f-a185-33cf9fc73425) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:32:31 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-9453ad82-b2cc-4999-bbf8-41276741d542 tempest-AttachVolumeTestJSON-774804622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f6d70e6-84c4-4c4f-a185-33cf9fc73425) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bbac0152-199f-4455-a58f-99b701050820', 'volume_name': 'volume-bbac0152-199f-4455-a58f-99b701050820', 'volume_size': 1}' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:32:31 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-9453ad82-b2cc-4999-bbf8-41276741d542 tempest-AttachVolumeTestJSON-774804622 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73a53777-c0fa-4989-be6a-7316e8cc60f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:32:31 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-9453ad82-b2cc-4999-bbf8-41276741d542 tempest-AttachVolumeTestJSON-774804622 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73a53777-c0fa-4989-be6a-7316e8cc60f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:32:31 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-9453ad82-b2cc-4999-bbf8-41276741d542 tempest-AttachVolumeTestJSON-774804622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07d71886-f3c8-4ac8-a820-bf80edcb4464) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:32:31 devstack cinder-volume[88899]: INFO cinder.volume.flows.manager.create_volume [None req-9453ad82-b2cc-4999-bbf8-41276741d542 tempest-AttachVolumeTestJSON-774804622 None] Volume bbac0152-199f-4455-a58f-99b701050820: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bbac0152-199f-4455-a58f-99b701050820', 'volume_size': 1} Aug 03 08:32:31 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-9453ad82-b2cc-4999-bbf8-41276741d542 tempest-AttachVolumeTestJSON-774804622 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:32:31 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-9453ad82-b2cc-4999-bbf8-41276741d542 tempest-AttachVolumeTestJSON-774804622 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:32:31 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-9453ad82-b2cc-4999-bbf8-41276741d542 tempest-AttachVolumeTestJSON-774804622 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:32:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1972426216',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bbac0152-199f-4455-a58f-99b701050820,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9bf4090138434ab497d39b037bbd3123',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:32:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:32:31Z,use_quota=True,user_id='e0bd98856b2a4c5d947e8c7c7337e770',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8bde7129-1dc4-42ab-b852-ab32c61b4921),volume_type_id=8bde7129-1dc4-42ab-b852-ab32c61b4921)}" {{(pid=88899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 08:32:31 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-9453ad82-b2cc-4999-bbf8-41276741d542 tempest-AttachVolumeTestJSON-774804622 None] Creating volume bbac0152-199f-4455-a58f-99b701050820 {{(pid=88899) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 08:32:31 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-9453ad82-b2cc-4999-bbf8-41276741d542 tempest-AttachVolumeTestJSON-774804622 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:32:31 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-9453ad82-b2cc-4999-bbf8-41276741d542 tempest-AttachVolumeTestJSON-774804622 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:32:31 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-9453ad82-b2cc-4999-bbf8-41276741d542 tempest-AttachVolumeTestJSON-774804622 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:32:31 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-9453ad82-b2cc-4999-bbf8-41276741d542 tempest-AttachVolumeTestJSON-774804622 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:32:31 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-9453ad82-b2cc-4999-bbf8-41276741d542 tempest-AttachVolumeTestJSON-774804622 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:32:31 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-9453ad82-b2cc-4999-bbf8-41276741d542 tempest-AttachVolumeTestJSON-774804622 None] Selected osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385 as target Quobyte volume. {{(pid=88899) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 08:32:31 devstack cinder-volume[88899]: INFO cinder.volume.drivers.remotefs [None req-9453ad82-b2cc-4999-bbf8-41276741d542 tempest-AttachVolumeTestJSON-774804622 None] casted to osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385 Aug 03 08:32:31 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-9453ad82-b2cc-4999-bbf8-41276741d542 tempest-AttachVolumeTestJSON-774804622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-bbac0152-199f-4455-a58f-99b701050820 1073741824 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:32:31 devstack sudo[94104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-bbac0152-199f-4455-a58f-99b701050820 1073741824 Aug 03 08:32:31 devstack sudo[94104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:32:31 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-bde6941e-791e-42be-89ef-1f4a07261746 tempest-VolumesTransfersV357Test-109480549 None] Transfer volume completed successfully. Aug 03 08:32:31 devstack sudo[94104]: pam_unix(sudo:session): session closed for user root Aug 03 08:32:31 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-9453ad82-b2cc-4999-bbf8-41276741d542 tempest-AttachVolumeTestJSON-774804622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-bbac0152-199f-4455-a58f-99b701050820 1073741824" returned: 0 in 0.680s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:32:31 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-9453ad82-b2cc-4999-bbf8-41276741d542 tempest-AttachVolumeTestJSON-774804622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-bbac0152-199f-4455-a58f-99b701050820 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:32:32 devstack sudo[94113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-bbac0152-199f-4455-a58f-99b701050820 Aug 03 08:32:32 devstack sudo[94113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:32:32 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-d6c43c86-5c0d-47f0-b022-50bde54a1030 tempest-VolumesTransfersV357Test-1357491500 None] Acquiring lock "cinder-ab33e651-b8f9-48d4-a442-33d0aa2aa36b-delete_volume" by "delete_volume" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:32:32 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-d6c43c86-5c0d-47f0-b022-50bde54a1030 tempest-VolumesTransfersV357Test-1357491500 None] Lock "cinder-ab33e651-b8f9-48d4-a442-33d0aa2aa36b-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:32:32 devstack sudo[94113]: pam_unix(sudo:session): session closed for user root Aug 03 08:32:32 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-9453ad82-b2cc-4999-bbf8-41276741d542 tempest-AttachVolumeTestJSON-774804622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-bbac0152-199f-4455-a58f-99b701050820" returned: 0 in 0.675s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:32:32 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-9453ad82-b2cc-4999-bbf8-41276741d542 tempest-AttachVolumeTestJSON-774804622 None] <== create_volume: return (1514ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'} {{(pid=88899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 08:32:32 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-9453ad82-b2cc-4999-bbf8-41276741d542 tempest-AttachVolumeTestJSON-774804622 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.519s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:32:32 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-9453ad82-b2cc-4999-bbf8-41276741d542 tempest-AttachVolumeTestJSON-774804622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07d71886-f3c8-4ac8-a820-bf80edcb4464) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bbac0152-199f-4455-a58f-99b701050820', 'volume_size': 1}' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:32:32 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-9453ad82-b2cc-4999-bbf8-41276741d542 tempest-AttachVolumeTestJSON-774804622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f138e572-9d08-46ca-a3d3-8b40c0bccc6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:32:32 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-d6c43c86-5c0d-47f0-b022-50bde54a1030 tempest-VolumesTransfersV357Test-1357491500 None] Acquiring lock "cinder-quobyte-ab33e651-b8f9-48d4-a442-33d0aa2aa36b" by "delete_volume" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:32:32 devstack cinder-volume[88899]: INFO cinder.volume.flows.manager.create_volume [None req-9453ad82-b2cc-4999-bbf8-41276741d542 tempest-AttachVolumeTestJSON-774804622 None] Volume volume-bbac0152-199f-4455-a58f-99b701050820 (bbac0152-199f-4455-a58f-99b701050820): created successfully Aug 03 08:32:32 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-9453ad82-b2cc-4999-bbf8-41276741d542 tempest-AttachVolumeTestJSON-774804622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f138e572-9d08-46ca-a3d3-8b40c0bccc6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:32:32 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-9453ad82-b2cc-4999-bbf8-41276741d542 tempest-AttachVolumeTestJSON-774804622 None] Flow 'volume_create_manager' (0e03d4f8-ec5d-4cbe-b5d3-b075d64b5c09) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:32:32 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-d6c43c86-5c0d-47f0-b022-50bde54a1030 tempest-VolumesTransfersV357Test-1357491500 None] Lock "cinder-quobyte-ab33e651-b8f9-48d4-a442-33d0aa2aa36b" acquired by "delete_volume" :: waited 0.029s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:32:32 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-9453ad82-b2cc-4999-bbf8-41276741d542 tempest-AttachVolumeTestJSON-774804622 None] Created volume successfully. Aug 03 08:32:32 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e564c51-be11-4f36-b8a3-4086d4b71f4a]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:32:32 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-d6c43c86-5c0d-47f0-b022-50bde54a1030 tempest-VolumesTransfersV357Test-1357491500 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-ab33e651-b8f9-48d4-a442-33d0aa2aa36b {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:32:32 devstack sudo[94118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-ab33e651-b8f9-48d4-a442-33d0aa2aa36b Aug 03 08:32:32 devstack sudo[94118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:32:33 devstack sudo[94118]: pam_unix(sudo:session): session closed for user root Aug 03 08:32:33 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-d6c43c86-5c0d-47f0-b022-50bde54a1030 tempest-VolumesTransfersV357Test-1357491500 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-ab33e651-b8f9-48d4-a442-33d0aa2aa36b" returned: 0 in 0.486s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:32:33 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-d6c43c86-5c0d-47f0-b022-50bde54a1030 tempest-VolumesTransfersV357Test-1357491500 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-ab33e651-b8f9-48d4-a442-33d0aa2aa36b {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:32:33 devstack sudo[94126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-ab33e651-b8f9-48d4-a442-33d0aa2aa36b Aug 03 08:32:33 devstack sudo[94126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:32:33 devstack sudo[94126]: pam_unix(sudo:session): session closed for user root Aug 03 08:32:33 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-d6c43c86-5c0d-47f0-b022-50bde54a1030 tempest-VolumesTransfersV357Test-1357491500 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-ab33e651-b8f9-48d4-a442-33d0aa2aa36b" returned: 0 in 0.369s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:32:33 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-d6c43c86-5c0d-47f0-b022-50bde54a1030 tempest-VolumesTransfersV357Test-1357491500 None] Lock "cinder-quobyte-ab33e651-b8f9-48d4-a442-33d0aa2aa36b" released by "delete_volume" :: held 0.917s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:32:33 devstack cinder-volume[88899]: DEBUG cinder.quota [None req-d6c43c86-5c0d-47f0-b022-50bde54a1030 tempest-VolumesTransfersV357Test-1357491500 None] Created reservations ['ec445ca4-3f7e-4d4f-8823-e3bced2cd4c5', 'a96b2a37-7a2e-4956-865b-8163e7af08f2', '2ff6ca79-95cc-48c2-ae24-9856f6394a47', '9061fb63-1551-4de6-93bd-0c6fb6f2f9ca'] {{(pid=88899) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 08:32:33 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-d6c43c86-5c0d-47f0-b022-50bde54a1030 tempest-VolumesTransfersV357Test-1357491500 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:32:33 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-d6c43c86-5c0d-47f0-b022-50bde54a1030 tempest-VolumesTransfersV357Test-1357491500 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:32:33 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-d6c43c86-5c0d-47f0-b022-50bde54a1030 tempest-VolumesTransfersV357Test-1357491500 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:32:33 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-d6c43c86-5c0d-47f0-b022-50bde54a1030 tempest-VolumesTransfersV357Test-1357491500 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:32:33 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-d6c43c86-5c0d-47f0-b022-50bde54a1030 tempest-VolumesTransfersV357Test-1357491500 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:32:33 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-d6c43c86-5c0d-47f0-b022-50bde54a1030 tempest-VolumesTransfersV357Test-1357491500 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:32:33 devstack sudo[94131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a Aug 03 08:32:33 devstack sudo[94131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:32:34 devstack sudo[94131]: pam_unix(sudo:session): session closed for user root Aug 03 08:32:34 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-d6c43c86-5c0d-47f0-b022-50bde54a1030 tempest-VolumesTransfersV357Test-1357491500 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a" returned: 0 in 0.438s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:32:34 devstack cinder-volume[88899]: DEBUG cinder.manager [None req-d6c43c86-5c0d-47f0-b022-50bde54a1030 tempest-VolumesTransfersV357Test-1357491500 None] Notifying Schedulers of capabilities ... {{(pid=88899) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 08:32:34 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-d6c43c86-5c0d-47f0-b022-50bde54a1030 tempest-VolumesTransfersV357Test-1357491500 None] Deleted volume successfully. Aug 03 08:32:34 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-d6c43c86-5c0d-47f0-b022-50bde54a1030 tempest-VolumesTransfersV357Test-1357491500 None] Lock "cinder-ab33e651-b8f9-48d4-a442-33d0aa2aa36b-delete_volume" released by "delete_volume" :: held 1.870s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:32:34 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [req-17f69444-0211-49b6-b346-270fecfa6de0 req-de655236-d8d8-4fb2-a2e0-78a83c337749 tempest-AttachVolumeTestJSON-774804622 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:32:34 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [req-17f69444-0211-49b6-b346-270fecfa6de0 req-de655236-d8d8-4fb2-a2e0-78a83c337749 tempest-AttachVolumeTestJSON-774804622 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:32:34 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [req-17f69444-0211-49b6-b346-270fecfa6de0 req-de655236-d8d8-4fb2-a2e0-78a83c337749 tempest-AttachVolumeTestJSON-774804622 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.018s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:32:34 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [req-17f69444-0211-49b6-b346-270fecfa6de0 req-de655236-d8d8-4fb2-a2e0-78a83c337749 tempest-AttachVolumeTestJSON-774804622 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385', 'name': 'volume-bbac0152-199f-4455-a58f-99b701050820', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c15ea986-7eb2-4450-a469-d067d366f8ea', 'enforce_multipath': True} {{(pid=88899) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 03 08:32:34 devstack cinder-volume[88899]: INFO cinder.volume.manager [req-17f69444-0211-49b6-b346-270fecfa6de0 req-de655236-d8d8-4fb2-a2e0-78a83c337749 tempest-AttachVolumeTestJSON-774804622 None] attachment_update completed successfully. Aug 03 08:32:35 devstack cinder-volume[88899]: DEBUG cinder.volume.flows.manager.create_volume [None req-460c66c3-bfe2-4e50-9c53-2e865554d67b tempest-VolumesTransfersV357Test-1343325150 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88899) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 08:32:36 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-460c66c3-bfe2-4e50-9c53-2e865554d67b tempest-VolumesTransfersV357Test-1343325150 None] Flow 'volume_create_manager' (63f7d106-6a74-42bf-aeed-7041ecec0804) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:32:36 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-460c66c3-bfe2-4e50-9c53-2e865554d67b tempest-VolumesTransfersV357Test-1343325150 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b6abb07-a4fa-4333-a93c-9a749952fef1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:32:36 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-460c66c3-bfe2-4e50-9c53-2e865554d67b tempest-VolumesTransfersV357Test-1343325150 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b6abb07-a4fa-4333-a93c-9a749952fef1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:32:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-474954295',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d29152d-8a09-4857-990d-35e811e2ad04,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='62ac6855788b4ca98d91573b45765113',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:32:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:32:36Z,use_quota=True,user_id='89aa9127f5c14eee9d0b59dcbd21caa1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8bde7129-1dc4-42ab-b852-ab32c61b4921),volume_type_id=8bde7129-1dc4-42ab-b852-ab32c61b4921)' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:32:36 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-460c66c3-bfe2-4e50-9c53-2e865554d67b tempest-VolumesTransfersV357Test-1343325150 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a6fed90-2847-4c6d-b6df-444c0d9edb39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:32:36 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-460c66c3-bfe2-4e50-9c53-2e865554d67b tempest-VolumesTransfersV357Test-1343325150 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a6fed90-2847-4c6d-b6df-444c0d9edb39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:32:36 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-460c66c3-bfe2-4e50-9c53-2e865554d67b tempest-VolumesTransfersV357Test-1343325150 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (64cf0ef7-9dc7-47be-9402-359d18e579a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:32:36 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-460c66c3-bfe2-4e50-9c53-2e865554d67b tempest-VolumesTransfersV357Test-1343325150 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (64cf0ef7-9dc7-47be-9402-359d18e579a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7d29152d-8a09-4857-990d-35e811e2ad04', 'volume_name': 'volume-7d29152d-8a09-4857-990d-35e811e2ad04', 'volume_size': 1}' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:32:36 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-460c66c3-bfe2-4e50-9c53-2e865554d67b tempest-VolumesTransfersV357Test-1343325150 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eedebcbc-8054-4329-b48d-1f79d4a3859b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:32:36 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-460c66c3-bfe2-4e50-9c53-2e865554d67b tempest-VolumesTransfersV357Test-1343325150 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eedebcbc-8054-4329-b48d-1f79d4a3859b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:32:36 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-460c66c3-bfe2-4e50-9c53-2e865554d67b tempest-VolumesTransfersV357Test-1343325150 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4bea546-546c-4339-a247-e9882b9ee1c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:32:36 devstack cinder-volume[88899]: INFO cinder.volume.flows.manager.create_volume [None req-460c66c3-bfe2-4e50-9c53-2e865554d67b tempest-VolumesTransfersV357Test-1343325150 None] Volume 7d29152d-8a09-4857-990d-35e811e2ad04: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7d29152d-8a09-4857-990d-35e811e2ad04', 'volume_size': 1} Aug 03 08:32:36 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-460c66c3-bfe2-4e50-9c53-2e865554d67b tempest-VolumesTransfersV357Test-1343325150 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:32:36 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-460c66c3-bfe2-4e50-9c53-2e865554d67b tempest-VolumesTransfersV357Test-1343325150 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:32:36 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-460c66c3-bfe2-4e50-9c53-2e865554d67b tempest-VolumesTransfersV357Test-1343325150 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:32:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-474954295',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d29152d-8a09-4857-990d-35e811e2ad04,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='62ac6855788b4ca98d91573b45765113',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:32:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:32:36Z,use_quota=True,user_id='89aa9127f5c14eee9d0b59dcbd21caa1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8bde7129-1dc4-42ab-b852-ab32c61b4921),volume_type_id=8bde7129-1dc4-42ab-b852-ab32c61b4921)}" {{(pid=88899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 08:32:36 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-460c66c3-bfe2-4e50-9c53-2e865554d67b tempest-VolumesTransfersV357Test-1343325150 None] Creating volume 7d29152d-8a09-4857-990d-35e811e2ad04 {{(pid=88899) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 08:32:36 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-460c66c3-bfe2-4e50-9c53-2e865554d67b tempest-VolumesTransfersV357Test-1343325150 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:32:36 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-460c66c3-bfe2-4e50-9c53-2e865554d67b tempest-VolumesTransfersV357Test-1343325150 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:32:36 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-460c66c3-bfe2-4e50-9c53-2e865554d67b tempest-VolumesTransfersV357Test-1343325150 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:32:36 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-460c66c3-bfe2-4e50-9c53-2e865554d67b tempest-VolumesTransfersV357Test-1343325150 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:32:36 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-460c66c3-bfe2-4e50-9c53-2e865554d67b tempest-VolumesTransfersV357Test-1343325150 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:32:36 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-460c66c3-bfe2-4e50-9c53-2e865554d67b tempest-VolumesTransfersV357Test-1343325150 None] Selected osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385 as target Quobyte volume. {{(pid=88899) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 08:32:36 devstack cinder-volume[88899]: INFO cinder.volume.drivers.remotefs [None req-460c66c3-bfe2-4e50-9c53-2e865554d67b tempest-VolumesTransfersV357Test-1343325150 None] casted to osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385 Aug 03 08:32:36 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-460c66c3-bfe2-4e50-9c53-2e865554d67b tempest-VolumesTransfersV357Test-1343325150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-7d29152d-8a09-4857-990d-35e811e2ad04 1073741824 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:32:36 devstack sudo[94149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-7d29152d-8a09-4857-990d-35e811e2ad04 1073741824 Aug 03 08:32:36 devstack sudo[94149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:32:36 devstack sudo[94149]: pam_unix(sudo:session): session closed for user root Aug 03 08:32:36 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-460c66c3-bfe2-4e50-9c53-2e865554d67b tempest-VolumesTransfersV357Test-1343325150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-7d29152d-8a09-4857-990d-35e811e2ad04 1073741824" returned: 0 in 0.812s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:32:37 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-460c66c3-bfe2-4e50-9c53-2e865554d67b tempest-VolumesTransfersV357Test-1343325150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-7d29152d-8a09-4857-990d-35e811e2ad04 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:32:37 devstack sudo[94159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-7d29152d-8a09-4857-990d-35e811e2ad04 Aug 03 08:32:37 devstack sudo[94159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:32:37 devstack sudo[94159]: pam_unix(sudo:session): session closed for user root Aug 03 08:32:37 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-460c66c3-bfe2-4e50-9c53-2e865554d67b tempest-VolumesTransfersV357Test-1343325150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-7d29152d-8a09-4857-990d-35e811e2ad04" returned: 0 in 0.506s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:32:37 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-460c66c3-bfe2-4e50-9c53-2e865554d67b tempest-VolumesTransfersV357Test-1343325150 None] <== create_volume: return (1426ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'} {{(pid=88899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 08:32:37 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-460c66c3-bfe2-4e50-9c53-2e865554d67b tempest-VolumesTransfersV357Test-1343325150 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.433s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:32:37 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-460c66c3-bfe2-4e50-9c53-2e865554d67b tempest-VolumesTransfersV357Test-1343325150 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4bea546-546c-4339-a247-e9882b9ee1c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7d29152d-8a09-4857-990d-35e811e2ad04', 'volume_size': 1}' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:32:37 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-460c66c3-bfe2-4e50-9c53-2e865554d67b tempest-VolumesTransfersV357Test-1343325150 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (908d706e-67c8-4cc5-b271-9c98444f1613) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:32:37 devstack cinder-volume[88899]: INFO cinder.volume.flows.manager.create_volume [None req-460c66c3-bfe2-4e50-9c53-2e865554d67b tempest-VolumesTransfersV357Test-1343325150 None] Volume volume-7d29152d-8a09-4857-990d-35e811e2ad04 (7d29152d-8a09-4857-990d-35e811e2ad04): created successfully Aug 03 08:32:37 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-460c66c3-bfe2-4e50-9c53-2e865554d67b tempest-VolumesTransfersV357Test-1343325150 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (908d706e-67c8-4cc5-b271-9c98444f1613) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:32:37 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-460c66c3-bfe2-4e50-9c53-2e865554d67b tempest-VolumesTransfersV357Test-1343325150 None] Flow 'volume_create_manager' (63f7d106-6a74-42bf-aeed-7041ecec0804) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:32:37 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-460c66c3-bfe2-4e50-9c53-2e865554d67b tempest-VolumesTransfersV357Test-1343325150 None] Created volume successfully. Aug 03 08:32:38 devstack cinder-volume[88899]: INFO cinder.volume.manager [req-e37b43c4-980e-4d45-8877-ced001798115 req-9538bea1-1540-40dc-b7da-6f49d4ca89ad tempest-AttachVolumeTestJSON-774804622 None] Terminate volume connection completed successfully. Aug 03 08:32:38 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [req-e37b43c4-980e-4d45-8877-ced001798115 req-9538bea1-1540-40dc-b7da-6f49d4ca89ad tempest-AttachVolumeTestJSON-774804622 None] Deleting attachment 3d272287-68d0-45b7-8b80-b9157a3beb13. {{(pid=88899) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 03 08:32:38 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-5225dabb-34a1-4b35-b582-e93afbb64e53 tempest-VolumesTransfersV357Test-1357491500 None] Acquiring lock "cinder-7d29152d-8a09-4857-990d-35e811e2ad04-delete_volume" by "delete_volume" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:32:38 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-5225dabb-34a1-4b35-b582-e93afbb64e53 tempest-VolumesTransfersV357Test-1357491500 None] Lock "cinder-7d29152d-8a09-4857-990d-35e811e2ad04-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:32:38 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-5225dabb-34a1-4b35-b582-e93afbb64e53 tempest-VolumesTransfersV357Test-1357491500 None] Acquiring lock "cinder-quobyte-7d29152d-8a09-4857-990d-35e811e2ad04" by "delete_volume" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:32:38 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-5225dabb-34a1-4b35-b582-e93afbb64e53 tempest-VolumesTransfersV357Test-1357491500 None] Lock "cinder-quobyte-7d29152d-8a09-4857-990d-35e811e2ad04" acquired by "delete_volume" :: waited 0.029s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:32:38 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[3304b874-60d8-43f1-81c3-f70adbcfdcd2]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:32:38 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-5225dabb-34a1-4b35-b582-e93afbb64e53 tempest-VolumesTransfersV357Test-1357491500 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-7d29152d-8a09-4857-990d-35e811e2ad04 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:32:38 devstack sudo[94170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-7d29152d-8a09-4857-990d-35e811e2ad04 Aug 03 08:32:38 devstack sudo[94170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:32:39 devstack sudo[94170]: pam_unix(sudo:session): session closed for user root Aug 03 08:32:39 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-5225dabb-34a1-4b35-b582-e93afbb64e53 tempest-VolumesTransfersV357Test-1357491500 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-7d29152d-8a09-4857-990d-35e811e2ad04" returned: 0 in 0.506s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:32:39 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-5225dabb-34a1-4b35-b582-e93afbb64e53 tempest-VolumesTransfersV357Test-1357491500 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-7d29152d-8a09-4857-990d-35e811e2ad04 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:32:39 devstack sudo[94208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-7d29152d-8a09-4857-990d-35e811e2ad04 Aug 03 08:32:39 devstack sudo[94208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:32:39 devstack sudo[94208]: pam_unix(sudo:session): session closed for user root Aug 03 08:32:39 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-5225dabb-34a1-4b35-b582-e93afbb64e53 tempest-VolumesTransfersV357Test-1357491500 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-7d29152d-8a09-4857-990d-35e811e2ad04" returned: 0 in 0.324s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:32:39 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-5225dabb-34a1-4b35-b582-e93afbb64e53 tempest-VolumesTransfersV357Test-1357491500 None] Lock "cinder-quobyte-7d29152d-8a09-4857-990d-35e811e2ad04" released by "delete_volume" :: held 0.894s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:32:39 devstack cinder-volume[88899]: DEBUG cinder.quota [None req-5225dabb-34a1-4b35-b582-e93afbb64e53 tempest-VolumesTransfersV357Test-1357491500 None] Created reservations ['4c3080ee-5c6e-4755-8183-aa1d174b0dc9', 'ab0bcf8e-dfed-44b1-82eb-52192a222533', '3adee2e2-6c23-4560-8079-487be6f741b4', 'd1376b1a-7e55-4be7-9d12-6b3b0337a0e2'] {{(pid=88899) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 08:32:39 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-5225dabb-34a1-4b35-b582-e93afbb64e53 tempest-VolumesTransfersV357Test-1357491500 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:32:39 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-5225dabb-34a1-4b35-b582-e93afbb64e53 tempest-VolumesTransfersV357Test-1357491500 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:32:39 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-5225dabb-34a1-4b35-b582-e93afbb64e53 tempest-VolumesTransfersV357Test-1357491500 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:32:39 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-5225dabb-34a1-4b35-b582-e93afbb64e53 tempest-VolumesTransfersV357Test-1357491500 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:32:39 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-5225dabb-34a1-4b35-b582-e93afbb64e53 tempest-VolumesTransfersV357Test-1357491500 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:32:39 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-5225dabb-34a1-4b35-b582-e93afbb64e53 tempest-VolumesTransfersV357Test-1357491500 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:32:39 devstack sudo[94211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a Aug 03 08:32:39 devstack sudo[94211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:32:40 devstack sudo[94211]: pam_unix(sudo:session): session closed for user root Aug 03 08:32:40 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-5225dabb-34a1-4b35-b582-e93afbb64e53 tempest-VolumesTransfersV357Test-1357491500 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a" returned: 0 in 0.336s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:32:40 devstack cinder-volume[88899]: DEBUG cinder.manager [None req-5225dabb-34a1-4b35-b582-e93afbb64e53 tempest-VolumesTransfersV357Test-1357491500 None] Notifying Schedulers of capabilities ... {{(pid=88899) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 08:32:40 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-5225dabb-34a1-4b35-b582-e93afbb64e53 tempest-VolumesTransfersV357Test-1357491500 None] Deleted volume successfully. Aug 03 08:32:40 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-5225dabb-34a1-4b35-b582-e93afbb64e53 tempest-VolumesTransfersV357Test-1357491500 None] Lock "cinder-7d29152d-8a09-4857-990d-35e811e2ad04-delete_volume" released by "delete_volume" :: held 1.590s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:32:40 devstack cinder-volume[88899]: INFO cinder.volume.manager [req-855aa076-72a8-4ff4-b92f-3db4c53410a8 req-95d7c62f-4eb4-45bc-8e56-ce299f111da1 tempest-AttachVolumeTestJSON-774804622 None] Terminate volume connection completed successfully. Aug 03 08:32:40 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [req-855aa076-72a8-4ff4-b92f-3db4c53410a8 req-95d7c62f-4eb4-45bc-8e56-ce299f111da1 tempest-AttachVolumeTestJSON-774804622 None] Deleting attachment c15ea986-7eb2-4450-a469-d067d366f8ea. {{(pid=88899) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 03 08:32:47 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-0508c793-17ce-473e-a67b-8b4db8f20846 tempest-AttachVolumeTestJSON-774804622 None] Acquiring lock "cinder-bbac0152-199f-4455-a58f-99b701050820-delete_volume" by "delete_volume" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:32:47 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-0508c793-17ce-473e-a67b-8b4db8f20846 tempest-AttachVolumeTestJSON-774804622 None] Lock "cinder-bbac0152-199f-4455-a58f-99b701050820-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:32:47 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-0508c793-17ce-473e-a67b-8b4db8f20846 tempest-AttachVolumeTestJSON-774804622 None] Acquiring lock "cinder-quobyte-bbac0152-199f-4455-a58f-99b701050820" by "delete_volume" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:32:47 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-0508c793-17ce-473e-a67b-8b4db8f20846 tempest-AttachVolumeTestJSON-774804622 None] Lock "cinder-quobyte-bbac0152-199f-4455-a58f-99b701050820" acquired by "delete_volume" :: waited 0.030s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:32:47 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a470ac4-7842-4d37-b870-62214f3a4568]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:32:47 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-0508c793-17ce-473e-a67b-8b4db8f20846 tempest-AttachVolumeTestJSON-774804622 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-bbac0152-199f-4455-a58f-99b701050820 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:32:47 devstack sudo[94284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-bbac0152-199f-4455-a58f-99b701050820 Aug 03 08:32:47 devstack sudo[94284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:32:48 devstack sudo[94284]: pam_unix(sudo:session): session closed for user root Aug 03 08:32:48 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-0508c793-17ce-473e-a67b-8b4db8f20846 tempest-AttachVolumeTestJSON-774804622 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-bbac0152-199f-4455-a58f-99b701050820" returned: 0 in 0.472s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:32:48 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-0508c793-17ce-473e-a67b-8b4db8f20846 tempest-AttachVolumeTestJSON-774804622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-bbac0152-199f-4455-a58f-99b701050820 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:32:48 devstack sudo[94294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-bbac0152-199f-4455-a58f-99b701050820 Aug 03 08:32:48 devstack sudo[94294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:32:48 devstack sudo[94294]: pam_unix(sudo:session): session closed for user root Aug 03 08:32:48 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-0508c793-17ce-473e-a67b-8b4db8f20846 tempest-AttachVolumeTestJSON-774804622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-bbac0152-199f-4455-a58f-99b701050820" returned: 0 in 0.340s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:32:48 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-0508c793-17ce-473e-a67b-8b4db8f20846 tempest-AttachVolumeTestJSON-774804622 None] Lock "cinder-quobyte-bbac0152-199f-4455-a58f-99b701050820" released by "delete_volume" :: held 0.860s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:32:48 devstack cinder-volume[88899]: DEBUG cinder.quota [None req-0508c793-17ce-473e-a67b-8b4db8f20846 tempest-AttachVolumeTestJSON-774804622 None] Created reservations ['108be159-13f0-415b-9db8-23453c13911d', 'c22518b3-a757-4073-a9c2-672260520fd5', '249e6bd6-b75e-4166-9d20-1b49b44a9291', '9f7e5391-194c-45a9-9289-bbde47714657'] {{(pid=88899) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 08:32:48 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-0508c793-17ce-473e-a67b-8b4db8f20846 tempest-AttachVolumeTestJSON-774804622 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:32:48 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-0508c793-17ce-473e-a67b-8b4db8f20846 tempest-AttachVolumeTestJSON-774804622 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:32:48 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-0508c793-17ce-473e-a67b-8b4db8f20846 tempest-AttachVolumeTestJSON-774804622 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:32:48 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-0508c793-17ce-473e-a67b-8b4db8f20846 tempest-AttachVolumeTestJSON-774804622 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:32:48 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-0508c793-17ce-473e-a67b-8b4db8f20846 tempest-AttachVolumeTestJSON-774804622 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:32:48 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-0508c793-17ce-473e-a67b-8b4db8f20846 tempest-AttachVolumeTestJSON-774804622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:32:48 devstack sudo[94303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a Aug 03 08:32:48 devstack sudo[94303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:32:48 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-a517dbe6-28b8-4a71-bf1d-9b560c768670 tempest-AttachVolumeTestJSON-774804622 None] Acquiring lock "cinder-d35f484a-dcf6-4fc7-91aa-0c28ed75c028-delete_volume" by "delete_volume" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:32:48 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-a517dbe6-28b8-4a71-bf1d-9b560c768670 tempest-AttachVolumeTestJSON-774804622 None] Lock "cinder-d35f484a-dcf6-4fc7-91aa-0c28ed75c028-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:32:48 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-a517dbe6-28b8-4a71-bf1d-9b560c768670 tempest-AttachVolumeTestJSON-774804622 None] Acquiring lock "cinder-quobyte-d35f484a-dcf6-4fc7-91aa-0c28ed75c028" by "delete_volume" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:32:48 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-a517dbe6-28b8-4a71-bf1d-9b560c768670 tempest-AttachVolumeTestJSON-774804622 None] Lock "cinder-quobyte-d35f484a-dcf6-4fc7-91aa-0c28ed75c028" acquired by "delete_volume" :: waited 0.028s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:32:48 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca50d4ff-acb5-4cb0-8958-bf3c36e835d5]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:32:48 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-a517dbe6-28b8-4a71-bf1d-9b560c768670 tempest-AttachVolumeTestJSON-774804622 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-d35f484a-dcf6-4fc7-91aa-0c28ed75c028 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:32:48 devstack cinder-volume[88899]: DEBUG cinder.volume.flows.manager.create_volume [None req-f18a4c25-d920-4248-b3c5-01cd7d0cd4a5 tempest-VolumesCloneNegativeTest-1233138324 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88899) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 08:32:49 devstack sudo[94303]: pam_unix(sudo:session): session closed for user root Aug 03 08:32:49 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-f18a4c25-d920-4248-b3c5-01cd7d0cd4a5 tempest-VolumesCloneNegativeTest-1233138324 None] Flow 'volume_create_manager' (f7d5e354-ca4c-4c68-a3f0-c364c6a58b8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:32:49 devstack sudo[94307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-d35f484a-dcf6-4fc7-91aa-0c28ed75c028 Aug 03 08:32:49 devstack sudo[94307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:32:49 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-f18a4c25-d920-4248-b3c5-01cd7d0cd4a5 tempest-VolumesCloneNegativeTest-1233138324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (564be841-3b17-40d9-b487-7c7061b43164) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:32:49 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-0508c793-17ce-473e-a67b-8b4db8f20846 tempest-AttachVolumeTestJSON-774804622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a" returned: 0 in 0.415s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:32:49 devstack cinder-volume[88899]: DEBUG cinder.manager [None req-0508c793-17ce-473e-a67b-8b4db8f20846 tempest-AttachVolumeTestJSON-774804622 None] Notifying Schedulers of capabilities ... {{(pid=88899) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 08:32:49 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-f18a4c25-d920-4248-b3c5-01cd7d0cd4a5 tempest-VolumesCloneNegativeTest-1233138324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (564be841-3b17-40d9-b487-7c7061b43164) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:32:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1912229328',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f83ce69c-c2b4-472a-b55d-5f2a1613631a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='40a2360db67b4562aaa0d7397539ac98',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:32:49Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:32:49Z,use_quota=True,user_id='0592d8c6e0024b63a96bfc167984dea5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8bde7129-1dc4-42ab-b852-ab32c61b4921),volume_type_id=8bde7129-1dc4-42ab-b852-ab32c61b4921)' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:32:49 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-f18a4c25-d920-4248-b3c5-01cd7d0cd4a5 tempest-VolumesCloneNegativeTest-1233138324 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80c40aae-7ea3-4947-8e4e-43766fe490b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:32:49 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-f18a4c25-d920-4248-b3c5-01cd7d0cd4a5 tempest-VolumesCloneNegativeTest-1233138324 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80c40aae-7ea3-4947-8e4e-43766fe490b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:32:49 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-f18a4c25-d920-4248-b3c5-01cd7d0cd4a5 tempest-VolumesCloneNegativeTest-1233138324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dedef810-75d9-449d-85ed-ae9c80865df2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:32:49 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-f18a4c25-d920-4248-b3c5-01cd7d0cd4a5 tempest-VolumesCloneNegativeTest-1233138324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dedef810-75d9-449d-85ed-ae9c80865df2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f83ce69c-c2b4-472a-b55d-5f2a1613631a', 'volume_name': 'volume-f83ce69c-c2b4-472a-b55d-5f2a1613631a', 'volume_size': 2}' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:32:49 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-f18a4c25-d920-4248-b3c5-01cd7d0cd4a5 tempest-VolumesCloneNegativeTest-1233138324 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b646624f-06ee-4d01-88ca-3b5e7dc25fdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:32:49 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-f18a4c25-d920-4248-b3c5-01cd7d0cd4a5 tempest-VolumesCloneNegativeTest-1233138324 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b646624f-06ee-4d01-88ca-3b5e7dc25fdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:32:49 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-f18a4c25-d920-4248-b3c5-01cd7d0cd4a5 tempest-VolumesCloneNegativeTest-1233138324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (866094d7-b203-487c-b70b-7c37534bdcce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:32:49 devstack cinder-volume[88899]: INFO cinder.volume.flows.manager.create_volume [None req-f18a4c25-d920-4248-b3c5-01cd7d0cd4a5 tempest-VolumesCloneNegativeTest-1233138324 None] Volume f83ce69c-c2b4-472a-b55d-5f2a1613631a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f83ce69c-c2b4-472a-b55d-5f2a1613631a', 'volume_size': 2} Aug 03 08:32:49 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-f18a4c25-d920-4248-b3c5-01cd7d0cd4a5 tempest-VolumesCloneNegativeTest-1233138324 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:32:49 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-f18a4c25-d920-4248-b3c5-01cd7d0cd4a5 tempest-VolumesCloneNegativeTest-1233138324 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:32:49 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-f18a4c25-d920-4248-b3c5-01cd7d0cd4a5 tempest-VolumesCloneNegativeTest-1233138324 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:32:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1912229328',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f83ce69c-c2b4-472a-b55d-5f2a1613631a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='40a2360db67b4562aaa0d7397539ac98',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:32:49Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:32:49Z,use_quota=True,user_id='0592d8c6e0024b63a96bfc167984dea5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8bde7129-1dc4-42ab-b852-ab32c61b4921),volume_type_id=8bde7129-1dc4-42ab-b852-ab32c61b4921)}" {{(pid=88899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 08:32:49 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-f18a4c25-d920-4248-b3c5-01cd7d0cd4a5 tempest-VolumesCloneNegativeTest-1233138324 None] Creating volume f83ce69c-c2b4-472a-b55d-5f2a1613631a {{(pid=88899) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 08:32:49 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-f18a4c25-d920-4248-b3c5-01cd7d0cd4a5 tempest-VolumesCloneNegativeTest-1233138324 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:32:49 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-f18a4c25-d920-4248-b3c5-01cd7d0cd4a5 tempest-VolumesCloneNegativeTest-1233138324 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:32:49 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-f18a4c25-d920-4248-b3c5-01cd7d0cd4a5 tempest-VolumesCloneNegativeTest-1233138324 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:32:49 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-f18a4c25-d920-4248-b3c5-01cd7d0cd4a5 tempest-VolumesCloneNegativeTest-1233138324 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:32:49 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-f18a4c25-d920-4248-b3c5-01cd7d0cd4a5 tempest-VolumesCloneNegativeTest-1233138324 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:32:49 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-f18a4c25-d920-4248-b3c5-01cd7d0cd4a5 tempest-VolumesCloneNegativeTest-1233138324 None] Selected osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385 as target Quobyte volume. {{(pid=88899) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 08:32:49 devstack cinder-volume[88899]: INFO cinder.volume.drivers.remotefs [None req-f18a4c25-d920-4248-b3c5-01cd7d0cd4a5 tempest-VolumesCloneNegativeTest-1233138324 None] casted to osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385 Aug 03 08:32:49 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-f18a4c25-d920-4248-b3c5-01cd7d0cd4a5 tempest-VolumesCloneNegativeTest-1233138324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-f83ce69c-c2b4-472a-b55d-5f2a1613631a 2147483648 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:32:49 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-0508c793-17ce-473e-a67b-8b4db8f20846 tempest-AttachVolumeTestJSON-774804622 None] Deleted volume successfully. Aug 03 08:32:49 devstack sudo[94310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-f83ce69c-c2b4-472a-b55d-5f2a1613631a 2147483648 Aug 03 08:32:49 devstack sudo[94310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:32:49 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-0508c793-17ce-473e-a67b-8b4db8f20846 tempest-AttachVolumeTestJSON-774804622 None] Lock "cinder-bbac0152-199f-4455-a58f-99b701050820-delete_volume" released by "delete_volume" :: held 1.627s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:32:49 devstack sudo[94307]: pam_unix(sudo:session): session closed for user root Aug 03 08:32:49 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-a517dbe6-28b8-4a71-bf1d-9b560c768670 tempest-AttachVolumeTestJSON-774804622 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-d35f484a-dcf6-4fc7-91aa-0c28ed75c028" returned: 0 in 0.437s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:32:49 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-a517dbe6-28b8-4a71-bf1d-9b560c768670 tempest-AttachVolumeTestJSON-774804622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-d35f484a-dcf6-4fc7-91aa-0c28ed75c028 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:32:49 devstack sudo[94315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-d35f484a-dcf6-4fc7-91aa-0c28ed75c028 Aug 03 08:32:49 devstack sudo[94315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:32:49 devstack sudo[94315]: pam_unix(sudo:session): session closed for user root Aug 03 08:32:49 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-a517dbe6-28b8-4a71-bf1d-9b560c768670 tempest-AttachVolumeTestJSON-774804622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-d35f484a-dcf6-4fc7-91aa-0c28ed75c028" returned: 0 in 0.354s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:32:49 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-a517dbe6-28b8-4a71-bf1d-9b560c768670 tempest-AttachVolumeTestJSON-774804622 None] Lock "cinder-quobyte-d35f484a-dcf6-4fc7-91aa-0c28ed75c028" released by "delete_volume" :: held 0.854s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:32:49 devstack cinder-volume[88899]: DEBUG dbcounter [-] [88899] Writing DB stats cinder:UPDATE=82,cinder:INSERT=16,cinder:SELECT=65,cinder:DELETE=4 {{(pid=88899) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 03 08:32:49 devstack sudo[94310]: pam_unix(sudo:session): session closed for user root Aug 03 08:32:49 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-f18a4c25-d920-4248-b3c5-01cd7d0cd4a5 tempest-VolumesCloneNegativeTest-1233138324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-f83ce69c-c2b4-472a-b55d-5f2a1613631a 2147483648" returned: 0 in 0.672s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:32:49 devstack cinder-volume[88899]: DEBUG cinder.quota [None req-a517dbe6-28b8-4a71-bf1d-9b560c768670 tempest-AttachVolumeTestJSON-774804622 None] Created reservations ['38e72cab-9652-4875-b9cc-1805ccbf8ea9', '8be7a5c3-f578-4323-96bb-85b718aa194e', 'c769317e-71d1-40af-b2c6-8f43d61278af', '9dc852ae-b48a-4e38-ae70-3f80ee025f1c'] {{(pid=88899) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 08:32:49 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-f18a4c25-d920-4248-b3c5-01cd7d0cd4a5 tempest-VolumesCloneNegativeTest-1233138324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-f83ce69c-c2b4-472a-b55d-5f2a1613631a {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:32:49 devstack sudo[94341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-f83ce69c-c2b4-472a-b55d-5f2a1613631a Aug 03 08:32:49 devstack sudo[94341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:32:50 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-a517dbe6-28b8-4a71-bf1d-9b560c768670 tempest-AttachVolumeTestJSON-774804622 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:32:50 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-a517dbe6-28b8-4a71-bf1d-9b560c768670 tempest-AttachVolumeTestJSON-774804622 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:32:50 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-a517dbe6-28b8-4a71-bf1d-9b560c768670 tempest-AttachVolumeTestJSON-774804622 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:32:50 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-a517dbe6-28b8-4a71-bf1d-9b560c768670 tempest-AttachVolumeTestJSON-774804622 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:32:50 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-a517dbe6-28b8-4a71-bf1d-9b560c768670 tempest-AttachVolumeTestJSON-774804622 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.069s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:32:50 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-a517dbe6-28b8-4a71-bf1d-9b560c768670 tempest-AttachVolumeTestJSON-774804622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:32:50 devstack sudo[94372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a Aug 03 08:32:50 devstack sudo[94372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:32:50 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-646c38db-2b6e-421d-92e1-ac340516ddc5 tempest-AttachVolumeTestJSON-774804622 None] Acquiring lock "cinder-27ad7c1f-d740-4d19-b5ef-e0f8f84745ba-delete_volume" by "delete_volume" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:32:50 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-646c38db-2b6e-421d-92e1-ac340516ddc5 tempest-AttachVolumeTestJSON-774804622 None] Lock "cinder-27ad7c1f-d740-4d19-b5ef-e0f8f84745ba-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:32:50 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-646c38db-2b6e-421d-92e1-ac340516ddc5 tempest-AttachVolumeTestJSON-774804622 None] Acquiring lock "cinder-quobyte-27ad7c1f-d740-4d19-b5ef-e0f8f84745ba" by "delete_volume" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:32:50 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-646c38db-2b6e-421d-92e1-ac340516ddc5 tempest-AttachVolumeTestJSON-774804622 None] Lock "cinder-quobyte-27ad7c1f-d740-4d19-b5ef-e0f8f84745ba" acquired by "delete_volume" :: waited 0.031s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:32:50 devstack sudo[94341]: pam_unix(sudo:session): session closed for user root Aug 03 08:32:50 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-f18a4c25-d920-4248-b3c5-01cd7d0cd4a5 tempest-VolumesCloneNegativeTest-1233138324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-f83ce69c-c2b4-472a-b55d-5f2a1613631a" returned: 0 in 0.697s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:32:50 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-f18a4c25-d920-4248-b3c5-01cd7d0cd4a5 tempest-VolumesCloneNegativeTest-1233138324 None] <== create_volume: return (1443ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'} {{(pid=88899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 08:32:50 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-f18a4c25-d920-4248-b3c5-01cd7d0cd4a5 tempest-VolumesCloneNegativeTest-1233138324 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.445s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:32:50 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[dda4e4d5-cb9d-4a0b-8eae-787b9da93132]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:32:50 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-646c38db-2b6e-421d-92e1-ac340516ddc5 tempest-AttachVolumeTestJSON-774804622 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-27ad7c1f-d740-4d19-b5ef-e0f8f84745ba {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:32:50 devstack sudo[94372]: pam_unix(sudo:session): session closed for user root Aug 03 08:32:50 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-f18a4c25-d920-4248-b3c5-01cd7d0cd4a5 tempest-VolumesCloneNegativeTest-1233138324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (866094d7-b203-487c-b70b-7c37534bdcce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f83ce69c-c2b4-472a-b55d-5f2a1613631a', 'volume_size': 2}' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:32:50 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-f18a4c25-d920-4248-b3c5-01cd7d0cd4a5 tempest-VolumesCloneNegativeTest-1233138324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b0e6f786-7feb-4fc3-ac49-35606e3e1214) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:32:50 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-a517dbe6-28b8-4a71-bf1d-9b560c768670 tempest-AttachVolumeTestJSON-774804622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a" returned: 0 in 0.546s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:32:50 devstack cinder-volume[88899]: DEBUG cinder.manager [None req-a517dbe6-28b8-4a71-bf1d-9b560c768670 tempest-AttachVolumeTestJSON-774804622 None] Notifying Schedulers of capabilities ... {{(pid=88899) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 08:32:50 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-a517dbe6-28b8-4a71-bf1d-9b560c768670 tempest-AttachVolumeTestJSON-774804622 None] Deleted volume successfully. Aug 03 08:32:50 devstack cinder-volume[88899]: INFO cinder.volume.flows.manager.create_volume [None req-f18a4c25-d920-4248-b3c5-01cd7d0cd4a5 tempest-VolumesCloneNegativeTest-1233138324 None] Volume volume-f83ce69c-c2b4-472a-b55d-5f2a1613631a (f83ce69c-c2b4-472a-b55d-5f2a1613631a): created successfully Aug 03 08:32:50 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-f18a4c25-d920-4248-b3c5-01cd7d0cd4a5 tempest-VolumesCloneNegativeTest-1233138324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b0e6f786-7feb-4fc3-ac49-35606e3e1214) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:32:50 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-f18a4c25-d920-4248-b3c5-01cd7d0cd4a5 tempest-VolumesCloneNegativeTest-1233138324 None] Flow 'volume_create_manager' (f7d5e354-ca4c-4c68-a3f0-c364c6a58b8e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:32:50 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-f18a4c25-d920-4248-b3c5-01cd7d0cd4a5 tempest-VolumesCloneNegativeTest-1233138324 None] Created volume successfully. Aug 03 08:32:50 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-a517dbe6-28b8-4a71-bf1d-9b560c768670 tempest-AttachVolumeTestJSON-774804622 None] Lock "cinder-d35f484a-dcf6-4fc7-91aa-0c28ed75c028-delete_volume" released by "delete_volume" :: held 1.948s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:32:50 devstack sudo[94392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-27ad7c1f-d740-4d19-b5ef-e0f8f84745ba Aug 03 08:32:50 devstack sudo[94392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:32:51 devstack sudo[94392]: pam_unix(sudo:session): session closed for user root Aug 03 08:32:51 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-646c38db-2b6e-421d-92e1-ac340516ddc5 tempest-AttachVolumeTestJSON-774804622 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-27ad7c1f-d740-4d19-b5ef-e0f8f84745ba" returned: 0 in 0.543s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:32:51 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-646c38db-2b6e-421d-92e1-ac340516ddc5 tempest-AttachVolumeTestJSON-774804622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-27ad7c1f-d740-4d19-b5ef-e0f8f84745ba {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:32:51 devstack sudo[94398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-27ad7c1f-d740-4d19-b5ef-e0f8f84745ba Aug 03 08:32:51 devstack sudo[94398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:32:51 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-7934e891-61bf-483c-b233-f997ce70a023 tempest-VolumesCloneNegativeTest-1233138324 None] Acquiring lock "cinder-f83ce69c-c2b4-472a-b55d-5f2a1613631a-delete_volume" by "delete_volume" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:32:51 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-7934e891-61bf-483c-b233-f997ce70a023 tempest-VolumesCloneNegativeTest-1233138324 None] Lock "cinder-f83ce69c-c2b4-472a-b55d-5f2a1613631a-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:32:51 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-7934e891-61bf-483c-b233-f997ce70a023 tempest-VolumesCloneNegativeTest-1233138324 None] Acquiring lock "cinder-quobyte-f83ce69c-c2b4-472a-b55d-5f2a1613631a" by "delete_volume" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:32:51 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-7934e891-61bf-483c-b233-f997ce70a023 tempest-VolumesCloneNegativeTest-1233138324 None] Lock "cinder-quobyte-f83ce69c-c2b4-472a-b55d-5f2a1613631a" acquired by "delete_volume" :: waited 0.053s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:32:51 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[b19be667-535c-48bd-bc71-2470ebeb8b59]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:32:51 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-7934e891-61bf-483c-b233-f997ce70a023 tempest-VolumesCloneNegativeTest-1233138324 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-f83ce69c-c2b4-472a-b55d-5f2a1613631a {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:32:51 devstack sudo[94398]: pam_unix(sudo:session): session closed for user root Aug 03 08:32:51 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-646c38db-2b6e-421d-92e1-ac340516ddc5 tempest-AttachVolumeTestJSON-774804622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-27ad7c1f-d740-4d19-b5ef-e0f8f84745ba" returned: 0 in 0.435s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:32:51 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-646c38db-2b6e-421d-92e1-ac340516ddc5 tempest-AttachVolumeTestJSON-774804622 None] Lock "cinder-quobyte-27ad7c1f-d740-4d19-b5ef-e0f8f84745ba" released by "delete_volume" :: held 1.073s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:32:51 devstack cinder-volume[88899]: DEBUG cinder.quota [None req-646c38db-2b6e-421d-92e1-ac340516ddc5 tempest-AttachVolumeTestJSON-774804622 None] Created reservations ['7bb428a7-6988-4d4d-b566-6f095a1f313a', '9b9dbd97-48e0-41f2-af65-3052fde4befb', '9af582ee-af20-4d35-9534-04687bdf6ffe', '8b2d0ae3-4e1b-49d4-b1b0-938da5017d58'] {{(pid=88899) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 08:32:51 devstack sudo[94403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-f83ce69c-c2b4-472a-b55d-5f2a1613631a Aug 03 08:32:51 devstack sudo[94403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:32:51 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-646c38db-2b6e-421d-92e1-ac340516ddc5 tempest-AttachVolumeTestJSON-774804622 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:32:51 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-646c38db-2b6e-421d-92e1-ac340516ddc5 tempest-AttachVolumeTestJSON-774804622 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:32:51 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-646c38db-2b6e-421d-92e1-ac340516ddc5 tempest-AttachVolumeTestJSON-774804622 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:32:51 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-646c38db-2b6e-421d-92e1-ac340516ddc5 tempest-AttachVolumeTestJSON-774804622 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:32:51 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-646c38db-2b6e-421d-92e1-ac340516ddc5 tempest-AttachVolumeTestJSON-774804622 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:32:51 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-646c38db-2b6e-421d-92e1-ac340516ddc5 tempest-AttachVolumeTestJSON-774804622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:32:51 devstack sudo[94405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a Aug 03 08:32:51 devstack sudo[94405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:32:51 devstack cinder-volume[88899]: DEBUG oslo_service.periodic_task [None req-f948fb4a-c4d7-499f-b1bd-8d6be3de0b53 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88899) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 03 08:32:51 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-f948fb4a-c4d7-499f-b1bd-8d6be3de0b53 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:32:51 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-f948fb4a-c4d7-499f-b1bd-8d6be3de0b53 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:32:51 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-f948fb4a-c4d7-499f-b1bd-8d6be3de0b53 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:32:51 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-f948fb4a-c4d7-499f-b1bd-8d6be3de0b53 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:32:51 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-f948fb4a-c4d7-499f-b1bd-8d6be3de0b53 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:32:51 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-f948fb4a-c4d7-499f-b1bd-8d6be3de0b53 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:32:51 devstack sudo[94407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a Aug 03 08:32:51 devstack sudo[94407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:32:52 devstack sudo[94403]: pam_unix(sudo:session): session closed for user root Aug 03 08:32:52 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-7934e891-61bf-483c-b233-f997ce70a023 tempest-VolumesCloneNegativeTest-1233138324 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-f83ce69c-c2b4-472a-b55d-5f2a1613631a" returned: 0 in 0.501s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:32:52 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-7934e891-61bf-483c-b233-f997ce70a023 tempest-VolumesCloneNegativeTest-1233138324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-f83ce69c-c2b4-472a-b55d-5f2a1613631a {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:32:52 devstack sudo[94414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-f83ce69c-c2b4-472a-b55d-5f2a1613631a Aug 03 08:32:52 devstack sudo[94414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:32:52 devstack sudo[94405]: pam_unix(sudo:session): session closed for user root Aug 03 08:32:52 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-646c38db-2b6e-421d-92e1-ac340516ddc5 tempest-AttachVolumeTestJSON-774804622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a" returned: 0 in 0.365s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:32:52 devstack cinder-volume[88899]: DEBUG cinder.manager [None req-646c38db-2b6e-421d-92e1-ac340516ddc5 tempest-AttachVolumeTestJSON-774804622 None] Notifying Schedulers of capabilities ... {{(pid=88899) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 08:32:52 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-646c38db-2b6e-421d-92e1-ac340516ddc5 tempest-AttachVolumeTestJSON-774804622 None] Deleted volume successfully. Aug 03 08:32:52 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-646c38db-2b6e-421d-92e1-ac340516ddc5 tempest-AttachVolumeTestJSON-774804622 None] Lock "cinder-27ad7c1f-d740-4d19-b5ef-e0f8f84745ba-delete_volume" released by "delete_volume" :: held 1.774s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:32:52 devstack sudo[94407]: pam_unix(sudo:session): session closed for user root Aug 03 08:32:52 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-f948fb4a-c4d7-499f-b1bd-8d6be3de0b53 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a" returned: 0 in 0.337s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:32:52 devstack cinder-volume[88899]: DEBUG cinder.manager [None req-f948fb4a-c4d7-499f-b1bd-8d6be3de0b53 None None] Notifying Schedulers of capabilities ... {{(pid=88899) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 08:32:52 devstack cinder-volume[88899]: DEBUG oslo_service.periodic_task [None req-f948fb4a-c4d7-499f-b1bd-8d6be3de0b53 None None] Running periodic task VolumeManager._thread_info {{(pid=88899) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 03 08:32:52 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-f948fb4a-c4d7-499f-b1bd-8d6be3de0b53 None None] thread count: 8 {{(pid=88899) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 03 08:32:52 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-f948fb4a-c4d7-499f-b1bd-8d6be3de0b53 None None] thread info: [<_MainThread(MainThread, started 132234320248960)>, , , , , , , ] {{(pid=88899) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 03 08:32:52 devstack sudo[94414]: pam_unix(sudo:session): session closed for user root Aug 03 08:32:52 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-7934e891-61bf-483c-b233-f997ce70a023 tempest-VolumesCloneNegativeTest-1233138324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-f83ce69c-c2b4-472a-b55d-5f2a1613631a" returned: 0 in 0.317s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:32:52 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-7934e891-61bf-483c-b233-f997ce70a023 tempest-VolumesCloneNegativeTest-1233138324 None] Lock "cinder-quobyte-f83ce69c-c2b4-472a-b55d-5f2a1613631a" released by "delete_volume" :: held 0.873s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:32:52 devstack cinder-volume[88899]: DEBUG cinder.quota [None req-7934e891-61bf-483c-b233-f997ce70a023 tempest-VolumesCloneNegativeTest-1233138324 None] Created reservations ['a1ec9b42-e1a0-40f3-812e-8d190286a9a3', '42ad52c3-35ce-4582-adb0-4b3e22b12ad9', 'a30bafd0-a59d-47fa-b8a7-d92f9ca07b3c', '282909be-f337-46f5-8948-ebf09098cdf6'] {{(pid=88899) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 08:32:52 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-7934e891-61bf-483c-b233-f997ce70a023 tempest-VolumesCloneNegativeTest-1233138324 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:32:52 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-7934e891-61bf-483c-b233-f997ce70a023 tempest-VolumesCloneNegativeTest-1233138324 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:32:52 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-7934e891-61bf-483c-b233-f997ce70a023 tempest-VolumesCloneNegativeTest-1233138324 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:32:52 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-7934e891-61bf-483c-b233-f997ce70a023 tempest-VolumesCloneNegativeTest-1233138324 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:32:52 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-7934e891-61bf-483c-b233-f997ce70a023 tempest-VolumesCloneNegativeTest-1233138324 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:32:52 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-7934e891-61bf-483c-b233-f997ce70a023 tempest-VolumesCloneNegativeTest-1233138324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:32:52 devstack sudo[94418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a Aug 03 08:32:52 devstack sudo[94418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:32:52 devstack sudo[94418]: pam_unix(sudo:session): session closed for user root Aug 03 08:32:52 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-7934e891-61bf-483c-b233-f997ce70a023 tempest-VolumesCloneNegativeTest-1233138324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a" returned: 0 in 0.288s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:32:52 devstack cinder-volume[88899]: DEBUG cinder.manager [None req-7934e891-61bf-483c-b233-f997ce70a023 tempest-VolumesCloneNegativeTest-1233138324 None] Notifying Schedulers of capabilities ... {{(pid=88899) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 08:32:52 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-7934e891-61bf-483c-b233-f997ce70a023 tempest-VolumesCloneNegativeTest-1233138324 None] Deleted volume successfully. Aug 03 08:32:52 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-7934e891-61bf-483c-b233-f997ce70a023 tempest-VolumesCloneNegativeTest-1233138324 None] Lock "cinder-f83ce69c-c2b4-472a-b55d-5f2a1613631a-delete_volume" released by "delete_volume" :: held 1.510s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:32:55 devstack cinder-volume[88899]: INFO cinder.volume.manager [req-935356b4-085f-4933-bd20-c0b8f8a7a4b0 req-3e28dab0-98f7-4667-bf37-91763fd2ca9f tempest-AttachVolumeNegativeTest-1279867800 None] Terminate volume connection completed successfully. Aug 03 08:32:55 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [req-935356b4-085f-4933-bd20-c0b8f8a7a4b0 req-3e28dab0-98f7-4667-bf37-91763fd2ca9f tempest-AttachVolumeNegativeTest-1279867800 None] Deleting attachment e6db599c-55fa-48d2-945f-bcae60ae5419. {{(pid=88899) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 03 08:32:57 devstack cinder-volume[88899]: DEBUG dbcounter [-] [88899] Writing DB stats cinder:SELECT=100,cinder:UPDATE=95,cinder:DELETE=12,cinder:INSERT=22 {{(pid=88899) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 03 08:32:57 devstack cinder-volume[88899]: DEBUG cinder.volume.flows.manager.create_volume [None req-7dcdf1f6-dd79-4c23-b895-7d24868cdb26 tempest-VolumesListTestJSON-1213495374 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88899) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 08:32:57 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-7dcdf1f6-dd79-4c23-b895-7d24868cdb26 tempest-VolumesListTestJSON-1213495374 None] Flow 'volume_create_manager' (c676f217-efb4-4b5e-b429-281b6ad93baa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:32:57 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-7dcdf1f6-dd79-4c23-b895-7d24868cdb26 tempest-VolumesListTestJSON-1213495374 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85eb8cd9-c4e0-4d00-93c5-dbe4c0feeeac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:32:57 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-7dcdf1f6-dd79-4c23-b895-7d24868cdb26 tempest-VolumesListTestJSON-1213495374 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85eb8cd9-c4e0-4d00-93c5-dbe4c0feeeac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:32:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1470171320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=79b81383-4012-4f41-99af-fbbb805b719f,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='ddbc7a9a75f04d04804075f2ec9d8a42',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:32:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:32:58Z,use_quota=True,user_id='4bc176cebeab461a87ff2f8470467b3e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8bde7129-1dc4-42ab-b852-ab32c61b4921),volume_type_id=8bde7129-1dc4-42ab-b852-ab32c61b4921)' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:32:58 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-7dcdf1f6-dd79-4c23-b895-7d24868cdb26 tempest-VolumesListTestJSON-1213495374 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1456fc80-0356-4f6d-9284-197f8e04598b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:32:58 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-7dcdf1f6-dd79-4c23-b895-7d24868cdb26 tempest-VolumesListTestJSON-1213495374 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1456fc80-0356-4f6d-9284-197f8e04598b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:32:58 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-7dcdf1f6-dd79-4c23-b895-7d24868cdb26 tempest-VolumesListTestJSON-1213495374 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e58b9f5-290d-42e0-b1f3-32f9e3050a21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:32:58 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-7dcdf1f6-dd79-4c23-b895-7d24868cdb26 tempest-VolumesListTestJSON-1213495374 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e58b9f5-290d-42e0-b1f3-32f9e3050a21) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '79b81383-4012-4f41-99af-fbbb805b719f', 'volume_name': 'volume-79b81383-4012-4f41-99af-fbbb805b719f', 'volume_size': 1}' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:32:58 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-7dcdf1f6-dd79-4c23-b895-7d24868cdb26 tempest-VolumesListTestJSON-1213495374 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5311c25f-2b22-4855-8157-b46aa27cc18a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:32:58 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-7dcdf1f6-dd79-4c23-b895-7d24868cdb26 tempest-VolumesListTestJSON-1213495374 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5311c25f-2b22-4855-8157-b46aa27cc18a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:32:58 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-7dcdf1f6-dd79-4c23-b895-7d24868cdb26 tempest-VolumesListTestJSON-1213495374 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25fc8c4a-4dba-4362-bb4c-2f9f6fd521a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:32:58 devstack cinder-volume[88899]: INFO cinder.volume.flows.manager.create_volume [None req-7dcdf1f6-dd79-4c23-b895-7d24868cdb26 tempest-VolumesListTestJSON-1213495374 None] Volume 79b81383-4012-4f41-99af-fbbb805b719f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-79b81383-4012-4f41-99af-fbbb805b719f', 'volume_size': 1} Aug 03 08:32:58 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-7dcdf1f6-dd79-4c23-b895-7d24868cdb26 tempest-VolumesListTestJSON-1213495374 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:32:58 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-7dcdf1f6-dd79-4c23-b895-7d24868cdb26 tempest-VolumesListTestJSON-1213495374 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:32:58 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-7dcdf1f6-dd79-4c23-b895-7d24868cdb26 tempest-VolumesListTestJSON-1213495374 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:32:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1470171320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=79b81383-4012-4f41-99af-fbbb805b719f,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='ddbc7a9a75f04d04804075f2ec9d8a42',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:32:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:32:58Z,use_quota=True,user_id='4bc176cebeab461a87ff2f8470467b3e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8bde7129-1dc4-42ab-b852-ab32c61b4921),volume_type_id=8bde7129-1dc4-42ab-b852-ab32c61b4921)}" {{(pid=88899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 08:32:58 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-7dcdf1f6-dd79-4c23-b895-7d24868cdb26 tempest-VolumesListTestJSON-1213495374 None] Creating volume 79b81383-4012-4f41-99af-fbbb805b719f {{(pid=88899) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 08:32:58 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-7dcdf1f6-dd79-4c23-b895-7d24868cdb26 tempest-VolumesListTestJSON-1213495374 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:32:58 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-7dcdf1f6-dd79-4c23-b895-7d24868cdb26 tempest-VolumesListTestJSON-1213495374 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:32:58 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-7dcdf1f6-dd79-4c23-b895-7d24868cdb26 tempest-VolumesListTestJSON-1213495374 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:32:58 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-7dcdf1f6-dd79-4c23-b895-7d24868cdb26 tempest-VolumesListTestJSON-1213495374 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:32:58 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-7dcdf1f6-dd79-4c23-b895-7d24868cdb26 tempest-VolumesListTestJSON-1213495374 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:32:58 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-7dcdf1f6-dd79-4c23-b895-7d24868cdb26 tempest-VolumesListTestJSON-1213495374 None] Selected osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385 as target Quobyte volume. {{(pid=88899) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 08:32:58 devstack cinder-volume[88899]: INFO cinder.volume.drivers.remotefs [None req-7dcdf1f6-dd79-4c23-b895-7d24868cdb26 tempest-VolumesListTestJSON-1213495374 None] casted to osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385 Aug 03 08:32:58 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-7dcdf1f6-dd79-4c23-b895-7d24868cdb26 tempest-VolumesListTestJSON-1213495374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-79b81383-4012-4f41-99af-fbbb805b719f 1073741824 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:32:58 devstack sudo[94456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-79b81383-4012-4f41-99af-fbbb805b719f 1073741824 Aug 03 08:32:58 devstack sudo[94456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:32:58 devstack sudo[94456]: pam_unix(sudo:session): session closed for user root Aug 03 08:32:58 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-7dcdf1f6-dd79-4c23-b895-7d24868cdb26 tempest-VolumesListTestJSON-1213495374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-79b81383-4012-4f41-99af-fbbb805b719f 1073741824" returned: 0 in 0.633s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:32:58 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-7dcdf1f6-dd79-4c23-b895-7d24868cdb26 tempest-VolumesListTestJSON-1213495374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-79b81383-4012-4f41-99af-fbbb805b719f {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:32:58 devstack sudo[94466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-79b81383-4012-4f41-99af-fbbb805b719f Aug 03 08:32:58 devstack sudo[94466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:32:59 devstack sudo[94466]: pam_unix(sudo:session): session closed for user root Aug 03 08:32:59 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-7dcdf1f6-dd79-4c23-b895-7d24868cdb26 tempest-VolumesListTestJSON-1213495374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-79b81383-4012-4f41-99af-fbbb805b719f" returned: 0 in 0.283s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:32:59 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-7dcdf1f6-dd79-4c23-b895-7d24868cdb26 tempest-VolumesListTestJSON-1213495374 None] <== create_volume: return (975ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'} {{(pid=88899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 08:32:59 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-7dcdf1f6-dd79-4c23-b895-7d24868cdb26 tempest-VolumesListTestJSON-1213495374 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.978s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:32:59 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-7dcdf1f6-dd79-4c23-b895-7d24868cdb26 tempest-VolumesListTestJSON-1213495374 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25fc8c4a-4dba-4362-bb4c-2f9f6fd521a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-79b81383-4012-4f41-99af-fbbb805b719f', 'volume_size': 1}' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:32:59 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-7dcdf1f6-dd79-4c23-b895-7d24868cdb26 tempest-VolumesListTestJSON-1213495374 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0af04ab4-aaa6-4f8a-b505-b50bd3f9759b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:32:59 devstack cinder-volume[88899]: INFO cinder.volume.flows.manager.create_volume [None req-7dcdf1f6-dd79-4c23-b895-7d24868cdb26 tempest-VolumesListTestJSON-1213495374 None] Volume volume-79b81383-4012-4f41-99af-fbbb805b719f (79b81383-4012-4f41-99af-fbbb805b719f): created successfully Aug 03 08:32:59 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-7dcdf1f6-dd79-4c23-b895-7d24868cdb26 tempest-VolumesListTestJSON-1213495374 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0af04ab4-aaa6-4f8a-b505-b50bd3f9759b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:32:59 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-7dcdf1f6-dd79-4c23-b895-7d24868cdb26 tempest-VolumesListTestJSON-1213495374 None] Flow 'volume_create_manager' (c676f217-efb4-4b5e-b429-281b6ad93baa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:32:59 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-7dcdf1f6-dd79-4c23-b895-7d24868cdb26 tempest-VolumesListTestJSON-1213495374 None] Created volume successfully. Aug 03 08:33:00 devstack cinder-volume[88899]: DEBUG cinder.volume.flows.manager.create_volume [None req-9eddb55e-1036-448c-9070-4442eecfcd10 tempest-VolumesListTestJSON-1213495374 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88899) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 08:33:00 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-9eddb55e-1036-448c-9070-4442eecfcd10 tempest-VolumesListTestJSON-1213495374 None] Flow 'volume_create_manager' (c17fd573-b6af-4204-b056-43126058a179) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:33:00 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-9eddb55e-1036-448c-9070-4442eecfcd10 tempest-VolumesListTestJSON-1213495374 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fba6aef6-0614-4879-a82b-e1241c2b6117) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:33:00 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-9eddb55e-1036-448c-9070-4442eecfcd10 tempest-VolumesListTestJSON-1213495374 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fba6aef6-0614-4879-a82b-e1241c2b6117) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:33:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1605795977',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=99adb792-b5c3-48fe-9992-8ee27a3ecc51,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='ddbc7a9a75f04d04804075f2ec9d8a42',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:33:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:33:01Z,use_quota=True,user_id='4bc176cebeab461a87ff2f8470467b3e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8bde7129-1dc4-42ab-b852-ab32c61b4921),volume_type_id=8bde7129-1dc4-42ab-b852-ab32c61b4921)' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:33:00 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-9eddb55e-1036-448c-9070-4442eecfcd10 tempest-VolumesListTestJSON-1213495374 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48a575fe-091c-4319-8e39-7621f06155d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:33:00 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-9eddb55e-1036-448c-9070-4442eecfcd10 tempest-VolumesListTestJSON-1213495374 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48a575fe-091c-4319-8e39-7621f06155d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:33:00 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-9eddb55e-1036-448c-9070-4442eecfcd10 tempest-VolumesListTestJSON-1213495374 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (faf45ac3-0c43-4ff0-a054-f2f8f8bab2b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:33:00 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-9eddb55e-1036-448c-9070-4442eecfcd10 tempest-VolumesListTestJSON-1213495374 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (faf45ac3-0c43-4ff0-a054-f2f8f8bab2b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '99adb792-b5c3-48fe-9992-8ee27a3ecc51', 'volume_name': 'volume-99adb792-b5c3-48fe-9992-8ee27a3ecc51', 'volume_size': 1}' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:33:00 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-9eddb55e-1036-448c-9070-4442eecfcd10 tempest-VolumesListTestJSON-1213495374 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (90c024e8-b980-4092-b52c-e06aeacb820c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:33:00 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-9eddb55e-1036-448c-9070-4442eecfcd10 tempest-VolumesListTestJSON-1213495374 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (90c024e8-b980-4092-b52c-e06aeacb820c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:33:00 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-9eddb55e-1036-448c-9070-4442eecfcd10 tempest-VolumesListTestJSON-1213495374 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e4235f4-52dc-4850-b412-dfd7539c307c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:33:00 devstack cinder-volume[88899]: INFO cinder.volume.flows.manager.create_volume [None req-9eddb55e-1036-448c-9070-4442eecfcd10 tempest-VolumesListTestJSON-1213495374 None] Volume 99adb792-b5c3-48fe-9992-8ee27a3ecc51: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-99adb792-b5c3-48fe-9992-8ee27a3ecc51', 'volume_size': 1} Aug 03 08:33:00 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-9eddb55e-1036-448c-9070-4442eecfcd10 tempest-VolumesListTestJSON-1213495374 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:33:00 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-9eddb55e-1036-448c-9070-4442eecfcd10 tempest-VolumesListTestJSON-1213495374 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:33:00 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-9eddb55e-1036-448c-9070-4442eecfcd10 tempest-VolumesListTestJSON-1213495374 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:33:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1605795977',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=99adb792-b5c3-48fe-9992-8ee27a3ecc51,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='ddbc7a9a75f04d04804075f2ec9d8a42',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:33:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:33:01Z,use_quota=True,user_id='4bc176cebeab461a87ff2f8470467b3e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8bde7129-1dc4-42ab-b852-ab32c61b4921),volume_type_id=8bde7129-1dc4-42ab-b852-ab32c61b4921)}" {{(pid=88899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 08:33:00 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-9eddb55e-1036-448c-9070-4442eecfcd10 tempest-VolumesListTestJSON-1213495374 None] Creating volume 99adb792-b5c3-48fe-9992-8ee27a3ecc51 {{(pid=88899) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 08:33:00 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-9eddb55e-1036-448c-9070-4442eecfcd10 tempest-VolumesListTestJSON-1213495374 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:33:00 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-9eddb55e-1036-448c-9070-4442eecfcd10 tempest-VolumesListTestJSON-1213495374 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:33:00 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-9eddb55e-1036-448c-9070-4442eecfcd10 tempest-VolumesListTestJSON-1213495374 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:33:00 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-9eddb55e-1036-448c-9070-4442eecfcd10 tempest-VolumesListTestJSON-1213495374 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:33:00 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-9eddb55e-1036-448c-9070-4442eecfcd10 tempest-VolumesListTestJSON-1213495374 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:33:00 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-9eddb55e-1036-448c-9070-4442eecfcd10 tempest-VolumesListTestJSON-1213495374 None] Selected osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385 as target Quobyte volume. {{(pid=88899) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 08:33:00 devstack cinder-volume[88899]: INFO cinder.volume.drivers.remotefs [None req-9eddb55e-1036-448c-9070-4442eecfcd10 tempest-VolumesListTestJSON-1213495374 None] casted to osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385 Aug 03 08:33:00 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-9eddb55e-1036-448c-9070-4442eecfcd10 tempest-VolumesListTestJSON-1213495374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-99adb792-b5c3-48fe-9992-8ee27a3ecc51 1073741824 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:33:00 devstack sudo[94484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-99adb792-b5c3-48fe-9992-8ee27a3ecc51 1073741824 Aug 03 08:33:00 devstack sudo[94484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:33:00 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [req-b8b70283-f53a-4c8e-8e70-4c108dfebaea req-ddb45734-ef8b-4e0c-8dac-43405fdac386 tempest-ServerActionsTestOtherA-826446422 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:33:01 devstack sudo[94484]: pam_unix(sudo:session): session closed for user root Aug 03 08:33:01 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-9eddb55e-1036-448c-9070-4442eecfcd10 tempest-VolumesListTestJSON-1213495374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-99adb792-b5c3-48fe-9992-8ee27a3ecc51 1073741824" returned: 0 in 0.570s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:33:01 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-9eddb55e-1036-448c-9070-4442eecfcd10 tempest-VolumesListTestJSON-1213495374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-99adb792-b5c3-48fe-9992-8ee27a3ecc51 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:33:01 devstack sudo[94490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-99adb792-b5c3-48fe-9992-8ee27a3ecc51 Aug 03 08:33:01 devstack sudo[94490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:33:01 devstack sudo[94490]: pam_unix(sudo:session): session closed for user root Aug 03 08:33:01 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-9eddb55e-1036-448c-9070-4442eecfcd10 tempest-VolumesListTestJSON-1213495374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-99adb792-b5c3-48fe-9992-8ee27a3ecc51" returned: 0 in 0.316s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:33:01 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-9eddb55e-1036-448c-9070-4442eecfcd10 tempest-VolumesListTestJSON-1213495374 None] <== create_volume: return (956ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'} {{(pid=88899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 08:33:01 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-9eddb55e-1036-448c-9070-4442eecfcd10 tempest-VolumesListTestJSON-1213495374 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.959s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:33:01 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [req-b8b70283-f53a-4c8e-8e70-4c108dfebaea req-ddb45734-ef8b-4e0c-8dac-43405fdac386 tempest-ServerActionsTestOtherA-826446422 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.843s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:33:01 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-9eddb55e-1036-448c-9070-4442eecfcd10 tempest-VolumesListTestJSON-1213495374 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e4235f4-52dc-4850-b412-dfd7539c307c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-99adb792-b5c3-48fe-9992-8ee27a3ecc51', 'volume_size': 1}' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:33:01 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-9eddb55e-1036-448c-9070-4442eecfcd10 tempest-VolumesListTestJSON-1213495374 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae38b237-4304-41b9-b417-4538beba29e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:33:01 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [req-b8b70283-f53a-4c8e-8e70-4c108dfebaea req-ddb45734-ef8b-4e0c-8dac-43405fdac386 tempest-ServerActionsTestOtherA-826446422 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.044s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:33:01 devstack cinder-volume[88899]: INFO cinder.volume.flows.manager.create_volume [None req-9eddb55e-1036-448c-9070-4442eecfcd10 tempest-VolumesListTestJSON-1213495374 None] Volume volume-99adb792-b5c3-48fe-9992-8ee27a3ecc51 (99adb792-b5c3-48fe-9992-8ee27a3ecc51): created successfully Aug 03 08:33:01 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-9eddb55e-1036-448c-9070-4442eecfcd10 tempest-VolumesListTestJSON-1213495374 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae38b237-4304-41b9-b417-4538beba29e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:33:01 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-9eddb55e-1036-448c-9070-4442eecfcd10 tempest-VolumesListTestJSON-1213495374 None] Flow 'volume_create_manager' (c17fd573-b6af-4204-b056-43126058a179) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:33:01 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-9eddb55e-1036-448c-9070-4442eecfcd10 tempest-VolumesListTestJSON-1213495374 None] Created volume successfully. Aug 03 08:33:01 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [req-b8b70283-f53a-4c8e-8e70-4c108dfebaea req-ddb45734-ef8b-4e0c-8dac-43405fdac386 tempest-ServerActionsTestOtherA-826446422 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385', 'name': 'volume-2052ceb3-4070-47e1-9ffc-7499996ccbca', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ed182402-bc2c-423d-a386-57a21131d3d3', 'enforce_multipath': True} {{(pid=88899) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 03 08:33:01 devstack cinder-volume[88899]: INFO cinder.volume.manager [req-b8b70283-f53a-4c8e-8e70-4c108dfebaea req-ddb45734-ef8b-4e0c-8dac-43405fdac386 tempest-ServerActionsTestOtherA-826446422 None] attachment_update completed successfully. Aug 03 08:33:03 devstack cinder-volume[88899]: DEBUG cinder.volume.flows.manager.create_volume [None req-cc7ba147-1a7c-44ab-a2c1-37664c9ebfff tempest-VolumesListTestJSON-1213495374 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88899) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 08:33:03 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-cc7ba147-1a7c-44ab-a2c1-37664c9ebfff tempest-VolumesListTestJSON-1213495374 None] Flow 'volume_create_manager' (3973fcc4-cc50-4c28-b7b4-4ea2bc7b519f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:33:03 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-cc7ba147-1a7c-44ab-a2c1-37664c9ebfff tempest-VolumesListTestJSON-1213495374 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9cd8283-da78-4dc6-8212-8f548b911bf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:33:03 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-cc7ba147-1a7c-44ab-a2c1-37664c9ebfff tempest-VolumesListTestJSON-1213495374 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9cd8283-da78-4dc6-8212-8f548b911bf1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:33:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1962762430',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5feb8068-7488-4210-8375-0d2c9da56a72,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='ddbc7a9a75f04d04804075f2ec9d8a42',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:33:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:33:03Z,use_quota=True,user_id='4bc176cebeab461a87ff2f8470467b3e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8bde7129-1dc4-42ab-b852-ab32c61b4921),volume_type_id=8bde7129-1dc4-42ab-b852-ab32c61b4921)' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:33:03 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-cc7ba147-1a7c-44ab-a2c1-37664c9ebfff tempest-VolumesListTestJSON-1213495374 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d83da999-b6ce-4f2f-a272-f913d801236a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:33:03 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-cc7ba147-1a7c-44ab-a2c1-37664c9ebfff tempest-VolumesListTestJSON-1213495374 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d83da999-b6ce-4f2f-a272-f913d801236a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:33:03 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-cc7ba147-1a7c-44ab-a2c1-37664c9ebfff tempest-VolumesListTestJSON-1213495374 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5bfd7a23-b001-4019-a62b-457be3f20b7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:33:03 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-cc7ba147-1a7c-44ab-a2c1-37664c9ebfff tempest-VolumesListTestJSON-1213495374 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5bfd7a23-b001-4019-a62b-457be3f20b7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5feb8068-7488-4210-8375-0d2c9da56a72', 'volume_name': 'volume-5feb8068-7488-4210-8375-0d2c9da56a72', 'volume_size': 1}' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:33:03 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-cc7ba147-1a7c-44ab-a2c1-37664c9ebfff tempest-VolumesListTestJSON-1213495374 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (38c4695a-8f8e-4eff-a8b2-156608818096) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:33:03 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-cc7ba147-1a7c-44ab-a2c1-37664c9ebfff tempest-VolumesListTestJSON-1213495374 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (38c4695a-8f8e-4eff-a8b2-156608818096) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:33:03 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-cc7ba147-1a7c-44ab-a2c1-37664c9ebfff tempest-VolumesListTestJSON-1213495374 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3700b933-210b-4131-83bf-879853f9c3b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:33:03 devstack cinder-volume[88899]: INFO cinder.volume.flows.manager.create_volume [None req-cc7ba147-1a7c-44ab-a2c1-37664c9ebfff tempest-VolumesListTestJSON-1213495374 None] Volume 5feb8068-7488-4210-8375-0d2c9da56a72: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5feb8068-7488-4210-8375-0d2c9da56a72', 'volume_size': 1} Aug 03 08:33:03 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-cc7ba147-1a7c-44ab-a2c1-37664c9ebfff tempest-VolumesListTestJSON-1213495374 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:33:03 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-cc7ba147-1a7c-44ab-a2c1-37664c9ebfff tempest-VolumesListTestJSON-1213495374 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:33:03 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-cc7ba147-1a7c-44ab-a2c1-37664c9ebfff tempest-VolumesListTestJSON-1213495374 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:33:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1962762430',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5feb8068-7488-4210-8375-0d2c9da56a72,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='ddbc7a9a75f04d04804075f2ec9d8a42',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:33:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:33:03Z,use_quota=True,user_id='4bc176cebeab461a87ff2f8470467b3e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8bde7129-1dc4-42ab-b852-ab32c61b4921),volume_type_id=8bde7129-1dc4-42ab-b852-ab32c61b4921)}" {{(pid=88899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 08:33:03 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-cc7ba147-1a7c-44ab-a2c1-37664c9ebfff tempest-VolumesListTestJSON-1213495374 None] Creating volume 5feb8068-7488-4210-8375-0d2c9da56a72 {{(pid=88899) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 08:33:03 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-cc7ba147-1a7c-44ab-a2c1-37664c9ebfff tempest-VolumesListTestJSON-1213495374 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:33:03 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-cc7ba147-1a7c-44ab-a2c1-37664c9ebfff tempest-VolumesListTestJSON-1213495374 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:33:03 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-cc7ba147-1a7c-44ab-a2c1-37664c9ebfff tempest-VolumesListTestJSON-1213495374 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:33:03 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-cc7ba147-1a7c-44ab-a2c1-37664c9ebfff tempest-VolumesListTestJSON-1213495374 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:33:03 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-cc7ba147-1a7c-44ab-a2c1-37664c9ebfff tempest-VolumesListTestJSON-1213495374 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:33:03 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-cc7ba147-1a7c-44ab-a2c1-37664c9ebfff tempest-VolumesListTestJSON-1213495374 None] Selected osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385 as target Quobyte volume. {{(pid=88899) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 08:33:03 devstack cinder-volume[88899]: INFO cinder.volume.drivers.remotefs [None req-cc7ba147-1a7c-44ab-a2c1-37664c9ebfff tempest-VolumesListTestJSON-1213495374 None] casted to osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385 Aug 03 08:33:03 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-cc7ba147-1a7c-44ab-a2c1-37664c9ebfff tempest-VolumesListTestJSON-1213495374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-5feb8068-7488-4210-8375-0d2c9da56a72 1073741824 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:33:03 devstack sudo[94878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-5feb8068-7488-4210-8375-0d2c9da56a72 1073741824 Aug 03 08:33:03 devstack sudo[94878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:33:04 devstack sudo[94878]: pam_unix(sudo:session): session closed for user root Aug 03 08:33:04 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-cc7ba147-1a7c-44ab-a2c1-37664c9ebfff tempest-VolumesListTestJSON-1213495374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-5feb8068-7488-4210-8375-0d2c9da56a72 1073741824" returned: 0 in 0.570s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:33:04 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-cc7ba147-1a7c-44ab-a2c1-37664c9ebfff tempest-VolumesListTestJSON-1213495374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-5feb8068-7488-4210-8375-0d2c9da56a72 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:33:04 devstack sudo[94883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-5feb8068-7488-4210-8375-0d2c9da56a72 Aug 03 08:33:04 devstack sudo[94883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:33:04 devstack sudo[94883]: pam_unix(sudo:session): session closed for user root Aug 03 08:33:04 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-cc7ba147-1a7c-44ab-a2c1-37664c9ebfff tempest-VolumesListTestJSON-1213495374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-5feb8068-7488-4210-8375-0d2c9da56a72" returned: 0 in 0.373s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:33:04 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-cc7ba147-1a7c-44ab-a2c1-37664c9ebfff tempest-VolumesListTestJSON-1213495374 None] <== create_volume: return (1004ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'} {{(pid=88899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 08:33:04 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-cc7ba147-1a7c-44ab-a2c1-37664c9ebfff tempest-VolumesListTestJSON-1213495374 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.007s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:33:04 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-cc7ba147-1a7c-44ab-a2c1-37664c9ebfff tempest-VolumesListTestJSON-1213495374 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3700b933-210b-4131-83bf-879853f9c3b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5feb8068-7488-4210-8375-0d2c9da56a72', 'volume_size': 1}' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:33:04 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-cc7ba147-1a7c-44ab-a2c1-37664c9ebfff tempest-VolumesListTestJSON-1213495374 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (27380bed-ca9a-443e-9e63-e83823755a0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:33:04 devstack cinder-volume[88899]: INFO cinder.volume.flows.manager.create_volume [None req-cc7ba147-1a7c-44ab-a2c1-37664c9ebfff tempest-VolumesListTestJSON-1213495374 None] Volume volume-5feb8068-7488-4210-8375-0d2c9da56a72 (5feb8068-7488-4210-8375-0d2c9da56a72): created successfully Aug 03 08:33:04 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-cc7ba147-1a7c-44ab-a2c1-37664c9ebfff tempest-VolumesListTestJSON-1213495374 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (27380bed-ca9a-443e-9e63-e83823755a0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:33:04 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-cc7ba147-1a7c-44ab-a2c1-37664c9ebfff tempest-VolumesListTestJSON-1213495374 None] Flow 'volume_create_manager' (3973fcc4-cc50-4c28-b7b4-4ea2bc7b519f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:33:04 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-cc7ba147-1a7c-44ab-a2c1-37664c9ebfff tempest-VolumesListTestJSON-1213495374 None] Created volume successfully. Aug 03 08:33:06 devstack cinder-volume[88899]: INFO cinder.volume.manager [req-856dc1c6-708f-4688-843b-11d71a729a53 req-9516799a-8c07-41fc-8cac-9c91a0a4bead tempest-ServerActionsTestOtherA-826446422 None] Terminate volume connection completed successfully. Aug 03 08:33:06 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [req-856dc1c6-708f-4688-843b-11d71a729a53 req-9516799a-8c07-41fc-8cac-9c91a0a4bead tempest-ServerActionsTestOtherA-826446422 None] Deleting attachment ed182402-bc2c-423d-a386-57a21131d3d3. {{(pid=88899) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 03 08:33:06 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-49d67ed6-16b3-4e61-be5b-dabb9cfad0b2 tempest-GroupSnapshotsTest-1944413600 None] Group tempest-GroupSnapshotsTest-Group-606972524: creating Aug 03 08:33:06 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-49d67ed6-16b3-4e61-be5b-dabb9cfad0b2 tempest-GroupSnapshotsTest-1944413600 None] Group tempest-GroupSnapshotsTest-Group-606972524: created successfully Aug 03 08:33:06 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-49d67ed6-16b3-4e61-be5b-dabb9cfad0b2 tempest-GroupSnapshotsTest-1944413600 None] Create group completed successfully. Aug 03 08:33:07 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [req-856dc1c6-708f-4688-843b-11d71a729a53 req-d4181bdc-619f-4a18-a110-06588eface0c tempest-ServerActionsTestOtherA-826446422 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:33:07 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [req-856dc1c6-708f-4688-843b-11d71a729a53 req-d4181bdc-619f-4a18-a110-06588eface0c tempest-ServerActionsTestOtherA-826446422 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:33:07 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [req-856dc1c6-708f-4688-843b-11d71a729a53 req-d4181bdc-619f-4a18-a110-06588eface0c tempest-ServerActionsTestOtherA-826446422 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.015s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:33:07 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [req-856dc1c6-708f-4688-843b-11d71a729a53 req-d4181bdc-619f-4a18-a110-06588eface0c tempest-ServerActionsTestOtherA-826446422 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385', 'name': 'volume-2052ceb3-4070-47e1-9ffc-7499996ccbca', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '1bc3b73a-070a-427b-a816-1a5a816d71f3', 'enforce_multipath': True} {{(pid=88899) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 03 08:33:07 devstack cinder-volume[88899]: INFO cinder.volume.manager [req-856dc1c6-708f-4688-843b-11d71a729a53 req-d4181bdc-619f-4a18-a110-06588eface0c tempest-ServerActionsTestOtherA-826446422 None] attachment_update completed successfully. Aug 03 08:33:08 devstack cinder-volume[88899]: DEBUG cinder.volume.flows.manager.create_volume [None req-68c3ce48-0ae7-46b6-8814-75ea9840c750 tempest-GroupSnapshotsTest-1944413600 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88899) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 08:33:08 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-68c3ce48-0ae7-46b6-8814-75ea9840c750 tempest-GroupSnapshotsTest-1944413600 None] Flow 'volume_create_manager' (131cf526-7954-42b7-b105-f96302cabf25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:33:08 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-68c3ce48-0ae7-46b6-8814-75ea9840c750 tempest-GroupSnapshotsTest-1944413600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a76591f4-a10a-4cd9-b844-4dd9cc46d295) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:33:08 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-68c3ce48-0ae7-46b6-8814-75ea9840c750 tempest-GroupSnapshotsTest-1944413600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a76591f4-a10a-4cd9-b844-4dd9cc46d295) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:33:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1441847604',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=482602d4-3a4c-4f47-bfd1-4d87f49191a0,host='devstack@QuobyteHD#QuobyteHD',id=c0651975-f526-4de6-91f1-d550d4bdc582,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2fdcb70d80ef43099f0479c4f5be4112',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:33:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:33:09Z,use_quota=True,user_id='d0f229235ffe4b97a62b4ad4a518020a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f02d13d-5b68-4d06-b203-17c8a4608d48),volume_type_id=2f02d13d-5b68-4d06-b203-17c8a4608d48)' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:33:08 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-68c3ce48-0ae7-46b6-8814-75ea9840c750 tempest-GroupSnapshotsTest-1944413600 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e15d9294-7dc0-4ed2-b476-2b906ef79558) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:33:08 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-68c3ce48-0ae7-46b6-8814-75ea9840c750 tempest-GroupSnapshotsTest-1944413600 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e15d9294-7dc0-4ed2-b476-2b906ef79558) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:33:08 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-68c3ce48-0ae7-46b6-8814-75ea9840c750 tempest-GroupSnapshotsTest-1944413600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (24df1d02-06d5-4840-b213-170a41f96158) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:33:08 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-68c3ce48-0ae7-46b6-8814-75ea9840c750 tempest-GroupSnapshotsTest-1944413600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (24df1d02-06d5-4840-b213-170a41f96158) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c0651975-f526-4de6-91f1-d550d4bdc582', 'volume_name': 'volume-c0651975-f526-4de6-91f1-d550d4bdc582', 'volume_size': 1}' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:33:08 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-68c3ce48-0ae7-46b6-8814-75ea9840c750 tempest-GroupSnapshotsTest-1944413600 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (34349b7e-523d-4102-8674-7e6b3f99601f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:33:08 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-68c3ce48-0ae7-46b6-8814-75ea9840c750 tempest-GroupSnapshotsTest-1944413600 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (34349b7e-523d-4102-8674-7e6b3f99601f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:33:08 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-68c3ce48-0ae7-46b6-8814-75ea9840c750 tempest-GroupSnapshotsTest-1944413600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e128e817-f25e-4f4a-8914-eb02e9f3553b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:33:08 devstack cinder-volume[88899]: INFO cinder.volume.flows.manager.create_volume [None req-68c3ce48-0ae7-46b6-8814-75ea9840c750 tempest-GroupSnapshotsTest-1944413600 None] Volume c0651975-f526-4de6-91f1-d550d4bdc582: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c0651975-f526-4de6-91f1-d550d4bdc582', 'volume_size': 1} Aug 03 08:33:08 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-68c3ce48-0ae7-46b6-8814-75ea9840c750 tempest-GroupSnapshotsTest-1944413600 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:33:08 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-68c3ce48-0ae7-46b6-8814-75ea9840c750 tempest-GroupSnapshotsTest-1944413600 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:33:08 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-68c3ce48-0ae7-46b6-8814-75ea9840c750 tempest-GroupSnapshotsTest-1944413600 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=482602d4-3a4c-4f47-bfd1-4d87f49191a0,created_at=2026-08-03T06:33:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1441847604',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=482602d4-3a4c-4f47-bfd1-4d87f49191a0,host='devstack@QuobyteHD#QuobyteHD',id=c0651975-f526-4de6-91f1-d550d4bdc582,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2fdcb70d80ef43099f0479c4f5be4112',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:33:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:33:09Z,use_quota=True,user_id='d0f229235ffe4b97a62b4ad4a518020a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f02d13d-5b68-4d06-b203-17c8a4608d48),volume_type_id=2f02d13d-5b68-4d06-b203-17c8a4608d48)}" {{(pid=88899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 08:33:08 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-68c3ce48-0ae7-46b6-8814-75ea9840c750 tempest-GroupSnapshotsTest-1944413600 None] Creating volume c0651975-f526-4de6-91f1-d550d4bdc582 {{(pid=88899) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 08:33:08 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-68c3ce48-0ae7-46b6-8814-75ea9840c750 tempest-GroupSnapshotsTest-1944413600 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:33:08 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-68c3ce48-0ae7-46b6-8814-75ea9840c750 tempest-GroupSnapshotsTest-1944413600 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:33:08 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-68c3ce48-0ae7-46b6-8814-75ea9840c750 tempest-GroupSnapshotsTest-1944413600 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:33:08 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-68c3ce48-0ae7-46b6-8814-75ea9840c750 tempest-GroupSnapshotsTest-1944413600 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:33:08 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-68c3ce48-0ae7-46b6-8814-75ea9840c750 tempest-GroupSnapshotsTest-1944413600 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:33:08 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-68c3ce48-0ae7-46b6-8814-75ea9840c750 tempest-GroupSnapshotsTest-1944413600 None] Selected osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385 as target Quobyte volume. {{(pid=88899) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 08:33:08 devstack cinder-volume[88899]: INFO cinder.volume.drivers.remotefs [None req-68c3ce48-0ae7-46b6-8814-75ea9840c750 tempest-GroupSnapshotsTest-1944413600 None] casted to osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385 Aug 03 08:33:08 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-68c3ce48-0ae7-46b6-8814-75ea9840c750 tempest-GroupSnapshotsTest-1944413600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c0651975-f526-4de6-91f1-d550d4bdc582 1073741824 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:33:08 devstack sudo[94989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c0651975-f526-4de6-91f1-d550d4bdc582 1073741824 Aug 03 08:33:08 devstack sudo[94989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:33:09 devstack sudo[94989]: pam_unix(sudo:session): session closed for user root Aug 03 08:33:09 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-68c3ce48-0ae7-46b6-8814-75ea9840c750 tempest-GroupSnapshotsTest-1944413600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c0651975-f526-4de6-91f1-d550d4bdc582 1073741824" returned: 0 in 0.723s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:33:09 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-68c3ce48-0ae7-46b6-8814-75ea9840c750 tempest-GroupSnapshotsTest-1944413600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c0651975-f526-4de6-91f1-d550d4bdc582 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:33:09 devstack sudo[95071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c0651975-f526-4de6-91f1-d550d4bdc582 Aug 03 08:33:09 devstack sudo[95071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:33:10 devstack sudo[95071]: pam_unix(sudo:session): session closed for user root Aug 03 08:33:10 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-68c3ce48-0ae7-46b6-8814-75ea9840c750 tempest-GroupSnapshotsTest-1944413600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c0651975-f526-4de6-91f1-d550d4bdc582" returned: 0 in 0.465s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:33:10 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-68c3ce48-0ae7-46b6-8814-75ea9840c750 tempest-GroupSnapshotsTest-1944413600 None] <== create_volume: return (1283ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'} {{(pid=88899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 08:33:10 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-68c3ce48-0ae7-46b6-8814-75ea9840c750 tempest-GroupSnapshotsTest-1944413600 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.286s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:33:10 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-68c3ce48-0ae7-46b6-8814-75ea9840c750 tempest-GroupSnapshotsTest-1944413600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e128e817-f25e-4f4a-8914-eb02e9f3553b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c0651975-f526-4de6-91f1-d550d4bdc582', 'volume_size': 1}' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:33:10 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-68c3ce48-0ae7-46b6-8814-75ea9840c750 tempest-GroupSnapshotsTest-1944413600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71b040fd-aa83-4330-a62b-1e18be3464f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:33:10 devstack cinder-volume[88899]: INFO cinder.volume.flows.manager.create_volume [None req-68c3ce48-0ae7-46b6-8814-75ea9840c750 tempest-GroupSnapshotsTest-1944413600 None] Volume volume-c0651975-f526-4de6-91f1-d550d4bdc582 (c0651975-f526-4de6-91f1-d550d4bdc582): created successfully Aug 03 08:33:10 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-68c3ce48-0ae7-46b6-8814-75ea9840c750 tempest-GroupSnapshotsTest-1944413600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71b040fd-aa83-4330-a62b-1e18be3464f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:33:10 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-68c3ce48-0ae7-46b6-8814-75ea9840c750 tempest-GroupSnapshotsTest-1944413600 None] Flow 'volume_create_manager' (131cf526-7954-42b7-b105-f96302cabf25) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:33:10 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-68c3ce48-0ae7-46b6-8814-75ea9840c750 tempest-GroupSnapshotsTest-1944413600 None] Created volume successfully. Aug 03 08:33:10 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-385a6138-3cbb-4bb8-965c-5d08c7f7ffbb tempest-VolumesListTestJSON-1213495374 None] Acquiring lock "cinder-5feb8068-7488-4210-8375-0d2c9da56a72-delete_volume" by "delete_volume" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:33:10 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-385a6138-3cbb-4bb8-965c-5d08c7f7ffbb tempest-VolumesListTestJSON-1213495374 None] Lock "cinder-5feb8068-7488-4210-8375-0d2c9da56a72-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:33:10 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-385a6138-3cbb-4bb8-965c-5d08c7f7ffbb tempest-VolumesListTestJSON-1213495374 None] Acquiring lock "cinder-quobyte-5feb8068-7488-4210-8375-0d2c9da56a72" by "delete_volume" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:33:10 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-385a6138-3cbb-4bb8-965c-5d08c7f7ffbb tempest-VolumesListTestJSON-1213495374 None] Lock "cinder-quobyte-5feb8068-7488-4210-8375-0d2c9da56a72" acquired by "delete_volume" :: waited 0.030s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:33:10 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf739574-f17d-443d-bb1f-f25bfebcdc5c]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:33:10 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-385a6138-3cbb-4bb8-965c-5d08c7f7ffbb tempest-VolumesListTestJSON-1213495374 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-5feb8068-7488-4210-8375-0d2c9da56a72 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:33:10 devstack sudo[95409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-5feb8068-7488-4210-8375-0d2c9da56a72 Aug 03 08:33:10 devstack sudo[95409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:33:11 devstack sudo[95409]: pam_unix(sudo:session): session closed for user root Aug 03 08:33:11 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-385a6138-3cbb-4bb8-965c-5d08c7f7ffbb tempest-VolumesListTestJSON-1213495374 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-5feb8068-7488-4210-8375-0d2c9da56a72" returned: 0 in 0.500s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:33:11 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-385a6138-3cbb-4bb8-965c-5d08c7f7ffbb tempest-VolumesListTestJSON-1213495374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-5feb8068-7488-4210-8375-0d2c9da56a72 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:33:11 devstack sudo[95427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-5feb8068-7488-4210-8375-0d2c9da56a72 Aug 03 08:33:11 devstack sudo[95427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:33:11 devstack sudo[95427]: pam_unix(sudo:session): session closed for user root Aug 03 08:33:11 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-385a6138-3cbb-4bb8-965c-5d08c7f7ffbb tempest-VolumesListTestJSON-1213495374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-5feb8068-7488-4210-8375-0d2c9da56a72" returned: 0 in 0.302s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:33:11 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-385a6138-3cbb-4bb8-965c-5d08c7f7ffbb tempest-VolumesListTestJSON-1213495374 None] Lock "cinder-quobyte-5feb8068-7488-4210-8375-0d2c9da56a72" released by "delete_volume" :: held 0.876s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:33:11 devstack cinder-volume[88899]: DEBUG cinder.quota [None req-385a6138-3cbb-4bb8-965c-5d08c7f7ffbb tempest-VolumesListTestJSON-1213495374 None] Created reservations ['3599cd5d-df2c-4e6d-b567-1368a0065036', 'faf53bef-4bb3-44a6-82c6-a71165e2735d', '79400dbc-1dd2-4716-9947-3adf6754a377', '13861f3c-7434-45c2-8002-82efe0aa6e1a'] {{(pid=88899) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 08:33:11 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-385a6138-3cbb-4bb8-965c-5d08c7f7ffbb tempest-VolumesListTestJSON-1213495374 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:33:11 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-385a6138-3cbb-4bb8-965c-5d08c7f7ffbb tempest-VolumesListTestJSON-1213495374 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:33:11 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-385a6138-3cbb-4bb8-965c-5d08c7f7ffbb tempest-VolumesListTestJSON-1213495374 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:33:11 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-385a6138-3cbb-4bb8-965c-5d08c7f7ffbb tempest-VolumesListTestJSON-1213495374 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:33:11 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-385a6138-3cbb-4bb8-965c-5d08c7f7ffbb tempest-VolumesListTestJSON-1213495374 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:33:11 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-385a6138-3cbb-4bb8-965c-5d08c7f7ffbb tempest-VolumesListTestJSON-1213495374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:33:11 devstack sudo[95458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a Aug 03 08:33:11 devstack sudo[95458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:33:12 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-96cf2f50-825f-466d-b1b9-5070ddd66a01 tempest-GroupSnapshotsTest-1944413600 None] GroupSnapshot 9c64bc4a-6d6d-4bd4-a3df-878023b97acb: creating. Aug 03 08:33:12 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-96cf2f50-825f-466d-b1b9-5070ddd66a01 tempest-GroupSnapshotsTest-1944413600 None] Group snapshot 9c64bc4a-6d6d-4bd4-a3df-878023b97acb: creating. {{(pid=88899) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Aug 03 08:33:12 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-96cf2f50-825f-466d-b1b9-5070ddd66a01 tempest-GroupSnapshotsTest-1944413600 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:33:12 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-96cf2f50-825f-466d-b1b9-5070ddd66a01 tempest-GroupSnapshotsTest-1944413600 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:33:12 devstack sudo[95458]: pam_unix(sudo:session): session closed for user root Aug 03 08:33:12 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-385a6138-3cbb-4bb8-965c-5d08c7f7ffbb tempest-VolumesListTestJSON-1213495374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a" returned: 0 in 0.606s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:33:12 devstack cinder-volume[88899]: DEBUG cinder.manager [None req-385a6138-3cbb-4bb8-965c-5d08c7f7ffbb tempest-VolumesListTestJSON-1213495374 None] Notifying Schedulers of capabilities ... {{(pid=88899) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 08:33:12 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-96cf2f50-825f-466d-b1b9-5070ddd66a01 tempest-GroupSnapshotsTest-1944413600 None] Creating offline snapshot 05aab29c-362a-4880-975d-ed51500d17d1 of volume c0651975-f526-4de6-91f1-d550d4bdc582 {{(pid=88899) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 03 08:33:12 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-385a6138-3cbb-4bb8-965c-5d08c7f7ffbb tempest-VolumesListTestJSON-1213495374 None] Deleted volume successfully. Aug 03 08:33:12 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[09025ce3-38b8-45c9-8848-b5fd5b87abd5]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:33:12 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-96cf2f50-825f-466d-b1b9-5070ddd66a01 tempest-GroupSnapshotsTest-1944413600 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c0651975-f526-4de6-91f1-d550d4bdc582 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:33:12 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-385a6138-3cbb-4bb8-965c-5d08c7f7ffbb tempest-VolumesListTestJSON-1213495374 None] Lock "cinder-5feb8068-7488-4210-8375-0d2c9da56a72-delete_volume" released by "delete_volume" :: held 2.069s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:33:12 devstack sudo[95499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c0651975-f526-4de6-91f1-d550d4bdc582 Aug 03 08:33:12 devstack sudo[95499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:33:12 devstack sudo[95499]: pam_unix(sudo:session): session closed for user root Aug 03 08:33:13 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-96cf2f50-825f-466d-b1b9-5070ddd66a01 tempest-GroupSnapshotsTest-1944413600 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c0651975-f526-4de6-91f1-d550d4bdc582" returned: 0 in 0.536s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:33:13 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-96cf2f50-825f-466d-b1b9-5070ddd66a01 tempest-GroupSnapshotsTest-1944413600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c0651975-f526-4de6-91f1-d550d4bdc582,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c0651975-f526-4de6-91f1-d550d4bdc582.05aab29c-362a-4880-975d-ed51500d17d1 1G {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:33:13 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-aa3bd09f-ab5a-42e9-882f-acba9d787e5a tempest-VolumesListTestJSON-1213495374 None] Acquiring lock "cinder-99adb792-b5c3-48fe-9992-8ee27a3ecc51-delete_volume" by "delete_volume" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:33:13 devstack sudo[95522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c0651975-f526-4de6-91f1-d550d4bdc582,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c0651975-f526-4de6-91f1-d550d4bdc582.05aab29c-362a-4880-975d-ed51500d17d1 1G Aug 03 08:33:13 devstack sudo[95522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:33:13 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-aa3bd09f-ab5a-42e9-882f-acba9d787e5a tempest-VolumesListTestJSON-1213495374 None] Lock "cinder-99adb792-b5c3-48fe-9992-8ee27a3ecc51-delete_volume" acquired by "delete_volume" :: waited 0.055s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:33:13 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-aa3bd09f-ab5a-42e9-882f-acba9d787e5a tempest-VolumesListTestJSON-1213495374 None] Acquiring lock "cinder-quobyte-99adb792-b5c3-48fe-9992-8ee27a3ecc51" by "delete_volume" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:33:13 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-aa3bd09f-ab5a-42e9-882f-acba9d787e5a tempest-VolumesListTestJSON-1213495374 None] Lock "cinder-quobyte-99adb792-b5c3-48fe-9992-8ee27a3ecc51" acquired by "delete_volume" :: waited 0.030s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:33:13 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e9502d3-375a-4c0c-8c5f-99385de0f64b]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:33:13 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-aa3bd09f-ab5a-42e9-882f-acba9d787e5a tempest-VolumesListTestJSON-1213495374 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-99adb792-b5c3-48fe-9992-8ee27a3ecc51 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:33:13 devstack sudo[95546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-99adb792-b5c3-48fe-9992-8ee27a3ecc51 Aug 03 08:33:13 devstack sudo[95546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:33:13 devstack sudo[95522]: pam_unix(sudo:session): session closed for user root Aug 03 08:33:13 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-96cf2f50-825f-466d-b1b9-5070ddd66a01 tempest-GroupSnapshotsTest-1944413600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c0651975-f526-4de6-91f1-d550d4bdc582,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c0651975-f526-4de6-91f1-d550d4bdc582.05aab29c-362a-4880-975d-ed51500d17d1 1G" returned: 0 in 0.713s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:33:13 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-96cf2f50-825f-466d-b1b9-5070ddd66a01 tempest-GroupSnapshotsTest-1944413600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c0651975-f526-4de6-91f1-d550d4bdc582 -F qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c0651975-f526-4de6-91f1-d550d4bdc582.05aab29c-362a-4880-975d-ed51500d17d1 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:33:13 devstack sudo[95560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c0651975-f526-4de6-91f1-d550d4bdc582 -F qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c0651975-f526-4de6-91f1-d550d4bdc582.05aab29c-362a-4880-975d-ed51500d17d1 Aug 03 08:33:13 devstack sudo[95560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:33:14 devstack sudo[95560]: pam_unix(sudo:session): session closed for user root Aug 03 08:33:14 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-96cf2f50-825f-466d-b1b9-5070ddd66a01 tempest-GroupSnapshotsTest-1944413600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c0651975-f526-4de6-91f1-d550d4bdc582 -F qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c0651975-f526-4de6-91f1-d550d4bdc582.05aab29c-362a-4880-975d-ed51500d17d1" returned: 0 in 0.553s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:33:14 devstack cinder-volume[88899]: WARNING cinder.volume.drivers.remotefs [None req-96cf2f50-825f-466d-b1b9-5070ddd66a01 tempest-GroupSnapshotsTest-1944413600 None] /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c0651975-f526-4de6-91f1-d550d4bdc582.05aab29c-362a-4880-975d-ed51500d17d1 is being set with open permissions: ugo+rw: NotImplementedError Aug 03 08:33:14 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-96cf2f50-825f-466d-b1b9-5070ddd66a01 tempest-GroupSnapshotsTest-1944413600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c0651975-f526-4de6-91f1-d550d4bdc582.05aab29c-362a-4880-975d-ed51500d17d1 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:33:14 devstack sudo[95546]: pam_unix(sudo:session): session closed for user root Aug 03 08:33:14 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-aa3bd09f-ab5a-42e9-882f-acba9d787e5a tempest-VolumesListTestJSON-1213495374 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-99adb792-b5c3-48fe-9992-8ee27a3ecc51" returned: 0 in 1.025s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:33:14 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-aa3bd09f-ab5a-42e9-882f-acba9d787e5a tempest-VolumesListTestJSON-1213495374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-99adb792-b5c3-48fe-9992-8ee27a3ecc51 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:33:14 devstack sudo[95569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-99adb792-b5c3-48fe-9992-8ee27a3ecc51 Aug 03 08:33:14 devstack sudo[95569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:33:14 devstack sudo[95568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c0651975-f526-4de6-91f1-d550d4bdc582.05aab29c-362a-4880-975d-ed51500d17d1 Aug 03 08:33:14 devstack sudo[95568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:33:14 devstack sudo[95568]: pam_unix(sudo:session): session closed for user root Aug 03 08:33:14 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-96cf2f50-825f-466d-b1b9-5070ddd66a01 tempest-GroupSnapshotsTest-1944413600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c0651975-f526-4de6-91f1-d550d4bdc582.05aab29c-362a-4880-975d-ed51500d17d1" returned: 0 in 0.538s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:33:14 devstack sudo[95569]: pam_unix(sudo:session): session closed for user root Aug 03 08:33:14 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-96cf2f50-825f-466d-b1b9-5070ddd66a01 tempest-GroupSnapshotsTest-1944413600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c0651975-f526-4de6-91f1-d550d4bdc582.info {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:33:14 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-aa3bd09f-ab5a-42e9-882f-acba9d787e5a tempest-VolumesListTestJSON-1213495374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-99adb792-b5c3-48fe-9992-8ee27a3ecc51" returned: 0 in 0.569s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:33:14 devstack sudo[95574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c0651975-f526-4de6-91f1-d550d4bdc582.info Aug 03 08:33:14 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-aa3bd09f-ab5a-42e9-882f-acba9d787e5a tempest-VolumesListTestJSON-1213495374 None] Lock "cinder-quobyte-99adb792-b5c3-48fe-9992-8ee27a3ecc51" released by "delete_volume" :: held 1.717s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:33:14 devstack sudo[95574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:33:15 devstack cinder-volume[88899]: DEBUG cinder.quota [None req-aa3bd09f-ab5a-42e9-882f-acba9d787e5a tempest-VolumesListTestJSON-1213495374 None] Created reservations ['223c6be1-4e17-4842-bb41-b8092c6808be', 'dfeae038-0439-46af-af94-8ae120512aa7', 'afad1e93-45d5-4d5f-a2b0-9e81f494fb2e', '399f8220-b22c-45db-916a-81d7c4f17341'] {{(pid=88899) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 08:33:15 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-aa3bd09f-ab5a-42e9-882f-acba9d787e5a tempest-VolumesListTestJSON-1213495374 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:33:15 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-aa3bd09f-ab5a-42e9-882f-acba9d787e5a tempest-VolumesListTestJSON-1213495374 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:33:15 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-aa3bd09f-ab5a-42e9-882f-acba9d787e5a tempest-VolumesListTestJSON-1213495374 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:33:15 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-aa3bd09f-ab5a-42e9-882f-acba9d787e5a tempest-VolumesListTestJSON-1213495374 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:33:15 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-aa3bd09f-ab5a-42e9-882f-acba9d787e5a tempest-VolumesListTestJSON-1213495374 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:33:15 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-aa3bd09f-ab5a-42e9-882f-acba9d787e5a tempest-VolumesListTestJSON-1213495374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:33:15 devstack sudo[95579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a Aug 03 08:33:15 devstack sudo[95579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:33:15 devstack sudo[95574]: pam_unix(sudo:session): session closed for user root Aug 03 08:33:15 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-96cf2f50-825f-466d-b1b9-5070ddd66a01 tempest-GroupSnapshotsTest-1944413600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c0651975-f526-4de6-91f1-d550d4bdc582.info" returned: 0 in 0.497s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:33:15 devstack cinder-volume[88899]: WARNING cinder.volume.drivers.remotefs [None req-96cf2f50-825f-466d-b1b9-5070ddd66a01 tempest-GroupSnapshotsTest-1944413600 None] /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c0651975-f526-4de6-91f1-d550d4bdc582.info is being set with open permissions: ugo+rw: NotImplementedError Aug 03 08:33:15 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-96cf2f50-825f-466d-b1b9-5070ddd66a01 tempest-GroupSnapshotsTest-1944413600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c0651975-f526-4de6-91f1-d550d4bdc582.info {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:33:15 devstack sudo[95582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c0651975-f526-4de6-91f1-d550d4bdc582.info Aug 03 08:33:15 devstack sudo[95582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:33:15 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-01ead717-0e46-45ef-8567-fd8d15b8b631 tempest-VolumesListTestJSON-1213495374 None] Acquiring lock "cinder-79b81383-4012-4f41-99af-fbbb805b719f-delete_volume" by "delete_volume" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:33:15 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-01ead717-0e46-45ef-8567-fd8d15b8b631 tempest-VolumesListTestJSON-1213495374 None] Lock "cinder-79b81383-4012-4f41-99af-fbbb805b719f-delete_volume" acquired by "delete_volume" :: waited 0.085s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:33:16 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-01ead717-0e46-45ef-8567-fd8d15b8b631 tempest-VolumesListTestJSON-1213495374 None] Acquiring lock "cinder-quobyte-79b81383-4012-4f41-99af-fbbb805b719f" by "delete_volume" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:33:16 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-01ead717-0e46-45ef-8567-fd8d15b8b631 tempest-VolumesListTestJSON-1213495374 None] Lock "cinder-quobyte-79b81383-4012-4f41-99af-fbbb805b719f" acquired by "delete_volume" :: waited 0.039s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:33:16 devstack sudo[95579]: pam_unix(sudo:session): session closed for user root Aug 03 08:33:16 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-aa3bd09f-ab5a-42e9-882f-acba9d787e5a tempest-VolumesListTestJSON-1213495374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a" returned: 0 in 0.936s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:33:16 devstack cinder-volume[88899]: DEBUG cinder.manager [None req-aa3bd09f-ab5a-42e9-882f-acba9d787e5a tempest-VolumesListTestJSON-1213495374 None] Notifying Schedulers of capabilities ... {{(pid=88899) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 08:33:16 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-aa3bd09f-ab5a-42e9-882f-acba9d787e5a tempest-VolumesListTestJSON-1213495374 None] Deleted volume successfully. Aug 03 08:33:16 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[b01c3980-b197-4e0e-a75d-f0a2bb306c7f]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:33:16 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-01ead717-0e46-45ef-8567-fd8d15b8b631 tempest-VolumesListTestJSON-1213495374 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-79b81383-4012-4f41-99af-fbbb805b719f {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:33:16 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-aa3bd09f-ab5a-42e9-882f-acba9d787e5a tempest-VolumesListTestJSON-1213495374 None] Lock "cinder-99adb792-b5c3-48fe-9992-8ee27a3ecc51-delete_volume" released by "delete_volume" :: held 3.182s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:33:16 devstack sudo[95582]: pam_unix(sudo:session): session closed for user root Aug 03 08:33:16 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-96cf2f50-825f-466d-b1b9-5070ddd66a01 tempest-GroupSnapshotsTest-1944413600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c0651975-f526-4de6-91f1-d550d4bdc582.info" returned: 0 in 0.986s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:33:16 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-96cf2f50-825f-466d-b1b9-5070ddd66a01 tempest-GroupSnapshotsTest-1944413600 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.080s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:33:16 devstack sudo[95585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-79b81383-4012-4f41-99af-fbbb805b719f Aug 03 08:33:16 devstack sudo[95585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:33:16 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-96cf2f50-825f-466d-b1b9-5070ddd66a01 tempest-GroupSnapshotsTest-1944413600 None] group_snapshot 9c64bc4a-6d6d-4bd4-a3df-878023b97acb: created successfully Aug 03 08:33:16 devstack sudo[95585]: pam_unix(sudo:session): session closed for user root Aug 03 08:33:16 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-01ead717-0e46-45ef-8567-fd8d15b8b631 tempest-VolumesListTestJSON-1213495374 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-79b81383-4012-4f41-99af-fbbb805b719f" returned: 0 in 0.718s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:33:16 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-01ead717-0e46-45ef-8567-fd8d15b8b631 tempest-VolumesListTestJSON-1213495374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-79b81383-4012-4f41-99af-fbbb805b719f {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:33:16 devstack sudo[95591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-79b81383-4012-4f41-99af-fbbb805b719f Aug 03 08:33:16 devstack sudo[95591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:33:17 devstack sudo[95591]: pam_unix(sudo:session): session closed for user root Aug 03 08:33:17 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-01ead717-0e46-45ef-8567-fd8d15b8b631 tempest-VolumesListTestJSON-1213495374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-79b81383-4012-4f41-99af-fbbb805b719f" returned: 0 in 0.401s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:33:17 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-01ead717-0e46-45ef-8567-fd8d15b8b631 tempest-VolumesListTestJSON-1213495374 None] Lock "cinder-quobyte-79b81383-4012-4f41-99af-fbbb805b719f" released by "delete_volume" :: held 1.228s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:33:17 devstack cinder-volume[88899]: DEBUG cinder.quota [None req-01ead717-0e46-45ef-8567-fd8d15b8b631 tempest-VolumesListTestJSON-1213495374 None] Created reservations ['77a73924-0a58-412a-a726-c1c645296e87', '4a0dd39a-aefe-49fe-b364-78bbc45ec32f', '8816c94c-2f6d-4f37-8b7f-0175701f9843', '75af73fa-f58a-4524-8ba0-ce3f81ca619e'] {{(pid=88899) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 08:33:17 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-01ead717-0e46-45ef-8567-fd8d15b8b631 tempest-VolumesListTestJSON-1213495374 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:33:17 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-01ead717-0e46-45ef-8567-fd8d15b8b631 tempest-VolumesListTestJSON-1213495374 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:33:17 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-01ead717-0e46-45ef-8567-fd8d15b8b631 tempest-VolumesListTestJSON-1213495374 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:33:17 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-01ead717-0e46-45ef-8567-fd8d15b8b631 tempest-VolumesListTestJSON-1213495374 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:33:17 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-01ead717-0e46-45ef-8567-fd8d15b8b631 tempest-VolumesListTestJSON-1213495374 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:33:17 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-01ead717-0e46-45ef-8567-fd8d15b8b631 tempest-VolumesListTestJSON-1213495374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:33:17 devstack sudo[95595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a Aug 03 08:33:17 devstack sudo[95595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:33:17 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-20070f6b-c318-4c00-a4ae-d52b294dd9d3 tempest-GroupSnapshotsTest-1944413600 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:33:17 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-20070f6b-c318-4c00-a4ae-d52b294dd9d3 tempest-GroupSnapshotsTest-1944413600 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:33:17 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-20070f6b-c318-4c00-a4ae-d52b294dd9d3 tempest-GroupSnapshotsTest-1944413600 None] Acquiring lock "cinder-quobyte-05aab29c-362a-4880-975d-ed51500d17d1-024abc5e-24b6-407d-971b-456d23bd2d37" by "_create_volume_from_snapshot" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:33:17 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-20070f6b-c318-4c00-a4ae-d52b294dd9d3 tempest-GroupSnapshotsTest-1944413600 None] Lock "cinder-quobyte-05aab29c-362a-4880-975d-ed51500d17d1-024abc5e-24b6-407d-971b-456d23bd2d37" acquired by "_create_volume_from_snapshot" :: waited 0.021s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:33:17 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-20070f6b-c318-4c00-a4ae-d52b294dd9d3 tempest-GroupSnapshotsTest-1944413600 None] Creating volume 024abc5e-24b6-407d-971b-456d23bd2d37 from snapshot 05aab29c-362a-4880-975d-ed51500d17d1 {{(pid=88899) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Aug 03 08:33:17 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-20070f6b-c318-4c00-a4ae-d52b294dd9d3 tempest-GroupSnapshotsTest-1944413600 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:33:17 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-20070f6b-c318-4c00-a4ae-d52b294dd9d3 tempest-GroupSnapshotsTest-1944413600 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:33:17 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-20070f6b-c318-4c00-a4ae-d52b294dd9d3 tempest-GroupSnapshotsTest-1944413600 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:33:17 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-20070f6b-c318-4c00-a4ae-d52b294dd9d3 tempest-GroupSnapshotsTest-1944413600 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:33:17 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-20070f6b-c318-4c00-a4ae-d52b294dd9d3 tempest-GroupSnapshotsTest-1944413600 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:33:17 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-20070f6b-c318-4c00-a4ae-d52b294dd9d3 tempest-GroupSnapshotsTest-1944413600 None] Selected osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385 as target Quobyte volume. {{(pid=88899) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 08:33:17 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-20070f6b-c318-4c00-a4ae-d52b294dd9d3 tempest-GroupSnapshotsTest-1944413600 None] Acquiring lock "cinder-quobyte-024abc5e-24b6-407d-971b-456d23bd2d37" by "_copy_volume_from_snapshot" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:33:17 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-20070f6b-c318-4c00-a4ae-d52b294dd9d3 tempest-GroupSnapshotsTest-1944413600 None] Lock "cinder-quobyte-024abc5e-24b6-407d-971b-456d23bd2d37" acquired by "_copy_volume_from_snapshot" :: waited 0.024s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:33:17 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-20070f6b-c318-4c00-a4ae-d52b294dd9d3 tempest-GroupSnapshotsTest-1944413600 None] snapshot: 05aab29c-362a-4880-975d-ed51500d17d1, volume: 024abc5e-24b6-407d-971b-456d23bd2d37, {{(pid=88899) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Aug 03 08:33:17 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-20070f6b-c318-4c00-a4ae-d52b294dd9d3 tempest-GroupSnapshotsTest-1944413600 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:33:17 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-20070f6b-c318-4c00-a4ae-d52b294dd9d3 tempest-GroupSnapshotsTest-1944413600 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:33:17 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-20070f6b-c318-4c00-a4ae-d52b294dd9d3 tempest-GroupSnapshotsTest-1944413600 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:33:18 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-20070f6b-c318-4c00-a4ae-d52b294dd9d3 tempest-GroupSnapshotsTest-1944413600 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:33:18 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-20070f6b-c318-4c00-a4ae-d52b294dd9d3 tempest-GroupSnapshotsTest-1944413600 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:33:18 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8ec1071-d0c8-4235-aeca-6c8f6c9cdc75]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:33:18 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-20070f6b-c318-4c00-a4ae-d52b294dd9d3 tempest-GroupSnapshotsTest-1944413600 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c0651975-f526-4de6-91f1-d550d4bdc582.05aab29c-362a-4880-975d-ed51500d17d1 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:33:18 devstack sudo[95595]: pam_unix(sudo:session): session closed for user root Aug 03 08:33:18 devstack sudo[95598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c0651975-f526-4de6-91f1-d550d4bdc582.05aab29c-362a-4880-975d-ed51500d17d1 Aug 03 08:33:18 devstack sudo[95598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:33:18 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-01ead717-0e46-45ef-8567-fd8d15b8b631 tempest-VolumesListTestJSON-1213495374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a" returned: 0 in 0.615s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:33:18 devstack cinder-volume[88899]: DEBUG cinder.manager [None req-01ead717-0e46-45ef-8567-fd8d15b8b631 tempest-VolumesListTestJSON-1213495374 None] Notifying Schedulers of capabilities ... {{(pid=88899) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 08:33:18 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-01ead717-0e46-45ef-8567-fd8d15b8b631 tempest-VolumesListTestJSON-1213495374 None] Deleted volume successfully. Aug 03 08:33:18 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-01ead717-0e46-45ef-8567-fd8d15b8b631 tempest-VolumesListTestJSON-1213495374 None] Lock "cinder-79b81383-4012-4f41-99af-fbbb805b719f-delete_volume" released by "delete_volume" :: held 2.353s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:33:18 devstack sudo[95598]: pam_unix(sudo:session): session closed for user root Aug 03 08:33:18 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-20070f6b-c318-4c00-a4ae-d52b294dd9d3 tempest-GroupSnapshotsTest-1944413600 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c0651975-f526-4de6-91f1-d550d4bdc582.05aab29c-362a-4880-975d-ed51500d17d1" returned: 0 in 0.631s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:33:18 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-20070f6b-c318-4c00-a4ae-d52b294dd9d3 tempest-GroupSnapshotsTest-1944413600 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c0651975-f526-4de6-91f1-d550d4bdc582(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88899) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 03 08:33:18 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b0a3f2e-20d4-4c88-8bca-a2c99e202c97]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:33:18 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-20070f6b-c318-4c00-a4ae-d52b294dd9d3 tempest-GroupSnapshotsTest-1944413600 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c0651975-f526-4de6-91f1-d550d4bdc582 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:33:18 devstack sudo[95603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c0651975-f526-4de6-91f1-d550d4bdc582 Aug 03 08:33:18 devstack sudo[95603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:33:19 devstack sudo[95603]: pam_unix(sudo:session): session closed for user root Aug 03 08:33:19 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-20070f6b-c318-4c00-a4ae-d52b294dd9d3 tempest-GroupSnapshotsTest-1944413600 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c0651975-f526-4de6-91f1-d550d4bdc582" returned: 0 in 0.572s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:33:19 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-20070f6b-c318-4c00-a4ae-d52b294dd9d3 tempest-GroupSnapshotsTest-1944413600 None] will copy from snapshot at /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c0651975-f526-4de6-91f1-d550d4bdc582 {{(pid=88899) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Aug 03 08:33:19 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-20070f6b-c318-4c00-a4ae-d52b294dd9d3 tempest-GroupSnapshotsTest-1944413600 None] Creating direct copy from snapshot {{(pid=88899) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Aug 03 08:33:19 devstack cinder-volume[88899]: DEBUG cinder.utils [None req-20070f6b-c318-4c00-a4ae-d52b294dd9d3 tempest-GroupSnapshotsTest-1944413600 None] Path /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-024abc5e-24b6-407d-971b-456d23bd2d37 not found in is_blk_device check {{(pid=88899) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Aug 03 08:33:19 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-20070f6b-c318-4c00-a4ae-d52b294dd9d3 tempest-GroupSnapshotsTest-1944413600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c0651975-f526-4de6-91f1-d550d4bdc582 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-024abc5e-24b6-407d-971b-456d23bd2d37 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:33:19 devstack sudo[95608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c0651975-f526-4de6-91f1-d550d4bdc582 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-024abc5e-24b6-407d-971b-456d23bd2d37 Aug 03 08:33:19 devstack sudo[95608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:33:27 devstack cinder-volume[88899]: DEBUG dbcounter [-] [88899] Writing DB stats cinder:INSERT=17,cinder:SELECT=63,cinder:UPDATE=73,cinder:DELETE=3 {{(pid=88899) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 03 08:33:28 devstack cinder-volume[88899]: DEBUG dbcounter [-] [88899] Writing DB stats cinder:SELECT=46,cinder:UPDATE=39,cinder:DELETE=6,cinder:INSERT=8 {{(pid=88899) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 03 08:33:28 devstack sudo[95608]: pam_unix(sudo:session): session closed for user root Aug 03 08:33:28 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-20070f6b-c318-4c00-a4ae-d52b294dd9d3 tempest-GroupSnapshotsTest-1944413600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c0651975-f526-4de6-91f1-d550d4bdc582 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-024abc5e-24b6-407d-971b-456d23bd2d37" returned: 0 in 9.154s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:33:28 devstack cinder-volume[88899]: DEBUG cinder.image.image_utils [None req-20070f6b-c318-4c00-a4ae-d52b294dd9d3 tempest-GroupSnapshotsTest-1944413600 None] Image conversion details: src /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c0651975-f526-4de6-91f1-d550d4bdc582, size 1024.00 MB, duration 9.15 sec, destination /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-024abc5e-24b6-407d-971b-456d23bd2d37 {{(pid=88899) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 03 08:33:28 devstack cinder-volume[88899]: INFO cinder.image.image_utils [None req-20070f6b-c318-4c00-a4ae-d52b294dd9d3 tempest-GroupSnapshotsTest-1944413600 None] Converted 1024.00 MB image at 111.86 MB/s Aug 03 08:33:28 devstack cinder-volume[88899]: WARNING cinder.volume.drivers.remotefs [None req-20070f6b-c318-4c00-a4ae-d52b294dd9d3 tempest-GroupSnapshotsTest-1944413600 None] /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-024abc5e-24b6-407d-971b-456d23bd2d37 is being set with open permissions: ugo+rw: NotImplementedError Aug 03 08:33:28 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-20070f6b-c318-4c00-a4ae-d52b294dd9d3 tempest-GroupSnapshotsTest-1944413600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-024abc5e-24b6-407d-971b-456d23bd2d37 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:33:28 devstack sudo[95663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-024abc5e-24b6-407d-971b-456d23bd2d37 Aug 03 08:33:28 devstack sudo[95663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:33:28 devstack sudo[95663]: pam_unix(sudo:session): session closed for user root Aug 03 08:33:28 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-20070f6b-c318-4c00-a4ae-d52b294dd9d3 tempest-GroupSnapshotsTest-1944413600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-024abc5e-24b6-407d-971b-456d23bd2d37" returned: 0 in 0.356s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:33:28 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-20070f6b-c318-4c00-a4ae-d52b294dd9d3 tempest-GroupSnapshotsTest-1944413600 None] Lock "cinder-quobyte-024abc5e-24b6-407d-971b-456d23bd2d37" released by "_copy_volume_from_snapshot" :: held 10.871s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:33:28 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-20070f6b-c318-4c00-a4ae-d52b294dd9d3 tempest-GroupSnapshotsTest-1944413600 None] Lock "cinder-quobyte-05aab29c-362a-4880-975d-ed51500d17d1-024abc5e-24b6-407d-971b-456d23bd2d37" released by "_create_volume_from_snapshot" :: held 10.978s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:33:28 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-20070f6b-c318-4c00-a4ae-d52b294dd9d3 tempest-GroupSnapshotsTest-1944413600 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.006s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:33:29 devstack cinder-volume[88899]: DEBUG cinder.volume.flows.manager.create_volume [None req-87771b47-2a62-4201-9643-64e84d48b56e tempest-VolumesSnapshotListTestJSON-651293966 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88899) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 08:33:29 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-87771b47-2a62-4201-9643-64e84d48b56e tempest-VolumesSnapshotListTestJSON-651293966 None] Flow 'volume_create_manager' (deb6c790-89cb-4293-87e7-d7440fb4b9d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:33:29 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-87771b47-2a62-4201-9643-64e84d48b56e tempest-VolumesSnapshotListTestJSON-651293966 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (52742ad1-b12b-4c4f-915c-b109c9c8e16a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:33:29 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-87771b47-2a62-4201-9643-64e84d48b56e tempest-VolumesSnapshotListTestJSON-651293966 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (52742ad1-b12b-4c4f-915c-b109c9c8e16a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:33:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-535717632',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9e50c09-afac-4032-8c98-137af4f2f895,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f82decefa098427980123db4e5331d7a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:33:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:33:29Z,use_quota=True,user_id='fa079a43dcf84240a9109ee4eae4445c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8bde7129-1dc4-42ab-b852-ab32c61b4921),volume_type_id=8bde7129-1dc4-42ab-b852-ab32c61b4921)' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:33:29 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-87771b47-2a62-4201-9643-64e84d48b56e tempest-VolumesSnapshotListTestJSON-651293966 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (00dcf166-4b7e-46ca-8519-b2b93640ecca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:33:29 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-87771b47-2a62-4201-9643-64e84d48b56e tempest-VolumesSnapshotListTestJSON-651293966 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (00dcf166-4b7e-46ca-8519-b2b93640ecca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:33:29 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-87771b47-2a62-4201-9643-64e84d48b56e tempest-VolumesSnapshotListTestJSON-651293966 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5c2185d-c88a-4a1a-b66f-e13bcb9bfe0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:33:29 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-87771b47-2a62-4201-9643-64e84d48b56e tempest-VolumesSnapshotListTestJSON-651293966 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5c2185d-c88a-4a1a-b66f-e13bcb9bfe0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b9e50c09-afac-4032-8c98-137af4f2f895', 'volume_name': 'volume-b9e50c09-afac-4032-8c98-137af4f2f895', 'volume_size': 1}' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:33:29 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-87771b47-2a62-4201-9643-64e84d48b56e tempest-VolumesSnapshotListTestJSON-651293966 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a97d8a9-e5d9-4f9c-bd73-40e9222aef22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:33:29 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-87771b47-2a62-4201-9643-64e84d48b56e tempest-VolumesSnapshotListTestJSON-651293966 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a97d8a9-e5d9-4f9c-bd73-40e9222aef22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:33:29 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-87771b47-2a62-4201-9643-64e84d48b56e tempest-VolumesSnapshotListTestJSON-651293966 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f570dd80-4e59-45c4-ba8b-5dc0c74f401d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:33:29 devstack cinder-volume[88899]: INFO cinder.volume.flows.manager.create_volume [None req-87771b47-2a62-4201-9643-64e84d48b56e tempest-VolumesSnapshotListTestJSON-651293966 None] Volume b9e50c09-afac-4032-8c98-137af4f2f895: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b9e50c09-afac-4032-8c98-137af4f2f895', 'volume_size': 1} Aug 03 08:33:29 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-87771b47-2a62-4201-9643-64e84d48b56e tempest-VolumesSnapshotListTestJSON-651293966 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:33:29 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-87771b47-2a62-4201-9643-64e84d48b56e tempest-VolumesSnapshotListTestJSON-651293966 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:33:29 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-87771b47-2a62-4201-9643-64e84d48b56e tempest-VolumesSnapshotListTestJSON-651293966 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:33:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-535717632',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9e50c09-afac-4032-8c98-137af4f2f895,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f82decefa098427980123db4e5331d7a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:33:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:33:29Z,use_quota=True,user_id='fa079a43dcf84240a9109ee4eae4445c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8bde7129-1dc4-42ab-b852-ab32c61b4921),volume_type_id=8bde7129-1dc4-42ab-b852-ab32c61b4921)}" {{(pid=88899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 08:33:29 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-87771b47-2a62-4201-9643-64e84d48b56e tempest-VolumesSnapshotListTestJSON-651293966 None] Creating volume b9e50c09-afac-4032-8c98-137af4f2f895 {{(pid=88899) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 08:33:29 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-87771b47-2a62-4201-9643-64e84d48b56e tempest-VolumesSnapshotListTestJSON-651293966 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:33:29 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-87771b47-2a62-4201-9643-64e84d48b56e tempest-VolumesSnapshotListTestJSON-651293966 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:33:29 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-87771b47-2a62-4201-9643-64e84d48b56e tempest-VolumesSnapshotListTestJSON-651293966 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:33:29 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-87771b47-2a62-4201-9643-64e84d48b56e tempest-VolumesSnapshotListTestJSON-651293966 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:33:29 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-87771b47-2a62-4201-9643-64e84d48b56e tempest-VolumesSnapshotListTestJSON-651293966 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:33:29 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-87771b47-2a62-4201-9643-64e84d48b56e tempest-VolumesSnapshotListTestJSON-651293966 None] Selected osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385 as target Quobyte volume. {{(pid=88899) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 08:33:29 devstack cinder-volume[88899]: INFO cinder.volume.drivers.remotefs [None req-87771b47-2a62-4201-9643-64e84d48b56e tempest-VolumesSnapshotListTestJSON-651293966 None] casted to osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385 Aug 03 08:33:29 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-87771b47-2a62-4201-9643-64e84d48b56e tempest-VolumesSnapshotListTestJSON-651293966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-b9e50c09-afac-4032-8c98-137af4f2f895 1073741824 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:33:29 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-20070f6b-c318-4c00-a4ae-d52b294dd9d3 tempest-GroupSnapshotsTest-1944413600 None] Create group from source-snapshot-9c64bc4a-6d6d-4bd4-a3df-878023b97acb completed successfully. Aug 03 08:33:29 devstack sudo[95670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-b9e50c09-afac-4032-8c98-137af4f2f895 1073741824 Aug 03 08:33:29 devstack sudo[95670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:33:29 devstack sudo[95670]: pam_unix(sudo:session): session closed for user root Aug 03 08:33:29 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-87771b47-2a62-4201-9643-64e84d48b56e tempest-VolumesSnapshotListTestJSON-651293966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-b9e50c09-afac-4032-8c98-137af4f2f895 1073741824" returned: 0 in 0.460s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:33:29 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-87771b47-2a62-4201-9643-64e84d48b56e tempest-VolumesSnapshotListTestJSON-651293966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-b9e50c09-afac-4032-8c98-137af4f2f895 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:33:29 devstack sudo[95699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-b9e50c09-afac-4032-8c98-137af4f2f895 Aug 03 08:33:29 devstack sudo[95699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:33:29 devstack sudo[95699]: pam_unix(sudo:session): session closed for user root Aug 03 08:33:29 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-87771b47-2a62-4201-9643-64e84d48b56e tempest-VolumesSnapshotListTestJSON-651293966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-b9e50c09-afac-4032-8c98-137af4f2f895" returned: 0 in 0.275s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:33:29 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-87771b47-2a62-4201-9643-64e84d48b56e tempest-VolumesSnapshotListTestJSON-651293966 None] <== create_volume: return (778ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'} {{(pid=88899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 08:33:29 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-87771b47-2a62-4201-9643-64e84d48b56e tempest-VolumesSnapshotListTestJSON-651293966 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.780s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:33:29 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-87771b47-2a62-4201-9643-64e84d48b56e tempest-VolumesSnapshotListTestJSON-651293966 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f570dd80-4e59-45c4-ba8b-5dc0c74f401d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b9e50c09-afac-4032-8c98-137af4f2f895', 'volume_size': 1}' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:33:29 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-87771b47-2a62-4201-9643-64e84d48b56e tempest-VolumesSnapshotListTestJSON-651293966 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ddc1724-415e-4472-b2f0-19b0afd2a2c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:33:29 devstack cinder-volume[88899]: INFO cinder.volume.flows.manager.create_volume [None req-87771b47-2a62-4201-9643-64e84d48b56e tempest-VolumesSnapshotListTestJSON-651293966 None] Volume volume-b9e50c09-afac-4032-8c98-137af4f2f895 (b9e50c09-afac-4032-8c98-137af4f2f895): created successfully Aug 03 08:33:29 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-87771b47-2a62-4201-9643-64e84d48b56e tempest-VolumesSnapshotListTestJSON-651293966 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ddc1724-415e-4472-b2f0-19b0afd2a2c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:33:29 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-87771b47-2a62-4201-9643-64e84d48b56e tempest-VolumesSnapshotListTestJSON-651293966 None] Flow 'volume_create_manager' (deb6c790-89cb-4293-87e7-d7440fb4b9d1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:33:29 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-87771b47-2a62-4201-9643-64e84d48b56e tempest-VolumesSnapshotListTestJSON-651293966 None] Created volume successfully. Aug 03 08:33:30 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-1150ee40-0cfc-46d7-950b-3cda6a4e5be8 tempest-GroupSnapshotsTest-1944413600 None] Acquiring lock "cinder-quobyte-024abc5e-24b6-407d-971b-456d23bd2d37" by "delete_volume" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:33:30 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-1150ee40-0cfc-46d7-950b-3cda6a4e5be8 tempest-GroupSnapshotsTest-1944413600 None] Lock "cinder-quobyte-024abc5e-24b6-407d-971b-456d23bd2d37" acquired by "delete_volume" :: waited 0.033s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:33:30 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae491af6-4678-49b3-95de-332f6ec956f6]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:33:30 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-1150ee40-0cfc-46d7-950b-3cda6a4e5be8 tempest-GroupSnapshotsTest-1944413600 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-024abc5e-24b6-407d-971b-456d23bd2d37 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:33:30 devstack sudo[95704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-024abc5e-24b6-407d-971b-456d23bd2d37 Aug 03 08:33:30 devstack sudo[95704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:33:30 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-5dde1e8a-a2da-43b7-b906-69f11afc2d19 tempest-VolumesSnapshotListTestJSON-651293966 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:33:30 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-5dde1e8a-a2da-43b7-b906-69f11afc2d19 tempest-VolumesSnapshotListTestJSON-651293966 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:33:30 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-5dde1e8a-a2da-43b7-b906-69f11afc2d19 tempest-VolumesSnapshotListTestJSON-651293966 None] Creating offline snapshot 14861506-e7da-488b-9ede-7908c1a2012b of volume b9e50c09-afac-4032-8c98-137af4f2f895 {{(pid=88899) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 03 08:33:30 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[a657920b-4706-49ee-af7f-ca1d7465df56]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:33:30 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-5dde1e8a-a2da-43b7-b906-69f11afc2d19 tempest-VolumesSnapshotListTestJSON-651293966 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-b9e50c09-afac-4032-8c98-137af4f2f895 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:33:30 devstack sudo[95706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-b9e50c09-afac-4032-8c98-137af4f2f895 Aug 03 08:33:30 devstack sudo[95706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:33:30 devstack sudo[95704]: pam_unix(sudo:session): session closed for user root Aug 03 08:33:30 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-1150ee40-0cfc-46d7-950b-3cda6a4e5be8 tempest-GroupSnapshotsTest-1944413600 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-024abc5e-24b6-407d-971b-456d23bd2d37" returned: 0 in 0.470s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:33:30 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-1150ee40-0cfc-46d7-950b-3cda6a4e5be8 tempest-GroupSnapshotsTest-1944413600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-024abc5e-24b6-407d-971b-456d23bd2d37 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:33:30 devstack sudo[95729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-024abc5e-24b6-407d-971b-456d23bd2d37 Aug 03 08:33:30 devstack sudo[95729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:33:30 devstack sudo[95706]: pam_unix(sudo:session): session closed for user root Aug 03 08:33:30 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-5dde1e8a-a2da-43b7-b906-69f11afc2d19 tempest-VolumesSnapshotListTestJSON-651293966 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-b9e50c09-afac-4032-8c98-137af4f2f895" returned: 0 in 0.457s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:33:30 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-5dde1e8a-a2da-43b7-b906-69f11afc2d19 tempest-VolumesSnapshotListTestJSON-651293966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-b9e50c09-afac-4032-8c98-137af4f2f895,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-b9e50c09-afac-4032-8c98-137af4f2f895.14861506-e7da-488b-9ede-7908c1a2012b 1G {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:33:30 devstack sudo[95734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-b9e50c09-afac-4032-8c98-137af4f2f895,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-b9e50c09-afac-4032-8c98-137af4f2f895.14861506-e7da-488b-9ede-7908c1a2012b 1G Aug 03 08:33:30 devstack sudo[95734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:33:31 devstack sudo[95729]: pam_unix(sudo:session): session closed for user root Aug 03 08:33:31 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-1150ee40-0cfc-46d7-950b-3cda6a4e5be8 tempest-GroupSnapshotsTest-1944413600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-024abc5e-24b6-407d-971b-456d23bd2d37" returned: 0 in 0.307s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:33:31 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-1150ee40-0cfc-46d7-950b-3cda6a4e5be8 tempest-GroupSnapshotsTest-1944413600 None] Lock "cinder-quobyte-024abc5e-24b6-407d-971b-456d23bd2d37" released by "delete_volume" :: held 0.841s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:33:31 devstack cinder-volume[88899]: DEBUG cinder.quota [None req-1150ee40-0cfc-46d7-950b-3cda6a4e5be8 tempest-GroupSnapshotsTest-1944413600 None] Created reservations ['657bf8ee-21c4-4b21-9d7a-59b8c2732f46'] {{(pid=88899) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 08:33:31 devstack cinder-volume[88899]: WARNING cinder.quota [None req-1150ee40-0cfc-46d7-950b-3cda6a4e5be8 tempest-GroupSnapshotsTest-1944413600 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-2085549362 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-2085549362, it is now deprecated. Please use the default quota class for default quota. Aug 03 08:33:31 devstack cinder-volume[88899]: WARNING cinder.quota [None req-1150ee40-0cfc-46d7-950b-3cda6a4e5be8 tempest-GroupSnapshotsTest-1944413600 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-2085549362 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-2085549362, it is now deprecated. Please use the default quota class for default quota. Aug 03 08:33:31 devstack cinder-volume[88899]: DEBUG cinder.quota [None req-1150ee40-0cfc-46d7-950b-3cda6a4e5be8 tempest-GroupSnapshotsTest-1944413600 None] Created reservations ['4a13238a-4cea-4575-b7ca-1060ad40e049', 'ac443795-0674-4f7e-8eab-c4dc3d888669', '64762736-b1fa-41b8-8f9c-d0f7cbdec9a2', '4deca8af-eafa-4122-929e-77f40300d15a'] {{(pid=88899) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 08:33:31 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-1150ee40-0cfc-46d7-950b-3cda6a4e5be8 tempest-GroupSnapshotsTest-1944413600 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:33:31 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-1150ee40-0cfc-46d7-950b-3cda6a4e5be8 tempest-GroupSnapshotsTest-1944413600 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:33:31 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-1150ee40-0cfc-46d7-950b-3cda6a4e5be8 tempest-GroupSnapshotsTest-1944413600 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:33:31 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-1150ee40-0cfc-46d7-950b-3cda6a4e5be8 tempest-GroupSnapshotsTest-1944413600 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:33:31 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-1150ee40-0cfc-46d7-950b-3cda6a4e5be8 tempest-GroupSnapshotsTest-1944413600 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:33:31 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-1150ee40-0cfc-46d7-950b-3cda6a4e5be8 tempest-GroupSnapshotsTest-1944413600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:33:31 devstack sudo[95741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a Aug 03 08:33:31 devstack sudo[95741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:33:31 devstack sudo[95734]: pam_unix(sudo:session): session closed for user root Aug 03 08:33:31 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-5dde1e8a-a2da-43b7-b906-69f11afc2d19 tempest-VolumesSnapshotListTestJSON-651293966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-b9e50c09-afac-4032-8c98-137af4f2f895,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-b9e50c09-afac-4032-8c98-137af4f2f895.14861506-e7da-488b-9ede-7908c1a2012b 1G" returned: 0 in 0.531s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:33:31 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-5dde1e8a-a2da-43b7-b906-69f11afc2d19 tempest-VolumesSnapshotListTestJSON-651293966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b9e50c09-afac-4032-8c98-137af4f2f895 -F qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-b9e50c09-afac-4032-8c98-137af4f2f895.14861506-e7da-488b-9ede-7908c1a2012b {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:33:31 devstack sudo[95743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b9e50c09-afac-4032-8c98-137af4f2f895 -F qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-b9e50c09-afac-4032-8c98-137af4f2f895.14861506-e7da-488b-9ede-7908c1a2012b Aug 03 08:33:31 devstack sudo[95743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:33:31 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-6123f87b-b4df-4736-aed0-fa72c3ab6338 tempest-GroupSnapshotsTest-1944413600 None] group_snapshot 9c64bc4a-6d6d-4bd4-a3df-878023b97acb: deleting Aug 03 08:33:31 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-6123f87b-b4df-4736-aed0-fa72c3ab6338 tempest-GroupSnapshotsTest-1944413600 None] group_snapshot 9c64bc4a-6d6d-4bd4-a3df-878023b97acb: deleting {{(pid=88899) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Aug 03 08:33:31 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-6123f87b-b4df-4736-aed0-fa72c3ab6338 tempest-GroupSnapshotsTest-1944413600 None] Acquiring lock "cinder-quobyte-c0651975-f526-4de6-91f1-d550d4bdc582" by "delete_snapshot" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:33:31 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-6123f87b-b4df-4736-aed0-fa72c3ab6338 tempest-GroupSnapshotsTest-1944413600 None] Lock "cinder-quobyte-c0651975-f526-4de6-91f1-d550d4bdc582" acquired by "delete_snapshot" :: waited 0.020s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:33:31 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-6123f87b-b4df-4736-aed0-fa72c3ab6338 tempest-GroupSnapshotsTest-1944413600 None] Acquiring lock "cinder-quobyte-05aab29c-362a-4880-975d-ed51500d17d1" by "_delete_snapshot" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:33:31 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-6123f87b-b4df-4736-aed0-fa72c3ab6338 tempest-GroupSnapshotsTest-1944413600 None] Lock "cinder-quobyte-05aab29c-362a-4880-975d-ed51500d17d1" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:33:31 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-6123f87b-b4df-4736-aed0-fa72c3ab6338 tempest-GroupSnapshotsTest-1944413600 None] Deleting offline snapshot 05aab29c-362a-4880-975d-ed51500d17d1 of volume c0651975-f526-4de6-91f1-d550d4bdc582 {{(pid=88899) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 03 08:33:31 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-6123f87b-b4df-4736-aed0-fa72c3ab6338 tempest-GroupSnapshotsTest-1944413600 None] snapshot_file for this snap is: volume-c0651975-f526-4de6-91f1-d550d4bdc582.05aab29c-362a-4880-975d-ed51500d17d1 {{(pid=88899) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 03 08:33:31 devstack sudo[95741]: pam_unix(sudo:session): session closed for user root Aug 03 08:33:31 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e3fd8da-9f11-4124-a870-a2a79dc3ed23]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:33:31 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-6123f87b-b4df-4736-aed0-fa72c3ab6338 tempest-GroupSnapshotsTest-1944413600 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c0651975-f526-4de6-91f1-d550d4bdc582.05aab29c-362a-4880-975d-ed51500d17d1 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:33:31 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-1150ee40-0cfc-46d7-950b-3cda6a4e5be8 tempest-GroupSnapshotsTest-1944413600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a" returned: 0 in 0.363s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:33:31 devstack cinder-volume[88899]: DEBUG cinder.manager [None req-1150ee40-0cfc-46d7-950b-3cda6a4e5be8 tempest-GroupSnapshotsTest-1944413600 None] Notifying Schedulers of capabilities ... {{(pid=88899) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 08:33:31 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-1150ee40-0cfc-46d7-950b-3cda6a4e5be8 tempest-GroupSnapshotsTest-1944413600 None] Delete group completed successfully. Aug 03 08:33:31 devstack sudo[95743]: pam_unix(sudo:session): session closed for user root Aug 03 08:33:31 devstack sudo[95746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c0651975-f526-4de6-91f1-d550d4bdc582.05aab29c-362a-4880-975d-ed51500d17d1 Aug 03 08:33:31 devstack sudo[95746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:33:31 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-5dde1e8a-a2da-43b7-b906-69f11afc2d19 tempest-VolumesSnapshotListTestJSON-651293966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b9e50c09-afac-4032-8c98-137af4f2f895 -F qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-b9e50c09-afac-4032-8c98-137af4f2f895.14861506-e7da-488b-9ede-7908c1a2012b" returned: 0 in 0.340s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:33:31 devstack cinder-volume[88899]: WARNING cinder.volume.drivers.remotefs [None req-5dde1e8a-a2da-43b7-b906-69f11afc2d19 tempest-VolumesSnapshotListTestJSON-651293966 None] /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-b9e50c09-afac-4032-8c98-137af4f2f895.14861506-e7da-488b-9ede-7908c1a2012b is being set with open permissions: ugo+rw Aug 03 08:33:31 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-5dde1e8a-a2da-43b7-b906-69f11afc2d19 tempest-VolumesSnapshotListTestJSON-651293966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-b9e50c09-afac-4032-8c98-137af4f2f895.14861506-e7da-488b-9ede-7908c1a2012b {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:33:31 devstack sudo[95751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-b9e50c09-afac-4032-8c98-137af4f2f895.14861506-e7da-488b-9ede-7908c1a2012b Aug 03 08:33:31 devstack sudo[95751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:33:32 devstack sudo[95751]: pam_unix(sudo:session): session closed for user root Aug 03 08:33:32 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-5dde1e8a-a2da-43b7-b906-69f11afc2d19 tempest-VolumesSnapshotListTestJSON-651293966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-b9e50c09-afac-4032-8c98-137af4f2f895.14861506-e7da-488b-9ede-7908c1a2012b" returned: 0 in 0.239s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:33:32 devstack sudo[95746]: pam_unix(sudo:session): session closed for user root Aug 03 08:33:32 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-6123f87b-b4df-4736-aed0-fa72c3ab6338 tempest-GroupSnapshotsTest-1944413600 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c0651975-f526-4de6-91f1-d550d4bdc582.05aab29c-362a-4880-975d-ed51500d17d1" returned: 0 in 0.392s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:33:32 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-6123f87b-b4df-4736-aed0-fa72c3ab6338 tempest-GroupSnapshotsTest-1944413600 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c0651975-f526-4de6-91f1-d550d4bdc582(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88899) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 03 08:33:32 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[4df45564-4ea8-4388-bd5f-136188e70d23]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:33:32 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-6123f87b-b4df-4736-aed0-fa72c3ab6338 tempest-GroupSnapshotsTest-1944413600 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c0651975-f526-4de6-91f1-d550d4bdc582 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:33:32 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-5dde1e8a-a2da-43b7-b906-69f11afc2d19 tempest-VolumesSnapshotListTestJSON-651293966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-b9e50c09-afac-4032-8c98-137af4f2f895.info {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:33:32 devstack sudo[95759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-b9e50c09-afac-4032-8c98-137af4f2f895.info Aug 03 08:33:32 devstack sudo[95759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:33:32 devstack sudo[95758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c0651975-f526-4de6-91f1-d550d4bdc582 Aug 03 08:33:32 devstack sudo[95758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:33:32 devstack sudo[95759]: pam_unix(sudo:session): session closed for user root Aug 03 08:33:32 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-5dde1e8a-a2da-43b7-b906-69f11afc2d19 tempest-VolumesSnapshotListTestJSON-651293966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-b9e50c09-afac-4032-8c98-137af4f2f895.info" returned: 0 in 0.237s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:33:32 devstack cinder-volume[88899]: WARNING cinder.volume.drivers.remotefs [None req-5dde1e8a-a2da-43b7-b906-69f11afc2d19 tempest-VolumesSnapshotListTestJSON-651293966 None] /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-b9e50c09-afac-4032-8c98-137af4f2f895.info is being set with open permissions: ugo+rw Aug 03 08:33:32 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-5dde1e8a-a2da-43b7-b906-69f11afc2d19 tempest-VolumesSnapshotListTestJSON-651293966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-b9e50c09-afac-4032-8c98-137af4f2f895.info {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:33:32 devstack sudo[95763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-b9e50c09-afac-4032-8c98-137af4f2f895.info Aug 03 08:33:32 devstack sudo[95763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:33:32 devstack sudo[95763]: pam_unix(sudo:session): session closed for user root Aug 03 08:33:32 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-5dde1e8a-a2da-43b7-b906-69f11afc2d19 tempest-VolumesSnapshotListTestJSON-651293966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-b9e50c09-afac-4032-8c98-137af4f2f895.info" returned: 0 in 0.241s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:33:32 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-5dde1e8a-a2da-43b7-b906-69f11afc2d19 tempest-VolumesSnapshotListTestJSON-651293966 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.172s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:33:32 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-5dde1e8a-a2da-43b7-b906-69f11afc2d19 tempest-VolumesSnapshotListTestJSON-651293966 None] Create snapshot completed successfully Aug 03 08:33:32 devstack sudo[95758]: pam_unix(sudo:session): session closed for user root Aug 03 08:33:32 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-6123f87b-b4df-4736-aed0-fa72c3ab6338 tempest-GroupSnapshotsTest-1944413600 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c0651975-f526-4de6-91f1-d550d4bdc582" returned: 0 in 0.557s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:33:32 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-6123f87b-b4df-4736-aed0-fa72c3ab6338 tempest-GroupSnapshotsTest-1944413600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c0651975-f526-4de6-91f1-d550d4bdc582.05aab29c-362a-4880-975d-ed51500d17d1 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:33:32 devstack sudo[95771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c0651975-f526-4de6-91f1-d550d4bdc582.05aab29c-362a-4880-975d-ed51500d17d1 Aug 03 08:33:32 devstack sudo[95771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:33:32 devstack sudo[95771]: pam_unix(sudo:session): session closed for user root Aug 03 08:33:32 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-6123f87b-b4df-4736-aed0-fa72c3ab6338 tempest-GroupSnapshotsTest-1944413600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c0651975-f526-4de6-91f1-d550d4bdc582.05aab29c-362a-4880-975d-ed51500d17d1" returned: 0 in 0.304s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:33:32 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-6123f87b-b4df-4736-aed0-fa72c3ab6338 tempest-GroupSnapshotsTest-1944413600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c0651975-f526-4de6-91f1-d550d4bdc582.05aab29c-362a-4880-975d-ed51500d17d1 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:33:32 devstack sudo[95777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c0651975-f526-4de6-91f1-d550d4bdc582.05aab29c-362a-4880-975d-ed51500d17d1 Aug 03 08:33:32 devstack sudo[95777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:33:33 devstack sudo[95777]: pam_unix(sudo:session): session closed for user root Aug 03 08:33:33 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-6123f87b-b4df-4736-aed0-fa72c3ab6338 tempest-GroupSnapshotsTest-1944413600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c0651975-f526-4de6-91f1-d550d4bdc582.05aab29c-362a-4880-975d-ed51500d17d1" returned: 0 in 0.253s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:33:33 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-6123f87b-b4df-4736-aed0-fa72c3ab6338 tempest-GroupSnapshotsTest-1944413600 None] Lock "cinder-quobyte-05aab29c-362a-4880-975d-ed51500d17d1" released by "_delete_snapshot" :: held 1.610s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:33:33 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-6123f87b-b4df-4736-aed0-fa72c3ab6338 tempest-GroupSnapshotsTest-1944413600 None] Lock "cinder-quobyte-c0651975-f526-4de6-91f1-d550d4bdc582" released by "delete_snapshot" :: held 1.641s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:33:33 devstack cinder-volume[88899]: WARNING cinder.quota [None req-6123f87b-b4df-4736-aed0-fa72c3ab6338 tempest-GroupSnapshotsTest-1944413600 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-2085549362 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-2085549362, it is now deprecated. Please use the default quota class for default quota. Aug 03 08:33:33 devstack cinder-volume[88899]: DEBUG cinder.quota [None req-6123f87b-b4df-4736-aed0-fa72c3ab6338 tempest-GroupSnapshotsTest-1944413600 None] Created reservations ['95d25fd2-25a8-47d5-abeb-4a6ce9b1fe96', '853c5a55-149a-4515-8bf1-48957d71760d', '3e33c1fc-af08-47d1-a2bc-56466cff8711', '97688b24-e119-442b-b945-12bf51958838'] {{(pid=88899) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 08:33:33 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-6123f87b-b4df-4736-aed0-fa72c3ab6338 tempest-GroupSnapshotsTest-1944413600 None] group_snapshot 9c64bc4a-6d6d-4bd4-a3df-878023b97acb: deleted successfully Aug 03 08:33:33 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-acfe1ef0-caf2-4c28-9b8f-32fd90a42cc4 tempest-VolumesSnapshotListTestJSON-651293966 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:33:33 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-acfe1ef0-caf2-4c28-9b8f-32fd90a42cc4 tempest-VolumesSnapshotListTestJSON-651293966 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:33:33 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-acfe1ef0-caf2-4c28-9b8f-32fd90a42cc4 tempest-VolumesSnapshotListTestJSON-651293966 None] Creating offline snapshot be35aae5-631b-4e7b-a335-b9dcb072fe8e of volume b9e50c09-afac-4032-8c98-137af4f2f895 {{(pid=88899) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 03 08:33:33 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[af8f0425-9c91-48be-83de-40be3101bf18]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:33:33 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-acfe1ef0-caf2-4c28-9b8f-32fd90a42cc4 tempest-VolumesSnapshotListTestJSON-651293966 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-b9e50c09-afac-4032-8c98-137af4f2f895.14861506-e7da-488b-9ede-7908c1a2012b {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:33:33 devstack sudo[95780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-b9e50c09-afac-4032-8c98-137af4f2f895.14861506-e7da-488b-9ede-7908c1a2012b Aug 03 08:33:33 devstack sudo[95780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:33:34 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-ee9605f5-7f89-430f-803b-c99d55ff449d tempest-GroupSnapshotsTest-1944413600 None] Acquiring lock "cinder-quobyte-c0651975-f526-4de6-91f1-d550d4bdc582" by "delete_volume" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:33:34 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-ee9605f5-7f89-430f-803b-c99d55ff449d tempest-GroupSnapshotsTest-1944413600 None] Lock "cinder-quobyte-c0651975-f526-4de6-91f1-d550d4bdc582" acquired by "delete_volume" :: waited 0.023s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:33:34 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0fea08b-f52d-42b0-9efa-1e753a1a51cf]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:33:34 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-ee9605f5-7f89-430f-803b-c99d55ff449d tempest-GroupSnapshotsTest-1944413600 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c0651975-f526-4de6-91f1-d550d4bdc582 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:33:34 devstack sudo[95780]: pam_unix(sudo:session): session closed for user root Aug 03 08:33:34 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-acfe1ef0-caf2-4c28-9b8f-32fd90a42cc4 tempest-VolumesSnapshotListTestJSON-651293966 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-b9e50c09-afac-4032-8c98-137af4f2f895.14861506-e7da-488b-9ede-7908c1a2012b" returned: 0 in 0.397s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:33:34 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-acfe1ef0-caf2-4c28-9b8f-32fd90a42cc4 tempest-VolumesSnapshotListTestJSON-651293966 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b9e50c09-afac-4032-8c98-137af4f2f895(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88899) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 03 08:33:34 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-acfe1ef0-caf2-4c28-9b8f-32fd90a42cc4 tempest-VolumesSnapshotListTestJSON-651293966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-b9e50c09-afac-4032-8c98-137af4f2f895.14861506-e7da-488b-9ede-7908c1a2012b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-b9e50c09-afac-4032-8c98-137af4f2f895.be35aae5-631b-4e7b-a335-b9dcb072fe8e 1G {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:33:34 devstack sudo[95786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-b9e50c09-afac-4032-8c98-137af4f2f895.14861506-e7da-488b-9ede-7908c1a2012b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-b9e50c09-afac-4032-8c98-137af4f2f895.be35aae5-631b-4e7b-a335-b9dcb072fe8e 1G Aug 03 08:33:34 devstack sudo[95786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:33:34 devstack sudo[95785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c0651975-f526-4de6-91f1-d550d4bdc582 Aug 03 08:33:34 devstack sudo[95785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:33:34 devstack sudo[95785]: pam_unix(sudo:session): session closed for user root Aug 03 08:33:34 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-ee9605f5-7f89-430f-803b-c99d55ff449d tempest-GroupSnapshotsTest-1944413600 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c0651975-f526-4de6-91f1-d550d4bdc582" returned: 0 in 0.366s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:33:34 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-ee9605f5-7f89-430f-803b-c99d55ff449d tempest-GroupSnapshotsTest-1944413600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c0651975-f526-4de6-91f1-d550d4bdc582 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:33:34 devstack sudo[95796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c0651975-f526-4de6-91f1-d550d4bdc582 Aug 03 08:33:34 devstack sudo[95796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:33:34 devstack sudo[95786]: pam_unix(sudo:session): session closed for user root Aug 03 08:33:34 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-acfe1ef0-caf2-4c28-9b8f-32fd90a42cc4 tempest-VolumesSnapshotListTestJSON-651293966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-b9e50c09-afac-4032-8c98-137af4f2f895.14861506-e7da-488b-9ede-7908c1a2012b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-b9e50c09-afac-4032-8c98-137af4f2f895.be35aae5-631b-4e7b-a335-b9dcb072fe8e 1G" returned: 0 in 0.415s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:33:34 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-acfe1ef0-caf2-4c28-9b8f-32fd90a42cc4 tempest-VolumesSnapshotListTestJSON-651293966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b9e50c09-afac-4032-8c98-137af4f2f895.14861506-e7da-488b-9ede-7908c1a2012b -F qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-b9e50c09-afac-4032-8c98-137af4f2f895.be35aae5-631b-4e7b-a335-b9dcb072fe8e {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:33:34 devstack sudo[95798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b9e50c09-afac-4032-8c98-137af4f2f895.14861506-e7da-488b-9ede-7908c1a2012b -F qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-b9e50c09-afac-4032-8c98-137af4f2f895.be35aae5-631b-4e7b-a335-b9dcb072fe8e Aug 03 08:33:34 devstack sudo[95798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:33:34 devstack sudo[95796]: pam_unix(sudo:session): session closed for user root Aug 03 08:33:34 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-ee9605f5-7f89-430f-803b-c99d55ff449d tempest-GroupSnapshotsTest-1944413600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c0651975-f526-4de6-91f1-d550d4bdc582" returned: 0 in 0.301s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:33:34 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-ee9605f5-7f89-430f-803b-c99d55ff449d tempest-GroupSnapshotsTest-1944413600 None] Lock "cinder-quobyte-c0651975-f526-4de6-91f1-d550d4bdc582" released by "delete_volume" :: held 0.743s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:33:34 devstack cinder-volume[88899]: DEBUG cinder.quota [None req-ee9605f5-7f89-430f-803b-c99d55ff449d tempest-GroupSnapshotsTest-1944413600 None] Created reservations ['fd7f2548-829d-4321-a175-13327fe51129'] {{(pid=88899) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 08:33:34 devstack sudo[95798]: pam_unix(sudo:session): session closed for user root Aug 03 08:33:34 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-acfe1ef0-caf2-4c28-9b8f-32fd90a42cc4 tempest-VolumesSnapshotListTestJSON-651293966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b9e50c09-afac-4032-8c98-137af4f2f895.14861506-e7da-488b-9ede-7908c1a2012b -F qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-b9e50c09-afac-4032-8c98-137af4f2f895.be35aae5-631b-4e7b-a335-b9dcb072fe8e" returned: 0 in 0.358s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:33:34 devstack cinder-volume[88899]: WARNING cinder.volume.drivers.remotefs [None req-acfe1ef0-caf2-4c28-9b8f-32fd90a42cc4 tempest-VolumesSnapshotListTestJSON-651293966 None] /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-b9e50c09-afac-4032-8c98-137af4f2f895.be35aae5-631b-4e7b-a335-b9dcb072fe8e is being set with open permissions: ugo+rw Aug 03 08:33:34 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-acfe1ef0-caf2-4c28-9b8f-32fd90a42cc4 tempest-VolumesSnapshotListTestJSON-651293966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-b9e50c09-afac-4032-8c98-137af4f2f895.be35aae5-631b-4e7b-a335-b9dcb072fe8e {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:33:34 devstack sudo[95804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-b9e50c09-afac-4032-8c98-137af4f2f895.be35aae5-631b-4e7b-a335-b9dcb072fe8e Aug 03 08:33:34 devstack sudo[95804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:33:34 devstack cinder-volume[88899]: WARNING cinder.db.api [None req-ee9605f5-7f89-430f-803b-c99d55ff449d tempest-GroupSnapshotsTest-1944413600 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-2085549362'] Aug 03 08:33:34 devstack cinder-volume[88899]: DEBUG cinder.quota [None req-ee9605f5-7f89-430f-803b-c99d55ff449d tempest-GroupSnapshotsTest-1944413600 None] Created reservations ['7ff2ec0b-9eb5-47a4-af2d-352aeaa1c4db', '47fd6ce2-172a-4685-acc3-7d8e03295a98', 'd1b45aef-100c-4f84-86c5-9542c4ce262a', 'b7228730-eea1-44d0-b40e-5aedee11980c'] {{(pid=88899) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 08:33:35 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-ee9605f5-7f89-430f-803b-c99d55ff449d tempest-GroupSnapshotsTest-1944413600 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:33:35 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-ee9605f5-7f89-430f-803b-c99d55ff449d tempest-GroupSnapshotsTest-1944413600 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:33:35 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-ee9605f5-7f89-430f-803b-c99d55ff449d tempest-GroupSnapshotsTest-1944413600 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:33:35 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-ee9605f5-7f89-430f-803b-c99d55ff449d tempest-GroupSnapshotsTest-1944413600 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:33:35 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-ee9605f5-7f89-430f-803b-c99d55ff449d tempest-GroupSnapshotsTest-1944413600 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:33:35 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-ee9605f5-7f89-430f-803b-c99d55ff449d tempest-GroupSnapshotsTest-1944413600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:33:35 devstack sudo[95806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a Aug 03 08:33:35 devstack sudo[95806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:33:35 devstack sudo[95804]: pam_unix(sudo:session): session closed for user root Aug 03 08:33:35 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-acfe1ef0-caf2-4c28-9b8f-32fd90a42cc4 tempest-VolumesSnapshotListTestJSON-651293966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-b9e50c09-afac-4032-8c98-137af4f2f895.be35aae5-631b-4e7b-a335-b9dcb072fe8e" returned: 0 in 0.257s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:33:35 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-acfe1ef0-caf2-4c28-9b8f-32fd90a42cc4 tempest-VolumesSnapshotListTestJSON-651293966 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.530s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:33:35 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-acfe1ef0-caf2-4c28-9b8f-32fd90a42cc4 tempest-VolumesSnapshotListTestJSON-651293966 None] Create snapshot completed successfully Aug 03 08:33:35 devstack sudo[95806]: pam_unix(sudo:session): session closed for user root Aug 03 08:33:35 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-ee9605f5-7f89-430f-803b-c99d55ff449d tempest-GroupSnapshotsTest-1944413600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a" returned: 0 in 0.297s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:33:35 devstack cinder-volume[88899]: DEBUG cinder.manager [None req-ee9605f5-7f89-430f-803b-c99d55ff449d tempest-GroupSnapshotsTest-1944413600 None] Notifying Schedulers of capabilities ... {{(pid=88899) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 08:33:35 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-ee9605f5-7f89-430f-803b-c99d55ff449d tempest-GroupSnapshotsTest-1944413600 None] Delete group completed successfully. Aug 03 08:33:35 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-d9844856-bb17-41f4-b5a5-6af4df41c57b tempest-GroupSnapshotsTest-1944413600 None] Group tempest-GroupSnapshotsTest-Group-1394656813: creating Aug 03 08:33:35 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-d9844856-bb17-41f4-b5a5-6af4df41c57b tempest-GroupSnapshotsTest-1944413600 None] Group tempest-GroupSnapshotsTest-Group-1394656813: created successfully Aug 03 08:33:35 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-d9844856-bb17-41f4-b5a5-6af4df41c57b tempest-GroupSnapshotsTest-1944413600 None] Create group completed successfully. Aug 03 08:33:36 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-67559072-dd7f-4be7-8b02-56b41877c851 tempest-VolumesSnapshotListTestJSON-651293966 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:33:36 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-67559072-dd7f-4be7-8b02-56b41877c851 tempest-VolumesSnapshotListTestJSON-651293966 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:33:36 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-67559072-dd7f-4be7-8b02-56b41877c851 tempest-VolumesSnapshotListTestJSON-651293966 None] Creating offline snapshot c640848c-a080-409b-b801-77ed4ca4ca9b of volume b9e50c09-afac-4032-8c98-137af4f2f895 {{(pid=88899) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 03 08:33:36 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a23b39a-3231-47cf-8938-cceb15f8cee6]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:33:36 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-67559072-dd7f-4be7-8b02-56b41877c851 tempest-VolumesSnapshotListTestJSON-651293966 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-b9e50c09-afac-4032-8c98-137af4f2f895.be35aae5-631b-4e7b-a335-b9dcb072fe8e {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:33:36 devstack sudo[95810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-b9e50c09-afac-4032-8c98-137af4f2f895.be35aae5-631b-4e7b-a335-b9dcb072fe8e Aug 03 08:33:36 devstack sudo[95810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:33:36 devstack sudo[95810]: pam_unix(sudo:session): session closed for user root Aug 03 08:33:36 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-67559072-dd7f-4be7-8b02-56b41877c851 tempest-VolumesSnapshotListTestJSON-651293966 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-b9e50c09-afac-4032-8c98-137af4f2f895.be35aae5-631b-4e7b-a335-b9dcb072fe8e" returned: 0 in 0.389s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:33:36 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-67559072-dd7f-4be7-8b02-56b41877c851 tempest-VolumesSnapshotListTestJSON-651293966 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b9e50c09-afac-4032-8c98-137af4f2f895(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88899) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 03 08:33:36 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-67559072-dd7f-4be7-8b02-56b41877c851 tempest-VolumesSnapshotListTestJSON-651293966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-b9e50c09-afac-4032-8c98-137af4f2f895.be35aae5-631b-4e7b-a335-b9dcb072fe8e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-b9e50c09-afac-4032-8c98-137af4f2f895.c640848c-a080-409b-b801-77ed4ca4ca9b 1G {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:33:36 devstack sudo[95815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-b9e50c09-afac-4032-8c98-137af4f2f895.be35aae5-631b-4e7b-a335-b9dcb072fe8e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-b9e50c09-afac-4032-8c98-137af4f2f895.c640848c-a080-409b-b801-77ed4ca4ca9b 1G Aug 03 08:33:36 devstack sudo[95815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:33:37 devstack sudo[95815]: pam_unix(sudo:session): session closed for user root Aug 03 08:33:37 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-67559072-dd7f-4be7-8b02-56b41877c851 tempest-VolumesSnapshotListTestJSON-651293966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-b9e50c09-afac-4032-8c98-137af4f2f895.be35aae5-631b-4e7b-a335-b9dcb072fe8e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-b9e50c09-afac-4032-8c98-137af4f2f895.c640848c-a080-409b-b801-77ed4ca4ca9b 1G" returned: 0 in 0.624s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:33:37 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-67559072-dd7f-4be7-8b02-56b41877c851 tempest-VolumesSnapshotListTestJSON-651293966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b9e50c09-afac-4032-8c98-137af4f2f895.be35aae5-631b-4e7b-a335-b9dcb072fe8e -F qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-b9e50c09-afac-4032-8c98-137af4f2f895.c640848c-a080-409b-b801-77ed4ca4ca9b {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:33:37 devstack sudo[95823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b9e50c09-afac-4032-8c98-137af4f2f895.be35aae5-631b-4e7b-a335-b9dcb072fe8e -F qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-b9e50c09-afac-4032-8c98-137af4f2f895.c640848c-a080-409b-b801-77ed4ca4ca9b Aug 03 08:33:37 devstack sudo[95823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:33:37 devstack sudo[95823]: pam_unix(sudo:session): session closed for user root Aug 03 08:33:37 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-67559072-dd7f-4be7-8b02-56b41877c851 tempest-VolumesSnapshotListTestJSON-651293966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b9e50c09-afac-4032-8c98-137af4f2f895.be35aae5-631b-4e7b-a335-b9dcb072fe8e -F qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-b9e50c09-afac-4032-8c98-137af4f2f895.c640848c-a080-409b-b801-77ed4ca4ca9b" returned: 0 in 0.312s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:33:37 devstack cinder-volume[88899]: WARNING cinder.volume.drivers.remotefs [None req-67559072-dd7f-4be7-8b02-56b41877c851 tempest-VolumesSnapshotListTestJSON-651293966 None] /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-b9e50c09-afac-4032-8c98-137af4f2f895.c640848c-a080-409b-b801-77ed4ca4ca9b is being set with open permissions: ugo+rw Aug 03 08:33:37 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-67559072-dd7f-4be7-8b02-56b41877c851 tempest-VolumesSnapshotListTestJSON-651293966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-b9e50c09-afac-4032-8c98-137af4f2f895.c640848c-a080-409b-b801-77ed4ca4ca9b {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:33:37 devstack sudo[95830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-b9e50c09-afac-4032-8c98-137af4f2f895.c640848c-a080-409b-b801-77ed4ca4ca9b Aug 03 08:33:37 devstack sudo[95830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:33:37 devstack cinder-volume[88899]: DEBUG cinder.volume.flows.manager.create_volume [None req-aab8ab25-f437-4cd7-96ee-d4dd261716bd tempest-GroupSnapshotsTest-1944413600 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88899) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 08:33:37 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-aab8ab25-f437-4cd7-96ee-d4dd261716bd tempest-GroupSnapshotsTest-1944413600 None] Flow 'volume_create_manager' (0b6f03b8-0665-461d-8ff3-dcc742f5f929) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:33:37 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-aab8ab25-f437-4cd7-96ee-d4dd261716bd tempest-GroupSnapshotsTest-1944413600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36149718-e6a3-46b3-846e-be84cdd031ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:33:37 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-aab8ab25-f437-4cd7-96ee-d4dd261716bd tempest-GroupSnapshotsTest-1944413600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36149718-e6a3-46b3-846e-be84cdd031ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:33:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1222757954',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=a50d9b68-eb7d-498a-9b8e-b3db8f0230cb,host='devstack@QuobyteHD#QuobyteHD',id=d9319880-9aa9-4c4e-9fe1-ce86f035edf0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2fdcb70d80ef43099f0479c4f5be4112',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:33:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:33:37Z,use_quota=True,user_id='d0f229235ffe4b97a62b4ad4a518020a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(86883796-83da-41e0-a21f-ebd4e50696f5),volume_type_id=86883796-83da-41e0-a21f-ebd4e50696f5)' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:33:37 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-aab8ab25-f437-4cd7-96ee-d4dd261716bd tempest-GroupSnapshotsTest-1944413600 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4b5d232-a4dd-4f70-a81c-978fde05f017) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:33:37 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-aab8ab25-f437-4cd7-96ee-d4dd261716bd tempest-GroupSnapshotsTest-1944413600 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4b5d232-a4dd-4f70-a81c-978fde05f017) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:33:37 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-aab8ab25-f437-4cd7-96ee-d4dd261716bd tempest-GroupSnapshotsTest-1944413600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (147670cd-9792-49a6-99ad-19d000039381) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:33:37 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-aab8ab25-f437-4cd7-96ee-d4dd261716bd tempest-GroupSnapshotsTest-1944413600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (147670cd-9792-49a6-99ad-19d000039381) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd9319880-9aa9-4c4e-9fe1-ce86f035edf0', 'volume_name': 'volume-d9319880-9aa9-4c4e-9fe1-ce86f035edf0', 'volume_size': 1}' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:33:37 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-aab8ab25-f437-4cd7-96ee-d4dd261716bd tempest-GroupSnapshotsTest-1944413600 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c892194d-ba72-408b-85f7-22d57ef82824) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:33:37 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-aab8ab25-f437-4cd7-96ee-d4dd261716bd tempest-GroupSnapshotsTest-1944413600 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c892194d-ba72-408b-85f7-22d57ef82824) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:33:37 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-aab8ab25-f437-4cd7-96ee-d4dd261716bd tempest-GroupSnapshotsTest-1944413600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e227a10-783a-494c-9408-da1863f1e500) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:33:37 devstack cinder-volume[88899]: INFO cinder.volume.flows.manager.create_volume [None req-aab8ab25-f437-4cd7-96ee-d4dd261716bd tempest-GroupSnapshotsTest-1944413600 None] Volume d9319880-9aa9-4c4e-9fe1-ce86f035edf0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d9319880-9aa9-4c4e-9fe1-ce86f035edf0', 'volume_size': 1} Aug 03 08:33:37 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-aab8ab25-f437-4cd7-96ee-d4dd261716bd tempest-GroupSnapshotsTest-1944413600 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:33:37 devstack sudo[95830]: pam_unix(sudo:session): session closed for user root Aug 03 08:33:37 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-67559072-dd7f-4be7-8b02-56b41877c851 tempest-VolumesSnapshotListTestJSON-651293966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-b9e50c09-afac-4032-8c98-137af4f2f895.c640848c-a080-409b-b801-77ed4ca4ca9b" returned: 0 in 0.317s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:33:37 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-67559072-dd7f-4be7-8b02-56b41877c851 tempest-VolumesSnapshotListTestJSON-651293966 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.738s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:33:37 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-aab8ab25-f437-4cd7-96ee-d4dd261716bd tempest-GroupSnapshotsTest-1944413600 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.063s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:33:37 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-aab8ab25-f437-4cd7-96ee-d4dd261716bd tempest-GroupSnapshotsTest-1944413600 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=a50d9b68-eb7d-498a-9b8e-b3db8f0230cb,created_at=2026-08-03T06:33:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1222757954',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=a50d9b68-eb7d-498a-9b8e-b3db8f0230cb,host='devstack@QuobyteHD#QuobyteHD',id=d9319880-9aa9-4c4e-9fe1-ce86f035edf0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2fdcb70d80ef43099f0479c4f5be4112',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:33:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:33:37Z,use_quota=True,user_id='d0f229235ffe4b97a62b4ad4a518020a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(86883796-83da-41e0-a21f-ebd4e50696f5),volume_type_id=86883796-83da-41e0-a21f-ebd4e50696f5)}" {{(pid=88899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 08:33:37 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-aab8ab25-f437-4cd7-96ee-d4dd261716bd tempest-GroupSnapshotsTest-1944413600 None] Creating volume d9319880-9aa9-4c4e-9fe1-ce86f035edf0 {{(pid=88899) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 08:33:37 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-aab8ab25-f437-4cd7-96ee-d4dd261716bd tempest-GroupSnapshotsTest-1944413600 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:33:37 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-aab8ab25-f437-4cd7-96ee-d4dd261716bd tempest-GroupSnapshotsTest-1944413600 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:33:37 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-aab8ab25-f437-4cd7-96ee-d4dd261716bd tempest-GroupSnapshotsTest-1944413600 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:33:37 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-aab8ab25-f437-4cd7-96ee-d4dd261716bd tempest-GroupSnapshotsTest-1944413600 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:33:37 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-aab8ab25-f437-4cd7-96ee-d4dd261716bd tempest-GroupSnapshotsTest-1944413600 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:33:37 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-aab8ab25-f437-4cd7-96ee-d4dd261716bd tempest-GroupSnapshotsTest-1944413600 None] Selected osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385 as target Quobyte volume. {{(pid=88899) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 08:33:37 devstack cinder-volume[88899]: INFO cinder.volume.drivers.remotefs [None req-aab8ab25-f437-4cd7-96ee-d4dd261716bd tempest-GroupSnapshotsTest-1944413600 None] casted to osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385 Aug 03 08:33:37 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-aab8ab25-f437-4cd7-96ee-d4dd261716bd tempest-GroupSnapshotsTest-1944413600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-d9319880-9aa9-4c4e-9fe1-ce86f035edf0 1073741824 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:33:37 devstack sudo[95834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-d9319880-9aa9-4c4e-9fe1-ce86f035edf0 1073741824 Aug 03 08:33:37 devstack sudo[95834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:33:37 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-67559072-dd7f-4be7-8b02-56b41877c851 tempest-VolumesSnapshotListTestJSON-651293966 None] Create snapshot completed successfully Aug 03 08:33:38 devstack sudo[95834]: pam_unix(sudo:session): session closed for user root Aug 03 08:33:38 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-aab8ab25-f437-4cd7-96ee-d4dd261716bd tempest-GroupSnapshotsTest-1944413600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-d9319880-9aa9-4c4e-9fe1-ce86f035edf0 1073741824" returned: 0 in 0.526s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:33:38 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-aab8ab25-f437-4cd7-96ee-d4dd261716bd tempest-GroupSnapshotsTest-1944413600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-d9319880-9aa9-4c4e-9fe1-ce86f035edf0 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:33:38 devstack sudo[95846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-d9319880-9aa9-4c4e-9fe1-ce86f035edf0 Aug 03 08:33:38 devstack sudo[95846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:33:38 devstack cinder-volume[88899]: INFO cinder.volume.manager [req-66e3d82f-1a52-40c3-b1c0-3724380543ed req-cc3bbfcd-0a1e-4713-a4f5-cf9c298cb0b2 tempest-ServerActionsTestOtherA-826446422 None] Terminate volume connection completed successfully. Aug 03 08:33:38 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [req-66e3d82f-1a52-40c3-b1c0-3724380543ed req-cc3bbfcd-0a1e-4713-a4f5-cf9c298cb0b2 tempest-ServerActionsTestOtherA-826446422 None] Deleting attachment 1bc3b73a-070a-427b-a816-1a5a816d71f3. {{(pid=88899) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 03 08:33:38 devstack sudo[95846]: pam_unix(sudo:session): session closed for user root Aug 03 08:33:38 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-aab8ab25-f437-4cd7-96ee-d4dd261716bd tempest-GroupSnapshotsTest-1944413600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-d9319880-9aa9-4c4e-9fe1-ce86f035edf0" returned: 0 in 0.492s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:33:38 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-aab8ab25-f437-4cd7-96ee-d4dd261716bd tempest-GroupSnapshotsTest-1944413600 None] <== create_volume: return (1090ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'} {{(pid=88899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 08:33:38 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-aab8ab25-f437-4cd7-96ee-d4dd261716bd tempest-GroupSnapshotsTest-1944413600 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.095s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:33:38 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-aab8ab25-f437-4cd7-96ee-d4dd261716bd tempest-GroupSnapshotsTest-1944413600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e227a10-783a-494c-9408-da1863f1e500) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d9319880-9aa9-4c4e-9fe1-ce86f035edf0', 'volume_size': 1}' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:33:38 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-aab8ab25-f437-4cd7-96ee-d4dd261716bd tempest-GroupSnapshotsTest-1944413600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c529780-ebaf-4d7d-a8d7-89c01cb28c60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:33:38 devstack cinder-volume[88899]: INFO cinder.volume.flows.manager.create_volume [None req-aab8ab25-f437-4cd7-96ee-d4dd261716bd tempest-GroupSnapshotsTest-1944413600 None] Volume volume-d9319880-9aa9-4c4e-9fe1-ce86f035edf0 (d9319880-9aa9-4c4e-9fe1-ce86f035edf0): created successfully Aug 03 08:33:38 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-aab8ab25-f437-4cd7-96ee-d4dd261716bd tempest-GroupSnapshotsTest-1944413600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c529780-ebaf-4d7d-a8d7-89c01cb28c60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:33:38 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-aab8ab25-f437-4cd7-96ee-d4dd261716bd tempest-GroupSnapshotsTest-1944413600 None] Flow 'volume_create_manager' (0b6f03b8-0665-461d-8ff3-dcc742f5f929) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:33:38 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-aab8ab25-f437-4cd7-96ee-d4dd261716bd tempest-GroupSnapshotsTest-1944413600 None] Created volume successfully. Aug 03 08:33:39 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-9de5a5d3-56f1-42ea-b652-a3847e4d6b9d tempest-VolumesSnapshotListTestJSON-651293966 None] Acquiring lock "cinder-c640848c-a080-409b-b801-77ed4ca4ca9b-delete_snapshot" by "delete_snapshot" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:33:39 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-9de5a5d3-56f1-42ea-b652-a3847e4d6b9d tempest-VolumesSnapshotListTestJSON-651293966 None] Lock "cinder-c640848c-a080-409b-b801-77ed4ca4ca9b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:33:39 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-9de5a5d3-56f1-42ea-b652-a3847e4d6b9d tempest-VolumesSnapshotListTestJSON-651293966 None] Acquiring lock "cinder-quobyte-b9e50c09-afac-4032-8c98-137af4f2f895" by "delete_snapshot" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:33:39 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-9de5a5d3-56f1-42ea-b652-a3847e4d6b9d tempest-VolumesSnapshotListTestJSON-651293966 None] Lock "cinder-quobyte-b9e50c09-afac-4032-8c98-137af4f2f895" acquired by "delete_snapshot" :: waited 0.022s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:33:39 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-9de5a5d3-56f1-42ea-b652-a3847e4d6b9d tempest-VolumesSnapshotListTestJSON-651293966 None] Acquiring lock "cinder-quobyte-c640848c-a080-409b-b801-77ed4ca4ca9b" by "_delete_snapshot" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:33:39 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-9de5a5d3-56f1-42ea-b652-a3847e4d6b9d tempest-VolumesSnapshotListTestJSON-651293966 None] Lock "cinder-quobyte-c640848c-a080-409b-b801-77ed4ca4ca9b" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:33:39 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-9de5a5d3-56f1-42ea-b652-a3847e4d6b9d tempest-VolumesSnapshotListTestJSON-651293966 None] Deleting offline snapshot c640848c-a080-409b-b801-77ed4ca4ca9b of volume b9e50c09-afac-4032-8c98-137af4f2f895 {{(pid=88899) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 03 08:33:39 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-9de5a5d3-56f1-42ea-b652-a3847e4d6b9d tempest-VolumesSnapshotListTestJSON-651293966 None] snapshot_file for this snap is: volume-b9e50c09-afac-4032-8c98-137af4f2f895.c640848c-a080-409b-b801-77ed4ca4ca9b {{(pid=88899) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 03 08:33:39 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[39add6ee-d081-4117-9e54-d274b5a544a3]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:33:39 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-9de5a5d3-56f1-42ea-b652-a3847e4d6b9d tempest-VolumesSnapshotListTestJSON-651293966 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-b9e50c09-afac-4032-8c98-137af4f2f895.c640848c-a080-409b-b801-77ed4ca4ca9b {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:33:39 devstack sudo[95853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-b9e50c09-afac-4032-8c98-137af4f2f895.c640848c-a080-409b-b801-77ed4ca4ca9b Aug 03 08:33:39 devstack sudo[95853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:33:40 devstack sudo[95853]: pam_unix(sudo:session): session closed for user root Aug 03 08:33:40 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-9de5a5d3-56f1-42ea-b652-a3847e4d6b9d tempest-VolumesSnapshotListTestJSON-651293966 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-b9e50c09-afac-4032-8c98-137af4f2f895.c640848c-a080-409b-b801-77ed4ca4ca9b" returned: 0 in 0.576s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:33:40 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-9de5a5d3-56f1-42ea-b652-a3847e4d6b9d tempest-VolumesSnapshotListTestJSON-651293966 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b9e50c09-afac-4032-8c98-137af4f2f895(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88899) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 03 08:33:40 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[44e45444-a1b0-4360-93b3-2433c8d425c9]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:33:40 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-9de5a5d3-56f1-42ea-b652-a3847e4d6b9d tempest-VolumesSnapshotListTestJSON-651293966 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-b9e50c09-afac-4032-8c98-137af4f2f895.be35aae5-631b-4e7b-a335-b9dcb072fe8e {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:33:40 devstack sudo[95883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-b9e50c09-afac-4032-8c98-137af4f2f895.be35aae5-631b-4e7b-a335-b9dcb072fe8e Aug 03 08:33:40 devstack sudo[95883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:33:40 devstack sudo[95883]: pam_unix(sudo:session): session closed for user root Aug 03 08:33:40 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-9de5a5d3-56f1-42ea-b652-a3847e4d6b9d tempest-VolumesSnapshotListTestJSON-651293966 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-b9e50c09-afac-4032-8c98-137af4f2f895.be35aae5-631b-4e7b-a335-b9dcb072fe8e" returned: 0 in 0.654s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:33:40 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-9de5a5d3-56f1-42ea-b652-a3847e4d6b9d tempest-VolumesSnapshotListTestJSON-651293966 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b9e50c09-afac-4032-8c98-137af4f2f895(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88899) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 03 08:33:40 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-9de5a5d3-56f1-42ea-b652-a3847e4d6b9d tempest-VolumesSnapshotListTestJSON-651293966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-b9e50c09-afac-4032-8c98-137af4f2f895.c640848c-a080-409b-b801-77ed4ca4ca9b {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:33:40 devstack sudo[95888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-b9e50c09-afac-4032-8c98-137af4f2f895.c640848c-a080-409b-b801-77ed4ca4ca9b Aug 03 08:33:40 devstack sudo[95888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:33:41 devstack cinder-volume[88899]: DEBUG cinder.volume.flows.manager.create_volume [None req-52ff8c9d-3a62-4030-9d61-61f2a8814bfc tempest-AttachVolumeNegativeTest-1279867800 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88899) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 08:33:41 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-52ff8c9d-3a62-4030-9d61-61f2a8814bfc tempest-AttachVolumeNegativeTest-1279867800 None] Flow 'volume_create_manager' (8e0513f2-dd88-4c86-afb5-379c47e7bb36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:33:41 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-52ff8c9d-3a62-4030-9d61-61f2a8814bfc tempest-AttachVolumeNegativeTest-1279867800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (29f1beb5-2847-4dba-a17a-4cbd20f93b90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:33:41 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-52ff8c9d-3a62-4030-9d61-61f2a8814bfc tempest-AttachVolumeNegativeTest-1279867800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (29f1beb5-2847-4dba-a17a-4cbd20f93b90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:33:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-733431235',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dfde963c-eaa2-46fd-a80f-4ddd0e14011c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f06670c627043c9a605aa207b29fe32',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:33:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:33:41Z,use_quota=True,user_id='3e4a15ae37a34d638cd37c201b61c395',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8bde7129-1dc4-42ab-b852-ab32c61b4921),volume_type_id=8bde7129-1dc4-42ab-b852-ab32c61b4921)' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:33:41 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-52ff8c9d-3a62-4030-9d61-61f2a8814bfc tempest-AttachVolumeNegativeTest-1279867800 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba61a6ac-07bc-49ba-9472-6f2a1c95de0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:33:41 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-52ff8c9d-3a62-4030-9d61-61f2a8814bfc tempest-AttachVolumeNegativeTest-1279867800 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba61a6ac-07bc-49ba-9472-6f2a1c95de0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:33:41 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-52ff8c9d-3a62-4030-9d61-61f2a8814bfc tempest-AttachVolumeNegativeTest-1279867800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b4b0c83-c63b-4b74-8160-ce563c5afa17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:33:41 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-52ff8c9d-3a62-4030-9d61-61f2a8814bfc tempest-AttachVolumeNegativeTest-1279867800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b4b0c83-c63b-4b74-8160-ce563c5afa17) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dfde963c-eaa2-46fd-a80f-4ddd0e14011c', 'volume_name': 'volume-dfde963c-eaa2-46fd-a80f-4ddd0e14011c', 'volume_size': 1}' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:33:41 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-52ff8c9d-3a62-4030-9d61-61f2a8814bfc tempest-AttachVolumeNegativeTest-1279867800 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a3fd6da-6e50-498e-886c-faf883b66980) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:33:41 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-52ff8c9d-3a62-4030-9d61-61f2a8814bfc tempest-AttachVolumeNegativeTest-1279867800 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a3fd6da-6e50-498e-886c-faf883b66980) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:33:41 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-52ff8c9d-3a62-4030-9d61-61f2a8814bfc tempest-AttachVolumeNegativeTest-1279867800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e242310-ee66-4fe2-b64c-c9940bee58df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:33:41 devstack cinder-volume[88899]: INFO cinder.volume.flows.manager.create_volume [None req-52ff8c9d-3a62-4030-9d61-61f2a8814bfc tempest-AttachVolumeNegativeTest-1279867800 None] Volume dfde963c-eaa2-46fd-a80f-4ddd0e14011c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dfde963c-eaa2-46fd-a80f-4ddd0e14011c', 'volume_size': 1} Aug 03 08:33:41 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-52ff8c9d-3a62-4030-9d61-61f2a8814bfc tempest-AttachVolumeNegativeTest-1279867800 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:33:41 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-52ff8c9d-3a62-4030-9d61-61f2a8814bfc tempest-AttachVolumeNegativeTest-1279867800 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:33:41 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-52ff8c9d-3a62-4030-9d61-61f2a8814bfc tempest-AttachVolumeNegativeTest-1279867800 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:33:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-733431235',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dfde963c-eaa2-46fd-a80f-4ddd0e14011c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f06670c627043c9a605aa207b29fe32',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:33:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:33:41Z,use_quota=True,user_id='3e4a15ae37a34d638cd37c201b61c395',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8bde7129-1dc4-42ab-b852-ab32c61b4921),volume_type_id=8bde7129-1dc4-42ab-b852-ab32c61b4921)}" {{(pid=88899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 08:33:41 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-52ff8c9d-3a62-4030-9d61-61f2a8814bfc tempest-AttachVolumeNegativeTest-1279867800 None] Creating volume dfde963c-eaa2-46fd-a80f-4ddd0e14011c {{(pid=88899) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 08:33:41 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-52ff8c9d-3a62-4030-9d61-61f2a8814bfc tempest-AttachVolumeNegativeTest-1279867800 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:33:41 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-52ff8c9d-3a62-4030-9d61-61f2a8814bfc tempest-AttachVolumeNegativeTest-1279867800 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:33:41 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-52ff8c9d-3a62-4030-9d61-61f2a8814bfc tempest-AttachVolumeNegativeTest-1279867800 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:33:41 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-52ff8c9d-3a62-4030-9d61-61f2a8814bfc tempest-AttachVolumeNegativeTest-1279867800 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:33:41 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-52ff8c9d-3a62-4030-9d61-61f2a8814bfc tempest-AttachVolumeNegativeTest-1279867800 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:33:41 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-52ff8c9d-3a62-4030-9d61-61f2a8814bfc tempest-AttachVolumeNegativeTest-1279867800 None] Selected osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385 as target Quobyte volume. {{(pid=88899) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 08:33:41 devstack cinder-volume[88899]: INFO cinder.volume.drivers.remotefs [None req-52ff8c9d-3a62-4030-9d61-61f2a8814bfc tempest-AttachVolumeNegativeTest-1279867800 None] casted to osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385 Aug 03 08:33:41 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-52ff8c9d-3a62-4030-9d61-61f2a8814bfc tempest-AttachVolumeNegativeTest-1279867800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-dfde963c-eaa2-46fd-a80f-4ddd0e14011c 1073741824 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:33:41 devstack sudo[95888]: pam_unix(sudo:session): session closed for user root Aug 03 08:33:41 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-9de5a5d3-56f1-42ea-b652-a3847e4d6b9d tempest-VolumesSnapshotListTestJSON-651293966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-b9e50c09-afac-4032-8c98-137af4f2f895.c640848c-a080-409b-b801-77ed4ca4ca9b" returned: 0 in 0.645s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:33:41 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-9de5a5d3-56f1-42ea-b652-a3847e4d6b9d tempest-VolumesSnapshotListTestJSON-651293966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-b9e50c09-afac-4032-8c98-137af4f2f895.c640848c-a080-409b-b801-77ed4ca4ca9b {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:33:41 devstack sudo[95897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-dfde963c-eaa2-46fd-a80f-4ddd0e14011c 1073741824 Aug 03 08:33:41 devstack sudo[95897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:33:41 devstack sudo[95898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-b9e50c09-afac-4032-8c98-137af4f2f895.c640848c-a080-409b-b801-77ed4ca4ca9b Aug 03 08:33:41 devstack sudo[95898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:33:41 devstack cinder-volume[88899]: DEBUG cinder.volume.flows.manager.create_volume [None req-714145ba-90f7-428c-8514-e05e1da49706 tempest-GroupSnapshotsTest-1944413600 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88899) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 08:33:41 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-714145ba-90f7-428c-8514-e05e1da49706 tempest-GroupSnapshotsTest-1944413600 None] Flow 'volume_create_manager' (06c92570-8634-4db2-821e-f1bc1e002366) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:33:41 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-714145ba-90f7-428c-8514-e05e1da49706 tempest-GroupSnapshotsTest-1944413600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (037934da-3d4b-49af-8858-e92dae0c19d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:33:41 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-714145ba-90f7-428c-8514-e05e1da49706 tempest-GroupSnapshotsTest-1944413600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (037934da-3d4b-49af-8858-e92dae0c19d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:33:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1716833514',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=a50d9b68-eb7d-498a-9b8e-b3db8f0230cb,host='devstack@QuobyteHD#QuobyteHD',id=408a47fd-ac2d-4d65-9de5-595cb59982a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2fdcb70d80ef43099f0479c4f5be4112',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:33:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:33:41Z,use_quota=True,user_id='d0f229235ffe4b97a62b4ad4a518020a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(86883796-83da-41e0-a21f-ebd4e50696f5),volume_type_id=86883796-83da-41e0-a21f-ebd4e50696f5)' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:33:41 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-714145ba-90f7-428c-8514-e05e1da49706 tempest-GroupSnapshotsTest-1944413600 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5e19640-2a0f-47b3-b17e-a1262c281536) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:33:41 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-714145ba-90f7-428c-8514-e05e1da49706 tempest-GroupSnapshotsTest-1944413600 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5e19640-2a0f-47b3-b17e-a1262c281536) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:33:41 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-714145ba-90f7-428c-8514-e05e1da49706 tempest-GroupSnapshotsTest-1944413600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eda66375-cf3f-4fb6-bb8c-acc740d64c04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:33:41 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-714145ba-90f7-428c-8514-e05e1da49706 tempest-GroupSnapshotsTest-1944413600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eda66375-cf3f-4fb6-bb8c-acc740d64c04) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '408a47fd-ac2d-4d65-9de5-595cb59982a4', 'volume_name': 'volume-408a47fd-ac2d-4d65-9de5-595cb59982a4', 'volume_size': 1}' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:33:41 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-714145ba-90f7-428c-8514-e05e1da49706 tempest-GroupSnapshotsTest-1944413600 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac61cf51-1af0-493e-bd9f-4a8dba179e56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:33:41 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-714145ba-90f7-428c-8514-e05e1da49706 tempest-GroupSnapshotsTest-1944413600 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac61cf51-1af0-493e-bd9f-4a8dba179e56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:33:41 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-714145ba-90f7-428c-8514-e05e1da49706 tempest-GroupSnapshotsTest-1944413600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b18c5b68-3d50-4786-a70b-d477e79ebe7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:33:41 devstack cinder-volume[88899]: INFO cinder.volume.flows.manager.create_volume [None req-714145ba-90f7-428c-8514-e05e1da49706 tempest-GroupSnapshotsTest-1944413600 None] Volume 408a47fd-ac2d-4d65-9de5-595cb59982a4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-408a47fd-ac2d-4d65-9de5-595cb59982a4', 'volume_size': 1} Aug 03 08:33:41 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-714145ba-90f7-428c-8514-e05e1da49706 tempest-GroupSnapshotsTest-1944413600 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:33:41 devstack sudo[95898]: pam_unix(sudo:session): session closed for user root Aug 03 08:33:41 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-9de5a5d3-56f1-42ea-b652-a3847e4d6b9d tempest-VolumesSnapshotListTestJSON-651293966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-b9e50c09-afac-4032-8c98-137af4f2f895.c640848c-a080-409b-b801-77ed4ca4ca9b" returned: 0 in 0.262s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:33:41 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-9de5a5d3-56f1-42ea-b652-a3847e4d6b9d tempest-VolumesSnapshotListTestJSON-651293966 None] Lock "cinder-quobyte-c640848c-a080-409b-b801-77ed4ca4ca9b" released by "_delete_snapshot" :: held 2.323s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:33:41 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-9de5a5d3-56f1-42ea-b652-a3847e4d6b9d tempest-VolumesSnapshotListTestJSON-651293966 None] Lock "cinder-quobyte-b9e50c09-afac-4032-8c98-137af4f2f895" released by "delete_snapshot" :: held 2.362s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:33:41 devstack cinder-volume[88899]: DEBUG cinder.quota [None req-9de5a5d3-56f1-42ea-b652-a3847e4d6b9d tempest-VolumesSnapshotListTestJSON-651293966 None] Created reservations ['1879059e-e268-4fda-b32a-1faab2271e8b', 'd78a86b5-5b86-49c0-9fec-8eac2944d5d2', '7f598f23-55ad-42f4-ba72-5d5057c8dcf0', '977d56c5-fb06-476c-a85b-bca5cadc9b22'] {{(pid=88899) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 08:33:41 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-9de5a5d3-56f1-42ea-b652-a3847e4d6b9d tempest-VolumesSnapshotListTestJSON-651293966 None] Delete snapshot completed successfully. Aug 03 08:33:41 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-9de5a5d3-56f1-42ea-b652-a3847e4d6b9d tempest-VolumesSnapshotListTestJSON-651293966 None] Lock "cinder-c640848c-a080-409b-b801-77ed4ca4ca9b-delete_snapshot" released by "delete_snapshot" :: held 2.539s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:33:41 devstack sudo[95897]: pam_unix(sudo:session): session closed for user root Aug 03 08:33:41 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-52ff8c9d-3a62-4030-9d61-61f2a8814bfc tempest-AttachVolumeNegativeTest-1279867800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-dfde963c-eaa2-46fd-a80f-4ddd0e14011c 1073741824" returned: 0 in 0.594s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:33:42 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-52ff8c9d-3a62-4030-9d61-61f2a8814bfc tempest-AttachVolumeNegativeTest-1279867800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-dfde963c-eaa2-46fd-a80f-4ddd0e14011c {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:33:42 devstack sudo[95907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-dfde963c-eaa2-46fd-a80f-4ddd0e14011c Aug 03 08:33:42 devstack sudo[95907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:33:42 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-cc2b10a5-d334-4726-9aca-339da2d88bcb tempest-VolumesSnapshotListTestJSON-651293966 None] Acquiring lock "cinder-be35aae5-631b-4e7b-a335-b9dcb072fe8e-delete_snapshot" by "delete_snapshot" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:33:42 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-cc2b10a5-d334-4726-9aca-339da2d88bcb tempest-VolumesSnapshotListTestJSON-651293966 None] Lock "cinder-be35aae5-631b-4e7b-a335-b9dcb072fe8e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:33:42 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-cc2b10a5-d334-4726-9aca-339da2d88bcb tempest-VolumesSnapshotListTestJSON-651293966 None] Acquiring lock "cinder-quobyte-b9e50c09-afac-4032-8c98-137af4f2f895" by "delete_snapshot" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:33:42 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-cc2b10a5-d334-4726-9aca-339da2d88bcb tempest-VolumesSnapshotListTestJSON-651293966 None] Lock "cinder-quobyte-b9e50c09-afac-4032-8c98-137af4f2f895" acquired by "delete_snapshot" :: waited 0.034s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:33:42 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-cc2b10a5-d334-4726-9aca-339da2d88bcb tempest-VolumesSnapshotListTestJSON-651293966 None] Acquiring lock "cinder-quobyte-be35aae5-631b-4e7b-a335-b9dcb072fe8e" by "_delete_snapshot" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:33:42 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-cc2b10a5-d334-4726-9aca-339da2d88bcb tempest-VolumesSnapshotListTestJSON-651293966 None] Lock "cinder-quobyte-be35aae5-631b-4e7b-a335-b9dcb072fe8e" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:33:42 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-cc2b10a5-d334-4726-9aca-339da2d88bcb tempest-VolumesSnapshotListTestJSON-651293966 None] Deleting offline snapshot be35aae5-631b-4e7b-a335-b9dcb072fe8e of volume b9e50c09-afac-4032-8c98-137af4f2f895 {{(pid=88899) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 03 08:33:42 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-cc2b10a5-d334-4726-9aca-339da2d88bcb tempest-VolumesSnapshotListTestJSON-651293966 None] snapshot_file for this snap is: volume-b9e50c09-afac-4032-8c98-137af4f2f895.be35aae5-631b-4e7b-a335-b9dcb072fe8e {{(pid=88899) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 03 08:33:42 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5b87418-c143-4ab8-98f6-15fa40df31b7]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:33:42 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-cc2b10a5-d334-4726-9aca-339da2d88bcb tempest-VolumesSnapshotListTestJSON-651293966 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-b9e50c09-afac-4032-8c98-137af4f2f895.be35aae5-631b-4e7b-a335-b9dcb072fe8e {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:33:42 devstack sudo[95907]: pam_unix(sudo:session): session closed for user root Aug 03 08:33:42 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-52ff8c9d-3a62-4030-9d61-61f2a8814bfc tempest-AttachVolumeNegativeTest-1279867800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-dfde963c-eaa2-46fd-a80f-4ddd0e14011c" returned: 0 in 0.315s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:33:42 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-52ff8c9d-3a62-4030-9d61-61f2a8814bfc tempest-AttachVolumeNegativeTest-1279867800 None] <== create_volume: return (965ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'} {{(pid=88899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 08:33:42 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-52ff8c9d-3a62-4030-9d61-61f2a8814bfc tempest-AttachVolumeNegativeTest-1279867800 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.969s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:33:42 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-714145ba-90f7-428c-8514-e05e1da49706 tempest-GroupSnapshotsTest-1944413600 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.771s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:33:42 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-714145ba-90f7-428c-8514-e05e1da49706 tempest-GroupSnapshotsTest-1944413600 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=a50d9b68-eb7d-498a-9b8e-b3db8f0230cb,created_at=2026-08-03T06:33:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1716833514',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=a50d9b68-eb7d-498a-9b8e-b3db8f0230cb,host='devstack@QuobyteHD#QuobyteHD',id=408a47fd-ac2d-4d65-9de5-595cb59982a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2fdcb70d80ef43099f0479c4f5be4112',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:33:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:33:41Z,use_quota=True,user_id='d0f229235ffe4b97a62b4ad4a518020a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(86883796-83da-41e0-a21f-ebd4e50696f5),volume_type_id=86883796-83da-41e0-a21f-ebd4e50696f5)}" {{(pid=88899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 08:33:42 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-714145ba-90f7-428c-8514-e05e1da49706 tempest-GroupSnapshotsTest-1944413600 None] Creating volume 408a47fd-ac2d-4d65-9de5-595cb59982a4 {{(pid=88899) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 08:33:42 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-714145ba-90f7-428c-8514-e05e1da49706 tempest-GroupSnapshotsTest-1944413600 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:33:42 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-714145ba-90f7-428c-8514-e05e1da49706 tempest-GroupSnapshotsTest-1944413600 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:33:42 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-714145ba-90f7-428c-8514-e05e1da49706 tempest-GroupSnapshotsTest-1944413600 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:33:42 devstack sudo[95909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-b9e50c09-afac-4032-8c98-137af4f2f895.be35aae5-631b-4e7b-a335-b9dcb072fe8e Aug 03 08:33:42 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-714145ba-90f7-428c-8514-e05e1da49706 tempest-GroupSnapshotsTest-1944413600 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:33:42 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-714145ba-90f7-428c-8514-e05e1da49706 tempest-GroupSnapshotsTest-1944413600 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:33:42 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-714145ba-90f7-428c-8514-e05e1da49706 tempest-GroupSnapshotsTest-1944413600 None] Selected osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385 as target Quobyte volume. {{(pid=88899) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 08:33:42 devstack sudo[95909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:33:42 devstack cinder-volume[88899]: INFO cinder.volume.drivers.remotefs [None req-714145ba-90f7-428c-8514-e05e1da49706 tempest-GroupSnapshotsTest-1944413600 None] casted to osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385 Aug 03 08:33:42 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-714145ba-90f7-428c-8514-e05e1da49706 tempest-GroupSnapshotsTest-1944413600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-408a47fd-ac2d-4d65-9de5-595cb59982a4 1073741824 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:33:42 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-52ff8c9d-3a62-4030-9d61-61f2a8814bfc tempest-AttachVolumeNegativeTest-1279867800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e242310-ee66-4fe2-b64c-c9940bee58df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dfde963c-eaa2-46fd-a80f-4ddd0e14011c', 'volume_size': 1}' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:33:42 devstack sudo[95912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-408a47fd-ac2d-4d65-9de5-595cb59982a4 1073741824 Aug 03 08:33:42 devstack sudo[95912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:33:42 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-52ff8c9d-3a62-4030-9d61-61f2a8814bfc tempest-AttachVolumeNegativeTest-1279867800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (acbbabac-02f9-4bd9-b4e3-22789a02935e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:33:42 devstack cinder-volume[88899]: INFO cinder.volume.flows.manager.create_volume [None req-52ff8c9d-3a62-4030-9d61-61f2a8814bfc tempest-AttachVolumeNegativeTest-1279867800 None] Volume volume-dfde963c-eaa2-46fd-a80f-4ddd0e14011c (dfde963c-eaa2-46fd-a80f-4ddd0e14011c): created successfully Aug 03 08:33:42 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-52ff8c9d-3a62-4030-9d61-61f2a8814bfc tempest-AttachVolumeNegativeTest-1279867800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (acbbabac-02f9-4bd9-b4e3-22789a02935e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:33:42 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-52ff8c9d-3a62-4030-9d61-61f2a8814bfc tempest-AttachVolumeNegativeTest-1279867800 None] Flow 'volume_create_manager' (8e0513f2-dd88-4c86-afb5-379c47e7bb36) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:33:42 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-52ff8c9d-3a62-4030-9d61-61f2a8814bfc tempest-AttachVolumeNegativeTest-1279867800 None] Created volume successfully. Aug 03 08:33:42 devstack sudo[95909]: pam_unix(sudo:session): session closed for user root Aug 03 08:33:42 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-cc2b10a5-d334-4726-9aca-339da2d88bcb tempest-VolumesSnapshotListTestJSON-651293966 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-b9e50c09-afac-4032-8c98-137af4f2f895.be35aae5-631b-4e7b-a335-b9dcb072fe8e" returned: 0 in 0.474s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:33:42 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-cc2b10a5-d334-4726-9aca-339da2d88bcb tempest-VolumesSnapshotListTestJSON-651293966 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b9e50c09-afac-4032-8c98-137af4f2f895(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88899) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 03 08:33:42 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[a21a122d-cb92-403e-9a46-ce005ccb36d5]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:33:42 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-cc2b10a5-d334-4726-9aca-339da2d88bcb tempest-VolumesSnapshotListTestJSON-651293966 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-b9e50c09-afac-4032-8c98-137af4f2f895.14861506-e7da-488b-9ede-7908c1a2012b {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:33:42 devstack sudo[95920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-b9e50c09-afac-4032-8c98-137af4f2f895.14861506-e7da-488b-9ede-7908c1a2012b Aug 03 08:33:42 devstack sudo[95920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:33:42 devstack sudo[95912]: pam_unix(sudo:session): session closed for user root Aug 03 08:33:42 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-714145ba-90f7-428c-8514-e05e1da49706 tempest-GroupSnapshotsTest-1944413600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-408a47fd-ac2d-4d65-9de5-595cb59982a4 1073741824" returned: 0 in 0.479s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:33:42 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-714145ba-90f7-428c-8514-e05e1da49706 tempest-GroupSnapshotsTest-1944413600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-408a47fd-ac2d-4d65-9de5-595cb59982a4 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:33:42 devstack sudo[95923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-408a47fd-ac2d-4d65-9de5-595cb59982a4 Aug 03 08:33:42 devstack sudo[95923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:33:43 devstack sudo[95920]: pam_unix(sudo:session): session closed for user root Aug 03 08:33:43 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-cc2b10a5-d334-4726-9aca-339da2d88bcb tempest-VolumesSnapshotListTestJSON-651293966 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-b9e50c09-afac-4032-8c98-137af4f2f895.14861506-e7da-488b-9ede-7908c1a2012b" returned: 0 in 0.375s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:33:43 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-cc2b10a5-d334-4726-9aca-339da2d88bcb tempest-VolumesSnapshotListTestJSON-651293966 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b9e50c09-afac-4032-8c98-137af4f2f895(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88899) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 03 08:33:43 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-cc2b10a5-d334-4726-9aca-339da2d88bcb tempest-VolumesSnapshotListTestJSON-651293966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-b9e50c09-afac-4032-8c98-137af4f2f895.be35aae5-631b-4e7b-a335-b9dcb072fe8e {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:33:43 devstack sudo[95929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-b9e50c09-afac-4032-8c98-137af4f2f895.be35aae5-631b-4e7b-a335-b9dcb072fe8e Aug 03 08:33:43 devstack sudo[95929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:33:43 devstack sudo[95923]: pam_unix(sudo:session): session closed for user root Aug 03 08:33:43 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-714145ba-90f7-428c-8514-e05e1da49706 tempest-GroupSnapshotsTest-1944413600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-408a47fd-ac2d-4d65-9de5-595cb59982a4" returned: 0 in 0.324s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:33:43 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-714145ba-90f7-428c-8514-e05e1da49706 tempest-GroupSnapshotsTest-1944413600 None] <== create_volume: return (844ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'} {{(pid=88899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 08:33:43 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-714145ba-90f7-428c-8514-e05e1da49706 tempest-GroupSnapshotsTest-1944413600 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.849s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:33:43 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-714145ba-90f7-428c-8514-e05e1da49706 tempest-GroupSnapshotsTest-1944413600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b18c5b68-3d50-4786-a70b-d477e79ebe7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-408a47fd-ac2d-4d65-9de5-595cb59982a4', 'volume_size': 1}' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:33:43 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-714145ba-90f7-428c-8514-e05e1da49706 tempest-GroupSnapshotsTest-1944413600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9378f24c-6b27-40a2-8d37-e4d3fd8f36ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:33:43 devstack cinder-volume[88899]: INFO cinder.volume.flows.manager.create_volume [None req-714145ba-90f7-428c-8514-e05e1da49706 tempest-GroupSnapshotsTest-1944413600 None] Volume volume-408a47fd-ac2d-4d65-9de5-595cb59982a4 (408a47fd-ac2d-4d65-9de5-595cb59982a4): created successfully Aug 03 08:33:43 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-714145ba-90f7-428c-8514-e05e1da49706 tempest-GroupSnapshotsTest-1944413600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9378f24c-6b27-40a2-8d37-e4d3fd8f36ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:33:43 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-714145ba-90f7-428c-8514-e05e1da49706 tempest-GroupSnapshotsTest-1944413600 None] Flow 'volume_create_manager' (06c92570-8634-4db2-821e-f1bc1e002366) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:33:43 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-714145ba-90f7-428c-8514-e05e1da49706 tempest-GroupSnapshotsTest-1944413600 None] Created volume successfully. Aug 03 08:33:43 devstack sudo[95929]: pam_unix(sudo:session): session closed for user root Aug 03 08:33:43 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-cc2b10a5-d334-4726-9aca-339da2d88bcb tempest-VolumesSnapshotListTestJSON-651293966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-b9e50c09-afac-4032-8c98-137af4f2f895.be35aae5-631b-4e7b-a335-b9dcb072fe8e" returned: 0 in 0.611s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:33:43 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-cc2b10a5-d334-4726-9aca-339da2d88bcb tempest-VolumesSnapshotListTestJSON-651293966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-b9e50c09-afac-4032-8c98-137af4f2f895.be35aae5-631b-4e7b-a335-b9dcb072fe8e {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:33:43 devstack sudo[95944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-b9e50c09-afac-4032-8c98-137af4f2f895.be35aae5-631b-4e7b-a335-b9dcb072fe8e Aug 03 08:33:43 devstack sudo[95944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:33:44 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-d32cdef4-9d13-4e91-b9df-37cfe2d6c152 tempest-GroupSnapshotsTest-1944413600 None] Update group completed successfully. Aug 03 08:33:44 devstack sudo[95944]: pam_unix(sudo:session): session closed for user root Aug 03 08:33:44 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-cc2b10a5-d334-4726-9aca-339da2d88bcb tempest-VolumesSnapshotListTestJSON-651293966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-b9e50c09-afac-4032-8c98-137af4f2f895.be35aae5-631b-4e7b-a335-b9dcb072fe8e" returned: 0 in 0.418s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:33:44 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-cc2b10a5-d334-4726-9aca-339da2d88bcb tempest-VolumesSnapshotListTestJSON-651293966 None] Lock "cinder-quobyte-be35aae5-631b-4e7b-a335-b9dcb072fe8e" released by "_delete_snapshot" :: held 2.015s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:33:44 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-cc2b10a5-d334-4726-9aca-339da2d88bcb tempest-VolumesSnapshotListTestJSON-651293966 None] Lock "cinder-quobyte-b9e50c09-afac-4032-8c98-137af4f2f895" released by "delete_snapshot" :: held 2.044s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:33:44 devstack cinder-volume[88899]: DEBUG cinder.quota [None req-cc2b10a5-d334-4726-9aca-339da2d88bcb tempest-VolumesSnapshotListTestJSON-651293966 None] Created reservations ['eb689fdc-1abb-429c-8003-036687abe545', '22745963-8412-4e58-859e-584e70376995', '97deb288-15f0-4960-8271-74f77a588dc8', '45ae0e59-8cd8-4b21-a3bd-015e953a57e4'] {{(pid=88899) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 08:33:44 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [req-609f11c3-fc20-4d0d-9442-f1b31cb003fa req-73fd619e-4ab1-4e2e-9dc9-d40eb00cae25 tempest-AttachVolumeNegativeTest-1279867800 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:33:44 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [req-609f11c3-fc20-4d0d-9442-f1b31cb003fa req-73fd619e-4ab1-4e2e-9dc9-d40eb00cae25 tempest-AttachVolumeNegativeTest-1279867800 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:33:44 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [req-609f11c3-fc20-4d0d-9442-f1b31cb003fa req-73fd619e-4ab1-4e2e-9dc9-d40eb00cae25 tempest-AttachVolumeNegativeTest-1279867800 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.020s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:33:44 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-cc2b10a5-d334-4726-9aca-339da2d88bcb tempest-VolumesSnapshotListTestJSON-651293966 None] Delete snapshot completed successfully. Aug 03 08:33:44 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-cc2b10a5-d334-4726-9aca-339da2d88bcb tempest-VolumesSnapshotListTestJSON-651293966 None] Lock "cinder-be35aae5-631b-4e7b-a335-b9dcb072fe8e-delete_snapshot" released by "delete_snapshot" :: held 2.299s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:33:44 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [req-609f11c3-fc20-4d0d-9442-f1b31cb003fa req-73fd619e-4ab1-4e2e-9dc9-d40eb00cae25 tempest-AttachVolumeNegativeTest-1279867800 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385', 'name': 'volume-dfde963c-eaa2-46fd-a80f-4ddd0e14011c', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '35cce6f4-6d9a-46ec-8008-05a8b8f7c344', 'enforce_multipath': True} {{(pid=88899) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 03 08:33:44 devstack cinder-volume[88899]: INFO cinder.volume.manager [req-609f11c3-fc20-4d0d-9442-f1b31cb003fa req-73fd619e-4ab1-4e2e-9dc9-d40eb00cae25 tempest-AttachVolumeNegativeTest-1279867800 None] attachment_update completed successfully. Aug 03 08:33:45 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-f60666cc-f7ec-4248-9909-835ab7f53e05 tempest-GroupSnapshotsTest-1944413600 None] Update group completed successfully. Aug 03 08:33:45 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-98112cdc-5400-4171-96b9-64af3e4249a6 tempest-VolumesSnapshotListTestJSON-651293966 None] Acquiring lock "cinder-14861506-e7da-488b-9ede-7908c1a2012b-delete_snapshot" by "delete_snapshot" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:33:45 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-98112cdc-5400-4171-96b9-64af3e4249a6 tempest-VolumesSnapshotListTestJSON-651293966 None] Lock "cinder-14861506-e7da-488b-9ede-7908c1a2012b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:33:45 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-98112cdc-5400-4171-96b9-64af3e4249a6 tempest-VolumesSnapshotListTestJSON-651293966 None] Acquiring lock "cinder-quobyte-b9e50c09-afac-4032-8c98-137af4f2f895" by "delete_snapshot" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:33:45 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-98112cdc-5400-4171-96b9-64af3e4249a6 tempest-VolumesSnapshotListTestJSON-651293966 None] Lock "cinder-quobyte-b9e50c09-afac-4032-8c98-137af4f2f895" acquired by "delete_snapshot" :: waited 0.025s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:33:45 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-98112cdc-5400-4171-96b9-64af3e4249a6 tempest-VolumesSnapshotListTestJSON-651293966 None] Acquiring lock "cinder-quobyte-14861506-e7da-488b-9ede-7908c1a2012b" by "_delete_snapshot" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:33:45 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-98112cdc-5400-4171-96b9-64af3e4249a6 tempest-VolumesSnapshotListTestJSON-651293966 None] Lock "cinder-quobyte-14861506-e7da-488b-9ede-7908c1a2012b" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:33:45 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-98112cdc-5400-4171-96b9-64af3e4249a6 tempest-VolumesSnapshotListTestJSON-651293966 None] Deleting offline snapshot 14861506-e7da-488b-9ede-7908c1a2012b of volume b9e50c09-afac-4032-8c98-137af4f2f895 {{(pid=88899) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 03 08:33:45 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-98112cdc-5400-4171-96b9-64af3e4249a6 tempest-VolumesSnapshotListTestJSON-651293966 None] snapshot_file for this snap is: volume-b9e50c09-afac-4032-8c98-137af4f2f895.14861506-e7da-488b-9ede-7908c1a2012b {{(pid=88899) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 03 08:33:45 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4fbd068-382a-478b-aaad-bc8906a09f35]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:33:45 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-98112cdc-5400-4171-96b9-64af3e4249a6 tempest-VolumesSnapshotListTestJSON-651293966 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-b9e50c09-afac-4032-8c98-137af4f2f895.14861506-e7da-488b-9ede-7908c1a2012b {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:33:45 devstack sudo[96350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-b9e50c09-afac-4032-8c98-137af4f2f895.14861506-e7da-488b-9ede-7908c1a2012b Aug 03 08:33:45 devstack sudo[96350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:33:45 devstack sudo[96350]: pam_unix(sudo:session): session closed for user root Aug 03 08:33:45 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-98112cdc-5400-4171-96b9-64af3e4249a6 tempest-VolumesSnapshotListTestJSON-651293966 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-b9e50c09-afac-4032-8c98-137af4f2f895.14861506-e7da-488b-9ede-7908c1a2012b" returned: 0 in 0.412s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:33:45 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-98112cdc-5400-4171-96b9-64af3e4249a6 tempest-VolumesSnapshotListTestJSON-651293966 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b9e50c09-afac-4032-8c98-137af4f2f895(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88899) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 03 08:33:45 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec756e51-f481-4c77-848d-e7eef06cef09]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:33:45 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-98112cdc-5400-4171-96b9-64af3e4249a6 tempest-VolumesSnapshotListTestJSON-651293966 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-b9e50c09-afac-4032-8c98-137af4f2f895 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:33:46 devstack sudo[96355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-b9e50c09-afac-4032-8c98-137af4f2f895 Aug 03 08:33:46 devstack sudo[96355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:33:46 devstack cinder-volume[88899]: DEBUG cinder.volume.flows.manager.create_volume [None req-52aa8b81-25f1-4a8d-ae16-857fe86fcccb tempest-ServerActionsTestOtherA-826446422 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88899) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 08:33:46 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-52aa8b81-25f1-4a8d-ae16-857fe86fcccb tempest-ServerActionsTestOtherA-826446422 None] Flow 'volume_create_manager' (48bc1ccd-ff90-48e2-90a6-97f421277012) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:33:46 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-52aa8b81-25f1-4a8d-ae16-857fe86fcccb tempest-ServerActionsTestOtherA-826446422 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e7cf165-1561-46dc-a26b-dbeec8ad6f07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:33:46 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-52aa8b81-25f1-4a8d-ae16-857fe86fcccb tempest-ServerActionsTestOtherA-826446422 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e7cf165-1561-46dc-a26b-dbeec8ad6f07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:33:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1049015038',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a62a55cb-cd3f-4d05-9d19-0aa3f9654f56,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d1b6fd66571345ff99d622246ebbb270',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:33:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:33:46Z,use_quota=True,user_id='87918a8b928c4bd1bc1147851e28ecf9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8bde7129-1dc4-42ab-b852-ab32c61b4921),volume_type_id=8bde7129-1dc4-42ab-b852-ab32c61b4921)' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:33:46 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-52aa8b81-25f1-4a8d-ae16-857fe86fcccb tempest-ServerActionsTestOtherA-826446422 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25aea4d0-126a-403c-9995-c9c55bc7a529) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:33:46 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-52aa8b81-25f1-4a8d-ae16-857fe86fcccb tempest-ServerActionsTestOtherA-826446422 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25aea4d0-126a-403c-9995-c9c55bc7a529) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:33:46 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-52aa8b81-25f1-4a8d-ae16-857fe86fcccb tempest-ServerActionsTestOtherA-826446422 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4caa13a-3d97-4e3b-a944-7fe7c1206e16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:33:46 devstack cinder-volume[88899]: DEBUG cinder.image.glance [None req-52aa8b81-25f1-4a8d-ae16-857fe86fcccb tempest-ServerActionsTestOtherA-826446422 None] Creating Keystone auth plugin from conf {{(pid=88899) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Aug 03 08:33:46 devstack sudo[96355]: pam_unix(sudo:session): session closed for user root Aug 03 08:33:46 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-98112cdc-5400-4171-96b9-64af3e4249a6 tempest-VolumesSnapshotListTestJSON-651293966 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-b9e50c09-afac-4032-8c98-137af4f2f895" returned: 0 in 0.443s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:33:46 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-98112cdc-5400-4171-96b9-64af3e4249a6 tempest-VolumesSnapshotListTestJSON-651293966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-b9e50c09-afac-4032-8c98-137af4f2f895.14861506-e7da-488b-9ede-7908c1a2012b {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:33:46 devstack sudo[96360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-b9e50c09-afac-4032-8c98-137af4f2f895.14861506-e7da-488b-9ede-7908c1a2012b Aug 03 08:33:46 devstack sudo[96360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:33:46 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-67f99c59-5250-46b7-b370-cb46201d63e3 tempest-GroupSnapshotsTest-1944413600 None] Update group completed successfully. Aug 03 08:33:46 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-52aa8b81-25f1-4a8d-ae16-857fe86fcccb tempest-ServerActionsTestOtherA-826446422 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4caa13a-3d97-4e3b-a944-7fe7c1206e16) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'a62a55cb-cd3f-4d05-9d19-0aa3f9654f56', 'volume_name': 'volume-a62a55cb-cd3f-4d05-9d19-0aa3f9654f56', 'volume_size': 1, 'image_id': '37045a76-b9b1-4156-b15f-85c62a8616c3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/37045a76-b9b1-4156-b15f-85c62a8616c3', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'adee82974e9f41769efcb3f4a0eef199', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '37045a76-b9b1-4156-b15f-85c62a8616c3', 'created_at': datetime.datetime(2026, 8, 3, 6, 23, 4, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 3, 6, 23, 6, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/37045a76-b9b1-4156-b15f-85c62a8616c3/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:33:46 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-52aa8b81-25f1-4a8d-ae16-857fe86fcccb tempest-ServerActionsTestOtherA-826446422 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d2f00e6f-2c4b-4673-995e-b2fff3eaecbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:33:46 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-52aa8b81-25f1-4a8d-ae16-857fe86fcccb tempest-ServerActionsTestOtherA-826446422 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d2f00e6f-2c4b-4673-995e-b2fff3eaecbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:33:46 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-52aa8b81-25f1-4a8d-ae16-857fe86fcccb tempest-ServerActionsTestOtherA-826446422 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7a89f87-6f27-4412-a41f-ea20ba172d5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:33:46 devstack cinder-volume[88899]: INFO cinder.volume.flows.manager.create_volume [None req-52aa8b81-25f1-4a8d-ae16-857fe86fcccb tempest-ServerActionsTestOtherA-826446422 None] Volume a62a55cb-cd3f-4d05-9d19-0aa3f9654f56: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-a62a55cb-cd3f-4d05-9d19-0aa3f9654f56', 'volume_size': 1, 'image_id': '37045a76-b9b1-4156-b15f-85c62a8616c3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/37045a76-b9b1-4156-b15f-85c62a8616c3', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'adee82974e9f41769efcb3f4a0eef199', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '37045a76-b9b1-4156-b15f-85c62a8616c3', 'created_at': datetime.datetime(2026, 8, 3, 6, 23, 4, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 3, 6, 23, 6, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/37045a76-b9b1-4156-b15f-85c62a8616c3/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Aug 03 08:33:46 devstack cinder-volume[88899]: DEBUG cinder.volume.flows.manager.create_volume [None req-52aa8b81-25f1-4a8d-ae16-857fe86fcccb tempest-ServerActionsTestOtherA-826446422 None] Trying to clone a62a55cb-cd3f-4d05-9d19-0aa3f9654f56 from image 37045a76-b9b1-4156-b15f-85c62a8616c3 at location (None, [{'url': 'file:///opt/stack/data/glance/images/37045a76-b9b1-4156-b15f-85c62a8616c3', 'metadata': {}}]). {{(pid=88899) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Aug 03 08:33:46 devstack sudo[96360]: pam_unix(sudo:session): session closed for user root Aug 03 08:33:46 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-98112cdc-5400-4171-96b9-64af3e4249a6 tempest-VolumesSnapshotListTestJSON-651293966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-b9e50c09-afac-4032-8c98-137af4f2f895.14861506-e7da-488b-9ede-7908c1a2012b" returned: 0 in 0.499s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:33:46 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-98112cdc-5400-4171-96b9-64af3e4249a6 tempest-VolumesSnapshotListTestJSON-651293966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-b9e50c09-afac-4032-8c98-137af4f2f895.14861506-e7da-488b-9ede-7908c1a2012b {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:33:46 devstack sudo[96388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-b9e50c09-afac-4032-8c98-137af4f2f895.14861506-e7da-488b-9ede-7908c1a2012b Aug 03 08:33:46 devstack sudo[96388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:33:47 devstack cinder-volume[88899]: DEBUG cinder.image.image_utils [None req-52aa8b81-25f1-4a8d-ae16-857fe86fcccb tempest-ServerActionsTestOtherA-826446422 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_37045a76-b9b1-4156-b15f-85c62a8616c3_61gogb_rdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=88899) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Aug 03 08:33:47 devstack cinder-volume[88899]: INFO cinder.image.image_utils [None req-52aa8b81-25f1-4a8d-ae16-857fe86fcccb tempest-ServerActionsTestOtherA-826446422 None] Image download 20.69 MB at 20.69 MB/s Aug 03 08:33:47 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0ded122-440a-4404-8e10-eacb62137525]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:33:47 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-52aa8b81-25f1-4a8d-ae16-857fe86fcccb tempest-ServerActionsTestOtherA-826446422 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_37045a76-b9b1-4156-b15f-85c62a8616c3_61gogb_rdevstack@QuobyteHD {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:33:47 devstack sudo[96388]: pam_unix(sudo:session): session closed for user root Aug 03 08:33:47 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-98112cdc-5400-4171-96b9-64af3e4249a6 tempest-VolumesSnapshotListTestJSON-651293966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-b9e50c09-afac-4032-8c98-137af4f2f895.14861506-e7da-488b-9ede-7908c1a2012b" returned: 0 in 0.293s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:33:47 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-98112cdc-5400-4171-96b9-64af3e4249a6 tempest-VolumesSnapshotListTestJSON-651293966 None] Lock "cinder-quobyte-14861506-e7da-488b-9ede-7908c1a2012b" released by "_delete_snapshot" :: held 1.798s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:33:47 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-98112cdc-5400-4171-96b9-64af3e4249a6 tempest-VolumesSnapshotListTestJSON-651293966 None] Lock "cinder-quobyte-b9e50c09-afac-4032-8c98-137af4f2f895" released by "delete_snapshot" :: held 1.828s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:33:47 devstack sudo[96395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_37045a76-b9b1-4156-b15f-85c62a8616c3_61gogb_rdevstack@QuobyteHD Aug 03 08:33:47 devstack sudo[96395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:33:47 devstack cinder-volume[88899]: DEBUG cinder.quota [None req-98112cdc-5400-4171-96b9-64af3e4249a6 tempest-VolumesSnapshotListTestJSON-651293966 None] Created reservations ['f210645b-d38c-4c95-bd42-1df655265a03', '29a05bc6-d536-477e-9139-67ef4464a2e4', '6eecff4d-11cf-4a77-990b-da6220c71b74', 'a455a833-fddb-42d8-8a83-59ec7e9a4946'] {{(pid=88899) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 08:33:47 devstack cinder-volume[88899]: INFO cinder.volume.manager [req-17bdcfd0-ce3a-4cbf-9f70-147d1478006c req-88e9e663-ea8c-4154-a043-387dbfb48464 tempest-AttachVolumeNegativeTest-1279867800 None] Terminate volume connection completed successfully. Aug 03 08:33:47 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [req-17bdcfd0-ce3a-4cbf-9f70-147d1478006c req-88e9e663-ea8c-4154-a043-387dbfb48464 tempest-AttachVolumeNegativeTest-1279867800 None] Deleting attachment 35cce6f4-6d9a-46ec-8008-05a8b8f7c344. {{(pid=88899) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 03 08:33:47 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-98112cdc-5400-4171-96b9-64af3e4249a6 tempest-VolumesSnapshotListTestJSON-651293966 None] Delete snapshot completed successfully. Aug 03 08:33:47 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-98112cdc-5400-4171-96b9-64af3e4249a6 tempest-VolumesSnapshotListTestJSON-651293966 None] Lock "cinder-14861506-e7da-488b-9ede-7908c1a2012b-delete_snapshot" released by "delete_snapshot" :: held 2.041s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:33:47 devstack sudo[96395]: pam_unix(sudo:session): session closed for user root Aug 03 08:33:47 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-52aa8b81-25f1-4a8d-ae16-857fe86fcccb tempest-ServerActionsTestOtherA-826446422 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_37045a76-b9b1-4156-b15f-85c62a8616c3_61gogb_rdevstack@QuobyteHD" returned: 0 in 0.405s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:33:47 devstack cinder-volume[88899]: DEBUG cinder.image.image_utils [None req-52aa8b81-25f1-4a8d-ae16-857fe86fcccb tempest-ServerActionsTestOtherA-826446422 None] Temporary image 37045a76-b9b1-4156-b15f-85c62a8616c3 is fetched for user 87918a8b928c4bd1bc1147851e28ecf9. {{(pid=88899) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Aug 03 08:33:47 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-5a96712f-2a93-4cd7-9f64-45a98713cdc5 tempest-VolumesSnapshotListTestJSON-651293966 None] Acquiring lock "cinder-b9e50c09-afac-4032-8c98-137af4f2f895-delete_volume" by "delete_volume" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:33:47 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd6510ef-952f-4fb3-a759-18636a839b5e]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:33:47 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-52aa8b81-25f1-4a8d-ae16-857fe86fcccb tempest-ServerActionsTestOtherA-826446422 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_37045a76-b9b1-4156-b15f-85c62a8616c3_61gogb_rdevstack@QuobyteHD {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:33:47 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-5a96712f-2a93-4cd7-9f64-45a98713cdc5 tempest-VolumesSnapshotListTestJSON-651293966 None] Lock "cinder-b9e50c09-afac-4032-8c98-137af4f2f895-delete_volume" acquired by "delete_volume" :: waited 0.055s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:33:47 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-c8a72da1-5383-4857-8e6d-69d6dde7866c tempest-GroupSnapshotsTest-1944413600 None] Update group completed successfully. Aug 03 08:33:47 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-5a96712f-2a93-4cd7-9f64-45a98713cdc5 tempest-VolumesSnapshotListTestJSON-651293966 None] Acquiring lock "cinder-quobyte-b9e50c09-afac-4032-8c98-137af4f2f895" by "delete_volume" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:33:47 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-5a96712f-2a93-4cd7-9f64-45a98713cdc5 tempest-VolumesSnapshotListTestJSON-651293966 None] Lock "cinder-quobyte-b9e50c09-afac-4032-8c98-137af4f2f895" acquired by "delete_volume" :: waited 0.016s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:33:47 devstack sudo[96429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_37045a76-b9b1-4156-b15f-85c62a8616c3_61gogb_rdevstack@QuobyteHD Aug 03 08:33:47 devstack sudo[96429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:33:47 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd6e4282-cf36-4423-a559-ecdf8283578d]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:33:47 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-5a96712f-2a93-4cd7-9f64-45a98713cdc5 tempest-VolumesSnapshotListTestJSON-651293966 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-b9e50c09-afac-4032-8c98-137af4f2f895 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:33:47 devstack sudo[96431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-b9e50c09-afac-4032-8c98-137af4f2f895 Aug 03 08:33:47 devstack sudo[96431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:33:48 devstack sudo[96429]: pam_unix(sudo:session): session closed for user root Aug 03 08:33:48 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-52aa8b81-25f1-4a8d-ae16-857fe86fcccb tempest-ServerActionsTestOtherA-826446422 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_37045a76-b9b1-4156-b15f-85c62a8616c3_61gogb_rdevstack@QuobyteHD" returned: 0 in 0.390s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:33:48 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-52aa8b81-25f1-4a8d-ae16-857fe86fcccb tempest-ServerActionsTestOtherA-826446422 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:33:48 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-52aa8b81-25f1-4a8d-ae16-857fe86fcccb tempest-ServerActionsTestOtherA-826446422 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:33:48 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-52aa8b81-25f1-4a8d-ae16-857fe86fcccb tempest-ServerActionsTestOtherA-826446422 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:33:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1049015038',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a62a55cb-cd3f-4d05-9d19-0aa3f9654f56,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d1b6fd66571345ff99d622246ebbb270',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:33:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:33:46Z,use_quota=True,user_id='87918a8b928c4bd1bc1147851e28ecf9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8bde7129-1dc4-42ab-b852-ab32c61b4921),volume_type_id=8bde7129-1dc4-42ab-b852-ab32c61b4921)}" {{(pid=88899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 08:33:48 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-52aa8b81-25f1-4a8d-ae16-857fe86fcccb tempest-ServerActionsTestOtherA-826446422 None] Creating volume a62a55cb-cd3f-4d05-9d19-0aa3f9654f56 {{(pid=88899) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 08:33:48 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-52aa8b81-25f1-4a8d-ae16-857fe86fcccb tempest-ServerActionsTestOtherA-826446422 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:33:48 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-52aa8b81-25f1-4a8d-ae16-857fe86fcccb tempest-ServerActionsTestOtherA-826446422 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:33:48 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-52aa8b81-25f1-4a8d-ae16-857fe86fcccb tempest-ServerActionsTestOtherA-826446422 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:33:48 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-52aa8b81-25f1-4a8d-ae16-857fe86fcccb tempest-ServerActionsTestOtherA-826446422 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:33:48 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-52aa8b81-25f1-4a8d-ae16-857fe86fcccb tempest-ServerActionsTestOtherA-826446422 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:33:48 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-52aa8b81-25f1-4a8d-ae16-857fe86fcccb tempest-ServerActionsTestOtherA-826446422 None] Selected osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385 as target Quobyte volume. {{(pid=88899) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 08:33:48 devstack cinder-volume[88899]: INFO cinder.volume.drivers.remotefs [None req-52aa8b81-25f1-4a8d-ae16-857fe86fcccb tempest-ServerActionsTestOtherA-826446422 None] casted to osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385 Aug 03 08:33:48 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-52aa8b81-25f1-4a8d-ae16-857fe86fcccb tempest-ServerActionsTestOtherA-826446422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-a62a55cb-cd3f-4d05-9d19-0aa3f9654f56 1073741824 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:33:48 devstack sudo[96437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-a62a55cb-cd3f-4d05-9d19-0aa3f9654f56 1073741824 Aug 03 08:33:48 devstack sudo[96437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:33:48 devstack sudo[96431]: pam_unix(sudo:session): session closed for user root Aug 03 08:33:48 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-5a96712f-2a93-4cd7-9f64-45a98713cdc5 tempest-VolumesSnapshotListTestJSON-651293966 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-b9e50c09-afac-4032-8c98-137af4f2f895" returned: 0 in 0.465s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:33:48 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-5a96712f-2a93-4cd7-9f64-45a98713cdc5 tempest-VolumesSnapshotListTestJSON-651293966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-b9e50c09-afac-4032-8c98-137af4f2f895 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:33:48 devstack sudo[96442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-b9e50c09-afac-4032-8c98-137af4f2f895 Aug 03 08:33:48 devstack sudo[96442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:33:48 devstack sudo[96442]: pam_unix(sudo:session): session closed for user root Aug 03 08:33:48 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-5a96712f-2a93-4cd7-9f64-45a98713cdc5 tempest-VolumesSnapshotListTestJSON-651293966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-b9e50c09-afac-4032-8c98-137af4f2f895" returned: 0 in 0.426s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:33:48 devstack sudo[96437]: pam_unix(sudo:session): session closed for user root Aug 03 08:33:48 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-52aa8b81-25f1-4a8d-ae16-857fe86fcccb tempest-ServerActionsTestOtherA-826446422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-a62a55cb-cd3f-4d05-9d19-0aa3f9654f56 1073741824" returned: 0 in 0.698s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:33:48 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-5a96712f-2a93-4cd7-9f64-45a98713cdc5 tempest-VolumesSnapshotListTestJSON-651293966 None] Lock "cinder-quobyte-b9e50c09-afac-4032-8c98-137af4f2f895" released by "delete_volume" :: held 1.004s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:33:48 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-52aa8b81-25f1-4a8d-ae16-857fe86fcccb tempest-ServerActionsTestOtherA-826446422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-a62a55cb-cd3f-4d05-9d19-0aa3f9654f56 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:33:48 devstack sudo[96470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-a62a55cb-cd3f-4d05-9d19-0aa3f9654f56 Aug 03 08:33:48 devstack sudo[96470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:33:48 devstack cinder-volume[88899]: DEBUG cinder.quota [None req-5a96712f-2a93-4cd7-9f64-45a98713cdc5 tempest-VolumesSnapshotListTestJSON-651293966 None] Created reservations ['dedbe6a3-8fff-427f-a2b2-53db8f1948d7', 'e776d63c-2a2a-4c0d-95eb-2545da145093', '28bc8a24-41fc-47c9-9ea0-c1f891f0b2f3', '30aede25-7b19-4f8e-ac34-92e8de65981b'] {{(pid=88899) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 08:33:49 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-5a96712f-2a93-4cd7-9f64-45a98713cdc5 tempest-VolumesSnapshotListTestJSON-651293966 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:33:49 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-5a96712f-2a93-4cd7-9f64-45a98713cdc5 tempest-VolumesSnapshotListTestJSON-651293966 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:33:49 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-5a96712f-2a93-4cd7-9f64-45a98713cdc5 tempest-VolumesSnapshotListTestJSON-651293966 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:33:49 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-5a96712f-2a93-4cd7-9f64-45a98713cdc5 tempest-VolumesSnapshotListTestJSON-651293966 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:33:49 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-5a96712f-2a93-4cd7-9f64-45a98713cdc5 tempest-VolumesSnapshotListTestJSON-651293966 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:33:49 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-5a96712f-2a93-4cd7-9f64-45a98713cdc5 tempest-VolumesSnapshotListTestJSON-651293966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:33:49 devstack sudo[96473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a Aug 03 08:33:49 devstack sudo[96473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:33:49 devstack sudo[96470]: pam_unix(sudo:session): session closed for user root Aug 03 08:33:49 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-52aa8b81-25f1-4a8d-ae16-857fe86fcccb tempest-ServerActionsTestOtherA-826446422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-a62a55cb-cd3f-4d05-9d19-0aa3f9654f56" returned: 0 in 0.421s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:33:49 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-52aa8b81-25f1-4a8d-ae16-857fe86fcccb tempest-ServerActionsTestOtherA-826446422 None] <== create_volume: return (1223ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'} {{(pid=88899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 08:33:49 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-52aa8b81-25f1-4a8d-ae16-857fe86fcccb tempest-ServerActionsTestOtherA-826446422 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.227s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:33:49 devstack cinder-volume[88899]: DEBUG cinder.volume.volume_utils [None req-52aa8b81-25f1-4a8d-ae16-857fe86fcccb tempest-ServerActionsTestOtherA-826446422 None] Attempting download of 37045a76-b9b1-4156-b15f-85c62a8616c3 ((None, [{'url': 'file:///opt/stack/data/glance/images/37045a76-b9b1-4156-b15f-85c62a8616c3', 'metadata': {}}])) to volume a62a55cb-cd3f-4d05-9d19-0aa3f9654f56. {{(pid=88899) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Aug 03 08:33:49 devstack sudo[96473]: pam_unix(sudo:session): session closed for user root Aug 03 08:33:49 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-5a96712f-2a93-4cd7-9f64-45a98713cdc5 tempest-VolumesSnapshotListTestJSON-651293966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a" returned: 0 in 0.374s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:33:49 devstack cinder-volume[88899]: DEBUG cinder.manager [None req-5a96712f-2a93-4cd7-9f64-45a98713cdc5 tempest-VolumesSnapshotListTestJSON-651293966 None] Notifying Schedulers of capabilities ... {{(pid=88899) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 08:33:49 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-5a96712f-2a93-4cd7-9f64-45a98713cdc5 tempest-VolumesSnapshotListTestJSON-651293966 None] Deleted volume successfully. Aug 03 08:33:49 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-5a96712f-2a93-4cd7-9f64-45a98713cdc5 tempest-VolumesSnapshotListTestJSON-651293966 None] Lock "cinder-b9e50c09-afac-4032-8c98-137af4f2f895-delete_volume" released by "delete_volume" :: held 1.765s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:33:49 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[deea2ae1-6e4e-433a-9739-4845903b2fe6]: (4, 'raw') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:33:49 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-52aa8b81-25f1-4a8d-ae16-857fe86fcccb tempest-ServerActionsTestOtherA-826446422 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_37045a76-b9b1-4156-b15f-85c62a8616c3_5kpigfta {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:33:49 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-b451b5ea-44b7-4181-9c6f-7a09374b8c92 tempest-GroupSnapshotsTest-1944413600 None] GroupSnapshot 337b2c69-4a5b-46d2-bc3d-00d97abdabd4: creating. Aug 03 08:33:49 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-b451b5ea-44b7-4181-9c6f-7a09374b8c92 tempest-GroupSnapshotsTest-1944413600 None] Group snapshot 337b2c69-4a5b-46d2-bc3d-00d97abdabd4: creating. {{(pid=88899) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Aug 03 08:33:49 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-b451b5ea-44b7-4181-9c6f-7a09374b8c92 tempest-GroupSnapshotsTest-1944413600 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:33:49 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-b451b5ea-44b7-4181-9c6f-7a09374b8c92 tempest-GroupSnapshotsTest-1944413600 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:33:49 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-b451b5ea-44b7-4181-9c6f-7a09374b8c92 tempest-GroupSnapshotsTest-1944413600 None] Creating offline snapshot 0a263736-01c0-4b75-9d23-da79f1ebe1b2 of volume 408a47fd-ac2d-4d65-9de5-595cb59982a4 {{(pid=88899) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 03 08:33:49 devstack sudo[96477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_37045a76-b9b1-4156-b15f-85c62a8616c3_5kpigfta Aug 03 08:33:49 devstack sudo[96477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:33:49 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[25c15652-b61d-4870-ace6-60ba885e5e89]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:33:49 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-b451b5ea-44b7-4181-9c6f-7a09374b8c92 tempest-GroupSnapshotsTest-1944413600 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-408a47fd-ac2d-4d65-9de5-595cb59982a4 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:33:49 devstack sudo[96479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-408a47fd-ac2d-4d65-9de5-595cb59982a4 Aug 03 08:33:49 devstack sudo[96479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:33:50 devstack sudo[96477]: pam_unix(sudo:session): session closed for user root Aug 03 08:33:50 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-52aa8b81-25f1-4a8d-ae16-857fe86fcccb tempest-ServerActionsTestOtherA-826446422 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_37045a76-b9b1-4156-b15f-85c62a8616c3_5kpigfta" returned: 0 in 0.518s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:33:50 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-52aa8b81-25f1-4a8d-ae16-857fe86fcccb tempest-ServerActionsTestOtherA-826446422 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_37045a76-b9b1-4156-b15f-85c62a8616c3_5kpigfta {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:33:50 devstack sudo[96479]: pam_unix(sudo:session): session closed for user root Aug 03 08:33:50 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-b451b5ea-44b7-4181-9c6f-7a09374b8c92 tempest-GroupSnapshotsTest-1944413600 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-408a47fd-ac2d-4d65-9de5-595cb59982a4" returned: 0 in 0.503s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:33:50 devstack sudo[96485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_37045a76-b9b1-4156-b15f-85c62a8616c3_5kpigfta Aug 03 08:33:50 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-b451b5ea-44b7-4181-9c6f-7a09374b8c92 tempest-GroupSnapshotsTest-1944413600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-408a47fd-ac2d-4d65-9de5-595cb59982a4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-408a47fd-ac2d-4d65-9de5-595cb59982a4.0a263736-01c0-4b75-9d23-da79f1ebe1b2 1G {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:33:50 devstack sudo[96485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:33:50 devstack sudo[96492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-408a47fd-ac2d-4d65-9de5-595cb59982a4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-408a47fd-ac2d-4d65-9de5-595cb59982a4.0a263736-01c0-4b75-9d23-da79f1ebe1b2 1G Aug 03 08:33:50 devstack sudo[96492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:33:50 devstack sudo[96485]: pam_unix(sudo:session): session closed for user root Aug 03 08:33:50 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-52aa8b81-25f1-4a8d-ae16-857fe86fcccb tempest-ServerActionsTestOtherA-826446422 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_37045a76-b9b1-4156-b15f-85c62a8616c3_5kpigfta" returned: 1 in 0.469s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:33:50 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-52aa8b81-25f1-4a8d-ae16-857fe86fcccb tempest-ServerActionsTestOtherA-826446422 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_37045a76-b9b1-4156-b15f-85c62a8616c3_5kpigfta' failed. Not Retrying. {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 03 08:33:50 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d9e04f5-e3d4-4a5b-9f7c-ac678a4ef66e]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:33:50 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-52aa8b81-25f1-4a8d-ae16-857fe86fcccb tempest-ServerActionsTestOtherA-826446422 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_37045a76-b9b1-4156-b15f-85c62a8616c3_61gogb_rdevstack@QuobyteHD {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:33:50 devstack sudo[96499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_37045a76-b9b1-4156-b15f-85c62a8616c3_61gogb_rdevstack@QuobyteHD Aug 03 08:33:50 devstack sudo[96499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:33:50 devstack sudo[96492]: pam_unix(sudo:session): session closed for user root Aug 03 08:33:50 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-b451b5ea-44b7-4181-9c6f-7a09374b8c92 tempest-GroupSnapshotsTest-1944413600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-408a47fd-ac2d-4d65-9de5-595cb59982a4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-408a47fd-ac2d-4d65-9de5-595cb59982a4.0a263736-01c0-4b75-9d23-da79f1ebe1b2 1G" returned: 0 in 0.654s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:33:50 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-b451b5ea-44b7-4181-9c6f-7a09374b8c92 tempest-GroupSnapshotsTest-1944413600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-408a47fd-ac2d-4d65-9de5-595cb59982a4 -F qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-408a47fd-ac2d-4d65-9de5-595cb59982a4.0a263736-01c0-4b75-9d23-da79f1ebe1b2 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:33:50 devstack sudo[96536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-408a47fd-ac2d-4d65-9de5-595cb59982a4 -F qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-408a47fd-ac2d-4d65-9de5-595cb59982a4.0a263736-01c0-4b75-9d23-da79f1ebe1b2 Aug 03 08:33:50 devstack sudo[96536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:33:50 devstack sudo[96499]: pam_unix(sudo:session): session closed for user root Aug 03 08:33:51 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-52aa8b81-25f1-4a8d-ae16-857fe86fcccb tempest-ServerActionsTestOtherA-826446422 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_37045a76-b9b1-4156-b15f-85c62a8616c3_61gogb_rdevstack@QuobyteHD" returned: 0 in 0.478s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:33:51 devstack cinder-volume[88899]: DEBUG cinder.image.image_utils [None req-52aa8b81-25f1-4a8d-ae16-857fe86fcccb tempest-ServerActionsTestOtherA-826446422 None] 37045a76-b9b1-4156-b15f-85c62a8616c3 was qcow2, converting to qcow2 {{(pid=88899) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Aug 03 08:33:51 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-52aa8b81-25f1-4a8d-ae16-857fe86fcccb tempest-ServerActionsTestOtherA-826446422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_37045a76-b9b1-4156-b15f-85c62a8616c3_61gogb_rdevstack@QuobyteHD /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-a62a55cb-cd3f-4d05-9d19-0aa3f9654f56 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:33:51 devstack sudo[96543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_37045a76-b9b1-4156-b15f-85c62a8616c3_61gogb_rdevstack@QuobyteHD /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-a62a55cb-cd3f-4d05-9d19-0aa3f9654f56 Aug 03 08:33:51 devstack sudo[96543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:33:51 devstack sudo[96536]: pam_unix(sudo:session): session closed for user root Aug 03 08:33:51 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-b451b5ea-44b7-4181-9c6f-7a09374b8c92 tempest-GroupSnapshotsTest-1944413600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-408a47fd-ac2d-4d65-9de5-595cb59982a4 -F qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-408a47fd-ac2d-4d65-9de5-595cb59982a4.0a263736-01c0-4b75-9d23-da79f1ebe1b2" returned: 0 in 0.601s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:33:51 devstack cinder-volume[88899]: WARNING cinder.volume.drivers.remotefs [None req-b451b5ea-44b7-4181-9c6f-7a09374b8c92 tempest-GroupSnapshotsTest-1944413600 None] /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-408a47fd-ac2d-4d65-9de5-595cb59982a4.0a263736-01c0-4b75-9d23-da79f1ebe1b2 is being set with open permissions: ugo+rw: NotImplementedError Aug 03 08:33:51 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-b451b5ea-44b7-4181-9c6f-7a09374b8c92 tempest-GroupSnapshotsTest-1944413600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-408a47fd-ac2d-4d65-9de5-595cb59982a4.0a263736-01c0-4b75-9d23-da79f1ebe1b2 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:33:51 devstack sudo[96553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-408a47fd-ac2d-4d65-9de5-595cb59982a4.0a263736-01c0-4b75-9d23-da79f1ebe1b2 Aug 03 08:33:51 devstack sudo[96553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:33:51 devstack cinder-volume[88899]: DEBUG oslo_service.periodic_task [None req-f948fb4a-c4d7-499f-b1bd-8d6be3de0b53 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88899) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 03 08:33:51 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-f948fb4a-c4d7-499f-b1bd-8d6be3de0b53 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:33:51 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-f948fb4a-c4d7-499f-b1bd-8d6be3de0b53 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:33:51 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-f948fb4a-c4d7-499f-b1bd-8d6be3de0b53 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:33:51 devstack sudo[96553]: pam_unix(sudo:session): session closed for user root Aug 03 08:33:51 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-f948fb4a-c4d7-499f-b1bd-8d6be3de0b53 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:33:51 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-f948fb4a-c4d7-499f-b1bd-8d6be3de0b53 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:33:51 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-f948fb4a-c4d7-499f-b1bd-8d6be3de0b53 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:33:51 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-b451b5ea-44b7-4181-9c6f-7a09374b8c92 tempest-GroupSnapshotsTest-1944413600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-408a47fd-ac2d-4d65-9de5-595cb59982a4.0a263736-01c0-4b75-9d23-da79f1ebe1b2" returned: 0 in 0.350s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:33:51 devstack sudo[96558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a Aug 03 08:33:51 devstack sudo[96558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:33:51 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-b451b5ea-44b7-4181-9c6f-7a09374b8c92 tempest-GroupSnapshotsTest-1944413600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-408a47fd-ac2d-4d65-9de5-595cb59982a4.info {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:33:51 devstack sudo[96560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-408a47fd-ac2d-4d65-9de5-595cb59982a4.info Aug 03 08:33:51 devstack sudo[96560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:33:52 devstack sudo[96558]: pam_unix(sudo:session): session closed for user root Aug 03 08:33:52 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-f948fb4a-c4d7-499f-b1bd-8d6be3de0b53 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a" returned: 0 in 0.377s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:33:52 devstack cinder-volume[88899]: DEBUG cinder.manager [None req-f948fb4a-c4d7-499f-b1bd-8d6be3de0b53 None None] Notifying Schedulers of capabilities ... {{(pid=88899) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 08:33:52 devstack cinder-volume[88899]: DEBUG oslo_service.periodic_task [None req-f948fb4a-c4d7-499f-b1bd-8d6be3de0b53 None None] Running periodic task VolumeManager._thread_info {{(pid=88899) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 03 08:33:52 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-f948fb4a-c4d7-499f-b1bd-8d6be3de0b53 None None] thread count: 28 {{(pid=88899) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 03 08:33:52 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-f948fb4a-c4d7-499f-b1bd-8d6be3de0b53 None None] thread info: [<_MainThread(MainThread, started 132234320248960)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88899) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 03 08:33:52 devstack sudo[96560]: pam_unix(sudo:session): session closed for user root Aug 03 08:33:52 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-b451b5ea-44b7-4181-9c6f-7a09374b8c92 tempest-GroupSnapshotsTest-1944413600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-408a47fd-ac2d-4d65-9de5-595cb59982a4.info" returned: 0 in 0.319s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:33:52 devstack cinder-volume[88899]: WARNING cinder.volume.drivers.remotefs [None req-b451b5ea-44b7-4181-9c6f-7a09374b8c92 tempest-GroupSnapshotsTest-1944413600 None] /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-408a47fd-ac2d-4d65-9de5-595cb59982a4.info is being set with open permissions: ugo+rw: NotImplementedError Aug 03 08:33:52 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-b451b5ea-44b7-4181-9c6f-7a09374b8c92 tempest-GroupSnapshotsTest-1944413600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-408a47fd-ac2d-4d65-9de5-595cb59982a4.info {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:33:52 devstack sudo[96564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-408a47fd-ac2d-4d65-9de5-595cb59982a4.info Aug 03 08:33:52 devstack sudo[96564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:33:52 devstack sudo[96564]: pam_unix(sudo:session): session closed for user root Aug 03 08:33:52 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-b451b5ea-44b7-4181-9c6f-7a09374b8c92 tempest-GroupSnapshotsTest-1944413600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-408a47fd-ac2d-4d65-9de5-595cb59982a4.info" returned: 0 in 0.297s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:33:52 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-b451b5ea-44b7-4181-9c6f-7a09374b8c92 tempest-GroupSnapshotsTest-1944413600 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.910s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:33:52 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-b451b5ea-44b7-4181-9c6f-7a09374b8c92 tempest-GroupSnapshotsTest-1944413600 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:33:52 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-b451b5ea-44b7-4181-9c6f-7a09374b8c92 tempest-GroupSnapshotsTest-1944413600 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:33:52 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-b451b5ea-44b7-4181-9c6f-7a09374b8c92 tempest-GroupSnapshotsTest-1944413600 None] Creating offline snapshot a9f917c0-df45-4ff9-95c5-2c1649da6911 of volume d9319880-9aa9-4c4e-9fe1-ce86f035edf0 {{(pid=88899) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 03 08:33:52 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e452a51-6cb5-409a-bfb0-ea4731fcda0e]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:33:52 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-b451b5ea-44b7-4181-9c6f-7a09374b8c92 tempest-GroupSnapshotsTest-1944413600 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-d9319880-9aa9-4c4e-9fe1-ce86f035edf0 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:33:52 devstack sudo[96567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-d9319880-9aa9-4c4e-9fe1-ce86f035edf0 Aug 03 08:33:52 devstack sudo[96567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:33:53 devstack sudo[96567]: pam_unix(sudo:session): session closed for user root Aug 03 08:33:53 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-b451b5ea-44b7-4181-9c6f-7a09374b8c92 tempest-GroupSnapshotsTest-1944413600 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-d9319880-9aa9-4c4e-9fe1-ce86f035edf0" returned: 0 in 0.454s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:33:53 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-b451b5ea-44b7-4181-9c6f-7a09374b8c92 tempest-GroupSnapshotsTest-1944413600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-d9319880-9aa9-4c4e-9fe1-ce86f035edf0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-d9319880-9aa9-4c4e-9fe1-ce86f035edf0.a9f917c0-df45-4ff9-95c5-2c1649da6911 1G {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:33:53 devstack sudo[96572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-d9319880-9aa9-4c4e-9fe1-ce86f035edf0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-d9319880-9aa9-4c4e-9fe1-ce86f035edf0.a9f917c0-df45-4ff9-95c5-2c1649da6911 1G Aug 03 08:33:53 devstack sudo[96572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:33:53 devstack sudo[96543]: pam_unix(sudo:session): session closed for user root Aug 03 08:33:53 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-52aa8b81-25f1-4a8d-ae16-857fe86fcccb tempest-ServerActionsTestOtherA-826446422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_37045a76-b9b1-4156-b15f-85c62a8616c3_61gogb_rdevstack@QuobyteHD /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-a62a55cb-cd3f-4d05-9d19-0aa3f9654f56" returned: 0 in 2.465s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:33:53 devstack cinder-volume[88899]: DEBUG cinder.image.image_utils [None req-52aa8b81-25f1-4a8d-ae16-857fe86fcccb tempest-ServerActionsTestOtherA-826446422 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_37045a76-b9b1-4156-b15f-85c62a8616c3_61gogb_rdevstack@QuobyteHD, size 112.00 MB, duration 2.47 sec, destination /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-a62a55cb-cd3f-4d05-9d19-0aa3f9654f56 {{(pid=88899) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 03 08:33:53 devstack cinder-volume[88899]: INFO cinder.image.image_utils [None req-52aa8b81-25f1-4a8d-ae16-857fe86fcccb tempest-ServerActionsTestOtherA-826446422 None] Converted 112.00 MB image at 45.41 MB/s Aug 03 08:33:53 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-52aa8b81-25f1-4a8d-ae16-857fe86fcccb tempest-ServerActionsTestOtherA-826446422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-a62a55cb-cd3f-4d05-9d19-0aa3f9654f56 1G {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:33:53 devstack sudo[96577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-a62a55cb-cd3f-4d05-9d19-0aa3f9654f56 1G Aug 03 08:33:53 devstack sudo[96577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:33:53 devstack sudo[96572]: pam_unix(sudo:session): session closed for user root Aug 03 08:33:53 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-b451b5ea-44b7-4181-9c6f-7a09374b8c92 tempest-GroupSnapshotsTest-1944413600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-d9319880-9aa9-4c4e-9fe1-ce86f035edf0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-d9319880-9aa9-4c4e-9fe1-ce86f035edf0.a9f917c0-df45-4ff9-95c5-2c1649da6911 1G" returned: 0 in 0.625s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:33:53 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-b451b5ea-44b7-4181-9c6f-7a09374b8c92 tempest-GroupSnapshotsTest-1944413600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d9319880-9aa9-4c4e-9fe1-ce86f035edf0 -F qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-d9319880-9aa9-4c4e-9fe1-ce86f035edf0.a9f917c0-df45-4ff9-95c5-2c1649da6911 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:33:53 devstack sudo[96580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d9319880-9aa9-4c4e-9fe1-ce86f035edf0 -F qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-d9319880-9aa9-4c4e-9fe1-ce86f035edf0.a9f917c0-df45-4ff9-95c5-2c1649da6911 Aug 03 08:33:53 devstack sudo[96580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:33:53 devstack sudo[96577]: pam_unix(sudo:session): session closed for user root Aug 03 08:33:53 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-52aa8b81-25f1-4a8d-ae16-857fe86fcccb tempest-ServerActionsTestOtherA-826446422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-a62a55cb-cd3f-4d05-9d19-0aa3f9654f56 1G" returned: 0 in 0.479s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:33:53 devstack cinder-volume[88899]: DEBUG cinder.volume.volume_utils [None req-52aa8b81-25f1-4a8d-ae16-857fe86fcccb tempest-ServerActionsTestOtherA-826446422 None] Downloaded image 37045a76-b9b1-4156-b15f-85c62a8616c3 ((None, [{'url': 'file:///opt/stack/data/glance/images/37045a76-b9b1-4156-b15f-85c62a8616c3', 'metadata': {}}])) to volume a62a55cb-cd3f-4d05-9d19-0aa3f9654f56 successfully. {{(pid=88899) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Aug 03 08:33:53 devstack cinder-volume[88899]: DEBUG cinder.image.image_utils [None req-52aa8b81-25f1-4a8d-ae16-857fe86fcccb tempest-ServerActionsTestOtherA-826446422 None] Temporary image 37045a76-b9b1-4156-b15f-85c62a8616c3 for user 87918a8b928c4bd1bc1147851e28ecf9 is deleted. {{(pid=88899) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Aug 03 08:33:53 devstack cinder-volume[88899]: DEBUG cinder.volume.volume_utils [None req-52aa8b81-25f1-4a8d-ae16-857fe86fcccb tempest-ServerActionsTestOtherA-826446422 None] Marking volume a62a55cb-cd3f-4d05-9d19-0aa3f9654f56 as bootable. {{(pid=88899) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Aug 03 08:33:53 devstack cinder-volume[88899]: DEBUG cinder.volume.flows.manager.create_volume [None req-52aa8b81-25f1-4a8d-ae16-857fe86fcccb tempest-ServerActionsTestOtherA-826446422 None] Copying metadata from image 37045a76-b9b1-4156-b15f-85c62a8616c3 to a62a55cb-cd3f-4d05-9d19-0aa3f9654f56. {{(pid=88899) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Aug 03 08:33:53 devstack cinder-volume[88899]: DEBUG cinder.volume.flows.manager.create_volume [None req-52aa8b81-25f1-4a8d-ae16-857fe86fcccb tempest-ServerActionsTestOtherA-826446422 None] Creating volume glance metadata for volume a62a55cb-cd3f-4d05-9d19-0aa3f9654f56 backed by image 37045a76-b9b1-4156-b15f-85c62a8616c3 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '37045a76-b9b1-4156-b15f-85c62a8616c3', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=88899) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Aug 03 08:33:54 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-52aa8b81-25f1-4a8d-ae16-857fe86fcccb tempest-ServerActionsTestOtherA-826446422 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7a89f87-6f27-4412-a41f-ea20ba172d5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a62a55cb-cd3f-4d05-9d19-0aa3f9654f56', 'volume_size': 1, 'image_id': '37045a76-b9b1-4156-b15f-85c62a8616c3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/37045a76-b9b1-4156-b15f-85c62a8616c3', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'adee82974e9f41769efcb3f4a0eef199', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '37045a76-b9b1-4156-b15f-85c62a8616c3', 'created_at': datetime.datetime(2026, 8, 3, 6, 23, 4, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 3, 6, 23, 6, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/37045a76-b9b1-4156-b15f-85c62a8616c3/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:33:54 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-52aa8b81-25f1-4a8d-ae16-857fe86fcccb tempest-ServerActionsTestOtherA-826446422 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09b7786e-4aee-4f3c-9c1b-ba9403b27b9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:33:54 devstack cinder-volume[88899]: INFO cinder.volume.flows.manager.create_volume [None req-52aa8b81-25f1-4a8d-ae16-857fe86fcccb tempest-ServerActionsTestOtherA-826446422 None] Volume volume-a62a55cb-cd3f-4d05-9d19-0aa3f9654f56 (a62a55cb-cd3f-4d05-9d19-0aa3f9654f56): created successfully Aug 03 08:33:54 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-52aa8b81-25f1-4a8d-ae16-857fe86fcccb tempest-ServerActionsTestOtherA-826446422 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09b7786e-4aee-4f3c-9c1b-ba9403b27b9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:33:54 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-52aa8b81-25f1-4a8d-ae16-857fe86fcccb tempest-ServerActionsTestOtherA-826446422 None] Flow 'volume_create_manager' (48bc1ccd-ff90-48e2-90a6-97f421277012) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:33:54 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-52aa8b81-25f1-4a8d-ae16-857fe86fcccb tempest-ServerActionsTestOtherA-826446422 None] Created volume successfully. Aug 03 08:33:54 devstack sudo[96580]: pam_unix(sudo:session): session closed for user root Aug 03 08:33:54 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-b451b5ea-44b7-4181-9c6f-7a09374b8c92 tempest-GroupSnapshotsTest-1944413600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d9319880-9aa9-4c4e-9fe1-ce86f035edf0 -F qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-d9319880-9aa9-4c4e-9fe1-ce86f035edf0.a9f917c0-df45-4ff9-95c5-2c1649da6911" returned: 0 in 0.487s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:33:54 devstack cinder-volume[88899]: WARNING cinder.volume.drivers.remotefs [None req-b451b5ea-44b7-4181-9c6f-7a09374b8c92 tempest-GroupSnapshotsTest-1944413600 None] /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-d9319880-9aa9-4c4e-9fe1-ce86f035edf0.a9f917c0-df45-4ff9-95c5-2c1649da6911 is being set with open permissions: ugo+rw: NotImplementedError Aug 03 08:33:54 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-b451b5ea-44b7-4181-9c6f-7a09374b8c92 tempest-GroupSnapshotsTest-1944413600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-d9319880-9aa9-4c4e-9fe1-ce86f035edf0.a9f917c0-df45-4ff9-95c5-2c1649da6911 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:33:54 devstack sudo[96591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-d9319880-9aa9-4c4e-9fe1-ce86f035edf0.a9f917c0-df45-4ff9-95c5-2c1649da6911 Aug 03 08:33:54 devstack sudo[96591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:33:54 devstack sudo[96591]: pam_unix(sudo:session): session closed for user root Aug 03 08:33:54 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-b451b5ea-44b7-4181-9c6f-7a09374b8c92 tempest-GroupSnapshotsTest-1944413600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-d9319880-9aa9-4c4e-9fe1-ce86f035edf0.a9f917c0-df45-4ff9-95c5-2c1649da6911" returned: 0 in 0.275s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:33:54 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-b451b5ea-44b7-4181-9c6f-7a09374b8c92 tempest-GroupSnapshotsTest-1944413600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-d9319880-9aa9-4c4e-9fe1-ce86f035edf0.info {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:33:54 devstack sudo[96594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-d9319880-9aa9-4c4e-9fe1-ce86f035edf0.info Aug 03 08:33:54 devstack sudo[96594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:33:54 devstack sudo[96594]: pam_unix(sudo:session): session closed for user root Aug 03 08:33:54 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-b451b5ea-44b7-4181-9c6f-7a09374b8c92 tempest-GroupSnapshotsTest-1944413600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-d9319880-9aa9-4c4e-9fe1-ce86f035edf0.info" returned: 0 in 0.400s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:33:54 devstack cinder-volume[88899]: WARNING cinder.volume.drivers.remotefs [None req-b451b5ea-44b7-4181-9c6f-7a09374b8c92 tempest-GroupSnapshotsTest-1944413600 None] /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-d9319880-9aa9-4c4e-9fe1-ce86f035edf0.info is being set with open permissions: ugo+rw: NotImplementedError Aug 03 08:33:54 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-b451b5ea-44b7-4181-9c6f-7a09374b8c92 tempest-GroupSnapshotsTest-1944413600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-d9319880-9aa9-4c4e-9fe1-ce86f035edf0.info {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:33:54 devstack sudo[96597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-d9319880-9aa9-4c4e-9fe1-ce86f035edf0.info Aug 03 08:33:54 devstack sudo[96597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:33:55 devstack sudo[96597]: pam_unix(sudo:session): session closed for user root Aug 03 08:33:55 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-b451b5ea-44b7-4181-9c6f-7a09374b8c92 tempest-GroupSnapshotsTest-1944413600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-d9319880-9aa9-4c4e-9fe1-ce86f035edf0.info" returned: 0 in 0.302s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:33:55 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-b451b5ea-44b7-4181-9c6f-7a09374b8c92 tempest-GroupSnapshotsTest-1944413600 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.671s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:33:55 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-b451b5ea-44b7-4181-9c6f-7a09374b8c92 tempest-GroupSnapshotsTest-1944413600 None] group_snapshot 337b2c69-4a5b-46d2-bc3d-00d97abdabd4: created successfully Aug 03 08:33:56 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-53131291-d7d7-4b06-9956-04cd023a9b11 tempest-GroupSnapshotsTest-1944413600 None] group_snapshot 337b2c69-4a5b-46d2-bc3d-00d97abdabd4: deleting Aug 03 08:33:56 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-53131291-d7d7-4b06-9956-04cd023a9b11 tempest-GroupSnapshotsTest-1944413600 None] group_snapshot 337b2c69-4a5b-46d2-bc3d-00d97abdabd4: deleting {{(pid=88899) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Aug 03 08:33:56 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-53131291-d7d7-4b06-9956-04cd023a9b11 tempest-GroupSnapshotsTest-1944413600 None] Acquiring lock "cinder-quobyte-408a47fd-ac2d-4d65-9de5-595cb59982a4" by "delete_snapshot" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:33:56 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-53131291-d7d7-4b06-9956-04cd023a9b11 tempest-GroupSnapshotsTest-1944413600 None] Lock "cinder-quobyte-408a47fd-ac2d-4d65-9de5-595cb59982a4" acquired by "delete_snapshot" :: waited 0.035s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:33:56 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-53131291-d7d7-4b06-9956-04cd023a9b11 tempest-GroupSnapshotsTest-1944413600 None] Acquiring lock "cinder-quobyte-0a263736-01c0-4b75-9d23-da79f1ebe1b2" by "_delete_snapshot" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:33:56 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-53131291-d7d7-4b06-9956-04cd023a9b11 tempest-GroupSnapshotsTest-1944413600 None] Lock "cinder-quobyte-0a263736-01c0-4b75-9d23-da79f1ebe1b2" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:33:56 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-53131291-d7d7-4b06-9956-04cd023a9b11 tempest-GroupSnapshotsTest-1944413600 None] Deleting offline snapshot 0a263736-01c0-4b75-9d23-da79f1ebe1b2 of volume 408a47fd-ac2d-4d65-9de5-595cb59982a4 {{(pid=88899) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 03 08:33:56 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-53131291-d7d7-4b06-9956-04cd023a9b11 tempest-GroupSnapshotsTest-1944413600 None] snapshot_file for this snap is: volume-408a47fd-ac2d-4d65-9de5-595cb59982a4.0a263736-01c0-4b75-9d23-da79f1ebe1b2 {{(pid=88899) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 03 08:33:56 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[8787f53e-dc89-441f-9217-9806fed1d3b9]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:33:56 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-53131291-d7d7-4b06-9956-04cd023a9b11 tempest-GroupSnapshotsTest-1944413600 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-408a47fd-ac2d-4d65-9de5-595cb59982a4.0a263736-01c0-4b75-9d23-da79f1ebe1b2 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:33:56 devstack sudo[96600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-408a47fd-ac2d-4d65-9de5-595cb59982a4.0a263736-01c0-4b75-9d23-da79f1ebe1b2 Aug 03 08:33:56 devstack sudo[96600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:33:56 devstack sudo[96600]: pam_unix(sudo:session): session closed for user root Aug 03 08:33:56 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-53131291-d7d7-4b06-9956-04cd023a9b11 tempest-GroupSnapshotsTest-1944413600 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-408a47fd-ac2d-4d65-9de5-595cb59982a4.0a263736-01c0-4b75-9d23-da79f1ebe1b2" returned: 0 in 0.586s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:33:56 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-53131291-d7d7-4b06-9956-04cd023a9b11 tempest-GroupSnapshotsTest-1944413600 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-408a47fd-ac2d-4d65-9de5-595cb59982a4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88899) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 03 08:33:56 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[0180f5c5-7048-45b4-9557-79b26e29c106]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:33:56 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-53131291-d7d7-4b06-9956-04cd023a9b11 tempest-GroupSnapshotsTest-1944413600 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-408a47fd-ac2d-4d65-9de5-595cb59982a4 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:33:57 devstack sudo[96608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-408a47fd-ac2d-4d65-9de5-595cb59982a4 Aug 03 08:33:57 devstack sudo[96608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:33:57 devstack sudo[96608]: pam_unix(sudo:session): session closed for user root Aug 03 08:33:57 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-53131291-d7d7-4b06-9956-04cd023a9b11 tempest-GroupSnapshotsTest-1944413600 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-408a47fd-ac2d-4d65-9de5-595cb59982a4" returned: 0 in 0.547s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:33:57 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-53131291-d7d7-4b06-9956-04cd023a9b11 tempest-GroupSnapshotsTest-1944413600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-408a47fd-ac2d-4d65-9de5-595cb59982a4.0a263736-01c0-4b75-9d23-da79f1ebe1b2 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:33:57 devstack sudo[96617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-408a47fd-ac2d-4d65-9de5-595cb59982a4.0a263736-01c0-4b75-9d23-da79f1ebe1b2 Aug 03 08:33:57 devstack sudo[96617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:33:57 devstack sudo[96617]: pam_unix(sudo:session): session closed for user root Aug 03 08:33:57 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-53131291-d7d7-4b06-9956-04cd023a9b11 tempest-GroupSnapshotsTest-1944413600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-408a47fd-ac2d-4d65-9de5-595cb59982a4.0a263736-01c0-4b75-9d23-da79f1ebe1b2" returned: 0 in 0.530s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:33:58 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-53131291-d7d7-4b06-9956-04cd023a9b11 tempest-GroupSnapshotsTest-1944413600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-408a47fd-ac2d-4d65-9de5-595cb59982a4.0a263736-01c0-4b75-9d23-da79f1ebe1b2 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:33:58 devstack sudo[96623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-408a47fd-ac2d-4d65-9de5-595cb59982a4.0a263736-01c0-4b75-9d23-da79f1ebe1b2 Aug 03 08:33:58 devstack sudo[96623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:33:58 devstack sudo[96623]: pam_unix(sudo:session): session closed for user root Aug 03 08:33:58 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-53131291-d7d7-4b06-9956-04cd023a9b11 tempest-GroupSnapshotsTest-1944413600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-408a47fd-ac2d-4d65-9de5-595cb59982a4.0a263736-01c0-4b75-9d23-da79f1ebe1b2" returned: 0 in 0.375s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:33:58 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-53131291-d7d7-4b06-9956-04cd023a9b11 tempest-GroupSnapshotsTest-1944413600 None] Lock "cinder-quobyte-0a263736-01c0-4b75-9d23-da79f1ebe1b2" released by "_delete_snapshot" :: held 2.189s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:33:58 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-53131291-d7d7-4b06-9956-04cd023a9b11 tempest-GroupSnapshotsTest-1944413600 None] Lock "cinder-quobyte-408a47fd-ac2d-4d65-9de5-595cb59982a4" released by "delete_snapshot" :: held 2.223s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:33:58 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-53131291-d7d7-4b06-9956-04cd023a9b11 tempest-GroupSnapshotsTest-1944413600 None] Acquiring lock "cinder-quobyte-d9319880-9aa9-4c4e-9fe1-ce86f035edf0" by "delete_snapshot" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:33:58 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-53131291-d7d7-4b06-9956-04cd023a9b11 tempest-GroupSnapshotsTest-1944413600 None] Lock "cinder-quobyte-d9319880-9aa9-4c4e-9fe1-ce86f035edf0" acquired by "delete_snapshot" :: waited 0.021s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:33:58 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-53131291-d7d7-4b06-9956-04cd023a9b11 tempest-GroupSnapshotsTest-1944413600 None] Acquiring lock "cinder-quobyte-a9f917c0-df45-4ff9-95c5-2c1649da6911" by "_delete_snapshot" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:33:58 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-53131291-d7d7-4b06-9956-04cd023a9b11 tempest-GroupSnapshotsTest-1944413600 None] Lock "cinder-quobyte-a9f917c0-df45-4ff9-95c5-2c1649da6911" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:33:58 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-53131291-d7d7-4b06-9956-04cd023a9b11 tempest-GroupSnapshotsTest-1944413600 None] Deleting offline snapshot a9f917c0-df45-4ff9-95c5-2c1649da6911 of volume d9319880-9aa9-4c4e-9fe1-ce86f035edf0 {{(pid=88899) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 03 08:33:58 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-53131291-d7d7-4b06-9956-04cd023a9b11 tempest-GroupSnapshotsTest-1944413600 None] snapshot_file for this snap is: volume-d9319880-9aa9-4c4e-9fe1-ce86f035edf0.a9f917c0-df45-4ff9-95c5-2c1649da6911 {{(pid=88899) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 03 08:33:58 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac3ca858-8565-44e9-8c65-b25a8411772e]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:33:58 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-53131291-d7d7-4b06-9956-04cd023a9b11 tempest-GroupSnapshotsTest-1944413600 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-d9319880-9aa9-4c4e-9fe1-ce86f035edf0.a9f917c0-df45-4ff9-95c5-2c1649da6911 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:33:58 devstack sudo[96627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-d9319880-9aa9-4c4e-9fe1-ce86f035edf0.a9f917c0-df45-4ff9-95c5-2c1649da6911 Aug 03 08:33:58 devstack sudo[96627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:33:59 devstack sudo[96627]: pam_unix(sudo:session): session closed for user root Aug 03 08:33:59 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-53131291-d7d7-4b06-9956-04cd023a9b11 tempest-GroupSnapshotsTest-1944413600 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-d9319880-9aa9-4c4e-9fe1-ce86f035edf0.a9f917c0-df45-4ff9-95c5-2c1649da6911" returned: 0 in 0.504s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:33:59 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-53131291-d7d7-4b06-9956-04cd023a9b11 tempest-GroupSnapshotsTest-1944413600 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d9319880-9aa9-4c4e-9fe1-ce86f035edf0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88899) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 03 08:33:59 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[303dce7d-7bdc-4aea-b617-d09d4a83d66b]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:33:59 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-53131291-d7d7-4b06-9956-04cd023a9b11 tempest-GroupSnapshotsTest-1944413600 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-d9319880-9aa9-4c4e-9fe1-ce86f035edf0 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:33:59 devstack sudo[96632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-d9319880-9aa9-4c4e-9fe1-ce86f035edf0 Aug 03 08:33:59 devstack sudo[96632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:33:59 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [req-e6cbaf42-c332-41e5-96d3-78a3bc1526f1 req-331ec830-c058-41bc-8db0-fec6caec3cfb tempest-ServerActionsTestOtherA-826446422 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:33:59 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [req-e6cbaf42-c332-41e5-96d3-78a3bc1526f1 req-331ec830-c058-41bc-8db0-fec6caec3cfb tempest-ServerActionsTestOtherA-826446422 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:33:59 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [req-e6cbaf42-c332-41e5-96d3-78a3bc1526f1 req-331ec830-c058-41bc-8db0-fec6caec3cfb tempest-ServerActionsTestOtherA-826446422 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.019s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:33:59 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [req-e6cbaf42-c332-41e5-96d3-78a3bc1526f1 req-331ec830-c058-41bc-8db0-fec6caec3cfb tempest-ServerActionsTestOtherA-826446422 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385', 'name': 'volume-a62a55cb-cd3f-4d05-9d19-0aa3f9654f56', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '9df575e3-f819-4b63-be8f-cf2018cb95a0', 'enforce_multipath': True} {{(pid=88899) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 03 08:33:59 devstack cinder-volume[88899]: INFO cinder.volume.manager [req-e6cbaf42-c332-41e5-96d3-78a3bc1526f1 req-331ec830-c058-41bc-8db0-fec6caec3cfb tempest-ServerActionsTestOtherA-826446422 None] attachment_update completed successfully. Aug 03 08:33:59 devstack sudo[96632]: pam_unix(sudo:session): session closed for user root Aug 03 08:33:59 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-53131291-d7d7-4b06-9956-04cd023a9b11 tempest-GroupSnapshotsTest-1944413600 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-d9319880-9aa9-4c4e-9fe1-ce86f035edf0" returned: 0 in 0.875s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:33:59 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-53131291-d7d7-4b06-9956-04cd023a9b11 tempest-GroupSnapshotsTest-1944413600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-d9319880-9aa9-4c4e-9fe1-ce86f035edf0.a9f917c0-df45-4ff9-95c5-2c1649da6911 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:34:00 devstack sudo[96646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-d9319880-9aa9-4c4e-9fe1-ce86f035edf0.a9f917c0-df45-4ff9-95c5-2c1649da6911 Aug 03 08:34:00 devstack sudo[96646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:34:00 devstack sudo[96646]: pam_unix(sudo:session): session closed for user root Aug 03 08:34:00 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-53131291-d7d7-4b06-9956-04cd023a9b11 tempest-GroupSnapshotsTest-1944413600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-d9319880-9aa9-4c4e-9fe1-ce86f035edf0.a9f917c0-df45-4ff9-95c5-2c1649da6911" returned: 0 in 0.569s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:34:00 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-53131291-d7d7-4b06-9956-04cd023a9b11 tempest-GroupSnapshotsTest-1944413600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-d9319880-9aa9-4c4e-9fe1-ce86f035edf0.a9f917c0-df45-4ff9-95c5-2c1649da6911 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:34:00 devstack sudo[96661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-d9319880-9aa9-4c4e-9fe1-ce86f035edf0.a9f917c0-df45-4ff9-95c5-2c1649da6911 Aug 03 08:34:00 devstack sudo[96661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:34:00 devstack sudo[96661]: pam_unix(sudo:session): session closed for user root Aug 03 08:34:00 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-53131291-d7d7-4b06-9956-04cd023a9b11 tempest-GroupSnapshotsTest-1944413600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-d9319880-9aa9-4c4e-9fe1-ce86f035edf0.a9f917c0-df45-4ff9-95c5-2c1649da6911" returned: 0 in 0.314s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:34:00 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-53131291-d7d7-4b06-9956-04cd023a9b11 tempest-GroupSnapshotsTest-1944413600 None] Lock "cinder-quobyte-a9f917c0-df45-4ff9-95c5-2c1649da6911" released by "_delete_snapshot" :: held 2.411s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:34:00 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-53131291-d7d7-4b06-9956-04cd023a9b11 tempest-GroupSnapshotsTest-1944413600 None] Lock "cinder-quobyte-d9319880-9aa9-4c4e-9fe1-ce86f035edf0" released by "delete_snapshot" :: held 2.445s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:34:01 devstack cinder-volume[88899]: WARNING cinder.quota [None req-53131291-d7d7-4b06-9956-04cd023a9b11 tempest-GroupSnapshotsTest-1944413600 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1397177391 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1397177391, it is now deprecated. Please use the default quota class for default quota. Aug 03 08:34:01 devstack cinder-volume[88899]: WARNING cinder.quota [None req-53131291-d7d7-4b06-9956-04cd023a9b11 tempest-GroupSnapshotsTest-1944413600 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1397177391 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1397177391, it is now deprecated. Please use the default quota class for default quota. Aug 03 08:34:01 devstack cinder-volume[88899]: DEBUG cinder.quota [None req-53131291-d7d7-4b06-9956-04cd023a9b11 tempest-GroupSnapshotsTest-1944413600 None] Created reservations ['ffe0283e-763a-4421-af43-5e983acce61e', '8fb001d9-a156-4aa4-b062-1e5e0011cef1', 'f509be0a-ef95-49ac-bac5-c5022b9e6425', '0d609744-5751-459c-9df0-d18f15a4db0c'] {{(pid=88899) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 08:34:01 devstack cinder-volume[88899]: DEBUG cinder.quota [None req-53131291-d7d7-4b06-9956-04cd023a9b11 tempest-GroupSnapshotsTest-1944413600 None] Created reservations ['0a933883-856e-465e-8c19-73cd959e8d6e', '6737b9e3-5e58-4c87-89d0-daf86c18d8e4', 'a3ac19da-6bca-4188-92b7-510e660ec280', 'c86eaea4-86a6-4223-99ec-31a6d9b20586'] {{(pid=88899) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 08:34:01 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-53131291-d7d7-4b06-9956-04cd023a9b11 tempest-GroupSnapshotsTest-1944413600 None] group_snapshot 337b2c69-4a5b-46d2-bc3d-00d97abdabd4: deleted successfully Aug 03 08:34:02 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-ffa245b7-8bf1-406b-ada5-159a70841a2c tempest-GroupSnapshotsTest-1944413600 None] Acquiring lock "cinder-quobyte-408a47fd-ac2d-4d65-9de5-595cb59982a4" by "delete_volume" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:34:02 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-ffa245b7-8bf1-406b-ada5-159a70841a2c tempest-GroupSnapshotsTest-1944413600 None] Lock "cinder-quobyte-408a47fd-ac2d-4d65-9de5-595cb59982a4" acquired by "delete_volume" :: waited 0.021s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:34:02 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[eebbfd6c-9ae3-44d6-9d90-825f894705e2]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:34:02 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-ffa245b7-8bf1-406b-ada5-159a70841a2c tempest-GroupSnapshotsTest-1944413600 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-408a47fd-ac2d-4d65-9de5-595cb59982a4 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:34:02 devstack sudo[96669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-408a47fd-ac2d-4d65-9de5-595cb59982a4 Aug 03 08:34:02 devstack sudo[96669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:34:02 devstack sudo[96669]: pam_unix(sudo:session): session closed for user root Aug 03 08:34:02 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-ffa245b7-8bf1-406b-ada5-159a70841a2c tempest-GroupSnapshotsTest-1944413600 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-408a47fd-ac2d-4d65-9de5-595cb59982a4" returned: 0 in 0.479s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:34:02 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-ffa245b7-8bf1-406b-ada5-159a70841a2c tempest-GroupSnapshotsTest-1944413600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-408a47fd-ac2d-4d65-9de5-595cb59982a4 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:34:02 devstack sudo[96674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-408a47fd-ac2d-4d65-9de5-595cb59982a4 Aug 03 08:34:02 devstack sudo[96674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:34:03 devstack sudo[96674]: pam_unix(sudo:session): session closed for user root Aug 03 08:34:03 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-ffa245b7-8bf1-406b-ada5-159a70841a2c tempest-GroupSnapshotsTest-1944413600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-408a47fd-ac2d-4d65-9de5-595cb59982a4" returned: 0 in 0.288s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:34:03 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-ffa245b7-8bf1-406b-ada5-159a70841a2c tempest-GroupSnapshotsTest-1944413600 None] Lock "cinder-quobyte-408a47fd-ac2d-4d65-9de5-595cb59982a4" released by "delete_volume" :: held 0.853s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:34:03 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-ffa245b7-8bf1-406b-ada5-159a70841a2c tempest-GroupSnapshotsTest-1944413600 None] Acquiring lock "cinder-quobyte-d9319880-9aa9-4c4e-9fe1-ce86f035edf0" by "delete_volume" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:34:03 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-ffa245b7-8bf1-406b-ada5-159a70841a2c tempest-GroupSnapshotsTest-1944413600 None] Lock "cinder-quobyte-d9319880-9aa9-4c4e-9fe1-ce86f035edf0" acquired by "delete_volume" :: waited 0.028s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:34:03 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb88f41f-4aca-4372-802f-ac41751dab67]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:34:03 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-ffa245b7-8bf1-406b-ada5-159a70841a2c tempest-GroupSnapshotsTest-1944413600 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-d9319880-9aa9-4c4e-9fe1-ce86f035edf0 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:34:03 devstack sudo[96677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-d9319880-9aa9-4c4e-9fe1-ce86f035edf0 Aug 03 08:34:03 devstack sudo[96677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:34:03 devstack sudo[96677]: pam_unix(sudo:session): session closed for user root Aug 03 08:34:03 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-ffa245b7-8bf1-406b-ada5-159a70841a2c tempest-GroupSnapshotsTest-1944413600 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-d9319880-9aa9-4c4e-9fe1-ce86f035edf0" returned: 0 in 0.604s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:34:03 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-ffa245b7-8bf1-406b-ada5-159a70841a2c tempest-GroupSnapshotsTest-1944413600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-d9319880-9aa9-4c4e-9fe1-ce86f035edf0 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:34:03 devstack sudo[96683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-d9319880-9aa9-4c4e-9fe1-ce86f035edf0 Aug 03 08:34:03 devstack sudo[96683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:34:04 devstack sudo[96683]: pam_unix(sudo:session): session closed for user root Aug 03 08:34:04 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-ffa245b7-8bf1-406b-ada5-159a70841a2c tempest-GroupSnapshotsTest-1944413600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-d9319880-9aa9-4c4e-9fe1-ce86f035edf0" returned: 0 in 0.301s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:34:04 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-ffa245b7-8bf1-406b-ada5-159a70841a2c tempest-GroupSnapshotsTest-1944413600 None] Lock "cinder-quobyte-d9319880-9aa9-4c4e-9fe1-ce86f035edf0" released by "delete_volume" :: held 0.985s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:34:04 devstack cinder-volume[88899]: DEBUG cinder.quota [None req-ffa245b7-8bf1-406b-ada5-159a70841a2c tempest-GroupSnapshotsTest-1944413600 None] Created reservations ['0b6c05ae-694d-423b-9cae-41653f270256'] {{(pid=88899) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 08:34:04 devstack cinder-volume[88899]: WARNING cinder.quota [None req-ffa245b7-8bf1-406b-ada5-159a70841a2c tempest-GroupSnapshotsTest-1944413600 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1397177391 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1397177391, it is now deprecated. Please use the default quota class for default quota. Aug 03 08:34:04 devstack cinder-volume[88899]: DEBUG cinder.quota [None req-ffa245b7-8bf1-406b-ada5-159a70841a2c tempest-GroupSnapshotsTest-1944413600 None] Created reservations ['40e6376e-1314-4360-8e0c-f6f33d2e9853', '32025ef5-41fa-4ef4-aebb-034c6648c35a', '0930d9d7-df20-4acd-a850-0c93e5ec24e7', '9a6bd65f-99e4-4551-9b53-934d5a83ab0d'] {{(pid=88899) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 08:34:04 devstack cinder-volume[88899]: DEBUG cinder.quota [None req-ffa245b7-8bf1-406b-ada5-159a70841a2c tempest-GroupSnapshotsTest-1944413600 None] Created reservations ['ac61707c-4489-4687-af9d-1704988a1ed9', '2a7f3312-9aa5-4c4e-a066-ff20d09f4c70', '77c0186b-ad88-49ab-8d7e-2381a735953a', '606a1dba-2936-4843-a557-c1cfc5462a59'] {{(pid=88899) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 08:34:04 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-ffa245b7-8bf1-406b-ada5-159a70841a2c tempest-GroupSnapshotsTest-1944413600 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:34:04 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-ffa245b7-8bf1-406b-ada5-159a70841a2c tempest-GroupSnapshotsTest-1944413600 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:34:04 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-ffa245b7-8bf1-406b-ada5-159a70841a2c tempest-GroupSnapshotsTest-1944413600 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:34:04 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-ffa245b7-8bf1-406b-ada5-159a70841a2c tempest-GroupSnapshotsTest-1944413600 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:34:04 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-ffa245b7-8bf1-406b-ada5-159a70841a2c tempest-GroupSnapshotsTest-1944413600 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:34:04 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-ffa245b7-8bf1-406b-ada5-159a70841a2c tempest-GroupSnapshotsTest-1944413600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:34:04 devstack sudo[96687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a Aug 03 08:34:04 devstack sudo[96687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:34:05 devstack sudo[96687]: pam_unix(sudo:session): session closed for user root Aug 03 08:34:05 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-ffa245b7-8bf1-406b-ada5-159a70841a2c tempest-GroupSnapshotsTest-1944413600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a" returned: 0 in 0.451s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:34:05 devstack cinder-volume[88899]: DEBUG cinder.manager [None req-ffa245b7-8bf1-406b-ada5-159a70841a2c tempest-GroupSnapshotsTest-1944413600 None] Notifying Schedulers of capabilities ... {{(pid=88899) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 08:34:05 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-ffa245b7-8bf1-406b-ada5-159a70841a2c tempest-GroupSnapshotsTest-1944413600 None] Delete group completed successfully. Aug 03 08:34:05 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-db40c59e-8be0-4d3f-b0d0-c9b16c68a8f2 tempest-GroupSnapshotsTest-1944413600 None] Group tempest-GroupSnapshotsTest-Group-611519496: creating Aug 03 08:34:05 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-db40c59e-8be0-4d3f-b0d0-c9b16c68a8f2 tempest-GroupSnapshotsTest-1944413600 None] Group tempest-GroupSnapshotsTest-Group-611519496: created successfully Aug 03 08:34:05 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-db40c59e-8be0-4d3f-b0d0-c9b16c68a8f2 tempest-GroupSnapshotsTest-1944413600 None] Create group completed successfully. Aug 03 08:34:08 devstack cinder-volume[88899]: DEBUG cinder.volume.flows.manager.create_volume [None req-df9da058-9db9-40a6-868f-80c540c3ee82 tempest-GroupSnapshotsTest-1944413600 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88899) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 08:34:08 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-df9da058-9db9-40a6-868f-80c540c3ee82 tempest-GroupSnapshotsTest-1944413600 None] Flow 'volume_create_manager' (0b291656-98b1-49e8-ac68-140bea75841c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:34:08 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-df9da058-9db9-40a6-868f-80c540c3ee82 tempest-GroupSnapshotsTest-1944413600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a6ecc1f-821f-4b5e-8ccc-38703f00f90c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:34:08 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-df9da058-9db9-40a6-868f-80c540c3ee82 tempest-GroupSnapshotsTest-1944413600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a6ecc1f-821f-4b5e-8ccc-38703f00f90c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:34:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1548649895',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=7cc92811-cd9e-41b6-a8a0-eb695f70240f,host='devstack@QuobyteHD#QuobyteHD',id=612c8cd8-fe3d-4f90-a960-6cb0fe39ed60,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2fdcb70d80ef43099f0479c4f5be4112',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:34:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:34:08Z,use_quota=True,user_id='d0f229235ffe4b97a62b4ad4a518020a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ea89aa-716a-48dc-9d7c-5613dedfd785),volume_type_id=b4ea89aa-716a-48dc-9d7c-5613dedfd785)' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:34:08 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-df9da058-9db9-40a6-868f-80c540c3ee82 tempest-GroupSnapshotsTest-1944413600 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0c1653c-9c3b-4974-bde7-19f3707bbb97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:34:08 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-df9da058-9db9-40a6-868f-80c540c3ee82 tempest-GroupSnapshotsTest-1944413600 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0c1653c-9c3b-4974-bde7-19f3707bbb97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:34:08 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-df9da058-9db9-40a6-868f-80c540c3ee82 tempest-GroupSnapshotsTest-1944413600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ddbe30c6-80ba-4e11-b158-067a6e014c24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:34:08 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-df9da058-9db9-40a6-868f-80c540c3ee82 tempest-GroupSnapshotsTest-1944413600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ddbe30c6-80ba-4e11-b158-067a6e014c24) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '612c8cd8-fe3d-4f90-a960-6cb0fe39ed60', 'volume_name': 'volume-612c8cd8-fe3d-4f90-a960-6cb0fe39ed60', 'volume_size': 1}' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:34:08 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-df9da058-9db9-40a6-868f-80c540c3ee82 tempest-GroupSnapshotsTest-1944413600 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4acc9474-133d-4639-9588-740ae5b1babc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:34:08 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-df9da058-9db9-40a6-868f-80c540c3ee82 tempest-GroupSnapshotsTest-1944413600 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4acc9474-133d-4639-9588-740ae5b1babc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:34:08 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-df9da058-9db9-40a6-868f-80c540c3ee82 tempest-GroupSnapshotsTest-1944413600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42805bef-d366-48cf-8498-d2984e837429) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:34:08 devstack cinder-volume[88899]: INFO cinder.volume.flows.manager.create_volume [None req-df9da058-9db9-40a6-868f-80c540c3ee82 tempest-GroupSnapshotsTest-1944413600 None] Volume 612c8cd8-fe3d-4f90-a960-6cb0fe39ed60: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-612c8cd8-fe3d-4f90-a960-6cb0fe39ed60', 'volume_size': 1} Aug 03 08:34:08 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-df9da058-9db9-40a6-868f-80c540c3ee82 tempest-GroupSnapshotsTest-1944413600 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:34:08 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-df9da058-9db9-40a6-868f-80c540c3ee82 tempest-GroupSnapshotsTest-1944413600 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:34:08 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-df9da058-9db9-40a6-868f-80c540c3ee82 tempest-GroupSnapshotsTest-1944413600 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=7cc92811-cd9e-41b6-a8a0-eb695f70240f,created_at=2026-08-03T06:34:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1548649895',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=7cc92811-cd9e-41b6-a8a0-eb695f70240f,host='devstack@QuobyteHD#QuobyteHD',id=612c8cd8-fe3d-4f90-a960-6cb0fe39ed60,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2fdcb70d80ef43099f0479c4f5be4112',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:34:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:34:08Z,use_quota=True,user_id='d0f229235ffe4b97a62b4ad4a518020a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ea89aa-716a-48dc-9d7c-5613dedfd785),volume_type_id=b4ea89aa-716a-48dc-9d7c-5613dedfd785)}" {{(pid=88899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 08:34:08 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-df9da058-9db9-40a6-868f-80c540c3ee82 tempest-GroupSnapshotsTest-1944413600 None] Creating volume 612c8cd8-fe3d-4f90-a960-6cb0fe39ed60 {{(pid=88899) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 08:34:08 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-df9da058-9db9-40a6-868f-80c540c3ee82 tempest-GroupSnapshotsTest-1944413600 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:34:08 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-df9da058-9db9-40a6-868f-80c540c3ee82 tempest-GroupSnapshotsTest-1944413600 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:34:08 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-df9da058-9db9-40a6-868f-80c540c3ee82 tempest-GroupSnapshotsTest-1944413600 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:34:08 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-df9da058-9db9-40a6-868f-80c540c3ee82 tempest-GroupSnapshotsTest-1944413600 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:34:08 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-df9da058-9db9-40a6-868f-80c540c3ee82 tempest-GroupSnapshotsTest-1944413600 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:34:08 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-df9da058-9db9-40a6-868f-80c540c3ee82 tempest-GroupSnapshotsTest-1944413600 None] Selected osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385 as target Quobyte volume. {{(pid=88899) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 08:34:08 devstack cinder-volume[88899]: INFO cinder.volume.drivers.remotefs [None req-df9da058-9db9-40a6-868f-80c540c3ee82 tempest-GroupSnapshotsTest-1944413600 None] casted to osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385 Aug 03 08:34:08 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-df9da058-9db9-40a6-868f-80c540c3ee82 tempest-GroupSnapshotsTest-1944413600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-612c8cd8-fe3d-4f90-a960-6cb0fe39ed60 1073741824 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:34:08 devstack sudo[97129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-612c8cd8-fe3d-4f90-a960-6cb0fe39ed60 1073741824 Aug 03 08:34:08 devstack sudo[97129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:34:09 devstack sudo[97129]: pam_unix(sudo:session): session closed for user root Aug 03 08:34:09 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-df9da058-9db9-40a6-868f-80c540c3ee82 tempest-GroupSnapshotsTest-1944413600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-612c8cd8-fe3d-4f90-a960-6cb0fe39ed60 1073741824" returned: 0 in 0.847s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:34:09 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-df9da058-9db9-40a6-868f-80c540c3ee82 tempest-GroupSnapshotsTest-1944413600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-612c8cd8-fe3d-4f90-a960-6cb0fe39ed60 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:34:09 devstack sudo[97163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-612c8cd8-fe3d-4f90-a960-6cb0fe39ed60 Aug 03 08:34:09 devstack sudo[97163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:34:09 devstack sudo[97163]: pam_unix(sudo:session): session closed for user root Aug 03 08:34:09 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-df9da058-9db9-40a6-868f-80c540c3ee82 tempest-GroupSnapshotsTest-1944413600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-612c8cd8-fe3d-4f90-a960-6cb0fe39ed60" returned: 0 in 0.388s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:34:09 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-df9da058-9db9-40a6-868f-80c540c3ee82 tempest-GroupSnapshotsTest-1944413600 None] <== create_volume: return (1320ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'} {{(pid=88899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 08:34:09 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-df9da058-9db9-40a6-868f-80c540c3ee82 tempest-GroupSnapshotsTest-1944413600 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.328s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:34:09 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-df9da058-9db9-40a6-868f-80c540c3ee82 tempest-GroupSnapshotsTest-1944413600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42805bef-d366-48cf-8498-d2984e837429) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-612c8cd8-fe3d-4f90-a960-6cb0fe39ed60', 'volume_size': 1}' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:34:09 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-df9da058-9db9-40a6-868f-80c540c3ee82 tempest-GroupSnapshotsTest-1944413600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df7c5b18-eb86-4900-91d5-19b0d6a453ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:34:09 devstack cinder-volume[88899]: INFO cinder.volume.flows.manager.create_volume [None req-df9da058-9db9-40a6-868f-80c540c3ee82 tempest-GroupSnapshotsTest-1944413600 None] Volume volume-612c8cd8-fe3d-4f90-a960-6cb0fe39ed60 (612c8cd8-fe3d-4f90-a960-6cb0fe39ed60): created successfully Aug 03 08:34:09 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-df9da058-9db9-40a6-868f-80c540c3ee82 tempest-GroupSnapshotsTest-1944413600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df7c5b18-eb86-4900-91d5-19b0d6a453ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:34:09 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-df9da058-9db9-40a6-868f-80c540c3ee82 tempest-GroupSnapshotsTest-1944413600 None] Flow 'volume_create_manager' (0b291656-98b1-49e8-ac68-140bea75841c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:34:09 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-df9da058-9db9-40a6-868f-80c540c3ee82 tempest-GroupSnapshotsTest-1944413600 None] Created volume successfully. Aug 03 08:34:11 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-248fa69f-e043-46f5-b788-74aafeece983 tempest-GroupSnapshotsTest-1944413600 None] GroupSnapshot 92bf3197-9d10-494a-a01a-40b8e1b5c5f0: creating. Aug 03 08:34:11 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-248fa69f-e043-46f5-b788-74aafeece983 tempest-GroupSnapshotsTest-1944413600 None] Group snapshot 92bf3197-9d10-494a-a01a-40b8e1b5c5f0: creating. {{(pid=88899) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Aug 03 08:34:11 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-248fa69f-e043-46f5-b788-74aafeece983 tempest-GroupSnapshotsTest-1944413600 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:34:11 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-248fa69f-e043-46f5-b788-74aafeece983 tempest-GroupSnapshotsTest-1944413600 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:34:11 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-248fa69f-e043-46f5-b788-74aafeece983 tempest-GroupSnapshotsTest-1944413600 None] Creating offline snapshot 5699a27b-de0a-456f-b15f-eb9cdeb55f53 of volume 612c8cd8-fe3d-4f90-a960-6cb0fe39ed60 {{(pid=88899) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 03 08:34:11 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[06ca04b4-493b-454b-8fab-580545edab3d]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:34:11 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-248fa69f-e043-46f5-b788-74aafeece983 tempest-GroupSnapshotsTest-1944413600 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-612c8cd8-fe3d-4f90-a960-6cb0fe39ed60 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:34:11 devstack sudo[97222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-612c8cd8-fe3d-4f90-a960-6cb0fe39ed60 Aug 03 08:34:11 devstack sudo[97222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:34:11 devstack sudo[97222]: pam_unix(sudo:session): session closed for user root Aug 03 08:34:11 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-248fa69f-e043-46f5-b788-74aafeece983 tempest-GroupSnapshotsTest-1944413600 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-612c8cd8-fe3d-4f90-a960-6cb0fe39ed60" returned: 0 in 0.707s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:34:11 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-248fa69f-e043-46f5-b788-74aafeece983 tempest-GroupSnapshotsTest-1944413600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-612c8cd8-fe3d-4f90-a960-6cb0fe39ed60,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-612c8cd8-fe3d-4f90-a960-6cb0fe39ed60.5699a27b-de0a-456f-b15f-eb9cdeb55f53 1G {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:34:12 devstack sudo[97235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-612c8cd8-fe3d-4f90-a960-6cb0fe39ed60,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-612c8cd8-fe3d-4f90-a960-6cb0fe39ed60.5699a27b-de0a-456f-b15f-eb9cdeb55f53 1G Aug 03 08:34:12 devstack sudo[97235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:34:13 devstack sudo[97235]: pam_unix(sudo:session): session closed for user root Aug 03 08:34:13 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-248fa69f-e043-46f5-b788-74aafeece983 tempest-GroupSnapshotsTest-1944413600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-612c8cd8-fe3d-4f90-a960-6cb0fe39ed60,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-612c8cd8-fe3d-4f90-a960-6cb0fe39ed60.5699a27b-de0a-456f-b15f-eb9cdeb55f53 1G" returned: 0 in 1.272s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:34:13 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-248fa69f-e043-46f5-b788-74aafeece983 tempest-GroupSnapshotsTest-1944413600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-612c8cd8-fe3d-4f90-a960-6cb0fe39ed60 -F qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-612c8cd8-fe3d-4f90-a960-6cb0fe39ed60.5699a27b-de0a-456f-b15f-eb9cdeb55f53 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:34:13 devstack sudo[97240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-612c8cd8-fe3d-4f90-a960-6cb0fe39ed60 -F qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-612c8cd8-fe3d-4f90-a960-6cb0fe39ed60.5699a27b-de0a-456f-b15f-eb9cdeb55f53 Aug 03 08:34:13 devstack sudo[97240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:34:13 devstack sudo[97240]: pam_unix(sudo:session): session closed for user root Aug 03 08:34:13 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-248fa69f-e043-46f5-b788-74aafeece983 tempest-GroupSnapshotsTest-1944413600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-612c8cd8-fe3d-4f90-a960-6cb0fe39ed60 -F qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-612c8cd8-fe3d-4f90-a960-6cb0fe39ed60.5699a27b-de0a-456f-b15f-eb9cdeb55f53" returned: 0 in 0.648s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:34:13 devstack cinder-volume[88899]: WARNING cinder.volume.drivers.remotefs [None req-248fa69f-e043-46f5-b788-74aafeece983 tempest-GroupSnapshotsTest-1944413600 None] /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-612c8cd8-fe3d-4f90-a960-6cb0fe39ed60.5699a27b-de0a-456f-b15f-eb9cdeb55f53 is being set with open permissions: ugo+rw: NotImplementedError Aug 03 08:34:13 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-248fa69f-e043-46f5-b788-74aafeece983 tempest-GroupSnapshotsTest-1944413600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-612c8cd8-fe3d-4f90-a960-6cb0fe39ed60.5699a27b-de0a-456f-b15f-eb9cdeb55f53 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:34:13 devstack sudo[97245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-612c8cd8-fe3d-4f90-a960-6cb0fe39ed60.5699a27b-de0a-456f-b15f-eb9cdeb55f53 Aug 03 08:34:13 devstack sudo[97245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:34:14 devstack sudo[97245]: pam_unix(sudo:session): session closed for user root Aug 03 08:34:14 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-248fa69f-e043-46f5-b788-74aafeece983 tempest-GroupSnapshotsTest-1944413600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-612c8cd8-fe3d-4f90-a960-6cb0fe39ed60.5699a27b-de0a-456f-b15f-eb9cdeb55f53" returned: 0 in 0.538s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:34:14 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-248fa69f-e043-46f5-b788-74aafeece983 tempest-GroupSnapshotsTest-1944413600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-612c8cd8-fe3d-4f90-a960-6cb0fe39ed60.info {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:34:14 devstack sudo[97248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-612c8cd8-fe3d-4f90-a960-6cb0fe39ed60.info Aug 03 08:34:14 devstack sudo[97248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:34:15 devstack sudo[97248]: pam_unix(sudo:session): session closed for user root Aug 03 08:34:15 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-248fa69f-e043-46f5-b788-74aafeece983 tempest-GroupSnapshotsTest-1944413600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-612c8cd8-fe3d-4f90-a960-6cb0fe39ed60.info" returned: 0 in 0.678s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:34:15 devstack cinder-volume[88899]: WARNING cinder.volume.drivers.remotefs [None req-248fa69f-e043-46f5-b788-74aafeece983 tempest-GroupSnapshotsTest-1944413600 None] /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-612c8cd8-fe3d-4f90-a960-6cb0fe39ed60.info is being set with open permissions: ugo+rw: NotImplementedError Aug 03 08:34:15 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-248fa69f-e043-46f5-b788-74aafeece983 tempest-GroupSnapshotsTest-1944413600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-612c8cd8-fe3d-4f90-a960-6cb0fe39ed60.info {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:34:15 devstack sudo[97252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-612c8cd8-fe3d-4f90-a960-6cb0fe39ed60.info Aug 03 08:34:15 devstack sudo[97252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:34:15 devstack sudo[97252]: pam_unix(sudo:session): session closed for user root Aug 03 08:34:15 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-248fa69f-e043-46f5-b788-74aafeece983 tempest-GroupSnapshotsTest-1944413600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-612c8cd8-fe3d-4f90-a960-6cb0fe39ed60.info" returned: 0 in 0.457s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:34:15 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-248fa69f-e043-46f5-b788-74aafeece983 tempest-GroupSnapshotsTest-1944413600 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.503s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:34:15 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-248fa69f-e043-46f5-b788-74aafeece983 tempest-GroupSnapshotsTest-1944413600 None] group_snapshot 92bf3197-9d10-494a-a01a-40b8e1b5c5f0: created successfully Aug 03 08:34:17 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-26b9c708-507a-415d-9fb7-7146a8570917 tempest-GroupSnapshotsTest-1944413600 None] group_snapshot 92bf3197-9d10-494a-a01a-40b8e1b5c5f0: deleting Aug 03 08:34:17 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-26b9c708-507a-415d-9fb7-7146a8570917 tempest-GroupSnapshotsTest-1944413600 None] group_snapshot 92bf3197-9d10-494a-a01a-40b8e1b5c5f0: deleting {{(pid=88899) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Aug 03 08:34:17 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-26b9c708-507a-415d-9fb7-7146a8570917 tempest-GroupSnapshotsTest-1944413600 None] Acquiring lock "cinder-quobyte-612c8cd8-fe3d-4f90-a960-6cb0fe39ed60" by "delete_snapshot" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:34:17 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-26b9c708-507a-415d-9fb7-7146a8570917 tempest-GroupSnapshotsTest-1944413600 None] Lock "cinder-quobyte-612c8cd8-fe3d-4f90-a960-6cb0fe39ed60" acquired by "delete_snapshot" :: waited 0.052s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:34:17 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-26b9c708-507a-415d-9fb7-7146a8570917 tempest-GroupSnapshotsTest-1944413600 None] Acquiring lock "cinder-quobyte-5699a27b-de0a-456f-b15f-eb9cdeb55f53" by "_delete_snapshot" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:34:17 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-26b9c708-507a-415d-9fb7-7146a8570917 tempest-GroupSnapshotsTest-1944413600 None] Lock "cinder-quobyte-5699a27b-de0a-456f-b15f-eb9cdeb55f53" acquired by "_delete_snapshot" :: waited 0.087s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:34:17 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-26b9c708-507a-415d-9fb7-7146a8570917 tempest-GroupSnapshotsTest-1944413600 None] Deleting offline snapshot 5699a27b-de0a-456f-b15f-eb9cdeb55f53 of volume 612c8cd8-fe3d-4f90-a960-6cb0fe39ed60 {{(pid=88899) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 03 08:34:17 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-26b9c708-507a-415d-9fb7-7146a8570917 tempest-GroupSnapshotsTest-1944413600 None] snapshot_file for this snap is: volume-612c8cd8-fe3d-4f90-a960-6cb0fe39ed60.5699a27b-de0a-456f-b15f-eb9cdeb55f53 {{(pid=88899) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 03 08:34:17 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[a19a217b-bc4e-45b5-a604-cd2aba6b932d]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:34:17 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-26b9c708-507a-415d-9fb7-7146a8570917 tempest-GroupSnapshotsTest-1944413600 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-612c8cd8-fe3d-4f90-a960-6cb0fe39ed60.5699a27b-de0a-456f-b15f-eb9cdeb55f53 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:34:18 devstack sudo[97257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-612c8cd8-fe3d-4f90-a960-6cb0fe39ed60.5699a27b-de0a-456f-b15f-eb9cdeb55f53 Aug 03 08:34:18 devstack sudo[97257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:34:18 devstack sudo[97257]: pam_unix(sudo:session): session closed for user root Aug 03 08:34:18 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-26b9c708-507a-415d-9fb7-7146a8570917 tempest-GroupSnapshotsTest-1944413600 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-612c8cd8-fe3d-4f90-a960-6cb0fe39ed60.5699a27b-de0a-456f-b15f-eb9cdeb55f53" returned: 0 in 1.160s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:34:18 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-26b9c708-507a-415d-9fb7-7146a8570917 tempest-GroupSnapshotsTest-1944413600 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-612c8cd8-fe3d-4f90-a960-6cb0fe39ed60(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88899) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 03 08:34:18 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc9fbe65-685d-4379-ae5a-77b80dae72a5]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:34:18 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-26b9c708-507a-415d-9fb7-7146a8570917 tempest-GroupSnapshotsTest-1944413600 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-612c8cd8-fe3d-4f90-a960-6cb0fe39ed60 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:34:19 devstack sudo[97262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-612c8cd8-fe3d-4f90-a960-6cb0fe39ed60 Aug 03 08:34:19 devstack sudo[97262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:34:19 devstack sudo[97262]: pam_unix(sudo:session): session closed for user root Aug 03 08:34:19 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-26b9c708-507a-415d-9fb7-7146a8570917 tempest-GroupSnapshotsTest-1944413600 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-612c8cd8-fe3d-4f90-a960-6cb0fe39ed60" returned: 0 in 0.899s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:34:19 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-26b9c708-507a-415d-9fb7-7146a8570917 tempest-GroupSnapshotsTest-1944413600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-612c8cd8-fe3d-4f90-a960-6cb0fe39ed60.5699a27b-de0a-456f-b15f-eb9cdeb55f53 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:34:19 devstack sudo[97268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-612c8cd8-fe3d-4f90-a960-6cb0fe39ed60.5699a27b-de0a-456f-b15f-eb9cdeb55f53 Aug 03 08:34:19 devstack sudo[97268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:34:20 devstack sudo[97268]: pam_unix(sudo:session): session closed for user root Aug 03 08:34:20 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-26b9c708-507a-415d-9fb7-7146a8570917 tempest-GroupSnapshotsTest-1944413600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-612c8cd8-fe3d-4f90-a960-6cb0fe39ed60.5699a27b-de0a-456f-b15f-eb9cdeb55f53" returned: 0 in 0.708s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:34:20 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-26b9c708-507a-415d-9fb7-7146a8570917 tempest-GroupSnapshotsTest-1944413600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-612c8cd8-fe3d-4f90-a960-6cb0fe39ed60.5699a27b-de0a-456f-b15f-eb9cdeb55f53 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:34:20 devstack sudo[97274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-612c8cd8-fe3d-4f90-a960-6cb0fe39ed60.5699a27b-de0a-456f-b15f-eb9cdeb55f53 Aug 03 08:34:20 devstack sudo[97274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:34:21 devstack sudo[97274]: pam_unix(sudo:session): session closed for user root Aug 03 08:34:21 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-26b9c708-507a-415d-9fb7-7146a8570917 tempest-GroupSnapshotsTest-1944413600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-612c8cd8-fe3d-4f90-a960-6cb0fe39ed60.5699a27b-de0a-456f-b15f-eb9cdeb55f53" returned: 0 in 0.589s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:34:21 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-26b9c708-507a-415d-9fb7-7146a8570917 tempest-GroupSnapshotsTest-1944413600 None] Lock "cinder-quobyte-5699a27b-de0a-456f-b15f-eb9cdeb55f53" released by "_delete_snapshot" :: held 3.639s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:34:21 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-26b9c708-507a-415d-9fb7-7146a8570917 tempest-GroupSnapshotsTest-1944413600 None] Lock "cinder-quobyte-612c8cd8-fe3d-4f90-a960-6cb0fe39ed60" released by "delete_snapshot" :: held 3.763s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:34:21 devstack cinder-volume[88899]: WARNING cinder.quota [None req-26b9c708-507a-415d-9fb7-7146a8570917 tempest-GroupSnapshotsTest-1944413600 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-185205742 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-185205742, it is now deprecated. Please use the default quota class for default quota. Aug 03 08:34:21 devstack cinder-volume[88899]: WARNING cinder.quota [None req-26b9c708-507a-415d-9fb7-7146a8570917 tempest-GroupSnapshotsTest-1944413600 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-185205742 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-185205742, it is now deprecated. Please use the default quota class for default quota. Aug 03 08:34:21 devstack cinder-volume[88899]: DEBUG cinder.quota [None req-26b9c708-507a-415d-9fb7-7146a8570917 tempest-GroupSnapshotsTest-1944413600 None] Created reservations ['6800a46f-73c2-4002-be15-4666536482c6', '6e43ce6a-9b1b-44da-9a83-1a44db551e1c', '71bbd4de-759f-4ffb-a0a4-b594a706f512', '4fa02fcc-8483-497a-a440-301654ef5b5f'] {{(pid=88899) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 08:34:21 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-26b9c708-507a-415d-9fb7-7146a8570917 tempest-GroupSnapshotsTest-1944413600 None] group_snapshot 92bf3197-9d10-494a-a01a-40b8e1b5c5f0: deleted successfully Aug 03 08:34:23 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-8656c891-c78c-48fd-ab76-8e41b47e2f8c tempest-GroupSnapshotsTest-1944413600 None] Acquiring lock "cinder-quobyte-612c8cd8-fe3d-4f90-a960-6cb0fe39ed60" by "delete_volume" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:34:23 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-8656c891-c78c-48fd-ab76-8e41b47e2f8c tempest-GroupSnapshotsTest-1944413600 None] Lock "cinder-quobyte-612c8cd8-fe3d-4f90-a960-6cb0fe39ed60" acquired by "delete_volume" :: waited 0.049s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:34:23 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[d466ab8d-126d-4817-af8e-119ba75601fa]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:34:23 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-8656c891-c78c-48fd-ab76-8e41b47e2f8c tempest-GroupSnapshotsTest-1944413600 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-612c8cd8-fe3d-4f90-a960-6cb0fe39ed60 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:34:23 devstack sudo[97279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-612c8cd8-fe3d-4f90-a960-6cb0fe39ed60 Aug 03 08:34:23 devstack sudo[97279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:34:24 devstack sudo[97279]: pam_unix(sudo:session): session closed for user root Aug 03 08:34:24 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-8656c891-c78c-48fd-ab76-8e41b47e2f8c tempest-GroupSnapshotsTest-1944413600 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-612c8cd8-fe3d-4f90-a960-6cb0fe39ed60" returned: 0 in 1.160s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:34:24 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-8656c891-c78c-48fd-ab76-8e41b47e2f8c tempest-GroupSnapshotsTest-1944413600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-612c8cd8-fe3d-4f90-a960-6cb0fe39ed60 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:34:24 devstack sudo[97284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-612c8cd8-fe3d-4f90-a960-6cb0fe39ed60 Aug 03 08:34:24 devstack sudo[97284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:34:24 devstack sudo[97284]: pam_unix(sudo:session): session closed for user root Aug 03 08:34:24 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-8656c891-c78c-48fd-ab76-8e41b47e2f8c tempest-GroupSnapshotsTest-1944413600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-612c8cd8-fe3d-4f90-a960-6cb0fe39ed60" returned: 0 in 0.439s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:34:24 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-8656c891-c78c-48fd-ab76-8e41b47e2f8c tempest-GroupSnapshotsTest-1944413600 None] Lock "cinder-quobyte-612c8cd8-fe3d-4f90-a960-6cb0fe39ed60" released by "delete_volume" :: held 1.758s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:34:25 devstack cinder-volume[88899]: DEBUG cinder.quota [None req-8656c891-c78c-48fd-ab76-8e41b47e2f8c tempest-GroupSnapshotsTest-1944413600 None] Created reservations ['34f31eca-1609-4702-9be6-f985fd7e2e44'] {{(pid=88899) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 08:34:25 devstack cinder-volume[88899]: WARNING cinder.quota [None req-8656c891-c78c-48fd-ab76-8e41b47e2f8c tempest-GroupSnapshotsTest-1944413600 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-185205742 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-185205742, it is now deprecated. Please use the default quota class for default quota. Aug 03 08:34:25 devstack cinder-volume[88899]: DEBUG cinder.quota [None req-8656c891-c78c-48fd-ab76-8e41b47e2f8c tempest-GroupSnapshotsTest-1944413600 None] Created reservations ['4e0f721b-30de-439b-8591-9a9896de793c', 'b2485d51-5d66-4e69-8448-f1bfeedca928', '2d639090-848b-4878-a35a-68e143f1a7ad', 'aae6616b-bf3d-4b5e-bfd8-42147475ffa6'] {{(pid=88899) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 08:34:25 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-8656c891-c78c-48fd-ab76-8e41b47e2f8c tempest-GroupSnapshotsTest-1944413600 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:34:25 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-8656c891-c78c-48fd-ab76-8e41b47e2f8c tempest-GroupSnapshotsTest-1944413600 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:34:25 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-8656c891-c78c-48fd-ab76-8e41b47e2f8c tempest-GroupSnapshotsTest-1944413600 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:34:25 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-8656c891-c78c-48fd-ab76-8e41b47e2f8c tempest-GroupSnapshotsTest-1944413600 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:34:25 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-8656c891-c78c-48fd-ab76-8e41b47e2f8c tempest-GroupSnapshotsTest-1944413600 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:34:25 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-8656c891-c78c-48fd-ab76-8e41b47e2f8c tempest-GroupSnapshotsTest-1944413600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:34:25 devstack sudo[97287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a Aug 03 08:34:25 devstack sudo[97287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:34:26 devstack sudo[97287]: pam_unix(sudo:session): session closed for user root Aug 03 08:34:26 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-8656c891-c78c-48fd-ab76-8e41b47e2f8c tempest-GroupSnapshotsTest-1944413600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a" returned: 0 in 0.833s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:34:26 devstack cinder-volume[88899]: DEBUG cinder.manager [None req-8656c891-c78c-48fd-ab76-8e41b47e2f8c tempest-GroupSnapshotsTest-1944413600 None] Notifying Schedulers of capabilities ... {{(pid=88899) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 08:34:26 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-8656c891-c78c-48fd-ab76-8e41b47e2f8c tempest-GroupSnapshotsTest-1944413600 None] Delete group completed successfully. Aug 03 08:34:26 devstack cinder-volume[88899]: DEBUG cinder.volume.flows.manager.create_volume [None req-a4c92b8c-d77c-4f03-abd7-784935b9fa0c tempest-TestServerVolumeAttachmentScenario-1345303408 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88899) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 08:34:26 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-a4c92b8c-d77c-4f03-abd7-784935b9fa0c tempest-TestServerVolumeAttachmentScenario-1345303408 None] Flow 'volume_create_manager' (0cfab928-3e1c-44d8-b30a-b5f8aad9fdd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:34:26 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-a4c92b8c-d77c-4f03-abd7-784935b9fa0c tempest-TestServerVolumeAttachmentScenario-1345303408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ed2adbc-35d6-4a31-83a0-451a0f0591f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:34:26 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-a4c92b8c-d77c-4f03-abd7-784935b9fa0c tempest-TestServerVolumeAttachmentScenario-1345303408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ed2adbc-35d6-4a31-83a0-451a0f0591f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:34:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1615848369',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b8762e6-f4ad-44b7-bed1-be69dbe129dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fcac48a8b83b4b68badbd1150d1f79b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:34:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:34:27Z,use_quota=True,user_id='0ffd1329869b4663b192653aab0d2a66',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8bde7129-1dc4-42ab-b852-ab32c61b4921),volume_type_id=8bde7129-1dc4-42ab-b852-ab32c61b4921)' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:34:26 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-a4c92b8c-d77c-4f03-abd7-784935b9fa0c tempest-TestServerVolumeAttachmentScenario-1345303408 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f050b36c-9304-4203-9536-8bf3f6fcafc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:34:26 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-a4c92b8c-d77c-4f03-abd7-784935b9fa0c tempest-TestServerVolumeAttachmentScenario-1345303408 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f050b36c-9304-4203-9536-8bf3f6fcafc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:34:26 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-a4c92b8c-d77c-4f03-abd7-784935b9fa0c tempest-TestServerVolumeAttachmentScenario-1345303408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc1059f6-2cab-49c6-9977-4379a12e6985) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:34:26 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-a4c92b8c-d77c-4f03-abd7-784935b9fa0c tempest-TestServerVolumeAttachmentScenario-1345303408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc1059f6-2cab-49c6-9977-4379a12e6985) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4b8762e6-f4ad-44b7-bed1-be69dbe129dc', 'volume_name': 'volume-4b8762e6-f4ad-44b7-bed1-be69dbe129dc', 'volume_size': 1}' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:34:26 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-a4c92b8c-d77c-4f03-abd7-784935b9fa0c tempest-TestServerVolumeAttachmentScenario-1345303408 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be83e2a8-8999-4961-9a42-a6fa0276658b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:34:26 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-a4c92b8c-d77c-4f03-abd7-784935b9fa0c tempest-TestServerVolumeAttachmentScenario-1345303408 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be83e2a8-8999-4961-9a42-a6fa0276658b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:34:26 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-a4c92b8c-d77c-4f03-abd7-784935b9fa0c tempest-TestServerVolumeAttachmentScenario-1345303408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d09a2f5-2a6d-4308-b01c-a547b035b869) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:34:26 devstack cinder-volume[88899]: INFO cinder.volume.flows.manager.create_volume [None req-a4c92b8c-d77c-4f03-abd7-784935b9fa0c tempest-TestServerVolumeAttachmentScenario-1345303408 None] Volume 4b8762e6-f4ad-44b7-bed1-be69dbe129dc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4b8762e6-f4ad-44b7-bed1-be69dbe129dc', 'volume_size': 1} Aug 03 08:34:26 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-a4c92b8c-d77c-4f03-abd7-784935b9fa0c tempest-TestServerVolumeAttachmentScenario-1345303408 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:34:26 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-a4c92b8c-d77c-4f03-abd7-784935b9fa0c tempest-TestServerVolumeAttachmentScenario-1345303408 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:34:26 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-a4c92b8c-d77c-4f03-abd7-784935b9fa0c tempest-TestServerVolumeAttachmentScenario-1345303408 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:34:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1615848369',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b8762e6-f4ad-44b7-bed1-be69dbe129dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fcac48a8b83b4b68badbd1150d1f79b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:34:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:34:27Z,use_quota=True,user_id='0ffd1329869b4663b192653aab0d2a66',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8bde7129-1dc4-42ab-b852-ab32c61b4921),volume_type_id=8bde7129-1dc4-42ab-b852-ab32c61b4921)}" {{(pid=88899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 08:34:26 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-a4c92b8c-d77c-4f03-abd7-784935b9fa0c tempest-TestServerVolumeAttachmentScenario-1345303408 None] Creating volume 4b8762e6-f4ad-44b7-bed1-be69dbe129dc {{(pid=88899) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 08:34:26 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-a4c92b8c-d77c-4f03-abd7-784935b9fa0c tempest-TestServerVolumeAttachmentScenario-1345303408 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:34:26 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-a4c92b8c-d77c-4f03-abd7-784935b9fa0c tempest-TestServerVolumeAttachmentScenario-1345303408 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:34:26 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-a4c92b8c-d77c-4f03-abd7-784935b9fa0c tempest-TestServerVolumeAttachmentScenario-1345303408 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:34:26 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-a4c92b8c-d77c-4f03-abd7-784935b9fa0c tempest-TestServerVolumeAttachmentScenario-1345303408 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:34:26 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-a4c92b8c-d77c-4f03-abd7-784935b9fa0c tempest-TestServerVolumeAttachmentScenario-1345303408 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:34:26 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-a4c92b8c-d77c-4f03-abd7-784935b9fa0c tempest-TestServerVolumeAttachmentScenario-1345303408 None] Selected osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385 as target Quobyte volume. {{(pid=88899) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 08:34:26 devstack cinder-volume[88899]: INFO cinder.volume.drivers.remotefs [None req-a4c92b8c-d77c-4f03-abd7-784935b9fa0c tempest-TestServerVolumeAttachmentScenario-1345303408 None] casted to osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385 Aug 03 08:34:26 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-a4c92b8c-d77c-4f03-abd7-784935b9fa0c tempest-TestServerVolumeAttachmentScenario-1345303408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-4b8762e6-f4ad-44b7-bed1-be69dbe129dc 1073741824 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:34:26 devstack sudo[97322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-4b8762e6-f4ad-44b7-bed1-be69dbe129dc 1073741824 Aug 03 08:34:26 devstack sudo[97322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:34:27 devstack cinder-volume[88899]: DEBUG cinder.volume.flows.manager.create_volume [None req-a0ede145-bee6-4f14-900b-10b7401013d9 tempest-TestServerVolumeAttachmentScenario-1345303408 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88899) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 08:34:27 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-a0ede145-bee6-4f14-900b-10b7401013d9 tempest-TestServerVolumeAttachmentScenario-1345303408 None] Flow 'volume_create_manager' (89d80fd9-7291-48f5-829e-acc97b585974) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:34:27 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-a0ede145-bee6-4f14-900b-10b7401013d9 tempest-TestServerVolumeAttachmentScenario-1345303408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a430e38-4a70-47d9-a983-4fa6b8056624) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:34:27 devstack sudo[97322]: pam_unix(sudo:session): session closed for user root Aug 03 08:34:27 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-a4c92b8c-d77c-4f03-abd7-784935b9fa0c tempest-TestServerVolumeAttachmentScenario-1345303408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-4b8762e6-f4ad-44b7-bed1-be69dbe129dc 1073741824" returned: 0 in 1.182s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:34:28 devstack cinder-volume[88899]: DEBUG dbcounter [-] [88899] Writing DB stats cinder:SELECT=154,cinder:UPDATE=141,cinder:INSERT=42,cinder:DELETE=3 {{(pid=88899) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 03 08:34:28 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-a0ede145-bee6-4f14-900b-10b7401013d9 tempest-TestServerVolumeAttachmentScenario-1345303408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a430e38-4a70-47d9-a983-4fa6b8056624) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:34:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1235504116',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1c4ea58d-362b-4f84-8788-6faad1d47b25,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fcac48a8b83b4b68badbd1150d1f79b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:34:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:34:28Z,use_quota=True,user_id='0ffd1329869b4663b192653aab0d2a66',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8bde7129-1dc4-42ab-b852-ab32c61b4921),volume_type_id=8bde7129-1dc4-42ab-b852-ab32c61b4921)' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:34:28 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-a0ede145-bee6-4f14-900b-10b7401013d9 tempest-TestServerVolumeAttachmentScenario-1345303408 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (233ab87a-2851-4ee7-81d8-d549e0410435) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:34:28 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-a0ede145-bee6-4f14-900b-10b7401013d9 tempest-TestServerVolumeAttachmentScenario-1345303408 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (233ab87a-2851-4ee7-81d8-d549e0410435) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:34:28 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-a0ede145-bee6-4f14-900b-10b7401013d9 tempest-TestServerVolumeAttachmentScenario-1345303408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0f65cf7-cc81-4d9a-adfa-7ffee43247aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:34:28 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-a0ede145-bee6-4f14-900b-10b7401013d9 tempest-TestServerVolumeAttachmentScenario-1345303408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0f65cf7-cc81-4d9a-adfa-7ffee43247aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1c4ea58d-362b-4f84-8788-6faad1d47b25', 'volume_name': 'volume-1c4ea58d-362b-4f84-8788-6faad1d47b25', 'volume_size': 1}' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:34:28 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-a0ede145-bee6-4f14-900b-10b7401013d9 tempest-TestServerVolumeAttachmentScenario-1345303408 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (199a67ed-ad59-4e66-8ac8-d72f7851b9b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:34:28 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-a0ede145-bee6-4f14-900b-10b7401013d9 tempest-TestServerVolumeAttachmentScenario-1345303408 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (199a67ed-ad59-4e66-8ac8-d72f7851b9b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:34:28 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-a0ede145-bee6-4f14-900b-10b7401013d9 tempest-TestServerVolumeAttachmentScenario-1345303408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ccc56aec-2713-4a99-b919-037b6dbe023b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:34:28 devstack cinder-volume[88899]: INFO cinder.volume.flows.manager.create_volume [None req-a0ede145-bee6-4f14-900b-10b7401013d9 tempest-TestServerVolumeAttachmentScenario-1345303408 None] Volume 1c4ea58d-362b-4f84-8788-6faad1d47b25: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1c4ea58d-362b-4f84-8788-6faad1d47b25', 'volume_size': 1} Aug 03 08:34:28 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-a0ede145-bee6-4f14-900b-10b7401013d9 tempest-TestServerVolumeAttachmentScenario-1345303408 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:34:28 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-a4c92b8c-d77c-4f03-abd7-784935b9fa0c tempest-TestServerVolumeAttachmentScenario-1345303408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-4b8762e6-f4ad-44b7-bed1-be69dbe129dc {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:34:28 devstack sudo[97353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-4b8762e6-f4ad-44b7-bed1-be69dbe129dc Aug 03 08:34:28 devstack sudo[97353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:34:28 devstack sudo[97353]: pam_unix(sudo:session): session closed for user root Aug 03 08:34:28 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-a4c92b8c-d77c-4f03-abd7-784935b9fa0c tempest-TestServerVolumeAttachmentScenario-1345303408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-4b8762e6-f4ad-44b7-bed1-be69dbe129dc" returned: 0 in 0.622s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:34:28 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-a4c92b8c-d77c-4f03-abd7-784935b9fa0c tempest-TestServerVolumeAttachmentScenario-1345303408 None] <== create_volume: return (1973ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'} {{(pid=88899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 08:34:28 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-a4c92b8c-d77c-4f03-abd7-784935b9fa0c tempest-TestServerVolumeAttachmentScenario-1345303408 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.977s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:34:28 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-a0ede145-bee6-4f14-900b-10b7401013d9 tempest-TestServerVolumeAttachmentScenario-1345303408 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.667s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:34:28 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-a0ede145-bee6-4f14-900b-10b7401013d9 tempest-TestServerVolumeAttachmentScenario-1345303408 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:34:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1235504116',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1c4ea58d-362b-4f84-8788-6faad1d47b25,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fcac48a8b83b4b68badbd1150d1f79b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:34:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:34:28Z,use_quota=True,user_id='0ffd1329869b4663b192653aab0d2a66',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8bde7129-1dc4-42ab-b852-ab32c61b4921),volume_type_id=8bde7129-1dc4-42ab-b852-ab32c61b4921)}" {{(pid=88899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 08:34:28 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-a0ede145-bee6-4f14-900b-10b7401013d9 tempest-TestServerVolumeAttachmentScenario-1345303408 None] Creating volume 1c4ea58d-362b-4f84-8788-6faad1d47b25 {{(pid=88899) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 08:34:28 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-a0ede145-bee6-4f14-900b-10b7401013d9 tempest-TestServerVolumeAttachmentScenario-1345303408 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:34:28 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-a0ede145-bee6-4f14-900b-10b7401013d9 tempest-TestServerVolumeAttachmentScenario-1345303408 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:34:28 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-a0ede145-bee6-4f14-900b-10b7401013d9 tempest-TestServerVolumeAttachmentScenario-1345303408 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:34:28 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-a0ede145-bee6-4f14-900b-10b7401013d9 tempest-TestServerVolumeAttachmentScenario-1345303408 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:34:28 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-a0ede145-bee6-4f14-900b-10b7401013d9 tempest-TestServerVolumeAttachmentScenario-1345303408 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:34:28 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-a0ede145-bee6-4f14-900b-10b7401013d9 tempest-TestServerVolumeAttachmentScenario-1345303408 None] Selected osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385 as target Quobyte volume. {{(pid=88899) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 08:34:28 devstack cinder-volume[88899]: INFO cinder.volume.drivers.remotefs [None req-a0ede145-bee6-4f14-900b-10b7401013d9 tempest-TestServerVolumeAttachmentScenario-1345303408 None] casted to osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385 Aug 03 08:34:28 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-a0ede145-bee6-4f14-900b-10b7401013d9 tempest-TestServerVolumeAttachmentScenario-1345303408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-1c4ea58d-362b-4f84-8788-6faad1d47b25 1073741824 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:34:28 devstack cinder-volume[88899]: DEBUG dbcounter [-] [88899] Writing DB stats cinder:SELECT=161,cinder:UPDATE=144,cinder:INSERT=39,cinder:DELETE=7 {{(pid=88899) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 03 08:34:28 devstack sudo[97358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-1c4ea58d-362b-4f84-8788-6faad1d47b25 1073741824 Aug 03 08:34:28 devstack sudo[97358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:34:28 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-a4c92b8c-d77c-4f03-abd7-784935b9fa0c tempest-TestServerVolumeAttachmentScenario-1345303408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d09a2f5-2a6d-4308-b01c-a547b035b869) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4b8762e6-f4ad-44b7-bed1-be69dbe129dc', 'volume_size': 1}' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:34:28 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-a4c92b8c-d77c-4f03-abd7-784935b9fa0c tempest-TestServerVolumeAttachmentScenario-1345303408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f8e4f83-c9c3-4c47-aecf-828699bc62d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:34:28 devstack cinder-volume[88899]: INFO cinder.volume.flows.manager.create_volume [None req-a4c92b8c-d77c-4f03-abd7-784935b9fa0c tempest-TestServerVolumeAttachmentScenario-1345303408 None] Volume volume-4b8762e6-f4ad-44b7-bed1-be69dbe129dc (4b8762e6-f4ad-44b7-bed1-be69dbe129dc): created successfully Aug 03 08:34:28 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-a4c92b8c-d77c-4f03-abd7-784935b9fa0c tempest-TestServerVolumeAttachmentScenario-1345303408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f8e4f83-c9c3-4c47-aecf-828699bc62d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:34:28 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-a4c92b8c-d77c-4f03-abd7-784935b9fa0c tempest-TestServerVolumeAttachmentScenario-1345303408 None] Flow 'volume_create_manager' (0cfab928-3e1c-44d8-b30a-b5f8aad9fdd1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:34:28 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-a4c92b8c-d77c-4f03-abd7-784935b9fa0c tempest-TestServerVolumeAttachmentScenario-1345303408 None] Created volume successfully. Aug 03 08:34:29 devstack sudo[97358]: pam_unix(sudo:session): session closed for user root Aug 03 08:34:29 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-a0ede145-bee6-4f14-900b-10b7401013d9 tempest-TestServerVolumeAttachmentScenario-1345303408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-1c4ea58d-362b-4f84-8788-6faad1d47b25 1073741824" returned: 0 in 0.687s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:34:29 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-a0ede145-bee6-4f14-900b-10b7401013d9 tempest-TestServerVolumeAttachmentScenario-1345303408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-1c4ea58d-362b-4f84-8788-6faad1d47b25 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:34:29 devstack sudo[97364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-1c4ea58d-362b-4f84-8788-6faad1d47b25 Aug 03 08:34:29 devstack sudo[97364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:34:30 devstack sudo[97364]: pam_unix(sudo:session): session closed for user root Aug 03 08:34:30 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-a0ede145-bee6-4f14-900b-10b7401013d9 tempest-TestServerVolumeAttachmentScenario-1345303408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-1c4ea58d-362b-4f84-8788-6faad1d47b25" returned: 0 in 0.525s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:34:30 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-a0ede145-bee6-4f14-900b-10b7401013d9 tempest-TestServerVolumeAttachmentScenario-1345303408 None] <== create_volume: return (1285ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'} {{(pid=88899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 08:34:30 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-a0ede145-bee6-4f14-900b-10b7401013d9 tempest-TestServerVolumeAttachmentScenario-1345303408 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.291s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:34:30 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-a0ede145-bee6-4f14-900b-10b7401013d9 tempest-TestServerVolumeAttachmentScenario-1345303408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ccc56aec-2713-4a99-b919-037b6dbe023b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1c4ea58d-362b-4f84-8788-6faad1d47b25', 'volume_size': 1}' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:34:30 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-a0ede145-bee6-4f14-900b-10b7401013d9 tempest-TestServerVolumeAttachmentScenario-1345303408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c222d4d-6d6f-4ad7-bcaa-992a33a175e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:34:30 devstack cinder-volume[88899]: INFO cinder.volume.flows.manager.create_volume [None req-a0ede145-bee6-4f14-900b-10b7401013d9 tempest-TestServerVolumeAttachmentScenario-1345303408 None] Volume volume-1c4ea58d-362b-4f84-8788-6faad1d47b25 (1c4ea58d-362b-4f84-8788-6faad1d47b25): created successfully Aug 03 08:34:30 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-a0ede145-bee6-4f14-900b-10b7401013d9 tempest-TestServerVolumeAttachmentScenario-1345303408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c222d4d-6d6f-4ad7-bcaa-992a33a175e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:34:30 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-a0ede145-bee6-4f14-900b-10b7401013d9 tempest-TestServerVolumeAttachmentScenario-1345303408 None] Flow 'volume_create_manager' (89d80fd9-7291-48f5-829e-acc97b585974) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:34:30 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-a0ede145-bee6-4f14-900b-10b7401013d9 tempest-TestServerVolumeAttachmentScenario-1345303408 None] Created volume successfully. Aug 03 08:34:34 devstack cinder-volume[88899]: INFO cinder.volume.manager [req-a8cfac40-76a9-45bd-acea-cf43e628f309 req-e9f73c37-6d94-4aca-b4cf-22cf569ff820 tempest-ServerActionsTestOtherA-826446422 None] Terminate volume connection completed successfully. Aug 03 08:34:34 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [req-a8cfac40-76a9-45bd-acea-cf43e628f309 req-e9f73c37-6d94-4aca-b4cf-22cf569ff820 tempest-ServerActionsTestOtherA-826446422 None] Deleting attachment 9df575e3-f819-4b63-be8f-cf2018cb95a0. {{(pid=88899) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 03 08:34:36 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [req-a8cfac40-76a9-45bd-acea-cf43e628f309 req-bd2eb68c-e798-4b14-b8fc-5aa23ada14ae tempest-ServerActionsTestOtherA-826446422 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:34:36 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [req-a8cfac40-76a9-45bd-acea-cf43e628f309 req-bd2eb68c-e798-4b14-b8fc-5aa23ada14ae tempest-ServerActionsTestOtherA-826446422 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:34:36 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [req-a8cfac40-76a9-45bd-acea-cf43e628f309 req-bd2eb68c-e798-4b14-b8fc-5aa23ada14ae tempest-ServerActionsTestOtherA-826446422 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.026s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:34:36 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [req-a8cfac40-76a9-45bd-acea-cf43e628f309 req-bd2eb68c-e798-4b14-b8fc-5aa23ada14ae tempest-ServerActionsTestOtherA-826446422 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385', 'name': 'volume-a62a55cb-cd3f-4d05-9d19-0aa3f9654f56', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '3673d427-8573-4560-adbf-1c98df7d38d3', 'enforce_multipath': True} {{(pid=88899) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 03 08:34:36 devstack cinder-volume[88899]: INFO cinder.volume.manager [req-a8cfac40-76a9-45bd-acea-cf43e628f309 req-bd2eb68c-e798-4b14-b8fc-5aa23ada14ae tempest-ServerActionsTestOtherA-826446422 None] attachment_update completed successfully. Aug 03 08:34:38 devstack cinder-volume[88899]: DEBUG cinder.volume.flows.manager.create_volume [None req-a4eb254c-dff4-4f6e-b08a-5c3d613e3e91 tempest-AttachVolumeNegativeTest-1279867800 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88899) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 08:34:38 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-a4eb254c-dff4-4f6e-b08a-5c3d613e3e91 tempest-AttachVolumeNegativeTest-1279867800 None] Flow 'volume_create_manager' (0f6e69e4-60d4-4246-a9ec-46dc99b2cd69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:34:39 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-a4eb254c-dff4-4f6e-b08a-5c3d613e3e91 tempest-AttachVolumeNegativeTest-1279867800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0985477a-424f-4a7d-a541-46994c88c068) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:34:39 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-a4eb254c-dff4-4f6e-b08a-5c3d613e3e91 tempest-AttachVolumeNegativeTest-1279867800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0985477a-424f-4a7d-a541-46994c88c068) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:34:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1848988595',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c1a9406e-9b9f-4b56-b936-e160d33a06cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f06670c627043c9a605aa207b29fe32',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:34:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:34:39Z,use_quota=True,user_id='3e4a15ae37a34d638cd37c201b61c395',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8bde7129-1dc4-42ab-b852-ab32c61b4921),volume_type_id=8bde7129-1dc4-42ab-b852-ab32c61b4921)' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:34:39 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-a4eb254c-dff4-4f6e-b08a-5c3d613e3e91 tempest-AttachVolumeNegativeTest-1279867800 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f229f6be-ea31-4e4b-b8c8-354016f0ac35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:34:39 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-a4eb254c-dff4-4f6e-b08a-5c3d613e3e91 tempest-AttachVolumeNegativeTest-1279867800 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f229f6be-ea31-4e4b-b8c8-354016f0ac35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:34:39 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-a4eb254c-dff4-4f6e-b08a-5c3d613e3e91 tempest-AttachVolumeNegativeTest-1279867800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34077d7d-dd10-4816-974f-e3342ff7bef6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:34:39 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-a4eb254c-dff4-4f6e-b08a-5c3d613e3e91 tempest-AttachVolumeNegativeTest-1279867800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34077d7d-dd10-4816-974f-e3342ff7bef6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c1a9406e-9b9f-4b56-b936-e160d33a06cc', 'volume_name': 'volume-c1a9406e-9b9f-4b56-b936-e160d33a06cc', 'volume_size': 1}' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:34:39 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-a4eb254c-dff4-4f6e-b08a-5c3d613e3e91 tempest-AttachVolumeNegativeTest-1279867800 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a228bbe-bb23-483d-98e5-c8aea9f1ba54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:34:39 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-a4eb254c-dff4-4f6e-b08a-5c3d613e3e91 tempest-AttachVolumeNegativeTest-1279867800 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a228bbe-bb23-483d-98e5-c8aea9f1ba54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:34:39 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-a4eb254c-dff4-4f6e-b08a-5c3d613e3e91 tempest-AttachVolumeNegativeTest-1279867800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a5343d42-c5f5-4e9b-ba87-d889789192e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:34:39 devstack cinder-volume[88899]: INFO cinder.volume.flows.manager.create_volume [None req-a4eb254c-dff4-4f6e-b08a-5c3d613e3e91 tempest-AttachVolumeNegativeTest-1279867800 None] Volume c1a9406e-9b9f-4b56-b936-e160d33a06cc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c1a9406e-9b9f-4b56-b936-e160d33a06cc', 'volume_size': 1} Aug 03 08:34:39 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-a4eb254c-dff4-4f6e-b08a-5c3d613e3e91 tempest-AttachVolumeNegativeTest-1279867800 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:34:39 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-a4eb254c-dff4-4f6e-b08a-5c3d613e3e91 tempest-AttachVolumeNegativeTest-1279867800 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:34:39 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-a4eb254c-dff4-4f6e-b08a-5c3d613e3e91 tempest-AttachVolumeNegativeTest-1279867800 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:34:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1848988595',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c1a9406e-9b9f-4b56-b936-e160d33a06cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f06670c627043c9a605aa207b29fe32',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:34:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:34:39Z,use_quota=True,user_id='3e4a15ae37a34d638cd37c201b61c395',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8bde7129-1dc4-42ab-b852-ab32c61b4921),volume_type_id=8bde7129-1dc4-42ab-b852-ab32c61b4921)}" {{(pid=88899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 08:34:39 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-a4eb254c-dff4-4f6e-b08a-5c3d613e3e91 tempest-AttachVolumeNegativeTest-1279867800 None] Creating volume c1a9406e-9b9f-4b56-b936-e160d33a06cc {{(pid=88899) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 08:34:39 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-a4eb254c-dff4-4f6e-b08a-5c3d613e3e91 tempest-AttachVolumeNegativeTest-1279867800 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:34:39 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-a4eb254c-dff4-4f6e-b08a-5c3d613e3e91 tempest-AttachVolumeNegativeTest-1279867800 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:34:39 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-a4eb254c-dff4-4f6e-b08a-5c3d613e3e91 tempest-AttachVolumeNegativeTest-1279867800 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:34:39 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-a4eb254c-dff4-4f6e-b08a-5c3d613e3e91 tempest-AttachVolumeNegativeTest-1279867800 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:34:39 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-a4eb254c-dff4-4f6e-b08a-5c3d613e3e91 tempest-AttachVolumeNegativeTest-1279867800 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:34:39 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-a4eb254c-dff4-4f6e-b08a-5c3d613e3e91 tempest-AttachVolumeNegativeTest-1279867800 None] Selected osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385 as target Quobyte volume. {{(pid=88899) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 08:34:39 devstack cinder-volume[88899]: INFO cinder.volume.drivers.remotefs [None req-a4eb254c-dff4-4f6e-b08a-5c3d613e3e91 tempest-AttachVolumeNegativeTest-1279867800 None] casted to osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385 Aug 03 08:34:39 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-a4eb254c-dff4-4f6e-b08a-5c3d613e3e91 tempest-AttachVolumeNegativeTest-1279867800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c1a9406e-9b9f-4b56-b936-e160d33a06cc 1073741824 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:34:39 devstack sudo[97872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c1a9406e-9b9f-4b56-b936-e160d33a06cc 1073741824 Aug 03 08:34:39 devstack sudo[97872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:34:39 devstack sudo[97872]: pam_unix(sudo:session): session closed for user root Aug 03 08:34:39 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-a4eb254c-dff4-4f6e-b08a-5c3d613e3e91 tempest-AttachVolumeNegativeTest-1279867800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c1a9406e-9b9f-4b56-b936-e160d33a06cc 1073741824" returned: 0 in 0.634s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:34:39 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-a4eb254c-dff4-4f6e-b08a-5c3d613e3e91 tempest-AttachVolumeNegativeTest-1279867800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c1a9406e-9b9f-4b56-b936-e160d33a06cc {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:34:39 devstack sudo[97890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c1a9406e-9b9f-4b56-b936-e160d33a06cc Aug 03 08:34:39 devstack sudo[97890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:34:40 devstack sudo[97890]: pam_unix(sudo:session): session closed for user root Aug 03 08:34:40 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-a4eb254c-dff4-4f6e-b08a-5c3d613e3e91 tempest-AttachVolumeNegativeTest-1279867800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c1a9406e-9b9f-4b56-b936-e160d33a06cc" returned: 0 in 0.357s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:34:40 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-a4eb254c-dff4-4f6e-b08a-5c3d613e3e91 tempest-AttachVolumeNegativeTest-1279867800 None] <== create_volume: return (1059ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'} {{(pid=88899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 08:34:40 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-a4eb254c-dff4-4f6e-b08a-5c3d613e3e91 tempest-AttachVolumeNegativeTest-1279867800 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.065s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:34:40 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-a4eb254c-dff4-4f6e-b08a-5c3d613e3e91 tempest-AttachVolumeNegativeTest-1279867800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a5343d42-c5f5-4e9b-ba87-d889789192e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c1a9406e-9b9f-4b56-b936-e160d33a06cc', 'volume_size': 1}' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:34:40 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-a4eb254c-dff4-4f6e-b08a-5c3d613e3e91 tempest-AttachVolumeNegativeTest-1279867800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2f7c7fc4-3c47-4802-9b0e-2a3d0f636543) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:34:40 devstack cinder-volume[88899]: INFO cinder.volume.flows.manager.create_volume [None req-a4eb254c-dff4-4f6e-b08a-5c3d613e3e91 tempest-AttachVolumeNegativeTest-1279867800 None] Volume volume-c1a9406e-9b9f-4b56-b936-e160d33a06cc (c1a9406e-9b9f-4b56-b936-e160d33a06cc): created successfully Aug 03 08:34:40 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-a4eb254c-dff4-4f6e-b08a-5c3d613e3e91 tempest-AttachVolumeNegativeTest-1279867800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2f7c7fc4-3c47-4802-9b0e-2a3d0f636543) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:34:40 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-a4eb254c-dff4-4f6e-b08a-5c3d613e3e91 tempest-AttachVolumeNegativeTest-1279867800 None] Flow 'volume_create_manager' (0f6e69e4-60d4-4246-a9ec-46dc99b2cd69) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:34:40 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-a4eb254c-dff4-4f6e-b08a-5c3d613e3e91 tempest-AttachVolumeNegativeTest-1279867800 None] Created volume successfully. Aug 03 08:34:43 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [req-28e4a915-2cab-4d06-916f-b4a6635d5d54 req-4772086c-ccd3-482a-8040-a3dc828467b4 tempest-AttachVolumeNegativeTest-1279867800 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:34:43 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [req-28e4a915-2cab-4d06-916f-b4a6635d5d54 req-4772086c-ccd3-482a-8040-a3dc828467b4 tempest-AttachVolumeNegativeTest-1279867800 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.003s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:34:43 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [req-28e4a915-2cab-4d06-916f-b4a6635d5d54 req-4772086c-ccd3-482a-8040-a3dc828467b4 tempest-AttachVolumeNegativeTest-1279867800 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.046s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:34:43 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [req-28e4a915-2cab-4d06-916f-b4a6635d5d54 req-4772086c-ccd3-482a-8040-a3dc828467b4 tempest-AttachVolumeNegativeTest-1279867800 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385', 'name': 'volume-c1a9406e-9b9f-4b56-b936-e160d33a06cc', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'cefd7805-7656-4141-99cf-cdb46790ef35', 'enforce_multipath': True} {{(pid=88899) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 03 08:34:43 devstack cinder-volume[88899]: INFO cinder.volume.manager [req-28e4a915-2cab-4d06-916f-b4a6635d5d54 req-4772086c-ccd3-482a-8040-a3dc828467b4 tempest-AttachVolumeNegativeTest-1279867800 None] attachment_update completed successfully. Aug 03 08:34:49 devstack cinder-volume[88899]: INFO cinder.volume.manager [req-b539e4a6-ca34-4804-bef9-55a0c31c1d71 req-5813a79a-23c7-45cb-b6eb-3b0ae2a0fc22 tempest-AttachVolumeNegativeTest-1279867800 None] Terminate volume connection completed successfully. Aug 03 08:34:49 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [req-b539e4a6-ca34-4804-bef9-55a0c31c1d71 req-5813a79a-23c7-45cb-b6eb-3b0ae2a0fc22 tempest-AttachVolumeNegativeTest-1279867800 None] Deleting attachment cefd7805-7656-4141-99cf-cdb46790ef35. {{(pid=88899) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 03 08:34:51 devstack cinder-volume[88899]: DEBUG oslo_service.periodic_task [None req-f948fb4a-c4d7-499f-b1bd-8d6be3de0b53 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88899) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 03 08:34:51 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-f948fb4a-c4d7-499f-b1bd-8d6be3de0b53 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:34:51 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-f948fb4a-c4d7-499f-b1bd-8d6be3de0b53 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:34:51 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-f948fb4a-c4d7-499f-b1bd-8d6be3de0b53 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:34:51 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-f948fb4a-c4d7-499f-b1bd-8d6be3de0b53 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:34:51 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-f948fb4a-c4d7-499f-b1bd-8d6be3de0b53 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:34:51 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-f948fb4a-c4d7-499f-b1bd-8d6be3de0b53 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:34:51 devstack sudo[98074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a Aug 03 08:34:51 devstack sudo[98074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:34:52 devstack sudo[98074]: pam_unix(sudo:session): session closed for user root Aug 03 08:34:52 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-f948fb4a-c4d7-499f-b1bd-8d6be3de0b53 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a" returned: 0 in 0.796s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:34:52 devstack cinder-volume[88899]: DEBUG cinder.manager [None req-f948fb4a-c4d7-499f-b1bd-8d6be3de0b53 None None] Notifying Schedulers of capabilities ... {{(pid=88899) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 08:34:52 devstack cinder-volume[88899]: DEBUG oslo_service.periodic_task [None req-f948fb4a-c4d7-499f-b1bd-8d6be3de0b53 None None] Running periodic task VolumeManager._thread_info {{(pid=88899) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 03 08:34:52 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-f948fb4a-c4d7-499f-b1bd-8d6be3de0b53 None None] thread count: 28 {{(pid=88899) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 03 08:34:52 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-f948fb4a-c4d7-499f-b1bd-8d6be3de0b53 None None] thread info: [<_MainThread(MainThread, started 132234320248960)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88899) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 03 08:34:57 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-e55761fb-01f5-4e9f-b417-f0fca06c1c75 tempest-AttachVolumeNegativeTest-1279867800 None] Acquiring lock "cinder-c1a9406e-9b9f-4b56-b936-e160d33a06cc-delete_volume" by "delete_volume" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:34:57 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-e55761fb-01f5-4e9f-b417-f0fca06c1c75 tempest-AttachVolumeNegativeTest-1279867800 None] Lock "cinder-c1a9406e-9b9f-4b56-b936-e160d33a06cc-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:34:57 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-e55761fb-01f5-4e9f-b417-f0fca06c1c75 tempest-AttachVolumeNegativeTest-1279867800 None] Acquiring lock "cinder-quobyte-c1a9406e-9b9f-4b56-b936-e160d33a06cc" by "delete_volume" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:34:57 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-e55761fb-01f5-4e9f-b417-f0fca06c1c75 tempest-AttachVolumeNegativeTest-1279867800 None] Lock "cinder-quobyte-c1a9406e-9b9f-4b56-b936-e160d33a06cc" acquired by "delete_volume" :: waited 0.029s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:34:57 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dc7d56f-d371-4208-b08f-3d6c9496f25e]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:34:57 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-e55761fb-01f5-4e9f-b417-f0fca06c1c75 tempest-AttachVolumeNegativeTest-1279867800 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c1a9406e-9b9f-4b56-b936-e160d33a06cc {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:34:57 devstack sudo[98127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c1a9406e-9b9f-4b56-b936-e160d33a06cc Aug 03 08:34:57 devstack sudo[98127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:34:57 devstack sudo[98127]: pam_unix(sudo:session): session closed for user root Aug 03 08:34:57 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-e55761fb-01f5-4e9f-b417-f0fca06c1c75 tempest-AttachVolumeNegativeTest-1279867800 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c1a9406e-9b9f-4b56-b936-e160d33a06cc" returned: 0 in 0.480s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:34:57 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-e55761fb-01f5-4e9f-b417-f0fca06c1c75 tempest-AttachVolumeNegativeTest-1279867800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c1a9406e-9b9f-4b56-b936-e160d33a06cc {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:34:57 devstack sudo[98134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c1a9406e-9b9f-4b56-b936-e160d33a06cc Aug 03 08:34:57 devstack sudo[98134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:34:58 devstack sudo[98134]: pam_unix(sudo:session): session closed for user root Aug 03 08:34:58 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-e55761fb-01f5-4e9f-b417-f0fca06c1c75 tempest-AttachVolumeNegativeTest-1279867800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c1a9406e-9b9f-4b56-b936-e160d33a06cc" returned: 0 in 0.313s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:34:58 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-e55761fb-01f5-4e9f-b417-f0fca06c1c75 tempest-AttachVolumeNegativeTest-1279867800 None] Lock "cinder-quobyte-c1a9406e-9b9f-4b56-b936-e160d33a06cc" released by "delete_volume" :: held 0.857s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:34:58 devstack cinder-volume[88899]: DEBUG cinder.quota [None req-e55761fb-01f5-4e9f-b417-f0fca06c1c75 tempest-AttachVolumeNegativeTest-1279867800 None] Created reservations ['1a20aad5-6748-4be5-9139-734c8ee68246', 'e9f5ba43-52a3-47cc-8515-f053f2cdf7cd', '11032c83-06f2-425a-b727-cd851c3649f4', '8d5177b9-3fcd-4564-9afc-5fb47580ef27'] {{(pid=88899) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 08:34:58 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-e55761fb-01f5-4e9f-b417-f0fca06c1c75 tempest-AttachVolumeNegativeTest-1279867800 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:34:58 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-e55761fb-01f5-4e9f-b417-f0fca06c1c75 tempest-AttachVolumeNegativeTest-1279867800 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:34:58 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-e55761fb-01f5-4e9f-b417-f0fca06c1c75 tempest-AttachVolumeNegativeTest-1279867800 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:34:58 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-e55761fb-01f5-4e9f-b417-f0fca06c1c75 tempest-AttachVolumeNegativeTest-1279867800 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:34:58 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-e55761fb-01f5-4e9f-b417-f0fca06c1c75 tempest-AttachVolumeNegativeTest-1279867800 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:34:58 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-e55761fb-01f5-4e9f-b417-f0fca06c1c75 tempest-AttachVolumeNegativeTest-1279867800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:34:58 devstack sudo[98137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a Aug 03 08:34:58 devstack sudo[98137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:34:58 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-52029006-2ceb-4e28-b20a-11df537fe462 tempest-AttachVolumeNegativeTest-1279867800 None] Acquiring lock "cinder-dfde963c-eaa2-46fd-a80f-4ddd0e14011c-delete_volume" by "delete_volume" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:34:58 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-52029006-2ceb-4e28-b20a-11df537fe462 tempest-AttachVolumeNegativeTest-1279867800 None] Lock "cinder-dfde963c-eaa2-46fd-a80f-4ddd0e14011c-delete_volume" acquired by "delete_volume" :: waited 0.063s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:34:58 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-52029006-2ceb-4e28-b20a-11df537fe462 tempest-AttachVolumeNegativeTest-1279867800 None] Acquiring lock "cinder-quobyte-dfde963c-eaa2-46fd-a80f-4ddd0e14011c" by "delete_volume" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:34:58 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-52029006-2ceb-4e28-b20a-11df537fe462 tempest-AttachVolumeNegativeTest-1279867800 None] Lock "cinder-quobyte-dfde963c-eaa2-46fd-a80f-4ddd0e14011c" acquired by "delete_volume" :: waited 0.026s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:34:58 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[876f870f-1287-4a21-b1b4-9fde5304baa7]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:34:58 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-52029006-2ceb-4e28-b20a-11df537fe462 tempest-AttachVolumeNegativeTest-1279867800 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-dfde963c-eaa2-46fd-a80f-4ddd0e14011c {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:34:59 devstack sudo[98137]: pam_unix(sudo:session): session closed for user root Aug 03 08:34:59 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-e55761fb-01f5-4e9f-b417-f0fca06c1c75 tempest-AttachVolumeNegativeTest-1279867800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a" returned: 0 in 0.635s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:34:59 devstack cinder-volume[88899]: DEBUG cinder.manager [None req-e55761fb-01f5-4e9f-b417-f0fca06c1c75 tempest-AttachVolumeNegativeTest-1279867800 None] Notifying Schedulers of capabilities ... {{(pid=88899) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 08:34:59 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-e55761fb-01f5-4e9f-b417-f0fca06c1c75 tempest-AttachVolumeNegativeTest-1279867800 None] Deleted volume successfully. Aug 03 08:34:59 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-e55761fb-01f5-4e9f-b417-f0fca06c1c75 tempest-AttachVolumeNegativeTest-1279867800 None] Lock "cinder-c1a9406e-9b9f-4b56-b936-e160d33a06cc-delete_volume" released by "delete_volume" :: held 1.940s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:34:59 devstack sudo[98139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-dfde963c-eaa2-46fd-a80f-4ddd0e14011c Aug 03 08:34:59 devstack sudo[98139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:34:59 devstack sudo[98139]: pam_unix(sudo:session): session closed for user root Aug 03 08:34:59 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-52029006-2ceb-4e28-b20a-11df537fe462 tempest-AttachVolumeNegativeTest-1279867800 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-dfde963c-eaa2-46fd-a80f-4ddd0e14011c" returned: 0 in 0.605s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:34:59 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-52029006-2ceb-4e28-b20a-11df537fe462 tempest-AttachVolumeNegativeTest-1279867800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-dfde963c-eaa2-46fd-a80f-4ddd0e14011c {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:34:59 devstack sudo[98172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-dfde963c-eaa2-46fd-a80f-4ddd0e14011c Aug 03 08:34:59 devstack sudo[98172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:34:59 devstack sudo[98172]: pam_unix(sudo:session): session closed for user root Aug 03 08:34:59 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-52029006-2ceb-4e28-b20a-11df537fe462 tempest-AttachVolumeNegativeTest-1279867800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-dfde963c-eaa2-46fd-a80f-4ddd0e14011c" returned: 0 in 0.304s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:34:59 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-52029006-2ceb-4e28-b20a-11df537fe462 tempest-AttachVolumeNegativeTest-1279867800 None] Lock "cinder-quobyte-dfde963c-eaa2-46fd-a80f-4ddd0e14011c" released by "delete_volume" :: held 0.986s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:34:59 devstack cinder-volume[88899]: DEBUG cinder.quota [None req-52029006-2ceb-4e28-b20a-11df537fe462 tempest-AttachVolumeNegativeTest-1279867800 None] Created reservations ['56624096-cc1a-4d1d-972b-7f98499b5fc4', 'ddf591ac-ca88-4e8e-a565-8551974727f8', 'c8512455-ba5e-4130-b11b-b2fdb75cc934', '2a990863-0a35-442d-bdbd-09bbdc5da5ec'] {{(pid=88899) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 08:35:00 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-52029006-2ceb-4e28-b20a-11df537fe462 tempest-AttachVolumeNegativeTest-1279867800 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:35:00 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-52029006-2ceb-4e28-b20a-11df537fe462 tempest-AttachVolumeNegativeTest-1279867800 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:35:00 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-52029006-2ceb-4e28-b20a-11df537fe462 tempest-AttachVolumeNegativeTest-1279867800 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:35:00 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-52029006-2ceb-4e28-b20a-11df537fe462 tempest-AttachVolumeNegativeTest-1279867800 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:35:00 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-52029006-2ceb-4e28-b20a-11df537fe462 tempest-AttachVolumeNegativeTest-1279867800 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:35:00 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-52029006-2ceb-4e28-b20a-11df537fe462 tempest-AttachVolumeNegativeTest-1279867800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:35:00 devstack sudo[98179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a Aug 03 08:35:00 devstack sudo[98179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:35:00 devstack sudo[98179]: pam_unix(sudo:session): session closed for user root Aug 03 08:35:00 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-52029006-2ceb-4e28-b20a-11df537fe462 tempest-AttachVolumeNegativeTest-1279867800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a" returned: 0 in 0.276s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:35:00 devstack cinder-volume[88899]: DEBUG cinder.manager [None req-52029006-2ceb-4e28-b20a-11df537fe462 tempest-AttachVolumeNegativeTest-1279867800 None] Notifying Schedulers of capabilities ... {{(pid=88899) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 08:35:00 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-52029006-2ceb-4e28-b20a-11df537fe462 tempest-AttachVolumeNegativeTest-1279867800 None] Deleted volume successfully. Aug 03 08:35:00 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-52029006-2ceb-4e28-b20a-11df537fe462 tempest-AttachVolumeNegativeTest-1279867800 None] Lock "cinder-dfde963c-eaa2-46fd-a80f-4ddd0e14011c-delete_volume" released by "delete_volume" :: held 1.601s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:35:01 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-e514c25a-4ea9-48de-ba1f-5d0b03ea70e0 tempest-AttachVolumeNegativeTest-1279867800 None] Acquiring lock "cinder-11b89d28-fc04-4ac0-a715-dc24cec72734-delete_volume" by "delete_volume" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:35:01 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-e514c25a-4ea9-48de-ba1f-5d0b03ea70e0 tempest-AttachVolumeNegativeTest-1279867800 None] Lock "cinder-11b89d28-fc04-4ac0-a715-dc24cec72734-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:35:01 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-e514c25a-4ea9-48de-ba1f-5d0b03ea70e0 tempest-AttachVolumeNegativeTest-1279867800 None] Acquiring lock "cinder-quobyte-11b89d28-fc04-4ac0-a715-dc24cec72734" by "delete_volume" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:35:01 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-e514c25a-4ea9-48de-ba1f-5d0b03ea70e0 tempest-AttachVolumeNegativeTest-1279867800 None] Lock "cinder-quobyte-11b89d28-fc04-4ac0-a715-dc24cec72734" acquired by "delete_volume" :: waited 0.013s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:35:01 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[db86a38b-ad32-4075-86fc-1e1f1d203d0a]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:35:01 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-e514c25a-4ea9-48de-ba1f-5d0b03ea70e0 tempest-AttachVolumeNegativeTest-1279867800 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-11b89d28-fc04-4ac0-a715-dc24cec72734 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:35:01 devstack sudo[98182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-11b89d28-fc04-4ac0-a715-dc24cec72734 Aug 03 08:35:01 devstack sudo[98182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:35:01 devstack sudo[98182]: pam_unix(sudo:session): session closed for user root Aug 03 08:35:01 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-e514c25a-4ea9-48de-ba1f-5d0b03ea70e0 tempest-AttachVolumeNegativeTest-1279867800 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-11b89d28-fc04-4ac0-a715-dc24cec72734" returned: 0 in 0.412s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:35:01 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-e514c25a-4ea9-48de-ba1f-5d0b03ea70e0 tempest-AttachVolumeNegativeTest-1279867800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-11b89d28-fc04-4ac0-a715-dc24cec72734 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:35:01 devstack sudo[98190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-11b89d28-fc04-4ac0-a715-dc24cec72734 Aug 03 08:35:01 devstack sudo[98190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:35:02 devstack sudo[98190]: pam_unix(sudo:session): session closed for user root Aug 03 08:35:02 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-e514c25a-4ea9-48de-ba1f-5d0b03ea70e0 tempest-AttachVolumeNegativeTest-1279867800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-11b89d28-fc04-4ac0-a715-dc24cec72734" returned: 0 in 0.241s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:35:02 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-e514c25a-4ea9-48de-ba1f-5d0b03ea70e0 tempest-AttachVolumeNegativeTest-1279867800 None] Lock "cinder-quobyte-11b89d28-fc04-4ac0-a715-dc24cec72734" released by "delete_volume" :: held 0.702s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:35:02 devstack cinder-volume[88899]: DEBUG cinder.quota [None req-e514c25a-4ea9-48de-ba1f-5d0b03ea70e0 tempest-AttachVolumeNegativeTest-1279867800 None] Created reservations ['c2f4fed9-ec99-48ed-be98-60c338b83b5e', 'ff0a25fc-19fe-47c1-a915-66e0af2b7ef7', '2615d471-5b6e-4bd4-90c2-f649248ee090', 'e77625d3-7dde-4822-84f3-478f2f10aa47'] {{(pid=88899) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 08:35:02 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-e514c25a-4ea9-48de-ba1f-5d0b03ea70e0 tempest-AttachVolumeNegativeTest-1279867800 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:35:02 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-e514c25a-4ea9-48de-ba1f-5d0b03ea70e0 tempest-AttachVolumeNegativeTest-1279867800 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:35:02 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-e514c25a-4ea9-48de-ba1f-5d0b03ea70e0 tempest-AttachVolumeNegativeTest-1279867800 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:35:02 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-e514c25a-4ea9-48de-ba1f-5d0b03ea70e0 tempest-AttachVolumeNegativeTest-1279867800 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:35:02 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-e514c25a-4ea9-48de-ba1f-5d0b03ea70e0 tempest-AttachVolumeNegativeTest-1279867800 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:35:02 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-e514c25a-4ea9-48de-ba1f-5d0b03ea70e0 tempest-AttachVolumeNegativeTest-1279867800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:35:02 devstack sudo[98193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a Aug 03 08:35:02 devstack sudo[98193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:35:02 devstack sudo[98193]: pam_unix(sudo:session): session closed for user root Aug 03 08:35:02 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-e514c25a-4ea9-48de-ba1f-5d0b03ea70e0 tempest-AttachVolumeNegativeTest-1279867800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a" returned: 0 in 0.254s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:35:02 devstack cinder-volume[88899]: DEBUG cinder.manager [None req-e514c25a-4ea9-48de-ba1f-5d0b03ea70e0 tempest-AttachVolumeNegativeTest-1279867800 None] Notifying Schedulers of capabilities ... {{(pid=88899) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 08:35:02 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-e514c25a-4ea9-48de-ba1f-5d0b03ea70e0 tempest-AttachVolumeNegativeTest-1279867800 None] Deleted volume successfully. Aug 03 08:35:02 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-e514c25a-4ea9-48de-ba1f-5d0b03ea70e0 tempest-AttachVolumeNegativeTest-1279867800 None] Lock "cinder-11b89d28-fc04-4ac0-a715-dc24cec72734-delete_volume" released by "delete_volume" :: held 1.182s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:35:05 devstack cinder-volume[88899]: DEBUG cinder.volume.flows.manager.create_volume [None req-b1387304-2bfa-4fff-b7f5-e15cfd2ff766 tempest-VolumeQuotasAdminTestJSON-899294622 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88899) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 08:35:05 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-b1387304-2bfa-4fff-b7f5-e15cfd2ff766 tempest-VolumeQuotasAdminTestJSON-899294622 None] Flow 'volume_create_manager' (5e89cf61-6f74-4562-933c-15fb904ffb9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:35:05 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-b1387304-2bfa-4fff-b7f5-e15cfd2ff766 tempest-VolumeQuotasAdminTestJSON-899294622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (095d72fa-854f-4338-8935-72760c408445) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:35:05 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-b1387304-2bfa-4fff-b7f5-e15cfd2ff766 tempest-VolumeQuotasAdminTestJSON-899294622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (095d72fa-854f-4338-8935-72760c408445) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:35:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-773864563',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a67f70a-9fa1-453d-8c08-7b271a494f3f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='04409111b21d477193302b4943ff5ab7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:35:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:35:06Z,use_quota=True,user_id='5918ab70743e4ebcbf7540cb1a34cb12',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8bde7129-1dc4-42ab-b852-ab32c61b4921),volume_type_id=8bde7129-1dc4-42ab-b852-ab32c61b4921)' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:35:05 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-b1387304-2bfa-4fff-b7f5-e15cfd2ff766 tempest-VolumeQuotasAdminTestJSON-899294622 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1c5238d-b270-43be-931d-714a30f18dfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:35:05 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-b1387304-2bfa-4fff-b7f5-e15cfd2ff766 tempest-VolumeQuotasAdminTestJSON-899294622 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1c5238d-b270-43be-931d-714a30f18dfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:35:05 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-b1387304-2bfa-4fff-b7f5-e15cfd2ff766 tempest-VolumeQuotasAdminTestJSON-899294622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7131e51-7378-4499-8bdb-7f1d9f53d357) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:35:05 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-b1387304-2bfa-4fff-b7f5-e15cfd2ff766 tempest-VolumeQuotasAdminTestJSON-899294622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7131e51-7378-4499-8bdb-7f1d9f53d357) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4a67f70a-9fa1-453d-8c08-7b271a494f3f', 'volume_name': 'volume-4a67f70a-9fa1-453d-8c08-7b271a494f3f', 'volume_size': 1}' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:35:05 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-b1387304-2bfa-4fff-b7f5-e15cfd2ff766 tempest-VolumeQuotasAdminTestJSON-899294622 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25bcf426-28ed-4735-ad76-d6f56a2982d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:35:05 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-b1387304-2bfa-4fff-b7f5-e15cfd2ff766 tempest-VolumeQuotasAdminTestJSON-899294622 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25bcf426-28ed-4735-ad76-d6f56a2982d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:35:05 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-b1387304-2bfa-4fff-b7f5-e15cfd2ff766 tempest-VolumeQuotasAdminTestJSON-899294622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (905275df-d19c-47c1-a28c-563185f36ad6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:35:05 devstack cinder-volume[88899]: INFO cinder.volume.flows.manager.create_volume [None req-b1387304-2bfa-4fff-b7f5-e15cfd2ff766 tempest-VolumeQuotasAdminTestJSON-899294622 None] Volume 4a67f70a-9fa1-453d-8c08-7b271a494f3f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4a67f70a-9fa1-453d-8c08-7b271a494f3f', 'volume_size': 1} Aug 03 08:35:05 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-b1387304-2bfa-4fff-b7f5-e15cfd2ff766 tempest-VolumeQuotasAdminTestJSON-899294622 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:35:05 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-b1387304-2bfa-4fff-b7f5-e15cfd2ff766 tempest-VolumeQuotasAdminTestJSON-899294622 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:35:05 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-b1387304-2bfa-4fff-b7f5-e15cfd2ff766 tempest-VolumeQuotasAdminTestJSON-899294622 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:35:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-773864563',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a67f70a-9fa1-453d-8c08-7b271a494f3f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='04409111b21d477193302b4943ff5ab7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:35:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:35:06Z,use_quota=True,user_id='5918ab70743e4ebcbf7540cb1a34cb12',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8bde7129-1dc4-42ab-b852-ab32c61b4921),volume_type_id=8bde7129-1dc4-42ab-b852-ab32c61b4921)}" {{(pid=88899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 08:35:05 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-b1387304-2bfa-4fff-b7f5-e15cfd2ff766 tempest-VolumeQuotasAdminTestJSON-899294622 None] Creating volume 4a67f70a-9fa1-453d-8c08-7b271a494f3f {{(pid=88899) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 08:35:05 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-b1387304-2bfa-4fff-b7f5-e15cfd2ff766 tempest-VolumeQuotasAdminTestJSON-899294622 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:35:05 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-b1387304-2bfa-4fff-b7f5-e15cfd2ff766 tempest-VolumeQuotasAdminTestJSON-899294622 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:35:05 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-b1387304-2bfa-4fff-b7f5-e15cfd2ff766 tempest-VolumeQuotasAdminTestJSON-899294622 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:35:05 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-b1387304-2bfa-4fff-b7f5-e15cfd2ff766 tempest-VolumeQuotasAdminTestJSON-899294622 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:35:05 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-b1387304-2bfa-4fff-b7f5-e15cfd2ff766 tempest-VolumeQuotasAdminTestJSON-899294622 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:35:05 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-b1387304-2bfa-4fff-b7f5-e15cfd2ff766 tempest-VolumeQuotasAdminTestJSON-899294622 None] Selected osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385 as target Quobyte volume. {{(pid=88899) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 08:35:05 devstack cinder-volume[88899]: INFO cinder.volume.drivers.remotefs [None req-b1387304-2bfa-4fff-b7f5-e15cfd2ff766 tempest-VolumeQuotasAdminTestJSON-899294622 None] casted to osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385 Aug 03 08:35:05 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-b1387304-2bfa-4fff-b7f5-e15cfd2ff766 tempest-VolumeQuotasAdminTestJSON-899294622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-4a67f70a-9fa1-453d-8c08-7b271a494f3f 1073741824 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:35:05 devstack sudo[98198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-4a67f70a-9fa1-453d-8c08-7b271a494f3f 1073741824 Aug 03 08:35:05 devstack sudo[98198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:35:06 devstack sudo[98198]: pam_unix(sudo:session): session closed for user root Aug 03 08:35:06 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-b1387304-2bfa-4fff-b7f5-e15cfd2ff766 tempest-VolumeQuotasAdminTestJSON-899294622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-4a67f70a-9fa1-453d-8c08-7b271a494f3f 1073741824" returned: 0 in 0.492s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:35:06 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-b1387304-2bfa-4fff-b7f5-e15cfd2ff766 tempest-VolumeQuotasAdminTestJSON-899294622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-4a67f70a-9fa1-453d-8c08-7b271a494f3f {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:35:06 devstack sudo[98205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-4a67f70a-9fa1-453d-8c08-7b271a494f3f Aug 03 08:35:06 devstack sudo[98205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:35:06 devstack sudo[98205]: pam_unix(sudo:session): session closed for user root Aug 03 08:35:06 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-b1387304-2bfa-4fff-b7f5-e15cfd2ff766 tempest-VolumeQuotasAdminTestJSON-899294622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-4a67f70a-9fa1-453d-8c08-7b271a494f3f" returned: 0 in 0.275s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:35:06 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-b1387304-2bfa-4fff-b7f5-e15cfd2ff766 tempest-VolumeQuotasAdminTestJSON-899294622 None] <== create_volume: return (823ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'} {{(pid=88899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 08:35:06 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-b1387304-2bfa-4fff-b7f5-e15cfd2ff766 tempest-VolumeQuotasAdminTestJSON-899294622 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.825s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:35:06 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-b1387304-2bfa-4fff-b7f5-e15cfd2ff766 tempest-VolumeQuotasAdminTestJSON-899294622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (905275df-d19c-47c1-a28c-563185f36ad6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4a67f70a-9fa1-453d-8c08-7b271a494f3f', 'volume_size': 1}' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:35:06 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-b1387304-2bfa-4fff-b7f5-e15cfd2ff766 tempest-VolumeQuotasAdminTestJSON-899294622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b0b3157-15b2-4c03-960c-696f3712fc63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:35:06 devstack cinder-volume[88899]: INFO cinder.volume.flows.manager.create_volume [None req-b1387304-2bfa-4fff-b7f5-e15cfd2ff766 tempest-VolumeQuotasAdminTestJSON-899294622 None] Volume volume-4a67f70a-9fa1-453d-8c08-7b271a494f3f (4a67f70a-9fa1-453d-8c08-7b271a494f3f): created successfully Aug 03 08:35:06 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-b1387304-2bfa-4fff-b7f5-e15cfd2ff766 tempest-VolumeQuotasAdminTestJSON-899294622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b0b3157-15b2-4c03-960c-696f3712fc63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:35:06 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-b1387304-2bfa-4fff-b7f5-e15cfd2ff766 tempest-VolumeQuotasAdminTestJSON-899294622 None] Flow 'volume_create_manager' (5e89cf61-6f74-4562-933c-15fb904ffb9a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:35:06 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-b1387304-2bfa-4fff-b7f5-e15cfd2ff766 tempest-VolumeQuotasAdminTestJSON-899294622 None] Created volume successfully. Aug 03 08:35:07 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-21a7a163-79b2-498c-b34d-39f57f34ac97 tempest-VolumeQuotasAdminTestJSON-899294622 None] Acquiring lock "cinder-4a67f70a-9fa1-453d-8c08-7b271a494f3f-delete_volume" by "delete_volume" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:35:07 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-21a7a163-79b2-498c-b34d-39f57f34ac97 tempest-VolumeQuotasAdminTestJSON-899294622 None] Lock "cinder-4a67f70a-9fa1-453d-8c08-7b271a494f3f-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:35:08 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-21a7a163-79b2-498c-b34d-39f57f34ac97 tempest-VolumeQuotasAdminTestJSON-899294622 None] Acquiring lock "cinder-quobyte-4a67f70a-9fa1-453d-8c08-7b271a494f3f" by "delete_volume" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:35:08 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-21a7a163-79b2-498c-b34d-39f57f34ac97 tempest-VolumeQuotasAdminTestJSON-899294622 None] Lock "cinder-quobyte-4a67f70a-9fa1-453d-8c08-7b271a494f3f" acquired by "delete_volume" :: waited 0.030s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:35:08 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb160946-3b90-4a2b-8550-12004bc9eb29]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:35:08 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-21a7a163-79b2-498c-b34d-39f57f34ac97 tempest-VolumeQuotasAdminTestJSON-899294622 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-4a67f70a-9fa1-453d-8c08-7b271a494f3f {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:35:08 devstack sudo[98209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-4a67f70a-9fa1-453d-8c08-7b271a494f3f Aug 03 08:35:08 devstack sudo[98209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:35:08 devstack sudo[98209]: pam_unix(sudo:session): session closed for user root Aug 03 08:35:08 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-21a7a163-79b2-498c-b34d-39f57f34ac97 tempest-VolumeQuotasAdminTestJSON-899294622 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-4a67f70a-9fa1-453d-8c08-7b271a494f3f" returned: 0 in 0.425s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:35:08 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-21a7a163-79b2-498c-b34d-39f57f34ac97 tempest-VolumeQuotasAdminTestJSON-899294622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-4a67f70a-9fa1-453d-8c08-7b271a494f3f {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:35:08 devstack sudo[98214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-4a67f70a-9fa1-453d-8c08-7b271a494f3f Aug 03 08:35:08 devstack sudo[98214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:35:08 devstack sudo[98214]: pam_unix(sudo:session): session closed for user root Aug 03 08:35:08 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-21a7a163-79b2-498c-b34d-39f57f34ac97 tempest-VolumeQuotasAdminTestJSON-899294622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-4a67f70a-9fa1-453d-8c08-7b271a494f3f" returned: 0 in 0.281s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:35:08 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-21a7a163-79b2-498c-b34d-39f57f34ac97 tempest-VolumeQuotasAdminTestJSON-899294622 None] Lock "cinder-quobyte-4a67f70a-9fa1-453d-8c08-7b271a494f3f" released by "delete_volume" :: held 0.766s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:35:08 devstack cinder-volume[88899]: DEBUG cinder.quota [None req-21a7a163-79b2-498c-b34d-39f57f34ac97 tempest-VolumeQuotasAdminTestJSON-899294622 None] Created reservations ['aa26cb5b-2920-4d22-b60e-d7496cd1bbbf', 'ae1dc995-66d9-4066-8cca-8d120298391c', '07333740-0877-4137-8000-e1e3847002d1', '5b8c5a46-6b18-4fd9-91de-dd9029c0f259'] {{(pid=88899) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 08:35:08 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-21a7a163-79b2-498c-b34d-39f57f34ac97 tempest-VolumeQuotasAdminTestJSON-899294622 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:35:08 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-21a7a163-79b2-498c-b34d-39f57f34ac97 tempest-VolumeQuotasAdminTestJSON-899294622 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:35:08 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-21a7a163-79b2-498c-b34d-39f57f34ac97 tempest-VolumeQuotasAdminTestJSON-899294622 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:35:08 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-21a7a163-79b2-498c-b34d-39f57f34ac97 tempest-VolumeQuotasAdminTestJSON-899294622 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:35:08 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-21a7a163-79b2-498c-b34d-39f57f34ac97 tempest-VolumeQuotasAdminTestJSON-899294622 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:35:08 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-21a7a163-79b2-498c-b34d-39f57f34ac97 tempest-VolumeQuotasAdminTestJSON-899294622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:35:09 devstack sudo[98217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a Aug 03 08:35:09 devstack sudo[98217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:35:09 devstack sudo[98217]: pam_unix(sudo:session): session closed for user root Aug 03 08:35:09 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-21a7a163-79b2-498c-b34d-39f57f34ac97 tempest-VolumeQuotasAdminTestJSON-899294622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a" returned: 0 in 0.487s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:35:09 devstack cinder-volume[88899]: DEBUG cinder.manager [None req-21a7a163-79b2-498c-b34d-39f57f34ac97 tempest-VolumeQuotasAdminTestJSON-899294622 None] Notifying Schedulers of capabilities ... {{(pid=88899) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 08:35:09 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-21a7a163-79b2-498c-b34d-39f57f34ac97 tempest-VolumeQuotasAdminTestJSON-899294622 None] Deleted volume successfully. Aug 03 08:35:09 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-21a7a163-79b2-498c-b34d-39f57f34ac97 tempest-VolumeQuotasAdminTestJSON-899294622 None] Lock "cinder-4a67f70a-9fa1-453d-8c08-7b271a494f3f-delete_volume" released by "delete_volume" :: held 1.553s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:35:10 devstack cinder-volume[88899]: DEBUG cinder.volume.flows.manager.create_volume [None req-ba1a27fb-7cdc-4abe-9016-9af3fb2ab6f6 tempest-VolumeQuotasAdminTestJSON-899294622 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88899) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 08:35:10 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-ba1a27fb-7cdc-4abe-9016-9af3fb2ab6f6 tempest-VolumeQuotasAdminTestJSON-899294622 None] Flow 'volume_create_manager' (cf0c2d32-dd8c-48d1-b8a2-e1ad46e50399) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:35:10 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-ba1a27fb-7cdc-4abe-9016-9af3fb2ab6f6 tempest-VolumeQuotasAdminTestJSON-899294622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de034237-d96f-4e3b-9427-fb619112d352) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:35:10 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-ba1a27fb-7cdc-4abe-9016-9af3fb2ab6f6 tempest-VolumeQuotasAdminTestJSON-899294622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de034237-d96f-4e3b-9427-fb619112d352) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:35:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1803860993',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=215afdcd-322e-4969-b378-e81e184d587a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='04409111b21d477193302b4943ff5ab7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:35:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:35:10Z,use_quota=True,user_id='5918ab70743e4ebcbf7540cb1a34cb12',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8bde7129-1dc4-42ab-b852-ab32c61b4921),volume_type_id=8bde7129-1dc4-42ab-b852-ab32c61b4921)' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:35:10 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-ba1a27fb-7cdc-4abe-9016-9af3fb2ab6f6 tempest-VolumeQuotasAdminTestJSON-899294622 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3b30fa7-b5e0-4d0f-87d5-985835c6a646) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:35:10 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-ba1a27fb-7cdc-4abe-9016-9af3fb2ab6f6 tempest-VolumeQuotasAdminTestJSON-899294622 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3b30fa7-b5e0-4d0f-87d5-985835c6a646) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:35:10 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-ba1a27fb-7cdc-4abe-9016-9af3fb2ab6f6 tempest-VolumeQuotasAdminTestJSON-899294622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (352e2406-ff67-477c-9289-da309a8b5366) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:35:10 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-ba1a27fb-7cdc-4abe-9016-9af3fb2ab6f6 tempest-VolumeQuotasAdminTestJSON-899294622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (352e2406-ff67-477c-9289-da309a8b5366) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '215afdcd-322e-4969-b378-e81e184d587a', 'volume_name': 'volume-215afdcd-322e-4969-b378-e81e184d587a', 'volume_size': 1}' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:35:10 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-ba1a27fb-7cdc-4abe-9016-9af3fb2ab6f6 tempest-VolumeQuotasAdminTestJSON-899294622 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (baabf755-1cea-440a-a576-3705c9239358) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:35:10 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-ba1a27fb-7cdc-4abe-9016-9af3fb2ab6f6 tempest-VolumeQuotasAdminTestJSON-899294622 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (baabf755-1cea-440a-a576-3705c9239358) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:35:10 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-ba1a27fb-7cdc-4abe-9016-9af3fb2ab6f6 tempest-VolumeQuotasAdminTestJSON-899294622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0058c3b2-be1f-428b-8206-14b316d95627) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:35:10 devstack cinder-volume[88899]: INFO cinder.volume.flows.manager.create_volume [None req-ba1a27fb-7cdc-4abe-9016-9af3fb2ab6f6 tempest-VolumeQuotasAdminTestJSON-899294622 None] Volume 215afdcd-322e-4969-b378-e81e184d587a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-215afdcd-322e-4969-b378-e81e184d587a', 'volume_size': 1} Aug 03 08:35:10 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-ba1a27fb-7cdc-4abe-9016-9af3fb2ab6f6 tempest-VolumeQuotasAdminTestJSON-899294622 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:35:10 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-ba1a27fb-7cdc-4abe-9016-9af3fb2ab6f6 tempest-VolumeQuotasAdminTestJSON-899294622 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:35:10 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-ba1a27fb-7cdc-4abe-9016-9af3fb2ab6f6 tempest-VolumeQuotasAdminTestJSON-899294622 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:35:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1803860993',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=215afdcd-322e-4969-b378-e81e184d587a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='04409111b21d477193302b4943ff5ab7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:35:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:35:10Z,use_quota=True,user_id='5918ab70743e4ebcbf7540cb1a34cb12',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8bde7129-1dc4-42ab-b852-ab32c61b4921),volume_type_id=8bde7129-1dc4-42ab-b852-ab32c61b4921)}" {{(pid=88899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 08:35:10 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-ba1a27fb-7cdc-4abe-9016-9af3fb2ab6f6 tempest-VolumeQuotasAdminTestJSON-899294622 None] Creating volume 215afdcd-322e-4969-b378-e81e184d587a {{(pid=88899) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 08:35:10 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-ba1a27fb-7cdc-4abe-9016-9af3fb2ab6f6 tempest-VolumeQuotasAdminTestJSON-899294622 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:35:10 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-ba1a27fb-7cdc-4abe-9016-9af3fb2ab6f6 tempest-VolumeQuotasAdminTestJSON-899294622 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:35:10 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-ba1a27fb-7cdc-4abe-9016-9af3fb2ab6f6 tempest-VolumeQuotasAdminTestJSON-899294622 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:35:10 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-ba1a27fb-7cdc-4abe-9016-9af3fb2ab6f6 tempest-VolumeQuotasAdminTestJSON-899294622 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:35:10 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-ba1a27fb-7cdc-4abe-9016-9af3fb2ab6f6 tempest-VolumeQuotasAdminTestJSON-899294622 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:35:10 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-ba1a27fb-7cdc-4abe-9016-9af3fb2ab6f6 tempest-VolumeQuotasAdminTestJSON-899294622 None] Selected osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385 as target Quobyte volume. {{(pid=88899) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 08:35:10 devstack cinder-volume[88899]: INFO cinder.volume.drivers.remotefs [None req-ba1a27fb-7cdc-4abe-9016-9af3fb2ab6f6 tempest-VolumeQuotasAdminTestJSON-899294622 None] casted to osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385 Aug 03 08:35:10 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-ba1a27fb-7cdc-4abe-9016-9af3fb2ab6f6 tempest-VolumeQuotasAdminTestJSON-899294622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-215afdcd-322e-4969-b378-e81e184d587a 1073741824 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:35:10 devstack cinder-volume[88899]: DEBUG cinder.volume.flows.manager.create_volume [req-a3affb76-babb-43e0-ae71-9a8937b9a699 req-480943a6-f1e5-49bc-8712-8c1e860edb06 tempest-VolumesGetTestJSON-23798790 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88899) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 08:35:10 devstack sudo[98246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-215afdcd-322e-4969-b378-e81e184d587a 1073741824 Aug 03 08:35:10 devstack sudo[98246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:35:10 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [req-a3affb76-babb-43e0-ae71-9a8937b9a699 req-480943a6-f1e5-49bc-8712-8c1e860edb06 tempest-VolumesGetTestJSON-23798790 None] Flow 'volume_create_manager' (73b3a6ab-2162-4f35-b7f3-036ea40d83e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:35:10 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [req-a3affb76-babb-43e0-ae71-9a8937b9a699 req-480943a6-f1e5-49bc-8712-8c1e860edb06 tempest-VolumesGetTestJSON-23798790 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab52f02d-1ad4-4061-8343-80c3e3493757) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:35:10 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [req-a3affb76-babb-43e0-ae71-9a8937b9a699 req-480943a6-f1e5-49bc-8712-8c1e860edb06 tempest-VolumesGetTestJSON-23798790 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab52f02d-1ad4-4061-8343-80c3e3493757) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:35:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1072553466',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ce3d6e0-c36b-4e53-9375-ecb9ea309c87,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b6117def5a0d4022899564d5322ca065',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:35:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:35:10Z,use_quota=True,user_id='895ff4afa3ba4b968798bda81aba9e30',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8bde7129-1dc4-42ab-b852-ab32c61b4921),volume_type_id=8bde7129-1dc4-42ab-b852-ab32c61b4921)' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:35:10 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [req-a3affb76-babb-43e0-ae71-9a8937b9a699 req-480943a6-f1e5-49bc-8712-8c1e860edb06 tempest-VolumesGetTestJSON-23798790 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (161f6f0a-f598-4234-8cd1-415e8b16918c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:35:10 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [req-a3affb76-babb-43e0-ae71-9a8937b9a699 req-480943a6-f1e5-49bc-8712-8c1e860edb06 tempest-VolumesGetTestJSON-23798790 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (161f6f0a-f598-4234-8cd1-415e8b16918c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:35:10 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [req-a3affb76-babb-43e0-ae71-9a8937b9a699 req-480943a6-f1e5-49bc-8712-8c1e860edb06 tempest-VolumesGetTestJSON-23798790 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34788f5f-519d-43f3-aacb-aa17434622c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:35:10 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [req-a3affb76-babb-43e0-ae71-9a8937b9a699 req-480943a6-f1e5-49bc-8712-8c1e860edb06 tempest-VolumesGetTestJSON-23798790 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34788f5f-519d-43f3-aacb-aa17434622c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9ce3d6e0-c36b-4e53-9375-ecb9ea309c87', 'volume_name': 'volume-9ce3d6e0-c36b-4e53-9375-ecb9ea309c87', 'volume_size': 1}' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:35:10 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [req-a3affb76-babb-43e0-ae71-9a8937b9a699 req-480943a6-f1e5-49bc-8712-8c1e860edb06 tempest-VolumesGetTestJSON-23798790 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b8ce47ca-c5e9-438a-8753-8befef2c04fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:35:10 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [req-a3affb76-babb-43e0-ae71-9a8937b9a699 req-480943a6-f1e5-49bc-8712-8c1e860edb06 tempest-VolumesGetTestJSON-23798790 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b8ce47ca-c5e9-438a-8753-8befef2c04fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:35:10 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [req-a3affb76-babb-43e0-ae71-9a8937b9a699 req-480943a6-f1e5-49bc-8712-8c1e860edb06 tempest-VolumesGetTestJSON-23798790 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3dce9d8-a4b1-4703-8448-fd963eed5009) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:35:10 devstack cinder-volume[88899]: INFO cinder.volume.flows.manager.create_volume [req-a3affb76-babb-43e0-ae71-9a8937b9a699 req-480943a6-f1e5-49bc-8712-8c1e860edb06 tempest-VolumesGetTestJSON-23798790 None] Volume 9ce3d6e0-c36b-4e53-9375-ecb9ea309c87: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9ce3d6e0-c36b-4e53-9375-ecb9ea309c87', 'volume_size': 1} Aug 03 08:35:10 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [req-a3affb76-babb-43e0-ae71-9a8937b9a699 req-480943a6-f1e5-49bc-8712-8c1e860edb06 tempest-VolumesGetTestJSON-23798790 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:35:10 devstack sudo[98246]: pam_unix(sudo:session): session closed for user root Aug 03 08:35:10 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-ba1a27fb-7cdc-4abe-9016-9af3fb2ab6f6 tempest-VolumeQuotasAdminTestJSON-899294622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-215afdcd-322e-4969-b378-e81e184d587a 1073741824" returned: 0 in 0.654s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:35:11 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-ba1a27fb-7cdc-4abe-9016-9af3fb2ab6f6 tempest-VolumeQuotasAdminTestJSON-899294622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-215afdcd-322e-4969-b378-e81e184d587a {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:35:11 devstack sudo[98259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-215afdcd-322e-4969-b378-e81e184d587a Aug 03 08:35:11 devstack sudo[98259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:35:11 devstack sudo[98259]: pam_unix(sudo:session): session closed for user root Aug 03 08:35:11 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-ba1a27fb-7cdc-4abe-9016-9af3fb2ab6f6 tempest-VolumeQuotasAdminTestJSON-899294622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-215afdcd-322e-4969-b378-e81e184d587a" returned: 0 in 0.399s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:35:11 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-ba1a27fb-7cdc-4abe-9016-9af3fb2ab6f6 tempest-VolumeQuotasAdminTestJSON-899294622 None] <== create_volume: return (1120ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'} {{(pid=88899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 08:35:11 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-ba1a27fb-7cdc-4abe-9016-9af3fb2ab6f6 tempest-VolumeQuotasAdminTestJSON-899294622 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.123s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:35:11 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [req-a3affb76-babb-43e0-ae71-9a8937b9a699 req-480943a6-f1e5-49bc-8712-8c1e860edb06 tempest-VolumesGetTestJSON-23798790 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.002s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:35:11 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [req-a3affb76-babb-43e0-ae71-9a8937b9a699 req-480943a6-f1e5-49bc-8712-8c1e860edb06 tempest-VolumesGetTestJSON-23798790 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:35:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1072553466',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ce3d6e0-c36b-4e53-9375-ecb9ea309c87,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b6117def5a0d4022899564d5322ca065',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:35:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:35:10Z,use_quota=True,user_id='895ff4afa3ba4b968798bda81aba9e30',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8bde7129-1dc4-42ab-b852-ab32c61b4921),volume_type_id=8bde7129-1dc4-42ab-b852-ab32c61b4921)}" {{(pid=88899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 08:35:11 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [req-a3affb76-babb-43e0-ae71-9a8937b9a699 req-480943a6-f1e5-49bc-8712-8c1e860edb06 tempest-VolumesGetTestJSON-23798790 None] Creating volume 9ce3d6e0-c36b-4e53-9375-ecb9ea309c87 {{(pid=88899) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 08:35:11 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [req-a3affb76-babb-43e0-ae71-9a8937b9a699 req-480943a6-f1e5-49bc-8712-8c1e860edb06 tempest-VolumesGetTestJSON-23798790 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:35:11 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [req-a3affb76-babb-43e0-ae71-9a8937b9a699 req-480943a6-f1e5-49bc-8712-8c1e860edb06 tempest-VolumesGetTestJSON-23798790 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:35:11 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [req-a3affb76-babb-43e0-ae71-9a8937b9a699 req-480943a6-f1e5-49bc-8712-8c1e860edb06 tempest-VolumesGetTestJSON-23798790 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:35:11 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [req-a3affb76-babb-43e0-ae71-9a8937b9a699 req-480943a6-f1e5-49bc-8712-8c1e860edb06 tempest-VolumesGetTestJSON-23798790 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:35:11 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [req-a3affb76-babb-43e0-ae71-9a8937b9a699 req-480943a6-f1e5-49bc-8712-8c1e860edb06 tempest-VolumesGetTestJSON-23798790 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:35:11 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [req-a3affb76-babb-43e0-ae71-9a8937b9a699 req-480943a6-f1e5-49bc-8712-8c1e860edb06 tempest-VolumesGetTestJSON-23798790 None] Selected osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385 as target Quobyte volume. {{(pid=88899) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 08:35:11 devstack cinder-volume[88899]: INFO cinder.volume.drivers.remotefs [req-a3affb76-babb-43e0-ae71-9a8937b9a699 req-480943a6-f1e5-49bc-8712-8c1e860edb06 tempest-VolumesGetTestJSON-23798790 None] casted to osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385 Aug 03 08:35:11 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [req-a3affb76-babb-43e0-ae71-9a8937b9a699 req-480943a6-f1e5-49bc-8712-8c1e860edb06 tempest-VolumesGetTestJSON-23798790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-9ce3d6e0-c36b-4e53-9375-ecb9ea309c87 1073741824 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:35:11 devstack sudo[98287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-9ce3d6e0-c36b-4e53-9375-ecb9ea309c87 1073741824 Aug 03 08:35:11 devstack sudo[98287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:35:11 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-ba1a27fb-7cdc-4abe-9016-9af3fb2ab6f6 tempest-VolumeQuotasAdminTestJSON-899294622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0058c3b2-be1f-428b-8206-14b316d95627) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-215afdcd-322e-4969-b378-e81e184d587a', 'volume_size': 1}' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:35:11 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-ba1a27fb-7cdc-4abe-9016-9af3fb2ab6f6 tempest-VolumeQuotasAdminTestJSON-899294622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec5a4e17-80fc-43dc-9f92-d2ab15c047cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:35:11 devstack cinder-volume[88899]: INFO cinder.volume.flows.manager.create_volume [None req-ba1a27fb-7cdc-4abe-9016-9af3fb2ab6f6 tempest-VolumeQuotasAdminTestJSON-899294622 None] Volume volume-215afdcd-322e-4969-b378-e81e184d587a (215afdcd-322e-4969-b378-e81e184d587a): created successfully Aug 03 08:35:11 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-ba1a27fb-7cdc-4abe-9016-9af3fb2ab6f6 tempest-VolumeQuotasAdminTestJSON-899294622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec5a4e17-80fc-43dc-9f92-d2ab15c047cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:35:11 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-ba1a27fb-7cdc-4abe-9016-9af3fb2ab6f6 tempest-VolumeQuotasAdminTestJSON-899294622 None] Flow 'volume_create_manager' (cf0c2d32-dd8c-48d1-b8a2-e1ad46e50399) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:35:11 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [req-9a7408b7-e22e-49e7-9a23-cb29e9f2150d req-74cb6bc5-e361-48e3-be0d-2227d1d063e2 tempest-TestServerVolumeAttachmentScenario-1345303408 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:35:11 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-ba1a27fb-7cdc-4abe-9016-9af3fb2ab6f6 tempest-VolumeQuotasAdminTestJSON-899294622 None] Created volume successfully. Aug 03 08:35:12 devstack sudo[98287]: pam_unix(sudo:session): session closed for user root Aug 03 08:35:12 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [req-a3affb76-babb-43e0-ae71-9a8937b9a699 req-480943a6-f1e5-49bc-8712-8c1e860edb06 tempest-VolumesGetTestJSON-23798790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-9ce3d6e0-c36b-4e53-9375-ecb9ea309c87 1073741824" returned: 0 in 0.648s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:35:12 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [req-a3affb76-babb-43e0-ae71-9a8937b9a699 req-480943a6-f1e5-49bc-8712-8c1e860edb06 tempest-VolumesGetTestJSON-23798790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-9ce3d6e0-c36b-4e53-9375-ecb9ea309c87 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:35:12 devstack sudo[98300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-9ce3d6e0-c36b-4e53-9375-ecb9ea309c87 Aug 03 08:35:12 devstack sudo[98300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:35:12 devstack sudo[98300]: pam_unix(sudo:session): session closed for user root Aug 03 08:35:12 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [req-a3affb76-babb-43e0-ae71-9a8937b9a699 req-480943a6-f1e5-49bc-8712-8c1e860edb06 tempest-VolumesGetTestJSON-23798790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-9ce3d6e0-c36b-4e53-9375-ecb9ea309c87" returned: 0 in 0.316s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:35:12 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [req-a3affb76-babb-43e0-ae71-9a8937b9a699 req-480943a6-f1e5-49bc-8712-8c1e860edb06 tempest-VolumesGetTestJSON-23798790 None] <== create_volume: return (1027ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'} {{(pid=88899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 08:35:12 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [req-a3affb76-babb-43e0-ae71-9a8937b9a699 req-480943a6-f1e5-49bc-8712-8c1e860edb06 tempest-VolumesGetTestJSON-23798790 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.030s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:35:12 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [req-9a7408b7-e22e-49e7-9a23-cb29e9f2150d req-74cb6bc5-e361-48e3-be0d-2227d1d063e2 tempest-TestServerVolumeAttachmentScenario-1345303408 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.867s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:35:12 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [req-a3affb76-babb-43e0-ae71-9a8937b9a699 req-480943a6-f1e5-49bc-8712-8c1e860edb06 tempest-VolumesGetTestJSON-23798790 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3dce9d8-a4b1-4703-8448-fd963eed5009) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9ce3d6e0-c36b-4e53-9375-ecb9ea309c87', 'volume_size': 1}' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:35:12 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [req-a3affb76-babb-43e0-ae71-9a8937b9a699 req-480943a6-f1e5-49bc-8712-8c1e860edb06 tempest-VolumesGetTestJSON-23798790 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (74a3c255-c412-4cdd-a91d-9bef4fe02dac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:35:12 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [req-9a7408b7-e22e-49e7-9a23-cb29e9f2150d req-74cb6bc5-e361-48e3-be0d-2227d1d063e2 tempest-TestServerVolumeAttachmentScenario-1345303408 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.031s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:35:12 devstack cinder-volume[88899]: INFO cinder.volume.flows.manager.create_volume [req-a3affb76-babb-43e0-ae71-9a8937b9a699 req-480943a6-f1e5-49bc-8712-8c1e860edb06 tempest-VolumesGetTestJSON-23798790 None] Volume volume-9ce3d6e0-c36b-4e53-9375-ecb9ea309c87 (9ce3d6e0-c36b-4e53-9375-ecb9ea309c87): created successfully Aug 03 08:35:12 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [req-a3affb76-babb-43e0-ae71-9a8937b9a699 req-480943a6-f1e5-49bc-8712-8c1e860edb06 tempest-VolumesGetTestJSON-23798790 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (74a3c255-c412-4cdd-a91d-9bef4fe02dac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:35:12 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [req-a3affb76-babb-43e0-ae71-9a8937b9a699 req-480943a6-f1e5-49bc-8712-8c1e860edb06 tempest-VolumesGetTestJSON-23798790 None] Flow 'volume_create_manager' (73b3a6ab-2162-4f35-b7f3-036ea40d83e3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:35:12 devstack cinder-volume[88899]: INFO cinder.volume.manager [req-a3affb76-babb-43e0-ae71-9a8937b9a699 req-480943a6-f1e5-49bc-8712-8c1e860edb06 tempest-VolumesGetTestJSON-23798790 None] Created volume successfully. Aug 03 08:35:12 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [req-9a7408b7-e22e-49e7-9a23-cb29e9f2150d req-74cb6bc5-e361-48e3-be0d-2227d1d063e2 tempest-TestServerVolumeAttachmentScenario-1345303408 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385', 'name': 'volume-4b8762e6-f4ad-44b7-bed1-be69dbe129dc', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '4cda0e48-64ed-420f-b938-a166807f6c1d', 'enforce_multipath': True} {{(pid=88899) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 03 08:35:12 devstack cinder-volume[88899]: INFO cinder.volume.manager [req-9a7408b7-e22e-49e7-9a23-cb29e9f2150d req-74cb6bc5-e361-48e3-be0d-2227d1d063e2 tempest-TestServerVolumeAttachmentScenario-1345303408 None] attachment_update completed successfully. Aug 03 08:35:13 devstack cinder-volume[88899]: INFO cinder.volume.manager [req-bd6ead88-7d4f-4fcd-8bc1-66994f8fdf41 req-a449bb8e-0da5-4a03-9916-16db306956ad tempest-ServerActionsTestOtherA-826446422 None] Terminate volume connection completed successfully. Aug 03 08:35:13 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [req-bd6ead88-7d4f-4fcd-8bc1-66994f8fdf41 req-a449bb8e-0da5-4a03-9916-16db306956ad tempest-ServerActionsTestOtherA-826446422 None] Deleting attachment 3673d427-8573-4560-adbf-1c98df7d38d3. {{(pid=88899) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 03 08:35:13 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-957f2321-0680-47ff-8570-c37230ffcf47 tempest-VolumeQuotasAdminTestJSON-66114029 None] Transfer volume completed successfully. Aug 03 08:35:13 devstack cinder-volume[88899]: DEBUG cinder.coordination [req-bd6ead88-7d4f-4fcd-8bc1-66994f8fdf41 req-c8202b26-36a7-4219-a904-6a554aa95b6d tempest-ServerActionsTestOtherA-826446422 None] Acquiring lock "cinder-a62a55cb-cd3f-4d05-9d19-0aa3f9654f56-delete_volume" by "delete_volume" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:35:13 devstack cinder-volume[88899]: DEBUG cinder.coordination [req-bd6ead88-7d4f-4fcd-8bc1-66994f8fdf41 req-c8202b26-36a7-4219-a904-6a554aa95b6d tempest-ServerActionsTestOtherA-826446422 None] Lock "cinder-a62a55cb-cd3f-4d05-9d19-0aa3f9654f56-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:35:13 devstack cinder-volume[88899]: DEBUG cinder.coordination [req-bd6ead88-7d4f-4fcd-8bc1-66994f8fdf41 req-c8202b26-36a7-4219-a904-6a554aa95b6d tempest-ServerActionsTestOtherA-826446422 None] Acquiring lock "cinder-quobyte-a62a55cb-cd3f-4d05-9d19-0aa3f9654f56" by "delete_volume" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:35:13 devstack cinder-volume[88899]: DEBUG cinder.coordination [req-bd6ead88-7d4f-4fcd-8bc1-66994f8fdf41 req-c8202b26-36a7-4219-a904-6a554aa95b6d tempest-ServerActionsTestOtherA-826446422 None] Lock "cinder-quobyte-a62a55cb-cd3f-4d05-9d19-0aa3f9654f56" acquired by "delete_volume" :: waited 0.027s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:35:13 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb27f634-7266-4346-87af-9150bca6dfdd]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:35:13 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [req-bd6ead88-7d4f-4fcd-8bc1-66994f8fdf41 req-c8202b26-36a7-4219-a904-6a554aa95b6d tempest-ServerActionsTestOtherA-826446422 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-a62a55cb-cd3f-4d05-9d19-0aa3f9654f56 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:35:13 devstack sudo[98689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-a62a55cb-cd3f-4d05-9d19-0aa3f9654f56 Aug 03 08:35:13 devstack sudo[98689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:35:13 devstack cinder-volume[88899]: DEBUG cinder.coordination [req-1348a78d-d9bb-4bf0-b580-7fe6282a0b41 req-dcfed482-e7e5-45fa-b07d-22d9546c8c9c tempest-VolumesGetTestJSON-23798790 None] Acquiring lock "cinder-9ce3d6e0-c36b-4e53-9375-ecb9ea309c87-delete_volume" by "delete_volume" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:35:13 devstack cinder-volume[88899]: DEBUG cinder.coordination [req-1348a78d-d9bb-4bf0-b580-7fe6282a0b41 req-dcfed482-e7e5-45fa-b07d-22d9546c8c9c tempest-VolumesGetTestJSON-23798790 None] Lock "cinder-9ce3d6e0-c36b-4e53-9375-ecb9ea309c87-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:35:13 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-6610a475-86d1-44cb-aff7-c8bade9f7e6f tempest-VolumeQuotasAdminTestJSON-418142311 None] Acquiring lock "cinder-215afdcd-322e-4969-b378-e81e184d587a-delete_volume" by "delete_volume" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:35:13 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-6610a475-86d1-44cb-aff7-c8bade9f7e6f tempest-VolumeQuotasAdminTestJSON-418142311 None] Lock "cinder-215afdcd-322e-4969-b378-e81e184d587a-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:35:13 devstack cinder-volume[88899]: DEBUG cinder.coordination [req-1348a78d-d9bb-4bf0-b580-7fe6282a0b41 req-dcfed482-e7e5-45fa-b07d-22d9546c8c9c tempest-VolumesGetTestJSON-23798790 None] Acquiring lock "cinder-quobyte-9ce3d6e0-c36b-4e53-9375-ecb9ea309c87" by "delete_volume" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:35:14 devstack cinder-volume[88899]: DEBUG cinder.coordination [req-1348a78d-d9bb-4bf0-b580-7fe6282a0b41 req-dcfed482-e7e5-45fa-b07d-22d9546c8c9c tempest-VolumesGetTestJSON-23798790 None] Lock "cinder-quobyte-9ce3d6e0-c36b-4e53-9375-ecb9ea309c87" acquired by "delete_volume" :: waited 0.035s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:35:14 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-6610a475-86d1-44cb-aff7-c8bade9f7e6f tempest-VolumeQuotasAdminTestJSON-418142311 None] Acquiring lock "cinder-quobyte-215afdcd-322e-4969-b378-e81e184d587a" by "delete_volume" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:35:14 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[0541af19-fffb-46eb-b64a-6d002c528c11]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:35:14 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [req-1348a78d-d9bb-4bf0-b580-7fe6282a0b41 req-dcfed482-e7e5-45fa-b07d-22d9546c8c9c tempest-VolumesGetTestJSON-23798790 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-9ce3d6e0-c36b-4e53-9375-ecb9ea309c87 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:35:14 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-6610a475-86d1-44cb-aff7-c8bade9f7e6f tempest-VolumeQuotasAdminTestJSON-418142311 None] Lock "cinder-quobyte-215afdcd-322e-4969-b378-e81e184d587a" acquired by "delete_volume" :: waited 0.044s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:35:14 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[dafe08f0-db8f-4f7a-a05b-13d4e91af5d5]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:35:14 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-6610a475-86d1-44cb-aff7-c8bade9f7e6f tempest-VolumeQuotasAdminTestJSON-418142311 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-215afdcd-322e-4969-b378-e81e184d587a {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:35:14 devstack sudo[98689]: pam_unix(sudo:session): session closed for user root Aug 03 08:35:14 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [req-bd6ead88-7d4f-4fcd-8bc1-66994f8fdf41 req-c8202b26-36a7-4219-a904-6a554aa95b6d tempest-ServerActionsTestOtherA-826446422 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-a62a55cb-cd3f-4d05-9d19-0aa3f9654f56" returned: 0 in 0.698s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:35:14 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [req-bd6ead88-7d4f-4fcd-8bc1-66994f8fdf41 req-c8202b26-36a7-4219-a904-6a554aa95b6d tempest-ServerActionsTestOtherA-826446422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-a62a55cb-cd3f-4d05-9d19-0aa3f9654f56 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:35:14 devstack sudo[98697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-a62a55cb-cd3f-4d05-9d19-0aa3f9654f56 Aug 03 08:35:14 devstack sudo[98697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:35:14 devstack sudo[98693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-9ce3d6e0-c36b-4e53-9375-ecb9ea309c87 Aug 03 08:35:14 devstack sudo[98693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:35:14 devstack sudo[98696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-215afdcd-322e-4969-b378-e81e184d587a Aug 03 08:35:14 devstack sudo[98696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:35:14 devstack sudo[98697]: pam_unix(sudo:session): session closed for user root Aug 03 08:35:14 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [req-bd6ead88-7d4f-4fcd-8bc1-66994f8fdf41 req-c8202b26-36a7-4219-a904-6a554aa95b6d tempest-ServerActionsTestOtherA-826446422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-a62a55cb-cd3f-4d05-9d19-0aa3f9654f56" returned: 0 in 0.274s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:35:14 devstack cinder-volume[88899]: DEBUG cinder.coordination [req-bd6ead88-7d4f-4fcd-8bc1-66994f8fdf41 req-c8202b26-36a7-4219-a904-6a554aa95b6d tempest-ServerActionsTestOtherA-826446422 None] Lock "cinder-quobyte-a62a55cb-cd3f-4d05-9d19-0aa3f9654f56" released by "delete_volume" :: held 1.037s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:35:14 devstack sudo[98693]: pam_unix(sudo:session): session closed for user root Aug 03 08:35:14 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [req-1348a78d-d9bb-4bf0-b580-7fe6282a0b41 req-dcfed482-e7e5-45fa-b07d-22d9546c8c9c tempest-VolumesGetTestJSON-23798790 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-9ce3d6e0-c36b-4e53-9375-ecb9ea309c87" returned: 0 in 0.440s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:35:14 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [req-1348a78d-d9bb-4bf0-b580-7fe6282a0b41 req-dcfed482-e7e5-45fa-b07d-22d9546c8c9c tempest-VolumesGetTestJSON-23798790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-9ce3d6e0-c36b-4e53-9375-ecb9ea309c87 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:35:14 devstack sudo[98707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-9ce3d6e0-c36b-4e53-9375-ecb9ea309c87 Aug 03 08:35:14 devstack sudo[98707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:35:14 devstack cinder-volume[88899]: DEBUG cinder.quota [req-bd6ead88-7d4f-4fcd-8bc1-66994f8fdf41 req-c8202b26-36a7-4219-a904-6a554aa95b6d tempest-ServerActionsTestOtherA-826446422 None] Created reservations ['db48df62-07d4-4b3a-8ade-ad3f1c1ae894', '974a79b0-a4f8-4822-95df-a7fad946ce99', '5d4e87d5-7ecc-4e4a-8666-85c869163ca8', '8a081ff9-ff9a-452e-9130-a57552797029'] {{(pid=88899) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 08:35:14 devstack sudo[98696]: pam_unix(sudo:session): session closed for user root Aug 03 08:35:14 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-6610a475-86d1-44cb-aff7-c8bade9f7e6f tempest-VolumeQuotasAdminTestJSON-418142311 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-215afdcd-322e-4969-b378-e81e184d587a" returned: 0 in 0.460s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:35:14 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-6610a475-86d1-44cb-aff7-c8bade9f7e6f tempest-VolumeQuotasAdminTestJSON-418142311 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-215afdcd-322e-4969-b378-e81e184d587a {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:35:14 devstack sudo[98711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-215afdcd-322e-4969-b378-e81e184d587a Aug 03 08:35:14 devstack sudo[98711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:35:14 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [req-bd6ead88-7d4f-4fcd-8bc1-66994f8fdf41 req-c8202b26-36a7-4219-a904-6a554aa95b6d tempest-ServerActionsTestOtherA-826446422 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:35:14 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [req-bd6ead88-7d4f-4fcd-8bc1-66994f8fdf41 req-c8202b26-36a7-4219-a904-6a554aa95b6d tempest-ServerActionsTestOtherA-826446422 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:35:14 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [req-bd6ead88-7d4f-4fcd-8bc1-66994f8fdf41 req-c8202b26-36a7-4219-a904-6a554aa95b6d tempest-ServerActionsTestOtherA-826446422 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:35:14 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [req-bd6ead88-7d4f-4fcd-8bc1-66994f8fdf41 req-c8202b26-36a7-4219-a904-6a554aa95b6d tempest-ServerActionsTestOtherA-826446422 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:35:14 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [req-bd6ead88-7d4f-4fcd-8bc1-66994f8fdf41 req-c8202b26-36a7-4219-a904-6a554aa95b6d tempest-ServerActionsTestOtherA-826446422 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:35:14 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [req-bd6ead88-7d4f-4fcd-8bc1-66994f8fdf41 req-c8202b26-36a7-4219-a904-6a554aa95b6d tempest-ServerActionsTestOtherA-826446422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:35:14 devstack sudo[98713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a Aug 03 08:35:14 devstack sudo[98713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:35:14 devstack sudo[98707]: pam_unix(sudo:session): session closed for user root Aug 03 08:35:14 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [req-1348a78d-d9bb-4bf0-b580-7fe6282a0b41 req-dcfed482-e7e5-45fa-b07d-22d9546c8c9c tempest-VolumesGetTestJSON-23798790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-9ce3d6e0-c36b-4e53-9375-ecb9ea309c87" returned: 0 in 0.459s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:35:14 devstack cinder-volume[88899]: DEBUG cinder.coordination [req-1348a78d-d9bb-4bf0-b580-7fe6282a0b41 req-dcfed482-e7e5-45fa-b07d-22d9546c8c9c tempest-VolumesGetTestJSON-23798790 None] Lock "cinder-quobyte-9ce3d6e0-c36b-4e53-9375-ecb9ea309c87" released by "delete_volume" :: held 0.968s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:35:14 devstack sudo[98711]: pam_unix(sudo:session): session closed for user root Aug 03 08:35:14 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-6610a475-86d1-44cb-aff7-c8bade9f7e6f tempest-VolumeQuotasAdminTestJSON-418142311 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-215afdcd-322e-4969-b378-e81e184d587a" returned: 0 in 0.390s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:35:15 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-6610a475-86d1-44cb-aff7-c8bade9f7e6f tempest-VolumeQuotasAdminTestJSON-418142311 None] Lock "cinder-quobyte-215afdcd-322e-4969-b378-e81e184d587a" released by "delete_volume" :: held 0.928s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:35:15 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-e7703c8e-8ec3-4315-a44c-e9abed185d1d tempest-ServerActionsTestOtherA-826446422 None] Acquiring lock "cinder-2052ceb3-4070-47e1-9ffc-7499996ccbca-delete_volume" by "delete_volume" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:35:15 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-e7703c8e-8ec3-4315-a44c-e9abed185d1d tempest-ServerActionsTestOtherA-826446422 None] Lock "cinder-2052ceb3-4070-47e1-9ffc-7499996ccbca-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:35:15 devstack sudo[98713]: pam_unix(sudo:session): session closed for user root Aug 03 08:35:15 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [req-bd6ead88-7d4f-4fcd-8bc1-66994f8fdf41 req-c8202b26-36a7-4219-a904-6a554aa95b6d tempest-ServerActionsTestOtherA-826446422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a" returned: 0 in 0.482s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:35:15 devstack cinder-volume[88899]: DEBUG cinder.manager [req-bd6ead88-7d4f-4fcd-8bc1-66994f8fdf41 req-c8202b26-36a7-4219-a904-6a554aa95b6d tempest-ServerActionsTestOtherA-826446422 None] Notifying Schedulers of capabilities ... {{(pid=88899) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 08:35:15 devstack cinder-volume[88899]: INFO cinder.volume.manager [req-bd6ead88-7d4f-4fcd-8bc1-66994f8fdf41 req-c8202b26-36a7-4219-a904-6a554aa95b6d tempest-ServerActionsTestOtherA-826446422 None] Deleted volume successfully. Aug 03 08:35:15 devstack cinder-volume[88899]: DEBUG cinder.quota [req-1348a78d-d9bb-4bf0-b580-7fe6282a0b41 req-dcfed482-e7e5-45fa-b07d-22d9546c8c9c tempest-VolumesGetTestJSON-23798790 None] Created reservations ['d016265b-a80e-4a2d-84ed-2bab2ca52f05', 'e4b297d4-7aa3-4e69-89dc-d7a1040338d5', '5d1c524f-bf7a-48ca-a914-209b35868cbb', '480f7417-fe19-4f49-a9b2-7d59ba27a6b1'] {{(pid=88899) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 08:35:15 devstack cinder-volume[88899]: DEBUG cinder.quota [None req-6610a475-86d1-44cb-aff7-c8bade9f7e6f tempest-VolumeQuotasAdminTestJSON-418142311 None] Created reservations ['f33d4a82-4ca9-42da-8a0f-532423ead11d', '37c1e6ac-878b-47d8-956c-3f955c6e0485', '5323aeae-a5c8-4a03-96a9-c9a0b1bfae2b', '5e1c796d-7da5-4853-80db-5ac8d4adacee'] {{(pid=88899) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 08:35:15 devstack cinder-volume[88899]: DEBUG cinder.coordination [req-bd6ead88-7d4f-4fcd-8bc1-66994f8fdf41 req-c8202b26-36a7-4219-a904-6a554aa95b6d tempest-ServerActionsTestOtherA-826446422 None] Lock "cinder-a62a55cb-cd3f-4d05-9d19-0aa3f9654f56-delete_volume" released by "delete_volume" :: held 2.040s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:35:15 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-e7703c8e-8ec3-4315-a44c-e9abed185d1d tempest-ServerActionsTestOtherA-826446422 None] Acquiring lock "cinder-quobyte-2052ceb3-4070-47e1-9ffc-7499996ccbca" by "delete_volume" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:35:15 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-e7703c8e-8ec3-4315-a44c-e9abed185d1d tempest-ServerActionsTestOtherA-826446422 None] Lock "cinder-quobyte-2052ceb3-4070-47e1-9ffc-7499996ccbca" acquired by "delete_volume" :: waited 0.031s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:35:15 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [req-1348a78d-d9bb-4bf0-b580-7fe6282a0b41 req-dcfed482-e7e5-45fa-b07d-22d9546c8c9c tempest-VolumesGetTestJSON-23798790 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:35:15 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [req-1348a78d-d9bb-4bf0-b580-7fe6282a0b41 req-dcfed482-e7e5-45fa-b07d-22d9546c8c9c tempest-VolumesGetTestJSON-23798790 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:35:15 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [req-1348a78d-d9bb-4bf0-b580-7fe6282a0b41 req-dcfed482-e7e5-45fa-b07d-22d9546c8c9c tempest-VolumesGetTestJSON-23798790 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:35:15 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [req-1348a78d-d9bb-4bf0-b580-7fe6282a0b41 req-dcfed482-e7e5-45fa-b07d-22d9546c8c9c tempest-VolumesGetTestJSON-23798790 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:35:15 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [req-1348a78d-d9bb-4bf0-b580-7fe6282a0b41 req-dcfed482-e7e5-45fa-b07d-22d9546c8c9c tempest-VolumesGetTestJSON-23798790 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:35:15 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [req-1348a78d-d9bb-4bf0-b580-7fe6282a0b41 req-dcfed482-e7e5-45fa-b07d-22d9546c8c9c tempest-VolumesGetTestJSON-23798790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:35:15 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[db81e8d0-8249-44bb-ac28-6089617938ab]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:35:15 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-e7703c8e-8ec3-4315-a44c-e9abed185d1d tempest-ServerActionsTestOtherA-826446422 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-2052ceb3-4070-47e1-9ffc-7499996ccbca {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:35:15 devstack sudo[98719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a Aug 03 08:35:15 devstack sudo[98719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:35:15 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-6610a475-86d1-44cb-aff7-c8bade9f7e6f tempest-VolumeQuotasAdminTestJSON-418142311 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:35:15 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-6610a475-86d1-44cb-aff7-c8bade9f7e6f tempest-VolumeQuotasAdminTestJSON-418142311 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:35:15 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-6610a475-86d1-44cb-aff7-c8bade9f7e6f tempest-VolumeQuotasAdminTestJSON-418142311 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:35:15 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-6610a475-86d1-44cb-aff7-c8bade9f7e6f tempest-VolumeQuotasAdminTestJSON-418142311 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:35:15 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-6610a475-86d1-44cb-aff7-c8bade9f7e6f tempest-VolumeQuotasAdminTestJSON-418142311 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:35:15 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-6610a475-86d1-44cb-aff7-c8bade9f7e6f tempest-VolumeQuotasAdminTestJSON-418142311 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:35:15 devstack sudo[98722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a Aug 03 08:35:15 devstack sudo[98722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:35:15 devstack sudo[98720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-2052ceb3-4070-47e1-9ffc-7499996ccbca Aug 03 08:35:15 devstack sudo[98720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:35:15 devstack sudo[98719]: pam_unix(sudo:session): session closed for user root Aug 03 08:35:15 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [req-1348a78d-d9bb-4bf0-b580-7fe6282a0b41 req-dcfed482-e7e5-45fa-b07d-22d9546c8c9c tempest-VolumesGetTestJSON-23798790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a" returned: 0 in 0.286s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:35:15 devstack cinder-volume[88899]: DEBUG cinder.manager [req-1348a78d-d9bb-4bf0-b580-7fe6282a0b41 req-dcfed482-e7e5-45fa-b07d-22d9546c8c9c tempest-VolumesGetTestJSON-23798790 None] Notifying Schedulers of capabilities ... {{(pid=88899) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 08:35:15 devstack cinder-volume[88899]: INFO cinder.volume.manager [req-1348a78d-d9bb-4bf0-b580-7fe6282a0b41 req-dcfed482-e7e5-45fa-b07d-22d9546c8c9c tempest-VolumesGetTestJSON-23798790 None] Deleted volume successfully. Aug 03 08:35:15 devstack cinder-volume[88899]: DEBUG cinder.coordination [req-1348a78d-d9bb-4bf0-b580-7fe6282a0b41 req-dcfed482-e7e5-45fa-b07d-22d9546c8c9c tempest-VolumesGetTestJSON-23798790 None] Lock "cinder-9ce3d6e0-c36b-4e53-9375-ecb9ea309c87-delete_volume" released by "delete_volume" :: held 1.861s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:35:15 devstack sudo[98722]: pam_unix(sudo:session): session closed for user root Aug 03 08:35:15 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-6610a475-86d1-44cb-aff7-c8bade9f7e6f tempest-VolumeQuotasAdminTestJSON-418142311 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a" returned: 0 in 0.302s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:35:15 devstack cinder-volume[88899]: DEBUG cinder.manager [None req-6610a475-86d1-44cb-aff7-c8bade9f7e6f tempest-VolumeQuotasAdminTestJSON-418142311 None] Notifying Schedulers of capabilities ... {{(pid=88899) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 08:35:15 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-6610a475-86d1-44cb-aff7-c8bade9f7e6f tempest-VolumeQuotasAdminTestJSON-418142311 None] Deleted volume successfully. Aug 03 08:35:15 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-6610a475-86d1-44cb-aff7-c8bade9f7e6f tempest-VolumeQuotasAdminTestJSON-418142311 None] Lock "cinder-215afdcd-322e-4969-b378-e81e184d587a-delete_volume" released by "delete_volume" :: held 1.877s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:35:15 devstack sudo[98720]: pam_unix(sudo:session): session closed for user root Aug 03 08:35:15 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-e7703c8e-8ec3-4315-a44c-e9abed185d1d tempest-ServerActionsTestOtherA-826446422 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-2052ceb3-4070-47e1-9ffc-7499996ccbca" returned: 0 in 0.437s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:35:15 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-e7703c8e-8ec3-4315-a44c-e9abed185d1d tempest-ServerActionsTestOtherA-826446422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-2052ceb3-4070-47e1-9ffc-7499996ccbca {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:35:15 devstack sudo[98730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-2052ceb3-4070-47e1-9ffc-7499996ccbca Aug 03 08:35:15 devstack sudo[98730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:35:16 devstack sudo[98730]: pam_unix(sudo:session): session closed for user root Aug 03 08:35:16 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-e7703c8e-8ec3-4315-a44c-e9abed185d1d tempest-ServerActionsTestOtherA-826446422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-2052ceb3-4070-47e1-9ffc-7499996ccbca" returned: 0 in 0.268s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:35:16 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-e7703c8e-8ec3-4315-a44c-e9abed185d1d tempest-ServerActionsTestOtherA-826446422 None] Lock "cinder-quobyte-2052ceb3-4070-47e1-9ffc-7499996ccbca" released by "delete_volume" :: held 0.773s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:35:16 devstack cinder-volume[88899]: DEBUG cinder.quota [None req-e7703c8e-8ec3-4315-a44c-e9abed185d1d tempest-ServerActionsTestOtherA-826446422 None] Created reservations ['2480fdde-1e90-401e-b06a-b4b1266f8e83', 'f868c780-1c1e-4d86-aaf9-d4053412422c', '5ec0b737-042a-4459-ba68-b41e6abdf410', '850718ab-7e21-4d81-8f03-e19be707b3a8'] {{(pid=88899) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 08:35:16 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-e7703c8e-8ec3-4315-a44c-e9abed185d1d tempest-ServerActionsTestOtherA-826446422 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:35:16 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-e7703c8e-8ec3-4315-a44c-e9abed185d1d tempest-ServerActionsTestOtherA-826446422 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:35:16 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-e7703c8e-8ec3-4315-a44c-e9abed185d1d tempest-ServerActionsTestOtherA-826446422 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:35:16 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-e7703c8e-8ec3-4315-a44c-e9abed185d1d tempest-ServerActionsTestOtherA-826446422 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:35:16 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-e7703c8e-8ec3-4315-a44c-e9abed185d1d tempest-ServerActionsTestOtherA-826446422 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:35:16 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-e7703c8e-8ec3-4315-a44c-e9abed185d1d tempest-ServerActionsTestOtherA-826446422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:35:16 devstack sudo[98733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a Aug 03 08:35:16 devstack sudo[98733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:35:16 devstack sudo[98733]: pam_unix(sudo:session): session closed for user root Aug 03 08:35:16 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-e7703c8e-8ec3-4315-a44c-e9abed185d1d tempest-ServerActionsTestOtherA-826446422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a" returned: 0 in 0.406s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:35:16 devstack cinder-volume[88899]: DEBUG cinder.manager [None req-e7703c8e-8ec3-4315-a44c-e9abed185d1d tempest-ServerActionsTestOtherA-826446422 None] Notifying Schedulers of capabilities ... {{(pid=88899) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 08:35:16 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-e7703c8e-8ec3-4315-a44c-e9abed185d1d tempest-ServerActionsTestOtherA-826446422 None] Deleted volume successfully. Aug 03 08:35:16 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-e7703c8e-8ec3-4315-a44c-e9abed185d1d tempest-ServerActionsTestOtherA-826446422 None] Lock "cinder-2052ceb3-4070-47e1-9ffc-7499996ccbca-delete_volume" released by "delete_volume" :: held 1.665s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:35:20 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [req-f11e6e11-51b1-42d9-bcc0-e1fb65db234c req-c252a2b9-107e-4970-8f00-f47b58b76b61 tempest-TestServerVolumeAttachmentScenario-1345303408 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:35:20 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [req-f11e6e11-51b1-42d9-bcc0-e1fb65db234c req-c252a2b9-107e-4970-8f00-f47b58b76b61 tempest-TestServerVolumeAttachmentScenario-1345303408 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:35:20 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [req-f11e6e11-51b1-42d9-bcc0-e1fb65db234c req-c252a2b9-107e-4970-8f00-f47b58b76b61 tempest-TestServerVolumeAttachmentScenario-1345303408 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.015s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:35:20 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [req-f11e6e11-51b1-42d9-bcc0-e1fb65db234c req-c252a2b9-107e-4970-8f00-f47b58b76b61 tempest-TestServerVolumeAttachmentScenario-1345303408 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385', 'name': 'volume-1c4ea58d-362b-4f84-8788-6faad1d47b25', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '96214a49-1e3f-4e96-b214-455af37bebfa', 'enforce_multipath': True} {{(pid=88899) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 03 08:35:20 devstack cinder-volume[88899]: INFO cinder.volume.manager [req-f11e6e11-51b1-42d9-bcc0-e1fb65db234c req-c252a2b9-107e-4970-8f00-f47b58b76b61 tempest-TestServerVolumeAttachmentScenario-1345303408 None] attachment_update completed successfully. Aug 03 08:35:22 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-092675a1-56db-498a-badd-c26fc6266cee tempest-BackendsCapabilitiesAdminTestsJSON-976251074 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.755386352539, 'free_capacity_gb': 1775.755386352539, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=88899) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Aug 03 08:35:22 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-56d40409-2b56-4af0-8cbb-1b3c5d8d2352 tempest-BackendsCapabilitiesAdminTestsJSON-976251074 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.755386352539, 'free_capacity_gb': 1775.755386352539, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=88899) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Aug 03 08:35:23 devstack cinder-volume[88899]: INFO cinder.volume.manager [req-f5397d6f-541c-4d5c-8e47-784aface4e56 req-d495466e-0d1a-4ef4-a816-3db29ebf82e0 tempest-TestServerVolumeAttachmentScenario-1345303408 None] Terminate volume connection completed successfully. Aug 03 08:35:23 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [req-f5397d6f-541c-4d5c-8e47-784aface4e56 req-d495466e-0d1a-4ef4-a816-3db29ebf82e0 tempest-TestServerVolumeAttachmentScenario-1345303408 None] Deleting attachment 96214a49-1e3f-4e96-b214-455af37bebfa. {{(pid=88899) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 03 08:35:25 devstack cinder-volume[88899]: INFO cinder.volume.manager [req-aaa4fd59-ba7b-4799-92ca-653f5a1ff85e req-3524c107-e18d-408f-b2a3-b3238bc372c0 tempest-TestServerVolumeAttachmentScenario-1345303408 None] Terminate volume connection completed successfully. Aug 03 08:35:25 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [req-aaa4fd59-ba7b-4799-92ca-653f5a1ff85e req-3524c107-e18d-408f-b2a3-b3238bc372c0 tempest-TestServerVolumeAttachmentScenario-1345303408 None] Deleting attachment 4cda0e48-64ed-420f-b938-a166807f6c1d. {{(pid=88899) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 03 08:35:28 devstack cinder-volume[88899]: DEBUG cinder.volume.flows.manager.create_volume [None req-02de21eb-58bb-4e22-b1a4-c16dbcf1b19c tempest-VolumeTypesAccessTest-88466777 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88899) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 08:35:28 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-02de21eb-58bb-4e22-b1a4-c16dbcf1b19c tempest-VolumeTypesAccessTest-88466777 None] Flow 'volume_create_manager' (083531fd-3665-4101-8886-aca1115d31fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:35:28 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-02de21eb-58bb-4e22-b1a4-c16dbcf1b19c tempest-VolumeTypesAccessTest-88466777 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (64630caf-1923-417e-a5d6-573886da807b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:35:28 devstack cinder-volume[88899]: DEBUG dbcounter [-] [88899] Writing DB stats cinder:SELECT=76,cinder:UPDATE=84,cinder:DELETE=6,cinder:INSERT=16 {{(pid=88899) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 03 08:35:28 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-02de21eb-58bb-4e22-b1a4-c16dbcf1b19c tempest-VolumeTypesAccessTest-88466777 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (64630caf-1923-417e-a5d6-573886da807b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:35:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-2105209313',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=19aefdde-6d0c-4593-b8d6-6fa1a537aa54,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46c2039ebd3a4fe79dde270ff5b4c9a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:35:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:35:29Z,use_quota=True,user_id='a44a5460c1de4624b0b7ddb9495a2201',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb47fcdb-cd3a-4ccf-ac5f-ad552e8fe962),volume_type_id=cb47fcdb-cd3a-4ccf-ac5f-ad552e8fe962)' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:35:28 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-02de21eb-58bb-4e22-b1a4-c16dbcf1b19c tempest-VolumeTypesAccessTest-88466777 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5192a7e1-2519-441f-ad45-94b1b1741288) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:35:28 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-02de21eb-58bb-4e22-b1a4-c16dbcf1b19c tempest-VolumeTypesAccessTest-88466777 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5192a7e1-2519-441f-ad45-94b1b1741288) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:35:28 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-02de21eb-58bb-4e22-b1a4-c16dbcf1b19c tempest-VolumeTypesAccessTest-88466777 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3eddc1d5-a76b-4844-8052-7306528bd4a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:35:28 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-02de21eb-58bb-4e22-b1a4-c16dbcf1b19c tempest-VolumeTypesAccessTest-88466777 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3eddc1d5-a76b-4844-8052-7306528bd4a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '19aefdde-6d0c-4593-b8d6-6fa1a537aa54', 'volume_name': 'volume-19aefdde-6d0c-4593-b8d6-6fa1a537aa54', 'volume_size': 1}' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:35:28 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-02de21eb-58bb-4e22-b1a4-c16dbcf1b19c tempest-VolumeTypesAccessTest-88466777 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7cb72879-aebc-470e-9e20-ea3e5e60a19d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:35:28 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-02de21eb-58bb-4e22-b1a4-c16dbcf1b19c tempest-VolumeTypesAccessTest-88466777 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7cb72879-aebc-470e-9e20-ea3e5e60a19d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:35:28 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-02de21eb-58bb-4e22-b1a4-c16dbcf1b19c tempest-VolumeTypesAccessTest-88466777 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b72647e-ec6c-48b8-9223-64ac557d56eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:35:28 devstack cinder-volume[88899]: INFO cinder.volume.flows.manager.create_volume [None req-02de21eb-58bb-4e22-b1a4-c16dbcf1b19c tempest-VolumeTypesAccessTest-88466777 None] Volume 19aefdde-6d0c-4593-b8d6-6fa1a537aa54: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-19aefdde-6d0c-4593-b8d6-6fa1a537aa54', 'volume_size': 1} Aug 03 08:35:28 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-02de21eb-58bb-4e22-b1a4-c16dbcf1b19c tempest-VolumeTypesAccessTest-88466777 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:35:28 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-02de21eb-58bb-4e22-b1a4-c16dbcf1b19c tempest-VolumeTypesAccessTest-88466777 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:35:28 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-02de21eb-58bb-4e22-b1a4-c16dbcf1b19c tempest-VolumeTypesAccessTest-88466777 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:35:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-2105209313',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=19aefdde-6d0c-4593-b8d6-6fa1a537aa54,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46c2039ebd3a4fe79dde270ff5b4c9a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:35:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:35:29Z,use_quota=True,user_id='a44a5460c1de4624b0b7ddb9495a2201',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb47fcdb-cd3a-4ccf-ac5f-ad552e8fe962),volume_type_id=cb47fcdb-cd3a-4ccf-ac5f-ad552e8fe962)}" {{(pid=88899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 08:35:28 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-02de21eb-58bb-4e22-b1a4-c16dbcf1b19c tempest-VolumeTypesAccessTest-88466777 None] Creating volume 19aefdde-6d0c-4593-b8d6-6fa1a537aa54 {{(pid=88899) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 08:35:28 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-02de21eb-58bb-4e22-b1a4-c16dbcf1b19c tempest-VolumeTypesAccessTest-88466777 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:35:28 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-02de21eb-58bb-4e22-b1a4-c16dbcf1b19c tempest-VolumeTypesAccessTest-88466777 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:35:28 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-02de21eb-58bb-4e22-b1a4-c16dbcf1b19c tempest-VolumeTypesAccessTest-88466777 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:35:28 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-02de21eb-58bb-4e22-b1a4-c16dbcf1b19c tempest-VolumeTypesAccessTest-88466777 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:35:28 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-02de21eb-58bb-4e22-b1a4-c16dbcf1b19c tempest-VolumeTypesAccessTest-88466777 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:35:28 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-02de21eb-58bb-4e22-b1a4-c16dbcf1b19c tempest-VolumeTypesAccessTest-88466777 None] Selected osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385 as target Quobyte volume. {{(pid=88899) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 08:35:28 devstack cinder-volume[88899]: INFO cinder.volume.drivers.remotefs [None req-02de21eb-58bb-4e22-b1a4-c16dbcf1b19c tempest-VolumeTypesAccessTest-88466777 None] casted to osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385 Aug 03 08:35:28 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-02de21eb-58bb-4e22-b1a4-c16dbcf1b19c tempest-VolumeTypesAccessTest-88466777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-19aefdde-6d0c-4593-b8d6-6fa1a537aa54 1073741824 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:35:29 devstack sudo[98847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-19aefdde-6d0c-4593-b8d6-6fa1a537aa54 1073741824 Aug 03 08:35:29 devstack sudo[98847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:35:29 devstack sudo[98847]: pam_unix(sudo:session): session closed for user root Aug 03 08:35:29 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-02de21eb-58bb-4e22-b1a4-c16dbcf1b19c tempest-VolumeTypesAccessTest-88466777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-19aefdde-6d0c-4593-b8d6-6fa1a537aa54 1073741824" returned: 0 in 0.654s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:35:29 devstack cinder-volume[88899]: DEBUG dbcounter [-] [88899] Writing DB stats cinder:UPDATE=88,cinder:DELETE=8,cinder:SELECT=88,cinder:INSERT=21 {{(pid=88899) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 03 08:35:29 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-02de21eb-58bb-4e22-b1a4-c16dbcf1b19c tempest-VolumeTypesAccessTest-88466777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-19aefdde-6d0c-4593-b8d6-6fa1a537aa54 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:35:29 devstack sudo[98854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-19aefdde-6d0c-4593-b8d6-6fa1a537aa54 Aug 03 08:35:29 devstack sudo[98854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:35:30 devstack sudo[98854]: pam_unix(sudo:session): session closed for user root Aug 03 08:35:30 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-02de21eb-58bb-4e22-b1a4-c16dbcf1b19c tempest-VolumeTypesAccessTest-88466777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-19aefdde-6d0c-4593-b8d6-6fa1a537aa54" returned: 0 in 0.376s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:35:30 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-02de21eb-58bb-4e22-b1a4-c16dbcf1b19c tempest-VolumeTypesAccessTest-88466777 None] <== create_volume: return (1106ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'} {{(pid=88899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 08:35:30 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-02de21eb-58bb-4e22-b1a4-c16dbcf1b19c tempest-VolumeTypesAccessTest-88466777 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.110s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:35:30 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-02de21eb-58bb-4e22-b1a4-c16dbcf1b19c tempest-VolumeTypesAccessTest-88466777 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b72647e-ec6c-48b8-9223-64ac557d56eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-19aefdde-6d0c-4593-b8d6-6fa1a537aa54', 'volume_size': 1}' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:35:30 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-02de21eb-58bb-4e22-b1a4-c16dbcf1b19c tempest-VolumeTypesAccessTest-88466777 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d040f09d-27f1-4c15-9dbb-1efa42f0b8cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:35:30 devstack cinder-volume[88899]: INFO cinder.volume.flows.manager.create_volume [None req-02de21eb-58bb-4e22-b1a4-c16dbcf1b19c tempest-VolumeTypesAccessTest-88466777 None] Volume volume-19aefdde-6d0c-4593-b8d6-6fa1a537aa54 (19aefdde-6d0c-4593-b8d6-6fa1a537aa54): created successfully Aug 03 08:35:30 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-02de21eb-58bb-4e22-b1a4-c16dbcf1b19c tempest-VolumeTypesAccessTest-88466777 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d040f09d-27f1-4c15-9dbb-1efa42f0b8cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:35:30 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-02de21eb-58bb-4e22-b1a4-c16dbcf1b19c tempest-VolumeTypesAccessTest-88466777 None] Flow 'volume_create_manager' (083531fd-3665-4101-8886-aca1115d31fe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:35:30 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-02de21eb-58bb-4e22-b1a4-c16dbcf1b19c tempest-VolumeTypesAccessTest-88466777 None] Created volume successfully. Aug 03 08:35:30 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-c4bc0743-0287-44df-a157-b6f7a0a7f593 tempest-GroupSnapshotsV319Test-1873872264 None] Group tempest-GroupSnapshotsV319Test-Group-1575971118: creating Aug 03 08:35:30 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-c4bc0743-0287-44df-a157-b6f7a0a7f593 tempest-GroupSnapshotsV319Test-1873872264 None] Group tempest-GroupSnapshotsV319Test-Group-1575971118: created successfully Aug 03 08:35:30 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-c4bc0743-0287-44df-a157-b6f7a0a7f593 tempest-GroupSnapshotsV319Test-1873872264 None] Create group completed successfully. Aug 03 08:35:31 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-0d9f5870-689d-4f75-afa7-479c44a0c2ef tempest-VolumeTypesAccessTest-88466777 None] Acquiring lock "cinder-19aefdde-6d0c-4593-b8d6-6fa1a537aa54-delete_volume" by "delete_volume" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:35:31 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-0d9f5870-689d-4f75-afa7-479c44a0c2ef tempest-VolumeTypesAccessTest-88466777 None] Lock "cinder-19aefdde-6d0c-4593-b8d6-6fa1a537aa54-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:35:31 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-0d9f5870-689d-4f75-afa7-479c44a0c2ef tempest-VolumeTypesAccessTest-88466777 None] Acquiring lock "cinder-quobyte-19aefdde-6d0c-4593-b8d6-6fa1a537aa54" by "delete_volume" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:35:31 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-0d9f5870-689d-4f75-afa7-479c44a0c2ef tempest-VolumeTypesAccessTest-88466777 None] Lock "cinder-quobyte-19aefdde-6d0c-4593-b8d6-6fa1a537aa54" acquired by "delete_volume" :: waited 0.019s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:35:31 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dec831c-2abe-4874-863e-06c16cb40cee]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:35:31 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-0d9f5870-689d-4f75-afa7-479c44a0c2ef tempest-VolumeTypesAccessTest-88466777 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-19aefdde-6d0c-4593-b8d6-6fa1a537aa54 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:35:31 devstack sudo[98858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-19aefdde-6d0c-4593-b8d6-6fa1a537aa54 Aug 03 08:35:31 devstack sudo[98858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:35:31 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-7ada73f0-cdf2-43be-ba3d-bc1a0bf013dc tempest-TestServerVolumeAttachmentScenario-1345303408 None] Acquiring lock "cinder-1c4ea58d-362b-4f84-8788-6faad1d47b25-delete_volume" by "delete_volume" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:35:31 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-7ada73f0-cdf2-43be-ba3d-bc1a0bf013dc tempest-TestServerVolumeAttachmentScenario-1345303408 None] Lock "cinder-1c4ea58d-362b-4f84-8788-6faad1d47b25-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:35:31 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-7ada73f0-cdf2-43be-ba3d-bc1a0bf013dc tempest-TestServerVolumeAttachmentScenario-1345303408 None] Acquiring lock "cinder-quobyte-1c4ea58d-362b-4f84-8788-6faad1d47b25" by "delete_volume" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:35:31 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-7ada73f0-cdf2-43be-ba3d-bc1a0bf013dc tempest-TestServerVolumeAttachmentScenario-1345303408 None] Lock "cinder-quobyte-1c4ea58d-362b-4f84-8788-6faad1d47b25" acquired by "delete_volume" :: waited 0.023s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:35:31 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[2556f6cc-27ef-4be4-9323-16688e1d5ba8]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:35:31 devstack sudo[98858]: pam_unix(sudo:session): session closed for user root Aug 03 08:35:31 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-7ada73f0-cdf2-43be-ba3d-bc1a0bf013dc tempest-TestServerVolumeAttachmentScenario-1345303408 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-1c4ea58d-362b-4f84-8788-6faad1d47b25 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:35:31 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-0d9f5870-689d-4f75-afa7-479c44a0c2ef tempest-VolumeTypesAccessTest-88466777 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-19aefdde-6d0c-4593-b8d6-6fa1a537aa54" returned: 0 in 0.511s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:35:31 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-0d9f5870-689d-4f75-afa7-479c44a0c2ef tempest-VolumeTypesAccessTest-88466777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-19aefdde-6d0c-4593-b8d6-6fa1a537aa54 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:35:31 devstack sudo[98864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-19aefdde-6d0c-4593-b8d6-6fa1a537aa54 Aug 03 08:35:31 devstack sudo[98864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:35:31 devstack sudo[98863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-1c4ea58d-362b-4f84-8788-6faad1d47b25 Aug 03 08:35:31 devstack sudo[98863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:35:32 devstack sudo[98864]: pam_unix(sudo:session): session closed for user root Aug 03 08:35:32 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-0d9f5870-689d-4f75-afa7-479c44a0c2ef tempest-VolumeTypesAccessTest-88466777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-19aefdde-6d0c-4593-b8d6-6fa1a537aa54" returned: 0 in 0.376s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:35:32 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-0d9f5870-689d-4f75-afa7-479c44a0c2ef tempest-VolumeTypesAccessTest-88466777 None] Lock "cinder-quobyte-19aefdde-6d0c-4593-b8d6-6fa1a537aa54" released by "delete_volume" :: held 0.949s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:35:32 devstack cinder-volume[88899]: WARNING cinder.quota [None req-0d9f5870-689d-4f75-afa7-479c44a0c2ef tempest-VolumeTypesAccessTest-88466777 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-1458702354 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-1458702354, it is now deprecated. Please use the default quota class for default quota. Aug 03 08:35:32 devstack cinder-volume[88899]: WARNING cinder.quota [None req-0d9f5870-689d-4f75-afa7-479c44a0c2ef tempest-VolumeTypesAccessTest-88466777 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-1458702354 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-1458702354, it is now deprecated. Please use the default quota class for default quota. Aug 03 08:35:32 devstack cinder-volume[88899]: DEBUG cinder.quota [None req-0d9f5870-689d-4f75-afa7-479c44a0c2ef tempest-VolumeTypesAccessTest-88466777 None] Created reservations ['1d839ab0-b2c0-47da-b4af-07ca91392d25', 'd1a96a6d-3406-45f8-9c4b-ee066f0c312b', '7695116b-74ae-4f86-845b-fee428db3e55', 'd19b6a6e-af4c-48bc-8c31-d9d8e305ed31'] {{(pid=88899) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 08:35:32 devstack sudo[98863]: pam_unix(sudo:session): session closed for user root Aug 03 08:35:32 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-7ada73f0-cdf2-43be-ba3d-bc1a0bf013dc tempest-TestServerVolumeAttachmentScenario-1345303408 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-1c4ea58d-362b-4f84-8788-6faad1d47b25" returned: 0 in 0.603s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:35:32 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-7ada73f0-cdf2-43be-ba3d-bc1a0bf013dc tempest-TestServerVolumeAttachmentScenario-1345303408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-1c4ea58d-362b-4f84-8788-6faad1d47b25 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:35:32 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-0d9f5870-689d-4f75-afa7-479c44a0c2ef tempest-VolumeTypesAccessTest-88466777 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:35:32 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-0d9f5870-689d-4f75-afa7-479c44a0c2ef tempest-VolumeTypesAccessTest-88466777 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:35:32 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-0d9f5870-689d-4f75-afa7-479c44a0c2ef tempest-VolumeTypesAccessTest-88466777 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:35:32 devstack sudo[98871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-1c4ea58d-362b-4f84-8788-6faad1d47b25 Aug 03 08:35:32 devstack sudo[98871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:35:32 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-0d9f5870-689d-4f75-afa7-479c44a0c2ef tempest-VolumeTypesAccessTest-88466777 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:35:32 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-0d9f5870-689d-4f75-afa7-479c44a0c2ef tempest-VolumeTypesAccessTest-88466777 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:35:32 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-0d9f5870-689d-4f75-afa7-479c44a0c2ef tempest-VolumeTypesAccessTest-88466777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:35:32 devstack cinder-volume[88899]: DEBUG cinder.volume.flows.manager.create_volume [None req-52fe2c65-c468-45b2-85cb-27f09d58dd08 tempest-GroupSnapshotsV319Test-1873872264 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88899) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 08:35:32 devstack sudo[98873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a Aug 03 08:35:32 devstack sudo[98873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:35:32 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-52fe2c65-c468-45b2-85cb-27f09d58dd08 tempest-GroupSnapshotsV319Test-1873872264 None] Flow 'volume_create_manager' (290d22c6-3c27-4029-afef-39d06cd96ea9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:35:32 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-52fe2c65-c468-45b2-85cb-27f09d58dd08 tempest-GroupSnapshotsV319Test-1873872264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (254a56c3-3ecb-4a48-a7ee-6d67a0dd2494) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:35:32 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-52fe2c65-c468-45b2-85cb-27f09d58dd08 tempest-GroupSnapshotsV319Test-1873872264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (254a56c3-3ecb-4a48-a7ee-6d67a0dd2494) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:35:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1517950478',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=48409d3e-4c35-4cf6-b422-e2a9ad7f7ddc,host='devstack@QuobyteHD#QuobyteHD',id=b1efc37f-42b1-47bf-9e1f-bd12419d2547,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7efda725b09c4bfd949ea92eb28859d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:35:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:35:32Z,use_quota=True,user_id='6c015e7ed6db40acb06cefeb26fdbe45',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68f63b3e-4d1e-403c-ba0f-da34fa25ec42),volume_type_id=68f63b3e-4d1e-403c-ba0f-da34fa25ec42)' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:35:32 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-52fe2c65-c468-45b2-85cb-27f09d58dd08 tempest-GroupSnapshotsV319Test-1873872264 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28454be5-e3af-420b-a779-a751d0b49425) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:35:32 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-52fe2c65-c468-45b2-85cb-27f09d58dd08 tempest-GroupSnapshotsV319Test-1873872264 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28454be5-e3af-420b-a779-a751d0b49425) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:35:32 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-52fe2c65-c468-45b2-85cb-27f09d58dd08 tempest-GroupSnapshotsV319Test-1873872264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2b42c5e-1cc5-4d6e-8380-cb7547bd9d6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:35:32 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-52fe2c65-c468-45b2-85cb-27f09d58dd08 tempest-GroupSnapshotsV319Test-1873872264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2b42c5e-1cc5-4d6e-8380-cb7547bd9d6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b1efc37f-42b1-47bf-9e1f-bd12419d2547', 'volume_name': 'volume-b1efc37f-42b1-47bf-9e1f-bd12419d2547', 'volume_size': 1}' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:35:32 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-52fe2c65-c468-45b2-85cb-27f09d58dd08 tempest-GroupSnapshotsV319Test-1873872264 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c2ab128-f274-44c9-8c27-51d4b435ddb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:35:32 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-52fe2c65-c468-45b2-85cb-27f09d58dd08 tempest-GroupSnapshotsV319Test-1873872264 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c2ab128-f274-44c9-8c27-51d4b435ddb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:35:32 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-52fe2c65-c468-45b2-85cb-27f09d58dd08 tempest-GroupSnapshotsV319Test-1873872264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (132618fc-5cb9-441c-b65b-7df3861c684f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:35:32 devstack cinder-volume[88899]: INFO cinder.volume.flows.manager.create_volume [None req-52fe2c65-c468-45b2-85cb-27f09d58dd08 tempest-GroupSnapshotsV319Test-1873872264 None] Volume b1efc37f-42b1-47bf-9e1f-bd12419d2547: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b1efc37f-42b1-47bf-9e1f-bd12419d2547', 'volume_size': 1} Aug 03 08:35:32 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-52fe2c65-c468-45b2-85cb-27f09d58dd08 tempest-GroupSnapshotsV319Test-1873872264 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:35:32 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-52fe2c65-c468-45b2-85cb-27f09d58dd08 tempest-GroupSnapshotsV319Test-1873872264 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:35:32 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-52fe2c65-c468-45b2-85cb-27f09d58dd08 tempest-GroupSnapshotsV319Test-1873872264 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=48409d3e-4c35-4cf6-b422-e2a9ad7f7ddc,created_at=2026-08-03T06:35:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1517950478',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=48409d3e-4c35-4cf6-b422-e2a9ad7f7ddc,host='devstack@QuobyteHD#QuobyteHD',id=b1efc37f-42b1-47bf-9e1f-bd12419d2547,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7efda725b09c4bfd949ea92eb28859d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:35:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:35:32Z,use_quota=True,user_id='6c015e7ed6db40acb06cefeb26fdbe45',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68f63b3e-4d1e-403c-ba0f-da34fa25ec42),volume_type_id=68f63b3e-4d1e-403c-ba0f-da34fa25ec42)}" {{(pid=88899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 08:35:32 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-52fe2c65-c468-45b2-85cb-27f09d58dd08 tempest-GroupSnapshotsV319Test-1873872264 None] Creating volume b1efc37f-42b1-47bf-9e1f-bd12419d2547 {{(pid=88899) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 08:35:32 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-52fe2c65-c468-45b2-85cb-27f09d58dd08 tempest-GroupSnapshotsV319Test-1873872264 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:35:32 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-52fe2c65-c468-45b2-85cb-27f09d58dd08 tempest-GroupSnapshotsV319Test-1873872264 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:35:32 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-52fe2c65-c468-45b2-85cb-27f09d58dd08 tempest-GroupSnapshotsV319Test-1873872264 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:35:32 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-52fe2c65-c468-45b2-85cb-27f09d58dd08 tempest-GroupSnapshotsV319Test-1873872264 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:35:32 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-52fe2c65-c468-45b2-85cb-27f09d58dd08 tempest-GroupSnapshotsV319Test-1873872264 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:35:32 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-52fe2c65-c468-45b2-85cb-27f09d58dd08 tempest-GroupSnapshotsV319Test-1873872264 None] Selected osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385 as target Quobyte volume. {{(pid=88899) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 08:35:32 devstack cinder-volume[88899]: INFO cinder.volume.drivers.remotefs [None req-52fe2c65-c468-45b2-85cb-27f09d58dd08 tempest-GroupSnapshotsV319Test-1873872264 None] casted to osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385 Aug 03 08:35:32 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-52fe2c65-c468-45b2-85cb-27f09d58dd08 tempest-GroupSnapshotsV319Test-1873872264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-b1efc37f-42b1-47bf-9e1f-bd12419d2547 1073741824 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:35:32 devstack sudo[98877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-b1efc37f-42b1-47bf-9e1f-bd12419d2547 1073741824 Aug 03 08:35:32 devstack sudo[98877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:35:32 devstack sudo[98871]: pam_unix(sudo:session): session closed for user root Aug 03 08:35:32 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-7ada73f0-cdf2-43be-ba3d-bc1a0bf013dc tempest-TestServerVolumeAttachmentScenario-1345303408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-1c4ea58d-362b-4f84-8788-6faad1d47b25" returned: 0 in 0.332s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:35:32 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-7ada73f0-cdf2-43be-ba3d-bc1a0bf013dc tempest-TestServerVolumeAttachmentScenario-1345303408 None] Lock "cinder-quobyte-1c4ea58d-362b-4f84-8788-6faad1d47b25" released by "delete_volume" :: held 1.008s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:35:32 devstack sudo[98873]: pam_unix(sudo:session): session closed for user root Aug 03 08:35:32 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-0d9f5870-689d-4f75-afa7-479c44a0c2ef tempest-VolumeTypesAccessTest-88466777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a" returned: 0 in 0.367s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:35:32 devstack cinder-volume[88899]: DEBUG cinder.manager [None req-0d9f5870-689d-4f75-afa7-479c44a0c2ef tempest-VolumeTypesAccessTest-88466777 None] Notifying Schedulers of capabilities ... {{(pid=88899) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 08:35:32 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-0d9f5870-689d-4f75-afa7-479c44a0c2ef tempest-VolumeTypesAccessTest-88466777 None] Deleted volume successfully. Aug 03 08:35:32 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-0d9f5870-689d-4f75-afa7-479c44a0c2ef tempest-VolumeTypesAccessTest-88466777 None] Lock "cinder-19aefdde-6d0c-4593-b8d6-6fa1a537aa54-delete_volume" released by "delete_volume" :: held 1.664s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:35:32 devstack cinder-volume[88899]: DEBUG cinder.quota [None req-7ada73f0-cdf2-43be-ba3d-bc1a0bf013dc tempest-TestServerVolumeAttachmentScenario-1345303408 None] Created reservations ['bf7dec09-0bc9-423d-8feb-16b82a757e58', 'da46b0c3-1410-4915-a72b-2b3848489943', '0094e5d5-48f6-4290-b2ed-dbeaadaeda6d', '5126c794-c5c7-47d1-8a4d-cb4f15a9b938'] {{(pid=88899) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 08:35:32 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-7ada73f0-cdf2-43be-ba3d-bc1a0bf013dc tempest-TestServerVolumeAttachmentScenario-1345303408 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:35:32 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-7ada73f0-cdf2-43be-ba3d-bc1a0bf013dc tempest-TestServerVolumeAttachmentScenario-1345303408 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:35:32 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-7ada73f0-cdf2-43be-ba3d-bc1a0bf013dc tempest-TestServerVolumeAttachmentScenario-1345303408 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:35:32 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-7ada73f0-cdf2-43be-ba3d-bc1a0bf013dc tempest-TestServerVolumeAttachmentScenario-1345303408 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:35:32 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-7ada73f0-cdf2-43be-ba3d-bc1a0bf013dc tempest-TestServerVolumeAttachmentScenario-1345303408 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:35:32 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-7ada73f0-cdf2-43be-ba3d-bc1a0bf013dc tempest-TestServerVolumeAttachmentScenario-1345303408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:35:32 devstack sudo[98884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a Aug 03 08:35:32 devstack sudo[98884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:35:33 devstack sudo[98877]: pam_unix(sudo:session): session closed for user root Aug 03 08:35:33 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-52fe2c65-c468-45b2-85cb-27f09d58dd08 tempest-GroupSnapshotsV319Test-1873872264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-b1efc37f-42b1-47bf-9e1f-bd12419d2547 1073741824" returned: 0 in 0.553s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:35:33 devstack sudo[98884]: pam_unix(sudo:session): session closed for user root Aug 03 08:35:33 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-7ada73f0-cdf2-43be-ba3d-bc1a0bf013dc tempest-TestServerVolumeAttachmentScenario-1345303408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a" returned: 0 in 0.258s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:35:33 devstack cinder-volume[88899]: DEBUG cinder.manager [None req-7ada73f0-cdf2-43be-ba3d-bc1a0bf013dc tempest-TestServerVolumeAttachmentScenario-1345303408 None] Notifying Schedulers of capabilities ... {{(pid=88899) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 08:35:33 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-52fe2c65-c468-45b2-85cb-27f09d58dd08 tempest-GroupSnapshotsV319Test-1873872264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-b1efc37f-42b1-47bf-9e1f-bd12419d2547 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:35:33 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-7ada73f0-cdf2-43be-ba3d-bc1a0bf013dc tempest-TestServerVolumeAttachmentScenario-1345303408 None] Deleted volume successfully. Aug 03 08:35:33 devstack sudo[98888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-b1efc37f-42b1-47bf-9e1f-bd12419d2547 Aug 03 08:35:33 devstack sudo[98888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:35:33 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-7ada73f0-cdf2-43be-ba3d-bc1a0bf013dc tempest-TestServerVolumeAttachmentScenario-1345303408 None] Lock "cinder-1c4ea58d-362b-4f84-8788-6faad1d47b25-delete_volume" released by "delete_volume" :: held 1.585s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:35:33 devstack sudo[98888]: pam_unix(sudo:session): session closed for user root Aug 03 08:35:33 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-52fe2c65-c468-45b2-85cb-27f09d58dd08 tempest-GroupSnapshotsV319Test-1873872264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-b1efc37f-42b1-47bf-9e1f-bd12419d2547" returned: 0 in 0.276s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:35:33 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-52fe2c65-c468-45b2-85cb-27f09d58dd08 tempest-GroupSnapshotsV319Test-1873872264 None] <== create_volume: return (879ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'} {{(pid=88899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 08:35:33 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-52fe2c65-c468-45b2-85cb-27f09d58dd08 tempest-GroupSnapshotsV319Test-1873872264 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.882s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:35:33 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-52fe2c65-c468-45b2-85cb-27f09d58dd08 tempest-GroupSnapshotsV319Test-1873872264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (132618fc-5cb9-441c-b65b-7df3861c684f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b1efc37f-42b1-47bf-9e1f-bd12419d2547', 'volume_size': 1}' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:35:33 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-52fe2c65-c468-45b2-85cb-27f09d58dd08 tempest-GroupSnapshotsV319Test-1873872264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c7a8c59-3d34-41fe-88c3-ac758e4449fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:35:33 devstack cinder-volume[88899]: INFO cinder.volume.flows.manager.create_volume [None req-52fe2c65-c468-45b2-85cb-27f09d58dd08 tempest-GroupSnapshotsV319Test-1873872264 None] Volume volume-b1efc37f-42b1-47bf-9e1f-bd12419d2547 (b1efc37f-42b1-47bf-9e1f-bd12419d2547): created successfully Aug 03 08:35:33 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-52fe2c65-c468-45b2-85cb-27f09d58dd08 tempest-GroupSnapshotsV319Test-1873872264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c7a8c59-3d34-41fe-88c3-ac758e4449fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:35:33 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-52fe2c65-c468-45b2-85cb-27f09d58dd08 tempest-GroupSnapshotsV319Test-1873872264 None] Flow 'volume_create_manager' (290d22c6-3c27-4029-afef-39d06cd96ea9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:35:33 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-52fe2c65-c468-45b2-85cb-27f09d58dd08 tempest-GroupSnapshotsV319Test-1873872264 None] Created volume successfully. Aug 03 08:35:33 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-4cf25cce-2007-460a-a43b-f7a6b485b6dc tempest-GroupSnapshotsV319Test-1873872264 None] GroupSnapshot 20f6a653-2e42-47e0-838e-0cd161ecc110: creating. Aug 03 08:35:33 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-686272e5-5ff3-4ee5-bddb-505b0b134ac2 tempest-TestServerVolumeAttachmentScenario-1345303408 None] Acquiring lock "cinder-4b8762e6-f4ad-44b7-bed1-be69dbe129dc-delete_volume" by "delete_volume" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:35:33 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-4cf25cce-2007-460a-a43b-f7a6b485b6dc tempest-GroupSnapshotsV319Test-1873872264 None] Group snapshot 20f6a653-2e42-47e0-838e-0cd161ecc110: creating. {{(pid=88899) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Aug 03 08:35:34 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-686272e5-5ff3-4ee5-bddb-505b0b134ac2 tempest-TestServerVolumeAttachmentScenario-1345303408 None] Lock "cinder-4b8762e6-f4ad-44b7-bed1-be69dbe129dc-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:35:34 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-4cf25cce-2007-460a-a43b-f7a6b485b6dc tempest-GroupSnapshotsV319Test-1873872264 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:35:34 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-4cf25cce-2007-460a-a43b-f7a6b485b6dc tempest-GroupSnapshotsV319Test-1873872264 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:35:34 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-4cf25cce-2007-460a-a43b-f7a6b485b6dc tempest-GroupSnapshotsV319Test-1873872264 None] Creating offline snapshot 0dbb74e8-383b-443d-9bc8-2dbd752d0ded of volume b1efc37f-42b1-47bf-9e1f-bd12419d2547 {{(pid=88899) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 03 08:35:34 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-686272e5-5ff3-4ee5-bddb-505b0b134ac2 tempest-TestServerVolumeAttachmentScenario-1345303408 None] Acquiring lock "cinder-quobyte-4b8762e6-f4ad-44b7-bed1-be69dbe129dc" by "delete_volume" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:35:34 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4cadd1c-ea0a-4b23-9c8d-4826c310a1df]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:35:34 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-4cf25cce-2007-460a-a43b-f7a6b485b6dc tempest-GroupSnapshotsV319Test-1873872264 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-b1efc37f-42b1-47bf-9e1f-bd12419d2547 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:35:34 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-686272e5-5ff3-4ee5-bddb-505b0b134ac2 tempest-TestServerVolumeAttachmentScenario-1345303408 None] Lock "cinder-quobyte-4b8762e6-f4ad-44b7-bed1-be69dbe129dc" acquired by "delete_volume" :: waited 0.035s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:35:34 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[c28212ee-df7b-44e0-8e0d-1fbd5c2328e8]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:35:34 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-686272e5-5ff3-4ee5-bddb-505b0b134ac2 tempest-TestServerVolumeAttachmentScenario-1345303408 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-4b8762e6-f4ad-44b7-bed1-be69dbe129dc {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:35:34 devstack sudo[98891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-b1efc37f-42b1-47bf-9e1f-bd12419d2547 Aug 03 08:35:34 devstack sudo[98891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:35:34 devstack sudo[98892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-4b8762e6-f4ad-44b7-bed1-be69dbe129dc Aug 03 08:35:34 devstack sudo[98892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:35:34 devstack sudo[98891]: pam_unix(sudo:session): session closed for user root Aug 03 08:35:34 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-4cf25cce-2007-460a-a43b-f7a6b485b6dc tempest-GroupSnapshotsV319Test-1873872264 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-b1efc37f-42b1-47bf-9e1f-bd12419d2547" returned: 0 in 0.407s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:35:34 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-4cf25cce-2007-460a-a43b-f7a6b485b6dc tempest-GroupSnapshotsV319Test-1873872264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-b1efc37f-42b1-47bf-9e1f-bd12419d2547,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-b1efc37f-42b1-47bf-9e1f-bd12419d2547.0dbb74e8-383b-443d-9bc8-2dbd752d0ded 1G {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:35:34 devstack sudo[98899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-b1efc37f-42b1-47bf-9e1f-bd12419d2547,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-b1efc37f-42b1-47bf-9e1f-bd12419d2547.0dbb74e8-383b-443d-9bc8-2dbd752d0ded 1G Aug 03 08:35:34 devstack sudo[98899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:35:34 devstack sudo[98892]: pam_unix(sudo:session): session closed for user root Aug 03 08:35:34 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-686272e5-5ff3-4ee5-bddb-505b0b134ac2 tempest-TestServerVolumeAttachmentScenario-1345303408 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-4b8762e6-f4ad-44b7-bed1-be69dbe129dc" returned: 0 in 0.519s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:35:34 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-686272e5-5ff3-4ee5-bddb-505b0b134ac2 tempest-TestServerVolumeAttachmentScenario-1345303408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-4b8762e6-f4ad-44b7-bed1-be69dbe129dc {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:35:34 devstack sudo[98904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-4b8762e6-f4ad-44b7-bed1-be69dbe129dc Aug 03 08:35:34 devstack sudo[98904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:35:35 devstack sudo[98904]: pam_unix(sudo:session): session closed for user root Aug 03 08:35:35 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-686272e5-5ff3-4ee5-bddb-505b0b134ac2 tempest-TestServerVolumeAttachmentScenario-1345303408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-4b8762e6-f4ad-44b7-bed1-be69dbe129dc" returned: 0 in 0.358s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:35:35 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-686272e5-5ff3-4ee5-bddb-505b0b134ac2 tempest-TestServerVolumeAttachmentScenario-1345303408 None] Lock "cinder-quobyte-4b8762e6-f4ad-44b7-bed1-be69dbe129dc" released by "delete_volume" :: held 0.956s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:35:35 devstack sudo[98899]: pam_unix(sudo:session): session closed for user root Aug 03 08:35:35 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-4cf25cce-2007-460a-a43b-f7a6b485b6dc tempest-GroupSnapshotsV319Test-1873872264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-b1efc37f-42b1-47bf-9e1f-bd12419d2547,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-b1efc37f-42b1-47bf-9e1f-bd12419d2547.0dbb74e8-383b-443d-9bc8-2dbd752d0ded 1G" returned: 0 in 0.670s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:35:35 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-4cf25cce-2007-460a-a43b-f7a6b485b6dc tempest-GroupSnapshotsV319Test-1873872264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b1efc37f-42b1-47bf-9e1f-bd12419d2547 -F qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-b1efc37f-42b1-47bf-9e1f-bd12419d2547.0dbb74e8-383b-443d-9bc8-2dbd752d0ded {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:35:35 devstack cinder-volume[88899]: DEBUG cinder.quota [None req-686272e5-5ff3-4ee5-bddb-505b0b134ac2 tempest-TestServerVolumeAttachmentScenario-1345303408 None] Created reservations ['ece8b819-3942-4263-b9a1-09db7ade6498', '1ec50a18-4e20-44a3-bd6b-a70b3e8f9178', '1b05f098-3cbd-4061-b440-123b5c91ea24', 'c9f0be07-e2a1-4c4a-91ab-31a76533962c'] {{(pid=88899) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 08:35:35 devstack sudo[98910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b1efc37f-42b1-47bf-9e1f-bd12419d2547 -F qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-b1efc37f-42b1-47bf-9e1f-bd12419d2547.0dbb74e8-383b-443d-9bc8-2dbd752d0ded Aug 03 08:35:35 devstack sudo[98910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:35:35 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-686272e5-5ff3-4ee5-bddb-505b0b134ac2 tempest-TestServerVolumeAttachmentScenario-1345303408 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:35:35 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-686272e5-5ff3-4ee5-bddb-505b0b134ac2 tempest-TestServerVolumeAttachmentScenario-1345303408 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:35:35 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-686272e5-5ff3-4ee5-bddb-505b0b134ac2 tempest-TestServerVolumeAttachmentScenario-1345303408 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:35:35 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-686272e5-5ff3-4ee5-bddb-505b0b134ac2 tempest-TestServerVolumeAttachmentScenario-1345303408 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:35:35 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-686272e5-5ff3-4ee5-bddb-505b0b134ac2 tempest-TestServerVolumeAttachmentScenario-1345303408 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:35:35 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-686272e5-5ff3-4ee5-bddb-505b0b134ac2 tempest-TestServerVolumeAttachmentScenario-1345303408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:35:35 devstack sudo[98912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a Aug 03 08:35:35 devstack sudo[98912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:35:35 devstack sudo[98912]: pam_unix(sudo:session): session closed for user root Aug 03 08:35:35 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-686272e5-5ff3-4ee5-bddb-505b0b134ac2 tempest-TestServerVolumeAttachmentScenario-1345303408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a" returned: 0 in 0.282s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:35:35 devstack cinder-volume[88899]: DEBUG cinder.manager [None req-686272e5-5ff3-4ee5-bddb-505b0b134ac2 tempest-TestServerVolumeAttachmentScenario-1345303408 None] Notifying Schedulers of capabilities ... {{(pid=88899) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 08:35:35 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-686272e5-5ff3-4ee5-bddb-505b0b134ac2 tempest-TestServerVolumeAttachmentScenario-1345303408 None] Deleted volume successfully. Aug 03 08:35:35 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-686272e5-5ff3-4ee5-bddb-505b0b134ac2 tempest-TestServerVolumeAttachmentScenario-1345303408 None] Lock "cinder-4b8762e6-f4ad-44b7-bed1-be69dbe129dc-delete_volume" released by "delete_volume" :: held 1.613s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:35:35 devstack sudo[98910]: pam_unix(sudo:session): session closed for user root Aug 03 08:35:35 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-4cf25cce-2007-460a-a43b-f7a6b485b6dc tempest-GroupSnapshotsV319Test-1873872264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b1efc37f-42b1-47bf-9e1f-bd12419d2547 -F qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-b1efc37f-42b1-47bf-9e1f-bd12419d2547.0dbb74e8-383b-443d-9bc8-2dbd752d0ded" returned: 0 in 0.530s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:35:35 devstack cinder-volume[88899]: WARNING cinder.volume.drivers.remotefs [None req-4cf25cce-2007-460a-a43b-f7a6b485b6dc tempest-GroupSnapshotsV319Test-1873872264 None] /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-b1efc37f-42b1-47bf-9e1f-bd12419d2547.0dbb74e8-383b-443d-9bc8-2dbd752d0ded is being set with open permissions: ugo+rw: NotImplementedError Aug 03 08:35:35 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-4cf25cce-2007-460a-a43b-f7a6b485b6dc tempest-GroupSnapshotsV319Test-1873872264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-b1efc37f-42b1-47bf-9e1f-bd12419d2547.0dbb74e8-383b-443d-9bc8-2dbd752d0ded {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:35:35 devstack sudo[98919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-b1efc37f-42b1-47bf-9e1f-bd12419d2547.0dbb74e8-383b-443d-9bc8-2dbd752d0ded Aug 03 08:35:35 devstack sudo[98919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:35:35 devstack sudo[98919]: pam_unix(sudo:session): session closed for user root Aug 03 08:35:35 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-4cf25cce-2007-460a-a43b-f7a6b485b6dc tempest-GroupSnapshotsV319Test-1873872264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-b1efc37f-42b1-47bf-9e1f-bd12419d2547.0dbb74e8-383b-443d-9bc8-2dbd752d0ded" returned: 0 in 0.278s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:35:36 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-4cf25cce-2007-460a-a43b-f7a6b485b6dc tempest-GroupSnapshotsV319Test-1873872264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-b1efc37f-42b1-47bf-9e1f-bd12419d2547.info {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:35:36 devstack sudo[98922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-b1efc37f-42b1-47bf-9e1f-bd12419d2547.info Aug 03 08:35:36 devstack sudo[98922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:35:36 devstack sudo[98922]: pam_unix(sudo:session): session closed for user root Aug 03 08:35:36 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-4cf25cce-2007-460a-a43b-f7a6b485b6dc tempest-GroupSnapshotsV319Test-1873872264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-b1efc37f-42b1-47bf-9e1f-bd12419d2547.info" returned: 0 in 0.314s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:35:36 devstack cinder-volume[88899]: WARNING cinder.volume.drivers.remotefs [None req-4cf25cce-2007-460a-a43b-f7a6b485b6dc tempest-GroupSnapshotsV319Test-1873872264 None] /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-b1efc37f-42b1-47bf-9e1f-bd12419d2547.info is being set with open permissions: ugo+rw: NotImplementedError Aug 03 08:35:36 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-4cf25cce-2007-460a-a43b-f7a6b485b6dc tempest-GroupSnapshotsV319Test-1873872264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-b1efc37f-42b1-47bf-9e1f-bd12419d2547.info {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:35:36 devstack sudo[98925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-b1efc37f-42b1-47bf-9e1f-bd12419d2547.info Aug 03 08:35:36 devstack sudo[98925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:35:36 devstack sudo[98925]: pam_unix(sudo:session): session closed for user root Aug 03 08:35:36 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-4cf25cce-2007-460a-a43b-f7a6b485b6dc tempest-GroupSnapshotsV319Test-1873872264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-b1efc37f-42b1-47bf-9e1f-bd12419d2547.info" returned: 0 in 0.282s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:35:36 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-4cf25cce-2007-460a-a43b-f7a6b485b6dc tempest-GroupSnapshotsV319Test-1873872264 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.604s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:35:36 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-4cf25cce-2007-460a-a43b-f7a6b485b6dc tempest-GroupSnapshotsV319Test-1873872264 None] group_snapshot 20f6a653-2e42-47e0-838e-0cd161ecc110: created successfully Aug 03 08:35:37 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-97df8943-a78d-4fb3-9b28-d7e5301cccca tempest-GroupSnapshotsV319Test-1873872264 None] group_snapshot 20f6a653-2e42-47e0-838e-0cd161ecc110: deleting Aug 03 08:35:37 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-97df8943-a78d-4fb3-9b28-d7e5301cccca tempest-GroupSnapshotsV319Test-1873872264 None] group_snapshot 20f6a653-2e42-47e0-838e-0cd161ecc110: deleting {{(pid=88899) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Aug 03 08:35:37 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-97df8943-a78d-4fb3-9b28-d7e5301cccca tempest-GroupSnapshotsV319Test-1873872264 None] Acquiring lock "cinder-quobyte-b1efc37f-42b1-47bf-9e1f-bd12419d2547" by "delete_snapshot" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:35:37 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-97df8943-a78d-4fb3-9b28-d7e5301cccca tempest-GroupSnapshotsV319Test-1873872264 None] Lock "cinder-quobyte-b1efc37f-42b1-47bf-9e1f-bd12419d2547" acquired by "delete_snapshot" :: waited 0.049s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:35:37 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-97df8943-a78d-4fb3-9b28-d7e5301cccca tempest-GroupSnapshotsV319Test-1873872264 None] Acquiring lock "cinder-quobyte-0dbb74e8-383b-443d-9bc8-2dbd752d0ded" by "_delete_snapshot" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:35:37 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-97df8943-a78d-4fb3-9b28-d7e5301cccca tempest-GroupSnapshotsV319Test-1873872264 None] Lock "cinder-quobyte-0dbb74e8-383b-443d-9bc8-2dbd752d0ded" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:35:37 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-97df8943-a78d-4fb3-9b28-d7e5301cccca tempest-GroupSnapshotsV319Test-1873872264 None] Deleting offline snapshot 0dbb74e8-383b-443d-9bc8-2dbd752d0ded of volume b1efc37f-42b1-47bf-9e1f-bd12419d2547 {{(pid=88899) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 03 08:35:37 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-97df8943-a78d-4fb3-9b28-d7e5301cccca tempest-GroupSnapshotsV319Test-1873872264 None] snapshot_file for this snap is: volume-b1efc37f-42b1-47bf-9e1f-bd12419d2547.0dbb74e8-383b-443d-9bc8-2dbd752d0ded {{(pid=88899) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 03 08:35:37 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb8cd342-b114-4c35-842d-44901b9c1532]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:35:37 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-97df8943-a78d-4fb3-9b28-d7e5301cccca tempest-GroupSnapshotsV319Test-1873872264 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-b1efc37f-42b1-47bf-9e1f-bd12419d2547.0dbb74e8-383b-443d-9bc8-2dbd752d0ded {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:35:38 devstack sudo[98929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-b1efc37f-42b1-47bf-9e1f-bd12419d2547.0dbb74e8-383b-443d-9bc8-2dbd752d0ded Aug 03 08:35:38 devstack sudo[98929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:35:38 devstack sudo[98929]: pam_unix(sudo:session): session closed for user root Aug 03 08:35:38 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-97df8943-a78d-4fb3-9b28-d7e5301cccca tempest-GroupSnapshotsV319Test-1873872264 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-b1efc37f-42b1-47bf-9e1f-bd12419d2547.0dbb74e8-383b-443d-9bc8-2dbd752d0ded" returned: 0 in 0.485s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:35:38 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-97df8943-a78d-4fb3-9b28-d7e5301cccca tempest-GroupSnapshotsV319Test-1873872264 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b1efc37f-42b1-47bf-9e1f-bd12419d2547(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88899) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 03 08:35:38 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[69d5db03-25fd-4d0f-be40-a668871066bc]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:35:38 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-97df8943-a78d-4fb3-9b28-d7e5301cccca tempest-GroupSnapshotsV319Test-1873872264 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-b1efc37f-42b1-47bf-9e1f-bd12419d2547 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:35:38 devstack sudo[98935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-b1efc37f-42b1-47bf-9e1f-bd12419d2547 Aug 03 08:35:38 devstack sudo[98935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:35:38 devstack sudo[98935]: pam_unix(sudo:session): session closed for user root Aug 03 08:35:38 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-97df8943-a78d-4fb3-9b28-d7e5301cccca tempest-GroupSnapshotsV319Test-1873872264 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-b1efc37f-42b1-47bf-9e1f-bd12419d2547" returned: 0 in 0.460s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:35:38 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-97df8943-a78d-4fb3-9b28-d7e5301cccca tempest-GroupSnapshotsV319Test-1873872264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-b1efc37f-42b1-47bf-9e1f-bd12419d2547.0dbb74e8-383b-443d-9bc8-2dbd752d0ded {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:35:38 devstack sudo[98940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-b1efc37f-42b1-47bf-9e1f-bd12419d2547.0dbb74e8-383b-443d-9bc8-2dbd752d0ded Aug 03 08:35:38 devstack sudo[98940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:35:39 devstack sudo[98940]: pam_unix(sudo:session): session closed for user root Aug 03 08:35:39 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-97df8943-a78d-4fb3-9b28-d7e5301cccca tempest-GroupSnapshotsV319Test-1873872264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-b1efc37f-42b1-47bf-9e1f-bd12419d2547.0dbb74e8-383b-443d-9bc8-2dbd752d0ded" returned: 0 in 0.541s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:35:39 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-97df8943-a78d-4fb3-9b28-d7e5301cccca tempest-GroupSnapshotsV319Test-1873872264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-b1efc37f-42b1-47bf-9e1f-bd12419d2547.0dbb74e8-383b-443d-9bc8-2dbd752d0ded {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:35:39 devstack sudo[98945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-b1efc37f-42b1-47bf-9e1f-bd12419d2547.0dbb74e8-383b-443d-9bc8-2dbd752d0ded Aug 03 08:35:39 devstack sudo[98945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:35:39 devstack sudo[98945]: pam_unix(sudo:session): session closed for user root Aug 03 08:35:39 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-97df8943-a78d-4fb3-9b28-d7e5301cccca tempest-GroupSnapshotsV319Test-1873872264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-b1efc37f-42b1-47bf-9e1f-bd12419d2547.0dbb74e8-383b-443d-9bc8-2dbd752d0ded" returned: 0 in 0.428s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:35:39 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-97df8943-a78d-4fb3-9b28-d7e5301cccca tempest-GroupSnapshotsV319Test-1873872264 None] Lock "cinder-quobyte-0dbb74e8-383b-443d-9bc8-2dbd752d0ded" released by "_delete_snapshot" :: held 2.056s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:35:39 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-97df8943-a78d-4fb3-9b28-d7e5301cccca tempest-GroupSnapshotsV319Test-1873872264 None] Lock "cinder-quobyte-b1efc37f-42b1-47bf-9e1f-bd12419d2547" released by "delete_snapshot" :: held 2.086s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:35:40 devstack cinder-volume[88899]: WARNING cinder.quota [None req-97df8943-a78d-4fb3-9b28-d7e5301cccca tempest-GroupSnapshotsV319Test-1873872264 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1489358605 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1489358605, it is now deprecated. Please use the default quota class for default quota. Aug 03 08:35:40 devstack cinder-volume[88899]: WARNING cinder.quota [None req-97df8943-a78d-4fb3-9b28-d7e5301cccca tempest-GroupSnapshotsV319Test-1873872264 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-1489358605 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-1489358605, it is now deprecated. Please use the default quota class for default quota. Aug 03 08:35:40 devstack cinder-volume[88899]: DEBUG cinder.quota [None req-97df8943-a78d-4fb3-9b28-d7e5301cccca tempest-GroupSnapshotsV319Test-1873872264 None] Created reservations ['9e9d6d00-fb67-4508-a357-576554eb95c7', 'b38a1e85-2a05-4c4e-92bf-29af423f7eb4', 'c6410cd9-3e5a-4ca4-8803-10225bc5e6af', '05f76d27-f217-4268-b215-9b4cd85660cc'] {{(pid=88899) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 08:35:40 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-97df8943-a78d-4fb3-9b28-d7e5301cccca tempest-GroupSnapshotsV319Test-1873872264 None] group_snapshot 20f6a653-2e42-47e0-838e-0cd161ecc110: deleted successfully Aug 03 08:35:41 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-b7ae039c-c18a-4b7a-bffa-bd8a4d7106bb tempest-GroupSnapshotsV319Test-1873872264 None] Acquiring lock "cinder-quobyte-b1efc37f-42b1-47bf-9e1f-bd12419d2547" by "delete_volume" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:35:41 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-b7ae039c-c18a-4b7a-bffa-bd8a4d7106bb tempest-GroupSnapshotsV319Test-1873872264 None] Lock "cinder-quobyte-b1efc37f-42b1-47bf-9e1f-bd12419d2547" acquired by "delete_volume" :: waited 0.040s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:35:41 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[72a393ac-c7d1-44eb-bb98-263f752840bf]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:35:41 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-b7ae039c-c18a-4b7a-bffa-bd8a4d7106bb tempest-GroupSnapshotsV319Test-1873872264 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-b1efc37f-42b1-47bf-9e1f-bd12419d2547 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:35:41 devstack sudo[98951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-b1efc37f-42b1-47bf-9e1f-bd12419d2547 Aug 03 08:35:41 devstack sudo[98951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:35:42 devstack sudo[98951]: pam_unix(sudo:session): session closed for user root Aug 03 08:35:42 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-b7ae039c-c18a-4b7a-bffa-bd8a4d7106bb tempest-GroupSnapshotsV319Test-1873872264 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-b1efc37f-42b1-47bf-9e1f-bd12419d2547" returned: 0 in 0.743s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:35:42 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-b7ae039c-c18a-4b7a-bffa-bd8a4d7106bb tempest-GroupSnapshotsV319Test-1873872264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-b1efc37f-42b1-47bf-9e1f-bd12419d2547 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:35:42 devstack sudo[98957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-b1efc37f-42b1-47bf-9e1f-bd12419d2547 Aug 03 08:35:42 devstack sudo[98957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:35:42 devstack sudo[98957]: pam_unix(sudo:session): session closed for user root Aug 03 08:35:42 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-b7ae039c-c18a-4b7a-bffa-bd8a4d7106bb tempest-GroupSnapshotsV319Test-1873872264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-b1efc37f-42b1-47bf-9e1f-bd12419d2547" returned: 0 in 0.468s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:35:43 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-b7ae039c-c18a-4b7a-bffa-bd8a4d7106bb tempest-GroupSnapshotsV319Test-1873872264 None] Lock "cinder-quobyte-b1efc37f-42b1-47bf-9e1f-bd12419d2547" released by "delete_volume" :: held 1.359s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:35:43 devstack cinder-volume[88899]: DEBUG cinder.quota [None req-b7ae039c-c18a-4b7a-bffa-bd8a4d7106bb tempest-GroupSnapshotsV319Test-1873872264 None] Created reservations ['e81be984-6b20-4a47-bec1-35b8b6414d8c'] {{(pid=88899) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 08:35:43 devstack cinder-volume[88899]: WARNING cinder.quota [None req-b7ae039c-c18a-4b7a-bffa-bd8a4d7106bb tempest-GroupSnapshotsV319Test-1873872264 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-1489358605 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-1489358605, it is now deprecated. Please use the default quota class for default quota. Aug 03 08:35:43 devstack cinder-volume[88899]: DEBUG cinder.quota [None req-b7ae039c-c18a-4b7a-bffa-bd8a4d7106bb tempest-GroupSnapshotsV319Test-1873872264 None] Created reservations ['8fee2bc3-fe24-4d65-beac-24580e334238', '97630c7c-f681-4db5-9e8a-aa38006d9e3a', '11730b08-75cc-4919-b773-fdc732f58e2c', '66431246-4438-481e-a36c-3f3b3a378f59'] {{(pid=88899) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 08:35:43 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-b7ae039c-c18a-4b7a-bffa-bd8a4d7106bb tempest-GroupSnapshotsV319Test-1873872264 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:35:43 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-b7ae039c-c18a-4b7a-bffa-bd8a4d7106bb tempest-GroupSnapshotsV319Test-1873872264 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:35:43 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-b7ae039c-c18a-4b7a-bffa-bd8a4d7106bb tempest-GroupSnapshotsV319Test-1873872264 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:35:43 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-b7ae039c-c18a-4b7a-bffa-bd8a4d7106bb tempest-GroupSnapshotsV319Test-1873872264 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:35:43 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-b7ae039c-c18a-4b7a-bffa-bd8a4d7106bb tempest-GroupSnapshotsV319Test-1873872264 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:35:43 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-b7ae039c-c18a-4b7a-bffa-bd8a4d7106bb tempest-GroupSnapshotsV319Test-1873872264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:35:43 devstack sudo[98963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a Aug 03 08:35:43 devstack sudo[98963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:35:44 devstack sudo[98963]: pam_unix(sudo:session): session closed for user root Aug 03 08:35:44 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-b7ae039c-c18a-4b7a-bffa-bd8a4d7106bb tempest-GroupSnapshotsV319Test-1873872264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a" returned: 0 in 0.605s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:35:44 devstack cinder-volume[88899]: DEBUG cinder.manager [None req-b7ae039c-c18a-4b7a-bffa-bd8a4d7106bb tempest-GroupSnapshotsV319Test-1873872264 None] Notifying Schedulers of capabilities ... {{(pid=88899) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 08:35:44 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-b7ae039c-c18a-4b7a-bffa-bd8a4d7106bb tempest-GroupSnapshotsV319Test-1873872264 None] Delete group completed successfully. Aug 03 08:35:51 devstack cinder-volume[88899]: DEBUG oslo_service.periodic_task [None req-f948fb4a-c4d7-499f-b1bd-8d6be3de0b53 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88899) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 03 08:35:51 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-f948fb4a-c4d7-499f-b1bd-8d6be3de0b53 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:35:51 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-f948fb4a-c4d7-499f-b1bd-8d6be3de0b53 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:35:51 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-f948fb4a-c4d7-499f-b1bd-8d6be3de0b53 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:35:51 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-f948fb4a-c4d7-499f-b1bd-8d6be3de0b53 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:35:51 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-f948fb4a-c4d7-499f-b1bd-8d6be3de0b53 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:35:51 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-f948fb4a-c4d7-499f-b1bd-8d6be3de0b53 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:35:51 devstack sudo[99007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a Aug 03 08:35:51 devstack sudo[99007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:35:52 devstack sudo[99007]: pam_unix(sudo:session): session closed for user root Aug 03 08:35:52 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-f948fb4a-c4d7-499f-b1bd-8d6be3de0b53 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a" returned: 0 in 0.438s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:35:52 devstack cinder-volume[88899]: DEBUG cinder.manager [None req-f948fb4a-c4d7-499f-b1bd-8d6be3de0b53 None None] Notifying Schedulers of capabilities ... {{(pid=88899) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 08:35:52 devstack cinder-volume[88899]: DEBUG oslo_service.periodic_task [None req-f948fb4a-c4d7-499f-b1bd-8d6be3de0b53 None None] Running periodic task VolumeManager._thread_info {{(pid=88899) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 03 08:35:52 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-f948fb4a-c4d7-499f-b1bd-8d6be3de0b53 None None] thread count: 28 {{(pid=88899) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 03 08:35:52 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-f948fb4a-c4d7-499f-b1bd-8d6be3de0b53 None None] thread info: [<_MainThread(MainThread, started 132234320248960)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88899) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 03 08:35:53 devstack cinder-volume[88899]: DEBUG dbcounter [-] [88899] Writing DB stats cinder:UPDATE=56,cinder:SELECT=36,cinder:INSERT=15,cinder:DELETE=2 {{(pid=88899) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 03 08:35:53 devstack cinder-volume[88899]: DEBUG dbcounter [-] [88899] Writing DB stats cinder:UPDATE=44,cinder:DELETE=3,cinder:SELECT=45,cinder:INSERT=9 {{(pid=88899) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 03 08:36:10 devstack cinder-volume[88899]: DEBUG cinder.volume.flows.manager.create_volume [None req-68e3159b-b9a2-4b63-8d43-47b8563b4ad8 tempest-SnapshotsActionsTest-2081672924 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88899) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 08:36:10 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-68e3159b-b9a2-4b63-8d43-47b8563b4ad8 tempest-SnapshotsActionsTest-2081672924 None] Flow 'volume_create_manager' (0e5e20b8-8b93-4e2d-acd3-3030e36cb55a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:36:10 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-68e3159b-b9a2-4b63-8d43-47b8563b4ad8 tempest-SnapshotsActionsTest-2081672924 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1eed37c0-c9f8-41d5-966b-dc4959926655) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:36:10 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-68e3159b-b9a2-4b63-8d43-47b8563b4ad8 tempest-SnapshotsActionsTest-2081672924 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1eed37c0-c9f8-41d5-966b-dc4959926655) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:36:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-408771466',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b82f4208-7884-4e40-b208-2865320cd5a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='acda8701d8de4bd6ab2c4248fef33782',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:36:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:36:10Z,use_quota=True,user_id='4afcf2961eef438684d4f17bb88cff41',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8bde7129-1dc4-42ab-b852-ab32c61b4921),volume_type_id=8bde7129-1dc4-42ab-b852-ab32c61b4921)' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:36:10 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-68e3159b-b9a2-4b63-8d43-47b8563b4ad8 tempest-SnapshotsActionsTest-2081672924 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a3170ca-dd5a-4f4e-ad96-f7a37a2cfcc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:36:10 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-68e3159b-b9a2-4b63-8d43-47b8563b4ad8 tempest-SnapshotsActionsTest-2081672924 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a3170ca-dd5a-4f4e-ad96-f7a37a2cfcc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:36:10 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-68e3159b-b9a2-4b63-8d43-47b8563b4ad8 tempest-SnapshotsActionsTest-2081672924 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fdfe4830-d94f-487c-806f-da970c003a7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:36:10 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-68e3159b-b9a2-4b63-8d43-47b8563b4ad8 tempest-SnapshotsActionsTest-2081672924 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fdfe4830-d94f-487c-806f-da970c003a7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b82f4208-7884-4e40-b208-2865320cd5a4', 'volume_name': 'volume-b82f4208-7884-4e40-b208-2865320cd5a4', 'volume_size': 1}' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:36:10 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-68e3159b-b9a2-4b63-8d43-47b8563b4ad8 tempest-SnapshotsActionsTest-2081672924 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (356cdb50-e92b-493e-a573-998e200f136f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:36:10 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-68e3159b-b9a2-4b63-8d43-47b8563b4ad8 tempest-SnapshotsActionsTest-2081672924 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (356cdb50-e92b-493e-a573-998e200f136f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:36:10 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-68e3159b-b9a2-4b63-8d43-47b8563b4ad8 tempest-SnapshotsActionsTest-2081672924 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c880c41-d0e4-4db2-8a1f-4a2c894546c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:36:10 devstack cinder-volume[88899]: INFO cinder.volume.flows.manager.create_volume [None req-68e3159b-b9a2-4b63-8d43-47b8563b4ad8 tempest-SnapshotsActionsTest-2081672924 None] Volume b82f4208-7884-4e40-b208-2865320cd5a4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b82f4208-7884-4e40-b208-2865320cd5a4', 'volume_size': 1} Aug 03 08:36:10 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-68e3159b-b9a2-4b63-8d43-47b8563b4ad8 tempest-SnapshotsActionsTest-2081672924 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:36:10 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-68e3159b-b9a2-4b63-8d43-47b8563b4ad8 tempest-SnapshotsActionsTest-2081672924 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:36:10 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-68e3159b-b9a2-4b63-8d43-47b8563b4ad8 tempest-SnapshotsActionsTest-2081672924 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:36:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-408771466',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b82f4208-7884-4e40-b208-2865320cd5a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='acda8701d8de4bd6ab2c4248fef33782',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:36:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:36:10Z,use_quota=True,user_id='4afcf2961eef438684d4f17bb88cff41',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8bde7129-1dc4-42ab-b852-ab32c61b4921),volume_type_id=8bde7129-1dc4-42ab-b852-ab32c61b4921)}" {{(pid=88899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 08:36:10 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-68e3159b-b9a2-4b63-8d43-47b8563b4ad8 tempest-SnapshotsActionsTest-2081672924 None] Creating volume b82f4208-7884-4e40-b208-2865320cd5a4 {{(pid=88899) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 08:36:10 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-68e3159b-b9a2-4b63-8d43-47b8563b4ad8 tempest-SnapshotsActionsTest-2081672924 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:36:10 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-68e3159b-b9a2-4b63-8d43-47b8563b4ad8 tempest-SnapshotsActionsTest-2081672924 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:36:10 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-68e3159b-b9a2-4b63-8d43-47b8563b4ad8 tempest-SnapshotsActionsTest-2081672924 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:36:10 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-68e3159b-b9a2-4b63-8d43-47b8563b4ad8 tempest-SnapshotsActionsTest-2081672924 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:36:10 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-68e3159b-b9a2-4b63-8d43-47b8563b4ad8 tempest-SnapshotsActionsTest-2081672924 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:36:10 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-68e3159b-b9a2-4b63-8d43-47b8563b4ad8 tempest-SnapshotsActionsTest-2081672924 None] Selected osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385 as target Quobyte volume. {{(pid=88899) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 08:36:10 devstack cinder-volume[88899]: INFO cinder.volume.drivers.remotefs [None req-68e3159b-b9a2-4b63-8d43-47b8563b4ad8 tempest-SnapshotsActionsTest-2081672924 None] casted to osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385 Aug 03 08:36:10 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-68e3159b-b9a2-4b63-8d43-47b8563b4ad8 tempest-SnapshotsActionsTest-2081672924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-b82f4208-7884-4e40-b208-2865320cd5a4 1073741824 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:36:10 devstack sudo[99197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-b82f4208-7884-4e40-b208-2865320cd5a4 1073741824 Aug 03 08:36:10 devstack sudo[99197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:36:11 devstack sudo[99197]: pam_unix(sudo:session): session closed for user root Aug 03 08:36:11 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-68e3159b-b9a2-4b63-8d43-47b8563b4ad8 tempest-SnapshotsActionsTest-2081672924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-b82f4208-7884-4e40-b208-2865320cd5a4 1073741824" returned: 0 in 0.801s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:36:11 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-68e3159b-b9a2-4b63-8d43-47b8563b4ad8 tempest-SnapshotsActionsTest-2081672924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-b82f4208-7884-4e40-b208-2865320cd5a4 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:36:11 devstack sudo[99203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-b82f4208-7884-4e40-b208-2865320cd5a4 Aug 03 08:36:11 devstack sudo[99203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:36:11 devstack sudo[99203]: pam_unix(sudo:session): session closed for user root Aug 03 08:36:11 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-68e3159b-b9a2-4b63-8d43-47b8563b4ad8 tempest-SnapshotsActionsTest-2081672924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-b82f4208-7884-4e40-b208-2865320cd5a4" returned: 0 in 0.411s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:36:11 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-68e3159b-b9a2-4b63-8d43-47b8563b4ad8 tempest-SnapshotsActionsTest-2081672924 None] <== create_volume: return (1336ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'} {{(pid=88899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 08:36:11 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-68e3159b-b9a2-4b63-8d43-47b8563b4ad8 tempest-SnapshotsActionsTest-2081672924 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.340s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:36:12 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-68e3159b-b9a2-4b63-8d43-47b8563b4ad8 tempest-SnapshotsActionsTest-2081672924 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c880c41-d0e4-4db2-8a1f-4a2c894546c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b82f4208-7884-4e40-b208-2865320cd5a4', 'volume_size': 1}' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:36:12 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-68e3159b-b9a2-4b63-8d43-47b8563b4ad8 tempest-SnapshotsActionsTest-2081672924 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (142bc335-6037-4769-abae-2e80e1d106a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:36:12 devstack cinder-volume[88899]: INFO cinder.volume.flows.manager.create_volume [None req-68e3159b-b9a2-4b63-8d43-47b8563b4ad8 tempest-SnapshotsActionsTest-2081672924 None] Volume volume-b82f4208-7884-4e40-b208-2865320cd5a4 (b82f4208-7884-4e40-b208-2865320cd5a4): created successfully Aug 03 08:36:12 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-68e3159b-b9a2-4b63-8d43-47b8563b4ad8 tempest-SnapshotsActionsTest-2081672924 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (142bc335-6037-4769-abae-2e80e1d106a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:36:12 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-68e3159b-b9a2-4b63-8d43-47b8563b4ad8 tempest-SnapshotsActionsTest-2081672924 None] Flow 'volume_create_manager' (0e5e20b8-8b93-4e2d-acd3-3030e36cb55a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:36:12 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-68e3159b-b9a2-4b63-8d43-47b8563b4ad8 tempest-SnapshotsActionsTest-2081672924 None] Created volume successfully. Aug 03 08:36:13 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-8d941e74-a683-4638-872e-e77cc9426ad1 tempest-SnapshotsActionsTest-2081672924 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:36:13 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-8d941e74-a683-4638-872e-e77cc9426ad1 tempest-SnapshotsActionsTest-2081672924 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:36:13 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-8d941e74-a683-4638-872e-e77cc9426ad1 tempest-SnapshotsActionsTest-2081672924 None] Creating offline snapshot 4f676038-43ab-43f3-8c50-3cbace0c9f5f of volume b82f4208-7884-4e40-b208-2865320cd5a4 {{(pid=88899) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 03 08:36:13 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d6edca8-fdd0-4aa4-aef9-cc862f022940]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:36:13 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-8d941e74-a683-4638-872e-e77cc9426ad1 tempest-SnapshotsActionsTest-2081672924 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-b82f4208-7884-4e40-b208-2865320cd5a4 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:36:13 devstack sudo[99257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-b82f4208-7884-4e40-b208-2865320cd5a4 Aug 03 08:36:13 devstack sudo[99257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:36:13 devstack sudo[99257]: pam_unix(sudo:session): session closed for user root Aug 03 08:36:13 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-8d941e74-a683-4638-872e-e77cc9426ad1 tempest-SnapshotsActionsTest-2081672924 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-b82f4208-7884-4e40-b208-2865320cd5a4" returned: 0 in 0.502s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:36:13 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-8d941e74-a683-4638-872e-e77cc9426ad1 tempest-SnapshotsActionsTest-2081672924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-b82f4208-7884-4e40-b208-2865320cd5a4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-b82f4208-7884-4e40-b208-2865320cd5a4.4f676038-43ab-43f3-8c50-3cbace0c9f5f 1G {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:36:13 devstack sudo[99263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-b82f4208-7884-4e40-b208-2865320cd5a4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-b82f4208-7884-4e40-b208-2865320cd5a4.4f676038-43ab-43f3-8c50-3cbace0c9f5f 1G Aug 03 08:36:13 devstack sudo[99263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:36:14 devstack sudo[99263]: pam_unix(sudo:session): session closed for user root Aug 03 08:36:14 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-8d941e74-a683-4638-872e-e77cc9426ad1 tempest-SnapshotsActionsTest-2081672924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-b82f4208-7884-4e40-b208-2865320cd5a4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-b82f4208-7884-4e40-b208-2865320cd5a4.4f676038-43ab-43f3-8c50-3cbace0c9f5f 1G" returned: 0 in 0.727s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:36:14 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-8d941e74-a683-4638-872e-e77cc9426ad1 tempest-SnapshotsActionsTest-2081672924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b82f4208-7884-4e40-b208-2865320cd5a4 -F qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-b82f4208-7884-4e40-b208-2865320cd5a4.4f676038-43ab-43f3-8c50-3cbace0c9f5f {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:36:14 devstack sudo[99277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b82f4208-7884-4e40-b208-2865320cd5a4 -F qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-b82f4208-7884-4e40-b208-2865320cd5a4.4f676038-43ab-43f3-8c50-3cbace0c9f5f Aug 03 08:36:14 devstack sudo[99277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:36:14 devstack sudo[99277]: pam_unix(sudo:session): session closed for user root Aug 03 08:36:14 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-8d941e74-a683-4638-872e-e77cc9426ad1 tempest-SnapshotsActionsTest-2081672924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b82f4208-7884-4e40-b208-2865320cd5a4 -F qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-b82f4208-7884-4e40-b208-2865320cd5a4.4f676038-43ab-43f3-8c50-3cbace0c9f5f" returned: 0 in 0.426s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:36:14 devstack cinder-volume[88899]: WARNING cinder.volume.drivers.remotefs [None req-8d941e74-a683-4638-872e-e77cc9426ad1 tempest-SnapshotsActionsTest-2081672924 None] /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-b82f4208-7884-4e40-b208-2865320cd5a4.4f676038-43ab-43f3-8c50-3cbace0c9f5f is being set with open permissions: ugo+rw Aug 03 08:36:14 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-8d941e74-a683-4638-872e-e77cc9426ad1 tempest-SnapshotsActionsTest-2081672924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-b82f4208-7884-4e40-b208-2865320cd5a4.4f676038-43ab-43f3-8c50-3cbace0c9f5f {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:36:14 devstack sudo[99293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-b82f4208-7884-4e40-b208-2865320cd5a4.4f676038-43ab-43f3-8c50-3cbace0c9f5f Aug 03 08:36:14 devstack sudo[99293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:36:15 devstack sudo[99293]: pam_unix(sudo:session): session closed for user root Aug 03 08:36:15 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-8d941e74-a683-4638-872e-e77cc9426ad1 tempest-SnapshotsActionsTest-2081672924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-b82f4208-7884-4e40-b208-2865320cd5a4.4f676038-43ab-43f3-8c50-3cbace0c9f5f" returned: 0 in 0.308s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:36:15 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-8d941e74-a683-4638-872e-e77cc9426ad1 tempest-SnapshotsActionsTest-2081672924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-b82f4208-7884-4e40-b208-2865320cd5a4.info {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:36:15 devstack sudo[99302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-b82f4208-7884-4e40-b208-2865320cd5a4.info Aug 03 08:36:15 devstack sudo[99302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:36:15 devstack sudo[99302]: pam_unix(sudo:session): session closed for user root Aug 03 08:36:15 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-8d941e74-a683-4638-872e-e77cc9426ad1 tempest-SnapshotsActionsTest-2081672924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-b82f4208-7884-4e40-b208-2865320cd5a4.info" returned: 0 in 0.285s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:36:15 devstack cinder-volume[88899]: WARNING cinder.volume.drivers.remotefs [None req-8d941e74-a683-4638-872e-e77cc9426ad1 tempest-SnapshotsActionsTest-2081672924 None] /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-b82f4208-7884-4e40-b208-2865320cd5a4.info is being set with open permissions: ugo+rw Aug 03 08:36:15 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-8d941e74-a683-4638-872e-e77cc9426ad1 tempest-SnapshotsActionsTest-2081672924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-b82f4208-7884-4e40-b208-2865320cd5a4.info {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:36:15 devstack sudo[99311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-b82f4208-7884-4e40-b208-2865320cd5a4.info Aug 03 08:36:15 devstack sudo[99311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:36:15 devstack sudo[99311]: pam_unix(sudo:session): session closed for user root Aug 03 08:36:15 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-8d941e74-a683-4638-872e-e77cc9426ad1 tempest-SnapshotsActionsTest-2081672924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-b82f4208-7884-4e40-b208-2865320cd5a4.info" returned: 0 in 0.370s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:36:15 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-8d941e74-a683-4638-872e-e77cc9426ad1 tempest-SnapshotsActionsTest-2081672924 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.787s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:36:15 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-8d941e74-a683-4638-872e-e77cc9426ad1 tempest-SnapshotsActionsTest-2081672924 None] Create snapshot completed successfully Aug 03 08:36:17 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-585749a7-4c7a-4d27-90d5-b413fb4a1336 tempest-SnapshotsActionsTest-2081672924 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:36:17 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-585749a7-4c7a-4d27-90d5-b413fb4a1336 tempest-SnapshotsActionsTest-2081672924 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:36:17 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-585749a7-4c7a-4d27-90d5-b413fb4a1336 tempest-SnapshotsActionsTest-2081672924 None] Creating offline snapshot a68b1e53-0a08-476c-88ff-ad51610efef1 of volume b82f4208-7884-4e40-b208-2865320cd5a4 {{(pid=88899) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 03 08:36:17 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ecbf74b-0655-4f2e-b20f-c784def69487]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:36:17 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-585749a7-4c7a-4d27-90d5-b413fb4a1336 tempest-SnapshotsActionsTest-2081672924 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-b82f4208-7884-4e40-b208-2865320cd5a4.4f676038-43ab-43f3-8c50-3cbace0c9f5f {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:36:17 devstack sudo[99339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-b82f4208-7884-4e40-b208-2865320cd5a4.4f676038-43ab-43f3-8c50-3cbace0c9f5f Aug 03 08:36:17 devstack sudo[99339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:36:18 devstack sudo[99339]: pam_unix(sudo:session): session closed for user root Aug 03 08:36:18 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-585749a7-4c7a-4d27-90d5-b413fb4a1336 tempest-SnapshotsActionsTest-2081672924 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-b82f4208-7884-4e40-b208-2865320cd5a4.4f676038-43ab-43f3-8c50-3cbace0c9f5f" returned: 0 in 0.545s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:36:18 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-585749a7-4c7a-4d27-90d5-b413fb4a1336 tempest-SnapshotsActionsTest-2081672924 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b82f4208-7884-4e40-b208-2865320cd5a4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88899) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 03 08:36:18 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-585749a7-4c7a-4d27-90d5-b413fb4a1336 tempest-SnapshotsActionsTest-2081672924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-b82f4208-7884-4e40-b208-2865320cd5a4.4f676038-43ab-43f3-8c50-3cbace0c9f5f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-b82f4208-7884-4e40-b208-2865320cd5a4.a68b1e53-0a08-476c-88ff-ad51610efef1 1G {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:36:18 devstack sudo[99345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-b82f4208-7884-4e40-b208-2865320cd5a4.4f676038-43ab-43f3-8c50-3cbace0c9f5f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-b82f4208-7884-4e40-b208-2865320cd5a4.a68b1e53-0a08-476c-88ff-ad51610efef1 1G Aug 03 08:36:18 devstack sudo[99345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:36:18 devstack sudo[99345]: pam_unix(sudo:session): session closed for user root Aug 03 08:36:18 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-585749a7-4c7a-4d27-90d5-b413fb4a1336 tempest-SnapshotsActionsTest-2081672924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-b82f4208-7884-4e40-b208-2865320cd5a4.4f676038-43ab-43f3-8c50-3cbace0c9f5f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-b82f4208-7884-4e40-b208-2865320cd5a4.a68b1e53-0a08-476c-88ff-ad51610efef1 1G" returned: 0 in 0.787s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:36:18 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-585749a7-4c7a-4d27-90d5-b413fb4a1336 tempest-SnapshotsActionsTest-2081672924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b82f4208-7884-4e40-b208-2865320cd5a4.4f676038-43ab-43f3-8c50-3cbace0c9f5f -F qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-b82f4208-7884-4e40-b208-2865320cd5a4.a68b1e53-0a08-476c-88ff-ad51610efef1 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:36:19 devstack sudo[99351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b82f4208-7884-4e40-b208-2865320cd5a4.4f676038-43ab-43f3-8c50-3cbace0c9f5f -F qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-b82f4208-7884-4e40-b208-2865320cd5a4.a68b1e53-0a08-476c-88ff-ad51610efef1 Aug 03 08:36:19 devstack sudo[99351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:36:19 devstack sudo[99351]: pam_unix(sudo:session): session closed for user root Aug 03 08:36:19 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-585749a7-4c7a-4d27-90d5-b413fb4a1336 tempest-SnapshotsActionsTest-2081672924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b82f4208-7884-4e40-b208-2865320cd5a4.4f676038-43ab-43f3-8c50-3cbace0c9f5f -F qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-b82f4208-7884-4e40-b208-2865320cd5a4.a68b1e53-0a08-476c-88ff-ad51610efef1" returned: 0 in 0.557s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:36:19 devstack cinder-volume[88899]: WARNING cinder.volume.drivers.remotefs [None req-585749a7-4c7a-4d27-90d5-b413fb4a1336 tempest-SnapshotsActionsTest-2081672924 None] /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-b82f4208-7884-4e40-b208-2865320cd5a4.a68b1e53-0a08-476c-88ff-ad51610efef1 is being set with open permissions: ugo+rw Aug 03 08:36:19 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-585749a7-4c7a-4d27-90d5-b413fb4a1336 tempest-SnapshotsActionsTest-2081672924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-b82f4208-7884-4e40-b208-2865320cd5a4.a68b1e53-0a08-476c-88ff-ad51610efef1 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:36:19 devstack sudo[99356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-b82f4208-7884-4e40-b208-2865320cd5a4.a68b1e53-0a08-476c-88ff-ad51610efef1 Aug 03 08:36:19 devstack sudo[99356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:36:19 devstack sudo[99356]: pam_unix(sudo:session): session closed for user root Aug 03 08:36:19 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-585749a7-4c7a-4d27-90d5-b413fb4a1336 tempest-SnapshotsActionsTest-2081672924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-b82f4208-7884-4e40-b208-2865320cd5a4.a68b1e53-0a08-476c-88ff-ad51610efef1" returned: 0 in 0.441s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:36:20 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-585749a7-4c7a-4d27-90d5-b413fb4a1336 tempest-SnapshotsActionsTest-2081672924 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.568s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:36:20 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-585749a7-4c7a-4d27-90d5-b413fb4a1336 tempest-SnapshotsActionsTest-2081672924 None] Create snapshot completed successfully Aug 03 08:36:21 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-6e4b0cb1-8a87-4d06-ba22-2cfa711dd4a6 tempest-SnapshotsActionsTest-1376615100 None] Acquiring lock "cinder-a68b1e53-0a08-476c-88ff-ad51610efef1-delete_snapshot" by "delete_snapshot" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:36:21 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-6e4b0cb1-8a87-4d06-ba22-2cfa711dd4a6 tempest-SnapshotsActionsTest-1376615100 None] Lock "cinder-a68b1e53-0a08-476c-88ff-ad51610efef1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:36:21 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-6e4b0cb1-8a87-4d06-ba22-2cfa711dd4a6 tempest-SnapshotsActionsTest-1376615100 None] Acquiring lock "cinder-quobyte-b82f4208-7884-4e40-b208-2865320cd5a4" by "delete_snapshot" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:36:21 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-6e4b0cb1-8a87-4d06-ba22-2cfa711dd4a6 tempest-SnapshotsActionsTest-1376615100 None] Lock "cinder-quobyte-b82f4208-7884-4e40-b208-2865320cd5a4" acquired by "delete_snapshot" :: waited 0.023s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:36:21 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-6e4b0cb1-8a87-4d06-ba22-2cfa711dd4a6 tempest-SnapshotsActionsTest-1376615100 None] Acquiring lock "cinder-quobyte-a68b1e53-0a08-476c-88ff-ad51610efef1" by "_delete_snapshot" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:36:21 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-6e4b0cb1-8a87-4d06-ba22-2cfa711dd4a6 tempest-SnapshotsActionsTest-1376615100 None] Lock "cinder-quobyte-a68b1e53-0a08-476c-88ff-ad51610efef1" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:36:21 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-6e4b0cb1-8a87-4d06-ba22-2cfa711dd4a6 tempest-SnapshotsActionsTest-1376615100 None] Deleting offline snapshot a68b1e53-0a08-476c-88ff-ad51610efef1 of volume b82f4208-7884-4e40-b208-2865320cd5a4 {{(pid=88899) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 03 08:36:21 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-6e4b0cb1-8a87-4d06-ba22-2cfa711dd4a6 tempest-SnapshotsActionsTest-1376615100 None] snapshot_file for this snap is: volume-b82f4208-7884-4e40-b208-2865320cd5a4.a68b1e53-0a08-476c-88ff-ad51610efef1 {{(pid=88899) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 03 08:36:21 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6737236-c50e-47f2-9bc1-cb366c1035a3]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:36:21 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-6e4b0cb1-8a87-4d06-ba22-2cfa711dd4a6 tempest-SnapshotsActionsTest-1376615100 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-b82f4208-7884-4e40-b208-2865320cd5a4.a68b1e53-0a08-476c-88ff-ad51610efef1 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:36:21 devstack sudo[99359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-b82f4208-7884-4e40-b208-2865320cd5a4.a68b1e53-0a08-476c-88ff-ad51610efef1 Aug 03 08:36:21 devstack sudo[99359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:36:22 devstack sudo[99359]: pam_unix(sudo:session): session closed for user root Aug 03 08:36:22 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-6e4b0cb1-8a87-4d06-ba22-2cfa711dd4a6 tempest-SnapshotsActionsTest-1376615100 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-b82f4208-7884-4e40-b208-2865320cd5a4.a68b1e53-0a08-476c-88ff-ad51610efef1" returned: 0 in 0.693s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:36:22 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-6e4b0cb1-8a87-4d06-ba22-2cfa711dd4a6 tempest-SnapshotsActionsTest-1376615100 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b82f4208-7884-4e40-b208-2865320cd5a4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88899) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 03 08:36:22 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3b37d5e-4506-4500-a685-5b709f5b9f07]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:36:22 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-6e4b0cb1-8a87-4d06-ba22-2cfa711dd4a6 tempest-SnapshotsActionsTest-1376615100 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-b82f4208-7884-4e40-b208-2865320cd5a4.4f676038-43ab-43f3-8c50-3cbace0c9f5f {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:36:22 devstack sudo[99365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-b82f4208-7884-4e40-b208-2865320cd5a4.4f676038-43ab-43f3-8c50-3cbace0c9f5f Aug 03 08:36:22 devstack sudo[99365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:36:23 devstack sudo[99365]: pam_unix(sudo:session): session closed for user root Aug 03 08:36:23 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-6e4b0cb1-8a87-4d06-ba22-2cfa711dd4a6 tempest-SnapshotsActionsTest-1376615100 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-b82f4208-7884-4e40-b208-2865320cd5a4.4f676038-43ab-43f3-8c50-3cbace0c9f5f" returned: 0 in 0.952s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:36:23 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-6e4b0cb1-8a87-4d06-ba22-2cfa711dd4a6 tempest-SnapshotsActionsTest-1376615100 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b82f4208-7884-4e40-b208-2865320cd5a4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88899) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 03 08:36:23 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-6e4b0cb1-8a87-4d06-ba22-2cfa711dd4a6 tempest-SnapshotsActionsTest-1376615100 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-b82f4208-7884-4e40-b208-2865320cd5a4.a68b1e53-0a08-476c-88ff-ad51610efef1 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:36:23 devstack sudo[99371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-b82f4208-7884-4e40-b208-2865320cd5a4.a68b1e53-0a08-476c-88ff-ad51610efef1 Aug 03 08:36:23 devstack sudo[99371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:36:23 devstack sudo[99371]: pam_unix(sudo:session): session closed for user root Aug 03 08:36:23 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-6e4b0cb1-8a87-4d06-ba22-2cfa711dd4a6 tempest-SnapshotsActionsTest-1376615100 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-b82f4208-7884-4e40-b208-2865320cd5a4.a68b1e53-0a08-476c-88ff-ad51610efef1" returned: 0 in 0.916s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:36:23 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-6e4b0cb1-8a87-4d06-ba22-2cfa711dd4a6 tempest-SnapshotsActionsTest-1376615100 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-b82f4208-7884-4e40-b208-2865320cd5a4.a68b1e53-0a08-476c-88ff-ad51610efef1 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:36:24 devstack sudo[99377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-b82f4208-7884-4e40-b208-2865320cd5a4.a68b1e53-0a08-476c-88ff-ad51610efef1 Aug 03 08:36:24 devstack sudo[99377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:36:24 devstack sudo[99377]: pam_unix(sudo:session): session closed for user root Aug 03 08:36:24 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-6e4b0cb1-8a87-4d06-ba22-2cfa711dd4a6 tempest-SnapshotsActionsTest-1376615100 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-b82f4208-7884-4e40-b208-2865320cd5a4.a68b1e53-0a08-476c-88ff-ad51610efef1" returned: 0 in 0.460s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:36:24 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-6e4b0cb1-8a87-4d06-ba22-2cfa711dd4a6 tempest-SnapshotsActionsTest-1376615100 None] Lock "cinder-quobyte-a68b1e53-0a08-476c-88ff-ad51610efef1" released by "_delete_snapshot" :: held 3.209s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:36:24 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-6e4b0cb1-8a87-4d06-ba22-2cfa711dd4a6 tempest-SnapshotsActionsTest-1376615100 None] Lock "cinder-quobyte-b82f4208-7884-4e40-b208-2865320cd5a4" released by "delete_snapshot" :: held 3.254s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:36:24 devstack cinder-volume[88899]: DEBUG cinder.quota [None req-6e4b0cb1-8a87-4d06-ba22-2cfa711dd4a6 tempest-SnapshotsActionsTest-1376615100 None] Created reservations ['d53393c1-ac57-4e1e-b169-dcba28755a1f', 'd724388a-e6c6-467b-9a35-ea2d0a42861b', '73f7b9e6-cd22-47fc-b30b-b761c14d0b88', '09ca9625-60dc-487c-822f-5cc81a6596da'] {{(pid=88899) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 08:36:24 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-6e4b0cb1-8a87-4d06-ba22-2cfa711dd4a6 tempest-SnapshotsActionsTest-1376615100 None] Delete snapshot completed successfully. Aug 03 08:36:24 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-6e4b0cb1-8a87-4d06-ba22-2cfa711dd4a6 tempest-SnapshotsActionsTest-1376615100 None] Lock "cinder-a68b1e53-0a08-476c-88ff-ad51610efef1-delete_snapshot" released by "delete_snapshot" :: held 3.522s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:36:26 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-2ca6186b-7132-4adc-9284-cab08637decd tempest-SnapshotsActionsTest-2081672924 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:36:26 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-2ca6186b-7132-4adc-9284-cab08637decd tempest-SnapshotsActionsTest-2081672924 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:36:26 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-2ca6186b-7132-4adc-9284-cab08637decd tempest-SnapshotsActionsTest-2081672924 None] Creating offline snapshot f2876010-2edc-47a4-8395-5c826cbd3300 of volume b82f4208-7884-4e40-b208-2865320cd5a4 {{(pid=88899) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 03 08:36:26 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ff28e70-2969-4857-a3a4-22322e09578e]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:36:26 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-2ca6186b-7132-4adc-9284-cab08637decd tempest-SnapshotsActionsTest-2081672924 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-b82f4208-7884-4e40-b208-2865320cd5a4.4f676038-43ab-43f3-8c50-3cbace0c9f5f {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:36:26 devstack sudo[99380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-b82f4208-7884-4e40-b208-2865320cd5a4.4f676038-43ab-43f3-8c50-3cbace0c9f5f Aug 03 08:36:26 devstack sudo[99380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:36:27 devstack sudo[99380]: pam_unix(sudo:session): session closed for user root Aug 03 08:36:27 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-2ca6186b-7132-4adc-9284-cab08637decd tempest-SnapshotsActionsTest-2081672924 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-b82f4208-7884-4e40-b208-2865320cd5a4.4f676038-43ab-43f3-8c50-3cbace0c9f5f" returned: 0 in 0.818s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:36:27 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-2ca6186b-7132-4adc-9284-cab08637decd tempest-SnapshotsActionsTest-2081672924 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b82f4208-7884-4e40-b208-2865320cd5a4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88899) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 03 08:36:27 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-2ca6186b-7132-4adc-9284-cab08637decd tempest-SnapshotsActionsTest-2081672924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-b82f4208-7884-4e40-b208-2865320cd5a4.4f676038-43ab-43f3-8c50-3cbace0c9f5f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-b82f4208-7884-4e40-b208-2865320cd5a4.f2876010-2edc-47a4-8395-5c826cbd3300 1G {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:36:27 devstack sudo[99385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-b82f4208-7884-4e40-b208-2865320cd5a4.4f676038-43ab-43f3-8c50-3cbace0c9f5f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-b82f4208-7884-4e40-b208-2865320cd5a4.f2876010-2edc-47a4-8395-5c826cbd3300 1G Aug 03 08:36:27 devstack sudo[99385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:36:27 devstack sudo[99385]: pam_unix(sudo:session): session closed for user root Aug 03 08:36:27 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-2ca6186b-7132-4adc-9284-cab08637decd tempest-SnapshotsActionsTest-2081672924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-b82f4208-7884-4e40-b208-2865320cd5a4.4f676038-43ab-43f3-8c50-3cbace0c9f5f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-b82f4208-7884-4e40-b208-2865320cd5a4.f2876010-2edc-47a4-8395-5c826cbd3300 1G" returned: 0 in 0.741s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:36:27 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-2ca6186b-7132-4adc-9284-cab08637decd tempest-SnapshotsActionsTest-2081672924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b82f4208-7884-4e40-b208-2865320cd5a4.4f676038-43ab-43f3-8c50-3cbace0c9f5f -F qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-b82f4208-7884-4e40-b208-2865320cd5a4.f2876010-2edc-47a4-8395-5c826cbd3300 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:36:27 devstack sudo[99392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b82f4208-7884-4e40-b208-2865320cd5a4.4f676038-43ab-43f3-8c50-3cbace0c9f5f -F qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-b82f4208-7884-4e40-b208-2865320cd5a4.f2876010-2edc-47a4-8395-5c826cbd3300 Aug 03 08:36:28 devstack sudo[99392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:36:28 devstack sudo[99392]: pam_unix(sudo:session): session closed for user root Aug 03 08:36:28 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-2ca6186b-7132-4adc-9284-cab08637decd tempest-SnapshotsActionsTest-2081672924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b82f4208-7884-4e40-b208-2865320cd5a4.4f676038-43ab-43f3-8c50-3cbace0c9f5f -F qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-b82f4208-7884-4e40-b208-2865320cd5a4.f2876010-2edc-47a4-8395-5c826cbd3300" returned: 0 in 0.608s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:36:28 devstack cinder-volume[88899]: WARNING cinder.volume.drivers.remotefs [None req-2ca6186b-7132-4adc-9284-cab08637decd tempest-SnapshotsActionsTest-2081672924 None] /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-b82f4208-7884-4e40-b208-2865320cd5a4.f2876010-2edc-47a4-8395-5c826cbd3300 is being set with open permissions: ugo+rw Aug 03 08:36:28 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-2ca6186b-7132-4adc-9284-cab08637decd tempest-SnapshotsActionsTest-2081672924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-b82f4208-7884-4e40-b208-2865320cd5a4.f2876010-2edc-47a4-8395-5c826cbd3300 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:36:28 devstack sudo[99397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-b82f4208-7884-4e40-b208-2865320cd5a4.f2876010-2edc-47a4-8395-5c826cbd3300 Aug 03 08:36:28 devstack sudo[99397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:36:28 devstack sudo[99397]: pam_unix(sudo:session): session closed for user root Aug 03 08:36:28 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-2ca6186b-7132-4adc-9284-cab08637decd tempest-SnapshotsActionsTest-2081672924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-b82f4208-7884-4e40-b208-2865320cd5a4.f2876010-2edc-47a4-8395-5c826cbd3300" returned: 0 in 0.411s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:36:29 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-2ca6186b-7132-4adc-9284-cab08637decd tempest-SnapshotsActionsTest-2081672924 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.786s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:36:29 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-2ca6186b-7132-4adc-9284-cab08637decd tempest-SnapshotsActionsTest-2081672924 None] Create snapshot completed successfully Aug 03 08:36:29 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-34a4fcaa-0c1e-476b-b5f2-cec1e5385dbc tempest-SnapshotsActionsTest-1376615100 None] Acquiring lock "cinder-f2876010-2edc-47a4-8395-5c826cbd3300-delete_snapshot" by "delete_snapshot" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:36:29 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-34a4fcaa-0c1e-476b-b5f2-cec1e5385dbc tempest-SnapshotsActionsTest-1376615100 None] Lock "cinder-f2876010-2edc-47a4-8395-5c826cbd3300-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:36:29 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-34a4fcaa-0c1e-476b-b5f2-cec1e5385dbc tempest-SnapshotsActionsTest-1376615100 None] Acquiring lock "cinder-quobyte-b82f4208-7884-4e40-b208-2865320cd5a4" by "delete_snapshot" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:36:29 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-34a4fcaa-0c1e-476b-b5f2-cec1e5385dbc tempest-SnapshotsActionsTest-1376615100 None] Lock "cinder-quobyte-b82f4208-7884-4e40-b208-2865320cd5a4" acquired by "delete_snapshot" :: waited 0.028s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:36:29 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-34a4fcaa-0c1e-476b-b5f2-cec1e5385dbc tempest-SnapshotsActionsTest-1376615100 None] Acquiring lock "cinder-quobyte-f2876010-2edc-47a4-8395-5c826cbd3300" by "_delete_snapshot" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:36:29 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-34a4fcaa-0c1e-476b-b5f2-cec1e5385dbc tempest-SnapshotsActionsTest-1376615100 None] Lock "cinder-quobyte-f2876010-2edc-47a4-8395-5c826cbd3300" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:36:29 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-34a4fcaa-0c1e-476b-b5f2-cec1e5385dbc tempest-SnapshotsActionsTest-1376615100 None] Deleting offline snapshot f2876010-2edc-47a4-8395-5c826cbd3300 of volume b82f4208-7884-4e40-b208-2865320cd5a4 {{(pid=88899) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 03 08:36:29 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-34a4fcaa-0c1e-476b-b5f2-cec1e5385dbc tempest-SnapshotsActionsTest-1376615100 None] snapshot_file for this snap is: volume-b82f4208-7884-4e40-b208-2865320cd5a4.f2876010-2edc-47a4-8395-5c826cbd3300 {{(pid=88899) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 03 08:36:29 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[338b03fc-1d69-49eb-8a42-0af84cbf50ec]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:36:29 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-34a4fcaa-0c1e-476b-b5f2-cec1e5385dbc tempest-SnapshotsActionsTest-1376615100 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-b82f4208-7884-4e40-b208-2865320cd5a4.f2876010-2edc-47a4-8395-5c826cbd3300 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:36:30 devstack sudo[99403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-b82f4208-7884-4e40-b208-2865320cd5a4.f2876010-2edc-47a4-8395-5c826cbd3300 Aug 03 08:36:30 devstack sudo[99403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:36:30 devstack sudo[99403]: pam_unix(sudo:session): session closed for user root Aug 03 08:36:30 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-34a4fcaa-0c1e-476b-b5f2-cec1e5385dbc tempest-SnapshotsActionsTest-1376615100 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-b82f4208-7884-4e40-b208-2865320cd5a4.f2876010-2edc-47a4-8395-5c826cbd3300" returned: 0 in 0.706s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:36:30 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-34a4fcaa-0c1e-476b-b5f2-cec1e5385dbc tempest-SnapshotsActionsTest-1376615100 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b82f4208-7884-4e40-b208-2865320cd5a4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88899) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 03 08:36:30 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4e6c33b-d32a-4f98-a134-4e546cf59c03]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:36:30 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-34a4fcaa-0c1e-476b-b5f2-cec1e5385dbc tempest-SnapshotsActionsTest-1376615100 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-b82f4208-7884-4e40-b208-2865320cd5a4.4f676038-43ab-43f3-8c50-3cbace0c9f5f {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:36:30 devstack cinder-volume[88899]: DEBUG cinder.volume.flows.manager.create_volume [None req-342f46b1-41ce-4253-9ce7-c1c6911d4fe1 tempest-ServerRescueNegativeTestJSON-1978977044 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88899) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 08:36:30 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-342f46b1-41ce-4253-9ce7-c1c6911d4fe1 tempest-ServerRescueNegativeTestJSON-1978977044 None] Flow 'volume_create_manager' (e93014b4-b07f-4a1b-a18d-aa8eea10966c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:36:30 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-342f46b1-41ce-4253-9ce7-c1c6911d4fe1 tempest-ServerRescueNegativeTestJSON-1978977044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc9f1026-ceb3-44e7-8cc1-179977ab2bc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:36:30 devstack sudo[99410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-b82f4208-7884-4e40-b208-2865320cd5a4.4f676038-43ab-43f3-8c50-3cbace0c9f5f Aug 03 08:36:30 devstack sudo[99410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:36:30 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-342f46b1-41ce-4253-9ce7-c1c6911d4fe1 tempest-ServerRescueNegativeTestJSON-1978977044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc9f1026-ceb3-44e7-8cc1-179977ab2bc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:36:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1140440433',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f777fee-2628-4f2c-bd5a-ed7783cae624,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ae26bba6b672494ca4f815cd07ba2c13',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:36:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:36:31Z,use_quota=True,user_id='102895b51b1e44a3879124577259116d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8bde7129-1dc4-42ab-b852-ab32c61b4921),volume_type_id=8bde7129-1dc4-42ab-b852-ab32c61b4921)' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:36:30 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-342f46b1-41ce-4253-9ce7-c1c6911d4fe1 tempest-ServerRescueNegativeTestJSON-1978977044 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e31583e2-56a4-4914-9e10-3104e4ec35e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:36:30 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-342f46b1-41ce-4253-9ce7-c1c6911d4fe1 tempest-ServerRescueNegativeTestJSON-1978977044 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e31583e2-56a4-4914-9e10-3104e4ec35e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:36:30 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-342f46b1-41ce-4253-9ce7-c1c6911d4fe1 tempest-ServerRescueNegativeTestJSON-1978977044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c2caae18-7564-4c23-bbea-673befab34dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:36:30 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-342f46b1-41ce-4253-9ce7-c1c6911d4fe1 tempest-ServerRescueNegativeTestJSON-1978977044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c2caae18-7564-4c23-bbea-673befab34dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6f777fee-2628-4f2c-bd5a-ed7783cae624', 'volume_name': 'volume-6f777fee-2628-4f2c-bd5a-ed7783cae624', 'volume_size': 1}' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:36:30 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-342f46b1-41ce-4253-9ce7-c1c6911d4fe1 tempest-ServerRescueNegativeTestJSON-1978977044 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4e2cb22-5a2a-43dd-ad8b-9420ebce3013) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:36:30 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-342f46b1-41ce-4253-9ce7-c1c6911d4fe1 tempest-ServerRescueNegativeTestJSON-1978977044 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4e2cb22-5a2a-43dd-ad8b-9420ebce3013) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:36:30 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-342f46b1-41ce-4253-9ce7-c1c6911d4fe1 tempest-ServerRescueNegativeTestJSON-1978977044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3112124-25e2-47ed-a3b5-da95965d0957) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:36:30 devstack cinder-volume[88899]: INFO cinder.volume.flows.manager.create_volume [None req-342f46b1-41ce-4253-9ce7-c1c6911d4fe1 tempest-ServerRescueNegativeTestJSON-1978977044 None] Volume 6f777fee-2628-4f2c-bd5a-ed7783cae624: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6f777fee-2628-4f2c-bd5a-ed7783cae624', 'volume_size': 1} Aug 03 08:36:30 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-342f46b1-41ce-4253-9ce7-c1c6911d4fe1 tempest-ServerRescueNegativeTestJSON-1978977044 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:36:30 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-342f46b1-41ce-4253-9ce7-c1c6911d4fe1 tempest-ServerRescueNegativeTestJSON-1978977044 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:36:30 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-342f46b1-41ce-4253-9ce7-c1c6911d4fe1 tempest-ServerRescueNegativeTestJSON-1978977044 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:36:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1140440433',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f777fee-2628-4f2c-bd5a-ed7783cae624,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ae26bba6b672494ca4f815cd07ba2c13',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:36:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:36:31Z,use_quota=True,user_id='102895b51b1e44a3879124577259116d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8bde7129-1dc4-42ab-b852-ab32c61b4921),volume_type_id=8bde7129-1dc4-42ab-b852-ab32c61b4921)}" {{(pid=88899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 08:36:30 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-342f46b1-41ce-4253-9ce7-c1c6911d4fe1 tempest-ServerRescueNegativeTestJSON-1978977044 None] Creating volume 6f777fee-2628-4f2c-bd5a-ed7783cae624 {{(pid=88899) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 08:36:30 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-342f46b1-41ce-4253-9ce7-c1c6911d4fe1 tempest-ServerRescueNegativeTestJSON-1978977044 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:36:30 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-342f46b1-41ce-4253-9ce7-c1c6911d4fe1 tempest-ServerRescueNegativeTestJSON-1978977044 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:36:30 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-342f46b1-41ce-4253-9ce7-c1c6911d4fe1 tempest-ServerRescueNegativeTestJSON-1978977044 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:36:30 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-342f46b1-41ce-4253-9ce7-c1c6911d4fe1 tempest-ServerRescueNegativeTestJSON-1978977044 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:36:30 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-342f46b1-41ce-4253-9ce7-c1c6911d4fe1 tempest-ServerRescueNegativeTestJSON-1978977044 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:36:30 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-342f46b1-41ce-4253-9ce7-c1c6911d4fe1 tempest-ServerRescueNegativeTestJSON-1978977044 None] Selected osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385 as target Quobyte volume. {{(pid=88899) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 08:36:30 devstack cinder-volume[88899]: INFO cinder.volume.drivers.remotefs [None req-342f46b1-41ce-4253-9ce7-c1c6911d4fe1 tempest-ServerRescueNegativeTestJSON-1978977044 None] casted to osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385 Aug 03 08:36:30 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-342f46b1-41ce-4253-9ce7-c1c6911d4fe1 tempest-ServerRescueNegativeTestJSON-1978977044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-6f777fee-2628-4f2c-bd5a-ed7783cae624 1073741824 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:36:30 devstack sudo[99412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-6f777fee-2628-4f2c-bd5a-ed7783cae624 1073741824 Aug 03 08:36:30 devstack sudo[99412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:36:31 devstack sudo[99410]: pam_unix(sudo:session): session closed for user root Aug 03 08:36:31 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-34a4fcaa-0c1e-476b-b5f2-cec1e5385dbc tempest-SnapshotsActionsTest-1376615100 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-b82f4208-7884-4e40-b208-2865320cd5a4.4f676038-43ab-43f3-8c50-3cbace0c9f5f" returned: 0 in 0.578s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:36:31 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-34a4fcaa-0c1e-476b-b5f2-cec1e5385dbc tempest-SnapshotsActionsTest-1376615100 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b82f4208-7884-4e40-b208-2865320cd5a4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88899) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 03 08:36:31 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-34a4fcaa-0c1e-476b-b5f2-cec1e5385dbc tempest-SnapshotsActionsTest-1376615100 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-b82f4208-7884-4e40-b208-2865320cd5a4.f2876010-2edc-47a4-8395-5c826cbd3300 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:36:31 devstack sudo[99419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-b82f4208-7884-4e40-b208-2865320cd5a4.f2876010-2edc-47a4-8395-5c826cbd3300 Aug 03 08:36:31 devstack sudo[99419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:36:31 devstack sudo[99412]: pam_unix(sudo:session): session closed for user root Aug 03 08:36:31 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-342f46b1-41ce-4253-9ce7-c1c6911d4fe1 tempest-ServerRescueNegativeTestJSON-1978977044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-6f777fee-2628-4f2c-bd5a-ed7783cae624 1073741824" returned: 0 in 0.641s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:36:31 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-342f46b1-41ce-4253-9ce7-c1c6911d4fe1 tempest-ServerRescueNegativeTestJSON-1978977044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-6f777fee-2628-4f2c-bd5a-ed7783cae624 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:36:31 devstack sudo[99426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-6f777fee-2628-4f2c-bd5a-ed7783cae624 Aug 03 08:36:31 devstack sudo[99426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:36:31 devstack sudo[99419]: pam_unix(sudo:session): session closed for user root Aug 03 08:36:31 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-34a4fcaa-0c1e-476b-b5f2-cec1e5385dbc tempest-SnapshotsActionsTest-1376615100 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-b82f4208-7884-4e40-b208-2865320cd5a4.f2876010-2edc-47a4-8395-5c826cbd3300" returned: 0 in 0.646s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:36:31 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-34a4fcaa-0c1e-476b-b5f2-cec1e5385dbc tempest-SnapshotsActionsTest-1376615100 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-b82f4208-7884-4e40-b208-2865320cd5a4.f2876010-2edc-47a4-8395-5c826cbd3300 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:36:31 devstack sudo[99428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-b82f4208-7884-4e40-b208-2865320cd5a4.f2876010-2edc-47a4-8395-5c826cbd3300 Aug 03 08:36:31 devstack sudo[99428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:36:31 devstack sudo[99426]: pam_unix(sudo:session): session closed for user root Aug 03 08:36:31 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-342f46b1-41ce-4253-9ce7-c1c6911d4fe1 tempest-ServerRescueNegativeTestJSON-1978977044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-6f777fee-2628-4f2c-bd5a-ed7783cae624" returned: 0 in 0.442s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:36:31 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-342f46b1-41ce-4253-9ce7-c1c6911d4fe1 tempest-ServerRescueNegativeTestJSON-1978977044 None] <== create_volume: return (1150ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'} {{(pid=88899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 08:36:31 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-342f46b1-41ce-4253-9ce7-c1c6911d4fe1 tempest-ServerRescueNegativeTestJSON-1978977044 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.156s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:36:31 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-342f46b1-41ce-4253-9ce7-c1c6911d4fe1 tempest-ServerRescueNegativeTestJSON-1978977044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3112124-25e2-47ed-a3b5-da95965d0957) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6f777fee-2628-4f2c-bd5a-ed7783cae624', 'volume_size': 1}' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:36:31 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-342f46b1-41ce-4253-9ce7-c1c6911d4fe1 tempest-ServerRescueNegativeTestJSON-1978977044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92b98827-9539-4c98-8b1e-4d54fb114d77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:36:32 devstack cinder-volume[88899]: INFO cinder.volume.flows.manager.create_volume [None req-342f46b1-41ce-4253-9ce7-c1c6911d4fe1 tempest-ServerRescueNegativeTestJSON-1978977044 None] Volume volume-6f777fee-2628-4f2c-bd5a-ed7783cae624 (6f777fee-2628-4f2c-bd5a-ed7783cae624): created successfully Aug 03 08:36:32 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-342f46b1-41ce-4253-9ce7-c1c6911d4fe1 tempest-ServerRescueNegativeTestJSON-1978977044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92b98827-9539-4c98-8b1e-4d54fb114d77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:36:32 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-342f46b1-41ce-4253-9ce7-c1c6911d4fe1 tempest-ServerRescueNegativeTestJSON-1978977044 None] Flow 'volume_create_manager' (e93014b4-b07f-4a1b-a18d-aa8eea10966c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:36:32 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-342f46b1-41ce-4253-9ce7-c1c6911d4fe1 tempest-ServerRescueNegativeTestJSON-1978977044 None] Created volume successfully. Aug 03 08:36:32 devstack sudo[99428]: pam_unix(sudo:session): session closed for user root Aug 03 08:36:32 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-34a4fcaa-0c1e-476b-b5f2-cec1e5385dbc tempest-SnapshotsActionsTest-1376615100 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-b82f4208-7884-4e40-b208-2865320cd5a4.f2876010-2edc-47a4-8395-5c826cbd3300" returned: 0 in 0.377s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:36:32 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-34a4fcaa-0c1e-476b-b5f2-cec1e5385dbc tempest-SnapshotsActionsTest-1376615100 None] Lock "cinder-quobyte-f2876010-2edc-47a4-8395-5c826cbd3300" released by "_delete_snapshot" :: held 2.501s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:36:32 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-34a4fcaa-0c1e-476b-b5f2-cec1e5385dbc tempest-SnapshotsActionsTest-1376615100 None] Lock "cinder-quobyte-b82f4208-7884-4e40-b208-2865320cd5a4" released by "delete_snapshot" :: held 2.541s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:36:32 devstack cinder-volume[88899]: DEBUG cinder.quota [None req-34a4fcaa-0c1e-476b-b5f2-cec1e5385dbc tempest-SnapshotsActionsTest-1376615100 None] Created reservations ['b9f6bf30-9bf5-412a-b22b-b7b3089bbd65', 'a3e567db-6098-4af7-a8da-170e4ea67997', 'e7355043-9609-4663-8486-21ac7b03ac9f', '4a124215-94cc-473a-ab6d-71a1b773a858'] {{(pid=88899) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 08:36:32 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-34a4fcaa-0c1e-476b-b5f2-cec1e5385dbc tempest-SnapshotsActionsTest-1376615100 None] Delete snapshot completed successfully. Aug 03 08:36:32 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-34a4fcaa-0c1e-476b-b5f2-cec1e5385dbc tempest-SnapshotsActionsTest-1376615100 None] Lock "cinder-f2876010-2edc-47a4-8395-5c826cbd3300-delete_snapshot" released by "delete_snapshot" :: held 2.740s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:36:33 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-a4cb91c2-bfa0-4c12-80af-986553583592 tempest-SnapshotsActionsTest-2081672924 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:36:33 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-a4cb91c2-bfa0-4c12-80af-986553583592 tempest-SnapshotsActionsTest-2081672924 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:36:33 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-a4cb91c2-bfa0-4c12-80af-986553583592 tempest-SnapshotsActionsTest-2081672924 None] Creating offline snapshot 2abbd935-bef8-459b-b0ab-c73aed8123d8 of volume b82f4208-7884-4e40-b208-2865320cd5a4 {{(pid=88899) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 03 08:36:33 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a5ef544-b744-4ccf-9287-d1d75cc44fa4]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:36:33 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-a4cb91c2-bfa0-4c12-80af-986553583592 tempest-SnapshotsActionsTest-2081672924 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-b82f4208-7884-4e40-b208-2865320cd5a4.4f676038-43ab-43f3-8c50-3cbace0c9f5f {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:36:33 devstack sudo[99434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-b82f4208-7884-4e40-b208-2865320cd5a4.4f676038-43ab-43f3-8c50-3cbace0c9f5f Aug 03 08:36:33 devstack sudo[99434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:36:34 devstack sudo[99434]: pam_unix(sudo:session): session closed for user root Aug 03 08:36:34 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-a4cb91c2-bfa0-4c12-80af-986553583592 tempest-SnapshotsActionsTest-2081672924 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-b82f4208-7884-4e40-b208-2865320cd5a4.4f676038-43ab-43f3-8c50-3cbace0c9f5f" returned: 0 in 0.503s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:36:34 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-a4cb91c2-bfa0-4c12-80af-986553583592 tempest-SnapshotsActionsTest-2081672924 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b82f4208-7884-4e40-b208-2865320cd5a4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88899) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 03 08:36:34 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-a4cb91c2-bfa0-4c12-80af-986553583592 tempest-SnapshotsActionsTest-2081672924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-b82f4208-7884-4e40-b208-2865320cd5a4.4f676038-43ab-43f3-8c50-3cbace0c9f5f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-b82f4208-7884-4e40-b208-2865320cd5a4.2abbd935-bef8-459b-b0ab-c73aed8123d8 1G {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:36:34 devstack sudo[99439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-b82f4208-7884-4e40-b208-2865320cd5a4.4f676038-43ab-43f3-8c50-3cbace0c9f5f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-b82f4208-7884-4e40-b208-2865320cd5a4.2abbd935-bef8-459b-b0ab-c73aed8123d8 1G Aug 03 08:36:34 devstack sudo[99439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:36:34 devstack sudo[99439]: pam_unix(sudo:session): session closed for user root Aug 03 08:36:34 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-a4cb91c2-bfa0-4c12-80af-986553583592 tempest-SnapshotsActionsTest-2081672924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-b82f4208-7884-4e40-b208-2865320cd5a4.4f676038-43ab-43f3-8c50-3cbace0c9f5f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-b82f4208-7884-4e40-b208-2865320cd5a4.2abbd935-bef8-459b-b0ab-c73aed8123d8 1G" returned: 0 in 0.670s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:36:34 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-a4cb91c2-bfa0-4c12-80af-986553583592 tempest-SnapshotsActionsTest-2081672924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b82f4208-7884-4e40-b208-2865320cd5a4.4f676038-43ab-43f3-8c50-3cbace0c9f5f -F qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-b82f4208-7884-4e40-b208-2865320cd5a4.2abbd935-bef8-459b-b0ab-c73aed8123d8 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:36:34 devstack sudo[99445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b82f4208-7884-4e40-b208-2865320cd5a4.4f676038-43ab-43f3-8c50-3cbace0c9f5f -F qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-b82f4208-7884-4e40-b208-2865320cd5a4.2abbd935-bef8-459b-b0ab-c73aed8123d8 Aug 03 08:36:34 devstack sudo[99445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:36:35 devstack sudo[99445]: pam_unix(sudo:session): session closed for user root Aug 03 08:36:35 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-a4cb91c2-bfa0-4c12-80af-986553583592 tempest-SnapshotsActionsTest-2081672924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b82f4208-7884-4e40-b208-2865320cd5a4.4f676038-43ab-43f3-8c50-3cbace0c9f5f -F qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-b82f4208-7884-4e40-b208-2865320cd5a4.2abbd935-bef8-459b-b0ab-c73aed8123d8" returned: 0 in 0.336s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:36:35 devstack cinder-volume[88899]: WARNING cinder.volume.drivers.remotefs [None req-a4cb91c2-bfa0-4c12-80af-986553583592 tempest-SnapshotsActionsTest-2081672924 None] /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-b82f4208-7884-4e40-b208-2865320cd5a4.2abbd935-bef8-459b-b0ab-c73aed8123d8 is being set with open permissions: ugo+rw Aug 03 08:36:35 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-a4cb91c2-bfa0-4c12-80af-986553583592 tempest-SnapshotsActionsTest-2081672924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-b82f4208-7884-4e40-b208-2865320cd5a4.2abbd935-bef8-459b-b0ab-c73aed8123d8 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:36:35 devstack sudo[99451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-b82f4208-7884-4e40-b208-2865320cd5a4.2abbd935-bef8-459b-b0ab-c73aed8123d8 Aug 03 08:36:35 devstack sudo[99451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:36:35 devstack sudo[99451]: pam_unix(sudo:session): session closed for user root Aug 03 08:36:35 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-a4cb91c2-bfa0-4c12-80af-986553583592 tempest-SnapshotsActionsTest-2081672924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-b82f4208-7884-4e40-b208-2865320cd5a4.2abbd935-bef8-459b-b0ab-c73aed8123d8" returned: 0 in 0.272s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:36:35 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-a4cb91c2-bfa0-4c12-80af-986553583592 tempest-SnapshotsActionsTest-2081672924 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.899s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:36:35 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-a4cb91c2-bfa0-4c12-80af-986553583592 tempest-SnapshotsActionsTest-2081672924 None] Create snapshot completed successfully Aug 03 08:36:35 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-251be04a-bc36-4410-8aa0-aaa55f5ba4a9 tempest-SnapshotsActionsTest-1376615100 None] Acquiring lock "cinder-2abbd935-bef8-459b-b0ab-c73aed8123d8-delete_snapshot" by "delete_snapshot" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:36:35 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-251be04a-bc36-4410-8aa0-aaa55f5ba4a9 tempest-SnapshotsActionsTest-1376615100 None] Lock "cinder-2abbd935-bef8-459b-b0ab-c73aed8123d8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:36:35 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-251be04a-bc36-4410-8aa0-aaa55f5ba4a9 tempest-SnapshotsActionsTest-1376615100 None] Acquiring lock "cinder-quobyte-b82f4208-7884-4e40-b208-2865320cd5a4" by "delete_snapshot" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:36:35 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-251be04a-bc36-4410-8aa0-aaa55f5ba4a9 tempest-SnapshotsActionsTest-1376615100 None] Lock "cinder-quobyte-b82f4208-7884-4e40-b208-2865320cd5a4" acquired by "delete_snapshot" :: waited 0.022s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:36:35 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-251be04a-bc36-4410-8aa0-aaa55f5ba4a9 tempest-SnapshotsActionsTest-1376615100 None] Acquiring lock "cinder-quobyte-2abbd935-bef8-459b-b0ab-c73aed8123d8" by "_delete_snapshot" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:36:35 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-251be04a-bc36-4410-8aa0-aaa55f5ba4a9 tempest-SnapshotsActionsTest-1376615100 None] Lock "cinder-quobyte-2abbd935-bef8-459b-b0ab-c73aed8123d8" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:36:35 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-251be04a-bc36-4410-8aa0-aaa55f5ba4a9 tempest-SnapshotsActionsTest-1376615100 None] Deleting offline snapshot 2abbd935-bef8-459b-b0ab-c73aed8123d8 of volume b82f4208-7884-4e40-b208-2865320cd5a4 {{(pid=88899) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 03 08:36:35 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-251be04a-bc36-4410-8aa0-aaa55f5ba4a9 tempest-SnapshotsActionsTest-1376615100 None] snapshot_file for this snap is: volume-b82f4208-7884-4e40-b208-2865320cd5a4.2abbd935-bef8-459b-b0ab-c73aed8123d8 {{(pid=88899) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 03 08:36:35 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b3d06ff-4fdd-4ba9-9c25-5a70ed8cbb82]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:36:35 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-251be04a-bc36-4410-8aa0-aaa55f5ba4a9 tempest-SnapshotsActionsTest-1376615100 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-b82f4208-7884-4e40-b208-2865320cd5a4.2abbd935-bef8-459b-b0ab-c73aed8123d8 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:36:35 devstack sudo[99454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-b82f4208-7884-4e40-b208-2865320cd5a4.2abbd935-bef8-459b-b0ab-c73aed8123d8 Aug 03 08:36:35 devstack sudo[99454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:36:36 devstack sudo[99454]: pam_unix(sudo:session): session closed for user root Aug 03 08:36:36 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-251be04a-bc36-4410-8aa0-aaa55f5ba4a9 tempest-SnapshotsActionsTest-1376615100 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-b82f4208-7884-4e40-b208-2865320cd5a4.2abbd935-bef8-459b-b0ab-c73aed8123d8" returned: 0 in 0.445s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:36:36 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-251be04a-bc36-4410-8aa0-aaa55f5ba4a9 tempest-SnapshotsActionsTest-1376615100 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b82f4208-7884-4e40-b208-2865320cd5a4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88899) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 03 08:36:36 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2df937e-f42c-4067-b38b-9923d54b5546]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:36:36 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-251be04a-bc36-4410-8aa0-aaa55f5ba4a9 tempest-SnapshotsActionsTest-1376615100 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-b82f4208-7884-4e40-b208-2865320cd5a4.4f676038-43ab-43f3-8c50-3cbace0c9f5f {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:36:36 devstack sudo[99459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-b82f4208-7884-4e40-b208-2865320cd5a4.4f676038-43ab-43f3-8c50-3cbace0c9f5f Aug 03 08:36:36 devstack sudo[99459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:36:36 devstack sudo[99459]: pam_unix(sudo:session): session closed for user root Aug 03 08:36:36 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-251be04a-bc36-4410-8aa0-aaa55f5ba4a9 tempest-SnapshotsActionsTest-1376615100 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-b82f4208-7884-4e40-b208-2865320cd5a4.4f676038-43ab-43f3-8c50-3cbace0c9f5f" returned: 0 in 0.499s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:36:36 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-251be04a-bc36-4410-8aa0-aaa55f5ba4a9 tempest-SnapshotsActionsTest-1376615100 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b82f4208-7884-4e40-b208-2865320cd5a4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88899) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 03 08:36:36 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-251be04a-bc36-4410-8aa0-aaa55f5ba4a9 tempest-SnapshotsActionsTest-1376615100 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-b82f4208-7884-4e40-b208-2865320cd5a4.2abbd935-bef8-459b-b0ab-c73aed8123d8 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:36:36 devstack sudo[99465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-b82f4208-7884-4e40-b208-2865320cd5a4.2abbd935-bef8-459b-b0ab-c73aed8123d8 Aug 03 08:36:36 devstack sudo[99465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:36:37 devstack sudo[99465]: pam_unix(sudo:session): session closed for user root Aug 03 08:36:37 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-251be04a-bc36-4410-8aa0-aaa55f5ba4a9 tempest-SnapshotsActionsTest-1376615100 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-b82f4208-7884-4e40-b208-2865320cd5a4.2abbd935-bef8-459b-b0ab-c73aed8123d8" returned: 0 in 0.532s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:36:37 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-251be04a-bc36-4410-8aa0-aaa55f5ba4a9 tempest-SnapshotsActionsTest-1376615100 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-b82f4208-7884-4e40-b208-2865320cd5a4.2abbd935-bef8-459b-b0ab-c73aed8123d8 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:36:37 devstack sudo[99471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-b82f4208-7884-4e40-b208-2865320cd5a4.2abbd935-bef8-459b-b0ab-c73aed8123d8 Aug 03 08:36:37 devstack sudo[99471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:36:37 devstack sudo[99471]: pam_unix(sudo:session): session closed for user root Aug 03 08:36:37 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-251be04a-bc36-4410-8aa0-aaa55f5ba4a9 tempest-SnapshotsActionsTest-1376615100 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-b82f4208-7884-4e40-b208-2865320cd5a4.2abbd935-bef8-459b-b0ab-c73aed8123d8" returned: 0 in 0.327s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:36:37 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-251be04a-bc36-4410-8aa0-aaa55f5ba4a9 tempest-SnapshotsActionsTest-1376615100 None] Lock "cinder-quobyte-2abbd935-bef8-459b-b0ab-c73aed8123d8" released by "_delete_snapshot" :: held 1.938s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:36:37 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-251be04a-bc36-4410-8aa0-aaa55f5ba4a9 tempest-SnapshotsActionsTest-1376615100 None] Lock "cinder-quobyte-b82f4208-7884-4e40-b208-2865320cd5a4" released by "delete_snapshot" :: held 1.969s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:36:37 devstack cinder-volume[88899]: DEBUG cinder.quota [None req-251be04a-bc36-4410-8aa0-aaa55f5ba4a9 tempest-SnapshotsActionsTest-1376615100 None] Created reservations ['5d9ab4a7-0434-438e-ad06-9a439a53d117', 'b0f6960a-1c7b-4f98-96bf-016b7890c01a', '719f3ff8-d9f6-4c6f-a736-80f8bf04d783', '3bb05105-fce2-4237-9920-84820f3c26f8'] {{(pid=88899) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 08:36:38 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-251be04a-bc36-4410-8aa0-aaa55f5ba4a9 tempest-SnapshotsActionsTest-1376615100 None] Delete snapshot completed successfully. Aug 03 08:36:38 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-251be04a-bc36-4410-8aa0-aaa55f5ba4a9 tempest-SnapshotsActionsTest-1376615100 None] Lock "cinder-2abbd935-bef8-459b-b0ab-c73aed8123d8-delete_snapshot" released by "delete_snapshot" :: held 2.327s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:36:39 devstack cinder-volume[88899]: DEBUG cinder.volume.flows.manager.create_volume [None req-37fba23c-e43f-48fd-b20e-41ca26ca91ce tempest-TestImageHashVerification-123135469 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88899) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 08:36:39 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-37fba23c-e43f-48fd-b20e-41ca26ca91ce tempest-TestImageHashVerification-123135469 None] Flow 'volume_create_manager' (24ed3854-aa1c-4485-a179-6778076fa46f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:36:39 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-37fba23c-e43f-48fd-b20e-41ca26ca91ce tempest-TestImageHashVerification-123135469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (816480e9-f70d-46c2-b365-d88b11c608c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:36:39 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-37fba23c-e43f-48fd-b20e-41ca26ca91ce tempest-TestImageHashVerification-123135469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (816480e9-f70d-46c2-b365-d88b11c608c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:36:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-1467538401',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e721c9e-ddf1-4f74-97e6-3cd14a7d720e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3088c076e3aa468e9ad51f87dd60f5c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:36:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:36:39Z,use_quota=True,user_id='e1ff14008d51471ca0a155b56e434350',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8bde7129-1dc4-42ab-b852-ab32c61b4921),volume_type_id=8bde7129-1dc4-42ab-b852-ab32c61b4921)' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:36:39 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-37fba23c-e43f-48fd-b20e-41ca26ca91ce tempest-TestImageHashVerification-123135469 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ec81cb0-70a1-4e6e-93f4-0903ddc7b4c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:36:39 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-37fba23c-e43f-48fd-b20e-41ca26ca91ce tempest-TestImageHashVerification-123135469 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ec81cb0-70a1-4e6e-93f4-0903ddc7b4c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:36:39 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-37fba23c-e43f-48fd-b20e-41ca26ca91ce tempest-TestImageHashVerification-123135469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f6c8f4b-968f-4140-9ab5-cecf90a14d3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:36:39 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-37fba23c-e43f-48fd-b20e-41ca26ca91ce tempest-TestImageHashVerification-123135469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f6c8f4b-968f-4140-9ab5-cecf90a14d3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1e721c9e-ddf1-4f74-97e6-3cd14a7d720e', 'volume_name': 'volume-1e721c9e-ddf1-4f74-97e6-3cd14a7d720e', 'volume_size': 1}' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:36:39 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-37fba23c-e43f-48fd-b20e-41ca26ca91ce tempest-TestImageHashVerification-123135469 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (90c43556-de2d-4613-911b-93de7abdecba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:36:39 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-37fba23c-e43f-48fd-b20e-41ca26ca91ce tempest-TestImageHashVerification-123135469 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (90c43556-de2d-4613-911b-93de7abdecba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:36:39 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-37fba23c-e43f-48fd-b20e-41ca26ca91ce tempest-TestImageHashVerification-123135469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7829a76-4e0a-44f9-b054-ee43c53315e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:36:39 devstack cinder-volume[88899]: INFO cinder.volume.flows.manager.create_volume [None req-37fba23c-e43f-48fd-b20e-41ca26ca91ce tempest-TestImageHashVerification-123135469 None] Volume 1e721c9e-ddf1-4f74-97e6-3cd14a7d720e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1e721c9e-ddf1-4f74-97e6-3cd14a7d720e', 'volume_size': 1} Aug 03 08:36:39 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-37fba23c-e43f-48fd-b20e-41ca26ca91ce tempest-TestImageHashVerification-123135469 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:36:39 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-37fba23c-e43f-48fd-b20e-41ca26ca91ce tempest-TestImageHashVerification-123135469 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:36:39 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-37fba23c-e43f-48fd-b20e-41ca26ca91ce tempest-TestImageHashVerification-123135469 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:36:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-1467538401',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e721c9e-ddf1-4f74-97e6-3cd14a7d720e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3088c076e3aa468e9ad51f87dd60f5c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:36:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:36:39Z,use_quota=True,user_id='e1ff14008d51471ca0a155b56e434350',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8bde7129-1dc4-42ab-b852-ab32c61b4921),volume_type_id=8bde7129-1dc4-42ab-b852-ab32c61b4921)}" {{(pid=88899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 08:36:39 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-37fba23c-e43f-48fd-b20e-41ca26ca91ce tempest-TestImageHashVerification-123135469 None] Creating volume 1e721c9e-ddf1-4f74-97e6-3cd14a7d720e {{(pid=88899) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 08:36:39 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-37fba23c-e43f-48fd-b20e-41ca26ca91ce tempest-TestImageHashVerification-123135469 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:36:39 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-37fba23c-e43f-48fd-b20e-41ca26ca91ce tempest-TestImageHashVerification-123135469 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:36:39 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-37fba23c-e43f-48fd-b20e-41ca26ca91ce tempest-TestImageHashVerification-123135469 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:36:39 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-37fba23c-e43f-48fd-b20e-41ca26ca91ce tempest-TestImageHashVerification-123135469 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:36:39 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-37fba23c-e43f-48fd-b20e-41ca26ca91ce tempest-TestImageHashVerification-123135469 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:36:39 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-37fba23c-e43f-48fd-b20e-41ca26ca91ce tempest-TestImageHashVerification-123135469 None] Selected osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385 as target Quobyte volume. {{(pid=88899) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 08:36:39 devstack cinder-volume[88899]: INFO cinder.volume.drivers.remotefs [None req-37fba23c-e43f-48fd-b20e-41ca26ca91ce tempest-TestImageHashVerification-123135469 None] casted to osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385 Aug 03 08:36:39 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-37fba23c-e43f-48fd-b20e-41ca26ca91ce tempest-TestImageHashVerification-123135469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-1e721c9e-ddf1-4f74-97e6-3cd14a7d720e 1073741824 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:36:39 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-84b26320-114f-4756-9b91-fd26e32364bb tempest-SnapshotsActionsTest-2081672924 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:36:39 devstack sudo[99494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-1e721c9e-ddf1-4f74-97e6-3cd14a7d720e 1073741824 Aug 03 08:36:39 devstack sudo[99494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:36:40 devstack sudo[99494]: pam_unix(sudo:session): session closed for user root Aug 03 08:36:40 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-37fba23c-e43f-48fd-b20e-41ca26ca91ce tempest-TestImageHashVerification-123135469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-1e721c9e-ddf1-4f74-97e6-3cd14a7d720e 1073741824" returned: 0 in 1.035s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:36:40 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-37fba23c-e43f-48fd-b20e-41ca26ca91ce tempest-TestImageHashVerification-123135469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-1e721c9e-ddf1-4f74-97e6-3cd14a7d720e {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:36:40 devstack sudo[99512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-1e721c9e-ddf1-4f74-97e6-3cd14a7d720e Aug 03 08:36:40 devstack sudo[99512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:36:41 devstack sudo[99512]: pam_unix(sudo:session): session closed for user root Aug 03 08:36:41 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-37fba23c-e43f-48fd-b20e-41ca26ca91ce tempest-TestImageHashVerification-123135469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-1e721c9e-ddf1-4f74-97e6-3cd14a7d720e" returned: 0 in 0.450s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:36:41 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-37fba23c-e43f-48fd-b20e-41ca26ca91ce tempest-TestImageHashVerification-123135469 None] <== create_volume: return (1587ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'} {{(pid=88899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 08:36:41 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-37fba23c-e43f-48fd-b20e-41ca26ca91ce tempest-TestImageHashVerification-123135469 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.591s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:36:41 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-84b26320-114f-4756-9b91-fd26e32364bb tempest-SnapshotsActionsTest-2081672924 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.517s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:36:41 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-37fba23c-e43f-48fd-b20e-41ca26ca91ce tempest-TestImageHashVerification-123135469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7829a76-4e0a-44f9-b054-ee43c53315e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1e721c9e-ddf1-4f74-97e6-3cd14a7d720e', 'volume_size': 1}' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:36:41 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-37fba23c-e43f-48fd-b20e-41ca26ca91ce tempest-TestImageHashVerification-123135469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b22f1c6c-a29a-4f78-93ed-869c27a77149) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:36:41 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-84b26320-114f-4756-9b91-fd26e32364bb tempest-SnapshotsActionsTest-2081672924 None] Creating offline snapshot d9e16015-7e12-428d-8299-84f6001a5c0a of volume b82f4208-7884-4e40-b208-2865320cd5a4 {{(pid=88899) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 03 08:36:41 devstack cinder-volume[88899]: INFO cinder.volume.flows.manager.create_volume [None req-37fba23c-e43f-48fd-b20e-41ca26ca91ce tempest-TestImageHashVerification-123135469 None] Volume volume-1e721c9e-ddf1-4f74-97e6-3cd14a7d720e (1e721c9e-ddf1-4f74-97e6-3cd14a7d720e): created successfully Aug 03 08:36:41 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-37fba23c-e43f-48fd-b20e-41ca26ca91ce tempest-TestImageHashVerification-123135469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b22f1c6c-a29a-4f78-93ed-869c27a77149) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:36:41 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-37fba23c-e43f-48fd-b20e-41ca26ca91ce tempest-TestImageHashVerification-123135469 None] Flow 'volume_create_manager' (24ed3854-aa1c-4485-a179-6778076fa46f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:36:41 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[adc5b283-fd0f-4656-b5f8-63ad54d0ce90]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:36:41 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-84b26320-114f-4756-9b91-fd26e32364bb tempest-SnapshotsActionsTest-2081672924 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-b82f4208-7884-4e40-b208-2865320cd5a4.4f676038-43ab-43f3-8c50-3cbace0c9f5f {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:36:41 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-37fba23c-e43f-48fd-b20e-41ca26ca91ce tempest-TestImageHashVerification-123135469 None] Created volume successfully. Aug 03 08:36:41 devstack sudo[99533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-b82f4208-7884-4e40-b208-2865320cd5a4.4f676038-43ab-43f3-8c50-3cbace0c9f5f Aug 03 08:36:41 devstack sudo[99533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:36:42 devstack sudo[99533]: pam_unix(sudo:session): session closed for user root Aug 03 08:36:42 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-84b26320-114f-4756-9b91-fd26e32364bb tempest-SnapshotsActionsTest-2081672924 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-b82f4208-7884-4e40-b208-2865320cd5a4.4f676038-43ab-43f3-8c50-3cbace0c9f5f" returned: 0 in 0.789s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:36:42 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-84b26320-114f-4756-9b91-fd26e32364bb tempest-SnapshotsActionsTest-2081672924 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b82f4208-7884-4e40-b208-2865320cd5a4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88899) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 03 08:36:42 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-84b26320-114f-4756-9b91-fd26e32364bb tempest-SnapshotsActionsTest-2081672924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-b82f4208-7884-4e40-b208-2865320cd5a4.4f676038-43ab-43f3-8c50-3cbace0c9f5f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-b82f4208-7884-4e40-b208-2865320cd5a4.d9e16015-7e12-428d-8299-84f6001a5c0a 1G {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:36:42 devstack sudo[99564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-b82f4208-7884-4e40-b208-2865320cd5a4.4f676038-43ab-43f3-8c50-3cbace0c9f5f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-b82f4208-7884-4e40-b208-2865320cd5a4.d9e16015-7e12-428d-8299-84f6001a5c0a 1G Aug 03 08:36:42 devstack sudo[99564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:36:43 devstack sudo[99564]: pam_unix(sudo:session): session closed for user root Aug 03 08:36:43 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-84b26320-114f-4756-9b91-fd26e32364bb tempest-SnapshotsActionsTest-2081672924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-b82f4208-7884-4e40-b208-2865320cd5a4.4f676038-43ab-43f3-8c50-3cbace0c9f5f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-b82f4208-7884-4e40-b208-2865320cd5a4.d9e16015-7e12-428d-8299-84f6001a5c0a 1G" returned: 0 in 0.858s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:36:43 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-84b26320-114f-4756-9b91-fd26e32364bb tempest-SnapshotsActionsTest-2081672924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b82f4208-7884-4e40-b208-2865320cd5a4.4f676038-43ab-43f3-8c50-3cbace0c9f5f -F qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-b82f4208-7884-4e40-b208-2865320cd5a4.d9e16015-7e12-428d-8299-84f6001a5c0a {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:36:43 devstack sudo[99575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b82f4208-7884-4e40-b208-2865320cd5a4.4f676038-43ab-43f3-8c50-3cbace0c9f5f -F qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-b82f4208-7884-4e40-b208-2865320cd5a4.d9e16015-7e12-428d-8299-84f6001a5c0a Aug 03 08:36:43 devstack sudo[99575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:36:43 devstack sudo[99575]: pam_unix(sudo:session): session closed for user root Aug 03 08:36:43 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-84b26320-114f-4756-9b91-fd26e32364bb tempest-SnapshotsActionsTest-2081672924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b82f4208-7884-4e40-b208-2865320cd5a4.4f676038-43ab-43f3-8c50-3cbace0c9f5f -F qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-b82f4208-7884-4e40-b208-2865320cd5a4.d9e16015-7e12-428d-8299-84f6001a5c0a" returned: 0 in 0.833s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:36:43 devstack cinder-volume[88899]: WARNING cinder.volume.drivers.remotefs [None req-84b26320-114f-4756-9b91-fd26e32364bb tempest-SnapshotsActionsTest-2081672924 None] /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-b82f4208-7884-4e40-b208-2865320cd5a4.d9e16015-7e12-428d-8299-84f6001a5c0a is being set with open permissions: ugo+rw Aug 03 08:36:44 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-84b26320-114f-4756-9b91-fd26e32364bb tempest-SnapshotsActionsTest-2081672924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-b82f4208-7884-4e40-b208-2865320cd5a4.d9e16015-7e12-428d-8299-84f6001a5c0a {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:36:44 devstack sudo[99580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-b82f4208-7884-4e40-b208-2865320cd5a4.d9e16015-7e12-428d-8299-84f6001a5c0a Aug 03 08:36:44 devstack sudo[99580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:36:44 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-fb2c1188-24d0-44cc-bb1d-e811fdc61c80 tempest-TestImageHashVerification-123135469 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:36:44 devstack sudo[99580]: pam_unix(sudo:session): session closed for user root Aug 03 08:36:44 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-84b26320-114f-4756-9b91-fd26e32364bb tempest-SnapshotsActionsTest-2081672924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-b82f4208-7884-4e40-b208-2865320cd5a4.d9e16015-7e12-428d-8299-84f6001a5c0a" returned: 0 in 0.616s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:36:44 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-84b26320-114f-4756-9b91-fd26e32364bb tempest-SnapshotsActionsTest-2081672924 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.345s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:36:44 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-fb2c1188-24d0-44cc-bb1d-e811fdc61c80 tempest-TestImageHashVerification-123135469 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.104s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:36:44 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[faf4395d-27ed-451b-a38e-6fc495b77529]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:36:44 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-fb2c1188-24d0-44cc-bb1d-e811fdc61c80 tempest-TestImageHashVerification-123135469 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-1e721c9e-ddf1-4f74-97e6-3cd14a7d720e {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:36:44 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-84b26320-114f-4756-9b91-fd26e32364bb tempest-SnapshotsActionsTest-2081672924 None] Create snapshot completed successfully Aug 03 08:36:44 devstack sudo[99583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-1e721c9e-ddf1-4f74-97e6-3cd14a7d720e Aug 03 08:36:44 devstack sudo[99583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:36:45 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-08ec09f9-5759-4dd3-944b-938d6d6f9fc8 tempest-SnapshotsActionsTest-1376615100 None] Acquiring lock "cinder-d9e16015-7e12-428d-8299-84f6001a5c0a-delete_snapshot" by "delete_snapshot" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:36:45 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-08ec09f9-5759-4dd3-944b-938d6d6f9fc8 tempest-SnapshotsActionsTest-1376615100 None] Lock "cinder-d9e16015-7e12-428d-8299-84f6001a5c0a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:36:45 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-08ec09f9-5759-4dd3-944b-938d6d6f9fc8 tempest-SnapshotsActionsTest-1376615100 None] Acquiring lock "cinder-quobyte-b82f4208-7884-4e40-b208-2865320cd5a4" by "delete_snapshot" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:36:45 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-08ec09f9-5759-4dd3-944b-938d6d6f9fc8 tempest-SnapshotsActionsTest-1376615100 None] Lock "cinder-quobyte-b82f4208-7884-4e40-b208-2865320cd5a4" acquired by "delete_snapshot" :: waited 0.036s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:36:45 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-08ec09f9-5759-4dd3-944b-938d6d6f9fc8 tempest-SnapshotsActionsTest-1376615100 None] Acquiring lock "cinder-quobyte-d9e16015-7e12-428d-8299-84f6001a5c0a" by "_delete_snapshot" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:36:45 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-08ec09f9-5759-4dd3-944b-938d6d6f9fc8 tempest-SnapshotsActionsTest-1376615100 None] Lock "cinder-quobyte-d9e16015-7e12-428d-8299-84f6001a5c0a" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:36:45 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-08ec09f9-5759-4dd3-944b-938d6d6f9fc8 tempest-SnapshotsActionsTest-1376615100 None] Deleting offline snapshot d9e16015-7e12-428d-8299-84f6001a5c0a of volume b82f4208-7884-4e40-b208-2865320cd5a4 {{(pid=88899) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 03 08:36:45 devstack sudo[99583]: pam_unix(sudo:session): session closed for user root Aug 03 08:36:45 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-08ec09f9-5759-4dd3-944b-938d6d6f9fc8 tempest-SnapshotsActionsTest-1376615100 None] snapshot_file for this snap is: volume-b82f4208-7884-4e40-b208-2865320cd5a4.d9e16015-7e12-428d-8299-84f6001a5c0a {{(pid=88899) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 03 08:36:45 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-fb2c1188-24d0-44cc-bb1d-e811fdc61c80 tempest-TestImageHashVerification-123135469 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-1e721c9e-ddf1-4f74-97e6-3cd14a7d720e" returned: 0 in 0.748s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:36:45 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6bb87e3-572d-4145-a10b-868c9ad1ddb0]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:36:45 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-08ec09f9-5759-4dd3-944b-938d6d6f9fc8 tempest-SnapshotsActionsTest-1376615100 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-b82f4208-7884-4e40-b208-2865320cd5a4.d9e16015-7e12-428d-8299-84f6001a5c0a {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:36:45 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[28f8990a-5ce7-42ad-b538-ac9b7dec5eaf]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:36:45 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-fb2c1188-24d0-44cc-bb1d-e811fdc61c80 tempest-TestImageHashVerification-123135469 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-1e721c9e-ddf1-4f74-97e6-3cd14a7d720e {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:36:45 devstack sudo[99589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-b82f4208-7884-4e40-b208-2865320cd5a4.d9e16015-7e12-428d-8299-84f6001a5c0a Aug 03 08:36:45 devstack sudo[99589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:36:45 devstack sudo[99590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-1e721c9e-ddf1-4f74-97e6-3cd14a7d720e Aug 03 08:36:45 devstack sudo[99590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:36:46 devstack sudo[99589]: pam_unix(sudo:session): session closed for user root Aug 03 08:36:46 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-08ec09f9-5759-4dd3-944b-938d6d6f9fc8 tempest-SnapshotsActionsTest-1376615100 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-b82f4208-7884-4e40-b208-2865320cd5a4.d9e16015-7e12-428d-8299-84f6001a5c0a" returned: 0 in 0.563s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:36:46 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-08ec09f9-5759-4dd3-944b-938d6d6f9fc8 tempest-SnapshotsActionsTest-1376615100 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b82f4208-7884-4e40-b208-2865320cd5a4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88899) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 03 08:36:46 devstack sudo[99590]: pam_unix(sudo:session): session closed for user root Aug 03 08:36:46 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[604bded3-3234-46c8-80b8-538a1cf1bd6a]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:36:46 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-08ec09f9-5759-4dd3-944b-938d6d6f9fc8 tempest-SnapshotsActionsTest-1376615100 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-b82f4208-7884-4e40-b208-2865320cd5a4.4f676038-43ab-43f3-8c50-3cbace0c9f5f {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:36:46 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-fb2c1188-24d0-44cc-bb1d-e811fdc61c80 tempest-TestImageHashVerification-123135469 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-1e721c9e-ddf1-4f74-97e6-3cd14a7d720e" returned: 0 in 0.621s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:36:46 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-fb2c1188-24d0-44cc-bb1d-e811fdc61c80 tempest-TestImageHashVerification-123135469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-1e721c9e-ddf1-4f74-97e6-3cd14a7d720e /opt/stack/data/cinder/conversion/1e721c9e-ddf1-4f74-97e6-3cd14a7d720e.temp_image.fc74f8f7-e224-4080-a060-daec7539a7d1tximqelj.img {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:36:46 devstack sudo[99614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-1e721c9e-ddf1-4f74-97e6-3cd14a7d720e /opt/stack/data/cinder/conversion/1e721c9e-ddf1-4f74-97e6-3cd14a7d720e.temp_image.fc74f8f7-e224-4080-a060-daec7539a7d1tximqelj.img Aug 03 08:36:46 devstack sudo[99614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:36:46 devstack sudo[99613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-b82f4208-7884-4e40-b208-2865320cd5a4.4f676038-43ab-43f3-8c50-3cbace0c9f5f Aug 03 08:36:46 devstack sudo[99613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:36:46 devstack sudo[99613]: pam_unix(sudo:session): session closed for user root Aug 03 08:36:46 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-08ec09f9-5759-4dd3-944b-938d6d6f9fc8 tempest-SnapshotsActionsTest-1376615100 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-b82f4208-7884-4e40-b208-2865320cd5a4.4f676038-43ab-43f3-8c50-3cbace0c9f5f" returned: 0 in 0.750s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:36:46 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-08ec09f9-5759-4dd3-944b-938d6d6f9fc8 tempest-SnapshotsActionsTest-1376615100 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b82f4208-7884-4e40-b208-2865320cd5a4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88899) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 03 08:36:46 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-08ec09f9-5759-4dd3-944b-938d6d6f9fc8 tempest-SnapshotsActionsTest-1376615100 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-b82f4208-7884-4e40-b208-2865320cd5a4.d9e16015-7e12-428d-8299-84f6001a5c0a {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:36:46 devstack sudo[99649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-b82f4208-7884-4e40-b208-2865320cd5a4.d9e16015-7e12-428d-8299-84f6001a5c0a Aug 03 08:36:46 devstack sudo[99649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:36:48 devstack sudo[99649]: pam_unix(sudo:session): session closed for user root Aug 03 08:36:48 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-08ec09f9-5759-4dd3-944b-938d6d6f9fc8 tempest-SnapshotsActionsTest-1376615100 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-b82f4208-7884-4e40-b208-2865320cd5a4.d9e16015-7e12-428d-8299-84f6001a5c0a" returned: 0 in 1.638s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:36:48 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-08ec09f9-5759-4dd3-944b-938d6d6f9fc8 tempest-SnapshotsActionsTest-1376615100 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-b82f4208-7884-4e40-b208-2865320cd5a4.d9e16015-7e12-428d-8299-84f6001a5c0a {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:36:48 devstack sudo[99713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-b82f4208-7884-4e40-b208-2865320cd5a4.d9e16015-7e12-428d-8299-84f6001a5c0a Aug 03 08:36:48 devstack sudo[99713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:36:49 devstack sudo[99713]: pam_unix(sudo:session): session closed for user root Aug 03 08:36:49 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-08ec09f9-5759-4dd3-944b-938d6d6f9fc8 tempest-SnapshotsActionsTest-1376615100 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-b82f4208-7884-4e40-b208-2865320cd5a4.d9e16015-7e12-428d-8299-84f6001a5c0a" returned: 0 in 0.781s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:36:49 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-08ec09f9-5759-4dd3-944b-938d6d6f9fc8 tempest-SnapshotsActionsTest-1376615100 None] Lock "cinder-quobyte-d9e16015-7e12-428d-8299-84f6001a5c0a" released by "_delete_snapshot" :: held 3.966s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:36:49 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-08ec09f9-5759-4dd3-944b-938d6d6f9fc8 tempest-SnapshotsActionsTest-1376615100 None] Lock "cinder-quobyte-b82f4208-7884-4e40-b208-2865320cd5a4" released by "delete_snapshot" :: held 4.025s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:36:49 devstack cinder-volume[88899]: DEBUG cinder.quota [None req-08ec09f9-5759-4dd3-944b-938d6d6f9fc8 tempest-SnapshotsActionsTest-1376615100 None] Created reservations ['75993659-8556-4970-b88c-53336f369936', 'ae2b1918-5713-4cdf-9cd8-67502576e568', '6ee0c7d7-64a5-48aa-8927-0b38aaf65775', '65a81048-83ee-4868-8e45-128bc3cac60a'] {{(pid=88899) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 08:36:50 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-08ec09f9-5759-4dd3-944b-938d6d6f9fc8 tempest-SnapshotsActionsTest-1376615100 None] Delete snapshot completed successfully. Aug 03 08:36:50 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-08ec09f9-5759-4dd3-944b-938d6d6f9fc8 tempest-SnapshotsActionsTest-1376615100 None] Lock "cinder-d9e16015-7e12-428d-8299-84f6001a5c0a-delete_snapshot" released by "delete_snapshot" :: held 4.806s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:36:51 devstack cinder-volume[88899]: DEBUG oslo_service.periodic_task [None req-f948fb4a-c4d7-499f-b1bd-8d6be3de0b53 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88899) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 03 08:36:51 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-f948fb4a-c4d7-499f-b1bd-8d6be3de0b53 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:36:51 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-f948fb4a-c4d7-499f-b1bd-8d6be3de0b53 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:36:51 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-f948fb4a-c4d7-499f-b1bd-8d6be3de0b53 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:36:51 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-f948fb4a-c4d7-499f-b1bd-8d6be3de0b53 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:36:51 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-f948fb4a-c4d7-499f-b1bd-8d6be3de0b53 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.031s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:36:51 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-f948fb4a-c4d7-499f-b1bd-8d6be3de0b53 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:36:51 devstack sudo[99776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a Aug 03 08:36:51 devstack sudo[99776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:36:52 devstack sudo[99776]: pam_unix(sudo:session): session closed for user root Aug 03 08:36:52 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-f948fb4a-c4d7-499f-b1bd-8d6be3de0b53 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a" returned: 0 in 1.054s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:36:52 devstack cinder-volume[88899]: DEBUG cinder.manager [None req-f948fb4a-c4d7-499f-b1bd-8d6be3de0b53 None None] Notifying Schedulers of capabilities ... {{(pid=88899) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 08:36:52 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-b6cb6ff1-78a8-4e26-b722-59c864adc84e tempest-SnapshotsActionsTest-2081672924 None] Acquiring lock "cinder-4f676038-43ab-43f3-8c50-3cbace0c9f5f-delete_snapshot" by "delete_snapshot" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:36:52 devstack cinder-volume[88899]: DEBUG oslo_service.periodic_task [None req-f948fb4a-c4d7-499f-b1bd-8d6be3de0b53 None None] Running periodic task VolumeManager._thread_info {{(pid=88899) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 03 08:36:52 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-f948fb4a-c4d7-499f-b1bd-8d6be3de0b53 None None] thread count: 28 {{(pid=88899) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 03 08:36:52 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-f948fb4a-c4d7-499f-b1bd-8d6be3de0b53 None None] thread info: [<_MainThread(MainThread, started 132234320248960)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88899) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 03 08:36:53 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-b6cb6ff1-78a8-4e26-b722-59c864adc84e tempest-SnapshotsActionsTest-2081672924 None] Lock "cinder-4f676038-43ab-43f3-8c50-3cbace0c9f5f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.117s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:36:53 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-b6cb6ff1-78a8-4e26-b722-59c864adc84e tempest-SnapshotsActionsTest-2081672924 None] Acquiring lock "cinder-quobyte-b82f4208-7884-4e40-b208-2865320cd5a4" by "delete_snapshot" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:36:53 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-b6cb6ff1-78a8-4e26-b722-59c864adc84e tempest-SnapshotsActionsTest-2081672924 None] Lock "cinder-quobyte-b82f4208-7884-4e40-b208-2865320cd5a4" acquired by "delete_snapshot" :: waited 0.078s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:36:53 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-b6cb6ff1-78a8-4e26-b722-59c864adc84e tempest-SnapshotsActionsTest-2081672924 None] Acquiring lock "cinder-quobyte-4f676038-43ab-43f3-8c50-3cbace0c9f5f" by "_delete_snapshot" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:36:53 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-b6cb6ff1-78a8-4e26-b722-59c864adc84e tempest-SnapshotsActionsTest-2081672924 None] Lock "cinder-quobyte-4f676038-43ab-43f3-8c50-3cbace0c9f5f" acquired by "_delete_snapshot" :: waited 0.094s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:36:53 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-b6cb6ff1-78a8-4e26-b722-59c864adc84e tempest-SnapshotsActionsTest-2081672924 None] Deleting offline snapshot 4f676038-43ab-43f3-8c50-3cbace0c9f5f of volume b82f4208-7884-4e40-b208-2865320cd5a4 {{(pid=88899) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 03 08:36:53 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-b6cb6ff1-78a8-4e26-b722-59c864adc84e tempest-SnapshotsActionsTest-2081672924 None] snapshot_file for this snap is: volume-b82f4208-7884-4e40-b208-2865320cd5a4.4f676038-43ab-43f3-8c50-3cbace0c9f5f {{(pid=88899) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 03 08:36:53 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf56097c-969e-41b0-8da7-c0c54e1cce53]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:36:53 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-b6cb6ff1-78a8-4e26-b722-59c864adc84e tempest-SnapshotsActionsTest-2081672924 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-b82f4208-7884-4e40-b208-2865320cd5a4.4f676038-43ab-43f3-8c50-3cbace0c9f5f {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:36:53 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-cf6a3ef6-e749-4667-9425-003cdd66442d tempest-ServerRescueNegativeTestJSON-1978977044 None] Acquiring lock "cinder-6f777fee-2628-4f2c-bd5a-ed7783cae624-delete_volume" by "delete_volume" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:36:53 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-cf6a3ef6-e749-4667-9425-003cdd66442d tempest-ServerRescueNegativeTestJSON-1978977044 None] Lock "cinder-6f777fee-2628-4f2c-bd5a-ed7783cae624-delete_volume" acquired by "delete_volume" :: waited 0.146s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:36:54 devstack sudo[99781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-b82f4208-7884-4e40-b208-2865320cd5a4.4f676038-43ab-43f3-8c50-3cbace0c9f5f Aug 03 08:36:54 devstack sudo[99781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:36:54 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-cf6a3ef6-e749-4667-9425-003cdd66442d tempest-ServerRescueNegativeTestJSON-1978977044 None] Acquiring lock "cinder-quobyte-6f777fee-2628-4f2c-bd5a-ed7783cae624" by "delete_volume" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:36:54 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-cf6a3ef6-e749-4667-9425-003cdd66442d tempest-ServerRescueNegativeTestJSON-1978977044 None] Lock "cinder-quobyte-6f777fee-2628-4f2c-bd5a-ed7783cae624" acquired by "delete_volume" :: waited 0.072s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:36:54 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c280791-7eda-45b6-ad4d-ff86fd0e9d42]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:36:54 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-cf6a3ef6-e749-4667-9425-003cdd66442d tempest-ServerRescueNegativeTestJSON-1978977044 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-6f777fee-2628-4f2c-bd5a-ed7783cae624 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:36:55 devstack sudo[99781]: pam_unix(sudo:session): session closed for user root Aug 03 08:36:55 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-b6cb6ff1-78a8-4e26-b722-59c864adc84e tempest-SnapshotsActionsTest-2081672924 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-b82f4208-7884-4e40-b208-2865320cd5a4.4f676038-43ab-43f3-8c50-3cbace0c9f5f" returned: 0 in 1.565s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:36:55 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-b6cb6ff1-78a8-4e26-b722-59c864adc84e tempest-SnapshotsActionsTest-2081672924 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b82f4208-7884-4e40-b208-2865320cd5a4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88899) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 03 08:36:55 devstack sudo[99783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-6f777fee-2628-4f2c-bd5a-ed7783cae624 Aug 03 08:36:55 devstack sudo[99783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:36:55 devstack sudo[99614]: pam_unix(sudo:session): session closed for user root Aug 03 08:36:55 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-fb2c1188-24d0-44cc-bb1d-e811fdc61c80 tempest-TestImageHashVerification-123135469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-1e721c9e-ddf1-4f74-97e6-3cd14a7d720e /opt/stack/data/cinder/conversion/1e721c9e-ddf1-4f74-97e6-3cd14a7d720e.temp_image.fc74f8f7-e224-4080-a060-daec7539a7d1tximqelj.img" returned: 0 in 9.012s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:36:55 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[54633bef-9e61-46b5-bebd-6e4061da8b9c]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:36:55 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-b6cb6ff1-78a8-4e26-b722-59c864adc84e tempest-SnapshotsActionsTest-2081672924 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-b82f4208-7884-4e40-b208-2865320cd5a4 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:36:55 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[67c5faa7-b793-4f87-90a7-64a7663d2ca9]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:36:55 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-fb2c1188-24d0-44cc-bb1d-e811fdc61c80 tempest-TestImageHashVerification-123135469 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-1e721c9e-ddf1-4f74-97e6-3cd14a7d720e {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:36:55 devstack sudo[99822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-b82f4208-7884-4e40-b208-2865320cd5a4 Aug 03 08:36:55 devstack sudo[99822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:36:55 devstack sudo[99823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-1e721c9e-ddf1-4f74-97e6-3cd14a7d720e Aug 03 08:36:55 devstack sudo[99823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:36:55 devstack sudo[99783]: pam_unix(sudo:session): session closed for user root Aug 03 08:36:55 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-cf6a3ef6-e749-4667-9425-003cdd66442d tempest-ServerRescueNegativeTestJSON-1978977044 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-6f777fee-2628-4f2c-bd5a-ed7783cae624" returned: 0 in 1.192s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:36:55 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-cf6a3ef6-e749-4667-9425-003cdd66442d tempest-ServerRescueNegativeTestJSON-1978977044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-6f777fee-2628-4f2c-bd5a-ed7783cae624 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:36:55 devstack sudo[99831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-6f777fee-2628-4f2c-bd5a-ed7783cae624 Aug 03 08:36:55 devstack sudo[99831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:36:55 devstack sudo[99822]: pam_unix(sudo:session): session closed for user root Aug 03 08:36:55 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-b6cb6ff1-78a8-4e26-b722-59c864adc84e tempest-SnapshotsActionsTest-2081672924 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-b82f4208-7884-4e40-b208-2865320cd5a4" returned: 0 in 0.842s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:36:55 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-b6cb6ff1-78a8-4e26-b722-59c864adc84e tempest-SnapshotsActionsTest-2081672924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-b82f4208-7884-4e40-b208-2865320cd5a4.4f676038-43ab-43f3-8c50-3cbace0c9f5f {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:36:56 devstack sudo[99838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-b82f4208-7884-4e40-b208-2865320cd5a4.4f676038-43ab-43f3-8c50-3cbace0c9f5f Aug 03 08:36:56 devstack sudo[99838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:36:56 devstack sudo[99831]: pam_unix(sudo:session): session closed for user root Aug 03 08:36:56 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-cf6a3ef6-e749-4667-9425-003cdd66442d tempest-ServerRescueNegativeTestJSON-1978977044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-6f777fee-2628-4f2c-bd5a-ed7783cae624" returned: 0 in 0.583s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:36:56 devstack sudo[99823]: pam_unix(sudo:session): session closed for user root Aug 03 08:36:56 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-fb2c1188-24d0-44cc-bb1d-e811fdc61c80 tempest-TestImageHashVerification-123135469 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-1e721c9e-ddf1-4f74-97e6-3cd14a7d720e" returned: 0 in 1.105s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:36:56 devstack cinder-volume[88899]: DEBUG cinder.image.image_utils [None req-fb2c1188-24d0-44cc-bb1d-e811fdc61c80 tempest-TestImageHashVerification-123135469 None] Image conversion details: src /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-1e721c9e-ddf1-4f74-97e6-3cd14a7d720e, size 1024.00 MB, duration 9.01 sec, destination /opt/stack/data/cinder/conversion/1e721c9e-ddf1-4f74-97e6-3cd14a7d720e.temp_image.fc74f8f7-e224-4080-a060-daec7539a7d1tximqelj.img {{(pid=88899) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 03 08:36:56 devstack cinder-volume[88899]: INFO cinder.image.image_utils [None req-fb2c1188-24d0-44cc-bb1d-e811fdc61c80 tempest-TestImageHashVerification-123135469 None] Converted 1024.00 MB image at 113.59 MB/s Aug 03 08:36:56 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-cf6a3ef6-e749-4667-9425-003cdd66442d tempest-ServerRescueNegativeTestJSON-1978977044 None] Lock "cinder-quobyte-6f777fee-2628-4f2c-bd5a-ed7783cae624" released by "delete_volume" :: held 1.946s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:36:56 devstack cinder-volume[88899]: DEBUG cinder.image.image_utils [None req-fb2c1188-24d0-44cc-bb1d-e811fdc61c80 tempest-TestImageHashVerification-123135469 None] fc74f8f7-e224-4080-a060-daec7539a7d1 was raw, no need to convert to raw {{(pid=88899) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}} Aug 03 08:36:56 devstack cinder-volume[88899]: DEBUG cinder.quota [None req-cf6a3ef6-e749-4667-9425-003cdd66442d tempest-ServerRescueNegativeTestJSON-1978977044 None] Created reservations ['2a083864-7685-4563-a960-8eda353b58e9', '2008d5c7-6965-407d-b863-a6d048cdd815', 'd61017e3-122e-4d95-9f57-c86283b8ad1d', 'ed001579-7c03-45e0-ae13-12bd1b77dad2'] {{(pid=88899) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 08:36:56 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-cf6a3ef6-e749-4667-9425-003cdd66442d tempest-ServerRescueNegativeTestJSON-1978977044 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:36:56 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-cf6a3ef6-e749-4667-9425-003cdd66442d tempest-ServerRescueNegativeTestJSON-1978977044 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:36:56 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-cf6a3ef6-e749-4667-9425-003cdd66442d tempest-ServerRescueNegativeTestJSON-1978977044 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:36:56 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-cf6a3ef6-e749-4667-9425-003cdd66442d tempest-ServerRescueNegativeTestJSON-1978977044 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:36:56 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-cf6a3ef6-e749-4667-9425-003cdd66442d tempest-ServerRescueNegativeTestJSON-1978977044 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:36:56 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-cf6a3ef6-e749-4667-9425-003cdd66442d tempest-ServerRescueNegativeTestJSON-1978977044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:36:56 devstack sudo[99845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a Aug 03 08:36:56 devstack sudo[99845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:36:56 devstack sudo[99838]: pam_unix(sudo:session): session closed for user root Aug 03 08:36:56 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-b6cb6ff1-78a8-4e26-b722-59c864adc84e tempest-SnapshotsActionsTest-2081672924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-b82f4208-7884-4e40-b208-2865320cd5a4.4f676038-43ab-43f3-8c50-3cbace0c9f5f" returned: 0 in 0.837s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:36:56 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-b6cb6ff1-78a8-4e26-b722-59c864adc84e tempest-SnapshotsActionsTest-2081672924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-b82f4208-7884-4e40-b208-2865320cd5a4.4f676038-43ab-43f3-8c50-3cbace0c9f5f {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:36:56 devstack sudo[99847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-b82f4208-7884-4e40-b208-2865320cd5a4.4f676038-43ab-43f3-8c50-3cbace0c9f5f Aug 03 08:36:56 devstack sudo[99847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:36:57 devstack sudo[99847]: pam_unix(sudo:session): session closed for user root Aug 03 08:36:57 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-b6cb6ff1-78a8-4e26-b722-59c864adc84e tempest-SnapshotsActionsTest-2081672924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-b82f4208-7884-4e40-b208-2865320cd5a4.4f676038-43ab-43f3-8c50-3cbace0c9f5f" returned: 0 in 0.496s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:36:57 devstack sudo[99845]: pam_unix(sudo:session): session closed for user root Aug 03 08:36:57 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-cf6a3ef6-e749-4667-9425-003cdd66442d tempest-ServerRescueNegativeTestJSON-1978977044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a" returned: 0 in 0.680s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:36:57 devstack cinder-volume[88899]: DEBUG cinder.manager [None req-cf6a3ef6-e749-4667-9425-003cdd66442d tempest-ServerRescueNegativeTestJSON-1978977044 None] Notifying Schedulers of capabilities ... {{(pid=88899) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 08:36:57 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-b6cb6ff1-78a8-4e26-b722-59c864adc84e tempest-SnapshotsActionsTest-2081672924 None] Lock "cinder-quobyte-4f676038-43ab-43f3-8c50-3cbace0c9f5f" released by "_delete_snapshot" :: held 4.151s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:36:57 devstack cinder-volume[88899]: DEBUG cinder.volume.flows.manager.create_volume [None req-daca7427-2c68-4000-93e3-2be7edee69cd tempest-VolumesActionsTest-415737388 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88899) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 08:36:57 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-daca7427-2c68-4000-93e3-2be7edee69cd tempest-VolumesActionsTest-415737388 None] Flow 'volume_create_manager' (189f3453-6ae5-4447-aa8b-79bcbcc63d6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:36:57 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-daca7427-2c68-4000-93e3-2be7edee69cd tempest-VolumesActionsTest-415737388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e8e8db4-a4e3-4198-af5c-cd938299938b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:36:57 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-b6cb6ff1-78a8-4e26-b722-59c864adc84e tempest-SnapshotsActionsTest-2081672924 None] Lock "cinder-quobyte-b82f4208-7884-4e40-b208-2865320cd5a4" released by "delete_snapshot" :: held 4.314s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:36:57 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-cf6a3ef6-e749-4667-9425-003cdd66442d tempest-ServerRescueNegativeTestJSON-1978977044 None] Deleted volume successfully. Aug 03 08:36:57 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-daca7427-2c68-4000-93e3-2be7edee69cd tempest-VolumesActionsTest-415737388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e8e8db4-a4e3-4198-af5c-cd938299938b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:36:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1587473547',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f8a1cf9a-15f8-4f65-a547-7ccb4ef2b18d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d2cd534485a4923b66db7805993790c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:36:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:36:57Z,use_quota=True,user_id='d9b57e0f46644b399e1a0aea198130dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8bde7129-1dc4-42ab-b852-ab32c61b4921),volume_type_id=8bde7129-1dc4-42ab-b852-ab32c61b4921)' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:36:57 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-daca7427-2c68-4000-93e3-2be7edee69cd tempest-VolumesActionsTest-415737388 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d9e85df-ed94-437b-b764-7daed7b9e0c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:36:57 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-daca7427-2c68-4000-93e3-2be7edee69cd tempest-VolumesActionsTest-415737388 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d9e85df-ed94-437b-b764-7daed7b9e0c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:36:57 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-daca7427-2c68-4000-93e3-2be7edee69cd tempest-VolumesActionsTest-415737388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (24ed00dc-0562-4da9-a5fe-454f294d23c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:36:57 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-daca7427-2c68-4000-93e3-2be7edee69cd tempest-VolumesActionsTest-415737388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (24ed00dc-0562-4da9-a5fe-454f294d23c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f8a1cf9a-15f8-4f65-a547-7ccb4ef2b18d', 'volume_name': 'volume-f8a1cf9a-15f8-4f65-a547-7ccb4ef2b18d', 'volume_size': 1}' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:36:57 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-daca7427-2c68-4000-93e3-2be7edee69cd tempest-VolumesActionsTest-415737388 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dbcb2907-37fc-4d64-9799-9b943dfae3a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:36:57 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-daca7427-2c68-4000-93e3-2be7edee69cd tempest-VolumesActionsTest-415737388 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dbcb2907-37fc-4d64-9799-9b943dfae3a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:36:57 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-daca7427-2c68-4000-93e3-2be7edee69cd tempest-VolumesActionsTest-415737388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b2a6496-8572-4def-9168-5bb5d53ce130) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:36:57 devstack cinder-volume[88899]: INFO cinder.volume.flows.manager.create_volume [None req-daca7427-2c68-4000-93e3-2be7edee69cd tempest-VolumesActionsTest-415737388 None] Volume f8a1cf9a-15f8-4f65-a547-7ccb4ef2b18d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f8a1cf9a-15f8-4f65-a547-7ccb4ef2b18d', 'volume_size': 1} Aug 03 08:36:57 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-daca7427-2c68-4000-93e3-2be7edee69cd tempest-VolumesActionsTest-415737388 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:36:57 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-cf6a3ef6-e749-4667-9425-003cdd66442d tempest-ServerRescueNegativeTestJSON-1978977044 None] Lock "cinder-6f777fee-2628-4f2c-bd5a-ed7783cae624-delete_volume" released by "delete_volume" :: held 3.611s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:36:57 devstack cinder-volume[88899]: DEBUG cinder.quota [None req-b6cb6ff1-78a8-4e26-b722-59c864adc84e tempest-SnapshotsActionsTest-2081672924 None] Created reservations ['3078bcb0-fe1a-44d5-8909-e860184ad553', 'af4fd94b-b3b0-4801-b4a4-bccd9905425a', '2d39e5fa-6062-4bf1-9b5a-f88328dcc2f1', '6d9ce7e3-3f2d-496b-9862-dba96f1acab3'] {{(pid=88899) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 08:36:57 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-b6cb6ff1-78a8-4e26-b722-59c864adc84e tempest-SnapshotsActionsTest-2081672924 None] Delete snapshot completed successfully. Aug 03 08:36:57 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-b6cb6ff1-78a8-4e26-b722-59c864adc84e tempest-SnapshotsActionsTest-2081672924 None] Lock "cinder-4f676038-43ab-43f3-8c50-3cbace0c9f5f-delete_snapshot" released by "delete_snapshot" :: held 4.761s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:36:59 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-1bbb0050-69dd-4019-a190-0e367fac3dcf tempest-SnapshotsActionsTest-2081672924 None] Acquiring lock "cinder-b82f4208-7884-4e40-b208-2865320cd5a4-delete_volume" by "delete_volume" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:36:59 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-1bbb0050-69dd-4019-a190-0e367fac3dcf tempest-SnapshotsActionsTest-2081672924 None] Lock "cinder-b82f4208-7884-4e40-b208-2865320cd5a4-delete_volume" acquired by "delete_volume" :: waited 0.110s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:36:59 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-1bbb0050-69dd-4019-a190-0e367fac3dcf tempest-SnapshotsActionsTest-2081672924 None] Acquiring lock "cinder-quobyte-b82f4208-7884-4e40-b208-2865320cd5a4" by "delete_volume" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:36:59 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-1bbb0050-69dd-4019-a190-0e367fac3dcf tempest-SnapshotsActionsTest-2081672924 None] Lock "cinder-quobyte-b82f4208-7884-4e40-b208-2865320cd5a4" acquired by "delete_volume" :: waited 0.033s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:36:59 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[24d37fc3-6ffa-4761-9384-79c30fac47a4]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:36:59 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-1bbb0050-69dd-4019-a190-0e367fac3dcf tempest-SnapshotsActionsTest-2081672924 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-b82f4208-7884-4e40-b208-2865320cd5a4 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:36:59 devstack sudo[99884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-b82f4208-7884-4e40-b208-2865320cd5a4 Aug 03 08:36:59 devstack sudo[99884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:37:00 devstack sudo[99884]: pam_unix(sudo:session): session closed for user root Aug 03 08:37:00 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-1bbb0050-69dd-4019-a190-0e367fac3dcf tempest-SnapshotsActionsTest-2081672924 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-b82f4208-7884-4e40-b208-2865320cd5a4" returned: 0 in 1.193s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:37:00 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-1bbb0050-69dd-4019-a190-0e367fac3dcf tempest-SnapshotsActionsTest-2081672924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-b82f4208-7884-4e40-b208-2865320cd5a4 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:37:00 devstack sudo[99892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-b82f4208-7884-4e40-b208-2865320cd5a4 Aug 03 08:37:00 devstack sudo[99892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:37:01 devstack sudo[99892]: pam_unix(sudo:session): session closed for user root Aug 03 08:37:01 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-1bbb0050-69dd-4019-a190-0e367fac3dcf tempest-SnapshotsActionsTest-2081672924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-b82f4208-7884-4e40-b208-2865320cd5a4" returned: 0 in 0.643s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:37:01 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-1bbb0050-69dd-4019-a190-0e367fac3dcf tempest-SnapshotsActionsTest-2081672924 None] Lock "cinder-quobyte-b82f4208-7884-4e40-b208-2865320cd5a4" released by "delete_volume" :: held 2.061s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:37:01 devstack cinder-volume[88899]: DEBUG cinder.quota [None req-1bbb0050-69dd-4019-a190-0e367fac3dcf tempest-SnapshotsActionsTest-2081672924 None] Created reservations ['6ca8ae80-2995-4a5f-af78-f5fcb76586da', '42fe905c-17cd-41ee-b24d-e4e505616e4d', '5d7b617d-2f07-4ccf-bc74-9d1a6c9f2c44', '358c87ee-bdc6-4c3f-9e51-99cd2d248a8f'] {{(pid=88899) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 08:37:02 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-1bbb0050-69dd-4019-a190-0e367fac3dcf tempest-SnapshotsActionsTest-2081672924 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:37:02 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-1bbb0050-69dd-4019-a190-0e367fac3dcf tempest-SnapshotsActionsTest-2081672924 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:37:02 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-1bbb0050-69dd-4019-a190-0e367fac3dcf tempest-SnapshotsActionsTest-2081672924 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:37:02 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-1bbb0050-69dd-4019-a190-0e367fac3dcf tempest-SnapshotsActionsTest-2081672924 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:37:02 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-1bbb0050-69dd-4019-a190-0e367fac3dcf tempest-SnapshotsActionsTest-2081672924 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:37:02 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-1bbb0050-69dd-4019-a190-0e367fac3dcf tempest-SnapshotsActionsTest-2081672924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:37:02 devstack sudo[99895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a Aug 03 08:37:02 devstack sudo[99895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:37:02 devstack sudo[99895]: pam_unix(sudo:session): session closed for user root Aug 03 08:37:02 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-1bbb0050-69dd-4019-a190-0e367fac3dcf tempest-SnapshotsActionsTest-2081672924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a" returned: 0 in 0.595s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:37:02 devstack cinder-volume[88899]: DEBUG cinder.manager [None req-1bbb0050-69dd-4019-a190-0e367fac3dcf tempest-SnapshotsActionsTest-2081672924 None] Notifying Schedulers of capabilities ... {{(pid=88899) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 08:37:02 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-1bbb0050-69dd-4019-a190-0e367fac3dcf tempest-SnapshotsActionsTest-2081672924 None] Deleted volume successfully. Aug 03 08:37:02 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-1bbb0050-69dd-4019-a190-0e367fac3dcf tempest-SnapshotsActionsTest-2081672924 None] Lock "cinder-b82f4208-7884-4e40-b208-2865320cd5a4-delete_volume" released by "delete_volume" :: held 3.439s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:37:12 devstack cinder-volume[88899]: DEBUG dbcounter [-] [88899] Writing DB stats cinder:SELECT=58,cinder:UPDATE=55,cinder:INSERT=15,cinder:DELETE=4 {{(pid=88899) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 03 08:37:12 devstack cinder-volume[88899]: DEBUG dbcounter [-] [88899] Writing DB stats cinder:SELECT=53,cinder:UPDATE=62,cinder:DELETE=6,cinder:INSERT=17 {{(pid=88899) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 03 08:37:27 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-fb2c1188-24d0-44cc-bb1d-e811fdc61c80 tempest-TestImageHashVerification-123135469 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 42.473s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:37:27 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-fb2c1188-24d0-44cc-bb1d-e811fdc61c80 tempest-TestImageHashVerification-123135469 None] Uploaded volume to glance image-id: fc74f8f7-e224-4080-a060-daec7539a7d1. {{(pid=88899) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Aug 03 08:37:27 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-daca7427-2c68-4000-93e3-2be7edee69cd tempest-VolumesActionsTest-415737388 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 29.591s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:37:27 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-daca7427-2c68-4000-93e3-2be7edee69cd tempest-VolumesActionsTest-415737388 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:36:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1587473547',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f8a1cf9a-15f8-4f65-a547-7ccb4ef2b18d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d2cd534485a4923b66db7805993790c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:36:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:36:57Z,use_quota=True,user_id='d9b57e0f46644b399e1a0aea198130dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8bde7129-1dc4-42ab-b852-ab32c61b4921),volume_type_id=8bde7129-1dc4-42ab-b852-ab32c61b4921)}" {{(pid=88899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 08:37:27 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-daca7427-2c68-4000-93e3-2be7edee69cd tempest-VolumesActionsTest-415737388 None] Creating volume f8a1cf9a-15f8-4f65-a547-7ccb4ef2b18d {{(pid=88899) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 08:37:27 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-daca7427-2c68-4000-93e3-2be7edee69cd tempest-VolumesActionsTest-415737388 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:37:27 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-daca7427-2c68-4000-93e3-2be7edee69cd tempest-VolumesActionsTest-415737388 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:37:27 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-daca7427-2c68-4000-93e3-2be7edee69cd tempest-VolumesActionsTest-415737388 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:37:27 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-daca7427-2c68-4000-93e3-2be7edee69cd tempest-VolumesActionsTest-415737388 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:37:27 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-daca7427-2c68-4000-93e3-2be7edee69cd tempest-VolumesActionsTest-415737388 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:37:27 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-daca7427-2c68-4000-93e3-2be7edee69cd tempest-VolumesActionsTest-415737388 None] Selected osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385 as target Quobyte volume. {{(pid=88899) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 08:37:27 devstack cinder-volume[88899]: INFO cinder.volume.drivers.remotefs [None req-daca7427-2c68-4000-93e3-2be7edee69cd tempest-VolumesActionsTest-415737388 None] casted to osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385 Aug 03 08:37:27 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-daca7427-2c68-4000-93e3-2be7edee69cd tempest-VolumesActionsTest-415737388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-f8a1cf9a-15f8-4f65-a547-7ccb4ef2b18d 1073741824 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:37:27 devstack sudo[99955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-f8a1cf9a-15f8-4f65-a547-7ccb4ef2b18d 1073741824 Aug 03 08:37:27 devstack sudo[99955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:37:27 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-fb2c1188-24d0-44cc-bb1d-e811fdc61c80 tempest-TestImageHashVerification-123135469 None] Copy volume to image completed successfully. Aug 03 08:37:27 devstack sudo[99955]: pam_unix(sudo:session): session closed for user root Aug 03 08:37:27 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-daca7427-2c68-4000-93e3-2be7edee69cd tempest-VolumesActionsTest-415737388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-f8a1cf9a-15f8-4f65-a547-7ccb4ef2b18d 1073741824" returned: 0 in 0.628s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:37:27 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-daca7427-2c68-4000-93e3-2be7edee69cd tempest-VolumesActionsTest-415737388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-f8a1cf9a-15f8-4f65-a547-7ccb4ef2b18d {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:37:27 devstack sudo[99961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-f8a1cf9a-15f8-4f65-a547-7ccb4ef2b18d Aug 03 08:37:27 devstack sudo[99961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:37:28 devstack sudo[99961]: pam_unix(sudo:session): session closed for user root Aug 03 08:37:28 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-daca7427-2c68-4000-93e3-2be7edee69cd tempest-VolumesActionsTest-415737388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-f8a1cf9a-15f8-4f65-a547-7ccb4ef2b18d" returned: 0 in 0.300s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:37:28 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-daca7427-2c68-4000-93e3-2be7edee69cd tempest-VolumesActionsTest-415737388 None] <== create_volume: return (1017ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'} {{(pid=88899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 08:37:28 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-daca7427-2c68-4000-93e3-2be7edee69cd tempest-VolumesActionsTest-415737388 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.020s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:37:28 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-daca7427-2c68-4000-93e3-2be7edee69cd tempest-VolumesActionsTest-415737388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b2a6496-8572-4def-9168-5bb5d53ce130) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f8a1cf9a-15f8-4f65-a547-7ccb4ef2b18d', 'volume_size': 1}' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:37:28 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-daca7427-2c68-4000-93e3-2be7edee69cd tempest-VolumesActionsTest-415737388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1bd79cca-354c-46c2-bfca-af51c37b6894) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:37:28 devstack cinder-volume[88899]: INFO cinder.volume.flows.manager.create_volume [None req-daca7427-2c68-4000-93e3-2be7edee69cd tempest-VolumesActionsTest-415737388 None] Volume volume-f8a1cf9a-15f8-4f65-a547-7ccb4ef2b18d (f8a1cf9a-15f8-4f65-a547-7ccb4ef2b18d): created successfully Aug 03 08:37:28 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-daca7427-2c68-4000-93e3-2be7edee69cd tempest-VolumesActionsTest-415737388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1bd79cca-354c-46c2-bfca-af51c37b6894) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:37:28 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-daca7427-2c68-4000-93e3-2be7edee69cd tempest-VolumesActionsTest-415737388 None] Flow 'volume_create_manager' (189f3453-6ae5-4447-aa8b-79bcbcc63d6e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:37:28 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-daca7427-2c68-4000-93e3-2be7edee69cd tempest-VolumesActionsTest-415737388 None] Created volume successfully. Aug 03 08:37:28 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-0b0907d8-0584-4485-994b-1d82359cdca9 tempest-TestImageHashVerification-123135469 None] Acquiring lock "cinder-1e721c9e-ddf1-4f74-97e6-3cd14a7d720e-delete_volume" by "delete_volume" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:37:28 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-58b20dc8-fc13-44ab-b5c8-2368f860c901 tempest-VolumesActionsTest-415737388 None] Acquiring lock "cinder-f8a1cf9a-15f8-4f65-a547-7ccb4ef2b18d" by "attach_volume" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:37:28 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-0b0907d8-0584-4485-994b-1d82359cdca9 tempest-TestImageHashVerification-123135469 None] Lock "cinder-1e721c9e-ddf1-4f74-97e6-3cd14a7d720e-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:37:28 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-58b20dc8-fc13-44ab-b5c8-2368f860c901 tempest-VolumesActionsTest-415737388 None] Lock "cinder-f8a1cf9a-15f8-4f65-a547-7ccb4ef2b18d" acquired by "attach_volume" :: waited 0.051s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:37:28 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-0b0907d8-0584-4485-994b-1d82359cdca9 tempest-TestImageHashVerification-123135469 None] Acquiring lock "cinder-quobyte-1e721c9e-ddf1-4f74-97e6-3cd14a7d720e" by "delete_volume" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:37:28 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-0b0907d8-0584-4485-994b-1d82359cdca9 tempest-TestImageHashVerification-123135469 None] Lock "cinder-quobyte-1e721c9e-ddf1-4f74-97e6-3cd14a7d720e" acquired by "delete_volume" :: waited 0.028s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:37:28 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5f0fe0b-5b96-45ea-b621-8f5f829f1e79]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:37:28 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-0b0907d8-0584-4485-994b-1d82359cdca9 tempest-TestImageHashVerification-123135469 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-1e721c9e-ddf1-4f74-97e6-3cd14a7d720e {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:37:28 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-58b20dc8-fc13-44ab-b5c8-2368f860c901 tempest-VolumesActionsTest-415737388 None] Attaching volume f8a1cf9a-15f8-4f65-a547-7ccb4ef2b18d to instance cf42e512-34e4-44e2-aa23-a36611960cbc at mountpoint /dev/vdb on host None. Aug 03 08:37:28 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-58b20dc8-fc13-44ab-b5c8-2368f860c901 tempest-VolumesActionsTest-415737388 None] Attach volume completed successfully. Aug 03 08:37:28 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-58b20dc8-fc13-44ab-b5c8-2368f860c901 tempest-VolumesActionsTest-415737388 None] Lock "cinder-f8a1cf9a-15f8-4f65-a547-7ccb4ef2b18d" released by "attach_volume" :: held 0.227s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:37:29 devstack sudo[99964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-1e721c9e-ddf1-4f74-97e6-3cd14a7d720e Aug 03 08:37:29 devstack sudo[99964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:37:29 devstack sudo[99964]: pam_unix(sudo:session): session closed for user root Aug 03 08:37:29 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-0b0907d8-0584-4485-994b-1d82359cdca9 tempest-TestImageHashVerification-123135469 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-1e721c9e-ddf1-4f74-97e6-3cd14a7d720e" returned: 0 in 0.423s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:37:29 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-0b0907d8-0584-4485-994b-1d82359cdca9 tempest-TestImageHashVerification-123135469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-1e721c9e-ddf1-4f74-97e6-3cd14a7d720e {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:37:29 devstack sudo[99969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-1e721c9e-ddf1-4f74-97e6-3cd14a7d720e Aug 03 08:37:29 devstack sudo[99969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:37:29 devstack sudo[99969]: pam_unix(sudo:session): session closed for user root Aug 03 08:37:29 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-0b0907d8-0584-4485-994b-1d82359cdca9 tempest-TestImageHashVerification-123135469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-1e721c9e-ddf1-4f74-97e6-3cd14a7d720e" returned: 0 in 0.275s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:37:29 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-0b0907d8-0584-4485-994b-1d82359cdca9 tempest-TestImageHashVerification-123135469 None] Lock "cinder-quobyte-1e721c9e-ddf1-4f74-97e6-3cd14a7d720e" released by "delete_volume" :: held 0.753s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:37:29 devstack cinder-volume[88899]: DEBUG cinder.quota [None req-0b0907d8-0584-4485-994b-1d82359cdca9 tempest-TestImageHashVerification-123135469 None] Created reservations ['9f85eccd-d529-4be0-83af-7baf27b00d01', 'df6275b3-728f-4aeb-9445-61d8c06d81eb', '0da84270-248e-406a-a20d-52ae4f69aa83', '1905c69e-6fea-404b-af60-f926ad61b1aa'] {{(pid=88899) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 08:37:29 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-0b0907d8-0584-4485-994b-1d82359cdca9 tempest-TestImageHashVerification-123135469 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:37:29 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-0b0907d8-0584-4485-994b-1d82359cdca9 tempest-TestImageHashVerification-123135469 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:37:29 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-0b0907d8-0584-4485-994b-1d82359cdca9 tempest-TestImageHashVerification-123135469 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:37:29 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-0b0907d8-0584-4485-994b-1d82359cdca9 tempest-TestImageHashVerification-123135469 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:37:29 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-0b0907d8-0584-4485-994b-1d82359cdca9 tempest-TestImageHashVerification-123135469 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:37:29 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-0b0907d8-0584-4485-994b-1d82359cdca9 tempest-TestImageHashVerification-123135469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:37:29 devstack sudo[99975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a Aug 03 08:37:29 devstack sudo[99975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:37:29 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-e0b6bbfc-85eb-42e0-8695-05a0db09e823 tempest-VolumesActionsTest-48611561 None] Terminate volume connection completed successfully. Aug 03 08:37:29 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-e0b6bbfc-85eb-42e0-8695-05a0db09e823 tempest-VolumesActionsTest-48611561 None] Acquiring lock "cinder-f8a1cf9a-15f8-4f65-a547-7ccb4ef2b18d-detach_volume" by "detach_volume" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:37:29 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-e0b6bbfc-85eb-42e0-8695-05a0db09e823 tempest-VolumesActionsTest-48611561 None] Lock "cinder-f8a1cf9a-15f8-4f65-a547-7ccb4ef2b18d-detach_volume" acquired by "detach_volume" :: waited 0.023s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:37:29 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-e0b6bbfc-85eb-42e0-8695-05a0db09e823 tempest-VolumesActionsTest-48611561 None] Detaching volume f8a1cf9a-15f8-4f65-a547-7ccb4ef2b18d from instance cf42e512-34e4-44e2-aa23-a36611960cbc. Aug 03 08:37:30 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-e0b6bbfc-85eb-42e0-8695-05a0db09e823 tempest-VolumesActionsTest-48611561 None] Detach volume completed successfully. Aug 03 08:37:30 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-e0b6bbfc-85eb-42e0-8695-05a0db09e823 tempest-VolumesActionsTest-48611561 None] Lock "cinder-f8a1cf9a-15f8-4f65-a547-7ccb4ef2b18d-detach_volume" released by "detach_volume" :: held 0.101s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:37:30 devstack sudo[99975]: pam_unix(sudo:session): session closed for user root Aug 03 08:37:30 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-0b0907d8-0584-4485-994b-1d82359cdca9 tempest-TestImageHashVerification-123135469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a" returned: 0 in 0.443s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:37:30 devstack cinder-volume[88899]: DEBUG cinder.manager [None req-0b0907d8-0584-4485-994b-1d82359cdca9 tempest-TestImageHashVerification-123135469 None] Notifying Schedulers of capabilities ... {{(pid=88899) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 08:37:30 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-0b0907d8-0584-4485-994b-1d82359cdca9 tempest-TestImageHashVerification-123135469 None] Deleted volume successfully. Aug 03 08:37:30 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-0b0907d8-0584-4485-994b-1d82359cdca9 tempest-TestImageHashVerification-123135469 None] Lock "cinder-1e721c9e-ddf1-4f74-97e6-3cd14a7d720e-delete_volume" released by "delete_volume" :: held 1.632s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:37:30 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-56a33bc4-70cb-4e0c-9bd4-7d01f440d88e tempest-VolumesActionsTest-415737388 None] Acquiring lock "cinder-f8a1cf9a-15f8-4f65-a547-7ccb4ef2b18d-detach_volume" by "detach_volume" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:37:30 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-56a33bc4-70cb-4e0c-9bd4-7d01f440d88e tempest-VolumesActionsTest-415737388 None] Lock "cinder-f8a1cf9a-15f8-4f65-a547-7ccb4ef2b18d-detach_volume" acquired by "detach_volume" :: waited 0.032s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:37:30 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-56a33bc4-70cb-4e0c-9bd4-7d01f440d88e tempest-VolumesActionsTest-415737388 None] Volume detach called, but volume not attached. Aug 03 08:37:30 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-56a33bc4-70cb-4e0c-9bd4-7d01f440d88e tempest-VolumesActionsTest-415737388 None] Lock "cinder-f8a1cf9a-15f8-4f65-a547-7ccb4ef2b18d-detach_volume" released by "detach_volume" :: held 0.023s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:37:30 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-293d6f98-159c-4ca3-858c-b89c47b57b2c tempest-VolumesActionsTest-415737388 None] Acquiring lock "cinder-f8a1cf9a-15f8-4f65-a547-7ccb4ef2b18d-delete_volume" by "delete_volume" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:37:30 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-293d6f98-159c-4ca3-858c-b89c47b57b2c tempest-VolumesActionsTest-415737388 None] Lock "cinder-f8a1cf9a-15f8-4f65-a547-7ccb4ef2b18d-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:37:30 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-293d6f98-159c-4ca3-858c-b89c47b57b2c tempest-VolumesActionsTest-415737388 None] Acquiring lock "cinder-quobyte-f8a1cf9a-15f8-4f65-a547-7ccb4ef2b18d" by "delete_volume" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:37:30 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-293d6f98-159c-4ca3-858c-b89c47b57b2c tempest-VolumesActionsTest-415737388 None] Lock "cinder-quobyte-f8a1cf9a-15f8-4f65-a547-7ccb4ef2b18d" acquired by "delete_volume" :: waited 0.031s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:37:30 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bc852c4-6278-4468-899a-29e4bc554b2b]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:37:30 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-293d6f98-159c-4ca3-858c-b89c47b57b2c tempest-VolumesActionsTest-415737388 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-f8a1cf9a-15f8-4f65-a547-7ccb4ef2b18d {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:37:30 devstack sudo[99979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-f8a1cf9a-15f8-4f65-a547-7ccb4ef2b18d Aug 03 08:37:30 devstack sudo[99979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:37:31 devstack sudo[99979]: pam_unix(sudo:session): session closed for user root Aug 03 08:37:31 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-293d6f98-159c-4ca3-858c-b89c47b57b2c tempest-VolumesActionsTest-415737388 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-f8a1cf9a-15f8-4f65-a547-7ccb4ef2b18d" returned: 0 in 0.493s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:37:31 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-293d6f98-159c-4ca3-858c-b89c47b57b2c tempest-VolumesActionsTest-415737388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-f8a1cf9a-15f8-4f65-a547-7ccb4ef2b18d {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:37:31 devstack sudo[99984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-f8a1cf9a-15f8-4f65-a547-7ccb4ef2b18d Aug 03 08:37:31 devstack sudo[99984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:37:31 devstack sudo[99984]: pam_unix(sudo:session): session closed for user root Aug 03 08:37:31 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-293d6f98-159c-4ca3-858c-b89c47b57b2c tempest-VolumesActionsTest-415737388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-f8a1cf9a-15f8-4f65-a547-7ccb4ef2b18d" returned: 0 in 0.314s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:37:31 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-293d6f98-159c-4ca3-858c-b89c47b57b2c tempest-VolumesActionsTest-415737388 None] Lock "cinder-quobyte-f8a1cf9a-15f8-4f65-a547-7ccb4ef2b18d" released by "delete_volume" :: held 0.886s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:37:31 devstack cinder-volume[88899]: DEBUG cinder.quota [None req-293d6f98-159c-4ca3-858c-b89c47b57b2c tempest-VolumesActionsTest-415737388 None] Created reservations ['bf7eb090-2147-4e91-8e3f-a85360d28480', 'a0ccc68a-5ef4-4acc-b1a5-b31903df47e0', '7cdfd85c-c4b3-4969-bf0a-5666ab72d75e', '05a7085c-48bb-4c41-a6d5-9bfb6c8a79a4'] {{(pid=88899) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 08:37:31 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-293d6f98-159c-4ca3-858c-b89c47b57b2c tempest-VolumesActionsTest-415737388 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:37:31 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-293d6f98-159c-4ca3-858c-b89c47b57b2c tempest-VolumesActionsTest-415737388 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:37:31 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-293d6f98-159c-4ca3-858c-b89c47b57b2c tempest-VolumesActionsTest-415737388 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:37:31 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-293d6f98-159c-4ca3-858c-b89c47b57b2c tempest-VolumesActionsTest-415737388 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:37:31 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-293d6f98-159c-4ca3-858c-b89c47b57b2c tempest-VolumesActionsTest-415737388 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:37:31 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-293d6f98-159c-4ca3-858c-b89c47b57b2c tempest-VolumesActionsTest-415737388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:37:31 devstack sudo[99988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a Aug 03 08:37:31 devstack sudo[99988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:37:32 devstack sudo[99988]: pam_unix(sudo:session): session closed for user root Aug 03 08:37:32 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-293d6f98-159c-4ca3-858c-b89c47b57b2c tempest-VolumesActionsTest-415737388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a" returned: 0 in 0.315s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:37:32 devstack cinder-volume[88899]: DEBUG cinder.manager [None req-293d6f98-159c-4ca3-858c-b89c47b57b2c tempest-VolumesActionsTest-415737388 None] Notifying Schedulers of capabilities ... {{(pid=88899) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 08:37:32 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-293d6f98-159c-4ca3-858c-b89c47b57b2c tempest-VolumesActionsTest-415737388 None] Deleted volume successfully. Aug 03 08:37:32 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-293d6f98-159c-4ca3-858c-b89c47b57b2c tempest-VolumesActionsTest-415737388 None] Lock "cinder-f8a1cf9a-15f8-4f65-a547-7ccb4ef2b18d-delete_volume" released by "delete_volume" :: held 1.650s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:37:38 devstack cinder-volume[88899]: DEBUG cinder.volume.flows.manager.create_volume [None req-256ccecb-4f54-45a6-9ad5-59640d88f718 tempest-VolumesActionsTest-415737388 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88899) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 08:37:38 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-256ccecb-4f54-45a6-9ad5-59640d88f718 tempest-VolumesActionsTest-415737388 None] Flow 'volume_create_manager' (712bc60c-cdde-4d2f-a54c-6c909edcc759) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:37:38 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-256ccecb-4f54-45a6-9ad5-59640d88f718 tempest-VolumesActionsTest-415737388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83357865-7ef1-4cc0-b7d9-f278d95a953d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:37:38 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-256ccecb-4f54-45a6-9ad5-59640d88f718 tempest-VolumesActionsTest-415737388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83357865-7ef1-4cc0-b7d9-f278d95a953d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:37:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1733595296',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d205f2c-c3ba-41cd-84b7-af9e3a6d5efa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d2cd534485a4923b66db7805993790c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:37:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:37:39Z,use_quota=True,user_id='d9b57e0f46644b399e1a0aea198130dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8bde7129-1dc4-42ab-b852-ab32c61b4921),volume_type_id=8bde7129-1dc4-42ab-b852-ab32c61b4921)' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:37:38 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-256ccecb-4f54-45a6-9ad5-59640d88f718 tempest-VolumesActionsTest-415737388 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d6d64e4c-41cb-4e9f-a577-2af56d5d84f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:37:38 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-256ccecb-4f54-45a6-9ad5-59640d88f718 tempest-VolumesActionsTest-415737388 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d6d64e4c-41cb-4e9f-a577-2af56d5d84f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:37:38 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-256ccecb-4f54-45a6-9ad5-59640d88f718 tempest-VolumesActionsTest-415737388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14aec851-e9a5-43d2-ba7d-6891d5081a47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:37:38 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-256ccecb-4f54-45a6-9ad5-59640d88f718 tempest-VolumesActionsTest-415737388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14aec851-e9a5-43d2-ba7d-6891d5081a47) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3d205f2c-c3ba-41cd-84b7-af9e3a6d5efa', 'volume_name': 'volume-3d205f2c-c3ba-41cd-84b7-af9e3a6d5efa', 'volume_size': 1}' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:37:38 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-256ccecb-4f54-45a6-9ad5-59640d88f718 tempest-VolumesActionsTest-415737388 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc93dffb-6922-4fe0-b78e-1da3f72a3d95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:37:39 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-256ccecb-4f54-45a6-9ad5-59640d88f718 tempest-VolumesActionsTest-415737388 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc93dffb-6922-4fe0-b78e-1da3f72a3d95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:37:39 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-256ccecb-4f54-45a6-9ad5-59640d88f718 tempest-VolumesActionsTest-415737388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4104139a-f672-4238-946b-86a5ba1dd365) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:37:39 devstack cinder-volume[88899]: INFO cinder.volume.flows.manager.create_volume [None req-256ccecb-4f54-45a6-9ad5-59640d88f718 tempest-VolumesActionsTest-415737388 None] Volume 3d205f2c-c3ba-41cd-84b7-af9e3a6d5efa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3d205f2c-c3ba-41cd-84b7-af9e3a6d5efa', 'volume_size': 1} Aug 03 08:37:39 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-256ccecb-4f54-45a6-9ad5-59640d88f718 tempest-VolumesActionsTest-415737388 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:37:39 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-256ccecb-4f54-45a6-9ad5-59640d88f718 tempest-VolumesActionsTest-415737388 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:37:39 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-256ccecb-4f54-45a6-9ad5-59640d88f718 tempest-VolumesActionsTest-415737388 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:37:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1733595296',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d205f2c-c3ba-41cd-84b7-af9e3a6d5efa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d2cd534485a4923b66db7805993790c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:37:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:37:39Z,use_quota=True,user_id='d9b57e0f46644b399e1a0aea198130dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8bde7129-1dc4-42ab-b852-ab32c61b4921),volume_type_id=8bde7129-1dc4-42ab-b852-ab32c61b4921)}" {{(pid=88899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 08:37:39 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-256ccecb-4f54-45a6-9ad5-59640d88f718 tempest-VolumesActionsTest-415737388 None] Creating volume 3d205f2c-c3ba-41cd-84b7-af9e3a6d5efa {{(pid=88899) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 08:37:39 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-256ccecb-4f54-45a6-9ad5-59640d88f718 tempest-VolumesActionsTest-415737388 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:37:39 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-256ccecb-4f54-45a6-9ad5-59640d88f718 tempest-VolumesActionsTest-415737388 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:37:39 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-256ccecb-4f54-45a6-9ad5-59640d88f718 tempest-VolumesActionsTest-415737388 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:37:39 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-256ccecb-4f54-45a6-9ad5-59640d88f718 tempest-VolumesActionsTest-415737388 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:37:39 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-256ccecb-4f54-45a6-9ad5-59640d88f718 tempest-VolumesActionsTest-415737388 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:37:39 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-256ccecb-4f54-45a6-9ad5-59640d88f718 tempest-VolumesActionsTest-415737388 None] Selected osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385 as target Quobyte volume. {{(pid=88899) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 08:37:39 devstack cinder-volume[88899]: INFO cinder.volume.drivers.remotefs [None req-256ccecb-4f54-45a6-9ad5-59640d88f718 tempest-VolumesActionsTest-415737388 None] casted to osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385 Aug 03 08:37:39 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-256ccecb-4f54-45a6-9ad5-59640d88f718 tempest-VolumesActionsTest-415737388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-3d205f2c-c3ba-41cd-84b7-af9e3a6d5efa 1073741824 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:37:39 devstack sudo[100105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-3d205f2c-c3ba-41cd-84b7-af9e3a6d5efa 1073741824 Aug 03 08:37:39 devstack sudo[100105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:37:39 devstack sudo[100105]: pam_unix(sudo:session): session closed for user root Aug 03 08:37:39 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-256ccecb-4f54-45a6-9ad5-59640d88f718 tempest-VolumesActionsTest-415737388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-3d205f2c-c3ba-41cd-84b7-af9e3a6d5efa 1073741824" returned: 0 in 0.693s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:37:39 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-256ccecb-4f54-45a6-9ad5-59640d88f718 tempest-VolumesActionsTest-415737388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-3d205f2c-c3ba-41cd-84b7-af9e3a6d5efa {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:37:39 devstack sudo[100128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-3d205f2c-c3ba-41cd-84b7-af9e3a6d5efa Aug 03 08:37:39 devstack sudo[100128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:37:39 devstack cinder-volume[88899]: DEBUG cinder.volume.flows.manager.create_volume [None req-1d4e99b4-fb18-42eb-9e42-b4adae3f731c tempest-VolumesDeleteCascade-2092426887 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88899) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 08:37:39 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-1d4e99b4-fb18-42eb-9e42-b4adae3f731c tempest-VolumesDeleteCascade-2092426887 None] Flow 'volume_create_manager' (a023a96c-343f-4681-a175-55fdb4a58bdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:37:40 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-1d4e99b4-fb18-42eb-9e42-b4adae3f731c tempest-VolumesDeleteCascade-2092426887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d475ca9-bd53-4600-9a15-e58f0668d364) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:37:40 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-1d4e99b4-fb18-42eb-9e42-b4adae3f731c tempest-VolumesDeleteCascade-2092426887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d475ca9-bd53-4600-9a15-e58f0668d364) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:37:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1687140100',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=52b00d24-cd53-4011-84eb-c09d3fe05304,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e6b9f3cf6e442b9bc0bbd3708562588',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:37:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:37:40Z,use_quota=True,user_id='69472b74f0154de3bbfc7d8c30c8abb0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8bde7129-1dc4-42ab-b852-ab32c61b4921),volume_type_id=8bde7129-1dc4-42ab-b852-ab32c61b4921)' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:37:40 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-1d4e99b4-fb18-42eb-9e42-b4adae3f731c tempest-VolumesDeleteCascade-2092426887 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (29b322f2-dc8f-41e6-a3b6-862ccead3fb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:37:40 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-1d4e99b4-fb18-42eb-9e42-b4adae3f731c tempest-VolumesDeleteCascade-2092426887 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (29b322f2-dc8f-41e6-a3b6-862ccead3fb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:37:40 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-1d4e99b4-fb18-42eb-9e42-b4adae3f731c tempest-VolumesDeleteCascade-2092426887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa072019-4a7d-416b-ab60-5078dca83f5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:37:40 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-1d4e99b4-fb18-42eb-9e42-b4adae3f731c tempest-VolumesDeleteCascade-2092426887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa072019-4a7d-416b-ab60-5078dca83f5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '52b00d24-cd53-4011-84eb-c09d3fe05304', 'volume_name': 'volume-52b00d24-cd53-4011-84eb-c09d3fe05304', 'volume_size': 1}' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:37:40 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-1d4e99b4-fb18-42eb-9e42-b4adae3f731c tempest-VolumesDeleteCascade-2092426887 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ebc02bee-e920-4cf5-a69b-a67780ed3f0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:37:40 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-1d4e99b4-fb18-42eb-9e42-b4adae3f731c tempest-VolumesDeleteCascade-2092426887 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ebc02bee-e920-4cf5-a69b-a67780ed3f0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:37:40 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-1d4e99b4-fb18-42eb-9e42-b4adae3f731c tempest-VolumesDeleteCascade-2092426887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1fcc9fff-43e0-471e-a886-b1c2fdcd59f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:37:40 devstack cinder-volume[88899]: INFO cinder.volume.flows.manager.create_volume [None req-1d4e99b4-fb18-42eb-9e42-b4adae3f731c tempest-VolumesDeleteCascade-2092426887 None] Volume 52b00d24-cd53-4011-84eb-c09d3fe05304: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-52b00d24-cd53-4011-84eb-c09d3fe05304', 'volume_size': 1} Aug 03 08:37:40 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-1d4e99b4-fb18-42eb-9e42-b4adae3f731c tempest-VolumesDeleteCascade-2092426887 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:37:40 devstack sudo[100128]: pam_unix(sudo:session): session closed for user root Aug 03 08:37:40 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-256ccecb-4f54-45a6-9ad5-59640d88f718 tempest-VolumesActionsTest-415737388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-3d205f2c-c3ba-41cd-84b7-af9e3a6d5efa" returned: 0 in 0.314s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:37:40 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-256ccecb-4f54-45a6-9ad5-59640d88f718 tempest-VolumesActionsTest-415737388 None] <== create_volume: return (1156ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'} {{(pid=88899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 08:37:40 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-256ccecb-4f54-45a6-9ad5-59640d88f718 tempest-VolumesActionsTest-415737388 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.158s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:37:40 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-1d4e99b4-fb18-42eb-9e42-b4adae3f731c tempest-VolumesDeleteCascade-2092426887 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.103s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:37:40 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-1d4e99b4-fb18-42eb-9e42-b4adae3f731c tempest-VolumesDeleteCascade-2092426887 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:37:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1687140100',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=52b00d24-cd53-4011-84eb-c09d3fe05304,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e6b9f3cf6e442b9bc0bbd3708562588',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:37:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:37:40Z,use_quota=True,user_id='69472b74f0154de3bbfc7d8c30c8abb0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8bde7129-1dc4-42ab-b852-ab32c61b4921),volume_type_id=8bde7129-1dc4-42ab-b852-ab32c61b4921)}" {{(pid=88899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 08:37:40 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-1d4e99b4-fb18-42eb-9e42-b4adae3f731c tempest-VolumesDeleteCascade-2092426887 None] Creating volume 52b00d24-cd53-4011-84eb-c09d3fe05304 {{(pid=88899) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 08:37:40 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-1d4e99b4-fb18-42eb-9e42-b4adae3f731c tempest-VolumesDeleteCascade-2092426887 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:37:40 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-1d4e99b4-fb18-42eb-9e42-b4adae3f731c tempest-VolumesDeleteCascade-2092426887 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:37:40 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-1d4e99b4-fb18-42eb-9e42-b4adae3f731c tempest-VolumesDeleteCascade-2092426887 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:37:40 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-1d4e99b4-fb18-42eb-9e42-b4adae3f731c tempest-VolumesDeleteCascade-2092426887 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:37:40 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-1d4e99b4-fb18-42eb-9e42-b4adae3f731c tempest-VolumesDeleteCascade-2092426887 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:37:40 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-1d4e99b4-fb18-42eb-9e42-b4adae3f731c tempest-VolumesDeleteCascade-2092426887 None] Selected osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385 as target Quobyte volume. {{(pid=88899) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 08:37:40 devstack cinder-volume[88899]: INFO cinder.volume.drivers.remotefs [None req-1d4e99b4-fb18-42eb-9e42-b4adae3f731c tempest-VolumesDeleteCascade-2092426887 None] casted to osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385 Aug 03 08:37:40 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-1d4e99b4-fb18-42eb-9e42-b4adae3f731c tempest-VolumesDeleteCascade-2092426887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-52b00d24-cd53-4011-84eb-c09d3fe05304 1073741824 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:37:40 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-256ccecb-4f54-45a6-9ad5-59640d88f718 tempest-VolumesActionsTest-415737388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4104139a-f672-4238-946b-86a5ba1dd365) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3d205f2c-c3ba-41cd-84b7-af9e3a6d5efa', 'volume_size': 1}' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:37:40 devstack sudo[100132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-52b00d24-cd53-4011-84eb-c09d3fe05304 1073741824 Aug 03 08:37:40 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-256ccecb-4f54-45a6-9ad5-59640d88f718 tempest-VolumesActionsTest-415737388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b5e9c77-7ade-4418-b729-e28a5aad7258) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:37:40 devstack sudo[100132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:37:40 devstack cinder-volume[88899]: INFO cinder.volume.flows.manager.create_volume [None req-256ccecb-4f54-45a6-9ad5-59640d88f718 tempest-VolumesActionsTest-415737388 None] Volume volume-3d205f2c-c3ba-41cd-84b7-af9e3a6d5efa (3d205f2c-c3ba-41cd-84b7-af9e3a6d5efa): created successfully Aug 03 08:37:40 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-256ccecb-4f54-45a6-9ad5-59640d88f718 tempest-VolumesActionsTest-415737388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b5e9c77-7ade-4418-b729-e28a5aad7258) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:37:40 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-256ccecb-4f54-45a6-9ad5-59640d88f718 tempest-VolumesActionsTest-415737388 None] Flow 'volume_create_manager' (712bc60c-cdde-4d2f-a54c-6c909edcc759) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:37:40 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-256ccecb-4f54-45a6-9ad5-59640d88f718 tempest-VolumesActionsTest-415737388 None] Created volume successfully. Aug 03 08:37:41 devstack sudo[100132]: pam_unix(sudo:session): session closed for user root Aug 03 08:37:41 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-1d4e99b4-fb18-42eb-9e42-b4adae3f731c tempest-VolumesDeleteCascade-2092426887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-52b00d24-cd53-4011-84eb-c09d3fe05304 1073741824" returned: 0 in 0.830s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:37:41 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-1d4e99b4-fb18-42eb-9e42-b4adae3f731c tempest-VolumesDeleteCascade-2092426887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-52b00d24-cd53-4011-84eb-c09d3fe05304 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:37:41 devstack sudo[100140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-52b00d24-cd53-4011-84eb-c09d3fe05304 Aug 03 08:37:41 devstack sudo[100140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:37:41 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-18fd8df2-cf13-44eb-a1e5-3b7e464bb619 tempest-VolumesActionsTest-48611561 None] Acquiring lock "cinder-3d205f2c-c3ba-41cd-84b7-af9e3a6d5efa-delete_volume" by "delete_volume" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:37:41 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-18fd8df2-cf13-44eb-a1e5-3b7e464bb619 tempest-VolumesActionsTest-48611561 None] Lock "cinder-3d205f2c-c3ba-41cd-84b7-af9e3a6d5efa-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:37:41 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-18fd8df2-cf13-44eb-a1e5-3b7e464bb619 tempest-VolumesActionsTest-48611561 None] Acquiring lock "cinder-quobyte-3d205f2c-c3ba-41cd-84b7-af9e3a6d5efa" by "delete_volume" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:37:41 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-18fd8df2-cf13-44eb-a1e5-3b7e464bb619 tempest-VolumesActionsTest-48611561 None] Lock "cinder-quobyte-3d205f2c-c3ba-41cd-84b7-af9e3a6d5efa" acquired by "delete_volume" :: waited 0.034s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:37:41 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8426da5-539c-42c9-91b1-51f628b50fda]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:37:41 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-18fd8df2-cf13-44eb-a1e5-3b7e464bb619 tempest-VolumesActionsTest-48611561 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-3d205f2c-c3ba-41cd-84b7-af9e3a6d5efa {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:37:41 devstack sudo[100140]: pam_unix(sudo:session): session closed for user root Aug 03 08:37:41 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-1d4e99b4-fb18-42eb-9e42-b4adae3f731c tempest-VolumesDeleteCascade-2092426887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-52b00d24-cd53-4011-84eb-c09d3fe05304" returned: 0 in 0.587s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:37:41 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-1d4e99b4-fb18-42eb-9e42-b4adae3f731c tempest-VolumesDeleteCascade-2092426887 None] <== create_volume: return (1506ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'} {{(pid=88899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 08:37:41 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-1d4e99b4-fb18-42eb-9e42-b4adae3f731c tempest-VolumesDeleteCascade-2092426887 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.514s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:37:41 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-1d4e99b4-fb18-42eb-9e42-b4adae3f731c tempest-VolumesDeleteCascade-2092426887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1fcc9fff-43e0-471e-a886-b1c2fdcd59f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-52b00d24-cd53-4011-84eb-c09d3fe05304', 'volume_size': 1}' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:37:41 devstack sudo[100143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-3d205f2c-c3ba-41cd-84b7-af9e3a6d5efa Aug 03 08:37:41 devstack sudo[100143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:37:41 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-1d4e99b4-fb18-42eb-9e42-b4adae3f731c tempest-VolumesDeleteCascade-2092426887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (696bd3f9-6ade-4090-9f47-2c3da97a68c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:37:41 devstack cinder-volume[88899]: INFO cinder.volume.flows.manager.create_volume [None req-1d4e99b4-fb18-42eb-9e42-b4adae3f731c tempest-VolumesDeleteCascade-2092426887 None] Volume volume-52b00d24-cd53-4011-84eb-c09d3fe05304 (52b00d24-cd53-4011-84eb-c09d3fe05304): created successfully Aug 03 08:37:41 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-1d4e99b4-fb18-42eb-9e42-b4adae3f731c tempest-VolumesDeleteCascade-2092426887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (696bd3f9-6ade-4090-9f47-2c3da97a68c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:37:41 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-1d4e99b4-fb18-42eb-9e42-b4adae3f731c tempest-VolumesDeleteCascade-2092426887 None] Flow 'volume_create_manager' (a023a96c-343f-4681-a175-55fdb4a58bdb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:37:41 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-1d4e99b4-fb18-42eb-9e42-b4adae3f731c tempest-VolumesDeleteCascade-2092426887 None] Created volume successfully. Aug 03 08:37:42 devstack sudo[100143]: pam_unix(sudo:session): session closed for user root Aug 03 08:37:42 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-18fd8df2-cf13-44eb-a1e5-3b7e464bb619 tempest-VolumesActionsTest-48611561 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-3d205f2c-c3ba-41cd-84b7-af9e3a6d5efa" returned: 0 in 0.670s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:37:42 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-18fd8df2-cf13-44eb-a1e5-3b7e464bb619 tempest-VolumesActionsTest-48611561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-3d205f2c-c3ba-41cd-84b7-af9e3a6d5efa {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:37:42 devstack sudo[100148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-3d205f2c-c3ba-41cd-84b7-af9e3a6d5efa Aug 03 08:37:42 devstack sudo[100148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:37:42 devstack sudo[100148]: pam_unix(sudo:session): session closed for user root Aug 03 08:37:42 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-18fd8df2-cf13-44eb-a1e5-3b7e464bb619 tempest-VolumesActionsTest-48611561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-3d205f2c-c3ba-41cd-84b7-af9e3a6d5efa" returned: 0 in 0.388s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:37:42 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-18fd8df2-cf13-44eb-a1e5-3b7e464bb619 tempest-VolumesActionsTest-48611561 None] Lock "cinder-quobyte-3d205f2c-c3ba-41cd-84b7-af9e3a6d5efa" released by "delete_volume" :: held 1.165s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:37:42 devstack cinder-volume[88899]: DEBUG cinder.quota [None req-18fd8df2-cf13-44eb-a1e5-3b7e464bb619 tempest-VolumesActionsTest-48611561 None] Created reservations ['58049fc3-170b-437b-9590-a177517e1f81', '7e20f6a1-1cc5-41bc-b3a5-7dbb7da48a3b', '4836286b-73af-48b7-949f-2d3c36d57c79', '62965a1c-40c7-4330-bb4e-2f3fce332c64'] {{(pid=88899) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 08:37:42 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-7f589052-3fad-49d3-b11b-d2b928420409 tempest-VolumesDeleteCascade-2092426887 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:37:42 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-7f589052-3fad-49d3-b11b-d2b928420409 tempest-VolumesDeleteCascade-2092426887 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:37:42 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-7f589052-3fad-49d3-b11b-d2b928420409 tempest-VolumesDeleteCascade-2092426887 None] Creating offline snapshot fb75737e-dcb8-458b-9187-cb8e565e3935 of volume 52b00d24-cd53-4011-84eb-c09d3fe05304 {{(pid=88899) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 03 08:37:42 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2c197ba-923e-4c70-aef0-e975110cd038]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:37:42 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-7f589052-3fad-49d3-b11b-d2b928420409 tempest-VolumesDeleteCascade-2092426887 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-52b00d24-cd53-4011-84eb-c09d3fe05304 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:37:42 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-18fd8df2-cf13-44eb-a1e5-3b7e464bb619 tempest-VolumesActionsTest-48611561 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:37:42 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-18fd8df2-cf13-44eb-a1e5-3b7e464bb619 tempest-VolumesActionsTest-48611561 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:37:42 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-18fd8df2-cf13-44eb-a1e5-3b7e464bb619 tempest-VolumesActionsTest-48611561 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:37:42 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-18fd8df2-cf13-44eb-a1e5-3b7e464bb619 tempest-VolumesActionsTest-48611561 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:37:42 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-18fd8df2-cf13-44eb-a1e5-3b7e464bb619 tempest-VolumesActionsTest-48611561 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:37:42 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-18fd8df2-cf13-44eb-a1e5-3b7e464bb619 tempest-VolumesActionsTest-48611561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:37:42 devstack sudo[100152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a Aug 03 08:37:42 devstack sudo[100152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:37:43 devstack sudo[100151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-52b00d24-cd53-4011-84eb-c09d3fe05304 Aug 03 08:37:43 devstack sudo[100151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:37:43 devstack sudo[100152]: pam_unix(sudo:session): session closed for user root Aug 03 08:37:43 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-18fd8df2-cf13-44eb-a1e5-3b7e464bb619 tempest-VolumesActionsTest-48611561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a" returned: 0 in 0.389s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:37:43 devstack cinder-volume[88899]: DEBUG cinder.manager [None req-18fd8df2-cf13-44eb-a1e5-3b7e464bb619 tempest-VolumesActionsTest-48611561 None] Notifying Schedulers of capabilities ... {{(pid=88899) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 08:37:43 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-18fd8df2-cf13-44eb-a1e5-3b7e464bb619 tempest-VolumesActionsTest-48611561 None] Deleted volume successfully. Aug 03 08:37:43 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-18fd8df2-cf13-44eb-a1e5-3b7e464bb619 tempest-VolumesActionsTest-48611561 None] Lock "cinder-3d205f2c-c3ba-41cd-84b7-af9e3a6d5efa-delete_volume" released by "delete_volume" :: held 2.042s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:37:43 devstack sudo[100151]: pam_unix(sudo:session): session closed for user root Aug 03 08:37:43 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-7f589052-3fad-49d3-b11b-d2b928420409 tempest-VolumesDeleteCascade-2092426887 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-52b00d24-cd53-4011-84eb-c09d3fe05304" returned: 0 in 0.641s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:37:43 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-7f589052-3fad-49d3-b11b-d2b928420409 tempest-VolumesDeleteCascade-2092426887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-52b00d24-cd53-4011-84eb-c09d3fe05304,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-52b00d24-cd53-4011-84eb-c09d3fe05304.fb75737e-dcb8-458b-9187-cb8e565e3935 1G {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:37:43 devstack sudo[100162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-52b00d24-cd53-4011-84eb-c09d3fe05304,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-52b00d24-cd53-4011-84eb-c09d3fe05304.fb75737e-dcb8-458b-9187-cb8e565e3935 1G Aug 03 08:37:43 devstack sudo[100162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:37:44 devstack sudo[100162]: pam_unix(sudo:session): session closed for user root Aug 03 08:37:44 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-7f589052-3fad-49d3-b11b-d2b928420409 tempest-VolumesDeleteCascade-2092426887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-52b00d24-cd53-4011-84eb-c09d3fe05304,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-52b00d24-cd53-4011-84eb-c09d3fe05304.fb75737e-dcb8-458b-9187-cb8e565e3935 1G" returned: 0 in 0.877s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:37:44 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-7f589052-3fad-49d3-b11b-d2b928420409 tempest-VolumesDeleteCascade-2092426887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-52b00d24-cd53-4011-84eb-c09d3fe05304 -F qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-52b00d24-cd53-4011-84eb-c09d3fe05304.fb75737e-dcb8-458b-9187-cb8e565e3935 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:37:44 devstack sudo[100169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-52b00d24-cd53-4011-84eb-c09d3fe05304 -F qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-52b00d24-cd53-4011-84eb-c09d3fe05304.fb75737e-dcb8-458b-9187-cb8e565e3935 Aug 03 08:37:44 devstack sudo[100169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:37:45 devstack sudo[100169]: pam_unix(sudo:session): session closed for user root Aug 03 08:37:45 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-7f589052-3fad-49d3-b11b-d2b928420409 tempest-VolumesDeleteCascade-2092426887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-52b00d24-cd53-4011-84eb-c09d3fe05304 -F qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-52b00d24-cd53-4011-84eb-c09d3fe05304.fb75737e-dcb8-458b-9187-cb8e565e3935" returned: 0 in 0.650s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:37:45 devstack cinder-volume[88899]: WARNING cinder.volume.drivers.remotefs [None req-7f589052-3fad-49d3-b11b-d2b928420409 tempest-VolumesDeleteCascade-2092426887 None] /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-52b00d24-cd53-4011-84eb-c09d3fe05304.fb75737e-dcb8-458b-9187-cb8e565e3935 is being set with open permissions: ugo+rw Aug 03 08:37:45 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-7f589052-3fad-49d3-b11b-d2b928420409 tempest-VolumesDeleteCascade-2092426887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-52b00d24-cd53-4011-84eb-c09d3fe05304.fb75737e-dcb8-458b-9187-cb8e565e3935 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:37:45 devstack sudo[100174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-52b00d24-cd53-4011-84eb-c09d3fe05304.fb75737e-dcb8-458b-9187-cb8e565e3935 Aug 03 08:37:45 devstack sudo[100174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:37:45 devstack cinder-volume[88899]: DEBUG cinder.volume.flows.manager.create_volume [None req-c79a082e-301f-4323-8ff2-1ed5d2098730 tempest-VolumesActionsTest-415737388 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88899) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 08:37:45 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-c79a082e-301f-4323-8ff2-1ed5d2098730 tempest-VolumesActionsTest-415737388 None] Flow 'volume_create_manager' (68c25357-3210-485a-9889-64884e49b703) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:37:45 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-c79a082e-301f-4323-8ff2-1ed5d2098730 tempest-VolumesActionsTest-415737388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31bf9201-b443-431d-80ea-8f26152f5bb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:37:45 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-c79a082e-301f-4323-8ff2-1ed5d2098730 tempest-VolumesActionsTest-415737388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31bf9201-b443-431d-80ea-8f26152f5bb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:37:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1110863518',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c298928d-5287-47b8-bc8e-7ead3f0c755b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d2cd534485a4923b66db7805993790c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:37:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:37:45Z,use_quota=True,user_id='d9b57e0f46644b399e1a0aea198130dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8bde7129-1dc4-42ab-b852-ab32c61b4921),volume_type_id=8bde7129-1dc4-42ab-b852-ab32c61b4921)' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:37:45 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-c79a082e-301f-4323-8ff2-1ed5d2098730 tempest-VolumesActionsTest-415737388 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c4ade9c-6dd4-477c-858f-6292142e2082) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:37:45 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-c79a082e-301f-4323-8ff2-1ed5d2098730 tempest-VolumesActionsTest-415737388 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c4ade9c-6dd4-477c-858f-6292142e2082) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:37:45 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-c79a082e-301f-4323-8ff2-1ed5d2098730 tempest-VolumesActionsTest-415737388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a4b8a865-ab27-477a-aa4b-9464e50b9d8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:37:45 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-c79a082e-301f-4323-8ff2-1ed5d2098730 tempest-VolumesActionsTest-415737388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a4b8a865-ab27-477a-aa4b-9464e50b9d8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c298928d-5287-47b8-bc8e-7ead3f0c755b', 'volume_name': 'volume-c298928d-5287-47b8-bc8e-7ead3f0c755b', 'volume_size': 1}' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:37:45 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-c79a082e-301f-4323-8ff2-1ed5d2098730 tempest-VolumesActionsTest-415737388 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6747f4f3-6066-4aa1-aa58-dbcf442db134) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:37:45 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-c79a082e-301f-4323-8ff2-1ed5d2098730 tempest-VolumesActionsTest-415737388 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6747f4f3-6066-4aa1-aa58-dbcf442db134) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:37:45 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-c79a082e-301f-4323-8ff2-1ed5d2098730 tempest-VolumesActionsTest-415737388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3484c195-5944-43f7-9215-7a0e7c5e01c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:37:45 devstack cinder-volume[88899]: INFO cinder.volume.flows.manager.create_volume [None req-c79a082e-301f-4323-8ff2-1ed5d2098730 tempest-VolumesActionsTest-415737388 None] Volume c298928d-5287-47b8-bc8e-7ead3f0c755b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c298928d-5287-47b8-bc8e-7ead3f0c755b', 'volume_size': 1} Aug 03 08:37:45 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-c79a082e-301f-4323-8ff2-1ed5d2098730 tempest-VolumesActionsTest-415737388 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:37:45 devstack sudo[100174]: pam_unix(sudo:session): session closed for user root Aug 03 08:37:45 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-7f589052-3fad-49d3-b11b-d2b928420409 tempest-VolumesDeleteCascade-2092426887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-52b00d24-cd53-4011-84eb-c09d3fe05304.fb75737e-dcb8-458b-9187-cb8e565e3935" returned: 0 in 0.430s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:37:45 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-7f589052-3fad-49d3-b11b-d2b928420409 tempest-VolumesDeleteCascade-2092426887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-52b00d24-cd53-4011-84eb-c09d3fe05304.info {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:37:45 devstack sudo[100177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-52b00d24-cd53-4011-84eb-c09d3fe05304.info Aug 03 08:37:45 devstack sudo[100177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:37:45 devstack sudo[100177]: pam_unix(sudo:session): session closed for user root Aug 03 08:37:45 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-7f589052-3fad-49d3-b11b-d2b928420409 tempest-VolumesDeleteCascade-2092426887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-52b00d24-cd53-4011-84eb-c09d3fe05304.info" returned: 0 in 0.364s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:37:45 devstack cinder-volume[88899]: WARNING cinder.volume.drivers.remotefs [None req-7f589052-3fad-49d3-b11b-d2b928420409 tempest-VolumesDeleteCascade-2092426887 None] /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-52b00d24-cd53-4011-84eb-c09d3fe05304.info is being set with open permissions: ugo+rw Aug 03 08:37:45 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-7f589052-3fad-49d3-b11b-d2b928420409 tempest-VolumesDeleteCascade-2092426887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-52b00d24-cd53-4011-84eb-c09d3fe05304.info {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:37:45 devstack sudo[100180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-52b00d24-cd53-4011-84eb-c09d3fe05304.info Aug 03 08:37:45 devstack sudo[100180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:37:46 devstack sudo[100180]: pam_unix(sudo:session): session closed for user root Aug 03 08:37:46 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-7f589052-3fad-49d3-b11b-d2b928420409 tempest-VolumesDeleteCascade-2092426887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-52b00d24-cd53-4011-84eb-c09d3fe05304.info" returned: 0 in 0.450s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:37:46 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-7f589052-3fad-49d3-b11b-d2b928420409 tempest-VolumesDeleteCascade-2092426887 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.583s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:37:46 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-c79a082e-301f-4323-8ff2-1ed5d2098730 tempest-VolumesActionsTest-415737388 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.137s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:37:46 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-c79a082e-301f-4323-8ff2-1ed5d2098730 tempest-VolumesActionsTest-415737388 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:37:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1110863518',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c298928d-5287-47b8-bc8e-7ead3f0c755b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d2cd534485a4923b66db7805993790c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:37:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:37:45Z,use_quota=True,user_id='d9b57e0f46644b399e1a0aea198130dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8bde7129-1dc4-42ab-b852-ab32c61b4921),volume_type_id=8bde7129-1dc4-42ab-b852-ab32c61b4921)}" {{(pid=88899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 08:37:46 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-c79a082e-301f-4323-8ff2-1ed5d2098730 tempest-VolumesActionsTest-415737388 None] Creating volume c298928d-5287-47b8-bc8e-7ead3f0c755b {{(pid=88899) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 08:37:46 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-c79a082e-301f-4323-8ff2-1ed5d2098730 tempest-VolumesActionsTest-415737388 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:37:46 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-c79a082e-301f-4323-8ff2-1ed5d2098730 tempest-VolumesActionsTest-415737388 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:37:46 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-c79a082e-301f-4323-8ff2-1ed5d2098730 tempest-VolumesActionsTest-415737388 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:37:46 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-c79a082e-301f-4323-8ff2-1ed5d2098730 tempest-VolumesActionsTest-415737388 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:37:46 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-c79a082e-301f-4323-8ff2-1ed5d2098730 tempest-VolumesActionsTest-415737388 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:37:46 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-c79a082e-301f-4323-8ff2-1ed5d2098730 tempest-VolumesActionsTest-415737388 None] Selected osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385 as target Quobyte volume. {{(pid=88899) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 08:37:46 devstack cinder-volume[88899]: INFO cinder.volume.drivers.remotefs [None req-c79a082e-301f-4323-8ff2-1ed5d2098730 tempest-VolumesActionsTest-415737388 None] casted to osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385 Aug 03 08:37:46 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-c79a082e-301f-4323-8ff2-1ed5d2098730 tempest-VolumesActionsTest-415737388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c298928d-5287-47b8-bc8e-7ead3f0c755b 1073741824 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:37:46 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-7f589052-3fad-49d3-b11b-d2b928420409 tempest-VolumesDeleteCascade-2092426887 None] Create snapshot completed successfully Aug 03 08:37:46 devstack sudo[100183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c298928d-5287-47b8-bc8e-7ead3f0c755b 1073741824 Aug 03 08:37:46 devstack sudo[100183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:37:47 devstack sudo[100183]: pam_unix(sudo:session): session closed for user root Aug 03 08:37:47 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-c79a082e-301f-4323-8ff2-1ed5d2098730 tempest-VolumesActionsTest-415737388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c298928d-5287-47b8-bc8e-7ead3f0c755b 1073741824" returned: 0 in 0.823s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:37:47 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-c79a082e-301f-4323-8ff2-1ed5d2098730 tempest-VolumesActionsTest-415737388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c298928d-5287-47b8-bc8e-7ead3f0c755b {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:37:47 devstack sudo[100200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c298928d-5287-47b8-bc8e-7ead3f0c755b Aug 03 08:37:47 devstack sudo[100200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:37:47 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-e6e9c7d4-43e9-4042-9a20-2c63d939e1fd tempest-VolumesDeleteCascade-2092426887 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:37:48 devstack sudo[100200]: pam_unix(sudo:session): session closed for user root Aug 03 08:37:48 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-c79a082e-301f-4323-8ff2-1ed5d2098730 tempest-VolumesActionsTest-415737388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c298928d-5287-47b8-bc8e-7ead3f0c755b" returned: 0 in 0.745s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:37:48 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-c79a082e-301f-4323-8ff2-1ed5d2098730 tempest-VolumesActionsTest-415737388 None] <== create_volume: return (1657ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'} {{(pid=88899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 08:37:48 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-c79a082e-301f-4323-8ff2-1ed5d2098730 tempest-VolumesActionsTest-415737388 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.668s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:37:48 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-e6e9c7d4-43e9-4042-9a20-2c63d939e1fd tempest-VolumesDeleteCascade-2092426887 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.258s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:37:48 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-e6e9c7d4-43e9-4042-9a20-2c63d939e1fd tempest-VolumesDeleteCascade-2092426887 None] Creating offline snapshot 7ff6cf32-fd69-4b3f-b39c-58e3e1ea8b8f of volume 52b00d24-cd53-4011-84eb-c09d3fe05304 {{(pid=88899) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 03 08:37:48 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-c79a082e-301f-4323-8ff2-1ed5d2098730 tempest-VolumesActionsTest-415737388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3484c195-5944-43f7-9215-7a0e7c5e01c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c298928d-5287-47b8-bc8e-7ead3f0c755b', 'volume_size': 1}' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:37:48 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-c79a082e-301f-4323-8ff2-1ed5d2098730 tempest-VolumesActionsTest-415737388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (34626d83-92a4-45fe-bf88-1d3b0169b71f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:37:48 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[4373fe07-eea7-4101-973d-1ccf49f51eb0]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:37:48 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-e6e9c7d4-43e9-4042-9a20-2c63d939e1fd tempest-VolumesDeleteCascade-2092426887 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-52b00d24-cd53-4011-84eb-c09d3fe05304.fb75737e-dcb8-458b-9187-cb8e565e3935 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:37:48 devstack cinder-volume[88899]: INFO cinder.volume.flows.manager.create_volume [None req-c79a082e-301f-4323-8ff2-1ed5d2098730 tempest-VolumesActionsTest-415737388 None] Volume volume-c298928d-5287-47b8-bc8e-7ead3f0c755b (c298928d-5287-47b8-bc8e-7ead3f0c755b): created successfully Aug 03 08:37:48 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-c79a082e-301f-4323-8ff2-1ed5d2098730 tempest-VolumesActionsTest-415737388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (34626d83-92a4-45fe-bf88-1d3b0169b71f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:37:48 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-c79a082e-301f-4323-8ff2-1ed5d2098730 tempest-VolumesActionsTest-415737388 None] Flow 'volume_create_manager' (68c25357-3210-485a-9889-64884e49b703) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:37:48 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-c79a082e-301f-4323-8ff2-1ed5d2098730 tempest-VolumesActionsTest-415737388 None] Created volume successfully. Aug 03 08:37:48 devstack sudo[100217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-52b00d24-cd53-4011-84eb-c09d3fe05304.fb75737e-dcb8-458b-9187-cb8e565e3935 Aug 03 08:37:48 devstack sudo[100217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:37:49 devstack sudo[100217]: pam_unix(sudo:session): session closed for user root Aug 03 08:37:49 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-e6e9c7d4-43e9-4042-9a20-2c63d939e1fd tempest-VolumesDeleteCascade-2092426887 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-52b00d24-cd53-4011-84eb-c09d3fe05304.fb75737e-dcb8-458b-9187-cb8e565e3935" returned: 0 in 1.065s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:37:49 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-e6e9c7d4-43e9-4042-9a20-2c63d939e1fd tempest-VolumesDeleteCascade-2092426887 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-52b00d24-cd53-4011-84eb-c09d3fe05304(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88899) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 03 08:37:49 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-e6e9c7d4-43e9-4042-9a20-2c63d939e1fd tempest-VolumesDeleteCascade-2092426887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-52b00d24-cd53-4011-84eb-c09d3fe05304.fb75737e-dcb8-458b-9187-cb8e565e3935,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-52b00d24-cd53-4011-84eb-c09d3fe05304.7ff6cf32-fd69-4b3f-b39c-58e3e1ea8b8f 1G {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:37:49 devstack sudo[100225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-52b00d24-cd53-4011-84eb-c09d3fe05304.fb75737e-dcb8-458b-9187-cb8e565e3935,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-52b00d24-cd53-4011-84eb-c09d3fe05304.7ff6cf32-fd69-4b3f-b39c-58e3e1ea8b8f 1G Aug 03 08:37:49 devstack sudo[100225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:37:49 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-48d6f9f5-fbc3-4d01-90c7-9226c7e0afa1 tempest-VolumesActionsTest-48611561 None] Acquiring lock "cinder-c298928d-5287-47b8-bc8e-7ead3f0c755b-delete_volume" by "delete_volume" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:37:50 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-48d6f9f5-fbc3-4d01-90c7-9226c7e0afa1 tempest-VolumesActionsTest-48611561 None] Lock "cinder-c298928d-5287-47b8-bc8e-7ead3f0c755b-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:37:50 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-48d6f9f5-fbc3-4d01-90c7-9226c7e0afa1 tempest-VolumesActionsTest-48611561 None] Acquiring lock "cinder-quobyte-c298928d-5287-47b8-bc8e-7ead3f0c755b" by "delete_volume" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:37:50 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-48d6f9f5-fbc3-4d01-90c7-9226c7e0afa1 tempest-VolumesActionsTest-48611561 None] Lock "cinder-quobyte-c298928d-5287-47b8-bc8e-7ead3f0c755b" acquired by "delete_volume" :: waited 0.032s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:37:50 devstack sudo[100225]: pam_unix(sudo:session): session closed for user root Aug 03 08:37:50 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-e6e9c7d4-43e9-4042-9a20-2c63d939e1fd tempest-VolumesDeleteCascade-2092426887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-52b00d24-cd53-4011-84eb-c09d3fe05304.fb75737e-dcb8-458b-9187-cb8e565e3935,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-52b00d24-cd53-4011-84eb-c09d3fe05304.7ff6cf32-fd69-4b3f-b39c-58e3e1ea8b8f 1G" returned: 0 in 0.893s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:37:50 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-e6e9c7d4-43e9-4042-9a20-2c63d939e1fd tempest-VolumesDeleteCascade-2092426887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-52b00d24-cd53-4011-84eb-c09d3fe05304.fb75737e-dcb8-458b-9187-cb8e565e3935 -F qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-52b00d24-cd53-4011-84eb-c09d3fe05304.7ff6cf32-fd69-4b3f-b39c-58e3e1ea8b8f {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:37:50 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[d67b0b56-8abb-4246-bf0e-1b71e862d580]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:37:50 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-48d6f9f5-fbc3-4d01-90c7-9226c7e0afa1 tempest-VolumesActionsTest-48611561 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c298928d-5287-47b8-bc8e-7ead3f0c755b {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:37:50 devstack sudo[100230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-52b00d24-cd53-4011-84eb-c09d3fe05304.fb75737e-dcb8-458b-9187-cb8e565e3935 -F qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-52b00d24-cd53-4011-84eb-c09d3fe05304.7ff6cf32-fd69-4b3f-b39c-58e3e1ea8b8f Aug 03 08:37:50 devstack sudo[100230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:37:50 devstack sudo[100231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c298928d-5287-47b8-bc8e-7ead3f0c755b Aug 03 08:37:50 devstack sudo[100231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:37:50 devstack sudo[100230]: pam_unix(sudo:session): session closed for user root Aug 03 08:37:50 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-e6e9c7d4-43e9-4042-9a20-2c63d939e1fd tempest-VolumesDeleteCascade-2092426887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-52b00d24-cd53-4011-84eb-c09d3fe05304.fb75737e-dcb8-458b-9187-cb8e565e3935 -F qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-52b00d24-cd53-4011-84eb-c09d3fe05304.7ff6cf32-fd69-4b3f-b39c-58e3e1ea8b8f" returned: 0 in 0.700s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:37:50 devstack cinder-volume[88899]: WARNING cinder.volume.drivers.remotefs [None req-e6e9c7d4-43e9-4042-9a20-2c63d939e1fd tempest-VolumesDeleteCascade-2092426887 None] /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-52b00d24-cd53-4011-84eb-c09d3fe05304.7ff6cf32-fd69-4b3f-b39c-58e3e1ea8b8f is being set with open permissions: ugo+rw Aug 03 08:37:50 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-e6e9c7d4-43e9-4042-9a20-2c63d939e1fd tempest-VolumesDeleteCascade-2092426887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-52b00d24-cd53-4011-84eb-c09d3fe05304.7ff6cf32-fd69-4b3f-b39c-58e3e1ea8b8f {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:37:50 devstack sudo[100240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-52b00d24-cd53-4011-84eb-c09d3fe05304.7ff6cf32-fd69-4b3f-b39c-58e3e1ea8b8f Aug 03 08:37:50 devstack sudo[100240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:37:51 devstack sudo[100231]: pam_unix(sudo:session): session closed for user root Aug 03 08:37:51 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-48d6f9f5-fbc3-4d01-90c7-9226c7e0afa1 tempest-VolumesActionsTest-48611561 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c298928d-5287-47b8-bc8e-7ead3f0c755b" returned: 0 in 0.829s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:37:51 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-48d6f9f5-fbc3-4d01-90c7-9226c7e0afa1 tempest-VolumesActionsTest-48611561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c298928d-5287-47b8-bc8e-7ead3f0c755b {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:37:51 devstack sudo[100243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c298928d-5287-47b8-bc8e-7ead3f0c755b Aug 03 08:37:51 devstack sudo[100243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:37:51 devstack sudo[100240]: pam_unix(sudo:session): session closed for user root Aug 03 08:37:51 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-e6e9c7d4-43e9-4042-9a20-2c63d939e1fd tempest-VolumesDeleteCascade-2092426887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-52b00d24-cd53-4011-84eb-c09d3fe05304.7ff6cf32-fd69-4b3f-b39c-58e3e1ea8b8f" returned: 0 in 0.509s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:37:51 devstack sudo[100243]: pam_unix(sudo:session): session closed for user root Aug 03 08:37:51 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-48d6f9f5-fbc3-4d01-90c7-9226c7e0afa1 tempest-VolumesActionsTest-48611561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c298928d-5287-47b8-bc8e-7ead3f0c755b" returned: 0 in 0.384s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:37:51 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-e6e9c7d4-43e9-4042-9a20-2c63d939e1fd tempest-VolumesDeleteCascade-2092426887 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.380s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:37:51 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-48d6f9f5-fbc3-4d01-90c7-9226c7e0afa1 tempest-VolumesActionsTest-48611561 None] Lock "cinder-quobyte-c298928d-5287-47b8-bc8e-7ead3f0c755b" released by "delete_volume" :: held 1.356s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:37:51 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-e6e9c7d4-43e9-4042-9a20-2c63d939e1fd tempest-VolumesDeleteCascade-2092426887 None] Create snapshot completed successfully Aug 03 08:37:51 devstack cinder-volume[88899]: DEBUG cinder.quota [None req-48d6f9f5-fbc3-4d01-90c7-9226c7e0afa1 tempest-VolumesActionsTest-48611561 None] Created reservations ['24ea4976-6a3e-45cb-8c5f-c7ce9f220983', 'd31e104b-d5ea-4cc4-9262-a345d1eef214', '3adeeb76-75b0-4ead-ab49-4912f3e98061', 'd772fd09-5fec-47ac-aa5a-7383d132e5fe'] {{(pid=88899) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 08:37:51 devstack cinder-volume[88899]: DEBUG oslo_service.periodic_task [None req-f948fb4a-c4d7-499f-b1bd-8d6be3de0b53 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88899) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 03 08:37:51 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-f948fb4a-c4d7-499f-b1bd-8d6be3de0b53 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:37:51 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-f948fb4a-c4d7-499f-b1bd-8d6be3de0b53 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:37:51 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-f948fb4a-c4d7-499f-b1bd-8d6be3de0b53 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:37:51 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-f948fb4a-c4d7-499f-b1bd-8d6be3de0b53 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:37:51 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-f948fb4a-c4d7-499f-b1bd-8d6be3de0b53 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:37:51 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-f948fb4a-c4d7-499f-b1bd-8d6be3de0b53 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:37:51 devstack sudo[100258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a Aug 03 08:37:51 devstack sudo[100258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:37:51 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-48d6f9f5-fbc3-4d01-90c7-9226c7e0afa1 tempest-VolumesActionsTest-48611561 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:37:51 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-48d6f9f5-fbc3-4d01-90c7-9226c7e0afa1 tempest-VolumesActionsTest-48611561 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:37:51 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-48d6f9f5-fbc3-4d01-90c7-9226c7e0afa1 tempest-VolumesActionsTest-48611561 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:37:51 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-48d6f9f5-fbc3-4d01-90c7-9226c7e0afa1 tempest-VolumesActionsTest-48611561 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:37:51 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-48d6f9f5-fbc3-4d01-90c7-9226c7e0afa1 tempest-VolumesActionsTest-48611561 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:37:51 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-48d6f9f5-fbc3-4d01-90c7-9226c7e0afa1 tempest-VolumesActionsTest-48611561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:37:52 devstack sudo[100262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a Aug 03 08:37:52 devstack sudo[100262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:37:52 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-f6d56919-652d-4dfc-9019-7d0c9794056b tempest-VolumesDeleteCascade-2092426887 None] Acquiring lock "cinder-52b00d24-cd53-4011-84eb-c09d3fe05304-delete_volume" by "delete_volume" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:37:52 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-f6d56919-652d-4dfc-9019-7d0c9794056b tempest-VolumesDeleteCascade-2092426887 None] Lock "cinder-52b00d24-cd53-4011-84eb-c09d3fe05304-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:37:52 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-f6d56919-652d-4dfc-9019-7d0c9794056b tempest-VolumesDeleteCascade-2092426887 None] Performing cascade delete. {{(pid=88899) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Aug 03 08:37:52 devstack sudo[100258]: pam_unix(sudo:session): session closed for user root Aug 03 08:37:52 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-f6d56919-652d-4dfc-9019-7d0c9794056b tempest-VolumesDeleteCascade-2092426887 None] Acquiring lock "cinder-7ff6cf32-fd69-4b3f-b39c-58e3e1ea8b8f-delete_snapshot" by "delete_snapshot" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:37:52 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-f948fb4a-c4d7-499f-b1bd-8d6be3de0b53 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a" returned: 0 in 0.941s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:37:52 devstack cinder-volume[88899]: DEBUG cinder.manager [None req-f948fb4a-c4d7-499f-b1bd-8d6be3de0b53 None None] Notifying Schedulers of capabilities ... {{(pid=88899) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 08:37:52 devstack cinder-volume[88899]: DEBUG oslo_service.periodic_task [None req-f948fb4a-c4d7-499f-b1bd-8d6be3de0b53 None None] Running periodic task VolumeManager._thread_info {{(pid=88899) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 03 08:37:52 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-f948fb4a-c4d7-499f-b1bd-8d6be3de0b53 None None] thread count: 28 {{(pid=88899) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 03 08:37:52 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-f948fb4a-c4d7-499f-b1bd-8d6be3de0b53 None None] thread info: [<_MainThread(MainThread, started 132234320248960)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88899) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 03 08:37:52 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-f6d56919-652d-4dfc-9019-7d0c9794056b tempest-VolumesDeleteCascade-2092426887 None] Lock "cinder-7ff6cf32-fd69-4b3f-b39c-58e3e1ea8b8f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.050s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:37:52 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-f6d56919-652d-4dfc-9019-7d0c9794056b tempest-VolumesDeleteCascade-2092426887 None] Acquiring lock "cinder-quobyte-52b00d24-cd53-4011-84eb-c09d3fe05304" by "delete_snapshot" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:37:52 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-f6d56919-652d-4dfc-9019-7d0c9794056b tempest-VolumesDeleteCascade-2092426887 None] Lock "cinder-quobyte-52b00d24-cd53-4011-84eb-c09d3fe05304" acquired by "delete_snapshot" :: waited 0.052s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:37:52 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-f6d56919-652d-4dfc-9019-7d0c9794056b tempest-VolumesDeleteCascade-2092426887 None] Acquiring lock "cinder-quobyte-7ff6cf32-fd69-4b3f-b39c-58e3e1ea8b8f" by "_delete_snapshot" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:37:52 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-f6d56919-652d-4dfc-9019-7d0c9794056b tempest-VolumesDeleteCascade-2092426887 None] Lock "cinder-quobyte-7ff6cf32-fd69-4b3f-b39c-58e3e1ea8b8f" acquired by "_delete_snapshot" :: waited 0.049s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:37:52 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-f6d56919-652d-4dfc-9019-7d0c9794056b tempest-VolumesDeleteCascade-2092426887 None] Deleting offline snapshot 7ff6cf32-fd69-4b3f-b39c-58e3e1ea8b8f of volume 52b00d24-cd53-4011-84eb-c09d3fe05304 {{(pid=88899) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 03 08:37:53 devstack sudo[100262]: pam_unix(sudo:session): session closed for user root Aug 03 08:37:53 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-f6d56919-652d-4dfc-9019-7d0c9794056b tempest-VolumesDeleteCascade-2092426887 None] snapshot_file for this snap is: volume-52b00d24-cd53-4011-84eb-c09d3fe05304.7ff6cf32-fd69-4b3f-b39c-58e3e1ea8b8f {{(pid=88899) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 03 08:37:53 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-48d6f9f5-fbc3-4d01-90c7-9226c7e0afa1 tempest-VolumesActionsTest-48611561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a" returned: 0 in 1.134s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:37:53 devstack cinder-volume[88899]: DEBUG cinder.manager [None req-48d6f9f5-fbc3-4d01-90c7-9226c7e0afa1 tempest-VolumesActionsTest-48611561 None] Notifying Schedulers of capabilities ... {{(pid=88899) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 08:37:53 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-48d6f9f5-fbc3-4d01-90c7-9226c7e0afa1 tempest-VolumesActionsTest-48611561 None] Deleted volume successfully. Aug 03 08:37:53 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc983729-369c-411c-a457-5e086b444527]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:37:53 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-f6d56919-652d-4dfc-9019-7d0c9794056b tempest-VolumesDeleteCascade-2092426887 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-52b00d24-cd53-4011-84eb-c09d3fe05304.7ff6cf32-fd69-4b3f-b39c-58e3e1ea8b8f {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:37:53 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-48d6f9f5-fbc3-4d01-90c7-9226c7e0afa1 tempest-VolumesActionsTest-48611561 None] Lock "cinder-c298928d-5287-47b8-bc8e-7ead3f0c755b-delete_volume" released by "delete_volume" :: held 3.188s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:37:53 devstack sudo[100315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-52b00d24-cd53-4011-84eb-c09d3fe05304.7ff6cf32-fd69-4b3f-b39c-58e3e1ea8b8f Aug 03 08:37:53 devstack sudo[100315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:37:54 devstack cinder-volume[88899]: DEBUG cinder.volume.flows.manager.create_volume [None req-29b2c95b-b5e5-465c-9635-b93a58292487 tempest-VolumesActionsTest-415737388 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88899) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 08:37:54 devstack sudo[100315]: pam_unix(sudo:session): session closed for user root Aug 03 08:37:54 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-29b2c95b-b5e5-465c-9635-b93a58292487 tempest-VolumesActionsTest-415737388 None] Flow 'volume_create_manager' (4aac7138-a2c5-411b-92be-743783a328b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:37:54 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-29b2c95b-b5e5-465c-9635-b93a58292487 tempest-VolumesActionsTest-415737388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (97be3525-d6ad-4503-a2bc-8c66147cf8a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:37:54 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-f6d56919-652d-4dfc-9019-7d0c9794056b tempest-VolumesDeleteCascade-2092426887 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-52b00d24-cd53-4011-84eb-c09d3fe05304.7ff6cf32-fd69-4b3f-b39c-58e3e1ea8b8f" returned: 0 in 0.956s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:37:54 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-f6d56919-652d-4dfc-9019-7d0c9794056b tempest-VolumesDeleteCascade-2092426887 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-52b00d24-cd53-4011-84eb-c09d3fe05304(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88899) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 03 08:37:54 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7e06b6c-0ec1-4653-91e9-b37350355837]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:37:54 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-f6d56919-652d-4dfc-9019-7d0c9794056b tempest-VolumesDeleteCascade-2092426887 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-52b00d24-cd53-4011-84eb-c09d3fe05304.fb75737e-dcb8-458b-9187-cb8e565e3935 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:37:54 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-29b2c95b-b5e5-465c-9635-b93a58292487 tempest-VolumesActionsTest-415737388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (97be3525-d6ad-4503-a2bc-8c66147cf8a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:37:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1332494369',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=95f31d2d-1d43-43db-aa60-f24865e0f1f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d2cd534485a4923b66db7805993790c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:37:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:37:54Z,use_quota=True,user_id='d9b57e0f46644b399e1a0aea198130dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8bde7129-1dc4-42ab-b852-ab32c61b4921),volume_type_id=8bde7129-1dc4-42ab-b852-ab32c61b4921)' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:37:54 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-29b2c95b-b5e5-465c-9635-b93a58292487 tempest-VolumesActionsTest-415737388 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5014b10e-f985-4249-a3f7-7c2596d7b127) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:37:54 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-29b2c95b-b5e5-465c-9635-b93a58292487 tempest-VolumesActionsTest-415737388 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5014b10e-f985-4249-a3f7-7c2596d7b127) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:37:54 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-29b2c95b-b5e5-465c-9635-b93a58292487 tempest-VolumesActionsTest-415737388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (64d29b2a-fec4-41e9-a9dc-dfc3c860560d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:37:54 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-29b2c95b-b5e5-465c-9635-b93a58292487 tempest-VolumesActionsTest-415737388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (64d29b2a-fec4-41e9-a9dc-dfc3c860560d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '95f31d2d-1d43-43db-aa60-f24865e0f1f0', 'volume_name': 'volume-95f31d2d-1d43-43db-aa60-f24865e0f1f0', 'volume_size': 1}' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:37:54 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-29b2c95b-b5e5-465c-9635-b93a58292487 tempest-VolumesActionsTest-415737388 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5214355f-6587-4328-ad3d-61815d316b9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:37:54 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-29b2c95b-b5e5-465c-9635-b93a58292487 tempest-VolumesActionsTest-415737388 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5214355f-6587-4328-ad3d-61815d316b9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:37:54 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-29b2c95b-b5e5-465c-9635-b93a58292487 tempest-VolumesActionsTest-415737388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01a56d16-e7fd-4c96-85a8-f954db64c0be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:37:54 devstack cinder-volume[88899]: INFO cinder.volume.flows.manager.create_volume [None req-29b2c95b-b5e5-465c-9635-b93a58292487 tempest-VolumesActionsTest-415737388 None] Volume 95f31d2d-1d43-43db-aa60-f24865e0f1f0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-95f31d2d-1d43-43db-aa60-f24865e0f1f0', 'volume_size': 1} Aug 03 08:37:54 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-29b2c95b-b5e5-465c-9635-b93a58292487 tempest-VolumesActionsTest-415737388 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:37:54 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-29b2c95b-b5e5-465c-9635-b93a58292487 tempest-VolumesActionsTest-415737388 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:37:54 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-29b2c95b-b5e5-465c-9635-b93a58292487 tempest-VolumesActionsTest-415737388 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:37:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1332494369',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=95f31d2d-1d43-43db-aa60-f24865e0f1f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d2cd534485a4923b66db7805993790c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:37:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:37:54Z,use_quota=True,user_id='d9b57e0f46644b399e1a0aea198130dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8bde7129-1dc4-42ab-b852-ab32c61b4921),volume_type_id=8bde7129-1dc4-42ab-b852-ab32c61b4921)}" {{(pid=88899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 08:37:54 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-29b2c95b-b5e5-465c-9635-b93a58292487 tempest-VolumesActionsTest-415737388 None] Creating volume 95f31d2d-1d43-43db-aa60-f24865e0f1f0 {{(pid=88899) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 08:37:54 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-29b2c95b-b5e5-465c-9635-b93a58292487 tempest-VolumesActionsTest-415737388 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:37:54 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-29b2c95b-b5e5-465c-9635-b93a58292487 tempest-VolumesActionsTest-415737388 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:37:54 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-29b2c95b-b5e5-465c-9635-b93a58292487 tempest-VolumesActionsTest-415737388 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:37:54 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-29b2c95b-b5e5-465c-9635-b93a58292487 tempest-VolumesActionsTest-415737388 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:37:54 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-29b2c95b-b5e5-465c-9635-b93a58292487 tempest-VolumesActionsTest-415737388 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:37:54 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-29b2c95b-b5e5-465c-9635-b93a58292487 tempest-VolumesActionsTest-415737388 None] Selected osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385 as target Quobyte volume. {{(pid=88899) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 08:37:54 devstack cinder-volume[88899]: INFO cinder.volume.drivers.remotefs [None req-29b2c95b-b5e5-465c-9635-b93a58292487 tempest-VolumesActionsTest-415737388 None] casted to osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385 Aug 03 08:37:54 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-29b2c95b-b5e5-465c-9635-b93a58292487 tempest-VolumesActionsTest-415737388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-95f31d2d-1d43-43db-aa60-f24865e0f1f0 1073741824 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:37:54 devstack sudo[100338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-95f31d2d-1d43-43db-aa60-f24865e0f1f0 1073741824 Aug 03 08:37:54 devstack sudo[100338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:37:54 devstack sudo[100335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-52b00d24-cd53-4011-84eb-c09d3fe05304.fb75737e-dcb8-458b-9187-cb8e565e3935 Aug 03 08:37:54 devstack sudo[100335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:37:54 devstack sudo[100335]: pam_unix(sudo:session): session closed for user root Aug 03 08:37:54 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-f6d56919-652d-4dfc-9019-7d0c9794056b tempest-VolumesDeleteCascade-2092426887 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-52b00d24-cd53-4011-84eb-c09d3fe05304.fb75737e-dcb8-458b-9187-cb8e565e3935" returned: 0 in 0.445s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:37:54 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-f6d56919-652d-4dfc-9019-7d0c9794056b tempest-VolumesDeleteCascade-2092426887 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-52b00d24-cd53-4011-84eb-c09d3fe05304(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88899) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 03 08:37:54 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-f6d56919-652d-4dfc-9019-7d0c9794056b tempest-VolumesDeleteCascade-2092426887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-52b00d24-cd53-4011-84eb-c09d3fe05304.7ff6cf32-fd69-4b3f-b39c-58e3e1ea8b8f {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:37:54 devstack sudo[100362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-52b00d24-cd53-4011-84eb-c09d3fe05304.7ff6cf32-fd69-4b3f-b39c-58e3e1ea8b8f Aug 03 08:37:54 devstack sudo[100362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:37:54 devstack sudo[100338]: pam_unix(sudo:session): session closed for user root Aug 03 08:37:54 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-29b2c95b-b5e5-465c-9635-b93a58292487 tempest-VolumesActionsTest-415737388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-95f31d2d-1d43-43db-aa60-f24865e0f1f0 1073741824" returned: 0 in 0.551s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:37:54 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-29b2c95b-b5e5-465c-9635-b93a58292487 tempest-VolumesActionsTest-415737388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-95f31d2d-1d43-43db-aa60-f24865e0f1f0 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:37:54 devstack sudo[100364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-95f31d2d-1d43-43db-aa60-f24865e0f1f0 Aug 03 08:37:54 devstack sudo[100364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:37:55 devstack sudo[100364]: pam_unix(sudo:session): session closed for user root Aug 03 08:37:55 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-29b2c95b-b5e5-465c-9635-b93a58292487 tempest-VolumesActionsTest-415737388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-95f31d2d-1d43-43db-aa60-f24865e0f1f0" returned: 0 in 0.348s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:37:55 devstack sudo[100362]: pam_unix(sudo:session): session closed for user root Aug 03 08:37:55 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-29b2c95b-b5e5-465c-9635-b93a58292487 tempest-VolumesActionsTest-415737388 None] <== create_volume: return (965ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'} {{(pid=88899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 08:37:55 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-29b2c95b-b5e5-465c-9635-b93a58292487 tempest-VolumesActionsTest-415737388 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.968s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:37:55 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-f6d56919-652d-4dfc-9019-7d0c9794056b tempest-VolumesDeleteCascade-2092426887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-52b00d24-cd53-4011-84eb-c09d3fe05304.7ff6cf32-fd69-4b3f-b39c-58e3e1ea8b8f" returned: 0 in 0.609s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:37:55 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-f6d56919-652d-4dfc-9019-7d0c9794056b tempest-VolumesDeleteCascade-2092426887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-52b00d24-cd53-4011-84eb-c09d3fe05304.7ff6cf32-fd69-4b3f-b39c-58e3e1ea8b8f {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:37:55 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-29b2c95b-b5e5-465c-9635-b93a58292487 tempest-VolumesActionsTest-415737388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01a56d16-e7fd-4c96-85a8-f954db64c0be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-95f31d2d-1d43-43db-aa60-f24865e0f1f0', 'volume_size': 1}' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:37:55 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-29b2c95b-b5e5-465c-9635-b93a58292487 tempest-VolumesActionsTest-415737388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (65712b23-cc65-4dcb-955d-b3ae834f9ed7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:37:55 devstack sudo[100370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-52b00d24-cd53-4011-84eb-c09d3fe05304.7ff6cf32-fd69-4b3f-b39c-58e3e1ea8b8f Aug 03 08:37:55 devstack sudo[100370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:37:55 devstack cinder-volume[88899]: INFO cinder.volume.flows.manager.create_volume [None req-29b2c95b-b5e5-465c-9635-b93a58292487 tempest-VolumesActionsTest-415737388 None] Volume volume-95f31d2d-1d43-43db-aa60-f24865e0f1f0 (95f31d2d-1d43-43db-aa60-f24865e0f1f0): created successfully Aug 03 08:37:55 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-29b2c95b-b5e5-465c-9635-b93a58292487 tempest-VolumesActionsTest-415737388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (65712b23-cc65-4dcb-955d-b3ae834f9ed7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:37:55 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-29b2c95b-b5e5-465c-9635-b93a58292487 tempest-VolumesActionsTest-415737388 None] Flow 'volume_create_manager' (4aac7138-a2c5-411b-92be-743783a328b3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:37:55 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-29b2c95b-b5e5-465c-9635-b93a58292487 tempest-VolumesActionsTest-415737388 None] Created volume successfully. Aug 03 08:37:55 devstack sudo[100370]: pam_unix(sudo:session): session closed for user root Aug 03 08:37:55 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-f6d56919-652d-4dfc-9019-7d0c9794056b tempest-VolumesDeleteCascade-2092426887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-52b00d24-cd53-4011-84eb-c09d3fe05304.7ff6cf32-fd69-4b3f-b39c-58e3e1ea8b8f" returned: 0 in 0.445s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:37:55 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-f6d56919-652d-4dfc-9019-7d0c9794056b tempest-VolumesDeleteCascade-2092426887 None] Lock "cinder-quobyte-7ff6cf32-fd69-4b3f-b39c-58e3e1ea8b8f" released by "_delete_snapshot" :: held 2.692s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:37:55 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-f6d56919-652d-4dfc-9019-7d0c9794056b tempest-VolumesDeleteCascade-2092426887 None] Lock "cinder-quobyte-52b00d24-cd53-4011-84eb-c09d3fe05304" released by "delete_snapshot" :: held 2.768s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:37:55 devstack cinder-volume[88899]: DEBUG cinder.quota [None req-f6d56919-652d-4dfc-9019-7d0c9794056b tempest-VolumesDeleteCascade-2092426887 None] Created reservations ['c0624c0c-4382-43ec-b206-467f1184d7b4', 'ccd3915e-fa81-45cd-8376-20e790536d46', 'b1071604-09e3-4bc0-9567-c039ae18ce50', '51c6bc2b-78c7-45bb-b935-b6173909c325'] {{(pid=88899) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 08:37:55 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-f6d56919-652d-4dfc-9019-7d0c9794056b tempest-VolumesDeleteCascade-2092426887 None] Delete snapshot completed successfully. Aug 03 08:37:55 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-f6d56919-652d-4dfc-9019-7d0c9794056b tempest-VolumesDeleteCascade-2092426887 None] Lock "cinder-7ff6cf32-fd69-4b3f-b39c-58e3e1ea8b8f-delete_snapshot" released by "delete_snapshot" :: held 3.163s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:37:55 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-f6d56919-652d-4dfc-9019-7d0c9794056b tempest-VolumesDeleteCascade-2092426887 None] Acquiring lock "cinder-fb75737e-dcb8-458b-9187-cb8e565e3935-delete_snapshot" by "delete_snapshot" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:37:56 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-f6d56919-652d-4dfc-9019-7d0c9794056b tempest-VolumesDeleteCascade-2092426887 None] Lock "cinder-fb75737e-dcb8-458b-9187-cb8e565e3935-delete_snapshot" acquired by "delete_snapshot" :: waited 0.039s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:37:56 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-f6d56919-652d-4dfc-9019-7d0c9794056b tempest-VolumesDeleteCascade-2092426887 None] Acquiring lock "cinder-quobyte-52b00d24-cd53-4011-84eb-c09d3fe05304" by "delete_snapshot" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:37:56 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-f6d56919-652d-4dfc-9019-7d0c9794056b tempest-VolumesDeleteCascade-2092426887 None] Lock "cinder-quobyte-52b00d24-cd53-4011-84eb-c09d3fe05304" acquired by "delete_snapshot" :: waited 0.045s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:37:56 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-f6d56919-652d-4dfc-9019-7d0c9794056b tempest-VolumesDeleteCascade-2092426887 None] Acquiring lock "cinder-quobyte-fb75737e-dcb8-458b-9187-cb8e565e3935" by "_delete_snapshot" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:37:56 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-f6d56919-652d-4dfc-9019-7d0c9794056b tempest-VolumesDeleteCascade-2092426887 None] Lock "cinder-quobyte-fb75737e-dcb8-458b-9187-cb8e565e3935" acquired by "_delete_snapshot" :: waited 0.038s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:37:56 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-f6d56919-652d-4dfc-9019-7d0c9794056b tempest-VolumesDeleteCascade-2092426887 None] Deleting offline snapshot fb75737e-dcb8-458b-9187-cb8e565e3935 of volume 52b00d24-cd53-4011-84eb-c09d3fe05304 {{(pid=88899) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 03 08:37:56 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-f6d56919-652d-4dfc-9019-7d0c9794056b tempest-VolumesDeleteCascade-2092426887 None] snapshot_file for this snap is: volume-52b00d24-cd53-4011-84eb-c09d3fe05304.fb75737e-dcb8-458b-9187-cb8e565e3935 {{(pid=88899) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 03 08:37:56 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e3f88ea-2f28-442e-87a2-4deb43507ea2]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:37:56 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-f6d56919-652d-4dfc-9019-7d0c9794056b tempest-VolumesDeleteCascade-2092426887 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-52b00d24-cd53-4011-84eb-c09d3fe05304.fb75737e-dcb8-458b-9187-cb8e565e3935 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:37:56 devstack sudo[100409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-52b00d24-cd53-4011-84eb-c09d3fe05304.fb75737e-dcb8-458b-9187-cb8e565e3935 Aug 03 08:37:56 devstack sudo[100409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:37:56 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-a2f3e178-d39b-437c-a918-a77eff1c6952 tempest-VolumesActionsTest-48611561 None] Acquiring lock "cinder-95f31d2d-1d43-43db-aa60-f24865e0f1f0-delete_volume" by "delete_volume" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:37:56 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-a2f3e178-d39b-437c-a918-a77eff1c6952 tempest-VolumesActionsTest-48611561 None] Lock "cinder-95f31d2d-1d43-43db-aa60-f24865e0f1f0-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:37:56 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-a2f3e178-d39b-437c-a918-a77eff1c6952 tempest-VolumesActionsTest-48611561 None] Acquiring lock "cinder-quobyte-95f31d2d-1d43-43db-aa60-f24865e0f1f0" by "delete_volume" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:37:56 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-a2f3e178-d39b-437c-a918-a77eff1c6952 tempest-VolumesActionsTest-48611561 None] Lock "cinder-quobyte-95f31d2d-1d43-43db-aa60-f24865e0f1f0" acquired by "delete_volume" :: waited 0.034s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:37:56 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4a7fb27-83a0-4f8f-a10f-1aa7c5df0a9c]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:37:56 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-a2f3e178-d39b-437c-a918-a77eff1c6952 tempest-VolumesActionsTest-48611561 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-95f31d2d-1d43-43db-aa60-f24865e0f1f0 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:37:56 devstack sudo[100409]: pam_unix(sudo:session): session closed for user root Aug 03 08:37:56 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-f6d56919-652d-4dfc-9019-7d0c9794056b tempest-VolumesDeleteCascade-2092426887 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-52b00d24-cd53-4011-84eb-c09d3fe05304.fb75737e-dcb8-458b-9187-cb8e565e3935" returned: 0 in 0.563s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:37:56 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-f6d56919-652d-4dfc-9019-7d0c9794056b tempest-VolumesDeleteCascade-2092426887 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-52b00d24-cd53-4011-84eb-c09d3fe05304(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88899) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 03 08:37:56 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[d647eafb-8b5d-4367-84e8-612ede7a4f41]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:37:56 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-f6d56919-652d-4dfc-9019-7d0c9794056b tempest-VolumesDeleteCascade-2092426887 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-52b00d24-cd53-4011-84eb-c09d3fe05304 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:37:56 devstack sudo[100415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-95f31d2d-1d43-43db-aa60-f24865e0f1f0 Aug 03 08:37:56 devstack sudo[100415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:37:56 devstack sudo[100417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-52b00d24-cd53-4011-84eb-c09d3fe05304 Aug 03 08:37:56 devstack sudo[100417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:37:57 devstack sudo[100415]: pam_unix(sudo:session): session closed for user root Aug 03 08:37:57 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-a2f3e178-d39b-437c-a918-a77eff1c6952 tempest-VolumesActionsTest-48611561 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-95f31d2d-1d43-43db-aa60-f24865e0f1f0" returned: 0 in 0.557s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:37:57 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-a2f3e178-d39b-437c-a918-a77eff1c6952 tempest-VolumesActionsTest-48611561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-95f31d2d-1d43-43db-aa60-f24865e0f1f0 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:37:57 devstack sudo[100423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-95f31d2d-1d43-43db-aa60-f24865e0f1f0 Aug 03 08:37:57 devstack sudo[100423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:37:57 devstack sudo[100417]: pam_unix(sudo:session): session closed for user root Aug 03 08:37:57 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-f6d56919-652d-4dfc-9019-7d0c9794056b tempest-VolumesDeleteCascade-2092426887 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-52b00d24-cd53-4011-84eb-c09d3fe05304" returned: 0 in 0.700s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:37:57 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-f6d56919-652d-4dfc-9019-7d0c9794056b tempest-VolumesDeleteCascade-2092426887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-52b00d24-cd53-4011-84eb-c09d3fe05304.fb75737e-dcb8-458b-9187-cb8e565e3935 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:37:57 devstack sudo[100429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-52b00d24-cd53-4011-84eb-c09d3fe05304.fb75737e-dcb8-458b-9187-cb8e565e3935 Aug 03 08:37:57 devstack sudo[100429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:37:57 devstack sudo[100423]: pam_unix(sudo:session): session closed for user root Aug 03 08:37:57 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-a2f3e178-d39b-437c-a918-a77eff1c6952 tempest-VolumesActionsTest-48611561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-95f31d2d-1d43-43db-aa60-f24865e0f1f0" returned: 0 in 0.484s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:37:57 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-a2f3e178-d39b-437c-a918-a77eff1c6952 tempest-VolumesActionsTest-48611561 None] Lock "cinder-quobyte-95f31d2d-1d43-43db-aa60-f24865e0f1f0" released by "delete_volume" :: held 1.127s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:37:57 devstack cinder-volume[88899]: DEBUG cinder.quota [None req-a2f3e178-d39b-437c-a918-a77eff1c6952 tempest-VolumesActionsTest-48611561 None] Created reservations ['f723806d-d0ae-4fd0-a26d-0295976061b5', '38366650-8ea8-4260-8d2c-ea44565c3df6', '68b02e39-6192-428a-87a5-789c3c172aff', 'ac3066dc-a1f5-45be-a3f3-b4a21e6d230a'] {{(pid=88899) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 08:37:57 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-a2f3e178-d39b-437c-a918-a77eff1c6952 tempest-VolumesActionsTest-48611561 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:37:57 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-a2f3e178-d39b-437c-a918-a77eff1c6952 tempest-VolumesActionsTest-48611561 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:37:57 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-a2f3e178-d39b-437c-a918-a77eff1c6952 tempest-VolumesActionsTest-48611561 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:37:57 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-a2f3e178-d39b-437c-a918-a77eff1c6952 tempest-VolumesActionsTest-48611561 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:37:57 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-a2f3e178-d39b-437c-a918-a77eff1c6952 tempest-VolumesActionsTest-48611561 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:37:57 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-a2f3e178-d39b-437c-a918-a77eff1c6952 tempest-VolumesActionsTest-48611561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:37:57 devstack sudo[100443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a Aug 03 08:37:57 devstack sudo[100443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:37:58 devstack sudo[100429]: pam_unix(sudo:session): session closed for user root Aug 03 08:37:58 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-f6d56919-652d-4dfc-9019-7d0c9794056b tempest-VolumesDeleteCascade-2092426887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-52b00d24-cd53-4011-84eb-c09d3fe05304.fb75737e-dcb8-458b-9187-cb8e565e3935" returned: 0 in 0.582s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:37:58 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-f6d56919-652d-4dfc-9019-7d0c9794056b tempest-VolumesDeleteCascade-2092426887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-52b00d24-cd53-4011-84eb-c09d3fe05304.fb75737e-dcb8-458b-9187-cb8e565e3935 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:37:58 devstack sudo[100457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-52b00d24-cd53-4011-84eb-c09d3fe05304.fb75737e-dcb8-458b-9187-cb8e565e3935 Aug 03 08:37:58 devstack sudo[100457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:37:58 devstack sudo[100443]: pam_unix(sudo:session): session closed for user root Aug 03 08:37:58 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-a2f3e178-d39b-437c-a918-a77eff1c6952 tempest-VolumesActionsTest-48611561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a" returned: 0 in 0.399s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:37:58 devstack cinder-volume[88899]: DEBUG cinder.manager [None req-a2f3e178-d39b-437c-a918-a77eff1c6952 tempest-VolumesActionsTest-48611561 None] Notifying Schedulers of capabilities ... {{(pid=88899) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 08:37:58 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-a2f3e178-d39b-437c-a918-a77eff1c6952 tempest-VolumesActionsTest-48611561 None] Deleted volume successfully. Aug 03 08:37:58 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-a2f3e178-d39b-437c-a918-a77eff1c6952 tempest-VolumesActionsTest-48611561 None] Lock "cinder-95f31d2d-1d43-43db-aa60-f24865e0f1f0-delete_volume" released by "delete_volume" :: held 1.902s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:37:58 devstack sudo[100457]: pam_unix(sudo:session): session closed for user root Aug 03 08:37:58 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-f6d56919-652d-4dfc-9019-7d0c9794056b tempest-VolumesDeleteCascade-2092426887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-52b00d24-cd53-4011-84eb-c09d3fe05304.fb75737e-dcb8-458b-9187-cb8e565e3935" returned: 0 in 0.369s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:37:58 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-f6d56919-652d-4dfc-9019-7d0c9794056b tempest-VolumesDeleteCascade-2092426887 None] Lock "cinder-quobyte-fb75737e-dcb8-458b-9187-cb8e565e3935" released by "_delete_snapshot" :: held 2.402s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:37:58 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-f6d56919-652d-4dfc-9019-7d0c9794056b tempest-VolumesDeleteCascade-2092426887 None] Lock "cinder-quobyte-52b00d24-cd53-4011-84eb-c09d3fe05304" released by "delete_snapshot" :: held 2.460s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:37:58 devstack cinder-volume[88899]: DEBUG cinder.quota [None req-f6d56919-652d-4dfc-9019-7d0c9794056b tempest-VolumesDeleteCascade-2092426887 None] Created reservations ['9694c0cf-bfcc-42c3-a4bb-f14de61b66c3', '55846813-b968-44ed-8084-c81a31a00125', '6cfd9a4b-96c3-465e-b337-26bc1c22841d', 'a38cc09a-3a50-46cd-b281-03b2bc9b3872'] {{(pid=88899) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 08:37:58 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-f6d56919-652d-4dfc-9019-7d0c9794056b tempest-VolumesDeleteCascade-2092426887 None] Delete snapshot completed successfully. Aug 03 08:37:58 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-f6d56919-652d-4dfc-9019-7d0c9794056b tempest-VolumesDeleteCascade-2092426887 None] Lock "cinder-fb75737e-dcb8-458b-9187-cb8e565e3935-delete_snapshot" released by "delete_snapshot" :: held 2.809s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:37:58 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-f6d56919-652d-4dfc-9019-7d0c9794056b tempest-VolumesDeleteCascade-2092426887 None] Snapshots deleted, issuing volume delete {{(pid=88899) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Aug 03 08:37:58 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-f6d56919-652d-4dfc-9019-7d0c9794056b tempest-VolumesDeleteCascade-2092426887 None] Acquiring lock "cinder-quobyte-52b00d24-cd53-4011-84eb-c09d3fe05304" by "delete_volume" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:37:58 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-f6d56919-652d-4dfc-9019-7d0c9794056b tempest-VolumesDeleteCascade-2092426887 None] Lock "cinder-quobyte-52b00d24-cd53-4011-84eb-c09d3fe05304" acquired by "delete_volume" :: waited 0.031s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:37:58 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[951ab7a9-1f20-4de4-ba6a-173d31c73405]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:37:58 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-f6d56919-652d-4dfc-9019-7d0c9794056b tempest-VolumesDeleteCascade-2092426887 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-52b00d24-cd53-4011-84eb-c09d3fe05304 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:37:59 devstack cinder-volume[88899]: DEBUG cinder.volume.flows.manager.create_volume [None req-641fcfee-6fd9-4ecc-b785-26f18bda3708 tempest-VolumeAndVolumeTypeFromImageTest-1807227024 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88899) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 08:37:59 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-641fcfee-6fd9-4ecc-b785-26f18bda3708 tempest-VolumeAndVolumeTypeFromImageTest-1807227024 None] Flow 'volume_create_manager' (c285192a-592f-4478-b16d-aa43b2994b3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:37:59 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-641fcfee-6fd9-4ecc-b785-26f18bda3708 tempest-VolumeAndVolumeTypeFromImageTest-1807227024 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa3f7dd2-377b-43de-970e-52e204d9b3a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:37:59 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-641fcfee-6fd9-4ecc-b785-26f18bda3708 tempest-VolumeAndVolumeTypeFromImageTest-1807227024 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa3f7dd2-377b-43de-970e-52e204d9b3a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:37:58Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8bb0d1cc-636f-43c0-83ba-f9522b5aa1dd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fcb29d4282ae467a956bc71674ff5386',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:37:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:37:59Z,use_quota=True,user_id='ee0e225c8fd0462d84f1dacb81c5a011',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad636962-8be3-485c-90c0-45602433e30f),volume_type_id=ad636962-8be3-485c-90c0-45602433e30f)' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:37:59 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-641fcfee-6fd9-4ecc-b785-26f18bda3708 tempest-VolumeAndVolumeTypeFromImageTest-1807227024 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (afd20b7c-bb93-4970-82a6-28ad611515dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:37:59 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-641fcfee-6fd9-4ecc-b785-26f18bda3708 tempest-VolumeAndVolumeTypeFromImageTest-1807227024 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (afd20b7c-bb93-4970-82a6-28ad611515dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:37:59 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-641fcfee-6fd9-4ecc-b785-26f18bda3708 tempest-VolumeAndVolumeTypeFromImageTest-1807227024 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f78a9f42-ce42-4d63-a7e3-9f22ab633c6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:37:59 devstack cinder-volume[88899]: DEBUG cinder.image.glance [None req-641fcfee-6fd9-4ecc-b785-26f18bda3708 tempest-VolumeAndVolumeTypeFromImageTest-1807227024 None] Creating Keystone auth plugin from conf {{(pid=88899) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Aug 03 08:37:59 devstack sudo[100469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-52b00d24-cd53-4011-84eb-c09d3fe05304 Aug 03 08:37:59 devstack sudo[100469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:37:59 devstack sudo[100469]: pam_unix(sudo:session): session closed for user root Aug 03 08:37:59 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-f6d56919-652d-4dfc-9019-7d0c9794056b tempest-VolumesDeleteCascade-2092426887 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-52b00d24-cd53-4011-84eb-c09d3fe05304" returned: 0 in 0.628s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:37:59 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-f6d56919-652d-4dfc-9019-7d0c9794056b tempest-VolumesDeleteCascade-2092426887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-52b00d24-cd53-4011-84eb-c09d3fe05304 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:37:59 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-641fcfee-6fd9-4ecc-b785-26f18bda3708 tempest-VolumeAndVolumeTypeFromImageTest-1807227024 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f78a9f42-ce42-4d63-a7e3-9f22ab633c6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '8bb0d1cc-636f-43c0-83ba-f9522b5aa1dd', 'volume_name': 'volume-8bb0d1cc-636f-43c0-83ba-f9522b5aa1dd', 'volume_size': 1, 'image_id': '517ce992-aacd-42f2-809c-af8848182f90', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/517ce992-aacd-42f2-809c-af8848182f90', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '35df2b1ebee246bfb2900cbbf0032368', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'fcb29d4282ae467a956bc71674ff5386', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'ecc38225f65ccd739a342895e0aadf4b95d7d9f706388eac78c77cd62ae19b9e2bd47639e1fb1fe00bd0989cf1f28c0e1e3a50b221e6cd78e6750a722691a8e1', 'id': '517ce992-aacd-42f2-809c-af8848182f90', 'created_at': datetime.datetime(2026, 8, 3, 6, 37, 55, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 3, 6, 37, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/517ce992-aacd-42f2-809c-af8848182f90/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:37:59 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-641fcfee-6fd9-4ecc-b785-26f18bda3708 tempest-VolumeAndVolumeTypeFromImageTest-1807227024 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c8322698-ce07-4827-96ca-1d9f4f2e6474) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:37:59 devstack sudo[100477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-52b00d24-cd53-4011-84eb-c09d3fe05304 Aug 03 08:37:59 devstack sudo[100477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:37:59 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-641fcfee-6fd9-4ecc-b785-26f18bda3708 tempest-VolumeAndVolumeTypeFromImageTest-1807227024 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c8322698-ce07-4827-96ca-1d9f4f2e6474) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:37:59 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-641fcfee-6fd9-4ecc-b785-26f18bda3708 tempest-VolumeAndVolumeTypeFromImageTest-1807227024 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e10fade9-b782-4b48-a0c1-6857c25af795) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:37:59 devstack cinder-volume[88899]: INFO cinder.volume.flows.manager.create_volume [None req-641fcfee-6fd9-4ecc-b785-26f18bda3708 tempest-VolumeAndVolumeTypeFromImageTest-1807227024 None] Volume 8bb0d1cc-636f-43c0-83ba-f9522b5aa1dd: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-8bb0d1cc-636f-43c0-83ba-f9522b5aa1dd', 'volume_size': 1, 'image_id': '517ce992-aacd-42f2-809c-af8848182f90', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/517ce992-aacd-42f2-809c-af8848182f90', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '35df2b1ebee246bfb2900cbbf0032368', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'fcb29d4282ae467a956bc71674ff5386', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'ecc38225f65ccd739a342895e0aadf4b95d7d9f706388eac78c77cd62ae19b9e2bd47639e1fb1fe00bd0989cf1f28c0e1e3a50b221e6cd78e6750a722691a8e1', 'id': '517ce992-aacd-42f2-809c-af8848182f90', 'created_at': datetime.datetime(2026, 8, 3, 6, 37, 55, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 3, 6, 37, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/517ce992-aacd-42f2-809c-af8848182f90/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Aug 03 08:37:59 devstack cinder-volume[88899]: DEBUG cinder.volume.flows.manager.create_volume [None req-641fcfee-6fd9-4ecc-b785-26f18bda3708 tempest-VolumeAndVolumeTypeFromImageTest-1807227024 None] Trying to clone 8bb0d1cc-636f-43c0-83ba-f9522b5aa1dd from image 517ce992-aacd-42f2-809c-af8848182f90 at location (None, [{'url': 'file:///opt/stack/data/glance/images/517ce992-aacd-42f2-809c-af8848182f90', 'metadata': {}}]). {{(pid=88899) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Aug 03 08:37:59 devstack cinder-volume[88899]: DEBUG cinder.volume.flows.manager.create_volume [None req-e4ee222c-fdd3-4f23-92c4-a38452ad1c24 tempest-VolumesActionsTest-415737388 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88899) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 08:37:59 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-e4ee222c-fdd3-4f23-92c4-a38452ad1c24 tempest-VolumesActionsTest-415737388 None] Flow 'volume_create_manager' (cb5e9a0a-b22e-48a7-a16f-7349b35cb047) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:37:59 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-e4ee222c-fdd3-4f23-92c4-a38452ad1c24 tempest-VolumesActionsTest-415737388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd0f4c6d-c67a-40fa-9cc1-db7b08ed3641) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:37:59 devstack cinder-volume[88899]: DEBUG cinder.image.image_utils [None req-641fcfee-6fd9-4ecc-b785-26f18bda3708 tempest-VolumeAndVolumeTypeFromImageTest-1807227024 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_517ce992-aacd-42f2-809c-af8848182f90_2lxhk0k5devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=88899) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Aug 03 08:37:59 devstack cinder-volume[88899]: INFO cinder.image.image_utils [None req-641fcfee-6fd9-4ecc-b785-26f18bda3708 tempest-VolumeAndVolumeTypeFromImageTest-1807227024 None] Image download 0.00 MB at 0.00 MB/s Aug 03 08:37:59 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-e4ee222c-fdd3-4f23-92c4-a38452ad1c24 tempest-VolumesActionsTest-415737388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd0f4c6d-c67a-40fa-9cc1-db7b08ed3641) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:37:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-737963385',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b040d7a5-2864-4594-b240-29032c6d55ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d2cd534485a4923b66db7805993790c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:38:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:38:00Z,use_quota=True,user_id='d9b57e0f46644b399e1a0aea198130dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8bde7129-1dc4-42ab-b852-ab32c61b4921),volume_type_id=8bde7129-1dc4-42ab-b852-ab32c61b4921)' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:37:59 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-e4ee222c-fdd3-4f23-92c4-a38452ad1c24 tempest-VolumesActionsTest-415737388 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (19a8a3f2-9126-491c-aa77-d1cd45d78988) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:37:59 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-e4ee222c-fdd3-4f23-92c4-a38452ad1c24 tempest-VolumesActionsTest-415737388 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (19a8a3f2-9126-491c-aa77-d1cd45d78988) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:37:59 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-e4ee222c-fdd3-4f23-92c4-a38452ad1c24 tempest-VolumesActionsTest-415737388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c7a6f401-3cea-45eb-890b-774ff91995ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:37:59 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-e4ee222c-fdd3-4f23-92c4-a38452ad1c24 tempest-VolumesActionsTest-415737388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c7a6f401-3cea-45eb-890b-774ff91995ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b040d7a5-2864-4594-b240-29032c6d55ee', 'volume_name': 'volume-b040d7a5-2864-4594-b240-29032c6d55ee', 'volume_size': 1}' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:37:59 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-e4ee222c-fdd3-4f23-92c4-a38452ad1c24 tempest-VolumesActionsTest-415737388 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dcd169d0-ab61-4b8f-979b-f80e00b834c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:37:59 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-e4ee222c-fdd3-4f23-92c4-a38452ad1c24 tempest-VolumesActionsTest-415737388 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dcd169d0-ab61-4b8f-979b-f80e00b834c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:37:59 devstack sudo[100477]: pam_unix(sudo:session): session closed for user root Aug 03 08:37:59 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-e4ee222c-fdd3-4f23-92c4-a38452ad1c24 tempest-VolumesActionsTest-415737388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b56866f-c437-4428-a591-9f22309756d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:37:59 devstack cinder-volume[88899]: INFO cinder.volume.flows.manager.create_volume [None req-e4ee222c-fdd3-4f23-92c4-a38452ad1c24 tempest-VolumesActionsTest-415737388 None] Volume b040d7a5-2864-4594-b240-29032c6d55ee: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b040d7a5-2864-4594-b240-29032c6d55ee', 'volume_size': 1} Aug 03 08:37:59 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-e4ee222c-fdd3-4f23-92c4-a38452ad1c24 tempest-VolumesActionsTest-415737388 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:37:59 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-e4ee222c-fdd3-4f23-92c4-a38452ad1c24 tempest-VolumesActionsTest-415737388 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:37:59 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-e4ee222c-fdd3-4f23-92c4-a38452ad1c24 tempest-VolumesActionsTest-415737388 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:37:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-737963385',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b040d7a5-2864-4594-b240-29032c6d55ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d2cd534485a4923b66db7805993790c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:38:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:38:00Z,use_quota=True,user_id='d9b57e0f46644b399e1a0aea198130dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8bde7129-1dc4-42ab-b852-ab32c61b4921),volume_type_id=8bde7129-1dc4-42ab-b852-ab32c61b4921)}" {{(pid=88899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 08:37:59 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-e4ee222c-fdd3-4f23-92c4-a38452ad1c24 tempest-VolumesActionsTest-415737388 None] Creating volume b040d7a5-2864-4594-b240-29032c6d55ee {{(pid=88899) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 08:37:59 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-e4ee222c-fdd3-4f23-92c4-a38452ad1c24 tempest-VolumesActionsTest-415737388 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:37:59 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-e4ee222c-fdd3-4f23-92c4-a38452ad1c24 tempest-VolumesActionsTest-415737388 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:37:59 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-e4ee222c-fdd3-4f23-92c4-a38452ad1c24 tempest-VolumesActionsTest-415737388 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:37:59 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-e4ee222c-fdd3-4f23-92c4-a38452ad1c24 tempest-VolumesActionsTest-415737388 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:37:59 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-e4ee222c-fdd3-4f23-92c4-a38452ad1c24 tempest-VolumesActionsTest-415737388 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:37:59 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-e4ee222c-fdd3-4f23-92c4-a38452ad1c24 tempest-VolumesActionsTest-415737388 None] Selected osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385 as target Quobyte volume. {{(pid=88899) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 08:37:59 devstack cinder-volume[88899]: INFO cinder.volume.drivers.remotefs [None req-e4ee222c-fdd3-4f23-92c4-a38452ad1c24 tempest-VolumesActionsTest-415737388 None] casted to osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385 Aug 03 08:37:59 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-e4ee222c-fdd3-4f23-92c4-a38452ad1c24 tempest-VolumesActionsTest-415737388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-b040d7a5-2864-4594-b240-29032c6d55ee 1073741824 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:37:59 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-f6d56919-652d-4dfc-9019-7d0c9794056b tempest-VolumesDeleteCascade-2092426887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-52b00d24-cd53-4011-84eb-c09d3fe05304" returned: 0 in 0.428s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:38:00 devstack sudo[100480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-b040d7a5-2864-4594-b240-29032c6d55ee 1073741824 Aug 03 08:38:00 devstack sudo[100480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:38:00 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[350c6805-8c95-4b48-95a5-17030464ff79]: (4, 'raw') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:38:00 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-641fcfee-6fd9-4ecc-b785-26f18bda3708 tempest-VolumeAndVolumeTypeFromImageTest-1807227024 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_517ce992-aacd-42f2-809c-af8848182f90_2lxhk0k5devstack@QuobyteHD {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:38:00 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-f6d56919-652d-4dfc-9019-7d0c9794056b tempest-VolumesDeleteCascade-2092426887 None] Lock "cinder-quobyte-52b00d24-cd53-4011-84eb-c09d3fe05304" released by "delete_volume" :: held 1.176s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:38:00 devstack cinder-volume[88899]: DEBUG cinder.quota [None req-f6d56919-652d-4dfc-9019-7d0c9794056b tempest-VolumesDeleteCascade-2092426887 None] Created reservations ['63915ccb-6670-4834-95db-f2a65d64b0ec', '1090d246-12a5-4579-bff2-f0362ed4687e', '34e2743d-2bcf-4565-9cf0-ecd5faf96206', '166efd92-a178-448b-9216-df1848e82c8a'] {{(pid=88899) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 08:38:00 devstack sudo[100482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_517ce992-aacd-42f2-809c-af8848182f90_2lxhk0k5devstack@QuobyteHD Aug 03 08:38:00 devstack sudo[100482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:38:00 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-f6d56919-652d-4dfc-9019-7d0c9794056b tempest-VolumesDeleteCascade-2092426887 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:38:00 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-f6d56919-652d-4dfc-9019-7d0c9794056b tempest-VolumesDeleteCascade-2092426887 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:38:00 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-f6d56919-652d-4dfc-9019-7d0c9794056b tempest-VolumesDeleteCascade-2092426887 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:38:00 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-f6d56919-652d-4dfc-9019-7d0c9794056b tempest-VolumesDeleteCascade-2092426887 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:38:00 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-f6d56919-652d-4dfc-9019-7d0c9794056b tempest-VolumesDeleteCascade-2092426887 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:38:00 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-f6d56919-652d-4dfc-9019-7d0c9794056b tempest-VolumesDeleteCascade-2092426887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:38:00 devstack sudo[100487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a Aug 03 08:38:00 devstack sudo[100487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:38:00 devstack sudo[100482]: pam_unix(sudo:session): session closed for user root Aug 03 08:38:00 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-641fcfee-6fd9-4ecc-b785-26f18bda3708 tempest-VolumeAndVolumeTypeFromImageTest-1807227024 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_517ce992-aacd-42f2-809c-af8848182f90_2lxhk0k5devstack@QuobyteHD" returned: 0 in 0.599s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:38:00 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-641fcfee-6fd9-4ecc-b785-26f18bda3708 tempest-VolumeAndVolumeTypeFromImageTest-1807227024 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_517ce992-aacd-42f2-809c-af8848182f90_2lxhk0k5devstack@QuobyteHD {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:38:00 devstack sudo[100480]: pam_unix(sudo:session): session closed for user root Aug 03 08:38:00 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-e4ee222c-fdd3-4f23-92c4-a38452ad1c24 tempest-VolumesActionsTest-415737388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-b040d7a5-2864-4594-b240-29032c6d55ee 1073741824" returned: 0 in 0.699s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:38:00 devstack sudo[100487]: pam_unix(sudo:session): session closed for user root Aug 03 08:38:00 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-f6d56919-652d-4dfc-9019-7d0c9794056b tempest-VolumesDeleteCascade-2092426887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a" returned: 0 in 0.418s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:38:00 devstack cinder-volume[88899]: DEBUG cinder.manager [None req-f6d56919-652d-4dfc-9019-7d0c9794056b tempest-VolumesDeleteCascade-2092426887 None] Notifying Schedulers of capabilities ... {{(pid=88899) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 08:38:00 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-f6d56919-652d-4dfc-9019-7d0c9794056b tempest-VolumesDeleteCascade-2092426887 None] Deleted volume successfully. Aug 03 08:38:00 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-e4ee222c-fdd3-4f23-92c4-a38452ad1c24 tempest-VolumesActionsTest-415737388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-b040d7a5-2864-4594-b240-29032c6d55ee {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:38:00 devstack sudo[100492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_517ce992-aacd-42f2-809c-af8848182f90_2lxhk0k5devstack@QuobyteHD Aug 03 08:38:00 devstack sudo[100492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:38:00 devstack sudo[100494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-b040d7a5-2864-4594-b240-29032c6d55ee Aug 03 08:38:00 devstack sudo[100494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:38:00 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-f6d56919-652d-4dfc-9019-7d0c9794056b tempest-VolumesDeleteCascade-2092426887 None] Lock "cinder-52b00d24-cd53-4011-84eb-c09d3fe05304-delete_volume" released by "delete_volume" :: held 8.335s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:38:01 devstack sudo[100492]: pam_unix(sudo:session): session closed for user root Aug 03 08:38:01 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-641fcfee-6fd9-4ecc-b785-26f18bda3708 tempest-VolumeAndVolumeTypeFromImageTest-1807227024 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_517ce992-aacd-42f2-809c-af8848182f90_2lxhk0k5devstack@QuobyteHD" returned: 1 in 0.465s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:38:01 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-641fcfee-6fd9-4ecc-b785-26f18bda3708 tempest-VolumeAndVolumeTypeFromImageTest-1807227024 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_517ce992-aacd-42f2-809c-af8848182f90_2lxhk0k5devstack@QuobyteHD' failed. Not Retrying. {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 03 08:38:01 devstack cinder-volume[88899]: DEBUG cinder.image.image_utils [None req-641fcfee-6fd9-4ecc-b785-26f18bda3708 tempest-VolumeAndVolumeTypeFromImageTest-1807227024 None] Temporary image 517ce992-aacd-42f2-809c-af8848182f90 is fetched for user ee0e225c8fd0462d84f1dacb81c5a011. {{(pid=88899) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Aug 03 08:38:01 devstack sudo[100494]: pam_unix(sudo:session): session closed for user root Aug 03 08:38:01 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-e4ee222c-fdd3-4f23-92c4-a38452ad1c24 tempest-VolumesActionsTest-415737388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-b040d7a5-2864-4594-b240-29032c6d55ee" returned: 0 in 0.356s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:38:01 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-e4ee222c-fdd3-4f23-92c4-a38452ad1c24 tempest-VolumesActionsTest-415737388 None] <== create_volume: return (1173ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'} {{(pid=88899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 08:38:01 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-e4ee222c-fdd3-4f23-92c4-a38452ad1c24 tempest-VolumesActionsTest-415737388 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.177s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:38:01 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-e4ee222c-fdd3-4f23-92c4-a38452ad1c24 tempest-VolumesActionsTest-415737388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b56866f-c437-4428-a591-9f22309756d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b040d7a5-2864-4594-b240-29032c6d55ee', 'volume_size': 1}' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:38:01 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-e4ee222c-fdd3-4f23-92c4-a38452ad1c24 tempest-VolumesActionsTest-415737388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f5763b7-69d5-4ef8-8d19-5143d1bd30e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:38:01 devstack cinder-volume[88899]: INFO cinder.volume.flows.manager.create_volume [None req-e4ee222c-fdd3-4f23-92c4-a38452ad1c24 tempest-VolumesActionsTest-415737388 None] Volume volume-b040d7a5-2864-4594-b240-29032c6d55ee (b040d7a5-2864-4594-b240-29032c6d55ee): created successfully Aug 03 08:38:01 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-e4ee222c-fdd3-4f23-92c4-a38452ad1c24 tempest-VolumesActionsTest-415737388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f5763b7-69d5-4ef8-8d19-5143d1bd30e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:38:01 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-e4ee222c-fdd3-4f23-92c4-a38452ad1c24 tempest-VolumesActionsTest-415737388 None] Flow 'volume_create_manager' (cb5e9a0a-b22e-48a7-a16f-7349b35cb047) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:38:01 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbddd7d7-14b6-419b-a63b-5596d0811214]: (4, 'raw') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:38:01 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-641fcfee-6fd9-4ecc-b785-26f18bda3708 tempest-VolumeAndVolumeTypeFromImageTest-1807227024 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_517ce992-aacd-42f2-809c-af8848182f90_2lxhk0k5devstack@QuobyteHD {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:38:01 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-e4ee222c-fdd3-4f23-92c4-a38452ad1c24 tempest-VolumesActionsTest-415737388 None] Created volume successfully. Aug 03 08:38:01 devstack sudo[100501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_517ce992-aacd-42f2-809c-af8848182f90_2lxhk0k5devstack@QuobyteHD Aug 03 08:38:01 devstack sudo[100501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:38:01 devstack cinder-volume[88899]: DEBUG cinder.volume.flows.manager.create_volume [None req-779533a7-81d3-4615-a23c-5ab8ed53dc64 tempest-VolumesDeleteCascade-2092426887 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88899) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 08:38:01 devstack sudo[100501]: pam_unix(sudo:session): session closed for user root Aug 03 08:38:01 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-779533a7-81d3-4615-a23c-5ab8ed53dc64 tempest-VolumesDeleteCascade-2092426887 None] Flow 'volume_create_manager' (daa48a6e-3c7e-437d-8ada-24675b3ab9dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:38:01 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-779533a7-81d3-4615-a23c-5ab8ed53dc64 tempest-VolumesDeleteCascade-2092426887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1cd66a0f-c405-4428-b8b2-ad102d500f89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:38:01 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-641fcfee-6fd9-4ecc-b785-26f18bda3708 tempest-VolumeAndVolumeTypeFromImageTest-1807227024 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_517ce992-aacd-42f2-809c-af8848182f90_2lxhk0k5devstack@QuobyteHD" returned: 0 in 0.406s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:38:01 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-641fcfee-6fd9-4ecc-b785-26f18bda3708 tempest-VolumeAndVolumeTypeFromImageTest-1807227024 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_517ce992-aacd-42f2-809c-af8848182f90_2lxhk0k5devstack@QuobyteHD {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:38:01 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-779533a7-81d3-4615-a23c-5ab8ed53dc64 tempest-VolumesDeleteCascade-2092426887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1cd66a0f-c405-4428-b8b2-ad102d500f89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:38:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-315403774',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=53c7271f-46db-4a1b-91f6-3a358ce1c149,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e6b9f3cf6e442b9bc0bbd3708562588',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:38:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:38:02Z,use_quota=True,user_id='69472b74f0154de3bbfc7d8c30c8abb0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8bde7129-1dc4-42ab-b852-ab32c61b4921),volume_type_id=8bde7129-1dc4-42ab-b852-ab32c61b4921)' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:38:01 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-779533a7-81d3-4615-a23c-5ab8ed53dc64 tempest-VolumesDeleteCascade-2092426887 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9413c25a-b874-469f-9781-5c30192270a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:38:01 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-779533a7-81d3-4615-a23c-5ab8ed53dc64 tempest-VolumesDeleteCascade-2092426887 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9413c25a-b874-469f-9781-5c30192270a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:38:01 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-779533a7-81d3-4615-a23c-5ab8ed53dc64 tempest-VolumesDeleteCascade-2092426887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd8fcd8b-cd4b-4c4c-85aa-6c491085462d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:38:01 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-779533a7-81d3-4615-a23c-5ab8ed53dc64 tempest-VolumesDeleteCascade-2092426887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd8fcd8b-cd4b-4c4c-85aa-6c491085462d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '53c7271f-46db-4a1b-91f6-3a358ce1c149', 'volume_name': 'volume-53c7271f-46db-4a1b-91f6-3a358ce1c149', 'volume_size': 1}' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:38:01 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-779533a7-81d3-4615-a23c-5ab8ed53dc64 tempest-VolumesDeleteCascade-2092426887 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a46a80e1-37aa-4bb8-b610-e3b126ada682) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:38:01 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-779533a7-81d3-4615-a23c-5ab8ed53dc64 tempest-VolumesDeleteCascade-2092426887 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a46a80e1-37aa-4bb8-b610-e3b126ada682) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:38:01 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-779533a7-81d3-4615-a23c-5ab8ed53dc64 tempest-VolumesDeleteCascade-2092426887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83b0b1b1-470d-464a-95f8-aa65320aef00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:38:01 devstack cinder-volume[88899]: INFO cinder.volume.flows.manager.create_volume [None req-779533a7-81d3-4615-a23c-5ab8ed53dc64 tempest-VolumesDeleteCascade-2092426887 None] Volume 53c7271f-46db-4a1b-91f6-3a358ce1c149: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-53c7271f-46db-4a1b-91f6-3a358ce1c149', 'volume_size': 1} Aug 03 08:38:01 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-779533a7-81d3-4615-a23c-5ab8ed53dc64 tempest-VolumesDeleteCascade-2092426887 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:38:01 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-779533a7-81d3-4615-a23c-5ab8ed53dc64 tempest-VolumesDeleteCascade-2092426887 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:38:01 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-779533a7-81d3-4615-a23c-5ab8ed53dc64 tempest-VolumesDeleteCascade-2092426887 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:38:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-315403774',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=53c7271f-46db-4a1b-91f6-3a358ce1c149,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e6b9f3cf6e442b9bc0bbd3708562588',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:38:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:38:02Z,use_quota=True,user_id='69472b74f0154de3bbfc7d8c30c8abb0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8bde7129-1dc4-42ab-b852-ab32c61b4921),volume_type_id=8bde7129-1dc4-42ab-b852-ab32c61b4921)}" {{(pid=88899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 08:38:01 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-779533a7-81d3-4615-a23c-5ab8ed53dc64 tempest-VolumesDeleteCascade-2092426887 None] Creating volume 53c7271f-46db-4a1b-91f6-3a358ce1c149 {{(pid=88899) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 08:38:01 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-779533a7-81d3-4615-a23c-5ab8ed53dc64 tempest-VolumesDeleteCascade-2092426887 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:38:01 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-779533a7-81d3-4615-a23c-5ab8ed53dc64 tempest-VolumesDeleteCascade-2092426887 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:38:01 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-779533a7-81d3-4615-a23c-5ab8ed53dc64 tempest-VolumesDeleteCascade-2092426887 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:38:01 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-779533a7-81d3-4615-a23c-5ab8ed53dc64 tempest-VolumesDeleteCascade-2092426887 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:38:01 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-779533a7-81d3-4615-a23c-5ab8ed53dc64 tempest-VolumesDeleteCascade-2092426887 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:38:01 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-779533a7-81d3-4615-a23c-5ab8ed53dc64 tempest-VolumesDeleteCascade-2092426887 None] Selected osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385 as target Quobyte volume. {{(pid=88899) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 08:38:01 devstack cinder-volume[88899]: INFO cinder.volume.drivers.remotefs [None req-779533a7-81d3-4615-a23c-5ab8ed53dc64 tempest-VolumesDeleteCascade-2092426887 None] casted to osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385 Aug 03 08:38:01 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-779533a7-81d3-4615-a23c-5ab8ed53dc64 tempest-VolumesDeleteCascade-2092426887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-53c7271f-46db-4a1b-91f6-3a358ce1c149 1073741824 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:38:01 devstack sudo[100506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-53c7271f-46db-4a1b-91f6-3a358ce1c149 1073741824 Aug 03 08:38:01 devstack sudo[100506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:38:01 devstack sudo[100505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_517ce992-aacd-42f2-809c-af8848182f90_2lxhk0k5devstack@QuobyteHD Aug 03 08:38:01 devstack sudo[100505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:38:02 devstack sudo[100505]: pam_unix(sudo:session): session closed for user root Aug 03 08:38:02 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-641fcfee-6fd9-4ecc-b785-26f18bda3708 tempest-VolumeAndVolumeTypeFromImageTest-1807227024 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_517ce992-aacd-42f2-809c-af8848182f90_2lxhk0k5devstack@QuobyteHD" returned: 1 in 0.487s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:38:02 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-641fcfee-6fd9-4ecc-b785-26f18bda3708 tempest-VolumeAndVolumeTypeFromImageTest-1807227024 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_517ce992-aacd-42f2-809c-af8848182f90_2lxhk0k5devstack@QuobyteHD' failed. Not Retrying. {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 03 08:38:02 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-641fcfee-6fd9-4ecc-b785-26f18bda3708 tempest-VolumeAndVolumeTypeFromImageTest-1807227024 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:38:02 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-9862f8da-7530-4e9b-a977-d6d66ef147c2 tempest-VolumesActionsTest-48611561 None] Acquiring lock "cinder-b040d7a5-2864-4594-b240-29032c6d55ee-delete_volume" by "delete_volume" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:38:02 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-9862f8da-7530-4e9b-a977-d6d66ef147c2 tempest-VolumesActionsTest-48611561 None] Lock "cinder-b040d7a5-2864-4594-b240-29032c6d55ee-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:38:02 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-9862f8da-7530-4e9b-a977-d6d66ef147c2 tempest-VolumesActionsTest-48611561 None] Acquiring lock "cinder-quobyte-b040d7a5-2864-4594-b240-29032c6d55ee" by "delete_volume" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:38:02 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-9862f8da-7530-4e9b-a977-d6d66ef147c2 tempest-VolumesActionsTest-48611561 None] Lock "cinder-quobyte-b040d7a5-2864-4594-b240-29032c6d55ee" acquired by "delete_volume" :: waited 0.021s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:38:02 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[1aafa227-2f5c-4aac-a1ba-3cbaa74e34b4]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:38:02 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-9862f8da-7530-4e9b-a977-d6d66ef147c2 tempest-VolumesActionsTest-48611561 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-b040d7a5-2864-4594-b240-29032c6d55ee {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:38:02 devstack sudo[100506]: pam_unix(sudo:session): session closed for user root Aug 03 08:38:02 devstack sudo[100516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-b040d7a5-2864-4594-b240-29032c6d55ee Aug 03 08:38:02 devstack sudo[100516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:38:02 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-779533a7-81d3-4615-a23c-5ab8ed53dc64 tempest-VolumesDeleteCascade-2092426887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-53c7271f-46db-4a1b-91f6-3a358ce1c149 1073741824" returned: 0 in 0.672s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:38:02 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-779533a7-81d3-4615-a23c-5ab8ed53dc64 tempest-VolumesDeleteCascade-2092426887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-53c7271f-46db-4a1b-91f6-3a358ce1c149 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:38:02 devstack sudo[100518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-53c7271f-46db-4a1b-91f6-3a358ce1c149 Aug 03 08:38:02 devstack sudo[100518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:38:02 devstack cinder-volume[88899]: DEBUG cinder.volume.flows.manager.create_volume [None req-88d90f63-90fc-4a75-8c1f-e288284eb731 tempest-ServersNegativeTestJSON-899715745 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88899) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 08:38:02 devstack sudo[100516]: pam_unix(sudo:session): session closed for user root Aug 03 08:38:02 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-88d90f63-90fc-4a75-8c1f-e288284eb731 tempest-ServersNegativeTestJSON-899715745 None] Flow 'volume_create_manager' (aa1ad4fc-e79d-4e3b-9673-1774518d8663) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:38:02 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-88d90f63-90fc-4a75-8c1f-e288284eb731 tempest-ServersNegativeTestJSON-899715745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25db057b-3862-42e8-9c7e-8842bd64196f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:38:02 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-9862f8da-7530-4e9b-a977-d6d66ef147c2 tempest-VolumesActionsTest-48611561 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-b040d7a5-2864-4594-b240-29032c6d55ee" returned: 0 in 0.457s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:38:02 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-9862f8da-7530-4e9b-a977-d6d66ef147c2 tempest-VolumesActionsTest-48611561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-b040d7a5-2864-4594-b240-29032c6d55ee {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:38:02 devstack sudo[100518]: pam_unix(sudo:session): session closed for user root Aug 03 08:38:02 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-88d90f63-90fc-4a75-8c1f-e288284eb731 tempest-ServersNegativeTestJSON-899715745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25db057b-3862-42e8-9c7e-8842bd64196f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:38:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1055861408',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f087f98-037e-40a5-a74c-630590557535,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6040725d47f6436e8c8048e98cdc9e5b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:38:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:38:03Z,use_quota=True,user_id='e10b03dd6cc643b3a7ba973170ffe4cd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8bde7129-1dc4-42ab-b852-ab32c61b4921),volume_type_id=8bde7129-1dc4-42ab-b852-ab32c61b4921)' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:38:02 devstack sudo[100525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-b040d7a5-2864-4594-b240-29032c6d55ee Aug 03 08:38:02 devstack sudo[100525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:38:02 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-88d90f63-90fc-4a75-8c1f-e288284eb731 tempest-ServersNegativeTestJSON-899715745 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9347ea2-0b4b-4531-a4d1-1962b654daa0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:38:02 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-88d90f63-90fc-4a75-8c1f-e288284eb731 tempest-ServersNegativeTestJSON-899715745 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9347ea2-0b4b-4531-a4d1-1962b654daa0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:38:02 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-88d90f63-90fc-4a75-8c1f-e288284eb731 tempest-ServersNegativeTestJSON-899715745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18c41871-0c44-4c43-a22f-61f19cc2f702) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:38:02 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-88d90f63-90fc-4a75-8c1f-e288284eb731 tempest-ServersNegativeTestJSON-899715745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18c41871-0c44-4c43-a22f-61f19cc2f702) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5f087f98-037e-40a5-a74c-630590557535', 'volume_name': 'volume-5f087f98-037e-40a5-a74c-630590557535', 'volume_size': 1}' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:38:02 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-88d90f63-90fc-4a75-8c1f-e288284eb731 tempest-ServersNegativeTestJSON-899715745 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a67379a-4747-4e2e-95e7-aea461e7bc82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:38:02 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-88d90f63-90fc-4a75-8c1f-e288284eb731 tempest-ServersNegativeTestJSON-899715745 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a67379a-4747-4e2e-95e7-aea461e7bc82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:38:02 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-88d90f63-90fc-4a75-8c1f-e288284eb731 tempest-ServersNegativeTestJSON-899715745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f93b84f2-f7b6-435f-b27d-9677a4d7a99a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:38:02 devstack cinder-volume[88899]: INFO cinder.volume.flows.manager.create_volume [None req-88d90f63-90fc-4a75-8c1f-e288284eb731 tempest-ServersNegativeTestJSON-899715745 None] Volume 5f087f98-037e-40a5-a74c-630590557535: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5f087f98-037e-40a5-a74c-630590557535', 'volume_size': 1} Aug 03 08:38:02 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-88d90f63-90fc-4a75-8c1f-e288284eb731 tempest-ServersNegativeTestJSON-899715745 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:38:02 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-779533a7-81d3-4615-a23c-5ab8ed53dc64 tempest-VolumesDeleteCascade-2092426887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-53c7271f-46db-4a1b-91f6-3a358ce1c149" returned: 0 in 0.352s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:38:02 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-779533a7-81d3-4615-a23c-5ab8ed53dc64 tempest-VolumesDeleteCascade-2092426887 None] <== create_volume: return (1086ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'} {{(pid=88899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 08:38:02 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-779533a7-81d3-4615-a23c-5ab8ed53dc64 tempest-VolumesDeleteCascade-2092426887 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.088s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:38:02 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-641fcfee-6fd9-4ecc-b785-26f18bda3708 tempest-VolumeAndVolumeTypeFromImageTest-1807227024 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.690s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:38:02 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-641fcfee-6fd9-4ecc-b785-26f18bda3708 tempest-VolumeAndVolumeTypeFromImageTest-1807227024 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:37:58Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8bb0d1cc-636f-43c0-83ba-f9522b5aa1dd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fcb29d4282ae467a956bc71674ff5386',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:37:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:37:59Z,use_quota=True,user_id='ee0e225c8fd0462d84f1dacb81c5a011',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad636962-8be3-485c-90c0-45602433e30f),volume_type_id=ad636962-8be3-485c-90c0-45602433e30f)}" {{(pid=88899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 08:38:02 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-641fcfee-6fd9-4ecc-b785-26f18bda3708 tempest-VolumeAndVolumeTypeFromImageTest-1807227024 None] Creating volume 8bb0d1cc-636f-43c0-83ba-f9522b5aa1dd {{(pid=88899) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 08:38:02 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-641fcfee-6fd9-4ecc-b785-26f18bda3708 tempest-VolumeAndVolumeTypeFromImageTest-1807227024 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:38:02 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-641fcfee-6fd9-4ecc-b785-26f18bda3708 tempest-VolumeAndVolumeTypeFromImageTest-1807227024 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:38:02 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-641fcfee-6fd9-4ecc-b785-26f18bda3708 tempest-VolumeAndVolumeTypeFromImageTest-1807227024 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:38:02 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-641fcfee-6fd9-4ecc-b785-26f18bda3708 tempest-VolumeAndVolumeTypeFromImageTest-1807227024 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:38:02 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-641fcfee-6fd9-4ecc-b785-26f18bda3708 tempest-VolumeAndVolumeTypeFromImageTest-1807227024 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:38:02 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-641fcfee-6fd9-4ecc-b785-26f18bda3708 tempest-VolumeAndVolumeTypeFromImageTest-1807227024 None] Selected osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385 as target Quobyte volume. {{(pid=88899) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 08:38:02 devstack cinder-volume[88899]: INFO cinder.volume.drivers.remotefs [None req-641fcfee-6fd9-4ecc-b785-26f18bda3708 tempest-VolumeAndVolumeTypeFromImageTest-1807227024 None] casted to osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385 Aug 03 08:38:02 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-641fcfee-6fd9-4ecc-b785-26f18bda3708 tempest-VolumeAndVolumeTypeFromImageTest-1807227024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-8bb0d1cc-636f-43c0-83ba-f9522b5aa1dd 1073741824 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:38:02 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-779533a7-81d3-4615-a23c-5ab8ed53dc64 tempest-VolumesDeleteCascade-2092426887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83b0b1b1-470d-464a-95f8-aa65320aef00) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-53c7271f-46db-4a1b-91f6-3a358ce1c149', 'volume_size': 1}' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:38:02 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-779533a7-81d3-4615-a23c-5ab8ed53dc64 tempest-VolumesDeleteCascade-2092426887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2f22008a-37cb-4df8-98cb-76d5a532e30c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:38:02 devstack sudo[100527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-8bb0d1cc-636f-43c0-83ba-f9522b5aa1dd 1073741824 Aug 03 08:38:02 devstack sudo[100527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:38:02 devstack cinder-volume[88899]: INFO cinder.volume.flows.manager.create_volume [None req-779533a7-81d3-4615-a23c-5ab8ed53dc64 tempest-VolumesDeleteCascade-2092426887 None] Volume volume-53c7271f-46db-4a1b-91f6-3a358ce1c149 (53c7271f-46db-4a1b-91f6-3a358ce1c149): created successfully Aug 03 08:38:02 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-779533a7-81d3-4615-a23c-5ab8ed53dc64 tempest-VolumesDeleteCascade-2092426887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2f22008a-37cb-4df8-98cb-76d5a532e30c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:38:02 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-779533a7-81d3-4615-a23c-5ab8ed53dc64 tempest-VolumesDeleteCascade-2092426887 None] Flow 'volume_create_manager' (daa48a6e-3c7e-437d-8ada-24675b3ab9dd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:38:02 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-779533a7-81d3-4615-a23c-5ab8ed53dc64 tempest-VolumesDeleteCascade-2092426887 None] Created volume successfully. Aug 03 08:38:02 devstack sudo[100525]: pam_unix(sudo:session): session closed for user root Aug 03 08:38:02 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-9862f8da-7530-4e9b-a977-d6d66ef147c2 tempest-VolumesActionsTest-48611561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-b040d7a5-2864-4594-b240-29032c6d55ee" returned: 0 in 0.262s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:38:03 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-9862f8da-7530-4e9b-a977-d6d66ef147c2 tempest-VolumesActionsTest-48611561 None] Lock "cinder-quobyte-b040d7a5-2864-4594-b240-29032c6d55ee" released by "delete_volume" :: held 0.778s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:38:03 devstack cinder-volume[88899]: DEBUG cinder.quota [None req-9862f8da-7530-4e9b-a977-d6d66ef147c2 tempest-VolumesActionsTest-48611561 None] Created reservations ['dd29ccdd-96b1-4c29-a63a-9eab3c5e07bb', '45f69acb-3362-4de7-9189-c3aafe507d72', 'a7a7e68d-f3d3-42f7-a8bd-c6191a7b7235', '609eda3b-9cba-4614-bad8-b17d22afd686'] {{(pid=88899) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 08:38:03 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-9862f8da-7530-4e9b-a977-d6d66ef147c2 tempest-VolumesActionsTest-48611561 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:38:03 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-9862f8da-7530-4e9b-a977-d6d66ef147c2 tempest-VolumesActionsTest-48611561 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:38:03 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-9862f8da-7530-4e9b-a977-d6d66ef147c2 tempest-VolumesActionsTest-48611561 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:38:03 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-9862f8da-7530-4e9b-a977-d6d66ef147c2 tempest-VolumesActionsTest-48611561 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:38:03 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-9862f8da-7530-4e9b-a977-d6d66ef147c2 tempest-VolumesActionsTest-48611561 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:38:03 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-9862f8da-7530-4e9b-a977-d6d66ef147c2 tempest-VolumesActionsTest-48611561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:38:03 devstack sudo[100533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a Aug 03 08:38:03 devstack sudo[100533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:38:03 devstack sudo[100527]: pam_unix(sudo:session): session closed for user root Aug 03 08:38:03 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-641fcfee-6fd9-4ecc-b785-26f18bda3708 tempest-VolumeAndVolumeTypeFromImageTest-1807227024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-8bb0d1cc-636f-43c0-83ba-f9522b5aa1dd 1073741824" returned: 0 in 0.537s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:38:03 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-641fcfee-6fd9-4ecc-b785-26f18bda3708 tempest-VolumeAndVolumeTypeFromImageTest-1807227024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-8bb0d1cc-636f-43c0-83ba-f9522b5aa1dd {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:38:03 devstack sudo[100533]: pam_unix(sudo:session): session closed for user root Aug 03 08:38:03 devstack sudo[100537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-8bb0d1cc-636f-43c0-83ba-f9522b5aa1dd Aug 03 08:38:03 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-9862f8da-7530-4e9b-a977-d6d66ef147c2 tempest-VolumesActionsTest-48611561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a" returned: 0 in 0.279s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:38:03 devstack cinder-volume[88899]: DEBUG cinder.manager [None req-9862f8da-7530-4e9b-a977-d6d66ef147c2 tempest-VolumesActionsTest-48611561 None] Notifying Schedulers of capabilities ... {{(pid=88899) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 08:38:03 devstack sudo[100537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:38:03 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-9862f8da-7530-4e9b-a977-d6d66ef147c2 tempest-VolumesActionsTest-48611561 None] Deleted volume successfully. Aug 03 08:38:03 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-9862f8da-7530-4e9b-a977-d6d66ef147c2 tempest-VolumesActionsTest-48611561 None] Lock "cinder-b040d7a5-2864-4594-b240-29032c6d55ee-delete_volume" released by "delete_volume" :: held 1.312s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:38:03 devstack sudo[100537]: pam_unix(sudo:session): session closed for user root Aug 03 08:38:03 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-641fcfee-6fd9-4ecc-b785-26f18bda3708 tempest-VolumeAndVolumeTypeFromImageTest-1807227024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-8bb0d1cc-636f-43c0-83ba-f9522b5aa1dd" returned: 0 in 0.289s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:38:03 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-641fcfee-6fd9-4ecc-b785-26f18bda3708 tempest-VolumeAndVolumeTypeFromImageTest-1807227024 None] <== create_volume: return (879ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'} {{(pid=88899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 08:38:03 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-641fcfee-6fd9-4ecc-b785-26f18bda3708 tempest-VolumeAndVolumeTypeFromImageTest-1807227024 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.884s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:38:03 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-88d90f63-90fc-4a75-8c1f-e288284eb731 tempest-ServersNegativeTestJSON-899715745 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.899s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:38:03 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-88d90f63-90fc-4a75-8c1f-e288284eb731 tempest-ServersNegativeTestJSON-899715745 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:38:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1055861408',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f087f98-037e-40a5-a74c-630590557535,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6040725d47f6436e8c8048e98cdc9e5b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:38:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:38:03Z,use_quota=True,user_id='e10b03dd6cc643b3a7ba973170ffe4cd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8bde7129-1dc4-42ab-b852-ab32c61b4921),volume_type_id=8bde7129-1dc4-42ab-b852-ab32c61b4921)}" {{(pid=88899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 08:38:03 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-88d90f63-90fc-4a75-8c1f-e288284eb731 tempest-ServersNegativeTestJSON-899715745 None] Creating volume 5f087f98-037e-40a5-a74c-630590557535 {{(pid=88899) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 08:38:03 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-88d90f63-90fc-4a75-8c1f-e288284eb731 tempest-ServersNegativeTestJSON-899715745 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:38:03 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-88d90f63-90fc-4a75-8c1f-e288284eb731 tempest-ServersNegativeTestJSON-899715745 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:38:03 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-88d90f63-90fc-4a75-8c1f-e288284eb731 tempest-ServersNegativeTestJSON-899715745 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:38:03 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-88d90f63-90fc-4a75-8c1f-e288284eb731 tempest-ServersNegativeTestJSON-899715745 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:38:03 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-88d90f63-90fc-4a75-8c1f-e288284eb731 tempest-ServersNegativeTestJSON-899715745 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:38:03 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-88d90f63-90fc-4a75-8c1f-e288284eb731 tempest-ServersNegativeTestJSON-899715745 None] Selected osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385 as target Quobyte volume. {{(pid=88899) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 08:38:03 devstack cinder-volume[88899]: INFO cinder.volume.drivers.remotefs [None req-88d90f63-90fc-4a75-8c1f-e288284eb731 tempest-ServersNegativeTestJSON-899715745 None] casted to osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385 Aug 03 08:38:03 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-88d90f63-90fc-4a75-8c1f-e288284eb731 tempest-ServersNegativeTestJSON-899715745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-5f087f98-037e-40a5-a74c-630590557535 1073741824 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:38:03 devstack sudo[100540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-5f087f98-037e-40a5-a74c-630590557535 1073741824 Aug 03 08:38:03 devstack sudo[100540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:38:03 devstack cinder-volume[88899]: DEBUG cinder.volume.volume_utils [None req-641fcfee-6fd9-4ecc-b785-26f18bda3708 tempest-VolumeAndVolumeTypeFromImageTest-1807227024 None] Attempting download of 517ce992-aacd-42f2-809c-af8848182f90 ((None, [{'url': 'file:///opt/stack/data/glance/images/517ce992-aacd-42f2-809c-af8848182f90', 'metadata': {}}])) to volume 8bb0d1cc-636f-43c0-83ba-f9522b5aa1dd. {{(pid=88899) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Aug 03 08:38:03 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[232ae0c1-bc80-4876-8676-d894b62a738c]: (4, 'raw') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:38:03 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-641fcfee-6fd9-4ecc-b785-26f18bda3708 tempest-VolumeAndVolumeTypeFromImageTest-1807227024 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_517ce992-aacd-42f2-809c-af8848182f90_xq7bcpuu {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:38:03 devstack sudo[100542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_517ce992-aacd-42f2-809c-af8848182f90_xq7bcpuu Aug 03 08:38:04 devstack sudo[100542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:38:04 devstack cinder-volume[88899]: DEBUG cinder.volume.flows.manager.create_volume [None req-48095151-15c4-4344-84ac-d7c47ee43f4b tempest-VolumesActionsTest-415737388 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88899) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 08:38:04 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-48095151-15c4-4344-84ac-d7c47ee43f4b tempest-VolumesActionsTest-415737388 None] Flow 'volume_create_manager' (32bbc013-c700-4b5c-8dd0-25e87a12264e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:38:04 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-48095151-15c4-4344-84ac-d7c47ee43f4b tempest-VolumesActionsTest-415737388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca90716e-3e3c-4af3-b482-7eeb44e1a4f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:38:04 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-48095151-15c4-4344-84ac-d7c47ee43f4b tempest-VolumesActionsTest-415737388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca90716e-3e3c-4af3-b482-7eeb44e1a4f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:38:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-204099429',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7479cf61-269b-454e-8916-07e78c7098cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d2cd534485a4923b66db7805993790c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:38:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:38:04Z,use_quota=True,user_id='d9b57e0f46644b399e1a0aea198130dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8bde7129-1dc4-42ab-b852-ab32c61b4921),volume_type_id=8bde7129-1dc4-42ab-b852-ab32c61b4921)' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:38:04 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-48095151-15c4-4344-84ac-d7c47ee43f4b tempest-VolumesActionsTest-415737388 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34886cfc-8830-44c5-bbd6-b83e5a9d4450) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:38:04 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-48095151-15c4-4344-84ac-d7c47ee43f4b tempest-VolumesActionsTest-415737388 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34886cfc-8830-44c5-bbd6-b83e5a9d4450) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:38:04 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-48095151-15c4-4344-84ac-d7c47ee43f4b tempest-VolumesActionsTest-415737388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d124342-3f5b-4549-ba35-d5170e12a991) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:38:04 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-48095151-15c4-4344-84ac-d7c47ee43f4b tempest-VolumesActionsTest-415737388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d124342-3f5b-4549-ba35-d5170e12a991) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7479cf61-269b-454e-8916-07e78c7098cc', 'volume_name': 'volume-7479cf61-269b-454e-8916-07e78c7098cc', 'volume_size': 1}' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:38:04 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-48095151-15c4-4344-84ac-d7c47ee43f4b tempest-VolumesActionsTest-415737388 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (521ee7ce-1d31-41f0-ba34-bdf353d5185d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:38:04 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-48095151-15c4-4344-84ac-d7c47ee43f4b tempest-VolumesActionsTest-415737388 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (521ee7ce-1d31-41f0-ba34-bdf353d5185d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:38:04 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-48095151-15c4-4344-84ac-d7c47ee43f4b tempest-VolumesActionsTest-415737388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (781837ef-30d8-43a5-a146-c13b5e89fc4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:38:04 devstack cinder-volume[88899]: INFO cinder.volume.flows.manager.create_volume [None req-48095151-15c4-4344-84ac-d7c47ee43f4b tempest-VolumesActionsTest-415737388 None] Volume 7479cf61-269b-454e-8916-07e78c7098cc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7479cf61-269b-454e-8916-07e78c7098cc', 'volume_size': 1} Aug 03 08:38:04 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-48095151-15c4-4344-84ac-d7c47ee43f4b tempest-VolumesActionsTest-415737388 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:38:04 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-531971bf-6d51-4450-aa3b-ae7f8e995023 tempest-VolumesDeleteCascade-2092426887 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:38:04 devstack sudo[100542]: pam_unix(sudo:session): session closed for user root Aug 03 08:38:04 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-641fcfee-6fd9-4ecc-b785-26f18bda3708 tempest-VolumeAndVolumeTypeFromImageTest-1807227024 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_517ce992-aacd-42f2-809c-af8848182f90_xq7bcpuu" returned: 0 in 0.384s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:38:04 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-641fcfee-6fd9-4ecc-b785-26f18bda3708 tempest-VolumeAndVolumeTypeFromImageTest-1807227024 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_517ce992-aacd-42f2-809c-af8848182f90_xq7bcpuu {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:38:04 devstack sudo[100540]: pam_unix(sudo:session): session closed for user root Aug 03 08:38:04 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-88d90f63-90fc-4a75-8c1f-e288284eb731 tempest-ServersNegativeTestJSON-899715745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-5f087f98-037e-40a5-a74c-630590557535 1073741824" returned: 0 in 0.570s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:38:04 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-88d90f63-90fc-4a75-8c1f-e288284eb731 tempest-ServersNegativeTestJSON-899715745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-5f087f98-037e-40a5-a74c-630590557535 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:38:04 devstack sudo[100550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-5f087f98-037e-40a5-a74c-630590557535 Aug 03 08:38:04 devstack sudo[100550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:38:04 devstack sudo[100549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_517ce992-aacd-42f2-809c-af8848182f90_xq7bcpuu Aug 03 08:38:04 devstack sudo[100549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:38:04 devstack sudo[100549]: pam_unix(sudo:session): session closed for user root Aug 03 08:38:04 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-641fcfee-6fd9-4ecc-b785-26f18bda3708 tempest-VolumeAndVolumeTypeFromImageTest-1807227024 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_517ce992-aacd-42f2-809c-af8848182f90_xq7bcpuu" returned: 1 in 0.336s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:38:04 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-641fcfee-6fd9-4ecc-b785-26f18bda3708 tempest-VolumeAndVolumeTypeFromImageTest-1807227024 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_517ce992-aacd-42f2-809c-af8848182f90_xq7bcpuu' failed. Not Retrying. {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 03 08:38:04 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[6249450a-3e30-48d1-90c7-b92b80705c06]: (4, 'raw') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:38:04 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-641fcfee-6fd9-4ecc-b785-26f18bda3708 tempest-VolumeAndVolumeTypeFromImageTest-1807227024 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_517ce992-aacd-42f2-809c-af8848182f90_2lxhk0k5devstack@QuobyteHD {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:38:04 devstack sudo[100550]: pam_unix(sudo:session): session closed for user root Aug 03 08:38:04 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-88d90f63-90fc-4a75-8c1f-e288284eb731 tempest-ServersNegativeTestJSON-899715745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-5f087f98-037e-40a5-a74c-630590557535" returned: 0 in 0.272s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:38:04 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-88d90f63-90fc-4a75-8c1f-e288284eb731 tempest-ServersNegativeTestJSON-899715745 None] <== create_volume: return (901ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'} {{(pid=88899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 08:38:04 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-88d90f63-90fc-4a75-8c1f-e288284eb731 tempest-ServersNegativeTestJSON-899715745 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.904s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:38:04 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-48095151-15c4-4344-84ac-d7c47ee43f4b tempest-VolumesActionsTest-415737388 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.512s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:38:04 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-48095151-15c4-4344-84ac-d7c47ee43f4b tempest-VolumesActionsTest-415737388 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:38:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-204099429',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7479cf61-269b-454e-8916-07e78c7098cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d2cd534485a4923b66db7805993790c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:38:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:38:04Z,use_quota=True,user_id='d9b57e0f46644b399e1a0aea198130dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8bde7129-1dc4-42ab-b852-ab32c61b4921),volume_type_id=8bde7129-1dc4-42ab-b852-ab32c61b4921)}" {{(pid=88899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 08:38:04 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-48095151-15c4-4344-84ac-d7c47ee43f4b tempest-VolumesActionsTest-415737388 None] Creating volume 7479cf61-269b-454e-8916-07e78c7098cc {{(pid=88899) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 08:38:04 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-48095151-15c4-4344-84ac-d7c47ee43f4b tempest-VolumesActionsTest-415737388 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:38:04 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-48095151-15c4-4344-84ac-d7c47ee43f4b tempest-VolumesActionsTest-415737388 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:38:04 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-48095151-15c4-4344-84ac-d7c47ee43f4b tempest-VolumesActionsTest-415737388 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:38:04 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-48095151-15c4-4344-84ac-d7c47ee43f4b tempest-VolumesActionsTest-415737388 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:38:04 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-48095151-15c4-4344-84ac-d7c47ee43f4b tempest-VolumesActionsTest-415737388 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:38:04 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-48095151-15c4-4344-84ac-d7c47ee43f4b tempest-VolumesActionsTest-415737388 None] Selected osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385 as target Quobyte volume. {{(pid=88899) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 08:38:04 devstack cinder-volume[88899]: INFO cinder.volume.drivers.remotefs [None req-48095151-15c4-4344-84ac-d7c47ee43f4b tempest-VolumesActionsTest-415737388 None] casted to osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385 Aug 03 08:38:04 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-48095151-15c4-4344-84ac-d7c47ee43f4b tempest-VolumesActionsTest-415737388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-7479cf61-269b-454e-8916-07e78c7098cc 1073741824 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:38:04 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-88d90f63-90fc-4a75-8c1f-e288284eb731 tempest-ServersNegativeTestJSON-899715745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f93b84f2-f7b6-435f-b27d-9677a4d7a99a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5f087f98-037e-40a5-a74c-630590557535', 'volume_size': 1}' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:38:04 devstack sudo[100557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-7479cf61-269b-454e-8916-07e78c7098cc 1073741824 Aug 03 08:38:04 devstack sudo[100557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:38:04 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-88d90f63-90fc-4a75-8c1f-e288284eb731 tempest-ServersNegativeTestJSON-899715745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58d727a8-7961-4e4d-adb8-14fb2e7b46cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:38:04 devstack cinder-volume[88899]: INFO cinder.volume.flows.manager.create_volume [None req-88d90f63-90fc-4a75-8c1f-e288284eb731 tempest-ServersNegativeTestJSON-899715745 None] Volume volume-5f087f98-037e-40a5-a74c-630590557535 (5f087f98-037e-40a5-a74c-630590557535): created successfully Aug 03 08:38:04 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-88d90f63-90fc-4a75-8c1f-e288284eb731 tempest-ServersNegativeTestJSON-899715745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58d727a8-7961-4e4d-adb8-14fb2e7b46cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:38:04 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-88d90f63-90fc-4a75-8c1f-e288284eb731 tempest-ServersNegativeTestJSON-899715745 None] Flow 'volume_create_manager' (aa1ad4fc-e79d-4e3b-9673-1774518d8663) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:38:04 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-88d90f63-90fc-4a75-8c1f-e288284eb731 tempest-ServersNegativeTestJSON-899715745 None] Created volume successfully. Aug 03 08:38:04 devstack sudo[100556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_517ce992-aacd-42f2-809c-af8848182f90_2lxhk0k5devstack@QuobyteHD Aug 03 08:38:04 devstack sudo[100556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:38:04 devstack sudo[100556]: pam_unix(sudo:session): session closed for user root Aug 03 08:38:04 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-641fcfee-6fd9-4ecc-b785-26f18bda3708 tempest-VolumeAndVolumeTypeFromImageTest-1807227024 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_517ce992-aacd-42f2-809c-af8848182f90_2lxhk0k5devstack@QuobyteHD" returned: 0 in 0.340s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:38:04 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-641fcfee-6fd9-4ecc-b785-26f18bda3708 tempest-VolumeAndVolumeTypeFromImageTest-1807227024 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_517ce992-aacd-42f2-809c-af8848182f90_2lxhk0k5devstack@QuobyteHD {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:38:05 devstack sudo[100566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_517ce992-aacd-42f2-809c-af8848182f90_2lxhk0k5devstack@QuobyteHD Aug 03 08:38:05 devstack sudo[100566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:38:05 devstack sudo[100557]: pam_unix(sudo:session): session closed for user root Aug 03 08:38:05 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-48095151-15c4-4344-84ac-d7c47ee43f4b tempest-VolumesActionsTest-415737388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-7479cf61-269b-454e-8916-07e78c7098cc 1073741824" returned: 0 in 0.505s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:38:05 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-48095151-15c4-4344-84ac-d7c47ee43f4b tempest-VolumesActionsTest-415737388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-7479cf61-269b-454e-8916-07e78c7098cc {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:38:05 devstack sudo[100569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-7479cf61-269b-454e-8916-07e78c7098cc Aug 03 08:38:05 devstack sudo[100569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:38:05 devstack sudo[100566]: pam_unix(sudo:session): session closed for user root Aug 03 08:38:05 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-641fcfee-6fd9-4ecc-b785-26f18bda3708 tempest-VolumeAndVolumeTypeFromImageTest-1807227024 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_517ce992-aacd-42f2-809c-af8848182f90_2lxhk0k5devstack@QuobyteHD" returned: 1 in 0.361s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:38:05 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-641fcfee-6fd9-4ecc-b785-26f18bda3708 tempest-VolumeAndVolumeTypeFromImageTest-1807227024 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_517ce992-aacd-42f2-809c-af8848182f90_2lxhk0k5devstack@QuobyteHD' failed. Not Retrying. {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 03 08:38:05 devstack cinder-volume[88899]: DEBUG cinder.image.image_utils [None req-641fcfee-6fd9-4ecc-b785-26f18bda3708 tempest-VolumeAndVolumeTypeFromImageTest-1807227024 None] 517ce992-aacd-42f2-809c-af8848182f90 was raw, converting to qcow2 {{(pid=88899) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Aug 03 08:38:05 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-641fcfee-6fd9-4ecc-b785-26f18bda3708 tempest-VolumeAndVolumeTypeFromImageTest-1807227024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_517ce992-aacd-42f2-809c-af8848182f90_2lxhk0k5devstack@QuobyteHD /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-8bb0d1cc-636f-43c0-83ba-f9522b5aa1dd {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:38:05 devstack sudo[100574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_517ce992-aacd-42f2-809c-af8848182f90_2lxhk0k5devstack@QuobyteHD /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-8bb0d1cc-636f-43c0-83ba-f9522b5aa1dd Aug 03 08:38:05 devstack sudo[100574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:38:05 devstack sudo[100569]: pam_unix(sudo:session): session closed for user root Aug 03 08:38:05 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-48095151-15c4-4344-84ac-d7c47ee43f4b tempest-VolumesActionsTest-415737388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-7479cf61-269b-454e-8916-07e78c7098cc" returned: 0 in 0.282s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:38:05 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-48095151-15c4-4344-84ac-d7c47ee43f4b tempest-VolumesActionsTest-415737388 None] <== create_volume: return (845ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'} {{(pid=88899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 08:38:05 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-48095151-15c4-4344-84ac-d7c47ee43f4b tempest-VolumesActionsTest-415737388 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.849s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:38:05 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-531971bf-6d51-4450-aa3b-ae7f8e995023 tempest-VolumesDeleteCascade-2092426887 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.366s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:38:05 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-48095151-15c4-4344-84ac-d7c47ee43f4b tempest-VolumesActionsTest-415737388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (781837ef-30d8-43a5-a146-c13b5e89fc4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7479cf61-269b-454e-8916-07e78c7098cc', 'volume_size': 1}' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:38:05 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-48095151-15c4-4344-84ac-d7c47ee43f4b tempest-VolumesActionsTest-415737388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea240548-3055-409f-9590-cef20c4b69eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:38:05 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-531971bf-6d51-4450-aa3b-ae7f8e995023 tempest-VolumesDeleteCascade-2092426887 None] Creating offline snapshot d747ca05-c4b4-4936-9ddb-29ca1988411b of volume 53c7271f-46db-4a1b-91f6-3a358ce1c149 {{(pid=88899) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 03 08:38:05 devstack cinder-volume[88899]: INFO cinder.volume.flows.manager.create_volume [None req-48095151-15c4-4344-84ac-d7c47ee43f4b tempest-VolumesActionsTest-415737388 None] Volume volume-7479cf61-269b-454e-8916-07e78c7098cc (7479cf61-269b-454e-8916-07e78c7098cc): created successfully Aug 03 08:38:05 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-48095151-15c4-4344-84ac-d7c47ee43f4b tempest-VolumesActionsTest-415737388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea240548-3055-409f-9590-cef20c4b69eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:38:05 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-48095151-15c4-4344-84ac-d7c47ee43f4b tempest-VolumesActionsTest-415737388 None] Flow 'volume_create_manager' (32bbc013-c700-4b5c-8dd0-25e87a12264e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:38:05 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[51c137a5-d4f4-4bfd-922f-c4563a31c7a9]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:38:05 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-531971bf-6d51-4450-aa3b-ae7f8e995023 tempest-VolumesDeleteCascade-2092426887 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-53c7271f-46db-4a1b-91f6-3a358ce1c149 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:38:05 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-48095151-15c4-4344-84ac-d7c47ee43f4b tempest-VolumesActionsTest-415737388 None] Created volume successfully. Aug 03 08:38:05 devstack sudo[100577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-53c7271f-46db-4a1b-91f6-3a358ce1c149 Aug 03 08:38:05 devstack sudo[100577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:38:05 devstack sudo[100574]: pam_unix(sudo:session): session closed for user root Aug 03 08:38:05 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-641fcfee-6fd9-4ecc-b785-26f18bda3708 tempest-VolumeAndVolumeTypeFromImageTest-1807227024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_517ce992-aacd-42f2-809c-af8848182f90_2lxhk0k5devstack@QuobyteHD /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-8bb0d1cc-636f-43c0-83ba-f9522b5aa1dd" returned: 0 in 0.522s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:38:05 devstack cinder-volume[88899]: DEBUG cinder.image.image_utils [None req-641fcfee-6fd9-4ecc-b785-26f18bda3708 tempest-VolumeAndVolumeTypeFromImageTest-1807227024 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_517ce992-aacd-42f2-809c-af8848182f90_2lxhk0k5devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-8bb0d1cc-636f-43c0-83ba-f9522b5aa1dd {{(pid=88899) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 03 08:38:05 devstack cinder-volume[88899]: INFO cinder.image.image_utils [None req-641fcfee-6fd9-4ecc-b785-26f18bda3708 tempest-VolumeAndVolumeTypeFromImageTest-1807227024 None] Converted 0.00 MB image at 0.00 MB/s Aug 03 08:38:05 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-641fcfee-6fd9-4ecc-b785-26f18bda3708 tempest-VolumeAndVolumeTypeFromImageTest-1807227024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-8bb0d1cc-636f-43c0-83ba-f9522b5aa1dd 1G {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:38:05 devstack sudo[100582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-8bb0d1cc-636f-43c0-83ba-f9522b5aa1dd 1G Aug 03 08:38:05 devstack sudo[100582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:38:05 devstack sudo[100577]: pam_unix(sudo:session): session closed for user root Aug 03 08:38:05 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-531971bf-6d51-4450-aa3b-ae7f8e995023 tempest-VolumesDeleteCascade-2092426887 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-53c7271f-46db-4a1b-91f6-3a358ce1c149" returned: 0 in 0.447s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:38:05 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-531971bf-6d51-4450-aa3b-ae7f8e995023 tempest-VolumesDeleteCascade-2092426887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-53c7271f-46db-4a1b-91f6-3a358ce1c149,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-53c7271f-46db-4a1b-91f6-3a358ce1c149.d747ca05-c4b4-4936-9ddb-29ca1988411b 1G {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:38:05 devstack sudo[100587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-53c7271f-46db-4a1b-91f6-3a358ce1c149,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-53c7271f-46db-4a1b-91f6-3a358ce1c149.d747ca05-c4b4-4936-9ddb-29ca1988411b 1G Aug 03 08:38:06 devstack sudo[100587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:38:06 devstack sudo[100582]: pam_unix(sudo:session): session closed for user root Aug 03 08:38:06 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-641fcfee-6fd9-4ecc-b785-26f18bda3708 tempest-VolumeAndVolumeTypeFromImageTest-1807227024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-8bb0d1cc-636f-43c0-83ba-f9522b5aa1dd 1G" returned: 0 in 0.393s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:38:06 devstack cinder-volume[88899]: DEBUG cinder.volume.volume_utils [None req-641fcfee-6fd9-4ecc-b785-26f18bda3708 tempest-VolumeAndVolumeTypeFromImageTest-1807227024 None] Downloaded image 517ce992-aacd-42f2-809c-af8848182f90 ((None, [{'url': 'file:///opt/stack/data/glance/images/517ce992-aacd-42f2-809c-af8848182f90', 'metadata': {}}])) to volume 8bb0d1cc-636f-43c0-83ba-f9522b5aa1dd successfully. {{(pid=88899) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Aug 03 08:38:06 devstack cinder-volume[88899]: DEBUG cinder.image.image_utils [None req-641fcfee-6fd9-4ecc-b785-26f18bda3708 tempest-VolumeAndVolumeTypeFromImageTest-1807227024 None] Temporary image 517ce992-aacd-42f2-809c-af8848182f90 for user ee0e225c8fd0462d84f1dacb81c5a011 is deleted. {{(pid=88899) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Aug 03 08:38:06 devstack cinder-volume[88899]: DEBUG cinder.volume.volume_utils [None req-641fcfee-6fd9-4ecc-b785-26f18bda3708 tempest-VolumeAndVolumeTypeFromImageTest-1807227024 None] Marking volume 8bb0d1cc-636f-43c0-83ba-f9522b5aa1dd as bootable. {{(pid=88899) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Aug 03 08:38:06 devstack cinder-volume[88899]: DEBUG cinder.volume.flows.manager.create_volume [None req-641fcfee-6fd9-4ecc-b785-26f18bda3708 tempest-VolumeAndVolumeTypeFromImageTest-1807227024 None] Copying metadata from image 517ce992-aacd-42f2-809c-af8848182f90 to 8bb0d1cc-636f-43c0-83ba-f9522b5aa1dd. {{(pid=88899) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Aug 03 08:38:06 devstack cinder-volume[88899]: DEBUG cinder.volume.flows.manager.create_volume [None req-641fcfee-6fd9-4ecc-b785-26f18bda3708 tempest-VolumeAndVolumeTypeFromImageTest-1807227024 None] Creating volume glance metadata for volume 8bb0d1cc-636f-43c0-83ba-f9522b5aa1dd backed by image 517ce992-aacd-42f2-809c-af8848182f90 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '517ce992-aacd-42f2-809c-af8848182f90', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '35df2b1ebee246bfb2900cbbf0032368', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=88899) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Aug 03 08:38:06 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-641fcfee-6fd9-4ecc-b785-26f18bda3708 tempest-VolumeAndVolumeTypeFromImageTest-1807227024 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e10fade9-b782-4b48-a0c1-6857c25af795) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8bb0d1cc-636f-43c0-83ba-f9522b5aa1dd', 'volume_size': 1, 'image_id': '517ce992-aacd-42f2-809c-af8848182f90', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/517ce992-aacd-42f2-809c-af8848182f90', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '35df2b1ebee246bfb2900cbbf0032368', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'fcb29d4282ae467a956bc71674ff5386', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'ecc38225f65ccd739a342895e0aadf4b95d7d9f706388eac78c77cd62ae19b9e2bd47639e1fb1fe00bd0989cf1f28c0e1e3a50b221e6cd78e6750a722691a8e1', 'id': '517ce992-aacd-42f2-809c-af8848182f90', 'created_at': datetime.datetime(2026, 8, 3, 6, 37, 55, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 3, 6, 37, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/517ce992-aacd-42f2-809c-af8848182f90/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:38:06 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-641fcfee-6fd9-4ecc-b785-26f18bda3708 tempest-VolumeAndVolumeTypeFromImageTest-1807227024 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86951c44-b63e-4f4e-845c-9d3d1965bc91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:38:06 devstack cinder-volume[88899]: INFO cinder.volume.flows.manager.create_volume [None req-641fcfee-6fd9-4ecc-b785-26f18bda3708 tempest-VolumeAndVolumeTypeFromImageTest-1807227024 None] Volume volume-8bb0d1cc-636f-43c0-83ba-f9522b5aa1dd (8bb0d1cc-636f-43c0-83ba-f9522b5aa1dd): created successfully Aug 03 08:38:06 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-641fcfee-6fd9-4ecc-b785-26f18bda3708 tempest-VolumeAndVolumeTypeFromImageTest-1807227024 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86951c44-b63e-4f4e-845c-9d3d1965bc91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:38:06 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-641fcfee-6fd9-4ecc-b785-26f18bda3708 tempest-VolumeAndVolumeTypeFromImageTest-1807227024 None] Flow 'volume_create_manager' (c285192a-592f-4478-b16d-aa43b2994b3f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:38:06 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-641fcfee-6fd9-4ecc-b785-26f18bda3708 tempest-VolumeAndVolumeTypeFromImageTest-1807227024 None] Created volume successfully. Aug 03 08:38:06 devstack sudo[100587]: pam_unix(sudo:session): session closed for user root Aug 03 08:38:06 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-531971bf-6d51-4450-aa3b-ae7f8e995023 tempest-VolumesDeleteCascade-2092426887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-53c7271f-46db-4a1b-91f6-3a358ce1c149,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-53c7271f-46db-4a1b-91f6-3a358ce1c149.d747ca05-c4b4-4936-9ddb-29ca1988411b 1G" returned: 0 in 0.644s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:38:06 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-531971bf-6d51-4450-aa3b-ae7f8e995023 tempest-VolumesDeleteCascade-2092426887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-53c7271f-46db-4a1b-91f6-3a358ce1c149 -F qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-53c7271f-46db-4a1b-91f6-3a358ce1c149.d747ca05-c4b4-4936-9ddb-29ca1988411b {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:38:06 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-8c869a19-bafc-40fd-9a13-6ef4afaa0b8e tempest-VolumeAndVolumeTypeFromImageTest-1807227024 None] Acquiring lock "cinder-8bb0d1cc-636f-43c0-83ba-f9522b5aa1dd-delete_volume" by "delete_volume" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:38:06 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-8c869a19-bafc-40fd-9a13-6ef4afaa0b8e tempest-VolumeAndVolumeTypeFromImageTest-1807227024 None] Lock "cinder-8bb0d1cc-636f-43c0-83ba-f9522b5aa1dd-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:38:06 devstack sudo[100596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-53c7271f-46db-4a1b-91f6-3a358ce1c149 -F qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-53c7271f-46db-4a1b-91f6-3a358ce1c149.d747ca05-c4b4-4936-9ddb-29ca1988411b Aug 03 08:38:06 devstack sudo[100596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:38:06 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-8c869a19-bafc-40fd-9a13-6ef4afaa0b8e tempest-VolumeAndVolumeTypeFromImageTest-1807227024 None] Acquiring lock "cinder-quobyte-8bb0d1cc-636f-43c0-83ba-f9522b5aa1dd" by "delete_volume" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:38:06 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-8c869a19-bafc-40fd-9a13-6ef4afaa0b8e tempest-VolumeAndVolumeTypeFromImageTest-1807227024 None] Lock "cinder-quobyte-8bb0d1cc-636f-43c0-83ba-f9522b5aa1dd" acquired by "delete_volume" :: waited 0.027s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:38:06 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[a427c96a-d0c3-40d3-b87e-ce56fd122ca2]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:38:06 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-8c869a19-bafc-40fd-9a13-6ef4afaa0b8e tempest-VolumeAndVolumeTypeFromImageTest-1807227024 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-8bb0d1cc-636f-43c0-83ba-f9522b5aa1dd {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:38:06 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-b725deb4-814a-4006-b679-0ff0c0769362 tempest-VolumesActionsTest-415737388 None] Acquiring lock "cinder-7479cf61-269b-454e-8916-07e78c7098cc-delete_volume" by "delete_volume" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:38:06 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-b725deb4-814a-4006-b679-0ff0c0769362 tempest-VolumesActionsTest-415737388 None] Lock "cinder-7479cf61-269b-454e-8916-07e78c7098cc-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:38:06 devstack sudo[100598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-8bb0d1cc-636f-43c0-83ba-f9522b5aa1dd Aug 03 08:38:06 devstack sudo[100598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:38:06 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-b725deb4-814a-4006-b679-0ff0c0769362 tempest-VolumesActionsTest-415737388 None] Acquiring lock "cinder-quobyte-7479cf61-269b-454e-8916-07e78c7098cc" by "delete_volume" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:38:07 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-b725deb4-814a-4006-b679-0ff0c0769362 tempest-VolumesActionsTest-415737388 None] Lock "cinder-quobyte-7479cf61-269b-454e-8916-07e78c7098cc" acquired by "delete_volume" :: waited 0.020s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:38:07 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c513c83-0d6b-4fb3-bd8f-9e27cb5762a6]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:38:07 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-b725deb4-814a-4006-b679-0ff0c0769362 tempest-VolumesActionsTest-415737388 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-7479cf61-269b-454e-8916-07e78c7098cc {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:38:07 devstack sudo[100596]: pam_unix(sudo:session): session closed for user root Aug 03 08:38:07 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-531971bf-6d51-4450-aa3b-ae7f8e995023 tempest-VolumesDeleteCascade-2092426887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-53c7271f-46db-4a1b-91f6-3a358ce1c149 -F qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-53c7271f-46db-4a1b-91f6-3a358ce1c149.d747ca05-c4b4-4936-9ddb-29ca1988411b" returned: 0 in 0.455s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:38:07 devstack cinder-volume[88899]: WARNING cinder.volume.drivers.remotefs [None req-531971bf-6d51-4450-aa3b-ae7f8e995023 tempest-VolumesDeleteCascade-2092426887 None] /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-53c7271f-46db-4a1b-91f6-3a358ce1c149.d747ca05-c4b4-4936-9ddb-29ca1988411b is being set with open permissions: ugo+rw Aug 03 08:38:07 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-531971bf-6d51-4450-aa3b-ae7f8e995023 tempest-VolumesDeleteCascade-2092426887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-53c7271f-46db-4a1b-91f6-3a358ce1c149.d747ca05-c4b4-4936-9ddb-29ca1988411b {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:38:07 devstack sudo[100604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-53c7271f-46db-4a1b-91f6-3a358ce1c149.d747ca05-c4b4-4936-9ddb-29ca1988411b Aug 03 08:38:07 devstack sudo[100604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:38:07 devstack sudo[100603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-7479cf61-269b-454e-8916-07e78c7098cc Aug 03 08:38:07 devstack sudo[100603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:38:07 devstack sudo[100598]: pam_unix(sudo:session): session closed for user root Aug 03 08:38:07 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-8c869a19-bafc-40fd-9a13-6ef4afaa0b8e tempest-VolumeAndVolumeTypeFromImageTest-1807227024 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-8bb0d1cc-636f-43c0-83ba-f9522b5aa1dd" returned: 0 in 0.584s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:38:07 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-8c869a19-bafc-40fd-9a13-6ef4afaa0b8e tempest-VolumeAndVolumeTypeFromImageTest-1807227024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-8bb0d1cc-636f-43c0-83ba-f9522b5aa1dd {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:38:07 devstack sudo[100604]: pam_unix(sudo:session): session closed for user root Aug 03 08:38:07 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-531971bf-6d51-4450-aa3b-ae7f8e995023 tempest-VolumesDeleteCascade-2092426887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-53c7271f-46db-4a1b-91f6-3a358ce1c149.d747ca05-c4b4-4936-9ddb-29ca1988411b" returned: 0 in 0.323s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:38:07 devstack sudo[100614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-8bb0d1cc-636f-43c0-83ba-f9522b5aa1dd Aug 03 08:38:07 devstack sudo[100614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:38:07 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-531971bf-6d51-4450-aa3b-ae7f8e995023 tempest-VolumesDeleteCascade-2092426887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-53c7271f-46db-4a1b-91f6-3a358ce1c149.info {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:38:07 devstack sudo[100617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-53c7271f-46db-4a1b-91f6-3a358ce1c149.info Aug 03 08:38:07 devstack sudo[100617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:38:07 devstack sudo[100603]: pam_unix(sudo:session): session closed for user root Aug 03 08:38:07 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-b725deb4-814a-4006-b679-0ff0c0769362 tempest-VolumesActionsTest-415737388 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-7479cf61-269b-454e-8916-07e78c7098cc" returned: 0 in 0.468s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:38:07 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-b725deb4-814a-4006-b679-0ff0c0769362 tempest-VolumesActionsTest-415737388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-7479cf61-269b-454e-8916-07e78c7098cc {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:38:07 devstack sudo[100619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-7479cf61-269b-454e-8916-07e78c7098cc Aug 03 08:38:07 devstack sudo[100619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:38:07 devstack cinder-volume[88899]: DEBUG cinder.volume.flows.manager.create_volume [None req-30946a1a-d7be-4ca4-a3bb-c18442fee929 tempest-ServersNegativeTestJSON-899715745 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88899) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 08:38:07 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-30946a1a-d7be-4ca4-a3bb-c18442fee929 tempest-ServersNegativeTestJSON-899715745 None] Flow 'volume_create_manager' (0af4ddce-ec18-42c0-a4fa-2cc8f3055f1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:38:07 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-30946a1a-d7be-4ca4-a3bb-c18442fee929 tempest-ServersNegativeTestJSON-899715745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a537605-c783-4d36-b453-06c4e4681784) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:38:07 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-30946a1a-d7be-4ca4-a3bb-c18442fee929 tempest-ServersNegativeTestJSON-899715745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a537605-c783-4d36-b453-06c4e4681784) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:38:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1487340059',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5605f93a-c3aa-40ed-ad85-c05bfb8d1484,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6040725d47f6436e8c8048e98cdc9e5b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:38:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:38:08Z,use_quota=True,user_id='e10b03dd6cc643b3a7ba973170ffe4cd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8bde7129-1dc4-42ab-b852-ab32c61b4921),volume_type_id=8bde7129-1dc4-42ab-b852-ab32c61b4921)' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:38:07 devstack sudo[100614]: pam_unix(sudo:session): session closed for user root Aug 03 08:38:07 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-30946a1a-d7be-4ca4-a3bb-c18442fee929 tempest-ServersNegativeTestJSON-899715745 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3247fbf9-cdfc-4372-99e1-7e6a32f17807) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:38:07 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-30946a1a-d7be-4ca4-a3bb-c18442fee929 tempest-ServersNegativeTestJSON-899715745 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3247fbf9-cdfc-4372-99e1-7e6a32f17807) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:38:07 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-30946a1a-d7be-4ca4-a3bb-c18442fee929 tempest-ServersNegativeTestJSON-899715745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c33af648-aa03-4f2c-8cbf-dc21dad1c766) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:38:07 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-30946a1a-d7be-4ca4-a3bb-c18442fee929 tempest-ServersNegativeTestJSON-899715745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c33af648-aa03-4f2c-8cbf-dc21dad1c766) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5605f93a-c3aa-40ed-ad85-c05bfb8d1484', 'volume_name': 'volume-5605f93a-c3aa-40ed-ad85-c05bfb8d1484', 'volume_size': 1}' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:38:07 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-30946a1a-d7be-4ca4-a3bb-c18442fee929 tempest-ServersNegativeTestJSON-899715745 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4ad50e2-375d-4083-8667-3068795d7348) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:38:07 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-30946a1a-d7be-4ca4-a3bb-c18442fee929 tempest-ServersNegativeTestJSON-899715745 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4ad50e2-375d-4083-8667-3068795d7348) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:38:07 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-30946a1a-d7be-4ca4-a3bb-c18442fee929 tempest-ServersNegativeTestJSON-899715745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c653254-c956-4d1e-a87b-7e81eb9bf2c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:38:07 devstack cinder-volume[88899]: INFO cinder.volume.flows.manager.create_volume [None req-30946a1a-d7be-4ca4-a3bb-c18442fee929 tempest-ServersNegativeTestJSON-899715745 None] Volume 5605f93a-c3aa-40ed-ad85-c05bfb8d1484: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5605f93a-c3aa-40ed-ad85-c05bfb8d1484', 'volume_size': 1} Aug 03 08:38:07 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-30946a1a-d7be-4ca4-a3bb-c18442fee929 tempest-ServersNegativeTestJSON-899715745 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:38:07 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-8c869a19-bafc-40fd-9a13-6ef4afaa0b8e tempest-VolumeAndVolumeTypeFromImageTest-1807227024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-8bb0d1cc-636f-43c0-83ba-f9522b5aa1dd" returned: 0 in 0.386s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:38:07 devstack sudo[100617]: pam_unix(sudo:session): session closed for user root Aug 03 08:38:07 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-8c869a19-bafc-40fd-9a13-6ef4afaa0b8e tempest-VolumeAndVolumeTypeFromImageTest-1807227024 None] Lock "cinder-quobyte-8bb0d1cc-636f-43c0-83ba-f9522b5aa1dd" released by "delete_volume" :: held 1.031s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:38:07 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-531971bf-6d51-4450-aa3b-ae7f8e995023 tempest-VolumesDeleteCascade-2092426887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-53c7271f-46db-4a1b-91f6-3a358ce1c149.info" returned: 0 in 0.332s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:38:07 devstack cinder-volume[88899]: WARNING cinder.volume.drivers.remotefs [None req-531971bf-6d51-4450-aa3b-ae7f8e995023 tempest-VolumesDeleteCascade-2092426887 None] /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-53c7271f-46db-4a1b-91f6-3a358ce1c149.info is being set with open permissions: ugo+rw Aug 03 08:38:07 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-531971bf-6d51-4450-aa3b-ae7f8e995023 tempest-VolumesDeleteCascade-2092426887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-53c7271f-46db-4a1b-91f6-3a358ce1c149.info {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:38:07 devstack sudo[100624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-53c7271f-46db-4a1b-91f6-3a358ce1c149.info Aug 03 08:38:07 devstack sudo[100624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:38:07 devstack cinder-volume[88899]: WARNING cinder.quota [None req-8c869a19-bafc-40fd-9a13-6ef4afaa0b8e tempest-VolumeAndVolumeTypeFromImageTest-1807227024 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Aug 03 08:38:07 devstack cinder-volume[88899]: WARNING cinder.quota [None req-8c869a19-bafc-40fd-9a13-6ef4afaa0b8e tempest-VolumeAndVolumeTypeFromImageTest-1807227024 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Aug 03 08:38:07 devstack sudo[100619]: pam_unix(sudo:session): session closed for user root Aug 03 08:38:07 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-b725deb4-814a-4006-b679-0ff0c0769362 tempest-VolumesActionsTest-415737388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-7479cf61-269b-454e-8916-07e78c7098cc" returned: 0 in 0.320s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:38:07 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-b725deb4-814a-4006-b679-0ff0c0769362 tempest-VolumesActionsTest-415737388 None] Lock "cinder-quobyte-7479cf61-269b-454e-8916-07e78c7098cc" released by "delete_volume" :: held 0.849s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:38:07 devstack cinder-volume[88899]: DEBUG cinder.quota [None req-8c869a19-bafc-40fd-9a13-6ef4afaa0b8e tempest-VolumeAndVolumeTypeFromImageTest-1807227024 None] Created reservations ['7df46460-6b0f-4a70-8697-d8f0140d7d04', 'e00f4b1b-1587-4bcb-885f-c6a2e52bd2eb', 'd46e089c-e039-497b-98a1-034cd2da3d63', 'b94c805a-189b-43b8-8d75-ae645d3ba554'] {{(pid=88899) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 08:38:07 devstack cinder-volume[88899]: DEBUG cinder.quota [None req-b725deb4-814a-4006-b679-0ff0c0769362 tempest-VolumesActionsTest-415737388 None] Created reservations ['c3132d1b-f8bd-4cd1-b245-4b3a79a296ab', '6226f3f8-54a5-4e3e-8986-e24c521ad90c', 'e4287b9d-dc74-4730-83f8-bd0d035a2879', '29d91b71-05e4-4331-ac35-77c476a1ffb4'] {{(pid=88899) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 08:38:07 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-8c869a19-bafc-40fd-9a13-6ef4afaa0b8e tempest-VolumeAndVolumeTypeFromImageTest-1807227024 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:38:07 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-8c869a19-bafc-40fd-9a13-6ef4afaa0b8e tempest-VolumeAndVolumeTypeFromImageTest-1807227024 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:38:07 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-8c869a19-bafc-40fd-9a13-6ef4afaa0b8e tempest-VolumeAndVolumeTypeFromImageTest-1807227024 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:38:07 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-8c869a19-bafc-40fd-9a13-6ef4afaa0b8e tempest-VolumeAndVolumeTypeFromImageTest-1807227024 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:38:07 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-8c869a19-bafc-40fd-9a13-6ef4afaa0b8e tempest-VolumeAndVolumeTypeFromImageTest-1807227024 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:38:07 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-8c869a19-bafc-40fd-9a13-6ef4afaa0b8e tempest-VolumeAndVolumeTypeFromImageTest-1807227024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:38:07 devstack sudo[100627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a Aug 03 08:38:07 devstack sudo[100627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:38:08 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-b725deb4-814a-4006-b679-0ff0c0769362 tempest-VolumesActionsTest-415737388 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:38:08 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-b725deb4-814a-4006-b679-0ff0c0769362 tempest-VolumesActionsTest-415737388 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:38:08 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-b725deb4-814a-4006-b679-0ff0c0769362 tempest-VolumesActionsTest-415737388 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:38:08 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-b725deb4-814a-4006-b679-0ff0c0769362 tempest-VolumesActionsTest-415737388 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:38:08 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-b725deb4-814a-4006-b679-0ff0c0769362 tempest-VolumesActionsTest-415737388 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:38:08 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-b725deb4-814a-4006-b679-0ff0c0769362 tempest-VolumesActionsTest-415737388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:38:08 devstack sudo[100630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a Aug 03 08:38:08 devstack sudo[100630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:38:08 devstack sudo[100624]: pam_unix(sudo:session): session closed for user root Aug 03 08:38:08 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-531971bf-6d51-4450-aa3b-ae7f8e995023 tempest-VolumesDeleteCascade-2092426887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-53c7271f-46db-4a1b-91f6-3a358ce1c149.info" returned: 0 in 0.332s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:38:08 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-531971bf-6d51-4450-aa3b-ae7f8e995023 tempest-VolumesDeleteCascade-2092426887 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.683s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:38:08 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-30946a1a-d7be-4ca4-a3bb-c18442fee929 tempest-ServersNegativeTestJSON-899715745 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.383s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:38:08 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-30946a1a-d7be-4ca4-a3bb-c18442fee929 tempest-ServersNegativeTestJSON-899715745 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:38:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1487340059',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5605f93a-c3aa-40ed-ad85-c05bfb8d1484,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6040725d47f6436e8c8048e98cdc9e5b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:38:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:38:08Z,use_quota=True,user_id='e10b03dd6cc643b3a7ba973170ffe4cd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8bde7129-1dc4-42ab-b852-ab32c61b4921),volume_type_id=8bde7129-1dc4-42ab-b852-ab32c61b4921)}" {{(pid=88899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 08:38:08 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-30946a1a-d7be-4ca4-a3bb-c18442fee929 tempest-ServersNegativeTestJSON-899715745 None] Creating volume 5605f93a-c3aa-40ed-ad85-c05bfb8d1484 {{(pid=88899) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 08:38:08 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-30946a1a-d7be-4ca4-a3bb-c18442fee929 tempest-ServersNegativeTestJSON-899715745 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:38:08 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-30946a1a-d7be-4ca4-a3bb-c18442fee929 tempest-ServersNegativeTestJSON-899715745 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:38:08 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-30946a1a-d7be-4ca4-a3bb-c18442fee929 tempest-ServersNegativeTestJSON-899715745 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:38:08 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-30946a1a-d7be-4ca4-a3bb-c18442fee929 tempest-ServersNegativeTestJSON-899715745 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:38:08 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-30946a1a-d7be-4ca4-a3bb-c18442fee929 tempest-ServersNegativeTestJSON-899715745 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:38:08 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-30946a1a-d7be-4ca4-a3bb-c18442fee929 tempest-ServersNegativeTestJSON-899715745 None] Selected osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385 as target Quobyte volume. {{(pid=88899) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 08:38:08 devstack cinder-volume[88899]: INFO cinder.volume.drivers.remotefs [None req-30946a1a-d7be-4ca4-a3bb-c18442fee929 tempest-ServersNegativeTestJSON-899715745 None] casted to osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385 Aug 03 08:38:08 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-30946a1a-d7be-4ca4-a3bb-c18442fee929 tempest-ServersNegativeTestJSON-899715745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-5605f93a-c3aa-40ed-ad85-c05bfb8d1484 1073741824 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:38:08 devstack sudo[100632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-5605f93a-c3aa-40ed-ad85-c05bfb8d1484 1073741824 Aug 03 08:38:08 devstack sudo[100632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:38:08 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-531971bf-6d51-4450-aa3b-ae7f8e995023 tempest-VolumesDeleteCascade-2092426887 None] Create snapshot completed successfully Aug 03 08:38:08 devstack sudo[100627]: pam_unix(sudo:session): session closed for user root Aug 03 08:38:08 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-8c869a19-bafc-40fd-9a13-6ef4afaa0b8e tempest-VolumeAndVolumeTypeFromImageTest-1807227024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a" returned: 0 in 0.329s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:38:08 devstack cinder-volume[88899]: DEBUG cinder.manager [None req-8c869a19-bafc-40fd-9a13-6ef4afaa0b8e tempest-VolumeAndVolumeTypeFromImageTest-1807227024 None] Notifying Schedulers of capabilities ... {{(pid=88899) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 08:38:08 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-8c869a19-bafc-40fd-9a13-6ef4afaa0b8e tempest-VolumeAndVolumeTypeFromImageTest-1807227024 None] Deleted volume successfully. Aug 03 08:38:08 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-8c869a19-bafc-40fd-9a13-6ef4afaa0b8e tempest-VolumeAndVolumeTypeFromImageTest-1807227024 None] Lock "cinder-8bb0d1cc-636f-43c0-83ba-f9522b5aa1dd-delete_volume" released by "delete_volume" :: held 1.670s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:38:08 devstack sudo[100630]: pam_unix(sudo:session): session closed for user root Aug 03 08:38:08 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-b725deb4-814a-4006-b679-0ff0c0769362 tempest-VolumesActionsTest-415737388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a" returned: 0 in 0.294s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:38:08 devstack cinder-volume[88899]: DEBUG cinder.manager [None req-b725deb4-814a-4006-b679-0ff0c0769362 tempest-VolumesActionsTest-415737388 None] Notifying Schedulers of capabilities ... {{(pid=88899) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 08:38:08 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-b725deb4-814a-4006-b679-0ff0c0769362 tempest-VolumesActionsTest-415737388 None] Deleted volume successfully. Aug 03 08:38:08 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-b725deb4-814a-4006-b679-0ff0c0769362 tempest-VolumesActionsTest-415737388 None] Lock "cinder-7479cf61-269b-454e-8916-07e78c7098cc-delete_volume" released by "delete_volume" :: held 1.450s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:38:08 devstack sudo[100632]: pam_unix(sudo:session): session closed for user root Aug 03 08:38:08 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-30946a1a-d7be-4ca4-a3bb-c18442fee929 tempest-ServersNegativeTestJSON-899715745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-5605f93a-c3aa-40ed-ad85-c05bfb8d1484 1073741824" returned: 0 in 0.499s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:38:08 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-30946a1a-d7be-4ca4-a3bb-c18442fee929 tempest-ServersNegativeTestJSON-899715745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-5605f93a-c3aa-40ed-ad85-c05bfb8d1484 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:38:08 devstack sudo[100640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-5605f93a-c3aa-40ed-ad85-c05bfb8d1484 Aug 03 08:38:08 devstack sudo[100640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:38:09 devstack sudo[100640]: pam_unix(sudo:session): session closed for user root Aug 03 08:38:09 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-30946a1a-d7be-4ca4-a3bb-c18442fee929 tempest-ServersNegativeTestJSON-899715745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-5605f93a-c3aa-40ed-ad85-c05bfb8d1484" returned: 0 in 0.327s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:38:09 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-30946a1a-d7be-4ca4-a3bb-c18442fee929 tempest-ServersNegativeTestJSON-899715745 None] <== create_volume: return (878ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'} {{(pid=88899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 08:38:09 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-30946a1a-d7be-4ca4-a3bb-c18442fee929 tempest-ServersNegativeTestJSON-899715745 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.882s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:38:09 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-30946a1a-d7be-4ca4-a3bb-c18442fee929 tempest-ServersNegativeTestJSON-899715745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c653254-c956-4d1e-a87b-7e81eb9bf2c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5605f93a-c3aa-40ed-ad85-c05bfb8d1484', 'volume_size': 1}' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:38:09 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-30946a1a-d7be-4ca4-a3bb-c18442fee929 tempest-ServersNegativeTestJSON-899715745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf75a786-d331-4344-8705-c62a181e9c11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:38:09 devstack cinder-volume[88899]: INFO cinder.volume.flows.manager.create_volume [None req-30946a1a-d7be-4ca4-a3bb-c18442fee929 tempest-ServersNegativeTestJSON-899715745 None] Volume volume-5605f93a-c3aa-40ed-ad85-c05bfb8d1484 (5605f93a-c3aa-40ed-ad85-c05bfb8d1484): created successfully Aug 03 08:38:09 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-30946a1a-d7be-4ca4-a3bb-c18442fee929 tempest-ServersNegativeTestJSON-899715745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf75a786-d331-4344-8705-c62a181e9c11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:38:09 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-30946a1a-d7be-4ca4-a3bb-c18442fee929 tempest-ServersNegativeTestJSON-899715745 None] Flow 'volume_create_manager' (0af4ddce-ec18-42c0-a4fa-2cc8f3055f1e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:38:09 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-30946a1a-d7be-4ca4-a3bb-c18442fee929 tempest-ServersNegativeTestJSON-899715745 None] Created volume successfully. Aug 03 08:38:10 devstack cinder-volume[88899]: DEBUG cinder.volume.flows.manager.create_volume [None req-ea4a0e39-be9d-4aa4-b4fa-2f8efbcab38f tempest-VolumesDeleteCascade-2092426887 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88899) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 08:38:10 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-ea4a0e39-be9d-4aa4-b4fa-2f8efbcab38f tempest-VolumesDeleteCascade-2092426887 None] Flow 'volume_create_manager' (b40ed307-567e-4431-9873-99036ea64d2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:38:10 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-ea4a0e39-be9d-4aa4-b4fa-2f8efbcab38f tempest-VolumesDeleteCascade-2092426887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (abc68588-4312-47c8-a307-f83e0bb10b4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:38:10 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-ea4a0e39-be9d-4aa4-b4fa-2f8efbcab38f tempest-VolumesDeleteCascade-2092426887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (abc68588-4312-47c8-a307-f83e0bb10b4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:38:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-724243856',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c021d85-6d14-4b1c-bf46-fd6d505e7cfc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e6b9f3cf6e442b9bc0bbd3708562588',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:38:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=d747ca05-c4b4-4936-9ddb-29ca1988411b,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:38:10Z,use_quota=True,user_id='69472b74f0154de3bbfc7d8c30c8abb0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8bde7129-1dc4-42ab-b852-ab32c61b4921),volume_type_id=8bde7129-1dc4-42ab-b852-ab32c61b4921)' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:38:10 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-ea4a0e39-be9d-4aa4-b4fa-2f8efbcab38f tempest-VolumesDeleteCascade-2092426887 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (abf99a34-e55f-4ce8-9976-03d72ec3ece7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:38:10 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-ea4a0e39-be9d-4aa4-b4fa-2f8efbcab38f tempest-VolumesDeleteCascade-2092426887 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (abf99a34-e55f-4ce8-9976-03d72ec3ece7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:38:10 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-ea4a0e39-be9d-4aa4-b4fa-2f8efbcab38f tempest-VolumesDeleteCascade-2092426887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7603504b-f8b1-4a2c-b7d8-48b0f64827d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:38:10 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-ea4a0e39-be9d-4aa4-b4fa-2f8efbcab38f tempest-VolumesDeleteCascade-2092426887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7603504b-f8b1-4a2c-b7d8-48b0f64827d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '6c021d85-6d14-4b1c-bf46-fd6d505e7cfc', 'volume_name': 'volume-6c021d85-6d14-4b1c-bf46-fd6d505e7cfc', 'volume_size': 1, 'snapshot_id': 'd747ca05-c4b4-4936-9ddb-29ca1988411b'}' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:38:10 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-ea4a0e39-be9d-4aa4-b4fa-2f8efbcab38f tempest-VolumesDeleteCascade-2092426887 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d10199f-afdc-4f67-9d49-36b108f2859c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:38:10 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-ea4a0e39-be9d-4aa4-b4fa-2f8efbcab38f tempest-VolumesDeleteCascade-2092426887 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d10199f-afdc-4f67-9d49-36b108f2859c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:38:10 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-ea4a0e39-be9d-4aa4-b4fa-2f8efbcab38f tempest-VolumesDeleteCascade-2092426887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e06ade3d-824f-49e4-91a3-425ab70441b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:38:10 devstack cinder-volume[88899]: INFO cinder.volume.flows.manager.create_volume [None req-ea4a0e39-be9d-4aa4-b4fa-2f8efbcab38f tempest-VolumesDeleteCascade-2092426887 None] Volume 6c021d85-6d14-4b1c-bf46-fd6d505e7cfc: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-6c021d85-6d14-4b1c-bf46-fd6d505e7cfc', 'volume_size': 1, 'snapshot_id': 'd747ca05-c4b4-4936-9ddb-29ca1988411b'} Aug 03 08:38:10 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-ea4a0e39-be9d-4aa4-b4fa-2f8efbcab38f tempest-VolumesDeleteCascade-2092426887 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:38:10 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-ea4a0e39-be9d-4aa4-b4fa-2f8efbcab38f tempest-VolumesDeleteCascade-2092426887 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:38:10 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-ea4a0e39-be9d-4aa4-b4fa-2f8efbcab38f tempest-VolumesDeleteCascade-2092426887 None] Acquiring lock "cinder-quobyte-d747ca05-c4b4-4936-9ddb-29ca1988411b-6c021d85-6d14-4b1c-bf46-fd6d505e7cfc" by "_create_volume_from_snapshot" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:38:10 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-ea4a0e39-be9d-4aa4-b4fa-2f8efbcab38f tempest-VolumesDeleteCascade-2092426887 None] Lock "cinder-quobyte-d747ca05-c4b4-4936-9ddb-29ca1988411b-6c021d85-6d14-4b1c-bf46-fd6d505e7cfc" acquired by "_create_volume_from_snapshot" :: waited 0.026s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:38:10 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-ea4a0e39-be9d-4aa4-b4fa-2f8efbcab38f tempest-VolumesDeleteCascade-2092426887 None] Creating volume 6c021d85-6d14-4b1c-bf46-fd6d505e7cfc from snapshot d747ca05-c4b4-4936-9ddb-29ca1988411b {{(pid=88899) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Aug 03 08:38:10 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-ea4a0e39-be9d-4aa4-b4fa-2f8efbcab38f tempest-VolumesDeleteCascade-2092426887 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:38:10 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-ea4a0e39-be9d-4aa4-b4fa-2f8efbcab38f tempest-VolumesDeleteCascade-2092426887 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:38:10 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-ea4a0e39-be9d-4aa4-b4fa-2f8efbcab38f tempest-VolumesDeleteCascade-2092426887 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:38:10 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-ea4a0e39-be9d-4aa4-b4fa-2f8efbcab38f tempest-VolumesDeleteCascade-2092426887 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:38:10 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-ea4a0e39-be9d-4aa4-b4fa-2f8efbcab38f tempest-VolumesDeleteCascade-2092426887 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:38:10 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-ea4a0e39-be9d-4aa4-b4fa-2f8efbcab38f tempest-VolumesDeleteCascade-2092426887 None] Selected osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385 as target Quobyte volume. {{(pid=88899) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 08:38:10 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-ea4a0e39-be9d-4aa4-b4fa-2f8efbcab38f tempest-VolumesDeleteCascade-2092426887 None] Acquiring lock "cinder-quobyte-6c021d85-6d14-4b1c-bf46-fd6d505e7cfc" by "_copy_volume_from_snapshot" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:38:10 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-ea4a0e39-be9d-4aa4-b4fa-2f8efbcab38f tempest-VolumesDeleteCascade-2092426887 None] Lock "cinder-quobyte-6c021d85-6d14-4b1c-bf46-fd6d505e7cfc" acquired by "_copy_volume_from_snapshot" :: waited 0.016s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:38:10 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-ea4a0e39-be9d-4aa4-b4fa-2f8efbcab38f tempest-VolumesDeleteCascade-2092426887 None] snapshot: d747ca05-c4b4-4936-9ddb-29ca1988411b, volume: 6c021d85-6d14-4b1c-bf46-fd6d505e7cfc, {{(pid=88899) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Aug 03 08:38:10 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-ea4a0e39-be9d-4aa4-b4fa-2f8efbcab38f tempest-VolumesDeleteCascade-2092426887 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:38:10 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-ea4a0e39-be9d-4aa4-b4fa-2f8efbcab38f tempest-VolumesDeleteCascade-2092426887 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:38:10 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-ea4a0e39-be9d-4aa4-b4fa-2f8efbcab38f tempest-VolumesDeleteCascade-2092426887 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:38:10 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-ea4a0e39-be9d-4aa4-b4fa-2f8efbcab38f tempest-VolumesDeleteCascade-2092426887 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:38:10 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-ea4a0e39-be9d-4aa4-b4fa-2f8efbcab38f tempest-VolumesDeleteCascade-2092426887 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:38:10 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[35e61b80-99ae-44d4-bb02-491a3899d0b6]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:38:10 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-ea4a0e39-be9d-4aa4-b4fa-2f8efbcab38f tempest-VolumesDeleteCascade-2092426887 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-53c7271f-46db-4a1b-91f6-3a358ce1c149.d747ca05-c4b4-4936-9ddb-29ca1988411b {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:38:10 devstack sudo[100649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-53c7271f-46db-4a1b-91f6-3a358ce1c149.d747ca05-c4b4-4936-9ddb-29ca1988411b Aug 03 08:38:10 devstack sudo[100649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:38:10 devstack sudo[100649]: pam_unix(sudo:session): session closed for user root Aug 03 08:38:10 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-ea4a0e39-be9d-4aa4-b4fa-2f8efbcab38f tempest-VolumesDeleteCascade-2092426887 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-53c7271f-46db-4a1b-91f6-3a358ce1c149.d747ca05-c4b4-4936-9ddb-29ca1988411b" returned: 0 in 0.467s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:38:10 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-ea4a0e39-be9d-4aa4-b4fa-2f8efbcab38f tempest-VolumesDeleteCascade-2092426887 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-53c7271f-46db-4a1b-91f6-3a358ce1c149(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88899) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 03 08:38:10 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8cded64-89be-4640-8dd1-d72d13279897]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:38:10 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-ea4a0e39-be9d-4aa4-b4fa-2f8efbcab38f tempest-VolumesDeleteCascade-2092426887 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-53c7271f-46db-4a1b-91f6-3a358ce1c149 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:38:11 devstack sudo[100657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-53c7271f-46db-4a1b-91f6-3a358ce1c149 Aug 03 08:38:11 devstack sudo[100657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:38:11 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-ab2b2fb1-e315-44f0-ae67-b8cc8de86d6d tempest-ServersNegativeTestJSON-899715745 None] Acquiring lock "cinder-5605f93a-c3aa-40ed-ad85-c05bfb8d1484-delete_volume" by "delete_volume" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:38:11 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-ab2b2fb1-e315-44f0-ae67-b8cc8de86d6d tempest-ServersNegativeTestJSON-899715745 None] Lock "cinder-5605f93a-c3aa-40ed-ad85-c05bfb8d1484-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:38:11 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-ab2b2fb1-e315-44f0-ae67-b8cc8de86d6d tempest-ServersNegativeTestJSON-899715745 None] Acquiring lock "cinder-quobyte-5605f93a-c3aa-40ed-ad85-c05bfb8d1484" by "delete_volume" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:38:11 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-ab2b2fb1-e315-44f0-ae67-b8cc8de86d6d tempest-ServersNegativeTestJSON-899715745 None] Lock "cinder-quobyte-5605f93a-c3aa-40ed-ad85-c05bfb8d1484" acquired by "delete_volume" :: waited 0.053s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:38:11 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[aed1ef2d-6761-47d6-8268-97a13681aebc]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:38:11 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-ab2b2fb1-e315-44f0-ae67-b8cc8de86d6d tempest-ServersNegativeTestJSON-899715745 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-5605f93a-c3aa-40ed-ad85-c05bfb8d1484 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:38:11 devstack sudo[100657]: pam_unix(sudo:session): session closed for user root Aug 03 08:38:11 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-ea4a0e39-be9d-4aa4-b4fa-2f8efbcab38f tempest-VolumesDeleteCascade-2092426887 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-53c7271f-46db-4a1b-91f6-3a358ce1c149" returned: 0 in 0.566s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:38:11 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-ea4a0e39-be9d-4aa4-b4fa-2f8efbcab38f tempest-VolumesDeleteCascade-2092426887 None] will copy from snapshot at /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-53c7271f-46db-4a1b-91f6-3a358ce1c149 {{(pid=88899) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Aug 03 08:38:11 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-ea4a0e39-be9d-4aa4-b4fa-2f8efbcab38f tempest-VolumesDeleteCascade-2092426887 None] Creating direct copy from snapshot {{(pid=88899) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Aug 03 08:38:11 devstack sudo[100659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-5605f93a-c3aa-40ed-ad85-c05bfb8d1484 Aug 03 08:38:11 devstack sudo[100659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:38:11 devstack cinder-volume[88899]: DEBUG cinder.utils [None req-ea4a0e39-be9d-4aa4-b4fa-2f8efbcab38f tempest-VolumesDeleteCascade-2092426887 None] Path /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-6c021d85-6d14-4b1c-bf46-fd6d505e7cfc not found in is_blk_device check {{(pid=88899) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Aug 03 08:38:11 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-ea4a0e39-be9d-4aa4-b4fa-2f8efbcab38f tempest-VolumesDeleteCascade-2092426887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-53c7271f-46db-4a1b-91f6-3a358ce1c149 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-6c021d85-6d14-4b1c-bf46-fd6d505e7cfc {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:38:11 devstack sudo[100664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-53c7271f-46db-4a1b-91f6-3a358ce1c149 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-6c021d85-6d14-4b1c-bf46-fd6d505e7cfc Aug 03 08:38:11 devstack sudo[100664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:38:11 devstack sudo[100659]: pam_unix(sudo:session): session closed for user root Aug 03 08:38:11 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-ab2b2fb1-e315-44f0-ae67-b8cc8de86d6d tempest-ServersNegativeTestJSON-899715745 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-5605f93a-c3aa-40ed-ad85-c05bfb8d1484" returned: 0 in 0.516s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:38:11 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-ab2b2fb1-e315-44f0-ae67-b8cc8de86d6d tempest-ServersNegativeTestJSON-899715745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-5605f93a-c3aa-40ed-ad85-c05bfb8d1484 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:38:11 devstack sudo[100670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-5605f93a-c3aa-40ed-ad85-c05bfb8d1484 Aug 03 08:38:11 devstack sudo[100670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:38:12 devstack sudo[100670]: pam_unix(sudo:session): session closed for user root Aug 03 08:38:12 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-ab2b2fb1-e315-44f0-ae67-b8cc8de86d6d tempest-ServersNegativeTestJSON-899715745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-5605f93a-c3aa-40ed-ad85-c05bfb8d1484" returned: 0 in 0.327s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:38:12 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-ab2b2fb1-e315-44f0-ae67-b8cc8de86d6d tempest-ServersNegativeTestJSON-899715745 None] Lock "cinder-quobyte-5605f93a-c3aa-40ed-ad85-c05bfb8d1484" released by "delete_volume" :: held 0.911s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:38:12 devstack cinder-volume[88899]: DEBUG cinder.quota [None req-ab2b2fb1-e315-44f0-ae67-b8cc8de86d6d tempest-ServersNegativeTestJSON-899715745 None] Created reservations ['4053d824-a216-4b2b-906d-0acdb764e52a', 'a8023e4e-01c3-4f6f-b822-c8429eb8c3bb', 'd252f629-0d17-4705-950a-871b37011fe2', '9fec281f-d6e5-43fc-abd6-1f476ed84567'] {{(pid=88899) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 08:38:12 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-ab2b2fb1-e315-44f0-ae67-b8cc8de86d6d tempest-ServersNegativeTestJSON-899715745 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:38:12 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-ab2b2fb1-e315-44f0-ae67-b8cc8de86d6d tempest-ServersNegativeTestJSON-899715745 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:38:12 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-ab2b2fb1-e315-44f0-ae67-b8cc8de86d6d tempest-ServersNegativeTestJSON-899715745 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:38:12 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-ab2b2fb1-e315-44f0-ae67-b8cc8de86d6d tempest-ServersNegativeTestJSON-899715745 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:38:12 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-ab2b2fb1-e315-44f0-ae67-b8cc8de86d6d tempest-ServersNegativeTestJSON-899715745 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:38:12 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-ab2b2fb1-e315-44f0-ae67-b8cc8de86d6d tempest-ServersNegativeTestJSON-899715745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:38:12 devstack sudo[100683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a Aug 03 08:38:12 devstack sudo[100683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:38:13 devstack sudo[100683]: pam_unix(sudo:session): session closed for user root Aug 03 08:38:13 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-ab2b2fb1-e315-44f0-ae67-b8cc8de86d6d tempest-ServersNegativeTestJSON-899715745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a" returned: 0 in 0.872s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:38:13 devstack cinder-volume[88899]: DEBUG cinder.manager [None req-ab2b2fb1-e315-44f0-ae67-b8cc8de86d6d tempest-ServersNegativeTestJSON-899715745 None] Notifying Schedulers of capabilities ... {{(pid=88899) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 08:38:13 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-ab2b2fb1-e315-44f0-ae67-b8cc8de86d6d tempest-ServersNegativeTestJSON-899715745 None] Deleted volume successfully. Aug 03 08:38:13 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-ab2b2fb1-e315-44f0-ae67-b8cc8de86d6d tempest-ServersNegativeTestJSON-899715745 None] Lock "cinder-5605f93a-c3aa-40ed-ad85-c05bfb8d1484-delete_volume" released by "delete_volume" :: held 2.212s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:38:13 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-7cbdefac-d724-4dfe-94e5-f63e3e97ac51 tempest-ServersNegativeTestJSON-899715745 None] Acquiring lock "cinder-5f087f98-037e-40a5-a74c-630590557535-delete_volume" by "delete_volume" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:38:13 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-7cbdefac-d724-4dfe-94e5-f63e3e97ac51 tempest-ServersNegativeTestJSON-899715745 None] Lock "cinder-5f087f98-037e-40a5-a74c-630590557535-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:38:14 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-7cbdefac-d724-4dfe-94e5-f63e3e97ac51 tempest-ServersNegativeTestJSON-899715745 None] Acquiring lock "cinder-quobyte-5f087f98-037e-40a5-a74c-630590557535" by "delete_volume" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:38:14 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-7cbdefac-d724-4dfe-94e5-f63e3e97ac51 tempest-ServersNegativeTestJSON-899715745 None] Lock "cinder-quobyte-5f087f98-037e-40a5-a74c-630590557535" acquired by "delete_volume" :: waited 0.025s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:38:14 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cf9e017-af0f-4046-b003-bfa427eec612]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:38:14 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-7cbdefac-d724-4dfe-94e5-f63e3e97ac51 tempest-ServersNegativeTestJSON-899715745 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-5f087f98-037e-40a5-a74c-630590557535 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:38:14 devstack sudo[100688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-5f087f98-037e-40a5-a74c-630590557535 Aug 03 08:38:14 devstack sudo[100688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:38:15 devstack sudo[100688]: pam_unix(sudo:session): session closed for user root Aug 03 08:38:15 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-7cbdefac-d724-4dfe-94e5-f63e3e97ac51 tempest-ServersNegativeTestJSON-899715745 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-5f087f98-037e-40a5-a74c-630590557535" returned: 0 in 1.133s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:38:15 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-7cbdefac-d724-4dfe-94e5-f63e3e97ac51 tempest-ServersNegativeTestJSON-899715745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-5f087f98-037e-40a5-a74c-630590557535 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:38:15 devstack sudo[100693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-5f087f98-037e-40a5-a74c-630590557535 Aug 03 08:38:15 devstack sudo[100693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:38:16 devstack sudo[100693]: pam_unix(sudo:session): session closed for user root Aug 03 08:38:16 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-7cbdefac-d724-4dfe-94e5-f63e3e97ac51 tempest-ServersNegativeTestJSON-899715745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-5f087f98-037e-40a5-a74c-630590557535" returned: 0 in 0.889s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:38:16 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-7cbdefac-d724-4dfe-94e5-f63e3e97ac51 tempest-ServersNegativeTestJSON-899715745 None] Lock "cinder-quobyte-5f087f98-037e-40a5-a74c-630590557535" released by "delete_volume" :: held 2.130s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:38:16 devstack cinder-volume[88899]: DEBUG cinder.quota [None req-7cbdefac-d724-4dfe-94e5-f63e3e97ac51 tempest-ServersNegativeTestJSON-899715745 None] Created reservations ['37d6eb56-9389-4421-92f2-8fbcf6ae0cb8', 'c8e70625-7fa4-4451-ab24-a1d226a4d47f', 'cfe6cd67-dfa2-4bc1-8dd2-d0678b36e58b', '8797c199-78be-47a1-bff4-825c44b82bc4'] {{(pid=88899) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 08:38:16 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-7cbdefac-d724-4dfe-94e5-f63e3e97ac51 tempest-ServersNegativeTestJSON-899715745 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:38:16 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-7cbdefac-d724-4dfe-94e5-f63e3e97ac51 tempest-ServersNegativeTestJSON-899715745 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:38:16 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-7cbdefac-d724-4dfe-94e5-f63e3e97ac51 tempest-ServersNegativeTestJSON-899715745 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:38:16 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-7cbdefac-d724-4dfe-94e5-f63e3e97ac51 tempest-ServersNegativeTestJSON-899715745 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:38:16 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-7cbdefac-d724-4dfe-94e5-f63e3e97ac51 tempest-ServersNegativeTestJSON-899715745 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.034s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:38:16 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-7cbdefac-d724-4dfe-94e5-f63e3e97ac51 tempest-ServersNegativeTestJSON-899715745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:38:16 devstack sudo[100696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a Aug 03 08:38:16 devstack sudo[100696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:38:17 devstack sudo[100696]: pam_unix(sudo:session): session closed for user root Aug 03 08:38:17 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-7cbdefac-d724-4dfe-94e5-f63e3e97ac51 tempest-ServersNegativeTestJSON-899715745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a" returned: 0 in 0.864s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:38:17 devstack cinder-volume[88899]: DEBUG cinder.manager [None req-7cbdefac-d724-4dfe-94e5-f63e3e97ac51 tempest-ServersNegativeTestJSON-899715745 None] Notifying Schedulers of capabilities ... {{(pid=88899) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 08:38:17 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-7cbdefac-d724-4dfe-94e5-f63e3e97ac51 tempest-ServersNegativeTestJSON-899715745 None] Deleted volume successfully. Aug 03 08:38:17 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-7cbdefac-d724-4dfe-94e5-f63e3e97ac51 tempest-ServersNegativeTestJSON-899715745 None] Lock "cinder-5f087f98-037e-40a5-a74c-630590557535-delete_volume" released by "delete_volume" :: held 3.684s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:38:18 devstack sudo[100664]: pam_unix(sudo:session): session closed for user root Aug 03 08:38:18 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-ea4a0e39-be9d-4aa4-b4fa-2f8efbcab38f tempest-VolumesDeleteCascade-2092426887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-53c7271f-46db-4a1b-91f6-3a358ce1c149 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-6c021d85-6d14-4b1c-bf46-fd6d505e7cfc" returned: 0 in 6.510s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:38:18 devstack cinder-volume[88899]: DEBUG cinder.image.image_utils [None req-ea4a0e39-be9d-4aa4-b4fa-2f8efbcab38f tempest-VolumesDeleteCascade-2092426887 None] Image conversion details: src /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-53c7271f-46db-4a1b-91f6-3a358ce1c149, size 1024.00 MB, duration 6.51 sec, destination /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-6c021d85-6d14-4b1c-bf46-fd6d505e7cfc {{(pid=88899) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 03 08:38:18 devstack cinder-volume[88899]: INFO cinder.image.image_utils [None req-ea4a0e39-be9d-4aa4-b4fa-2f8efbcab38f tempest-VolumesDeleteCascade-2092426887 None] Converted 1024.00 MB image at 157.27 MB/s Aug 03 08:38:18 devstack cinder-volume[88899]: WARNING cinder.volume.drivers.remotefs [None req-ea4a0e39-be9d-4aa4-b4fa-2f8efbcab38f tempest-VolumesDeleteCascade-2092426887 None] /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-6c021d85-6d14-4b1c-bf46-fd6d505e7cfc is being set with open permissions: ugo+rw Aug 03 08:38:18 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-ea4a0e39-be9d-4aa4-b4fa-2f8efbcab38f tempest-VolumesDeleteCascade-2092426887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-6c021d85-6d14-4b1c-bf46-fd6d505e7cfc {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:38:18 devstack sudo[100700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-6c021d85-6d14-4b1c-bf46-fd6d505e7cfc Aug 03 08:38:18 devstack sudo[100700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:38:18 devstack sudo[100700]: pam_unix(sudo:session): session closed for user root Aug 03 08:38:18 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-ea4a0e39-be9d-4aa4-b4fa-2f8efbcab38f tempest-VolumesDeleteCascade-2092426887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-6c021d85-6d14-4b1c-bf46-fd6d505e7cfc" returned: 0 in 0.385s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:38:18 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-ea4a0e39-be9d-4aa4-b4fa-2f8efbcab38f tempest-VolumesDeleteCascade-2092426887 None] Lock "cinder-quobyte-6c021d85-6d14-4b1c-bf46-fd6d505e7cfc" released by "_copy_volume_from_snapshot" :: held 8.053s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:38:18 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-ea4a0e39-be9d-4aa4-b4fa-2f8efbcab38f tempest-VolumesDeleteCascade-2092426887 None] Lock "cinder-quobyte-d747ca05-c4b4-4936-9ddb-29ca1988411b-6c021d85-6d14-4b1c-bf46-fd6d505e7cfc" released by "_create_volume_from_snapshot" :: held 8.212s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:38:18 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-ea4a0e39-be9d-4aa4-b4fa-2f8efbcab38f tempest-VolumesDeleteCascade-2092426887 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.238s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:38:18 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-ea4a0e39-be9d-4aa4-b4fa-2f8efbcab38f tempest-VolumesDeleteCascade-2092426887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e06ade3d-824f-49e4-91a3-425ab70441b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6c021d85-6d14-4b1c-bf46-fd6d505e7cfc', 'volume_size': 1, 'snapshot_id': 'd747ca05-c4b4-4936-9ddb-29ca1988411b'}' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:38:18 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-ea4a0e39-be9d-4aa4-b4fa-2f8efbcab38f tempest-VolumesDeleteCascade-2092426887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed07c5e3-f549-4a72-b36b-46c028bdbc28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:38:18 devstack cinder-volume[88899]: INFO cinder.volume.flows.manager.create_volume [None req-ea4a0e39-be9d-4aa4-b4fa-2f8efbcab38f tempest-VolumesDeleteCascade-2092426887 None] Volume volume-6c021d85-6d14-4b1c-bf46-fd6d505e7cfc (6c021d85-6d14-4b1c-bf46-fd6d505e7cfc): created successfully Aug 03 08:38:18 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-ea4a0e39-be9d-4aa4-b4fa-2f8efbcab38f tempest-VolumesDeleteCascade-2092426887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed07c5e3-f549-4a72-b36b-46c028bdbc28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:38:18 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-ea4a0e39-be9d-4aa4-b4fa-2f8efbcab38f tempest-VolumesDeleteCascade-2092426887 None] Flow 'volume_create_manager' (b40ed307-567e-4431-9873-99036ea64d2a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:38:18 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-ea4a0e39-be9d-4aa4-b4fa-2f8efbcab38f tempest-VolumesDeleteCascade-2092426887 None] Created volume successfully. Aug 03 08:38:19 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-4b664d75-0987-4f1d-8d24-bf9c083b8184 tempest-VolumesDeleteCascade-2092426887 None] Acquiring lock "cinder-53c7271f-46db-4a1b-91f6-3a358ce1c149-delete_volume" by "delete_volume" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:38:19 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-4b664d75-0987-4f1d-8d24-bf9c083b8184 tempest-VolumesDeleteCascade-2092426887 None] Lock "cinder-53c7271f-46db-4a1b-91f6-3a358ce1c149-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:38:19 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-4b664d75-0987-4f1d-8d24-bf9c083b8184 tempest-VolumesDeleteCascade-2092426887 None] Performing cascade delete. {{(pid=88899) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Aug 03 08:38:19 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-4b664d75-0987-4f1d-8d24-bf9c083b8184 tempest-VolumesDeleteCascade-2092426887 None] Acquiring lock "cinder-d747ca05-c4b4-4936-9ddb-29ca1988411b-delete_snapshot" by "delete_snapshot" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:38:19 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-4b664d75-0987-4f1d-8d24-bf9c083b8184 tempest-VolumesDeleteCascade-2092426887 None] Lock "cinder-d747ca05-c4b4-4936-9ddb-29ca1988411b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:38:19 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-4b664d75-0987-4f1d-8d24-bf9c083b8184 tempest-VolumesDeleteCascade-2092426887 None] Acquiring lock "cinder-quobyte-53c7271f-46db-4a1b-91f6-3a358ce1c149" by "delete_snapshot" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:38:19 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-4b664d75-0987-4f1d-8d24-bf9c083b8184 tempest-VolumesDeleteCascade-2092426887 None] Lock "cinder-quobyte-53c7271f-46db-4a1b-91f6-3a358ce1c149" acquired by "delete_snapshot" :: waited 0.019s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:38:19 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-4b664d75-0987-4f1d-8d24-bf9c083b8184 tempest-VolumesDeleteCascade-2092426887 None] Acquiring lock "cinder-quobyte-d747ca05-c4b4-4936-9ddb-29ca1988411b" by "_delete_snapshot" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:38:19 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-4b664d75-0987-4f1d-8d24-bf9c083b8184 tempest-VolumesDeleteCascade-2092426887 None] Lock "cinder-quobyte-d747ca05-c4b4-4936-9ddb-29ca1988411b" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:38:19 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-4b664d75-0987-4f1d-8d24-bf9c083b8184 tempest-VolumesDeleteCascade-2092426887 None] Deleting offline snapshot d747ca05-c4b4-4936-9ddb-29ca1988411b of volume 53c7271f-46db-4a1b-91f6-3a358ce1c149 {{(pid=88899) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 03 08:38:20 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-4b664d75-0987-4f1d-8d24-bf9c083b8184 tempest-VolumesDeleteCascade-2092426887 None] snapshot_file for this snap is: volume-53c7271f-46db-4a1b-91f6-3a358ce1c149.d747ca05-c4b4-4936-9ddb-29ca1988411b {{(pid=88899) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 03 08:38:20 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1be70bd-bac2-4c41-8a1f-5067e3f553f9]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:38:20 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-4b664d75-0987-4f1d-8d24-bf9c083b8184 tempest-VolumesDeleteCascade-2092426887 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-53c7271f-46db-4a1b-91f6-3a358ce1c149.d747ca05-c4b4-4936-9ddb-29ca1988411b {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:38:20 devstack sudo[100729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-53c7271f-46db-4a1b-91f6-3a358ce1c149.d747ca05-c4b4-4936-9ddb-29ca1988411b Aug 03 08:38:20 devstack sudo[100729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:38:20 devstack sudo[100729]: pam_unix(sudo:session): session closed for user root Aug 03 08:38:20 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-4b664d75-0987-4f1d-8d24-bf9c083b8184 tempest-VolumesDeleteCascade-2092426887 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-53c7271f-46db-4a1b-91f6-3a358ce1c149.d747ca05-c4b4-4936-9ddb-29ca1988411b" returned: 0 in 0.521s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:38:20 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-4b664d75-0987-4f1d-8d24-bf9c083b8184 tempest-VolumesDeleteCascade-2092426887 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-53c7271f-46db-4a1b-91f6-3a358ce1c149(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88899) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 03 08:38:20 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[93ff0b9b-ec18-4b86-bcbc-f57397e982c0]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:38:20 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-4b664d75-0987-4f1d-8d24-bf9c083b8184 tempest-VolumesDeleteCascade-2092426887 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-53c7271f-46db-4a1b-91f6-3a358ce1c149 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:38:20 devstack sudo[100737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-53c7271f-46db-4a1b-91f6-3a358ce1c149 Aug 03 08:38:20 devstack sudo[100737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:38:21 devstack sudo[100737]: pam_unix(sudo:session): session closed for user root Aug 03 08:38:21 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-4b664d75-0987-4f1d-8d24-bf9c083b8184 tempest-VolumesDeleteCascade-2092426887 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-53c7271f-46db-4a1b-91f6-3a358ce1c149" returned: 0 in 0.685s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:38:21 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-4b664d75-0987-4f1d-8d24-bf9c083b8184 tempest-VolumesDeleteCascade-2092426887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-53c7271f-46db-4a1b-91f6-3a358ce1c149.d747ca05-c4b4-4936-9ddb-29ca1988411b {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:38:21 devstack sudo[100743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-53c7271f-46db-4a1b-91f6-3a358ce1c149.d747ca05-c4b4-4936-9ddb-29ca1988411b Aug 03 08:38:21 devstack sudo[100743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:38:21 devstack sudo[100743]: pam_unix(sudo:session): session closed for user root Aug 03 08:38:21 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-4b664d75-0987-4f1d-8d24-bf9c083b8184 tempest-VolumesDeleteCascade-2092426887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-53c7271f-46db-4a1b-91f6-3a358ce1c149.d747ca05-c4b4-4936-9ddb-29ca1988411b" returned: 0 in 0.472s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:38:21 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-4b664d75-0987-4f1d-8d24-bf9c083b8184 tempest-VolumesDeleteCascade-2092426887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-53c7271f-46db-4a1b-91f6-3a358ce1c149.d747ca05-c4b4-4936-9ddb-29ca1988411b {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:38:21 devstack sudo[100750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-53c7271f-46db-4a1b-91f6-3a358ce1c149.d747ca05-c4b4-4936-9ddb-29ca1988411b Aug 03 08:38:21 devstack sudo[100750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:38:22 devstack sudo[100750]: pam_unix(sudo:session): session closed for user root Aug 03 08:38:22 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-4b664d75-0987-4f1d-8d24-bf9c083b8184 tempest-VolumesDeleteCascade-2092426887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-53c7271f-46db-4a1b-91f6-3a358ce1c149.d747ca05-c4b4-4936-9ddb-29ca1988411b" returned: 0 in 0.380s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:38:22 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-4b664d75-0987-4f1d-8d24-bf9c083b8184 tempest-VolumesDeleteCascade-2092426887 None] Lock "cinder-quobyte-d747ca05-c4b4-4936-9ddb-29ca1988411b" released by "_delete_snapshot" :: held 2.287s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:38:22 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-4b664d75-0987-4f1d-8d24-bf9c083b8184 tempest-VolumesDeleteCascade-2092426887 None] Lock "cinder-quobyte-53c7271f-46db-4a1b-91f6-3a358ce1c149" released by "delete_snapshot" :: held 2.322s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:38:22 devstack cinder-volume[88899]: DEBUG dbcounter [-] [88899] Writing DB stats cinder:UPDATE=143,cinder:INSERT=47,cinder:SELECT=111,cinder:DELETE=15 {{(pid=88899) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 03 08:38:22 devstack cinder-volume[88899]: DEBUG cinder.quota [None req-4b664d75-0987-4f1d-8d24-bf9c083b8184 tempest-VolumesDeleteCascade-2092426887 None] Created reservations ['57b09cd8-5956-49ea-a8bd-ec820f0d54a4', 'b854f8a4-8b8c-4fa1-a604-e00caa36a560', 'd98ee7da-7531-49b0-ad38-11ad41dc791b', '8ccbd6c4-9dbf-4195-8a1c-9120da14f40f'] {{(pid=88899) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 08:38:22 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-4b664d75-0987-4f1d-8d24-bf9c083b8184 tempest-VolumesDeleteCascade-2092426887 None] Delete snapshot completed successfully. Aug 03 08:38:22 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-4b664d75-0987-4f1d-8d24-bf9c083b8184 tempest-VolumesDeleteCascade-2092426887 None] Lock "cinder-d747ca05-c4b4-4936-9ddb-29ca1988411b-delete_snapshot" released by "delete_snapshot" :: held 2.590s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:38:22 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-4b664d75-0987-4f1d-8d24-bf9c083b8184 tempest-VolumesDeleteCascade-2092426887 None] Snapshots deleted, issuing volume delete {{(pid=88899) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Aug 03 08:38:22 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-4b664d75-0987-4f1d-8d24-bf9c083b8184 tempest-VolumesDeleteCascade-2092426887 None] Acquiring lock "cinder-quobyte-53c7271f-46db-4a1b-91f6-3a358ce1c149" by "delete_volume" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:38:22 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-4b664d75-0987-4f1d-8d24-bf9c083b8184 tempest-VolumesDeleteCascade-2092426887 None] Lock "cinder-quobyte-53c7271f-46db-4a1b-91f6-3a358ce1c149" acquired by "delete_volume" :: waited 0.019s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:38:22 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[37bbf090-e84a-48be-b681-47c13c9c8d55]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:38:22 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-4b664d75-0987-4f1d-8d24-bf9c083b8184 tempest-VolumesDeleteCascade-2092426887 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-53c7271f-46db-4a1b-91f6-3a358ce1c149 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:38:22 devstack sudo[100753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-53c7271f-46db-4a1b-91f6-3a358ce1c149 Aug 03 08:38:22 devstack sudo[100753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:38:23 devstack sudo[100753]: pam_unix(sudo:session): session closed for user root Aug 03 08:38:23 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-4b664d75-0987-4f1d-8d24-bf9c083b8184 tempest-VolumesDeleteCascade-2092426887 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-53c7271f-46db-4a1b-91f6-3a358ce1c149" returned: 0 in 0.513s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:38:23 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-4b664d75-0987-4f1d-8d24-bf9c083b8184 tempest-VolumesDeleteCascade-2092426887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-53c7271f-46db-4a1b-91f6-3a358ce1c149 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:38:23 devstack sudo[100758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-53c7271f-46db-4a1b-91f6-3a358ce1c149 Aug 03 08:38:23 devstack sudo[100758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:38:23 devstack sudo[100758]: pam_unix(sudo:session): session closed for user root Aug 03 08:38:23 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-4b664d75-0987-4f1d-8d24-bf9c083b8184 tempest-VolumesDeleteCascade-2092426887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-53c7271f-46db-4a1b-91f6-3a358ce1c149" returned: 0 in 0.324s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:38:23 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-4b664d75-0987-4f1d-8d24-bf9c083b8184 tempest-VolumesDeleteCascade-2092426887 None] Lock "cinder-quobyte-53c7271f-46db-4a1b-91f6-3a358ce1c149" released by "delete_volume" :: held 0.922s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:38:23 devstack cinder-volume[88899]: DEBUG dbcounter [-] [88899] Writing DB stats cinder:SELECT=129,cinder:UPDATE=154,cinder:DELETE=11,cinder:INSERT=33 {{(pid=88899) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 03 08:38:23 devstack cinder-volume[88899]: DEBUG cinder.quota [None req-4b664d75-0987-4f1d-8d24-bf9c083b8184 tempest-VolumesDeleteCascade-2092426887 None] Created reservations ['066777fd-ee6e-40db-a999-615c739d9811', 'afb53130-83a1-4ca1-bb77-12b9d22bf2e7', '6a8105cf-ea3c-4f27-b49c-1d860001ff06', 'f44dd3ae-9f33-4d0d-9090-f3380ff7352a'] {{(pid=88899) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 08:38:23 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-4b664d75-0987-4f1d-8d24-bf9c083b8184 tempest-VolumesDeleteCascade-2092426887 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:38:23 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-4b664d75-0987-4f1d-8d24-bf9c083b8184 tempest-VolumesDeleteCascade-2092426887 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:38:23 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-4b664d75-0987-4f1d-8d24-bf9c083b8184 tempest-VolumesDeleteCascade-2092426887 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:38:23 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-4b664d75-0987-4f1d-8d24-bf9c083b8184 tempest-VolumesDeleteCascade-2092426887 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:38:23 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-4b664d75-0987-4f1d-8d24-bf9c083b8184 tempest-VolumesDeleteCascade-2092426887 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:38:23 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-4b664d75-0987-4f1d-8d24-bf9c083b8184 tempest-VolumesDeleteCascade-2092426887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:38:23 devstack sudo[100761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a Aug 03 08:38:23 devstack sudo[100761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:38:23 devstack sudo[100761]: pam_unix(sudo:session): session closed for user root Aug 03 08:38:23 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-4b664d75-0987-4f1d-8d24-bf9c083b8184 tempest-VolumesDeleteCascade-2092426887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a" returned: 0 in 0.329s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:38:23 devstack cinder-volume[88899]: DEBUG cinder.manager [None req-4b664d75-0987-4f1d-8d24-bf9c083b8184 tempest-VolumesDeleteCascade-2092426887 None] Notifying Schedulers of capabilities ... {{(pid=88899) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 08:38:23 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-4b664d75-0987-4f1d-8d24-bf9c083b8184 tempest-VolumesDeleteCascade-2092426887 None] Deleted volume successfully. Aug 03 08:38:24 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-4b664d75-0987-4f1d-8d24-bf9c083b8184 tempest-VolumesDeleteCascade-2092426887 None] Lock "cinder-53c7271f-46db-4a1b-91f6-3a358ce1c149-delete_volume" released by "delete_volume" :: held 4.225s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:38:24 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-749e446e-c3ef-4409-a7de-b5adf7743129 tempest-VolumesDeleteCascade-2092426887 None] Acquiring lock "cinder-6c021d85-6d14-4b1c-bf46-fd6d505e7cfc-delete_volume" by "delete_volume" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:38:24 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-749e446e-c3ef-4409-a7de-b5adf7743129 tempest-VolumesDeleteCascade-2092426887 None] Lock "cinder-6c021d85-6d14-4b1c-bf46-fd6d505e7cfc-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:38:24 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-749e446e-c3ef-4409-a7de-b5adf7743129 tempest-VolumesDeleteCascade-2092426887 None] Acquiring lock "cinder-quobyte-6c021d85-6d14-4b1c-bf46-fd6d505e7cfc" by "delete_volume" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:38:24 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-749e446e-c3ef-4409-a7de-b5adf7743129 tempest-VolumesDeleteCascade-2092426887 None] Lock "cinder-quobyte-6c021d85-6d14-4b1c-bf46-fd6d505e7cfc" acquired by "delete_volume" :: waited 0.040s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:38:24 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2b18af2-30b2-443d-b3f8-d5616a77c714]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:38:24 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-749e446e-c3ef-4409-a7de-b5adf7743129 tempest-VolumesDeleteCascade-2092426887 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-6c021d85-6d14-4b1c-bf46-fd6d505e7cfc {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:38:24 devstack sudo[100765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-6c021d85-6d14-4b1c-bf46-fd6d505e7cfc Aug 03 08:38:24 devstack sudo[100765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:38:25 devstack sudo[100765]: pam_unix(sudo:session): session closed for user root Aug 03 08:38:25 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-749e446e-c3ef-4409-a7de-b5adf7743129 tempest-VolumesDeleteCascade-2092426887 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-6c021d85-6d14-4b1c-bf46-fd6d505e7cfc" returned: 0 in 0.468s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:38:25 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-749e446e-c3ef-4409-a7de-b5adf7743129 tempest-VolumesDeleteCascade-2092426887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-6c021d85-6d14-4b1c-bf46-fd6d505e7cfc {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:38:25 devstack sudo[100771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-6c021d85-6d14-4b1c-bf46-fd6d505e7cfc Aug 03 08:38:25 devstack sudo[100771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:38:25 devstack sudo[100771]: pam_unix(sudo:session): session closed for user root Aug 03 08:38:25 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-749e446e-c3ef-4409-a7de-b5adf7743129 tempest-VolumesDeleteCascade-2092426887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-6c021d85-6d14-4b1c-bf46-fd6d505e7cfc" returned: 0 in 0.335s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:38:25 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-749e446e-c3ef-4409-a7de-b5adf7743129 tempest-VolumesDeleteCascade-2092426887 None] Lock "cinder-quobyte-6c021d85-6d14-4b1c-bf46-fd6d505e7cfc" released by "delete_volume" :: held 0.873s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:38:25 devstack cinder-volume[88899]: DEBUG cinder.quota [None req-749e446e-c3ef-4409-a7de-b5adf7743129 tempest-VolumesDeleteCascade-2092426887 None] Created reservations ['4321dc00-9a79-4ce9-a545-f341ecfb871c', 'eebf1db8-4e72-435b-bd79-6073d969ec64', '8c99ddbe-86b3-4f69-b3b6-a98104a53d54', 'ab03f4d8-aa3b-407d-9563-25172732898b'] {{(pid=88899) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 08:38:25 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-749e446e-c3ef-4409-a7de-b5adf7743129 tempest-VolumesDeleteCascade-2092426887 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:38:25 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-749e446e-c3ef-4409-a7de-b5adf7743129 tempest-VolumesDeleteCascade-2092426887 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:38:25 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-749e446e-c3ef-4409-a7de-b5adf7743129 tempest-VolumesDeleteCascade-2092426887 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:38:25 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-749e446e-c3ef-4409-a7de-b5adf7743129 tempest-VolumesDeleteCascade-2092426887 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:38:25 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-749e446e-c3ef-4409-a7de-b5adf7743129 tempest-VolumesDeleteCascade-2092426887 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:38:25 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-749e446e-c3ef-4409-a7de-b5adf7743129 tempest-VolumesDeleteCascade-2092426887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:38:25 devstack sudo[100774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a Aug 03 08:38:25 devstack sudo[100774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:38:26 devstack sudo[100774]: pam_unix(sudo:session): session closed for user root Aug 03 08:38:26 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-749e446e-c3ef-4409-a7de-b5adf7743129 tempest-VolumesDeleteCascade-2092426887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a" returned: 0 in 0.352s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:38:26 devstack cinder-volume[88899]: DEBUG cinder.manager [None req-749e446e-c3ef-4409-a7de-b5adf7743129 tempest-VolumesDeleteCascade-2092426887 None] Notifying Schedulers of capabilities ... {{(pid=88899) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 08:38:26 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-749e446e-c3ef-4409-a7de-b5adf7743129 tempest-VolumesDeleteCascade-2092426887 None] Deleted volume successfully. Aug 03 08:38:26 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-749e446e-c3ef-4409-a7de-b5adf7743129 tempest-VolumesDeleteCascade-2092426887 None] Lock "cinder-6c021d85-6d14-4b1c-bf46-fd6d505e7cfc-delete_volume" released by "delete_volume" :: held 1.638s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:38:29 devstack cinder-volume[88899]: DEBUG cinder.volume.flows.manager.create_volume [None req-04f1eafa-8220-484f-9ae8-75be4964d43a tempest-VolumesImageMetadata-1846734108 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88899) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 08:38:29 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-04f1eafa-8220-484f-9ae8-75be4964d43a tempest-VolumesImageMetadata-1846734108 None] Flow 'volume_create_manager' (8eea574b-4643-4fae-90bf-8ac38bd94b42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:38:29 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-04f1eafa-8220-484f-9ae8-75be4964d43a tempest-VolumesImageMetadata-1846734108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a5fca87-1bb8-4412-94dc-cefa29ca67b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:38:29 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-04f1eafa-8220-484f-9ae8-75be4964d43a tempest-VolumesImageMetadata-1846734108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a5fca87-1bb8-4412-94dc-cefa29ca67b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:38:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1886440646',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3cf8c599-e87a-49dd-9348-8f2c7365ca5f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='920d6f81cd8a41418df224b6954a47f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:38:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:38:30Z,use_quota=True,user_id='5cfd4cb73de94f5da9a8d312e06b47a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8bde7129-1dc4-42ab-b852-ab32c61b4921),volume_type_id=8bde7129-1dc4-42ab-b852-ab32c61b4921)' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:38:29 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-04f1eafa-8220-484f-9ae8-75be4964d43a tempest-VolumesImageMetadata-1846734108 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea09136b-074b-4a00-ab92-6a0bf35df305) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:38:29 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-04f1eafa-8220-484f-9ae8-75be4964d43a tempest-VolumesImageMetadata-1846734108 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea09136b-074b-4a00-ab92-6a0bf35df305) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:38:29 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-04f1eafa-8220-484f-9ae8-75be4964d43a tempest-VolumesImageMetadata-1846734108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86ec280d-d858-4b2c-9558-4cc353643f4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:38:29 devstack cinder-volume[88899]: DEBUG cinder.image.glance [None req-04f1eafa-8220-484f-9ae8-75be4964d43a tempest-VolumesImageMetadata-1846734108 None] Creating Keystone auth plugin from conf {{(pid=88899) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Aug 03 08:38:30 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-04f1eafa-8220-484f-9ae8-75be4964d43a tempest-VolumesImageMetadata-1846734108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86ec280d-d858-4b2c-9558-4cc353643f4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '3cf8c599-e87a-49dd-9348-8f2c7365ca5f', 'volume_name': 'volume-3cf8c599-e87a-49dd-9348-8f2c7365ca5f', 'volume_size': 1, 'image_id': '37045a76-b9b1-4156-b15f-85c62a8616c3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/37045a76-b9b1-4156-b15f-85c62a8616c3', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'adee82974e9f41769efcb3f4a0eef199', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '37045a76-b9b1-4156-b15f-85c62a8616c3', 'created_at': datetime.datetime(2026, 8, 3, 6, 23, 4, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 3, 6, 23, 6, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/37045a76-b9b1-4156-b15f-85c62a8616c3/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:38:30 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-04f1eafa-8220-484f-9ae8-75be4964d43a tempest-VolumesImageMetadata-1846734108 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (19615ff8-12a3-4695-9990-8f8060267834) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:38:30 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-04f1eafa-8220-484f-9ae8-75be4964d43a tempest-VolumesImageMetadata-1846734108 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (19615ff8-12a3-4695-9990-8f8060267834) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:38:30 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-04f1eafa-8220-484f-9ae8-75be4964d43a tempest-VolumesImageMetadata-1846734108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38f12775-bca2-449d-9b6a-6b1df5790d6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:38:30 devstack cinder-volume[88899]: INFO cinder.volume.flows.manager.create_volume [None req-04f1eafa-8220-484f-9ae8-75be4964d43a tempest-VolumesImageMetadata-1846734108 None] Volume 3cf8c599-e87a-49dd-9348-8f2c7365ca5f: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-3cf8c599-e87a-49dd-9348-8f2c7365ca5f', 'volume_size': 1, 'image_id': '37045a76-b9b1-4156-b15f-85c62a8616c3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/37045a76-b9b1-4156-b15f-85c62a8616c3', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'adee82974e9f41769efcb3f4a0eef199', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '37045a76-b9b1-4156-b15f-85c62a8616c3', 'created_at': datetime.datetime(2026, 8, 3, 6, 23, 4, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 3, 6, 23, 6, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/37045a76-b9b1-4156-b15f-85c62a8616c3/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Aug 03 08:38:30 devstack cinder-volume[88899]: DEBUG cinder.volume.flows.manager.create_volume [None req-04f1eafa-8220-484f-9ae8-75be4964d43a tempest-VolumesImageMetadata-1846734108 None] Trying to clone 3cf8c599-e87a-49dd-9348-8f2c7365ca5f from image 37045a76-b9b1-4156-b15f-85c62a8616c3 at location (None, [{'url': 'file:///opt/stack/data/glance/images/37045a76-b9b1-4156-b15f-85c62a8616c3', 'metadata': {}}]). {{(pid=88899) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Aug 03 08:38:30 devstack cinder-volume[88899]: DEBUG cinder.image.image_utils [None req-04f1eafa-8220-484f-9ae8-75be4964d43a tempest-VolumesImageMetadata-1846734108 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_37045a76-b9b1-4156-b15f-85c62a8616c3_5qdromtwdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=88899) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Aug 03 08:38:30 devstack cinder-volume[88899]: INFO cinder.image.image_utils [None req-04f1eafa-8220-484f-9ae8-75be4964d43a tempest-VolumesImageMetadata-1846734108 None] Image download 20.69 MB at 20.69 MB/s Aug 03 08:38:30 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[e12df832-169e-4d4b-b2e8-289d2cf1d409]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:38:30 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-04f1eafa-8220-484f-9ae8-75be4964d43a tempest-VolumesImageMetadata-1846734108 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_37045a76-b9b1-4156-b15f-85c62a8616c3_5qdromtwdevstack@QuobyteHD {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:38:31 devstack sudo[100781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_37045a76-b9b1-4156-b15f-85c62a8616c3_5qdromtwdevstack@QuobyteHD Aug 03 08:38:31 devstack sudo[100781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:38:31 devstack sudo[100781]: pam_unix(sudo:session): session closed for user root Aug 03 08:38:31 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-04f1eafa-8220-484f-9ae8-75be4964d43a tempest-VolumesImageMetadata-1846734108 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_37045a76-b9b1-4156-b15f-85c62a8616c3_5qdromtwdevstack@QuobyteHD" returned: 0 in 0.541s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:38:31 devstack cinder-volume[88899]: DEBUG cinder.image.image_utils [None req-04f1eafa-8220-484f-9ae8-75be4964d43a tempest-VolumesImageMetadata-1846734108 None] Temporary image 37045a76-b9b1-4156-b15f-85c62a8616c3 is fetched for user 5cfd4cb73de94f5da9a8d312e06b47a4. {{(pid=88899) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Aug 03 08:38:31 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[660f8ce0-dd44-4682-8de7-9ae5c4fee6d1]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:38:31 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-04f1eafa-8220-484f-9ae8-75be4964d43a tempest-VolumesImageMetadata-1846734108 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_37045a76-b9b1-4156-b15f-85c62a8616c3_5qdromtwdevstack@QuobyteHD {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:38:31 devstack sudo[100786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_37045a76-b9b1-4156-b15f-85c62a8616c3_5qdromtwdevstack@QuobyteHD Aug 03 08:38:31 devstack sudo[100786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:38:32 devstack sudo[100786]: pam_unix(sudo:session): session closed for user root Aug 03 08:38:32 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-04f1eafa-8220-484f-9ae8-75be4964d43a tempest-VolumesImageMetadata-1846734108 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_37045a76-b9b1-4156-b15f-85c62a8616c3_5qdromtwdevstack@QuobyteHD" returned: 0 in 0.459s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:38:32 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-04f1eafa-8220-484f-9ae8-75be4964d43a tempest-VolumesImageMetadata-1846734108 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:38:32 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-04f1eafa-8220-484f-9ae8-75be4964d43a tempest-VolumesImageMetadata-1846734108 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:38:32 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-04f1eafa-8220-484f-9ae8-75be4964d43a tempest-VolumesImageMetadata-1846734108 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:38:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1886440646',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3cf8c599-e87a-49dd-9348-8f2c7365ca5f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='920d6f81cd8a41418df224b6954a47f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:38:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:38:30Z,use_quota=True,user_id='5cfd4cb73de94f5da9a8d312e06b47a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8bde7129-1dc4-42ab-b852-ab32c61b4921),volume_type_id=8bde7129-1dc4-42ab-b852-ab32c61b4921)}" {{(pid=88899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 08:38:32 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-04f1eafa-8220-484f-9ae8-75be4964d43a tempest-VolumesImageMetadata-1846734108 None] Creating volume 3cf8c599-e87a-49dd-9348-8f2c7365ca5f {{(pid=88899) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 08:38:32 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-04f1eafa-8220-484f-9ae8-75be4964d43a tempest-VolumesImageMetadata-1846734108 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:38:32 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-04f1eafa-8220-484f-9ae8-75be4964d43a tempest-VolumesImageMetadata-1846734108 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:38:32 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-04f1eafa-8220-484f-9ae8-75be4964d43a tempest-VolumesImageMetadata-1846734108 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:38:32 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-04f1eafa-8220-484f-9ae8-75be4964d43a tempest-VolumesImageMetadata-1846734108 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:38:32 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-04f1eafa-8220-484f-9ae8-75be4964d43a tempest-VolumesImageMetadata-1846734108 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:38:32 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-04f1eafa-8220-484f-9ae8-75be4964d43a tempest-VolumesImageMetadata-1846734108 None] Selected osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385 as target Quobyte volume. {{(pid=88899) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 08:38:32 devstack cinder-volume[88899]: INFO cinder.volume.drivers.remotefs [None req-04f1eafa-8220-484f-9ae8-75be4964d43a tempest-VolumesImageMetadata-1846734108 None] casted to osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385 Aug 03 08:38:32 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-04f1eafa-8220-484f-9ae8-75be4964d43a tempest-VolumesImageMetadata-1846734108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-3cf8c599-e87a-49dd-9348-8f2c7365ca5f 1073741824 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:38:32 devstack cinder-volume[88899]: DEBUG cinder.volume.flows.manager.create_volume [None req-606fab7b-7b29-4235-919f-440b2c243e27 tempest-VolumesCloneTest-1143049529 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88899) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 08:38:32 devstack sudo[100792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-3cf8c599-e87a-49dd-9348-8f2c7365ca5f 1073741824 Aug 03 08:38:32 devstack sudo[100792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:38:32 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-606fab7b-7b29-4235-919f-440b2c243e27 tempest-VolumesCloneTest-1143049529 None] Flow 'volume_create_manager' (a49988fc-eac5-4230-858c-14503c1696f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:38:32 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-606fab7b-7b29-4235-919f-440b2c243e27 tempest-VolumesCloneTest-1143049529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (73e77f41-3eaa-45d0-8fb4-6ec66f45ae8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:38:32 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-606fab7b-7b29-4235-919f-440b2c243e27 tempest-VolumesCloneTest-1143049529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (73e77f41-3eaa-45d0-8fb4-6ec66f45ae8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:38:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-2059869263',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4429ad90-c38b-488e-8345-1d297ade4529,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e08a6d0fc354ec88bae7076aabe791e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:38:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:38:32Z,use_quota=True,user_id='19bbdd587c2f46a7a4de351b13af87a9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8bde7129-1dc4-42ab-b852-ab32c61b4921),volume_type_id=8bde7129-1dc4-42ab-b852-ab32c61b4921)' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:38:32 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-606fab7b-7b29-4235-919f-440b2c243e27 tempest-VolumesCloneTest-1143049529 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61fee3ee-2e4b-47c0-ab33-fbe18159cfb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:38:32 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-606fab7b-7b29-4235-919f-440b2c243e27 tempest-VolumesCloneTest-1143049529 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61fee3ee-2e4b-47c0-ab33-fbe18159cfb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:38:32 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-606fab7b-7b29-4235-919f-440b2c243e27 tempest-VolumesCloneTest-1143049529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac8fd30e-f579-42a9-abca-47d1cc6b09bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:38:32 devstack cinder-volume[88899]: DEBUG cinder.image.glance [None req-606fab7b-7b29-4235-919f-440b2c243e27 tempest-VolumesCloneTest-1143049529 None] Creating Keystone auth plugin from conf {{(pid=88899) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Aug 03 08:38:32 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-606fab7b-7b29-4235-919f-440b2c243e27 tempest-VolumesCloneTest-1143049529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac8fd30e-f579-42a9-abca-47d1cc6b09bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '4429ad90-c38b-488e-8345-1d297ade4529', 'volume_name': 'volume-4429ad90-c38b-488e-8345-1d297ade4529', 'volume_size': 1, 'image_id': '37045a76-b9b1-4156-b15f-85c62a8616c3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/37045a76-b9b1-4156-b15f-85c62a8616c3', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'adee82974e9f41769efcb3f4a0eef199', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '37045a76-b9b1-4156-b15f-85c62a8616c3', 'created_at': datetime.datetime(2026, 8, 3, 6, 23, 4, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 3, 6, 23, 6, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/37045a76-b9b1-4156-b15f-85c62a8616c3/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:38:32 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-606fab7b-7b29-4235-919f-440b2c243e27 tempest-VolumesCloneTest-1143049529 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (53ddb1de-b16d-4369-bdba-301bff47fe7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:38:32 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-606fab7b-7b29-4235-919f-440b2c243e27 tempest-VolumesCloneTest-1143049529 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (53ddb1de-b16d-4369-bdba-301bff47fe7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:38:32 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-606fab7b-7b29-4235-919f-440b2c243e27 tempest-VolumesCloneTest-1143049529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8360cc8f-f44c-42a2-8579-044eedf05e61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:38:32 devstack cinder-volume[88899]: INFO cinder.volume.flows.manager.create_volume [None req-606fab7b-7b29-4235-919f-440b2c243e27 tempest-VolumesCloneTest-1143049529 None] Volume 4429ad90-c38b-488e-8345-1d297ade4529: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-4429ad90-c38b-488e-8345-1d297ade4529', 'volume_size': 1, 'image_id': '37045a76-b9b1-4156-b15f-85c62a8616c3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/37045a76-b9b1-4156-b15f-85c62a8616c3', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'adee82974e9f41769efcb3f4a0eef199', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '37045a76-b9b1-4156-b15f-85c62a8616c3', 'created_at': datetime.datetime(2026, 8, 3, 6, 23, 4, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 3, 6, 23, 6, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/37045a76-b9b1-4156-b15f-85c62a8616c3/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Aug 03 08:38:32 devstack cinder-volume[88899]: DEBUG cinder.volume.flows.manager.create_volume [None req-606fab7b-7b29-4235-919f-440b2c243e27 tempest-VolumesCloneTest-1143049529 None] Trying to clone 4429ad90-c38b-488e-8345-1d297ade4529 from image 37045a76-b9b1-4156-b15f-85c62a8616c3 at location (None, [{'url': 'file:///opt/stack/data/glance/images/37045a76-b9b1-4156-b15f-85c62a8616c3', 'metadata': {}}]). {{(pid=88899) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Aug 03 08:38:33 devstack sudo[100792]: pam_unix(sudo:session): session closed for user root Aug 03 08:38:33 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-04f1eafa-8220-484f-9ae8-75be4964d43a tempest-VolumesImageMetadata-1846734108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-3cf8c599-e87a-49dd-9348-8f2c7365ca5f 1073741824" returned: 0 in 0.847s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:38:33 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-04f1eafa-8220-484f-9ae8-75be4964d43a tempest-VolumesImageMetadata-1846734108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-3cf8c599-e87a-49dd-9348-8f2c7365ca5f {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:38:33 devstack sudo[100800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-3cf8c599-e87a-49dd-9348-8f2c7365ca5f Aug 03 08:38:33 devstack sudo[100800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:38:33 devstack sudo[100800]: pam_unix(sudo:session): session closed for user root Aug 03 08:38:33 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-04f1eafa-8220-484f-9ae8-75be4964d43a tempest-VolumesImageMetadata-1846734108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-3cf8c599-e87a-49dd-9348-8f2c7365ca5f" returned: 0 in 0.488s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:38:33 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-04f1eafa-8220-484f-9ae8-75be4964d43a tempest-VolumesImageMetadata-1846734108 None] <== create_volume: return (1423ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'} {{(pid=88899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 08:38:33 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-04f1eafa-8220-484f-9ae8-75be4964d43a tempest-VolumesImageMetadata-1846734108 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.426s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:38:33 devstack cinder-volume[88899]: DEBUG cinder.image.image_utils [None req-606fab7b-7b29-4235-919f-440b2c243e27 tempest-VolumesCloneTest-1143049529 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_37045a76-b9b1-4156-b15f-85c62a8616c3_as4ktlezdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=88899) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Aug 03 08:38:33 devstack cinder-volume[88899]: INFO cinder.image.image_utils [None req-606fab7b-7b29-4235-919f-440b2c243e27 tempest-VolumesCloneTest-1143049529 None] Image download 20.69 MB at 20.69 MB/s Aug 03 08:38:33 devstack cinder-volume[88899]: DEBUG cinder.volume.volume_utils [None req-04f1eafa-8220-484f-9ae8-75be4964d43a tempest-VolumesImageMetadata-1846734108 None] Attempting download of 37045a76-b9b1-4156-b15f-85c62a8616c3 ((None, [{'url': 'file:///opt/stack/data/glance/images/37045a76-b9b1-4156-b15f-85c62a8616c3', 'metadata': {}}])) to volume 3cf8c599-e87a-49dd-9348-8f2c7365ca5f. {{(pid=88899) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Aug 03 08:38:33 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6d2f7ca-af41-4223-a3fb-0f1e3af89ec7]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:38:33 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-606fab7b-7b29-4235-919f-440b2c243e27 tempest-VolumesCloneTest-1143049529 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_37045a76-b9b1-4156-b15f-85c62a8616c3_as4ktlezdevstack@QuobyteHD {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:38:33 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[9571903b-a191-4a86-8956-896d6ea2a60e]: (4, 'raw') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:38:33 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-04f1eafa-8220-484f-9ae8-75be4964d43a tempest-VolumesImageMetadata-1846734108 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_37045a76-b9b1-4156-b15f-85c62a8616c3_lai_c9nf {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:38:34 devstack sudo[100804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_37045a76-b9b1-4156-b15f-85c62a8616c3_as4ktlezdevstack@QuobyteHD Aug 03 08:38:34 devstack sudo[100804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:38:34 devstack sudo[100805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_37045a76-b9b1-4156-b15f-85c62a8616c3_lai_c9nf Aug 03 08:38:34 devstack sudo[100805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:38:34 devstack sudo[100804]: pam_unix(sudo:session): session closed for user root Aug 03 08:38:34 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-606fab7b-7b29-4235-919f-440b2c243e27 tempest-VolumesCloneTest-1143049529 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_37045a76-b9b1-4156-b15f-85c62a8616c3_as4ktlezdevstack@QuobyteHD" returned: 0 in 0.521s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:38:34 devstack cinder-volume[88899]: DEBUG cinder.image.image_utils [None req-606fab7b-7b29-4235-919f-440b2c243e27 tempest-VolumesCloneTest-1143049529 None] Temporary image 37045a76-b9b1-4156-b15f-85c62a8616c3 is fetched for user 19bbdd587c2f46a7a4de351b13af87a9. {{(pid=88899) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Aug 03 08:38:34 devstack sudo[100805]: pam_unix(sudo:session): session closed for user root Aug 03 08:38:34 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-04f1eafa-8220-484f-9ae8-75be4964d43a tempest-VolumesImageMetadata-1846734108 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_37045a76-b9b1-4156-b15f-85c62a8616c3_lai_c9nf" returned: 0 in 0.560s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:38:34 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-04f1eafa-8220-484f-9ae8-75be4964d43a tempest-VolumesImageMetadata-1846734108 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_37045a76-b9b1-4156-b15f-85c62a8616c3_lai_c9nf {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:38:34 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[9eca2139-6c40-45fd-85f3-280f6e87c5c2]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:38:34 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-606fab7b-7b29-4235-919f-440b2c243e27 tempest-VolumesCloneTest-1143049529 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_37045a76-b9b1-4156-b15f-85c62a8616c3_as4ktlezdevstack@QuobyteHD {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:38:34 devstack sudo[100813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_37045a76-b9b1-4156-b15f-85c62a8616c3_lai_c9nf Aug 03 08:38:34 devstack sudo[100813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:38:34 devstack sudo[100814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_37045a76-b9b1-4156-b15f-85c62a8616c3_as4ktlezdevstack@QuobyteHD Aug 03 08:38:34 devstack sudo[100814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:38:34 devstack sudo[100813]: pam_unix(sudo:session): session closed for user root Aug 03 08:38:34 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-04f1eafa-8220-484f-9ae8-75be4964d43a tempest-VolumesImageMetadata-1846734108 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_37045a76-b9b1-4156-b15f-85c62a8616c3_lai_c9nf" returned: 1 in 0.453s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:38:34 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-04f1eafa-8220-484f-9ae8-75be4964d43a tempest-VolumesImageMetadata-1846734108 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_37045a76-b9b1-4156-b15f-85c62a8616c3_lai_c9nf' failed. Not Retrying. {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 03 08:38:34 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[497f9d17-0ba1-47eb-b8cd-887bf1858bef]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:38:34 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-04f1eafa-8220-484f-9ae8-75be4964d43a tempest-VolumesImageMetadata-1846734108 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_37045a76-b9b1-4156-b15f-85c62a8616c3_5qdromtwdevstack@QuobyteHD {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:38:34 devstack sudo[100814]: pam_unix(sudo:session): session closed for user root Aug 03 08:38:34 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-606fab7b-7b29-4235-919f-440b2c243e27 tempest-VolumesCloneTest-1143049529 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_37045a76-b9b1-4156-b15f-85c62a8616c3_as4ktlezdevstack@QuobyteHD" returned: 0 in 0.464s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:38:34 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-606fab7b-7b29-4235-919f-440b2c243e27 tempest-VolumesCloneTest-1143049529 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:38:34 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-606fab7b-7b29-4235-919f-440b2c243e27 tempest-VolumesCloneTest-1143049529 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:38:34 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-606fab7b-7b29-4235-919f-440b2c243e27 tempest-VolumesCloneTest-1143049529 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:38:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-2059869263',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4429ad90-c38b-488e-8345-1d297ade4529,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e08a6d0fc354ec88bae7076aabe791e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:38:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:38:32Z,use_quota=True,user_id='19bbdd587c2f46a7a4de351b13af87a9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8bde7129-1dc4-42ab-b852-ab32c61b4921),volume_type_id=8bde7129-1dc4-42ab-b852-ab32c61b4921)}" {{(pid=88899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 08:38:34 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-606fab7b-7b29-4235-919f-440b2c243e27 tempest-VolumesCloneTest-1143049529 None] Creating volume 4429ad90-c38b-488e-8345-1d297ade4529 {{(pid=88899) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 08:38:34 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-606fab7b-7b29-4235-919f-440b2c243e27 tempest-VolumesCloneTest-1143049529 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:38:34 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-606fab7b-7b29-4235-919f-440b2c243e27 tempest-VolumesCloneTest-1143049529 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:38:34 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-606fab7b-7b29-4235-919f-440b2c243e27 tempest-VolumesCloneTest-1143049529 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:38:34 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-606fab7b-7b29-4235-919f-440b2c243e27 tempest-VolumesCloneTest-1143049529 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:38:34 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-606fab7b-7b29-4235-919f-440b2c243e27 tempest-VolumesCloneTest-1143049529 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:38:34 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-606fab7b-7b29-4235-919f-440b2c243e27 tempest-VolumesCloneTest-1143049529 None] Selected osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385 as target Quobyte volume. {{(pid=88899) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 08:38:34 devstack cinder-volume[88899]: INFO cinder.volume.drivers.remotefs [None req-606fab7b-7b29-4235-919f-440b2c243e27 tempest-VolumesCloneTest-1143049529 None] casted to osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385 Aug 03 08:38:34 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-606fab7b-7b29-4235-919f-440b2c243e27 tempest-VolumesCloneTest-1143049529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-4429ad90-c38b-488e-8345-1d297ade4529 1073741824 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:38:34 devstack sudo[100823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-4429ad90-c38b-488e-8345-1d297ade4529 1073741824 Aug 03 08:38:34 devstack sudo[100823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:38:35 devstack sudo[100822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_37045a76-b9b1-4156-b15f-85c62a8616c3_5qdromtwdevstack@QuobyteHD Aug 03 08:38:35 devstack sudo[100822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:38:35 devstack sudo[100822]: pam_unix(sudo:session): session closed for user root Aug 03 08:38:35 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-04f1eafa-8220-484f-9ae8-75be4964d43a tempest-VolumesImageMetadata-1846734108 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_37045a76-b9b1-4156-b15f-85c62a8616c3_5qdromtwdevstack@QuobyteHD" returned: 0 in 0.532s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:38:35 devstack cinder-volume[88899]: DEBUG cinder.image.image_utils [None req-04f1eafa-8220-484f-9ae8-75be4964d43a tempest-VolumesImageMetadata-1846734108 None] 37045a76-b9b1-4156-b15f-85c62a8616c3 was qcow2, converting to qcow2 {{(pid=88899) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Aug 03 08:38:35 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-04f1eafa-8220-484f-9ae8-75be4964d43a tempest-VolumesImageMetadata-1846734108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_37045a76-b9b1-4156-b15f-85c62a8616c3_5qdromtwdevstack@QuobyteHD /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-3cf8c599-e87a-49dd-9348-8f2c7365ca5f {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:38:35 devstack sudo[100834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_37045a76-b9b1-4156-b15f-85c62a8616c3_5qdromtwdevstack@QuobyteHD /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-3cf8c599-e87a-49dd-9348-8f2c7365ca5f Aug 03 08:38:35 devstack sudo[100834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:38:35 devstack sudo[100823]: pam_unix(sudo:session): session closed for user root Aug 03 08:38:35 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-606fab7b-7b29-4235-919f-440b2c243e27 tempest-VolumesCloneTest-1143049529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-4429ad90-c38b-488e-8345-1d297ade4529 1073741824" returned: 0 in 0.622s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:38:35 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-606fab7b-7b29-4235-919f-440b2c243e27 tempest-VolumesCloneTest-1143049529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-4429ad90-c38b-488e-8345-1d297ade4529 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:38:35 devstack sudo[100836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-4429ad90-c38b-488e-8345-1d297ade4529 Aug 03 08:38:35 devstack sudo[100836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:38:36 devstack sudo[100836]: pam_unix(sudo:session): session closed for user root Aug 03 08:38:36 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-606fab7b-7b29-4235-919f-440b2c243e27 tempest-VolumesCloneTest-1143049529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-4429ad90-c38b-488e-8345-1d297ade4529" returned: 0 in 0.490s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:38:36 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-606fab7b-7b29-4235-919f-440b2c243e27 tempest-VolumesCloneTest-1143049529 None] <== create_volume: return (1178ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'} {{(pid=88899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 08:38:36 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-606fab7b-7b29-4235-919f-440b2c243e27 tempest-VolumesCloneTest-1143049529 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.183s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:38:36 devstack cinder-volume[88899]: DEBUG cinder.volume.volume_utils [None req-606fab7b-7b29-4235-919f-440b2c243e27 tempest-VolumesCloneTest-1143049529 None] Attempting download of 37045a76-b9b1-4156-b15f-85c62a8616c3 ((None, [{'url': 'file:///opt/stack/data/glance/images/37045a76-b9b1-4156-b15f-85c62a8616c3', 'metadata': {}}])) to volume 4429ad90-c38b-488e-8345-1d297ade4529. {{(pid=88899) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Aug 03 08:38:36 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2c78288-66e1-4586-b43d-e21b924b41d9]: (4, 'raw') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:38:36 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-606fab7b-7b29-4235-919f-440b2c243e27 tempest-VolumesCloneTest-1143049529 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_37045a76-b9b1-4156-b15f-85c62a8616c3_ibal_ekj {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:38:36 devstack sudo[100844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_37045a76-b9b1-4156-b15f-85c62a8616c3_ibal_ekj Aug 03 08:38:36 devstack sudo[100844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:38:36 devstack sudo[100844]: pam_unix(sudo:session): session closed for user root Aug 03 08:38:36 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-606fab7b-7b29-4235-919f-440b2c243e27 tempest-VolumesCloneTest-1143049529 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_37045a76-b9b1-4156-b15f-85c62a8616c3_ibal_ekj" returned: 0 in 0.471s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:38:36 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-606fab7b-7b29-4235-919f-440b2c243e27 tempest-VolumesCloneTest-1143049529 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_37045a76-b9b1-4156-b15f-85c62a8616c3_ibal_ekj {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:38:36 devstack sudo[100848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_37045a76-b9b1-4156-b15f-85c62a8616c3_ibal_ekj Aug 03 08:38:36 devstack sudo[100848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:38:37 devstack sudo[100848]: pam_unix(sudo:session): session closed for user root Aug 03 08:38:37 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-606fab7b-7b29-4235-919f-440b2c243e27 tempest-VolumesCloneTest-1143049529 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_37045a76-b9b1-4156-b15f-85c62a8616c3_ibal_ekj" returned: 1 in 0.418s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:38:37 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-606fab7b-7b29-4235-919f-440b2c243e27 tempest-VolumesCloneTest-1143049529 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_37045a76-b9b1-4156-b15f-85c62a8616c3_ibal_ekj' failed. Not Retrying. {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 03 08:38:37 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[e83d932c-0272-4a43-a692-bffe09b144be]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:38:37 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-606fab7b-7b29-4235-919f-440b2c243e27 tempest-VolumesCloneTest-1143049529 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_37045a76-b9b1-4156-b15f-85c62a8616c3_as4ktlezdevstack@QuobyteHD {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:38:37 devstack sudo[100852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_37045a76-b9b1-4156-b15f-85c62a8616c3_as4ktlezdevstack@QuobyteHD Aug 03 08:38:37 devstack sudo[100852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:38:37 devstack sudo[100852]: pam_unix(sudo:session): session closed for user root Aug 03 08:38:37 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-606fab7b-7b29-4235-919f-440b2c243e27 tempest-VolumesCloneTest-1143049529 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_37045a76-b9b1-4156-b15f-85c62a8616c3_as4ktlezdevstack@QuobyteHD" returned: 0 in 0.439s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:38:37 devstack cinder-volume[88899]: DEBUG cinder.image.image_utils [None req-606fab7b-7b29-4235-919f-440b2c243e27 tempest-VolumesCloneTest-1143049529 None] 37045a76-b9b1-4156-b15f-85c62a8616c3 was qcow2, converting to qcow2 {{(pid=88899) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Aug 03 08:38:37 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-606fab7b-7b29-4235-919f-440b2c243e27 tempest-VolumesCloneTest-1143049529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_37045a76-b9b1-4156-b15f-85c62a8616c3_as4ktlezdevstack@QuobyteHD /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-4429ad90-c38b-488e-8345-1d297ade4529 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:38:37 devstack sudo[100858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_37045a76-b9b1-4156-b15f-85c62a8616c3_as4ktlezdevstack@QuobyteHD /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-4429ad90-c38b-488e-8345-1d297ade4529 Aug 03 08:38:37 devstack sudo[100858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:38:37 devstack sudo[100834]: pam_unix(sudo:session): session closed for user root Aug 03 08:38:37 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-04f1eafa-8220-484f-9ae8-75be4964d43a tempest-VolumesImageMetadata-1846734108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_37045a76-b9b1-4156-b15f-85c62a8616c3_5qdromtwdevstack@QuobyteHD /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-3cf8c599-e87a-49dd-9348-8f2c7365ca5f" returned: 0 in 2.441s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:38:37 devstack cinder-volume[88899]: DEBUG cinder.image.image_utils [None req-04f1eafa-8220-484f-9ae8-75be4964d43a tempest-VolumesImageMetadata-1846734108 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_37045a76-b9b1-4156-b15f-85c62a8616c3_5qdromtwdevstack@QuobyteHD, size 112.00 MB, duration 2.44 sec, destination /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-3cf8c599-e87a-49dd-9348-8f2c7365ca5f {{(pid=88899) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 03 08:38:37 devstack cinder-volume[88899]: INFO cinder.image.image_utils [None req-04f1eafa-8220-484f-9ae8-75be4964d43a tempest-VolumesImageMetadata-1846734108 None] Converted 112.00 MB image at 45.86 MB/s Aug 03 08:38:37 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-04f1eafa-8220-484f-9ae8-75be4964d43a tempest-VolumesImageMetadata-1846734108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-3cf8c599-e87a-49dd-9348-8f2c7365ca5f 1G {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:38:37 devstack sudo[100860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-3cf8c599-e87a-49dd-9348-8f2c7365ca5f 1G Aug 03 08:38:37 devstack sudo[100860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:38:38 devstack sudo[100860]: pam_unix(sudo:session): session closed for user root Aug 03 08:38:38 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-04f1eafa-8220-484f-9ae8-75be4964d43a tempest-VolumesImageMetadata-1846734108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-3cf8c599-e87a-49dd-9348-8f2c7365ca5f 1G" returned: 0 in 0.434s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:38:38 devstack cinder-volume[88899]: DEBUG cinder.volume.volume_utils [None req-04f1eafa-8220-484f-9ae8-75be4964d43a tempest-VolumesImageMetadata-1846734108 None] Downloaded image 37045a76-b9b1-4156-b15f-85c62a8616c3 ((None, [{'url': 'file:///opt/stack/data/glance/images/37045a76-b9b1-4156-b15f-85c62a8616c3', 'metadata': {}}])) to volume 3cf8c599-e87a-49dd-9348-8f2c7365ca5f successfully. {{(pid=88899) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Aug 03 08:38:38 devstack cinder-volume[88899]: DEBUG cinder.image.image_utils [None req-04f1eafa-8220-484f-9ae8-75be4964d43a tempest-VolumesImageMetadata-1846734108 None] Temporary image 37045a76-b9b1-4156-b15f-85c62a8616c3 for user 5cfd4cb73de94f5da9a8d312e06b47a4 is deleted. {{(pid=88899) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Aug 03 08:38:38 devstack cinder-volume[88899]: DEBUG cinder.volume.volume_utils [None req-04f1eafa-8220-484f-9ae8-75be4964d43a tempest-VolumesImageMetadata-1846734108 None] Marking volume 3cf8c599-e87a-49dd-9348-8f2c7365ca5f as bootable. {{(pid=88899) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Aug 03 08:38:38 devstack cinder-volume[88899]: DEBUG cinder.volume.flows.manager.create_volume [None req-04f1eafa-8220-484f-9ae8-75be4964d43a tempest-VolumesImageMetadata-1846734108 None] Copying metadata from image 37045a76-b9b1-4156-b15f-85c62a8616c3 to 3cf8c599-e87a-49dd-9348-8f2c7365ca5f. {{(pid=88899) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Aug 03 08:38:38 devstack cinder-volume[88899]: DEBUG cinder.volume.flows.manager.create_volume [None req-04f1eafa-8220-484f-9ae8-75be4964d43a tempest-VolumesImageMetadata-1846734108 None] Creating volume glance metadata for volume 3cf8c599-e87a-49dd-9348-8f2c7365ca5f backed by image 37045a76-b9b1-4156-b15f-85c62a8616c3 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '37045a76-b9b1-4156-b15f-85c62a8616c3', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=88899) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Aug 03 08:38:38 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-04f1eafa-8220-484f-9ae8-75be4964d43a tempest-VolumesImageMetadata-1846734108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38f12775-bca2-449d-9b6a-6b1df5790d6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3cf8c599-e87a-49dd-9348-8f2c7365ca5f', 'volume_size': 1, 'image_id': '37045a76-b9b1-4156-b15f-85c62a8616c3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/37045a76-b9b1-4156-b15f-85c62a8616c3', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'adee82974e9f41769efcb3f4a0eef199', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '37045a76-b9b1-4156-b15f-85c62a8616c3', 'created_at': datetime.datetime(2026, 8, 3, 6, 23, 4, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 3, 6, 23, 6, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/37045a76-b9b1-4156-b15f-85c62a8616c3/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:38:38 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-04f1eafa-8220-484f-9ae8-75be4964d43a tempest-VolumesImageMetadata-1846734108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3229b760-63c6-4756-85dd-0ac39c98666d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:38:38 devstack cinder-volume[88899]: INFO cinder.volume.flows.manager.create_volume [None req-04f1eafa-8220-484f-9ae8-75be4964d43a tempest-VolumesImageMetadata-1846734108 None] Volume volume-3cf8c599-e87a-49dd-9348-8f2c7365ca5f (3cf8c599-e87a-49dd-9348-8f2c7365ca5f): created successfully Aug 03 08:38:38 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-04f1eafa-8220-484f-9ae8-75be4964d43a tempest-VolumesImageMetadata-1846734108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3229b760-63c6-4756-85dd-0ac39c98666d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:38:38 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-04f1eafa-8220-484f-9ae8-75be4964d43a tempest-VolumesImageMetadata-1846734108 None] Flow 'volume_create_manager' (8eea574b-4643-4fae-90bf-8ac38bd94b42) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:38:38 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-04f1eafa-8220-484f-9ae8-75be4964d43a tempest-VolumesImageMetadata-1846734108 None] Created volume successfully. Aug 03 08:38:39 devstack sudo[100858]: pam_unix(sudo:session): session closed for user root Aug 03 08:38:39 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-606fab7b-7b29-4235-919f-440b2c243e27 tempest-VolumesCloneTest-1143049529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_37045a76-b9b1-4156-b15f-85c62a8616c3_as4ktlezdevstack@QuobyteHD /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-4429ad90-c38b-488e-8345-1d297ade4529" returned: 0 in 2.390s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:38:39 devstack cinder-volume[88899]: DEBUG cinder.image.image_utils [None req-606fab7b-7b29-4235-919f-440b2c243e27 tempest-VolumesCloneTest-1143049529 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_37045a76-b9b1-4156-b15f-85c62a8616c3_as4ktlezdevstack@QuobyteHD, size 112.00 MB, duration 2.39 sec, destination /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-4429ad90-c38b-488e-8345-1d297ade4529 {{(pid=88899) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 03 08:38:39 devstack cinder-volume[88899]: INFO cinder.image.image_utils [None req-606fab7b-7b29-4235-919f-440b2c243e27 tempest-VolumesCloneTest-1143049529 None] Converted 112.00 MB image at 46.85 MB/s Aug 03 08:38:39 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-606fab7b-7b29-4235-919f-440b2c243e27 tempest-VolumesCloneTest-1143049529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-4429ad90-c38b-488e-8345-1d297ade4529 1G {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:38:40 devstack sudo[100873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-4429ad90-c38b-488e-8345-1d297ade4529 1G Aug 03 08:38:40 devstack sudo[100873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:38:40 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-fdf5da10-3ed3-4552-88c8-ec84ff0b880f tempest-VolumesImageMetadata-1846734108 None] Acquiring lock "cinder-3cf8c599-e87a-49dd-9348-8f2c7365ca5f-delete_volume" by "delete_volume" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:38:40 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-fdf5da10-3ed3-4552-88c8-ec84ff0b880f tempest-VolumesImageMetadata-1846734108 None] Lock "cinder-3cf8c599-e87a-49dd-9348-8f2c7365ca5f-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:38:40 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-fdf5da10-3ed3-4552-88c8-ec84ff0b880f tempest-VolumesImageMetadata-1846734108 None] Acquiring lock "cinder-quobyte-3cf8c599-e87a-49dd-9348-8f2c7365ca5f" by "delete_volume" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:38:40 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-fdf5da10-3ed3-4552-88c8-ec84ff0b880f tempest-VolumesImageMetadata-1846734108 None] Lock "cinder-quobyte-3cf8c599-e87a-49dd-9348-8f2c7365ca5f" acquired by "delete_volume" :: waited 0.019s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:38:40 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e8ff710-8afb-433f-a41a-2bf70a5e7938]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:38:40 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-fdf5da10-3ed3-4552-88c8-ec84ff0b880f tempest-VolumesImageMetadata-1846734108 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-3cf8c599-e87a-49dd-9348-8f2c7365ca5f {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:38:40 devstack sudo[100875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-3cf8c599-e87a-49dd-9348-8f2c7365ca5f Aug 03 08:38:40 devstack sudo[100875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:38:40 devstack sudo[100873]: pam_unix(sudo:session): session closed for user root Aug 03 08:38:40 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-606fab7b-7b29-4235-919f-440b2c243e27 tempest-VolumesCloneTest-1143049529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-4429ad90-c38b-488e-8345-1d297ade4529 1G" returned: 0 in 0.506s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:38:40 devstack cinder-volume[88899]: DEBUG cinder.volume.volume_utils [None req-606fab7b-7b29-4235-919f-440b2c243e27 tempest-VolumesCloneTest-1143049529 None] Downloaded image 37045a76-b9b1-4156-b15f-85c62a8616c3 ((None, [{'url': 'file:///opt/stack/data/glance/images/37045a76-b9b1-4156-b15f-85c62a8616c3', 'metadata': {}}])) to volume 4429ad90-c38b-488e-8345-1d297ade4529 successfully. {{(pid=88899) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Aug 03 08:38:40 devstack cinder-volume[88899]: DEBUG cinder.image.image_utils [None req-606fab7b-7b29-4235-919f-440b2c243e27 tempest-VolumesCloneTest-1143049529 None] Temporary image 37045a76-b9b1-4156-b15f-85c62a8616c3 for user 19bbdd587c2f46a7a4de351b13af87a9 is deleted. {{(pid=88899) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Aug 03 08:38:40 devstack cinder-volume[88899]: DEBUG cinder.volume.volume_utils [None req-606fab7b-7b29-4235-919f-440b2c243e27 tempest-VolumesCloneTest-1143049529 None] Marking volume 4429ad90-c38b-488e-8345-1d297ade4529 as bootable. {{(pid=88899) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Aug 03 08:38:40 devstack cinder-volume[88899]: DEBUG cinder.volume.flows.manager.create_volume [None req-606fab7b-7b29-4235-919f-440b2c243e27 tempest-VolumesCloneTest-1143049529 None] Copying metadata from image 37045a76-b9b1-4156-b15f-85c62a8616c3 to 4429ad90-c38b-488e-8345-1d297ade4529. {{(pid=88899) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Aug 03 08:38:40 devstack cinder-volume[88899]: DEBUG cinder.volume.flows.manager.create_volume [None req-606fab7b-7b29-4235-919f-440b2c243e27 tempest-VolumesCloneTest-1143049529 None] Creating volume glance metadata for volume 4429ad90-c38b-488e-8345-1d297ade4529 backed by image 37045a76-b9b1-4156-b15f-85c62a8616c3 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '37045a76-b9b1-4156-b15f-85c62a8616c3', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=88899) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Aug 03 08:38:40 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-606fab7b-7b29-4235-919f-440b2c243e27 tempest-VolumesCloneTest-1143049529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8360cc8f-f44c-42a2-8579-044eedf05e61) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4429ad90-c38b-488e-8345-1d297ade4529', 'volume_size': 1, 'image_id': '37045a76-b9b1-4156-b15f-85c62a8616c3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/37045a76-b9b1-4156-b15f-85c62a8616c3', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'adee82974e9f41769efcb3f4a0eef199', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '37045a76-b9b1-4156-b15f-85c62a8616c3', 'created_at': datetime.datetime(2026, 8, 3, 6, 23, 4, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 3, 6, 23, 6, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/37045a76-b9b1-4156-b15f-85c62a8616c3/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:38:40 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-606fab7b-7b29-4235-919f-440b2c243e27 tempest-VolumesCloneTest-1143049529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d418d93e-186e-4a6c-a073-86be092c976f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:38:40 devstack cinder-volume[88899]: INFO cinder.volume.flows.manager.create_volume [None req-606fab7b-7b29-4235-919f-440b2c243e27 tempest-VolumesCloneTest-1143049529 None] Volume volume-4429ad90-c38b-488e-8345-1d297ade4529 (4429ad90-c38b-488e-8345-1d297ade4529): created successfully Aug 03 08:38:40 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-606fab7b-7b29-4235-919f-440b2c243e27 tempest-VolumesCloneTest-1143049529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d418d93e-186e-4a6c-a073-86be092c976f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:38:40 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-606fab7b-7b29-4235-919f-440b2c243e27 tempest-VolumesCloneTest-1143049529 None] Flow 'volume_create_manager' (a49988fc-eac5-4230-858c-14503c1696f4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:38:40 devstack sudo[100875]: pam_unix(sudo:session): session closed for user root Aug 03 08:38:40 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-fdf5da10-3ed3-4552-88c8-ec84ff0b880f tempest-VolumesImageMetadata-1846734108 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-3cf8c599-e87a-49dd-9348-8f2c7365ca5f" returned: 0 in 0.494s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:38:40 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-fdf5da10-3ed3-4552-88c8-ec84ff0b880f tempest-VolumesImageMetadata-1846734108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-3cf8c599-e87a-49dd-9348-8f2c7365ca5f {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:38:40 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-606fab7b-7b29-4235-919f-440b2c243e27 tempest-VolumesCloneTest-1143049529 None] Created volume successfully. Aug 03 08:38:40 devstack sudo[100883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-3cf8c599-e87a-49dd-9348-8f2c7365ca5f Aug 03 08:38:40 devstack sudo[100883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:38:40 devstack sudo[100883]: pam_unix(sudo:session): session closed for user root Aug 03 08:38:41 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-fdf5da10-3ed3-4552-88c8-ec84ff0b880f tempest-VolumesImageMetadata-1846734108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-3cf8c599-e87a-49dd-9348-8f2c7365ca5f" returned: 0 in 0.298s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:38:41 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-fdf5da10-3ed3-4552-88c8-ec84ff0b880f tempest-VolumesImageMetadata-1846734108 None] Lock "cinder-quobyte-3cf8c599-e87a-49dd-9348-8f2c7365ca5f" released by "delete_volume" :: held 0.856s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:38:41 devstack cinder-volume[88899]: DEBUG cinder.quota [None req-fdf5da10-3ed3-4552-88c8-ec84ff0b880f tempest-VolumesImageMetadata-1846734108 None] Created reservations ['89b25242-743e-48a8-b364-007044e655d2', '44c78222-9cd3-4d4e-95f1-5668ac58269d', '1376dd28-145a-4595-ac98-75aa982272f9', '5acfd2d9-be6b-4fdf-89b1-300db3b961f5'] {{(pid=88899) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 08:38:41 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-fdf5da10-3ed3-4552-88c8-ec84ff0b880f tempest-VolumesImageMetadata-1846734108 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:38:41 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-fdf5da10-3ed3-4552-88c8-ec84ff0b880f tempest-VolumesImageMetadata-1846734108 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:38:41 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-fdf5da10-3ed3-4552-88c8-ec84ff0b880f tempest-VolumesImageMetadata-1846734108 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:38:41 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-fdf5da10-3ed3-4552-88c8-ec84ff0b880f tempest-VolumesImageMetadata-1846734108 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:38:41 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-fdf5da10-3ed3-4552-88c8-ec84ff0b880f tempest-VolumesImageMetadata-1846734108 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:38:41 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-fdf5da10-3ed3-4552-88c8-ec84ff0b880f tempest-VolumesImageMetadata-1846734108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:38:41 devstack sudo[100886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a Aug 03 08:38:41 devstack sudo[100886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:38:41 devstack cinder-volume[88899]: DEBUG cinder.volume.flows.manager.create_volume [None req-bed6baaf-8f0b-490f-b592-d936fcecdcfe tempest-VolumesCloneTest-1143049529 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88899) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 08:38:41 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-bed6baaf-8f0b-490f-b592-d936fcecdcfe tempest-VolumesCloneTest-1143049529 None] Flow 'volume_create_manager' (f423ab97-26aa-4291-b87b-36739d87d10e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:38:41 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-bed6baaf-8f0b-490f-b592-d936fcecdcfe tempest-VolumesCloneTest-1143049529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bfc1b5d5-90da-4559-aac8-c0056d1401c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:38:41 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-bed6baaf-8f0b-490f-b592-d936fcecdcfe tempest-VolumesCloneTest-1143049529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bfc1b5d5-90da-4559-aac8-c0056d1401c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=True,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:38:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-2099751501',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d0a1d42-49dd-4d90-b28b-6fd21858841c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e08a6d0fc354ec88bae7076aabe791e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:38:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=4429ad90-c38b-488e-8345-1d297ade4529,status='creating',terminated_at=None,updated_at=2026-08-03T06:38:41Z,use_quota=True,user_id='19bbdd587c2f46a7a4de351b13af87a9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8bde7129-1dc4-42ab-b852-ab32c61b4921),volume_type_id=8bde7129-1dc4-42ab-b852-ab32c61b4921)' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:38:41 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-bed6baaf-8f0b-490f-b592-d936fcecdcfe tempest-VolumesCloneTest-1143049529 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (35ca29a1-8745-4308-83bd-09e8786484fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:38:41 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-bed6baaf-8f0b-490f-b592-d936fcecdcfe tempest-VolumesCloneTest-1143049529 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (35ca29a1-8745-4308-83bd-09e8786484fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:38:41 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-bed6baaf-8f0b-490f-b592-d936fcecdcfe tempest-VolumesCloneTest-1143049529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7bb4f5bb-e338-42be-96d0-c0e99d7358bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:38:41 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-bed6baaf-8f0b-490f-b592-d936fcecdcfe tempest-VolumesCloneTest-1143049529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7bb4f5bb-e338-42be-96d0-c0e99d7358bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '6d0a1d42-49dd-4d90-b28b-6fd21858841c', 'volume_name': 'volume-6d0a1d42-49dd-4d90-b28b-6fd21858841c', 'volume_size': 1, 'source_volid': '4429ad90-c38b-488e-8345-1d297ade4529', 'source_volstatus': 'available'}' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:38:41 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-bed6baaf-8f0b-490f-b592-d936fcecdcfe tempest-VolumesCloneTest-1143049529 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b8ed1006-4e33-4dd1-a85e-ad23f2ed5be3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:38:41 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-bed6baaf-8f0b-490f-b592-d936fcecdcfe tempest-VolumesCloneTest-1143049529 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b8ed1006-4e33-4dd1-a85e-ad23f2ed5be3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:38:41 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-bed6baaf-8f0b-490f-b592-d936fcecdcfe tempest-VolumesCloneTest-1143049529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (960f27eb-6a64-413a-bf62-3ae05175d888) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:38:41 devstack cinder-volume[88899]: INFO cinder.volume.flows.manager.create_volume [None req-bed6baaf-8f0b-490f-b592-d936fcecdcfe tempest-VolumesCloneTest-1143049529 None] Volume 6d0a1d42-49dd-4d90-b28b-6fd21858841c: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-6d0a1d42-49dd-4d90-b28b-6fd21858841c', 'volume_size': 1, 'source_volid': '4429ad90-c38b-488e-8345-1d297ade4529', 'source_volstatus': 'available'} Aug 03 08:38:41 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-fdf5da10-3ed3-4552-88c8-ec84ff0b880f tempest-VolumesImageMetadata-1846734108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a" returned: 0 in 0.483s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:38:41 devstack sudo[100886]: pam_unix(sudo:session): session closed for user root Aug 03 08:38:41 devstack cinder-volume[88899]: DEBUG cinder.manager [None req-fdf5da10-3ed3-4552-88c8-ec84ff0b880f tempest-VolumesImageMetadata-1846734108 None] Notifying Schedulers of capabilities ... {{(pid=88899) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 08:38:41 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-fdf5da10-3ed3-4552-88c8-ec84ff0b880f tempest-VolumesImageMetadata-1846734108 None] Deleted volume successfully. Aug 03 08:38:41 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-bed6baaf-8f0b-490f-b592-d936fcecdcfe tempest-VolumesCloneTest-1143049529 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:38:41 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-bed6baaf-8f0b-490f-b592-d936fcecdcfe tempest-VolumesCloneTest-1143049529 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:38:41 devstack cinder-volume[88899]: INFO cinder.volume.drivers.remotefs [None req-bed6baaf-8f0b-490f-b592-d936fcecdcfe tempest-VolumesCloneTest-1143049529 None] Cloning volume 4429ad90-c38b-488e-8345-1d297ade4529 to volume 6d0a1d42-49dd-4d90-b28b-6fd21858841c Aug 03 08:38:41 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-fdf5da10-3ed3-4552-88c8-ec84ff0b880f tempest-VolumesImageMetadata-1846734108 None] Lock "cinder-3cf8c599-e87a-49dd-9348-8f2c7365ca5f-delete_volume" released by "delete_volume" :: held 1.733s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:38:41 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-bed6baaf-8f0b-490f-b592-d936fcecdcfe tempest-VolumesCloneTest-1143049529 None] Creating offline snapshot c8d5af8f-2825-4e56-8ee5-1b08d55430b9 of volume 4429ad90-c38b-488e-8345-1d297ade4529 {{(pid=88899) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 03 08:38:41 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[07d81ee9-ec07-44bc-971e-1cc8a4c15a37]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:38:41 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-bed6baaf-8f0b-490f-b592-d936fcecdcfe tempest-VolumesCloneTest-1143049529 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-4429ad90-c38b-488e-8345-1d297ade4529 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:38:42 devstack sudo[100889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-4429ad90-c38b-488e-8345-1d297ade4529 Aug 03 08:38:42 devstack sudo[100889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:38:42 devstack sudo[100889]: pam_unix(sudo:session): session closed for user root Aug 03 08:38:42 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-bed6baaf-8f0b-490f-b592-d936fcecdcfe tempest-VolumesCloneTest-1143049529 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-4429ad90-c38b-488e-8345-1d297ade4529" returned: 0 in 0.452s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:38:42 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-bed6baaf-8f0b-490f-b592-d936fcecdcfe tempest-VolumesCloneTest-1143049529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-4429ad90-c38b-488e-8345-1d297ade4529,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-4429ad90-c38b-488e-8345-1d297ade4529.c8d5af8f-2825-4e56-8ee5-1b08d55430b9 1G {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:38:42 devstack sudo[100894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-4429ad90-c38b-488e-8345-1d297ade4529,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-4429ad90-c38b-488e-8345-1d297ade4529.c8d5af8f-2825-4e56-8ee5-1b08d55430b9 1G Aug 03 08:38:42 devstack sudo[100894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:38:42 devstack sudo[100894]: pam_unix(sudo:session): session closed for user root Aug 03 08:38:42 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-bed6baaf-8f0b-490f-b592-d936fcecdcfe tempest-VolumesCloneTest-1143049529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-4429ad90-c38b-488e-8345-1d297ade4529,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-4429ad90-c38b-488e-8345-1d297ade4529.c8d5af8f-2825-4e56-8ee5-1b08d55430b9 1G" returned: 0 in 0.654s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:38:42 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-bed6baaf-8f0b-490f-b592-d936fcecdcfe tempest-VolumesCloneTest-1143049529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4429ad90-c38b-488e-8345-1d297ade4529 -F qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-4429ad90-c38b-488e-8345-1d297ade4529.c8d5af8f-2825-4e56-8ee5-1b08d55430b9 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:38:43 devstack sudo[100900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4429ad90-c38b-488e-8345-1d297ade4529 -F qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-4429ad90-c38b-488e-8345-1d297ade4529.c8d5af8f-2825-4e56-8ee5-1b08d55430b9 Aug 03 08:38:43 devstack sudo[100900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:38:43 devstack sudo[100900]: pam_unix(sudo:session): session closed for user root Aug 03 08:38:43 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-bed6baaf-8f0b-490f-b592-d936fcecdcfe tempest-VolumesCloneTest-1143049529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4429ad90-c38b-488e-8345-1d297ade4529 -F qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-4429ad90-c38b-488e-8345-1d297ade4529.c8d5af8f-2825-4e56-8ee5-1b08d55430b9" returned: 0 in 0.432s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:38:43 devstack cinder-volume[88899]: WARNING cinder.volume.drivers.remotefs [None req-bed6baaf-8f0b-490f-b592-d936fcecdcfe tempest-VolumesCloneTest-1143049529 None] /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-4429ad90-c38b-488e-8345-1d297ade4529.c8d5af8f-2825-4e56-8ee5-1b08d55430b9 is being set with open permissions: ugo+rw Aug 03 08:38:43 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-bed6baaf-8f0b-490f-b592-d936fcecdcfe tempest-VolumesCloneTest-1143049529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-4429ad90-c38b-488e-8345-1d297ade4529.c8d5af8f-2825-4e56-8ee5-1b08d55430b9 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:38:43 devstack sudo[100905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-4429ad90-c38b-488e-8345-1d297ade4529.c8d5af8f-2825-4e56-8ee5-1b08d55430b9 Aug 03 08:38:43 devstack sudo[100905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:38:43 devstack sudo[100905]: pam_unix(sudo:session): session closed for user root Aug 03 08:38:43 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-bed6baaf-8f0b-490f-b592-d936fcecdcfe tempest-VolumesCloneTest-1143049529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-4429ad90-c38b-488e-8345-1d297ade4529.c8d5af8f-2825-4e56-8ee5-1b08d55430b9" returned: 0 in 0.314s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:38:43 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-bed6baaf-8f0b-490f-b592-d936fcecdcfe tempest-VolumesCloneTest-1143049529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-4429ad90-c38b-488e-8345-1d297ade4529.info {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:38:43 devstack sudo[100908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-4429ad90-c38b-488e-8345-1d297ade4529.info Aug 03 08:38:43 devstack sudo[100908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:38:44 devstack sudo[100908]: pam_unix(sudo:session): session closed for user root Aug 03 08:38:44 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-bed6baaf-8f0b-490f-b592-d936fcecdcfe tempest-VolumesCloneTest-1143049529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-4429ad90-c38b-488e-8345-1d297ade4529.info" returned: 0 in 0.277s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:38:44 devstack cinder-volume[88899]: WARNING cinder.volume.drivers.remotefs [None req-bed6baaf-8f0b-490f-b592-d936fcecdcfe tempest-VolumesCloneTest-1143049529 None] /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-4429ad90-c38b-488e-8345-1d297ade4529.info is being set with open permissions: ugo+rw Aug 03 08:38:44 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-bed6baaf-8f0b-490f-b592-d936fcecdcfe tempest-VolumesCloneTest-1143049529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-4429ad90-c38b-488e-8345-1d297ade4529.info {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:38:44 devstack sudo[100911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-4429ad90-c38b-488e-8345-1d297ade4529.info Aug 03 08:38:44 devstack sudo[100911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:38:44 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-1e547e02-8e0c-45b9-843a-a4cc980a937f tempest-GroupsTest-63405649 None] Group tempest-Group1-693590874: creating Aug 03 08:38:44 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-1e547e02-8e0c-45b9-843a-a4cc980a937f tempest-GroupsTest-63405649 None] Group tempest-Group1-693590874: created successfully Aug 03 08:38:44 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-1e547e02-8e0c-45b9-843a-a4cc980a937f tempest-GroupsTest-63405649 None] Create group completed successfully. Aug 03 08:38:44 devstack sudo[100911]: pam_unix(sudo:session): session closed for user root Aug 03 08:38:44 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-bed6baaf-8f0b-490f-b592-d936fcecdcfe tempest-VolumesCloneTest-1143049529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-4429ad90-c38b-488e-8345-1d297ade4529.info" returned: 0 in 0.352s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:38:44 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-bed6baaf-8f0b-490f-b592-d936fcecdcfe tempest-VolumesCloneTest-1143049529 None] Acquiring lock "cinder-quobyte-6d0a1d42-49dd-4d90-b28b-6fd21858841c" by "_copy_volume_from_snapshot" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:38:44 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-bed6baaf-8f0b-490f-b592-d936fcecdcfe tempest-VolumesCloneTest-1143049529 None] Lock "cinder-quobyte-6d0a1d42-49dd-4d90-b28b-6fd21858841c" acquired by "_copy_volume_from_snapshot" :: waited 0.018s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:38:44 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-bed6baaf-8f0b-490f-b592-d936fcecdcfe tempest-VolumesCloneTest-1143049529 None] snapshot: c8d5af8f-2825-4e56-8ee5-1b08d55430b9, volume: 6d0a1d42-49dd-4d90-b28b-6fd21858841c, {{(pid=88899) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Aug 03 08:38:44 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-bed6baaf-8f0b-490f-b592-d936fcecdcfe tempest-VolumesCloneTest-1143049529 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:38:44 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-bed6baaf-8f0b-490f-b592-d936fcecdcfe tempest-VolumesCloneTest-1143049529 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:38:44 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-bed6baaf-8f0b-490f-b592-d936fcecdcfe tempest-VolumesCloneTest-1143049529 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:38:44 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-bed6baaf-8f0b-490f-b592-d936fcecdcfe tempest-VolumesCloneTest-1143049529 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:38:44 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-bed6baaf-8f0b-490f-b592-d936fcecdcfe tempest-VolumesCloneTest-1143049529 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:38:44 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[58576809-6693-476c-b9e6-a4ce028b85b9]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:38:44 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-bed6baaf-8f0b-490f-b592-d936fcecdcfe tempest-VolumesCloneTest-1143049529 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-4429ad90-c38b-488e-8345-1d297ade4529.c8d5af8f-2825-4e56-8ee5-1b08d55430b9 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:38:44 devstack sudo[100914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-4429ad90-c38b-488e-8345-1d297ade4529.c8d5af8f-2825-4e56-8ee5-1b08d55430b9 Aug 03 08:38:44 devstack sudo[100914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:38:45 devstack sudo[100914]: pam_unix(sudo:session): session closed for user root Aug 03 08:38:45 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-bed6baaf-8f0b-490f-b592-d936fcecdcfe tempest-VolumesCloneTest-1143049529 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-4429ad90-c38b-488e-8345-1d297ade4529.c8d5af8f-2825-4e56-8ee5-1b08d55430b9" returned: 0 in 0.576s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:38:45 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-bed6baaf-8f0b-490f-b592-d936fcecdcfe tempest-VolumesCloneTest-1143049529 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4429ad90-c38b-488e-8345-1d297ade4529(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88899) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 03 08:38:45 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[40b3de11-6b2a-4c1b-9cfd-e18bd1230833]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:38:45 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-bed6baaf-8f0b-490f-b592-d936fcecdcfe tempest-VolumesCloneTest-1143049529 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-4429ad90-c38b-488e-8345-1d297ade4529 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:38:45 devstack sudo[100920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-4429ad90-c38b-488e-8345-1d297ade4529 Aug 03 08:38:45 devstack sudo[100920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:38:45 devstack sudo[100920]: pam_unix(sudo:session): session closed for user root Aug 03 08:38:45 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-bed6baaf-8f0b-490f-b592-d936fcecdcfe tempest-VolumesCloneTest-1143049529 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-4429ad90-c38b-488e-8345-1d297ade4529" returned: 0 in 0.525s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:38:45 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-bed6baaf-8f0b-490f-b592-d936fcecdcfe tempest-VolumesCloneTest-1143049529 None] will copy from snapshot at /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-4429ad90-c38b-488e-8345-1d297ade4529 {{(pid=88899) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Aug 03 08:38:45 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-bed6baaf-8f0b-490f-b592-d936fcecdcfe tempest-VolumesCloneTest-1143049529 None] Creating direct copy from snapshot {{(pid=88899) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Aug 03 08:38:45 devstack cinder-volume[88899]: DEBUG cinder.utils [None req-bed6baaf-8f0b-490f-b592-d936fcecdcfe tempest-VolumesCloneTest-1143049529 None] Path /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-6d0a1d42-49dd-4d90-b28b-6fd21858841c not found in is_blk_device check {{(pid=88899) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Aug 03 08:38:45 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-bed6baaf-8f0b-490f-b592-d936fcecdcfe tempest-VolumesCloneTest-1143049529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-4429ad90-c38b-488e-8345-1d297ade4529 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-6d0a1d42-49dd-4d90-b28b-6fd21858841c {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:38:45 devstack sudo[100925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-4429ad90-c38b-488e-8345-1d297ade4529 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-6d0a1d42-49dd-4d90-b28b-6fd21858841c Aug 03 08:38:45 devstack sudo[100925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:38:45 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-d8e21295-f6bd-43a9-8b10-053dc23cb11b tempest-GroupsTest-63405649 None] Group tempest-Group2-1282850110: creating Aug 03 08:38:45 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-d8e21295-f6bd-43a9-8b10-053dc23cb11b tempest-GroupsTest-63405649 None] Group tempest-Group2-1282850110: created successfully Aug 03 08:38:45 devstack cinder-volume[88899]: DEBUG cinder.volume.flows.manager.create_volume [None req-2f7ebaff-f992-4928-ba91-477dbedfc21f tempest-VolumesMetadataTest-380966294 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88899) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 08:38:45 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-2f7ebaff-f992-4928-ba91-477dbedfc21f tempest-VolumesMetadataTest-380966294 None] Flow 'volume_create_manager' (664bbaba-9ecc-48d2-9f62-f243314c1fdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:38:45 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-2f7ebaff-f992-4928-ba91-477dbedfc21f tempest-VolumesMetadataTest-380966294 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71191071-5fd6-4b0b-bbad-0aecc22b7836) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:38:45 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-d8e21295-f6bd-43a9-8b10-053dc23cb11b tempest-GroupsTest-63405649 None] Create group completed successfully. Aug 03 08:38:45 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-2f7ebaff-f992-4928-ba91-477dbedfc21f tempest-VolumesMetadataTest-380966294 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71191071-5fd6-4b0b-bbad-0aecc22b7836) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:38:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1672611305',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=70c77646-f70d-45cd-9706-eee1425903ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='887d5d3baf564412976d0164b1b114af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:38:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:38:46Z,use_quota=True,user_id='2599d356963a421d8d6347e80995ecb0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8bde7129-1dc4-42ab-b852-ab32c61b4921),volume_type_id=8bde7129-1dc4-42ab-b852-ab32c61b4921)' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:38:45 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-2f7ebaff-f992-4928-ba91-477dbedfc21f tempest-VolumesMetadataTest-380966294 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (355167ae-6ea8-41c1-a612-fa32b433afb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:38:45 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-2f7ebaff-f992-4928-ba91-477dbedfc21f tempest-VolumesMetadataTest-380966294 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (355167ae-6ea8-41c1-a612-fa32b433afb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:38:45 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-2f7ebaff-f992-4928-ba91-477dbedfc21f tempest-VolumesMetadataTest-380966294 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b05c460c-523d-401a-8768-9a8c0d2a60d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:38:45 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-2f7ebaff-f992-4928-ba91-477dbedfc21f tempest-VolumesMetadataTest-380966294 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b05c460c-523d-401a-8768-9a8c0d2a60d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '70c77646-f70d-45cd-9706-eee1425903ca', 'volume_name': 'volume-70c77646-f70d-45cd-9706-eee1425903ca', 'volume_size': 1}' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:38:45 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-2f7ebaff-f992-4928-ba91-477dbedfc21f tempest-VolumesMetadataTest-380966294 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52f18ece-fd15-4de7-8622-a5b7c092702b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:38:45 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-2f7ebaff-f992-4928-ba91-477dbedfc21f tempest-VolumesMetadataTest-380966294 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52f18ece-fd15-4de7-8622-a5b7c092702b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:38:45 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-2f7ebaff-f992-4928-ba91-477dbedfc21f tempest-VolumesMetadataTest-380966294 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db403228-f6ce-479b-b869-b822f740d52f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:38:45 devstack cinder-volume[88899]: INFO cinder.volume.flows.manager.create_volume [None req-2f7ebaff-f992-4928-ba91-477dbedfc21f tempest-VolumesMetadataTest-380966294 None] Volume 70c77646-f70d-45cd-9706-eee1425903ca: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-70c77646-f70d-45cd-9706-eee1425903ca', 'volume_size': 1} Aug 03 08:38:45 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-2f7ebaff-f992-4928-ba91-477dbedfc21f tempest-VolumesMetadataTest-380966294 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:38:47 devstack sudo[100925]: pam_unix(sudo:session): session closed for user root Aug 03 08:38:47 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-bed6baaf-8f0b-490f-b592-d936fcecdcfe tempest-VolumesCloneTest-1143049529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-4429ad90-c38b-488e-8345-1d297ade4529 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-6d0a1d42-49dd-4d90-b28b-6fd21858841c" returned: 0 in 1.628s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:38:47 devstack cinder-volume[88899]: DEBUG cinder.image.image_utils [None req-bed6baaf-8f0b-490f-b592-d936fcecdcfe tempest-VolumesCloneTest-1143049529 None] Image conversion details: src /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-4429ad90-c38b-488e-8345-1d297ade4529, size 1024.00 MB, duration 1.63 sec, destination /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-6d0a1d42-49dd-4d90-b28b-6fd21858841c {{(pid=88899) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 03 08:38:47 devstack cinder-volume[88899]: INFO cinder.image.image_utils [None req-bed6baaf-8f0b-490f-b592-d936fcecdcfe tempest-VolumesCloneTest-1143049529 None] Converted 1024.00 MB image at 628.68 MB/s Aug 03 08:38:47 devstack cinder-volume[88899]: WARNING cinder.volume.drivers.remotefs [None req-bed6baaf-8f0b-490f-b592-d936fcecdcfe tempest-VolumesCloneTest-1143049529 None] /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-6d0a1d42-49dd-4d90-b28b-6fd21858841c is being set with open permissions: ugo+rw Aug 03 08:38:47 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-bed6baaf-8f0b-490f-b592-d936fcecdcfe tempest-VolumesCloneTest-1143049529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-6d0a1d42-49dd-4d90-b28b-6fd21858841c {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:38:47 devstack sudo[100934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-6d0a1d42-49dd-4d90-b28b-6fd21858841c Aug 03 08:38:47 devstack sudo[100934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:38:47 devstack cinder-volume[88899]: DEBUG cinder.volume.flows.manager.create_volume [None req-4671e7ca-4b31-47d1-bf84-ccc7da3b7808 tempest-GroupsTest-63405649 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88899) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 08:38:47 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-4671e7ca-4b31-47d1-bf84-ccc7da3b7808 tempest-GroupsTest-63405649 None] Flow 'volume_create_manager' (192df235-a557-4382-b5d9-3ba75d31ac29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:38:47 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-4671e7ca-4b31-47d1-bf84-ccc7da3b7808 tempest-GroupsTest-63405649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (46328467-b60d-4de7-b82b-53feb93a2b16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:38:47 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-4671e7ca-4b31-47d1-bf84-ccc7da3b7808 tempest-GroupsTest-63405649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (46328467-b60d-4de7-b82b-53feb93a2b16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:38:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1963160497',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=7aa79d53-52ac-43ab-abab-b9867d69c148,host='devstack@QuobyteHD#QuobyteHD',id=dd24540e-851d-4ad7-87e8-5da753916c58,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='caa16087ffe641b5b7b935d3f5200ce8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:38:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:38:47Z,use_quota=True,user_id='d77b9b03ddfd4f99b8f181a85ab7abe6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fb4a954-e38e-46d8-aa96-9e9a8fe130fa),volume_type_id=5fb4a954-e38e-46d8-aa96-9e9a8fe130fa)' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:38:47 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-4671e7ca-4b31-47d1-bf84-ccc7da3b7808 tempest-GroupsTest-63405649 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (508e906e-116d-4f4a-a0f4-3728cf12f9c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:38:47 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-4671e7ca-4b31-47d1-bf84-ccc7da3b7808 tempest-GroupsTest-63405649 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (508e906e-116d-4f4a-a0f4-3728cf12f9c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:38:47 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-4671e7ca-4b31-47d1-bf84-ccc7da3b7808 tempest-GroupsTest-63405649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a8d91beb-904a-438e-be32-7d6f3eddcbd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:38:47 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-4671e7ca-4b31-47d1-bf84-ccc7da3b7808 tempest-GroupsTest-63405649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a8d91beb-904a-438e-be32-7d6f3eddcbd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dd24540e-851d-4ad7-87e8-5da753916c58', 'volume_name': 'volume-dd24540e-851d-4ad7-87e8-5da753916c58', 'volume_size': 1}' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:38:47 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-4671e7ca-4b31-47d1-bf84-ccc7da3b7808 tempest-GroupsTest-63405649 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (248c3472-8f23-43f6-ac61-743d8f131dba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:38:47 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-4671e7ca-4b31-47d1-bf84-ccc7da3b7808 tempest-GroupsTest-63405649 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (248c3472-8f23-43f6-ac61-743d8f131dba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:38:47 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-4671e7ca-4b31-47d1-bf84-ccc7da3b7808 tempest-GroupsTest-63405649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5eb48eb3-af17-4f94-a6af-0f5265076255) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:38:47 devstack cinder-volume[88899]: INFO cinder.volume.flows.manager.create_volume [None req-4671e7ca-4b31-47d1-bf84-ccc7da3b7808 tempest-GroupsTest-63405649 None] Volume dd24540e-851d-4ad7-87e8-5da753916c58: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dd24540e-851d-4ad7-87e8-5da753916c58', 'volume_size': 1} Aug 03 08:38:47 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-4671e7ca-4b31-47d1-bf84-ccc7da3b7808 tempest-GroupsTest-63405649 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:38:47 devstack sudo[100934]: pam_unix(sudo:session): session closed for user root Aug 03 08:38:47 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-bed6baaf-8f0b-490f-b592-d936fcecdcfe tempest-VolumesCloneTest-1143049529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-6d0a1d42-49dd-4d90-b28b-6fd21858841c" returned: 0 in 0.488s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:38:47 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-bed6baaf-8f0b-490f-b592-d936fcecdcfe tempest-VolumesCloneTest-1143049529 None] Lock "cinder-quobyte-6d0a1d42-49dd-4d90-b28b-6fd21858841c" released by "_copy_volume_from_snapshot" :: held 3.300s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:38:47 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-bed6baaf-8f0b-490f-b592-d936fcecdcfe tempest-VolumesCloneTest-1143049529 None] Acquiring lock "cinder-quobyte-c8d5af8f-2825-4e56-8ee5-1b08d55430b9" by "_delete_snapshot" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:38:47 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-bed6baaf-8f0b-490f-b592-d936fcecdcfe tempest-VolumesCloneTest-1143049529 None] Lock "cinder-quobyte-c8d5af8f-2825-4e56-8ee5-1b08d55430b9" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:38:47 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-bed6baaf-8f0b-490f-b592-d936fcecdcfe tempest-VolumesCloneTest-1143049529 None] Deleting offline snapshot c8d5af8f-2825-4e56-8ee5-1b08d55430b9 of volume 4429ad90-c38b-488e-8345-1d297ade4529 {{(pid=88899) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 03 08:38:47 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-bed6baaf-8f0b-490f-b592-d936fcecdcfe tempest-VolumesCloneTest-1143049529 None] snapshot_file for this snap is: volume-4429ad90-c38b-488e-8345-1d297ade4529.c8d5af8f-2825-4e56-8ee5-1b08d55430b9 {{(pid=88899) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 03 08:38:47 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[7853211a-6f48-4737-90b9-fdf8bc78e136]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:38:47 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-bed6baaf-8f0b-490f-b592-d936fcecdcfe tempest-VolumesCloneTest-1143049529 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-4429ad90-c38b-488e-8345-1d297ade4529.c8d5af8f-2825-4e56-8ee5-1b08d55430b9 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:38:47 devstack sudo[100937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-4429ad90-c38b-488e-8345-1d297ade4529.c8d5af8f-2825-4e56-8ee5-1b08d55430b9 Aug 03 08:38:47 devstack sudo[100937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:38:48 devstack sudo[100937]: pam_unix(sudo:session): session closed for user root Aug 03 08:38:48 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-bed6baaf-8f0b-490f-b592-d936fcecdcfe tempest-VolumesCloneTest-1143049529 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-4429ad90-c38b-488e-8345-1d297ade4529.c8d5af8f-2825-4e56-8ee5-1b08d55430b9" returned: 0 in 0.442s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:38:48 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-bed6baaf-8f0b-490f-b592-d936fcecdcfe tempest-VolumesCloneTest-1143049529 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4429ad90-c38b-488e-8345-1d297ade4529(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88899) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 03 08:38:48 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[0730390a-f3a7-4a43-a5e7-e0bfa724b97d]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:38:48 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-bed6baaf-8f0b-490f-b592-d936fcecdcfe tempest-VolumesCloneTest-1143049529 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-4429ad90-c38b-488e-8345-1d297ade4529 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:38:48 devstack sudo[100943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-4429ad90-c38b-488e-8345-1d297ade4529 Aug 03 08:38:48 devstack sudo[100943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:38:48 devstack sudo[100943]: pam_unix(sudo:session): session closed for user root Aug 03 08:38:48 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-bed6baaf-8f0b-490f-b592-d936fcecdcfe tempest-VolumesCloneTest-1143049529 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-4429ad90-c38b-488e-8345-1d297ade4529" returned: 0 in 0.459s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:38:48 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-bed6baaf-8f0b-490f-b592-d936fcecdcfe tempest-VolumesCloneTest-1143049529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-4429ad90-c38b-488e-8345-1d297ade4529.c8d5af8f-2825-4e56-8ee5-1b08d55430b9 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:38:48 devstack sudo[100950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-4429ad90-c38b-488e-8345-1d297ade4529.c8d5af8f-2825-4e56-8ee5-1b08d55430b9 Aug 03 08:38:48 devstack sudo[100950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:38:49 devstack sudo[100950]: pam_unix(sudo:session): session closed for user root Aug 03 08:38:49 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-bed6baaf-8f0b-490f-b592-d936fcecdcfe tempest-VolumesCloneTest-1143049529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-4429ad90-c38b-488e-8345-1d297ade4529.c8d5af8f-2825-4e56-8ee5-1b08d55430b9" returned: 0 in 0.392s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:38:49 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-bed6baaf-8f0b-490f-b592-d936fcecdcfe tempest-VolumesCloneTest-1143049529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-4429ad90-c38b-488e-8345-1d297ade4529.c8d5af8f-2825-4e56-8ee5-1b08d55430b9 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:38:49 devstack sudo[100956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-4429ad90-c38b-488e-8345-1d297ade4529.c8d5af8f-2825-4e56-8ee5-1b08d55430b9 Aug 03 08:38:49 devstack sudo[100956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:38:49 devstack sudo[100956]: pam_unix(sudo:session): session closed for user root Aug 03 08:38:49 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-bed6baaf-8f0b-490f-b592-d936fcecdcfe tempest-VolumesCloneTest-1143049529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-4429ad90-c38b-488e-8345-1d297ade4529.c8d5af8f-2825-4e56-8ee5-1b08d55430b9" returned: 0 in 0.271s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:38:49 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-bed6baaf-8f0b-490f-b592-d936fcecdcfe tempest-VolumesCloneTest-1143049529 None] Lock "cinder-quobyte-c8d5af8f-2825-4e56-8ee5-1b08d55430b9" released by "_delete_snapshot" :: held 1.680s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:38:49 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-bed6baaf-8f0b-490f-b592-d936fcecdcfe tempest-VolumesCloneTest-1143049529 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 7.743s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:38:49 devstack cinder-volume[88899]: DEBUG cinder.volume.volume_utils [None req-bed6baaf-8f0b-490f-b592-d936fcecdcfe tempest-VolumesCloneTest-1143049529 None] Marking volume 6d0a1d42-49dd-4d90-b28b-6fd21858841c as bootable. {{(pid=88899) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Aug 03 08:38:49 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-2f7ebaff-f992-4928-ba91-477dbedfc21f tempest-VolumesMetadataTest-380966294 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.571s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:38:49 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-2f7ebaff-f992-4928-ba91-477dbedfc21f tempest-VolumesMetadataTest-380966294 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:38:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1672611305',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=70c77646-f70d-45cd-9706-eee1425903ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='887d5d3baf564412976d0164b1b114af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:38:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:38:46Z,use_quota=True,user_id='2599d356963a421d8d6347e80995ecb0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8bde7129-1dc4-42ab-b852-ab32c61b4921),volume_type_id=8bde7129-1dc4-42ab-b852-ab32c61b4921)}" {{(pid=88899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 08:38:49 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-2f7ebaff-f992-4928-ba91-477dbedfc21f tempest-VolumesMetadataTest-380966294 None] Creating volume 70c77646-f70d-45cd-9706-eee1425903ca {{(pid=88899) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 08:38:49 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-2f7ebaff-f992-4928-ba91-477dbedfc21f tempest-VolumesMetadataTest-380966294 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:38:49 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-2f7ebaff-f992-4928-ba91-477dbedfc21f tempest-VolumesMetadataTest-380966294 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:38:49 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-2f7ebaff-f992-4928-ba91-477dbedfc21f tempest-VolumesMetadataTest-380966294 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:38:49 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-2f7ebaff-f992-4928-ba91-477dbedfc21f tempest-VolumesMetadataTest-380966294 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:38:49 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-2f7ebaff-f992-4928-ba91-477dbedfc21f tempest-VolumesMetadataTest-380966294 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:38:49 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-2f7ebaff-f992-4928-ba91-477dbedfc21f tempest-VolumesMetadataTest-380966294 None] Selected osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385 as target Quobyte volume. {{(pid=88899) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 08:38:49 devstack cinder-volume[88899]: INFO cinder.volume.drivers.remotefs [None req-2f7ebaff-f992-4928-ba91-477dbedfc21f tempest-VolumesMetadataTest-380966294 None] casted to osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385 Aug 03 08:38:49 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-2f7ebaff-f992-4928-ba91-477dbedfc21f tempest-VolumesMetadataTest-380966294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-70c77646-f70d-45cd-9706-eee1425903ca 1073741824 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:38:49 devstack sudo[100959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-70c77646-f70d-45cd-9706-eee1425903ca 1073741824 Aug 03 08:38:49 devstack cinder-volume[88899]: DEBUG cinder.volume.flows.manager.create_volume [None req-bed6baaf-8f0b-490f-b592-d936fcecdcfe tempest-VolumesCloneTest-1143049529 None] Copying metadata from source volume 4429ad90-c38b-488e-8345-1d297ade4529 to 6d0a1d42-49dd-4d90-b28b-6fd21858841c. {{(pid=88899) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:438}} Aug 03 08:38:49 devstack sudo[100959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:38:49 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-bed6baaf-8f0b-490f-b592-d936fcecdcfe tempest-VolumesCloneTest-1143049529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (960f27eb-6a64-413a-bf62-3ae05175d888) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6d0a1d42-49dd-4d90-b28b-6fd21858841c', 'volume_size': 1, 'source_volid': '4429ad90-c38b-488e-8345-1d297ade4529', 'source_volstatus': 'available'}' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:38:49 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-bed6baaf-8f0b-490f-b592-d936fcecdcfe tempest-VolumesCloneTest-1143049529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83ca4713-3f9f-4212-8667-1e138db8091d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:38:49 devstack cinder-volume[88899]: INFO cinder.volume.flows.manager.create_volume [None req-bed6baaf-8f0b-490f-b592-d936fcecdcfe tempest-VolumesCloneTest-1143049529 None] Volume volume-6d0a1d42-49dd-4d90-b28b-6fd21858841c (6d0a1d42-49dd-4d90-b28b-6fd21858841c): created successfully Aug 03 08:38:49 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-bed6baaf-8f0b-490f-b592-d936fcecdcfe tempest-VolumesCloneTest-1143049529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83ca4713-3f9f-4212-8667-1e138db8091d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:38:49 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-bed6baaf-8f0b-490f-b592-d936fcecdcfe tempest-VolumesCloneTest-1143049529 None] Flow 'volume_create_manager' (f423ab97-26aa-4291-b87b-36739d87d10e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:38:49 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-bed6baaf-8f0b-490f-b592-d936fcecdcfe tempest-VolumesCloneTest-1143049529 None] Created volume successfully. Aug 03 08:38:50 devstack sudo[100959]: pam_unix(sudo:session): session closed for user root Aug 03 08:38:50 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-2f7ebaff-f992-4928-ba91-477dbedfc21f tempest-VolumesMetadataTest-380966294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-70c77646-f70d-45cd-9706-eee1425903ca 1073741824" returned: 0 in 0.612s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:38:50 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-2f7ebaff-f992-4928-ba91-477dbedfc21f tempest-VolumesMetadataTest-380966294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-70c77646-f70d-45cd-9706-eee1425903ca {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:38:50 devstack sudo[100964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-70c77646-f70d-45cd-9706-eee1425903ca Aug 03 08:38:50 devstack sudo[100964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:38:50 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-a4ea85a6-ef75-4cfb-a522-a53951f2caea tempest-VolumesCloneTest-1143049529 None] Acquiring lock "cinder-6d0a1d42-49dd-4d90-b28b-6fd21858841c-delete_volume" by "delete_volume" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:38:50 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-a4ea85a6-ef75-4cfb-a522-a53951f2caea tempest-VolumesCloneTest-1143049529 None] Lock "cinder-6d0a1d42-49dd-4d90-b28b-6fd21858841c-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:38:50 devstack sudo[100964]: pam_unix(sudo:session): session closed for user root Aug 03 08:38:50 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-2f7ebaff-f992-4928-ba91-477dbedfc21f tempest-VolumesMetadataTest-380966294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-70c77646-f70d-45cd-9706-eee1425903ca" returned: 0 in 0.299s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:38:50 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-2f7ebaff-f992-4928-ba91-477dbedfc21f tempest-VolumesMetadataTest-380966294 None] <== create_volume: return (952ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'} {{(pid=88899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 08:38:50 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-2f7ebaff-f992-4928-ba91-477dbedfc21f tempest-VolumesMetadataTest-380966294 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.959s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:38:50 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-4671e7ca-4b31-47d1-bf84-ccc7da3b7808 tempest-GroupsTest-63405649 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.821s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:38:50 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-4671e7ca-4b31-47d1-bf84-ccc7da3b7808 tempest-GroupsTest-63405649 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=7aa79d53-52ac-43ab-abab-b9867d69c148,created_at=2026-08-03T06:38:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1963160497',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=7aa79d53-52ac-43ab-abab-b9867d69c148,host='devstack@QuobyteHD#QuobyteHD',id=dd24540e-851d-4ad7-87e8-5da753916c58,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='caa16087ffe641b5b7b935d3f5200ce8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:38:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:38:47Z,use_quota=True,user_id='d77b9b03ddfd4f99b8f181a85ab7abe6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fb4a954-e38e-46d8-aa96-9e9a8fe130fa),volume_type_id=5fb4a954-e38e-46d8-aa96-9e9a8fe130fa)}" {{(pid=88899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 08:38:50 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-4671e7ca-4b31-47d1-bf84-ccc7da3b7808 tempest-GroupsTest-63405649 None] Creating volume dd24540e-851d-4ad7-87e8-5da753916c58 {{(pid=88899) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 08:38:50 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-4671e7ca-4b31-47d1-bf84-ccc7da3b7808 tempest-GroupsTest-63405649 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:38:50 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-4671e7ca-4b31-47d1-bf84-ccc7da3b7808 tempest-GroupsTest-63405649 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:38:50 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-4671e7ca-4b31-47d1-bf84-ccc7da3b7808 tempest-GroupsTest-63405649 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:38:50 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-4671e7ca-4b31-47d1-bf84-ccc7da3b7808 tempest-GroupsTest-63405649 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:38:50 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-4671e7ca-4b31-47d1-bf84-ccc7da3b7808 tempest-GroupsTest-63405649 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:38:50 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-4671e7ca-4b31-47d1-bf84-ccc7da3b7808 tempest-GroupsTest-63405649 None] Selected osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385 as target Quobyte volume. {{(pid=88899) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 08:38:50 devstack cinder-volume[88899]: INFO cinder.volume.drivers.remotefs [None req-4671e7ca-4b31-47d1-bf84-ccc7da3b7808 tempest-GroupsTest-63405649 None] casted to osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385 Aug 03 08:38:50 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-4671e7ca-4b31-47d1-bf84-ccc7da3b7808 tempest-GroupsTest-63405649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-dd24540e-851d-4ad7-87e8-5da753916c58 1073741824 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:38:50 devstack sudo[100967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-dd24540e-851d-4ad7-87e8-5da753916c58 1073741824 Aug 03 08:38:50 devstack sudo[100967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:38:50 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-2f7ebaff-f992-4928-ba91-477dbedfc21f tempest-VolumesMetadataTest-380966294 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db403228-f6ce-479b-b869-b822f740d52f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-70c77646-f70d-45cd-9706-eee1425903ca', 'volume_size': 1}' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:38:50 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-2f7ebaff-f992-4928-ba91-477dbedfc21f tempest-VolumesMetadataTest-380966294 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53cf54f8-1072-4f57-8da7-f24f093bfd57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:38:50 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-a4ea85a6-ef75-4cfb-a522-a53951f2caea tempest-VolumesCloneTest-1143049529 None] Acquiring lock "cinder-quobyte-6d0a1d42-49dd-4d90-b28b-6fd21858841c" by "delete_volume" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:38:50 devstack cinder-volume[88899]: INFO cinder.volume.flows.manager.create_volume [None req-2f7ebaff-f992-4928-ba91-477dbedfc21f tempest-VolumesMetadataTest-380966294 None] Volume volume-70c77646-f70d-45cd-9706-eee1425903ca (70c77646-f70d-45cd-9706-eee1425903ca): created successfully Aug 03 08:38:50 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-2f7ebaff-f992-4928-ba91-477dbedfc21f tempest-VolumesMetadataTest-380966294 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53cf54f8-1072-4f57-8da7-f24f093bfd57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:38:50 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-2f7ebaff-f992-4928-ba91-477dbedfc21f tempest-VolumesMetadataTest-380966294 None] Flow 'volume_create_manager' (664bbaba-9ecc-48d2-9f62-f243314c1fdb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:38:50 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-a4ea85a6-ef75-4cfb-a522-a53951f2caea tempest-VolumesCloneTest-1143049529 None] Lock "cinder-quobyte-6d0a1d42-49dd-4d90-b28b-6fd21858841c" acquired by "delete_volume" :: waited 0.047s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:38:50 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-2f7ebaff-f992-4928-ba91-477dbedfc21f tempest-VolumesMetadataTest-380966294 None] Created volume successfully. Aug 03 08:38:50 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[37d2cded-4bc2-447c-9409-de6aacae99be]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:38:50 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-a4ea85a6-ef75-4cfb-a522-a53951f2caea tempest-VolumesCloneTest-1143049529 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-6d0a1d42-49dd-4d90-b28b-6fd21858841c {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:38:50 devstack sudo[100969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-6d0a1d42-49dd-4d90-b28b-6fd21858841c Aug 03 08:38:50 devstack sudo[100969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:38:51 devstack sudo[100967]: pam_unix(sudo:session): session closed for user root Aug 03 08:38:51 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-4671e7ca-4b31-47d1-bf84-ccc7da3b7808 tempest-GroupsTest-63405649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-dd24540e-851d-4ad7-87e8-5da753916c58 1073741824" returned: 0 in 0.565s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:38:51 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-4671e7ca-4b31-47d1-bf84-ccc7da3b7808 tempest-GroupsTest-63405649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-dd24540e-851d-4ad7-87e8-5da753916c58 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:38:51 devstack sudo[100979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-dd24540e-851d-4ad7-87e8-5da753916c58 Aug 03 08:38:51 devstack sudo[100979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:38:51 devstack sudo[100969]: pam_unix(sudo:session): session closed for user root Aug 03 08:38:51 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-a4ea85a6-ef75-4cfb-a522-a53951f2caea tempest-VolumesCloneTest-1143049529 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-6d0a1d42-49dd-4d90-b28b-6fd21858841c" returned: 0 in 0.530s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:38:51 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-a4ea85a6-ef75-4cfb-a522-a53951f2caea tempest-VolumesCloneTest-1143049529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-6d0a1d42-49dd-4d90-b28b-6fd21858841c {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:38:51 devstack sudo[100981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-6d0a1d42-49dd-4d90-b28b-6fd21858841c Aug 03 08:38:51 devstack sudo[100981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:38:51 devstack sudo[100979]: pam_unix(sudo:session): session closed for user root Aug 03 08:38:51 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-4671e7ca-4b31-47d1-bf84-ccc7da3b7808 tempest-GroupsTest-63405649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-dd24540e-851d-4ad7-87e8-5da753916c58" returned: 0 in 0.356s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:38:51 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-4671e7ca-4b31-47d1-bf84-ccc7da3b7808 tempest-GroupsTest-63405649 None] <== create_volume: return (980ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'} {{(pid=88899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 08:38:51 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-4671e7ca-4b31-47d1-bf84-ccc7da3b7808 tempest-GroupsTest-63405649 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.987s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:38:51 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-4671e7ca-4b31-47d1-bf84-ccc7da3b7808 tempest-GroupsTest-63405649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5eb48eb3-af17-4f94-a6af-0f5265076255) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dd24540e-851d-4ad7-87e8-5da753916c58', 'volume_size': 1}' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:38:51 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-4671e7ca-4b31-47d1-bf84-ccc7da3b7808 tempest-GroupsTest-63405649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa651d7c-c1da-4d22-b962-4d50952d9f31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:38:51 devstack cinder-volume[88899]: INFO cinder.volume.flows.manager.create_volume [None req-4671e7ca-4b31-47d1-bf84-ccc7da3b7808 tempest-GroupsTest-63405649 None] Volume volume-dd24540e-851d-4ad7-87e8-5da753916c58 (dd24540e-851d-4ad7-87e8-5da753916c58): created successfully Aug 03 08:38:51 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-4671e7ca-4b31-47d1-bf84-ccc7da3b7808 tempest-GroupsTest-63405649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa651d7c-c1da-4d22-b962-4d50952d9f31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:38:51 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-4671e7ca-4b31-47d1-bf84-ccc7da3b7808 tempest-GroupsTest-63405649 None] Flow 'volume_create_manager' (192df235-a557-4382-b5d9-3ba75d31ac29) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:38:51 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-4671e7ca-4b31-47d1-bf84-ccc7da3b7808 tempest-GroupsTest-63405649 None] Created volume successfully. Aug 03 08:38:51 devstack sudo[100981]: pam_unix(sudo:session): session closed for user root Aug 03 08:38:51 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-a4ea85a6-ef75-4cfb-a522-a53951f2caea tempest-VolumesCloneTest-1143049529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-6d0a1d42-49dd-4d90-b28b-6fd21858841c" returned: 0 in 0.379s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:38:51 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-a4ea85a6-ef75-4cfb-a522-a53951f2caea tempest-VolumesCloneTest-1143049529 None] Lock "cinder-quobyte-6d0a1d42-49dd-4d90-b28b-6fd21858841c" released by "delete_volume" :: held 0.989s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:38:51 devstack cinder-volume[88899]: DEBUG cinder.quota [None req-a4ea85a6-ef75-4cfb-a522-a53951f2caea tempest-VolumesCloneTest-1143049529 None] Created reservations ['6756fddd-83ae-4d8d-9e4f-9bde43ea8c37', '85f32379-c5c1-4643-8661-075d8778baeb', '9af77276-68c1-4e63-8a06-33b26dfa16b6', '400c8ae8-a087-430f-b0ea-79f21987bb86'] {{(pid=88899) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 08:38:51 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-a4ea85a6-ef75-4cfb-a522-a53951f2caea tempest-VolumesCloneTest-1143049529 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:38:51 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-a4ea85a6-ef75-4cfb-a522-a53951f2caea tempest-VolumesCloneTest-1143049529 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:38:51 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-a4ea85a6-ef75-4cfb-a522-a53951f2caea tempest-VolumesCloneTest-1143049529 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:38:51 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-a4ea85a6-ef75-4cfb-a522-a53951f2caea tempest-VolumesCloneTest-1143049529 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:38:51 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-a4ea85a6-ef75-4cfb-a522-a53951f2caea tempest-VolumesCloneTest-1143049529 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:38:51 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-a4ea85a6-ef75-4cfb-a522-a53951f2caea tempest-VolumesCloneTest-1143049529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:38:51 devstack cinder-volume[88899]: DEBUG oslo_service.periodic_task [None req-f948fb4a-c4d7-499f-b1bd-8d6be3de0b53 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88899) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 03 08:38:51 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-f948fb4a-c4d7-499f-b1bd-8d6be3de0b53 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:38:51 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-f948fb4a-c4d7-499f-b1bd-8d6be3de0b53 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:38:51 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-f948fb4a-c4d7-499f-b1bd-8d6be3de0b53 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:38:51 devstack sudo[100985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a Aug 03 08:38:51 devstack sudo[100985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:38:51 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-f948fb4a-c4d7-499f-b1bd-8d6be3de0b53 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:38:51 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-f948fb4a-c4d7-499f-b1bd-8d6be3de0b53 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:38:51 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-f948fb4a-c4d7-499f-b1bd-8d6be3de0b53 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:38:51 devstack sudo[100987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a Aug 03 08:38:51 devstack sudo[100987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:38:52 devstack sudo[100985]: pam_unix(sudo:session): session closed for user root Aug 03 08:38:52 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-2c207870-f669-4af0-8510-ec6e9626af52 tempest-VolumesMetadataTest-380966294 None] Acquiring lock "cinder-70c77646-f70d-45cd-9706-eee1425903ca-delete_volume" by "delete_volume" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:38:52 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-a4ea85a6-ef75-4cfb-a522-a53951f2caea tempest-VolumesCloneTest-1143049529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a" returned: 0 in 0.353s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:38:52 devstack sudo[100987]: pam_unix(sudo:session): session closed for user root Aug 03 08:38:52 devstack cinder-volume[88899]: DEBUG cinder.manager [None req-a4ea85a6-ef75-4cfb-a522-a53951f2caea tempest-VolumesCloneTest-1143049529 None] Notifying Schedulers of capabilities ... {{(pid=88899) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 08:38:52 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-a4ea85a6-ef75-4cfb-a522-a53951f2caea tempest-VolumesCloneTest-1143049529 None] Deleted volume successfully. Aug 03 08:38:52 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-f948fb4a-c4d7-499f-b1bd-8d6be3de0b53 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a" returned: 0 in 0.325s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:38:52 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-2c207870-f669-4af0-8510-ec6e9626af52 tempest-VolumesMetadataTest-380966294 None] Lock "cinder-70c77646-f70d-45cd-9706-eee1425903ca-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:38:52 devstack cinder-volume[88899]: DEBUG cinder.manager [None req-f948fb4a-c4d7-499f-b1bd-8d6be3de0b53 None None] Notifying Schedulers of capabilities ... {{(pid=88899) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 08:38:52 devstack cinder-volume[88899]: DEBUG oslo_service.periodic_task [None req-f948fb4a-c4d7-499f-b1bd-8d6be3de0b53 None None] Running periodic task VolumeManager._thread_info {{(pid=88899) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 03 08:38:52 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-f948fb4a-c4d7-499f-b1bd-8d6be3de0b53 None None] thread count: 28 {{(pid=88899) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 03 08:38:52 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-f948fb4a-c4d7-499f-b1bd-8d6be3de0b53 None None] thread info: [<_MainThread(MainThread, started 132234320248960)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88899) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 03 08:38:52 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-a4ea85a6-ef75-4cfb-a522-a53951f2caea tempest-VolumesCloneTest-1143049529 None] Lock "cinder-6d0a1d42-49dd-4d90-b28b-6fd21858841c-delete_volume" released by "delete_volume" :: held 1.749s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:38:52 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-2c207870-f669-4af0-8510-ec6e9626af52 tempest-VolumesMetadataTest-380966294 None] Acquiring lock "cinder-quobyte-70c77646-f70d-45cd-9706-eee1425903ca" by "delete_volume" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:38:52 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-2c207870-f669-4af0-8510-ec6e9626af52 tempest-VolumesMetadataTest-380966294 None] Lock "cinder-quobyte-70c77646-f70d-45cd-9706-eee1425903ca" acquired by "delete_volume" :: waited 0.014s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:38:52 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[5deb1aba-5aac-48b7-ad94-aba29c2dfc5e]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:38:52 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-2c207870-f669-4af0-8510-ec6e9626af52 tempest-VolumesMetadataTest-380966294 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-70c77646-f70d-45cd-9706-eee1425903ca {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:38:52 devstack sudo[100991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-70c77646-f70d-45cd-9706-eee1425903ca Aug 03 08:38:52 devstack sudo[100991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:38:52 devstack sudo[100991]: pam_unix(sudo:session): session closed for user root Aug 03 08:38:52 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-2c207870-f669-4af0-8510-ec6e9626af52 tempest-VolumesMetadataTest-380966294 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-70c77646-f70d-45cd-9706-eee1425903ca" returned: 0 in 0.403s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:38:52 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-2c207870-f669-4af0-8510-ec6e9626af52 tempest-VolumesMetadataTest-380966294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-70c77646-f70d-45cd-9706-eee1425903ca {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:38:52 devstack sudo[100996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-70c77646-f70d-45cd-9706-eee1425903ca Aug 03 08:38:52 devstack sudo[100996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:38:52 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-30aa4a64-18b4-415e-8589-6228fc9cf030 tempest-VolumesCloneTest-1143049529 None] Acquiring lock "cinder-4429ad90-c38b-488e-8345-1d297ade4529-delete_volume" by "delete_volume" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:38:52 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-30aa4a64-18b4-415e-8589-6228fc9cf030 tempest-VolumesCloneTest-1143049529 None] Lock "cinder-4429ad90-c38b-488e-8345-1d297ade4529-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:38:52 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-30aa4a64-18b4-415e-8589-6228fc9cf030 tempest-VolumesCloneTest-1143049529 None] Acquiring lock "cinder-quobyte-4429ad90-c38b-488e-8345-1d297ade4529" by "delete_volume" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:38:53 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-30aa4a64-18b4-415e-8589-6228fc9cf030 tempest-VolumesCloneTest-1143049529 None] Lock "cinder-quobyte-4429ad90-c38b-488e-8345-1d297ade4529" acquired by "delete_volume" :: waited 0.039s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:38:53 devstack sudo[100996]: pam_unix(sudo:session): session closed for user root Aug 03 08:38:53 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-2c207870-f669-4af0-8510-ec6e9626af52 tempest-VolumesMetadataTest-380966294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-70c77646-f70d-45cd-9706-eee1425903ca" returned: 0 in 0.448s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:38:53 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[decb2497-070a-4625-9a09-88b1a177714b]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:38:53 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-30aa4a64-18b4-415e-8589-6228fc9cf030 tempest-VolumesCloneTest-1143049529 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-4429ad90-c38b-488e-8345-1d297ade4529 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:38:53 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-2c207870-f669-4af0-8510-ec6e9626af52 tempest-VolumesMetadataTest-380966294 None] Lock "cinder-quobyte-70c77646-f70d-45cd-9706-eee1425903ca" released by "delete_volume" :: held 0.920s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:38:53 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-06dcda2a-ffa5-438f-bc0b-bf80d20fdbad tempest-GroupsTest-63405649 None] Acquiring lock "cinder-quobyte-dd24540e-851d-4ad7-87e8-5da753916c58" by "delete_volume" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:38:53 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-06dcda2a-ffa5-438f-bc0b-bf80d20fdbad tempest-GroupsTest-63405649 None] Lock "cinder-quobyte-dd24540e-851d-4ad7-87e8-5da753916c58" acquired by "delete_volume" :: waited 0.034s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:38:53 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[10d481f7-626f-489e-8795-cbfe460a8e65]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:38:53 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-06dcda2a-ffa5-438f-bc0b-bf80d20fdbad tempest-GroupsTest-63405649 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-dd24540e-851d-4ad7-87e8-5da753916c58 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:38:53 devstack cinder-volume[88899]: DEBUG cinder.quota [None req-2c207870-f669-4af0-8510-ec6e9626af52 tempest-VolumesMetadataTest-380966294 None] Created reservations ['e58f82df-f61a-4733-9416-58dfa5b3a013', '60677807-b99e-440a-9b25-34d067d0aac0', '18bca02d-30af-41cc-9e9e-7e18421d9507', '3207feb2-6f08-494e-93a3-3d1f7309b08c'] {{(pid=88899) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 08:38:53 devstack sudo[100999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-4429ad90-c38b-488e-8345-1d297ade4529 Aug 03 08:38:53 devstack sudo[100999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:38:53 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-2c207870-f669-4af0-8510-ec6e9626af52 tempest-VolumesMetadataTest-380966294 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:38:53 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-2c207870-f669-4af0-8510-ec6e9626af52 tempest-VolumesMetadataTest-380966294 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:38:53 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-2c207870-f669-4af0-8510-ec6e9626af52 tempest-VolumesMetadataTest-380966294 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:38:53 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-2c207870-f669-4af0-8510-ec6e9626af52 tempest-VolumesMetadataTest-380966294 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:38:53 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-2c207870-f669-4af0-8510-ec6e9626af52 tempest-VolumesMetadataTest-380966294 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:38:53 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-2c207870-f669-4af0-8510-ec6e9626af52 tempest-VolumesMetadataTest-380966294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:38:53 devstack sudo[101000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-dd24540e-851d-4ad7-87e8-5da753916c58 Aug 03 08:38:53 devstack sudo[101000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:38:53 devstack sudo[101003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a Aug 03 08:38:53 devstack sudo[101003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:38:53 devstack sudo[100999]: pam_unix(sudo:session): session closed for user root Aug 03 08:38:53 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-30aa4a64-18b4-415e-8589-6228fc9cf030 tempest-VolumesCloneTest-1143049529 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-4429ad90-c38b-488e-8345-1d297ade4529" returned: 0 in 0.463s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:38:53 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-30aa4a64-18b4-415e-8589-6228fc9cf030 tempest-VolumesCloneTest-1143049529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-4429ad90-c38b-488e-8345-1d297ade4529 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:38:53 devstack sudo[101010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-4429ad90-c38b-488e-8345-1d297ade4529 Aug 03 08:38:53 devstack sudo[101010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:38:53 devstack sudo[101003]: pam_unix(sudo:session): session closed for user root Aug 03 08:38:53 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-2c207870-f669-4af0-8510-ec6e9626af52 tempest-VolumesMetadataTest-380966294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a" returned: 0 in 0.276s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:38:53 devstack cinder-volume[88899]: DEBUG cinder.manager [None req-2c207870-f669-4af0-8510-ec6e9626af52 tempest-VolumesMetadataTest-380966294 None] Notifying Schedulers of capabilities ... {{(pid=88899) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 08:38:53 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-2c207870-f669-4af0-8510-ec6e9626af52 tempest-VolumesMetadataTest-380966294 None] Deleted volume successfully. Aug 03 08:38:53 devstack sudo[101000]: pam_unix(sudo:session): session closed for user root Aug 03 08:38:53 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-06dcda2a-ffa5-438f-bc0b-bf80d20fdbad tempest-GroupsTest-63405649 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-dd24540e-851d-4ad7-87e8-5da753916c58" returned: 0 in 0.451s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:38:53 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-06dcda2a-ffa5-438f-bc0b-bf80d20fdbad tempest-GroupsTest-63405649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-dd24540e-851d-4ad7-87e8-5da753916c58 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:38:53 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-2c207870-f669-4af0-8510-ec6e9626af52 tempest-VolumesMetadataTest-380966294 None] Lock "cinder-70c77646-f70d-45cd-9706-eee1425903ca-delete_volume" released by "delete_volume" :: held 1.564s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:38:53 devstack sudo[101015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-dd24540e-851d-4ad7-87e8-5da753916c58 Aug 03 08:38:53 devstack sudo[101015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:38:53 devstack sudo[101010]: pam_unix(sudo:session): session closed for user root Aug 03 08:38:53 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-30aa4a64-18b4-415e-8589-6228fc9cf030 tempest-VolumesCloneTest-1143049529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-4429ad90-c38b-488e-8345-1d297ade4529" returned: 0 in 0.303s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:38:53 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-30aa4a64-18b4-415e-8589-6228fc9cf030 tempest-VolumesCloneTest-1143049529 None] Lock "cinder-quobyte-4429ad90-c38b-488e-8345-1d297ade4529" released by "delete_volume" :: held 0.870s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:38:53 devstack cinder-volume[88899]: DEBUG cinder.quota [None req-30aa4a64-18b4-415e-8589-6228fc9cf030 tempest-VolumesCloneTest-1143049529 None] Created reservations ['389133ec-a3a5-4c51-881f-9036381e847d', '757fc3e8-58c1-4c0a-a55a-2ed10e75dbbc', '114065e5-7f2c-4264-b4ee-7cb5f525775e', 'd8ae1b79-8a1e-4d7a-afb4-58a9aa728939'] {{(pid=88899) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 08:38:53 devstack sudo[101015]: pam_unix(sudo:session): session closed for user root Aug 03 08:38:53 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-06dcda2a-ffa5-438f-bc0b-bf80d20fdbad tempest-GroupsTest-63405649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-dd24540e-851d-4ad7-87e8-5da753916c58" returned: 0 in 0.310s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:38:54 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-06dcda2a-ffa5-438f-bc0b-bf80d20fdbad tempest-GroupsTest-63405649 None] Lock "cinder-quobyte-dd24540e-851d-4ad7-87e8-5da753916c58" released by "delete_volume" :: held 0.835s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:38:54 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-30aa4a64-18b4-415e-8589-6228fc9cf030 tempest-VolumesCloneTest-1143049529 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:38:54 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-30aa4a64-18b4-415e-8589-6228fc9cf030 tempest-VolumesCloneTest-1143049529 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:38:54 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-30aa4a64-18b4-415e-8589-6228fc9cf030 tempest-VolumesCloneTest-1143049529 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:38:54 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-30aa4a64-18b4-415e-8589-6228fc9cf030 tempest-VolumesCloneTest-1143049529 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:38:54 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-30aa4a64-18b4-415e-8589-6228fc9cf030 tempest-VolumesCloneTest-1143049529 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:38:54 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-30aa4a64-18b4-415e-8589-6228fc9cf030 tempest-VolumesCloneTest-1143049529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:38:54 devstack sudo[101019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a Aug 03 08:38:54 devstack cinder-volume[88899]: DEBUG cinder.quota [None req-06dcda2a-ffa5-438f-bc0b-bf80d20fdbad tempest-GroupsTest-63405649 None] Created reservations ['36b6c0a2-7c84-4cba-b0fe-474aedfa1599'] {{(pid=88899) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 08:38:54 devstack sudo[101019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:38:54 devstack cinder-volume[88899]: WARNING cinder.quota [None req-06dcda2a-ffa5-438f-bc0b-bf80d20fdbad tempest-GroupsTest-63405649 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-884044411 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-884044411, it is now deprecated. Please use the default quota class for default quota. Aug 03 08:38:54 devstack cinder-volume[88899]: WARNING cinder.quota [None req-06dcda2a-ffa5-438f-bc0b-bf80d20fdbad tempest-GroupsTest-63405649 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-884044411 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-884044411, it is now deprecated. Please use the default quota class for default quota. Aug 03 08:38:54 devstack cinder-volume[88899]: DEBUG cinder.quota [None req-06dcda2a-ffa5-438f-bc0b-bf80d20fdbad tempest-GroupsTest-63405649 None] Created reservations ['876b12fc-38fc-4651-a3c1-ea3c50d8c790', 'd6394558-4e39-4aba-a592-f6d828c5ff1a', '4be6153a-1f55-4aa3-86ba-5e0f2316ed63', '395bccf4-5e84-445f-935a-f7488efb217e'] {{(pid=88899) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 08:38:54 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-06dcda2a-ffa5-438f-bc0b-bf80d20fdbad tempest-GroupsTest-63405649 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:38:54 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-06dcda2a-ffa5-438f-bc0b-bf80d20fdbad tempest-GroupsTest-63405649 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:38:54 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-06dcda2a-ffa5-438f-bc0b-bf80d20fdbad tempest-GroupsTest-63405649 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:38:54 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-06dcda2a-ffa5-438f-bc0b-bf80d20fdbad tempest-GroupsTest-63405649 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:38:54 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-06dcda2a-ffa5-438f-bc0b-bf80d20fdbad tempest-GroupsTest-63405649 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:38:54 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-06dcda2a-ffa5-438f-bc0b-bf80d20fdbad tempest-GroupsTest-63405649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:38:54 devstack sudo[101021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a Aug 03 08:38:54 devstack sudo[101021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:38:54 devstack sudo[101019]: pam_unix(sudo:session): session closed for user root Aug 03 08:38:54 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-30aa4a64-18b4-415e-8589-6228fc9cf030 tempest-VolumesCloneTest-1143049529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a" returned: 0 in 0.356s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:38:54 devstack cinder-volume[88899]: DEBUG cinder.manager [None req-30aa4a64-18b4-415e-8589-6228fc9cf030 tempest-VolumesCloneTest-1143049529 None] Notifying Schedulers of capabilities ... {{(pid=88899) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 08:38:54 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-30aa4a64-18b4-415e-8589-6228fc9cf030 tempest-VolumesCloneTest-1143049529 None] Deleted volume successfully. Aug 03 08:38:54 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-30aa4a64-18b4-415e-8589-6228fc9cf030 tempest-VolumesCloneTest-1143049529 None] Lock "cinder-4429ad90-c38b-488e-8345-1d297ade4529-delete_volume" released by "delete_volume" :: held 1.622s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:38:54 devstack cinder-volume[88899]: DEBUG cinder.quota [None req-228bdefb-caad-4c89-9a4b-301224f877cb tempest-GroupsTest-63405649 None] Created reservations ['4a10295c-1a4f-45e8-9c5e-53f32aff1fca'] {{(pid=88899) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 08:38:54 devstack sudo[101021]: pam_unix(sudo:session): session closed for user root Aug 03 08:38:54 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-228bdefb-caad-4c89-9a4b-301224f877cb tempest-GroupsTest-63405649 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:38:54 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-228bdefb-caad-4c89-9a4b-301224f877cb tempest-GroupsTest-63405649 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:38:54 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-228bdefb-caad-4c89-9a4b-301224f877cb tempest-GroupsTest-63405649 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:38:54 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-228bdefb-caad-4c89-9a4b-301224f877cb tempest-GroupsTest-63405649 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:38:54 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-228bdefb-caad-4c89-9a4b-301224f877cb tempest-GroupsTest-63405649 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:38:54 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-228bdefb-caad-4c89-9a4b-301224f877cb tempest-GroupsTest-63405649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:38:54 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-06dcda2a-ffa5-438f-bc0b-bf80d20fdbad tempest-GroupsTest-63405649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a" returned: 0 in 0.379s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:38:54 devstack cinder-volume[88899]: DEBUG cinder.manager [None req-06dcda2a-ffa5-438f-bc0b-bf80d20fdbad tempest-GroupsTest-63405649 None] Notifying Schedulers of capabilities ... {{(pid=88899) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 08:38:54 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-06dcda2a-ffa5-438f-bc0b-bf80d20fdbad tempest-GroupsTest-63405649 None] Delete group completed successfully. Aug 03 08:38:54 devstack sudo[101025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a Aug 03 08:38:54 devstack sudo[101025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:38:54 devstack sudo[101025]: pam_unix(sudo:session): session closed for user root Aug 03 08:38:54 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-228bdefb-caad-4c89-9a4b-301224f877cb tempest-GroupsTest-63405649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a" returned: 0 in 0.306s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:38:54 devstack cinder-volume[88899]: DEBUG cinder.manager [None req-228bdefb-caad-4c89-9a4b-301224f877cb tempest-GroupsTest-63405649 None] Notifying Schedulers of capabilities ... {{(pid=88899) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 08:38:54 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-228bdefb-caad-4c89-9a4b-301224f877cb tempest-GroupsTest-63405649 None] Delete group completed successfully. Aug 03 08:38:55 devstack cinder-volume[88899]: DEBUG cinder.volume.flows.manager.create_volume [None req-ee904e06-65d0-413b-8da4-9f424dd46a49 tempest-VolumesCloneTest-1143049529 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88899) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 08:38:55 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-ee904e06-65d0-413b-8da4-9f424dd46a49 tempest-VolumesCloneTest-1143049529 None] Flow 'volume_create_manager' (e55fbbb2-9819-41e9-bc29-bb82ed3aaa90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:38:55 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-ee904e06-65d0-413b-8da4-9f424dd46a49 tempest-VolumesCloneTest-1143049529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f74233af-c617-41cd-8a88-bd91a31177af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:38:55 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-ee904e06-65d0-413b-8da4-9f424dd46a49 tempest-VolumesCloneTest-1143049529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f74233af-c617-41cd-8a88-bd91a31177af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:38:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-494324430',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c6f08e43-eea9-4a15-8777-fdeadac83a3c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e08a6d0fc354ec88bae7076aabe791e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:38:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:38:56Z,use_quota=True,user_id='19bbdd587c2f46a7a4de351b13af87a9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8bde7129-1dc4-42ab-b852-ab32c61b4921),volume_type_id=8bde7129-1dc4-42ab-b852-ab32c61b4921)' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:38:55 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-ee904e06-65d0-413b-8da4-9f424dd46a49 tempest-VolumesCloneTest-1143049529 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b0d669f1-5d81-4fc7-9286-7120c5eebb4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:38:55 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-ee904e06-65d0-413b-8da4-9f424dd46a49 tempest-VolumesCloneTest-1143049529 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b0d669f1-5d81-4fc7-9286-7120c5eebb4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:38:55 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-ee904e06-65d0-413b-8da4-9f424dd46a49 tempest-VolumesCloneTest-1143049529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8543cdc7-afb5-4aca-b26e-d81a70661346) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:38:55 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-ee904e06-65d0-413b-8da4-9f424dd46a49 tempest-VolumesCloneTest-1143049529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8543cdc7-afb5-4aca-b26e-d81a70661346) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c6f08e43-eea9-4a15-8777-fdeadac83a3c', 'volume_name': 'volume-c6f08e43-eea9-4a15-8777-fdeadac83a3c', 'volume_size': 1}' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:38:55 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-ee904e06-65d0-413b-8da4-9f424dd46a49 tempest-VolumesCloneTest-1143049529 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d3f1558c-ab75-4fee-a297-7f40057a0ef2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:38:55 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-ee904e06-65d0-413b-8da4-9f424dd46a49 tempest-VolumesCloneTest-1143049529 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d3f1558c-ab75-4fee-a297-7f40057a0ef2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:38:55 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-ee904e06-65d0-413b-8da4-9f424dd46a49 tempest-VolumesCloneTest-1143049529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b6c2cc4-08a5-4a8b-a92a-c2ee912aea52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:38:55 devstack cinder-volume[88899]: INFO cinder.volume.flows.manager.create_volume [None req-ee904e06-65d0-413b-8da4-9f424dd46a49 tempest-VolumesCloneTest-1143049529 None] Volume c6f08e43-eea9-4a15-8777-fdeadac83a3c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c6f08e43-eea9-4a15-8777-fdeadac83a3c', 'volume_size': 1} Aug 03 08:38:55 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-ee904e06-65d0-413b-8da4-9f424dd46a49 tempest-VolumesCloneTest-1143049529 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:38:55 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-ee904e06-65d0-413b-8da4-9f424dd46a49 tempest-VolumesCloneTest-1143049529 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:38:55 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-ee904e06-65d0-413b-8da4-9f424dd46a49 tempest-VolumesCloneTest-1143049529 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:38:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-494324430',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c6f08e43-eea9-4a15-8777-fdeadac83a3c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e08a6d0fc354ec88bae7076aabe791e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:38:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:38:56Z,use_quota=True,user_id='19bbdd587c2f46a7a4de351b13af87a9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8bde7129-1dc4-42ab-b852-ab32c61b4921),volume_type_id=8bde7129-1dc4-42ab-b852-ab32c61b4921)}" {{(pid=88899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 08:38:55 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-ee904e06-65d0-413b-8da4-9f424dd46a49 tempest-VolumesCloneTest-1143049529 None] Creating volume c6f08e43-eea9-4a15-8777-fdeadac83a3c {{(pid=88899) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 08:38:55 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-ee904e06-65d0-413b-8da4-9f424dd46a49 tempest-VolumesCloneTest-1143049529 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:38:55 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-ee904e06-65d0-413b-8da4-9f424dd46a49 tempest-VolumesCloneTest-1143049529 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:38:55 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-ee904e06-65d0-413b-8da4-9f424dd46a49 tempest-VolumesCloneTest-1143049529 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:38:55 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-ee904e06-65d0-413b-8da4-9f424dd46a49 tempest-VolumesCloneTest-1143049529 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:38:55 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-ee904e06-65d0-413b-8da4-9f424dd46a49 tempest-VolumesCloneTest-1143049529 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:38:55 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-ee904e06-65d0-413b-8da4-9f424dd46a49 tempest-VolumesCloneTest-1143049529 None] Selected osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385 as target Quobyte volume. {{(pid=88899) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 08:38:55 devstack cinder-volume[88899]: INFO cinder.volume.drivers.remotefs [None req-ee904e06-65d0-413b-8da4-9f424dd46a49 tempest-VolumesCloneTest-1143049529 None] casted to osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385 Aug 03 08:38:55 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-ee904e06-65d0-413b-8da4-9f424dd46a49 tempest-VolumesCloneTest-1143049529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c6f08e43-eea9-4a15-8777-fdeadac83a3c 1073741824 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:38:55 devstack sudo[101028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c6f08e43-eea9-4a15-8777-fdeadac83a3c 1073741824 Aug 03 08:38:55 devstack sudo[101028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:38:56 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-8879d62f-092c-4f94-8c9f-a9287c74fc00 tempest-GroupsTest-63405649 None] Group tempest-GroupsTest-Group-1640614426: creating Aug 03 08:38:56 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-8879d62f-092c-4f94-8c9f-a9287c74fc00 tempest-GroupsTest-63405649 None] Group tempest-GroupsTest-Group-1640614426: created successfully Aug 03 08:38:56 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-8879d62f-092c-4f94-8c9f-a9287c74fc00 tempest-GroupsTest-63405649 None] Create group completed successfully. Aug 03 08:38:56 devstack sudo[101028]: pam_unix(sudo:session): session closed for user root Aug 03 08:38:56 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-ee904e06-65d0-413b-8da4-9f424dd46a49 tempest-VolumesCloneTest-1143049529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c6f08e43-eea9-4a15-8777-fdeadac83a3c 1073741824" returned: 0 in 0.684s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:38:56 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-ee904e06-65d0-413b-8da4-9f424dd46a49 tempest-VolumesCloneTest-1143049529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c6f08e43-eea9-4a15-8777-fdeadac83a3c {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:38:56 devstack sudo[101034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c6f08e43-eea9-4a15-8777-fdeadac83a3c Aug 03 08:38:56 devstack sudo[101034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:38:56 devstack sudo[101034]: pam_unix(sudo:session): session closed for user root Aug 03 08:38:56 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-ee904e06-65d0-413b-8da4-9f424dd46a49 tempest-VolumesCloneTest-1143049529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c6f08e43-eea9-4a15-8777-fdeadac83a3c" returned: 0 in 0.341s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:38:56 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-ee904e06-65d0-413b-8da4-9f424dd46a49 tempest-VolumesCloneTest-1143049529 None] <== create_volume: return (1078ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'} {{(pid=88899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 08:38:56 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-ee904e06-65d0-413b-8da4-9f424dd46a49 tempest-VolumesCloneTest-1143049529 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.081s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:38:56 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-ee904e06-65d0-413b-8da4-9f424dd46a49 tempest-VolumesCloneTest-1143049529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b6c2cc4-08a5-4a8b-a92a-c2ee912aea52) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c6f08e43-eea9-4a15-8777-fdeadac83a3c', 'volume_size': 1}' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:38:56 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-ee904e06-65d0-413b-8da4-9f424dd46a49 tempest-VolumesCloneTest-1143049529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6fc81d9-e8b3-477c-a48b-a7200c11580e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:38:56 devstack cinder-volume[88899]: INFO cinder.volume.flows.manager.create_volume [None req-ee904e06-65d0-413b-8da4-9f424dd46a49 tempest-VolumesCloneTest-1143049529 None] Volume volume-c6f08e43-eea9-4a15-8777-fdeadac83a3c (c6f08e43-eea9-4a15-8777-fdeadac83a3c): created successfully Aug 03 08:38:57 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-ee904e06-65d0-413b-8da4-9f424dd46a49 tempest-VolumesCloneTest-1143049529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6fc81d9-e8b3-477c-a48b-a7200c11580e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:38:57 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-ee904e06-65d0-413b-8da4-9f424dd46a49 tempest-VolumesCloneTest-1143049529 None] Flow 'volume_create_manager' (e55fbbb2-9819-41e9-bc29-bb82ed3aaa90) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:38:57 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-ee904e06-65d0-413b-8da4-9f424dd46a49 tempest-VolumesCloneTest-1143049529 None] Created volume successfully. Aug 03 08:38:58 devstack cinder-volume[88899]: DEBUG cinder.volume.flows.manager.create_volume [None req-dbe3a99f-961d-42af-b2da-633066474248 tempest-GroupsTest-63405649 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88899) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 08:38:58 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-dbe3a99f-961d-42af-b2da-633066474248 tempest-GroupsTest-63405649 None] Flow 'volume_create_manager' (bf43dc7e-422d-49d3-b44e-a5aed40587f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:38:58 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-dbe3a99f-961d-42af-b2da-633066474248 tempest-GroupsTest-63405649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (faa36d37-c5a5-4f1b-be18-409735688f7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:38:58 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-dbe3a99f-961d-42af-b2da-633066474248 tempest-GroupsTest-63405649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (faa36d37-c5a5-4f1b-be18-409735688f7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:38:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1710770001',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=74d500a7-9f86-4156-b967-1cff35772848,host='devstack@QuobyteHD#QuobyteHD',id=eb2657de-305f-4763-a5d1-8b7fb7d744c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='caa16087ffe641b5b7b935d3f5200ce8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:38:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:38:58Z,use_quota=True,user_id='d77b9b03ddfd4f99b8f181a85ab7abe6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(85800862-efa0-452c-aa2f-8a558da131d3),volume_type_id=85800862-efa0-452c-aa2f-8a558da131d3)' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:38:58 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-dbe3a99f-961d-42af-b2da-633066474248 tempest-GroupsTest-63405649 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (204ecadb-b746-429e-ae98-49bc86bbac63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:38:58 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-dbe3a99f-961d-42af-b2da-633066474248 tempest-GroupsTest-63405649 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (204ecadb-b746-429e-ae98-49bc86bbac63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:38:58 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-dbe3a99f-961d-42af-b2da-633066474248 tempest-GroupsTest-63405649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f079af37-4aa0-4ffd-9fba-a63f878111f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:38:58 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-dbe3a99f-961d-42af-b2da-633066474248 tempest-GroupsTest-63405649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f079af37-4aa0-4ffd-9fba-a63f878111f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eb2657de-305f-4763-a5d1-8b7fb7d744c7', 'volume_name': 'volume-eb2657de-305f-4763-a5d1-8b7fb7d744c7', 'volume_size': 1}' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:38:58 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-dbe3a99f-961d-42af-b2da-633066474248 tempest-GroupsTest-63405649 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (98530048-befe-4c6e-a621-6542a494da41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:38:58 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-dbe3a99f-961d-42af-b2da-633066474248 tempest-GroupsTest-63405649 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (98530048-befe-4c6e-a621-6542a494da41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:38:58 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-dbe3a99f-961d-42af-b2da-633066474248 tempest-GroupsTest-63405649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (19cf94d1-37bf-4603-83d3-15697dc91dd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:38:58 devstack cinder-volume[88899]: INFO cinder.volume.flows.manager.create_volume [None req-dbe3a99f-961d-42af-b2da-633066474248 tempest-GroupsTest-63405649 None] Volume eb2657de-305f-4763-a5d1-8b7fb7d744c7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eb2657de-305f-4763-a5d1-8b7fb7d744c7', 'volume_size': 1} Aug 03 08:38:58 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-dbe3a99f-961d-42af-b2da-633066474248 tempest-GroupsTest-63405649 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:38:58 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-dbe3a99f-961d-42af-b2da-633066474248 tempest-GroupsTest-63405649 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:38:58 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-dbe3a99f-961d-42af-b2da-633066474248 tempest-GroupsTest-63405649 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=74d500a7-9f86-4156-b967-1cff35772848,created_at=2026-08-03T06:38:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1710770001',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=74d500a7-9f86-4156-b967-1cff35772848,host='devstack@QuobyteHD#QuobyteHD',id=eb2657de-305f-4763-a5d1-8b7fb7d744c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='caa16087ffe641b5b7b935d3f5200ce8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:38:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:38:58Z,use_quota=True,user_id='d77b9b03ddfd4f99b8f181a85ab7abe6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(85800862-efa0-452c-aa2f-8a558da131d3),volume_type_id=85800862-efa0-452c-aa2f-8a558da131d3)}" {{(pid=88899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 08:38:58 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-dbe3a99f-961d-42af-b2da-633066474248 tempest-GroupsTest-63405649 None] Creating volume eb2657de-305f-4763-a5d1-8b7fb7d744c7 {{(pid=88899) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 08:38:58 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-dbe3a99f-961d-42af-b2da-633066474248 tempest-GroupsTest-63405649 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:38:58 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-dbe3a99f-961d-42af-b2da-633066474248 tempest-GroupsTest-63405649 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:38:58 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-dbe3a99f-961d-42af-b2da-633066474248 tempest-GroupsTest-63405649 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:38:58 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-dbe3a99f-961d-42af-b2da-633066474248 tempest-GroupsTest-63405649 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:38:58 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-dbe3a99f-961d-42af-b2da-633066474248 tempest-GroupsTest-63405649 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:38:58 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-dbe3a99f-961d-42af-b2da-633066474248 tempest-GroupsTest-63405649 None] Selected osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385 as target Quobyte volume. {{(pid=88899) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 08:38:58 devstack cinder-volume[88899]: INFO cinder.volume.drivers.remotefs [None req-dbe3a99f-961d-42af-b2da-633066474248 tempest-GroupsTest-63405649 None] casted to osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385 Aug 03 08:38:58 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-dbe3a99f-961d-42af-b2da-633066474248 tempest-GroupsTest-63405649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-eb2657de-305f-4763-a5d1-8b7fb7d744c7 1073741824 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:38:58 devstack sudo[101077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-eb2657de-305f-4763-a5d1-8b7fb7d744c7 1073741824 Aug 03 08:38:58 devstack sudo[101077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:38:58 devstack cinder-volume[88899]: DEBUG cinder.volume.flows.manager.create_volume [None req-cad866b5-11a9-4050-8254-ccf7b29b92b3 tempest-VolumesCloneTest-1143049529 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88899) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 08:38:58 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-cad866b5-11a9-4050-8254-ccf7b29b92b3 tempest-VolumesCloneTest-1143049529 None] Flow 'volume_create_manager' (4d31fb85-9aec-4ea8-a161-ccba227fc0f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:38:58 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-cad866b5-11a9-4050-8254-ccf7b29b92b3 tempest-VolumesCloneTest-1143049529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (891e3382-3042-4d54-8619-5b5328662297) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:38:58 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-cad866b5-11a9-4050-8254-ccf7b29b92b3 tempest-VolumesCloneTest-1143049529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (891e3382-3042-4d54-8619-5b5328662297) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:38:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1084697789',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=975e3310-3a64-408c-af7b-e5f74ac94bbf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e08a6d0fc354ec88bae7076aabe791e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:38:58Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=c6f08e43-eea9-4a15-8777-fdeadac83a3c,status='creating',terminated_at=None,updated_at=2026-08-03T06:38:58Z,use_quota=True,user_id='19bbdd587c2f46a7a4de351b13af87a9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8bde7129-1dc4-42ab-b852-ab32c61b4921),volume_type_id=8bde7129-1dc4-42ab-b852-ab32c61b4921)' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:38:58 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-cad866b5-11a9-4050-8254-ccf7b29b92b3 tempest-VolumesCloneTest-1143049529 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (88439030-aa98-40e2-9892-e4ab248c5a07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:38:58 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-cad866b5-11a9-4050-8254-ccf7b29b92b3 tempest-VolumesCloneTest-1143049529 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (88439030-aa98-40e2-9892-e4ab248c5a07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:38:58 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-cad866b5-11a9-4050-8254-ccf7b29b92b3 tempest-VolumesCloneTest-1143049529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b04bf24f-2a0c-44bd-805c-f9736c93857c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:38:58 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-cad866b5-11a9-4050-8254-ccf7b29b92b3 tempest-VolumesCloneTest-1143049529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b04bf24f-2a0c-44bd-805c-f9736c93857c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '975e3310-3a64-408c-af7b-e5f74ac94bbf', 'volume_name': 'volume-975e3310-3a64-408c-af7b-e5f74ac94bbf', 'volume_size': 2, 'source_volid': 'c6f08e43-eea9-4a15-8777-fdeadac83a3c', 'source_volstatus': 'available'}' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:38:58 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-cad866b5-11a9-4050-8254-ccf7b29b92b3 tempest-VolumesCloneTest-1143049529 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8140c1c0-a961-4382-8d10-f030af395f21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:38:58 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-cad866b5-11a9-4050-8254-ccf7b29b92b3 tempest-VolumesCloneTest-1143049529 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8140c1c0-a961-4382-8d10-f030af395f21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:38:58 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-cad866b5-11a9-4050-8254-ccf7b29b92b3 tempest-VolumesCloneTest-1143049529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a8764c75-4cfa-4c78-825d-6a65f6681897) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:38:58 devstack cinder-volume[88899]: INFO cinder.volume.flows.manager.create_volume [None req-cad866b5-11a9-4050-8254-ccf7b29b92b3 tempest-VolumesCloneTest-1143049529 None] Volume 975e3310-3a64-408c-af7b-e5f74ac94bbf: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-975e3310-3a64-408c-af7b-e5f74ac94bbf', 'volume_size': 2, 'source_volid': 'c6f08e43-eea9-4a15-8777-fdeadac83a3c', 'source_volstatus': 'available'} Aug 03 08:38:58 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-cad866b5-11a9-4050-8254-ccf7b29b92b3 tempest-VolumesCloneTest-1143049529 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:38:58 devstack sudo[101077]: pam_unix(sudo:session): session closed for user root Aug 03 08:38:58 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-dbe3a99f-961d-42af-b2da-633066474248 tempest-GroupsTest-63405649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-eb2657de-305f-4763-a5d1-8b7fb7d744c7 1073741824" returned: 0 in 0.591s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:38:58 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-dbe3a99f-961d-42af-b2da-633066474248 tempest-GroupsTest-63405649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-eb2657de-305f-4763-a5d1-8b7fb7d744c7 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:38:58 devstack sudo[101085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-eb2657de-305f-4763-a5d1-8b7fb7d744c7 Aug 03 08:38:58 devstack sudo[101085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:38:59 devstack sudo[101085]: pam_unix(sudo:session): session closed for user root Aug 03 08:38:59 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-dbe3a99f-961d-42af-b2da-633066474248 tempest-GroupsTest-63405649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-eb2657de-305f-4763-a5d1-8b7fb7d744c7" returned: 0 in 0.280s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:38:59 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-dbe3a99f-961d-42af-b2da-633066474248 tempest-GroupsTest-63405649 None] <== create_volume: return (934ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'} {{(pid=88899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 08:38:59 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-dbe3a99f-961d-42af-b2da-633066474248 tempest-GroupsTest-63405649 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.937s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:38:59 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-cad866b5-11a9-4050-8254-ccf7b29b92b3 tempest-VolumesCloneTest-1143049529 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.555s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:38:59 devstack cinder-volume[88899]: INFO cinder.volume.drivers.remotefs [None req-cad866b5-11a9-4050-8254-ccf7b29b92b3 tempest-VolumesCloneTest-1143049529 None] Cloning volume c6f08e43-eea9-4a15-8777-fdeadac83a3c to volume 975e3310-3a64-408c-af7b-e5f74ac94bbf Aug 03 08:38:59 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-dbe3a99f-961d-42af-b2da-633066474248 tempest-GroupsTest-63405649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (19cf94d1-37bf-4603-83d3-15697dc91dd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eb2657de-305f-4763-a5d1-8b7fb7d744c7', 'volume_size': 1}' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:38:59 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-dbe3a99f-961d-42af-b2da-633066474248 tempest-GroupsTest-63405649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7be3b47e-81f1-476a-831b-d97473b511b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:38:59 devstack cinder-volume[88899]: INFO cinder.volume.flows.manager.create_volume [None req-dbe3a99f-961d-42af-b2da-633066474248 tempest-GroupsTest-63405649 None] Volume volume-eb2657de-305f-4763-a5d1-8b7fb7d744c7 (eb2657de-305f-4763-a5d1-8b7fb7d744c7): created successfully Aug 03 08:38:59 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-dbe3a99f-961d-42af-b2da-633066474248 tempest-GroupsTest-63405649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7be3b47e-81f1-476a-831b-d97473b511b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:38:59 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-dbe3a99f-961d-42af-b2da-633066474248 tempest-GroupsTest-63405649 None] Flow 'volume_create_manager' (bf43dc7e-422d-49d3-b44e-a5aed40587f9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:38:59 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-cad866b5-11a9-4050-8254-ccf7b29b92b3 tempest-VolumesCloneTest-1143049529 None] Creating offline snapshot 7e692bae-0e5f-40c4-bcc8-8e88eb9592dd of volume c6f08e43-eea9-4a15-8777-fdeadac83a3c {{(pid=88899) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 03 08:38:59 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-dbe3a99f-961d-42af-b2da-633066474248 tempest-GroupsTest-63405649 None] Created volume successfully. Aug 03 08:38:59 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[0710e1a0-eac0-46f9-9c4a-b780df3fa34d]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:38:59 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-cad866b5-11a9-4050-8254-ccf7b29b92b3 tempest-VolumesCloneTest-1143049529 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c6f08e43-eea9-4a15-8777-fdeadac83a3c {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:38:59 devstack sudo[101088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c6f08e43-eea9-4a15-8777-fdeadac83a3c Aug 03 08:38:59 devstack sudo[101088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:38:59 devstack sudo[101088]: pam_unix(sudo:session): session closed for user root Aug 03 08:38:59 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-cad866b5-11a9-4050-8254-ccf7b29b92b3 tempest-VolumesCloneTest-1143049529 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c6f08e43-eea9-4a15-8777-fdeadac83a3c" returned: 0 in 0.525s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:38:59 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-cad866b5-11a9-4050-8254-ccf7b29b92b3 tempest-VolumesCloneTest-1143049529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c6f08e43-eea9-4a15-8777-fdeadac83a3c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c6f08e43-eea9-4a15-8777-fdeadac83a3c.7e692bae-0e5f-40c4-bcc8-8e88eb9592dd 1G {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:38:59 devstack sudo[101093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c6f08e43-eea9-4a15-8777-fdeadac83a3c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c6f08e43-eea9-4a15-8777-fdeadac83a3c.7e692bae-0e5f-40c4-bcc8-8e88eb9592dd 1G Aug 03 08:38:59 devstack sudo[101093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:39:00 devstack sudo[101093]: pam_unix(sudo:session): session closed for user root Aug 03 08:39:00 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-cad866b5-11a9-4050-8254-ccf7b29b92b3 tempest-VolumesCloneTest-1143049529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c6f08e43-eea9-4a15-8777-fdeadac83a3c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c6f08e43-eea9-4a15-8777-fdeadac83a3c.7e692bae-0e5f-40c4-bcc8-8e88eb9592dd 1G" returned: 0 in 0.672s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:39:00 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-cad866b5-11a9-4050-8254-ccf7b29b92b3 tempest-VolumesCloneTest-1143049529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c6f08e43-eea9-4a15-8777-fdeadac83a3c -F qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c6f08e43-eea9-4a15-8777-fdeadac83a3c.7e692bae-0e5f-40c4-bcc8-8e88eb9592dd {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:39:00 devstack sudo[101104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c6f08e43-eea9-4a15-8777-fdeadac83a3c -F qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c6f08e43-eea9-4a15-8777-fdeadac83a3c.7e692bae-0e5f-40c4-bcc8-8e88eb9592dd Aug 03 08:39:00 devstack sudo[101104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:39:01 devstack sudo[101104]: pam_unix(sudo:session): session closed for user root Aug 03 08:39:01 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-cad866b5-11a9-4050-8254-ccf7b29b92b3 tempest-VolumesCloneTest-1143049529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c6f08e43-eea9-4a15-8777-fdeadac83a3c -F qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c6f08e43-eea9-4a15-8777-fdeadac83a3c.7e692bae-0e5f-40c4-bcc8-8e88eb9592dd" returned: 0 in 0.483s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:39:01 devstack cinder-volume[88899]: WARNING cinder.volume.drivers.remotefs [None req-cad866b5-11a9-4050-8254-ccf7b29b92b3 tempest-VolumesCloneTest-1143049529 None] /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c6f08e43-eea9-4a15-8777-fdeadac83a3c.7e692bae-0e5f-40c4-bcc8-8e88eb9592dd is being set with open permissions: ugo+rw Aug 03 08:39:01 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-cad866b5-11a9-4050-8254-ccf7b29b92b3 tempest-VolumesCloneTest-1143049529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c6f08e43-eea9-4a15-8777-fdeadac83a3c.7e692bae-0e5f-40c4-bcc8-8e88eb9592dd {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:39:01 devstack cinder-volume[88899]: DEBUG cinder.volume.flows.manager.create_volume [None req-fbacde9f-e113-49d8-8900-cd770629aaa3 tempest-GroupsTest-63405649 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88899) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 08:39:01 devstack sudo[101121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c6f08e43-eea9-4a15-8777-fdeadac83a3c.7e692bae-0e5f-40c4-bcc8-8e88eb9592dd Aug 03 08:39:01 devstack sudo[101121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:39:01 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-fbacde9f-e113-49d8-8900-cd770629aaa3 tempest-GroupsTest-63405649 None] Flow 'volume_create_manager' (939c4fb5-06df-4b54-9497-6d42a7d6d1ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:39:01 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-fbacde9f-e113-49d8-8900-cd770629aaa3 tempest-GroupsTest-63405649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a6c62bd-7c6b-4e69-90ae-916c3112b087) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:39:01 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-fbacde9f-e113-49d8-8900-cd770629aaa3 tempest-GroupsTest-63405649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a6c62bd-7c6b-4e69-90ae-916c3112b087) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:39:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-154699903',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=74d500a7-9f86-4156-b967-1cff35772848,host='devstack@QuobyteHD#QuobyteHD',id=f3d1f434-93bb-41f0-85a5-9bdb8e0a0c9c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='caa16087ffe641b5b7b935d3f5200ce8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:39:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:39:01Z,use_quota=True,user_id='d77b9b03ddfd4f99b8f181a85ab7abe6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(85800862-efa0-452c-aa2f-8a558da131d3),volume_type_id=85800862-efa0-452c-aa2f-8a558da131d3)' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:39:01 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-fbacde9f-e113-49d8-8900-cd770629aaa3 tempest-GroupsTest-63405649 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4563eef-8c2e-450c-9282-379a20b478d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:39:01 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-fbacde9f-e113-49d8-8900-cd770629aaa3 tempest-GroupsTest-63405649 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4563eef-8c2e-450c-9282-379a20b478d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:39:01 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-fbacde9f-e113-49d8-8900-cd770629aaa3 tempest-GroupsTest-63405649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d79c447-e305-4548-a24b-d22a79eaad12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:39:01 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-fbacde9f-e113-49d8-8900-cd770629aaa3 tempest-GroupsTest-63405649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d79c447-e305-4548-a24b-d22a79eaad12) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f3d1f434-93bb-41f0-85a5-9bdb8e0a0c9c', 'volume_name': 'volume-f3d1f434-93bb-41f0-85a5-9bdb8e0a0c9c', 'volume_size': 1}' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:39:01 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-fbacde9f-e113-49d8-8900-cd770629aaa3 tempest-GroupsTest-63405649 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d540d984-ca5a-42f5-8b5d-75399f8e2f98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:39:01 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-fbacde9f-e113-49d8-8900-cd770629aaa3 tempest-GroupsTest-63405649 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d540d984-ca5a-42f5-8b5d-75399f8e2f98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:39:01 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-fbacde9f-e113-49d8-8900-cd770629aaa3 tempest-GroupsTest-63405649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b14fb6a-27c9-40b3-9db4-3aaca9f2b304) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:39:01 devstack cinder-volume[88899]: INFO cinder.volume.flows.manager.create_volume [None req-fbacde9f-e113-49d8-8900-cd770629aaa3 tempest-GroupsTest-63405649 None] Volume f3d1f434-93bb-41f0-85a5-9bdb8e0a0c9c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f3d1f434-93bb-41f0-85a5-9bdb8e0a0c9c', 'volume_size': 1} Aug 03 08:39:01 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-fbacde9f-e113-49d8-8900-cd770629aaa3 tempest-GroupsTest-63405649 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:39:01 devstack cinder-volume[88899]: DEBUG cinder.volume.flows.manager.create_volume [None req-5b9ec327-57dd-4992-94e6-22f070d84ac1 tempest-VolumesTransfersV355Test-696244887 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88899) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 08:39:01 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-5b9ec327-57dd-4992-94e6-22f070d84ac1 tempest-VolumesTransfersV355Test-696244887 None] Flow 'volume_create_manager' (6158ce0e-b38b-4981-aff9-aaadadee18ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:39:01 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-5b9ec327-57dd-4992-94e6-22f070d84ac1 tempest-VolumesTransfersV355Test-696244887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (73c37907-e019-43d1-82d4-6750298b47a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:39:01 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-5b9ec327-57dd-4992-94e6-22f070d84ac1 tempest-VolumesTransfersV355Test-696244887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (73c37907-e019-43d1-82d4-6750298b47a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:39:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-874360997',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d5ec7510-c237-4bb4-bad4-9c4746ba8f7d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e7777f506dab4529a6411b54e64bcd76',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:39:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:39:01Z,use_quota=True,user_id='0d5ed631b8084461a51f8ca76ebb65a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8bde7129-1dc4-42ab-b852-ab32c61b4921),volume_type_id=8bde7129-1dc4-42ab-b852-ab32c61b4921)' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:39:01 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-5b9ec327-57dd-4992-94e6-22f070d84ac1 tempest-VolumesTransfersV355Test-696244887 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f434ac53-96db-4ae9-b4ce-2a49379a2f38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:39:01 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-5b9ec327-57dd-4992-94e6-22f070d84ac1 tempest-VolumesTransfersV355Test-696244887 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f434ac53-96db-4ae9-b4ce-2a49379a2f38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:39:01 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-5b9ec327-57dd-4992-94e6-22f070d84ac1 tempest-VolumesTransfersV355Test-696244887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (886b4518-7278-4ddc-93c5-fe4277bf65ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:39:01 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-5b9ec327-57dd-4992-94e6-22f070d84ac1 tempest-VolumesTransfersV355Test-696244887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (886b4518-7278-4ddc-93c5-fe4277bf65ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd5ec7510-c237-4bb4-bad4-9c4746ba8f7d', 'volume_name': 'volume-d5ec7510-c237-4bb4-bad4-9c4746ba8f7d', 'volume_size': 1}' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:39:01 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-5b9ec327-57dd-4992-94e6-22f070d84ac1 tempest-VolumesTransfersV355Test-696244887 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb5f47db-e961-4707-ab9a-72b36067c06f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:39:01 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-5b9ec327-57dd-4992-94e6-22f070d84ac1 tempest-VolumesTransfersV355Test-696244887 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb5f47db-e961-4707-ab9a-72b36067c06f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:39:01 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-5b9ec327-57dd-4992-94e6-22f070d84ac1 tempest-VolumesTransfersV355Test-696244887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aad7fabf-cf79-4824-ba18-5a2f172aede0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:39:01 devstack cinder-volume[88899]: INFO cinder.volume.flows.manager.create_volume [None req-5b9ec327-57dd-4992-94e6-22f070d84ac1 tempest-VolumesTransfersV355Test-696244887 None] Volume d5ec7510-c237-4bb4-bad4-9c4746ba8f7d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d5ec7510-c237-4bb4-bad4-9c4746ba8f7d', 'volume_size': 1} Aug 03 08:39:01 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-5b9ec327-57dd-4992-94e6-22f070d84ac1 tempest-VolumesTransfersV355Test-696244887 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:39:01 devstack sudo[101121]: pam_unix(sudo:session): session closed for user root Aug 03 08:39:01 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-cad866b5-11a9-4050-8254-ccf7b29b92b3 tempest-VolumesCloneTest-1143049529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c6f08e43-eea9-4a15-8777-fdeadac83a3c.7e692bae-0e5f-40c4-bcc8-8e88eb9592dd" returned: 0 in 0.318s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:39:01 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-cad866b5-11a9-4050-8254-ccf7b29b92b3 tempest-VolumesCloneTest-1143049529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c6f08e43-eea9-4a15-8777-fdeadac83a3c.info {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:39:01 devstack sudo[101128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c6f08e43-eea9-4a15-8777-fdeadac83a3c.info Aug 03 08:39:01 devstack sudo[101128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:39:01 devstack sudo[101128]: pam_unix(sudo:session): session closed for user root Aug 03 08:39:01 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-cad866b5-11a9-4050-8254-ccf7b29b92b3 tempest-VolumesCloneTest-1143049529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c6f08e43-eea9-4a15-8777-fdeadac83a3c.info" returned: 0 in 0.298s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:39:01 devstack cinder-volume[88899]: WARNING cinder.volume.drivers.remotefs [None req-cad866b5-11a9-4050-8254-ccf7b29b92b3 tempest-VolumesCloneTest-1143049529 None] /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c6f08e43-eea9-4a15-8777-fdeadac83a3c.info is being set with open permissions: ugo+rw Aug 03 08:39:01 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-cad866b5-11a9-4050-8254-ccf7b29b92b3 tempest-VolumesCloneTest-1143049529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c6f08e43-eea9-4a15-8777-fdeadac83a3c.info {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:39:01 devstack sudo[101131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c6f08e43-eea9-4a15-8777-fdeadac83a3c.info Aug 03 08:39:01 devstack sudo[101131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:39:01 devstack sudo[101131]: pam_unix(sudo:session): session closed for user root Aug 03 08:39:01 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-cad866b5-11a9-4050-8254-ccf7b29b92b3 tempest-VolumesCloneTest-1143049529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c6f08e43-eea9-4a15-8777-fdeadac83a3c.info" returned: 0 in 0.262s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:39:01 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-cad866b5-11a9-4050-8254-ccf7b29b92b3 tempest-VolumesCloneTest-1143049529 None] Acquiring lock "cinder-quobyte-975e3310-3a64-408c-af7b-e5f74ac94bbf" by "_copy_volume_from_snapshot" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:39:01 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-cad866b5-11a9-4050-8254-ccf7b29b92b3 tempest-VolumesCloneTest-1143049529 None] Lock "cinder-quobyte-975e3310-3a64-408c-af7b-e5f74ac94bbf" acquired by "_copy_volume_from_snapshot" :: waited 0.017s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:39:01 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-cad866b5-11a9-4050-8254-ccf7b29b92b3 tempest-VolumesCloneTest-1143049529 None] snapshot: 7e692bae-0e5f-40c4-bcc8-8e88eb9592dd, volume: 975e3310-3a64-408c-af7b-e5f74ac94bbf, {{(pid=88899) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Aug 03 08:39:01 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-cad866b5-11a9-4050-8254-ccf7b29b92b3 tempest-VolumesCloneTest-1143049529 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:39:01 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-cad866b5-11a9-4050-8254-ccf7b29b92b3 tempest-VolumesCloneTest-1143049529 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:39:01 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-cad866b5-11a9-4050-8254-ccf7b29b92b3 tempest-VolumesCloneTest-1143049529 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:39:02 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-cad866b5-11a9-4050-8254-ccf7b29b92b3 tempest-VolumesCloneTest-1143049529 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:39:02 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-cad866b5-11a9-4050-8254-ccf7b29b92b3 tempest-VolumesCloneTest-1143049529 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:39:02 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[8540e201-ce3a-41e9-b472-bb611d7d4770]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:39:02 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-cad866b5-11a9-4050-8254-ccf7b29b92b3 tempest-VolumesCloneTest-1143049529 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c6f08e43-eea9-4a15-8777-fdeadac83a3c.7e692bae-0e5f-40c4-bcc8-8e88eb9592dd {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:39:02 devstack sudo[101134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c6f08e43-eea9-4a15-8777-fdeadac83a3c.7e692bae-0e5f-40c4-bcc8-8e88eb9592dd Aug 03 08:39:02 devstack sudo[101134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:39:02 devstack sudo[101134]: pam_unix(sudo:session): session closed for user root Aug 03 08:39:02 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-cad866b5-11a9-4050-8254-ccf7b29b92b3 tempest-VolumesCloneTest-1143049529 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c6f08e43-eea9-4a15-8777-fdeadac83a3c.7e692bae-0e5f-40c4-bcc8-8e88eb9592dd" returned: 0 in 0.398s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:39:02 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-cad866b5-11a9-4050-8254-ccf7b29b92b3 tempest-VolumesCloneTest-1143049529 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c6f08e43-eea9-4a15-8777-fdeadac83a3c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88899) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 03 08:39:02 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0f07ef2-032b-4079-b9e2-daceb93f5404]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:39:02 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-cad866b5-11a9-4050-8254-ccf7b29b92b3 tempest-VolumesCloneTest-1143049529 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c6f08e43-eea9-4a15-8777-fdeadac83a3c {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:39:02 devstack sudo[101139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c6f08e43-eea9-4a15-8777-fdeadac83a3c Aug 03 08:39:02 devstack sudo[101139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:39:02 devstack sudo[101139]: pam_unix(sudo:session): session closed for user root Aug 03 08:39:02 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-cad866b5-11a9-4050-8254-ccf7b29b92b3 tempest-VolumesCloneTest-1143049529 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c6f08e43-eea9-4a15-8777-fdeadac83a3c" returned: 0 in 0.405s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:39:02 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-cad866b5-11a9-4050-8254-ccf7b29b92b3 tempest-VolumesCloneTest-1143049529 None] will copy from snapshot at /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c6f08e43-eea9-4a15-8777-fdeadac83a3c {{(pid=88899) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Aug 03 08:39:02 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-cad866b5-11a9-4050-8254-ccf7b29b92b3 tempest-VolumesCloneTest-1143049529 None] Creating direct copy from snapshot {{(pid=88899) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Aug 03 08:39:02 devstack cinder-volume[88899]: DEBUG cinder.utils [None req-cad866b5-11a9-4050-8254-ccf7b29b92b3 tempest-VolumesCloneTest-1143049529 None] Path /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-975e3310-3a64-408c-af7b-e5f74ac94bbf not found in is_blk_device check {{(pid=88899) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Aug 03 08:39:02 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-cad866b5-11a9-4050-8254-ccf7b29b92b3 tempest-VolumesCloneTest-1143049529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c6f08e43-eea9-4a15-8777-fdeadac83a3c /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-975e3310-3a64-408c-af7b-e5f74ac94bbf {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:39:02 devstack sudo[101146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c6f08e43-eea9-4a15-8777-fdeadac83a3c /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-975e3310-3a64-408c-af7b-e5f74ac94bbf Aug 03 08:39:02 devstack sudo[101146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:39:09 devstack sudo[101146]: pam_unix(sudo:session): session closed for user root Aug 03 08:39:09 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-cad866b5-11a9-4050-8254-ccf7b29b92b3 tempest-VolumesCloneTest-1143049529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c6f08e43-eea9-4a15-8777-fdeadac83a3c /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-975e3310-3a64-408c-af7b-e5f74ac94bbf" returned: 0 in 6.541s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:39:09 devstack cinder-volume[88899]: DEBUG cinder.image.image_utils [None req-cad866b5-11a9-4050-8254-ccf7b29b92b3 tempest-VolumesCloneTest-1143049529 None] Image conversion details: src /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c6f08e43-eea9-4a15-8777-fdeadac83a3c, size 1024.00 MB, duration 6.54 sec, destination /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-975e3310-3a64-408c-af7b-e5f74ac94bbf {{(pid=88899) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 03 08:39:09 devstack cinder-volume[88899]: INFO cinder.image.image_utils [None req-cad866b5-11a9-4050-8254-ccf7b29b92b3 tempest-VolumesCloneTest-1143049529 None] Converted 1024.00 MB image at 156.53 MB/s Aug 03 08:39:09 devstack cinder-volume[88899]: WARNING cinder.volume.drivers.remotefs [None req-cad866b5-11a9-4050-8254-ccf7b29b92b3 tempest-VolumesCloneTest-1143049529 None] /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-975e3310-3a64-408c-af7b-e5f74ac94bbf is being set with open permissions: ugo+rw Aug 03 08:39:09 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-cad866b5-11a9-4050-8254-ccf7b29b92b3 tempest-VolumesCloneTest-1143049529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-975e3310-3a64-408c-af7b-e5f74ac94bbf {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:39:09 devstack sudo[101244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-975e3310-3a64-408c-af7b-e5f74ac94bbf Aug 03 08:39:09 devstack sudo[101244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:39:09 devstack sudo[101244]: pam_unix(sudo:session): session closed for user root Aug 03 08:39:09 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-cad866b5-11a9-4050-8254-ccf7b29b92b3 tempest-VolumesCloneTest-1143049529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-975e3310-3a64-408c-af7b-e5f74ac94bbf" returned: 0 in 0.253s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:39:09 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-cad866b5-11a9-4050-8254-ccf7b29b92b3 tempest-VolumesCloneTest-1143049529 None] Lock "cinder-quobyte-975e3310-3a64-408c-af7b-e5f74ac94bbf" released by "_copy_volume_from_snapshot" :: held 7.678s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:39:09 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-cad866b5-11a9-4050-8254-ccf7b29b92b3 tempest-VolumesCloneTest-1143049529 None] Acquiring lock "cinder-quobyte-7e692bae-0e5f-40c4-bcc8-8e88eb9592dd" by "_delete_snapshot" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:39:09 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-cad866b5-11a9-4050-8254-ccf7b29b92b3 tempest-VolumesCloneTest-1143049529 None] Lock "cinder-quobyte-7e692bae-0e5f-40c4-bcc8-8e88eb9592dd" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:39:09 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-cad866b5-11a9-4050-8254-ccf7b29b92b3 tempest-VolumesCloneTest-1143049529 None] Deleting offline snapshot 7e692bae-0e5f-40c4-bcc8-8e88eb9592dd of volume c6f08e43-eea9-4a15-8777-fdeadac83a3c {{(pid=88899) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 03 08:39:09 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-cad866b5-11a9-4050-8254-ccf7b29b92b3 tempest-VolumesCloneTest-1143049529 None] snapshot_file for this snap is: volume-c6f08e43-eea9-4a15-8777-fdeadac83a3c.7e692bae-0e5f-40c4-bcc8-8e88eb9592dd {{(pid=88899) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 03 08:39:09 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec798325-388e-4bdf-aa85-cb0441757191]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:39:09 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-cad866b5-11a9-4050-8254-ccf7b29b92b3 tempest-VolumesCloneTest-1143049529 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c6f08e43-eea9-4a15-8777-fdeadac83a3c.7e692bae-0e5f-40c4-bcc8-8e88eb9592dd {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:39:09 devstack sudo[101247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c6f08e43-eea9-4a15-8777-fdeadac83a3c.7e692bae-0e5f-40c4-bcc8-8e88eb9592dd Aug 03 08:39:09 devstack sudo[101247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:39:10 devstack sudo[101247]: pam_unix(sudo:session): session closed for user root Aug 03 08:39:10 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-cad866b5-11a9-4050-8254-ccf7b29b92b3 tempest-VolumesCloneTest-1143049529 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c6f08e43-eea9-4a15-8777-fdeadac83a3c.7e692bae-0e5f-40c4-bcc8-8e88eb9592dd" returned: 0 in 0.456s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:39:10 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-cad866b5-11a9-4050-8254-ccf7b29b92b3 tempest-VolumesCloneTest-1143049529 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c6f08e43-eea9-4a15-8777-fdeadac83a3c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88899) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 03 08:39:10 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[89e2af75-8c25-4894-95e2-173fb4da9269]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:39:10 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-cad866b5-11a9-4050-8254-ccf7b29b92b3 tempest-VolumesCloneTest-1143049529 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c6f08e43-eea9-4a15-8777-fdeadac83a3c {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:39:10 devstack sudo[101253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c6f08e43-eea9-4a15-8777-fdeadac83a3c Aug 03 08:39:10 devstack sudo[101253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:39:10 devstack sudo[101253]: pam_unix(sudo:session): session closed for user root Aug 03 08:39:10 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-cad866b5-11a9-4050-8254-ccf7b29b92b3 tempest-VolumesCloneTest-1143049529 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c6f08e43-eea9-4a15-8777-fdeadac83a3c" returned: 0 in 0.627s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:39:10 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-cad866b5-11a9-4050-8254-ccf7b29b92b3 tempest-VolumesCloneTest-1143049529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c6f08e43-eea9-4a15-8777-fdeadac83a3c.7e692bae-0e5f-40c4-bcc8-8e88eb9592dd {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:39:10 devstack sudo[101265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c6f08e43-eea9-4a15-8777-fdeadac83a3c.7e692bae-0e5f-40c4-bcc8-8e88eb9592dd Aug 03 08:39:10 devstack sudo[101265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:39:11 devstack sudo[101265]: pam_unix(sudo:session): session closed for user root Aug 03 08:39:11 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-cad866b5-11a9-4050-8254-ccf7b29b92b3 tempest-VolumesCloneTest-1143049529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c6f08e43-eea9-4a15-8777-fdeadac83a3c.7e692bae-0e5f-40c4-bcc8-8e88eb9592dd" returned: 0 in 0.453s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:39:11 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-cad866b5-11a9-4050-8254-ccf7b29b92b3 tempest-VolumesCloneTest-1143049529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c6f08e43-eea9-4a15-8777-fdeadac83a3c.7e692bae-0e5f-40c4-bcc8-8e88eb9592dd {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:39:11 devstack sudo[101271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c6f08e43-eea9-4a15-8777-fdeadac83a3c.7e692bae-0e5f-40c4-bcc8-8e88eb9592dd Aug 03 08:39:11 devstack sudo[101271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:39:11 devstack cinder-volume[88899]: DEBUG dbcounter [-] [88899] Writing DB stats cinder:UPDATE=88,cinder:SELECT=87,cinder:INSERT=36,cinder:DELETE=6 {{(pid=88899) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 03 08:39:11 devstack sudo[101271]: pam_unix(sudo:session): session closed for user root Aug 03 08:39:11 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-cad866b5-11a9-4050-8254-ccf7b29b92b3 tempest-VolumesCloneTest-1143049529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c6f08e43-eea9-4a15-8777-fdeadac83a3c.7e692bae-0e5f-40c4-bcc8-8e88eb9592dd" returned: 0 in 0.281s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:39:11 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-cad866b5-11a9-4050-8254-ccf7b29b92b3 tempest-VolumesCloneTest-1143049529 None] Lock "cinder-quobyte-7e692bae-0e5f-40c4-bcc8-8e88eb9592dd" released by "_delete_snapshot" :: held 1.944s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:39:11 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-cad866b5-11a9-4050-8254-ccf7b29b92b3 tempest-VolumesCloneTest-1143049529 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 12.440s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:39:11 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-fbacde9f-e113-49d8-8900-cd770629aaa3 tempest-GroupsTest-63405649 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.520s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:39:11 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-fbacde9f-e113-49d8-8900-cd770629aaa3 tempest-GroupsTest-63405649 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=74d500a7-9f86-4156-b967-1cff35772848,created_at=2026-08-03T06:39:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-154699903',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=74d500a7-9f86-4156-b967-1cff35772848,host='devstack@QuobyteHD#QuobyteHD',id=f3d1f434-93bb-41f0-85a5-9bdb8e0a0c9c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='caa16087ffe641b5b7b935d3f5200ce8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:39:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:39:01Z,use_quota=True,user_id='d77b9b03ddfd4f99b8f181a85ab7abe6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(85800862-efa0-452c-aa2f-8a558da131d3),volume_type_id=85800862-efa0-452c-aa2f-8a558da131d3)}" {{(pid=88899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 08:39:11 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-fbacde9f-e113-49d8-8900-cd770629aaa3 tempest-GroupsTest-63405649 None] Creating volume f3d1f434-93bb-41f0-85a5-9bdb8e0a0c9c {{(pid=88899) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 08:39:11 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-fbacde9f-e113-49d8-8900-cd770629aaa3 tempest-GroupsTest-63405649 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:39:11 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-fbacde9f-e113-49d8-8900-cd770629aaa3 tempest-GroupsTest-63405649 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:39:11 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-fbacde9f-e113-49d8-8900-cd770629aaa3 tempest-GroupsTest-63405649 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:39:11 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-fbacde9f-e113-49d8-8900-cd770629aaa3 tempest-GroupsTest-63405649 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:39:11 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-fbacde9f-e113-49d8-8900-cd770629aaa3 tempest-GroupsTest-63405649 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:39:11 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-fbacde9f-e113-49d8-8900-cd770629aaa3 tempest-GroupsTest-63405649 None] Selected osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385 as target Quobyte volume. {{(pid=88899) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 08:39:11 devstack cinder-volume[88899]: INFO cinder.volume.drivers.remotefs [None req-fbacde9f-e113-49d8-8900-cd770629aaa3 tempest-GroupsTest-63405649 None] casted to osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385 Aug 03 08:39:11 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-fbacde9f-e113-49d8-8900-cd770629aaa3 tempest-GroupsTest-63405649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-f3d1f434-93bb-41f0-85a5-9bdb8e0a0c9c 1073741824 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:39:11 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-cad866b5-11a9-4050-8254-ccf7b29b92b3 tempest-VolumesCloneTest-1143049529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a8764c75-4cfa-4c78-825d-6a65f6681897) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-975e3310-3a64-408c-af7b-e5f74ac94bbf', 'volume_size': 2, 'source_volid': 'c6f08e43-eea9-4a15-8777-fdeadac83a3c', 'source_volstatus': 'available'}' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:39:11 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-cad866b5-11a9-4050-8254-ccf7b29b92b3 tempest-VolumesCloneTest-1143049529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (62f4a5c4-31b7-45cc-b008-243520084667) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:39:11 devstack sudo[101274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-f3d1f434-93bb-41f0-85a5-9bdb8e0a0c9c 1073741824 Aug 03 08:39:11 devstack sudo[101274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:39:11 devstack cinder-volume[88899]: INFO cinder.volume.flows.manager.create_volume [None req-cad866b5-11a9-4050-8254-ccf7b29b92b3 tempest-VolumesCloneTest-1143049529 None] Volume volume-975e3310-3a64-408c-af7b-e5f74ac94bbf (975e3310-3a64-408c-af7b-e5f74ac94bbf): created successfully Aug 03 08:39:11 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-cad866b5-11a9-4050-8254-ccf7b29b92b3 tempest-VolumesCloneTest-1143049529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (62f4a5c4-31b7-45cc-b008-243520084667) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:39:11 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-cad866b5-11a9-4050-8254-ccf7b29b92b3 tempest-VolumesCloneTest-1143049529 None] Flow 'volume_create_manager' (4d31fb85-9aec-4ea8-a161-ccba227fc0f9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:39:11 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-cad866b5-11a9-4050-8254-ccf7b29b92b3 tempest-VolumesCloneTest-1143049529 None] Created volume successfully. Aug 03 08:39:12 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-1f3eb1c0-f870-47a9-93e5-7b497fafde67 tempest-VolumesCloneTest-1143049529 None] Acquiring lock "cinder-975e3310-3a64-408c-af7b-e5f74ac94bbf-delete_volume" by "delete_volume" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:39:12 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-1f3eb1c0-f870-47a9-93e5-7b497fafde67 tempest-VolumesCloneTest-1143049529 None] Lock "cinder-975e3310-3a64-408c-af7b-e5f74ac94bbf-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:39:12 devstack sudo[101274]: pam_unix(sudo:session): session closed for user root Aug 03 08:39:12 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-fbacde9f-e113-49d8-8900-cd770629aaa3 tempest-GroupsTest-63405649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-f3d1f434-93bb-41f0-85a5-9bdb8e0a0c9c 1073741824" returned: 0 in 0.548s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:39:12 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-1f3eb1c0-f870-47a9-93e5-7b497fafde67 tempest-VolumesCloneTest-1143049529 None] Acquiring lock "cinder-quobyte-975e3310-3a64-408c-af7b-e5f74ac94bbf" by "delete_volume" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:39:12 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-1f3eb1c0-f870-47a9-93e5-7b497fafde67 tempest-VolumesCloneTest-1143049529 None] Lock "cinder-quobyte-975e3310-3a64-408c-af7b-e5f74ac94bbf" acquired by "delete_volume" :: waited 0.030s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:39:12 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-fbacde9f-e113-49d8-8900-cd770629aaa3 tempest-GroupsTest-63405649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-f3d1f434-93bb-41f0-85a5-9bdb8e0a0c9c {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:39:12 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[54f6443c-f97f-4a30-920e-35379ec996ab]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:39:12 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-1f3eb1c0-f870-47a9-93e5-7b497fafde67 tempest-VolumesCloneTest-1143049529 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-975e3310-3a64-408c-af7b-e5f74ac94bbf {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:39:12 devstack sudo[101280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-f3d1f434-93bb-41f0-85a5-9bdb8e0a0c9c Aug 03 08:39:12 devstack sudo[101280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:39:12 devstack sudo[101281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-975e3310-3a64-408c-af7b-e5f74ac94bbf Aug 03 08:39:12 devstack sudo[101281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:39:12 devstack sudo[101280]: pam_unix(sudo:session): session closed for user root Aug 03 08:39:12 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-fbacde9f-e113-49d8-8900-cd770629aaa3 tempest-GroupsTest-63405649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-f3d1f434-93bb-41f0-85a5-9bdb8e0a0c9c" returned: 0 in 0.284s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:39:12 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-fbacde9f-e113-49d8-8900-cd770629aaa3 tempest-GroupsTest-63405649 None] <== create_volume: return (904ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'} {{(pid=88899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 08:39:12 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-fbacde9f-e113-49d8-8900-cd770629aaa3 tempest-GroupsTest-63405649 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.907s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:39:12 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-5b9ec327-57dd-4992-94e6-22f070d84ac1 tempest-VolumesTransfersV355Test-696244887 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.360s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:39:12 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-5b9ec327-57dd-4992-94e6-22f070d84ac1 tempest-VolumesTransfersV355Test-696244887 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:39:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-874360997',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d5ec7510-c237-4bb4-bad4-9c4746ba8f7d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e7777f506dab4529a6411b54e64bcd76',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:39:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:39:01Z,use_quota=True,user_id='0d5ed631b8084461a51f8ca76ebb65a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8bde7129-1dc4-42ab-b852-ab32c61b4921),volume_type_id=8bde7129-1dc4-42ab-b852-ab32c61b4921)}" {{(pid=88899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 08:39:12 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-5b9ec327-57dd-4992-94e6-22f070d84ac1 tempest-VolumesTransfersV355Test-696244887 None] Creating volume d5ec7510-c237-4bb4-bad4-9c4746ba8f7d {{(pid=88899) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 08:39:12 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-5b9ec327-57dd-4992-94e6-22f070d84ac1 tempest-VolumesTransfersV355Test-696244887 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:39:12 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-5b9ec327-57dd-4992-94e6-22f070d84ac1 tempest-VolumesTransfersV355Test-696244887 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:39:12 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-5b9ec327-57dd-4992-94e6-22f070d84ac1 tempest-VolumesTransfersV355Test-696244887 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:39:12 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-5b9ec327-57dd-4992-94e6-22f070d84ac1 tempest-VolumesTransfersV355Test-696244887 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:39:12 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-5b9ec327-57dd-4992-94e6-22f070d84ac1 tempest-VolumesTransfersV355Test-696244887 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:39:12 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-5b9ec327-57dd-4992-94e6-22f070d84ac1 tempest-VolumesTransfersV355Test-696244887 None] Selected osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385 as target Quobyte volume. {{(pid=88899) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 08:39:12 devstack cinder-volume[88899]: INFO cinder.volume.drivers.remotefs [None req-5b9ec327-57dd-4992-94e6-22f070d84ac1 tempest-VolumesTransfersV355Test-696244887 None] casted to osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385 Aug 03 08:39:12 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-5b9ec327-57dd-4992-94e6-22f070d84ac1 tempest-VolumesTransfersV355Test-696244887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-d5ec7510-c237-4bb4-bad4-9c4746ba8f7d 1073741824 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:39:12 devstack sudo[101285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-d5ec7510-c237-4bb4-bad4-9c4746ba8f7d 1073741824 Aug 03 08:39:12 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-fbacde9f-e113-49d8-8900-cd770629aaa3 tempest-GroupsTest-63405649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b14fb6a-27c9-40b3-9db4-3aaca9f2b304) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f3d1f434-93bb-41f0-85a5-9bdb8e0a0c9c', 'volume_size': 1}' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:39:12 devstack sudo[101285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:39:12 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-fbacde9f-e113-49d8-8900-cd770629aaa3 tempest-GroupsTest-63405649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56645719-c498-4a51-8360-190676674014) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:39:12 devstack cinder-volume[88899]: INFO cinder.volume.flows.manager.create_volume [None req-fbacde9f-e113-49d8-8900-cd770629aaa3 tempest-GroupsTest-63405649 None] Volume volume-f3d1f434-93bb-41f0-85a5-9bdb8e0a0c9c (f3d1f434-93bb-41f0-85a5-9bdb8e0a0c9c): created successfully Aug 03 08:39:12 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-fbacde9f-e113-49d8-8900-cd770629aaa3 tempest-GroupsTest-63405649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56645719-c498-4a51-8360-190676674014) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:39:12 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-fbacde9f-e113-49d8-8900-cd770629aaa3 tempest-GroupsTest-63405649 None] Flow 'volume_create_manager' (939c4fb5-06df-4b54-9497-6d42a7d6d1ca) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:39:12 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-fbacde9f-e113-49d8-8900-cd770629aaa3 tempest-GroupsTest-63405649 None] Created volume successfully. Aug 03 08:39:12 devstack sudo[101281]: pam_unix(sudo:session): session closed for user root Aug 03 08:39:12 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-1f3eb1c0-f870-47a9-93e5-7b497fafde67 tempest-VolumesCloneTest-1143049529 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-975e3310-3a64-408c-af7b-e5f74ac94bbf" returned: 0 in 0.463s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:39:12 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-1f3eb1c0-f870-47a9-93e5-7b497fafde67 tempest-VolumesCloneTest-1143049529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-975e3310-3a64-408c-af7b-e5f74ac94bbf {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:39:12 devstack sudo[101290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-975e3310-3a64-408c-af7b-e5f74ac94bbf Aug 03 08:39:12 devstack sudo[101290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:39:13 devstack sudo[101290]: pam_unix(sudo:session): session closed for user root Aug 03 08:39:13 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-1f3eb1c0-f870-47a9-93e5-7b497fafde67 tempest-VolumesCloneTest-1143049529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-975e3310-3a64-408c-af7b-e5f74ac94bbf" returned: 0 in 0.329s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:39:13 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-1f3eb1c0-f870-47a9-93e5-7b497fafde67 tempest-VolumesCloneTest-1143049529 None] Lock "cinder-quobyte-975e3310-3a64-408c-af7b-e5f74ac94bbf" released by "delete_volume" :: held 0.848s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:39:13 devstack sudo[101285]: pam_unix(sudo:session): session closed for user root Aug 03 08:39:13 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-5b9ec327-57dd-4992-94e6-22f070d84ac1 tempest-VolumesTransfersV355Test-696244887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-d5ec7510-c237-4bb4-bad4-9c4746ba8f7d 1073741824" returned: 0 in 0.521s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:39:13 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-5b9ec327-57dd-4992-94e6-22f070d84ac1 tempest-VolumesTransfersV355Test-696244887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-d5ec7510-c237-4bb4-bad4-9c4746ba8f7d {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:39:13 devstack sudo[101296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-d5ec7510-c237-4bb4-bad4-9c4746ba8f7d Aug 03 08:39:13 devstack sudo[101296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:39:13 devstack cinder-volume[88899]: DEBUG cinder.quota [None req-1f3eb1c0-f870-47a9-93e5-7b497fafde67 tempest-VolumesCloneTest-1143049529 None] Created reservations ['726146f2-4dd1-4043-afdb-4bf9384244e0', '2c267e9a-9b9d-4f07-9b01-fed044aad1fd', 'cbfa09c3-b4fb-4cbe-9516-ddd7ffc69e0d', '6220f2a4-f4f8-42dc-9501-549f5a3e2dbc'] {{(pid=88899) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 08:39:13 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-1f3eb1c0-f870-47a9-93e5-7b497fafde67 tempest-VolumesCloneTest-1143049529 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:39:13 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-1f3eb1c0-f870-47a9-93e5-7b497fafde67 tempest-VolumesCloneTest-1143049529 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:39:13 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-1f3eb1c0-f870-47a9-93e5-7b497fafde67 tempest-VolumesCloneTest-1143049529 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:39:13 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-1f3eb1c0-f870-47a9-93e5-7b497fafde67 tempest-VolumesCloneTest-1143049529 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:39:13 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-1f3eb1c0-f870-47a9-93e5-7b497fafde67 tempest-VolumesCloneTest-1143049529 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:39:13 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-1f3eb1c0-f870-47a9-93e5-7b497fafde67 tempest-VolumesCloneTest-1143049529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:39:13 devstack sudo[101298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a Aug 03 08:39:13 devstack sudo[101298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:39:13 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-2976add5-6295-4b1f-b67a-8cd79ffeadc2 tempest-VolumesCloneTest-1143049529 None] Acquiring lock "cinder-c6f08e43-eea9-4a15-8777-fdeadac83a3c-delete_volume" by "delete_volume" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:39:13 devstack sudo[101296]: pam_unix(sudo:session): session closed for user root Aug 03 08:39:13 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-5b9ec327-57dd-4992-94e6-22f070d84ac1 tempest-VolumesTransfersV355Test-696244887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-d5ec7510-c237-4bb4-bad4-9c4746ba8f7d" returned: 0 in 0.345s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:39:13 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-5b9ec327-57dd-4992-94e6-22f070d84ac1 tempest-VolumesTransfersV355Test-696244887 None] <== create_volume: return (934ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'} {{(pid=88899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 08:39:13 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-5b9ec327-57dd-4992-94e6-22f070d84ac1 tempest-VolumesTransfersV355Test-696244887 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.938s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:39:13 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-2976add5-6295-4b1f-b67a-8cd79ffeadc2 tempest-VolumesCloneTest-1143049529 None] Lock "cinder-c6f08e43-eea9-4a15-8777-fdeadac83a3c-delete_volume" acquired by "delete_volume" :: waited 0.058s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:39:13 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-5b9ec327-57dd-4992-94e6-22f070d84ac1 tempest-VolumesTransfersV355Test-696244887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aad7fabf-cf79-4824-ba18-5a2f172aede0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d5ec7510-c237-4bb4-bad4-9c4746ba8f7d', 'volume_size': 1}' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:39:13 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-5b9ec327-57dd-4992-94e6-22f070d84ac1 tempest-VolumesTransfersV355Test-696244887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d363c48-163d-46b5-ba7d-37cf0f813c31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:39:13 devstack cinder-volume[88899]: INFO cinder.volume.flows.manager.create_volume [None req-5b9ec327-57dd-4992-94e6-22f070d84ac1 tempest-VolumesTransfersV355Test-696244887 None] Volume volume-d5ec7510-c237-4bb4-bad4-9c4746ba8f7d (d5ec7510-c237-4bb4-bad4-9c4746ba8f7d): created successfully Aug 03 08:39:13 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-5b9ec327-57dd-4992-94e6-22f070d84ac1 tempest-VolumesTransfersV355Test-696244887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d363c48-163d-46b5-ba7d-37cf0f813c31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:39:13 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-5b9ec327-57dd-4992-94e6-22f070d84ac1 tempest-VolumesTransfersV355Test-696244887 None] Flow 'volume_create_manager' (6158ce0e-b38b-4981-aff9-aaadadee18ca) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:39:13 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-2976add5-6295-4b1f-b67a-8cd79ffeadc2 tempest-VolumesCloneTest-1143049529 None] Acquiring lock "cinder-quobyte-c6f08e43-eea9-4a15-8777-fdeadac83a3c" by "delete_volume" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:39:13 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-5b9ec327-57dd-4992-94e6-22f070d84ac1 tempest-VolumesTransfersV355Test-696244887 None] Created volume successfully. Aug 03 08:39:13 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-2976add5-6295-4b1f-b67a-8cd79ffeadc2 tempest-VolumesCloneTest-1143049529 None] Lock "cinder-quobyte-c6f08e43-eea9-4a15-8777-fdeadac83a3c" acquired by "delete_volume" :: waited 0.026s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:39:13 devstack sudo[101298]: pam_unix(sudo:session): session closed for user root Aug 03 08:39:13 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-1f3eb1c0-f870-47a9-93e5-7b497fafde67 tempest-VolumesCloneTest-1143049529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a" returned: 0 in 0.405s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:39:13 devstack cinder-volume[88899]: DEBUG cinder.manager [None req-1f3eb1c0-f870-47a9-93e5-7b497fafde67 tempest-VolumesCloneTest-1143049529 None] Notifying Schedulers of capabilities ... {{(pid=88899) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 08:39:13 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5037ef6-f0fe-4ac2-bca1-b21ec2cb2743]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:39:13 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-2976add5-6295-4b1f-b67a-8cd79ffeadc2 tempest-VolumesCloneTest-1143049529 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c6f08e43-eea9-4a15-8777-fdeadac83a3c {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:39:13 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-1f3eb1c0-f870-47a9-93e5-7b497fafde67 tempest-VolumesCloneTest-1143049529 None] Deleted volume successfully. Aug 03 08:39:13 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-1f3eb1c0-f870-47a9-93e5-7b497fafde67 tempest-VolumesCloneTest-1143049529 None] Lock "cinder-975e3310-3a64-408c-af7b-e5f74ac94bbf-delete_volume" released by "delete_volume" :: held 1.572s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:39:13 devstack sudo[101302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c6f08e43-eea9-4a15-8777-fdeadac83a3c Aug 03 08:39:13 devstack sudo[101302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:39:14 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-aef82e5e-0908-47d0-a09b-ae2b8d7865b0 tempest-GroupsTest-63405649 None] Update group completed successfully. Aug 03 08:39:14 devstack sudo[101302]: pam_unix(sudo:session): session closed for user root Aug 03 08:39:14 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-2976add5-6295-4b1f-b67a-8cd79ffeadc2 tempest-VolumesCloneTest-1143049529 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c6f08e43-eea9-4a15-8777-fdeadac83a3c" returned: 0 in 0.397s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:39:14 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-2976add5-6295-4b1f-b67a-8cd79ffeadc2 tempest-VolumesCloneTest-1143049529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c6f08e43-eea9-4a15-8777-fdeadac83a3c {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:39:14 devstack sudo[101307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c6f08e43-eea9-4a15-8777-fdeadac83a3c Aug 03 08:39:14 devstack sudo[101307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:39:14 devstack sudo[101307]: pam_unix(sudo:session): session closed for user root Aug 03 08:39:14 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-2976add5-6295-4b1f-b67a-8cd79ffeadc2 tempest-VolumesCloneTest-1143049529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c6f08e43-eea9-4a15-8777-fdeadac83a3c" returned: 0 in 0.282s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:39:14 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-2976add5-6295-4b1f-b67a-8cd79ffeadc2 tempest-VolumesCloneTest-1143049529 None] Lock "cinder-quobyte-c6f08e43-eea9-4a15-8777-fdeadac83a3c" released by "delete_volume" :: held 0.761s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:39:14 devstack cinder-volume[88899]: DEBUG cinder.quota [None req-2976add5-6295-4b1f-b67a-8cd79ffeadc2 tempest-VolumesCloneTest-1143049529 None] Created reservations ['3aa54b52-15f5-491d-894d-502c340aa6b1', 'eba8d711-057b-4483-9aa8-b54d7165f5dc', 'd3dbc2dd-9c59-40d0-a0eb-917df8913ff5', 'd3aa2eed-3440-404b-adb1-ead7ce815835'] {{(pid=88899) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 08:39:14 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-2976add5-6295-4b1f-b67a-8cd79ffeadc2 tempest-VolumesCloneTest-1143049529 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:39:14 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-2976add5-6295-4b1f-b67a-8cd79ffeadc2 tempest-VolumesCloneTest-1143049529 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:39:14 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-2976add5-6295-4b1f-b67a-8cd79ffeadc2 tempest-VolumesCloneTest-1143049529 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:39:14 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-2976add5-6295-4b1f-b67a-8cd79ffeadc2 tempest-VolumesCloneTest-1143049529 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:39:14 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-2976add5-6295-4b1f-b67a-8cd79ffeadc2 tempest-VolumesCloneTest-1143049529 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:39:14 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-2976add5-6295-4b1f-b67a-8cd79ffeadc2 tempest-VolumesCloneTest-1143049529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:39:14 devstack sudo[101310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a Aug 03 08:39:14 devstack sudo[101310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:39:14 devstack sudo[101310]: pam_unix(sudo:session): session closed for user root Aug 03 08:39:14 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-2976add5-6295-4b1f-b67a-8cd79ffeadc2 tempest-VolumesCloneTest-1143049529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a" returned: 0 in 0.376s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:39:14 devstack cinder-volume[88899]: DEBUG cinder.manager [None req-2976add5-6295-4b1f-b67a-8cd79ffeadc2 tempest-VolumesCloneTest-1143049529 None] Notifying Schedulers of capabilities ... {{(pid=88899) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 08:39:14 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-2976add5-6295-4b1f-b67a-8cd79ffeadc2 tempest-VolumesCloneTest-1143049529 None] Deleted volume successfully. Aug 03 08:39:15 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-2976add5-6295-4b1f-b67a-8cd79ffeadc2 tempest-VolumesCloneTest-1143049529 None] Lock "cinder-c6f08e43-eea9-4a15-8777-fdeadac83a3c-delete_volume" released by "delete_volume" :: held 1.436s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:39:15 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-1013b3ca-0415-4350-85e8-7077b24e33a5 tempest-VolumesTransfersV355Test-803326102 None] Transfer volume completed successfully. Aug 03 08:39:15 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-d7d7de19-09a4-4f50-9945-ffe939aeb1dd tempest-GroupsTest-63405649 None] Update group completed successfully. Aug 03 08:39:16 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-5bdcfa72-a91d-41fd-94ed-baf3ba9ea4e6 tempest-VolumesTransfersV355Test-896932722 None] Acquiring lock "cinder-d5ec7510-c237-4bb4-bad4-9c4746ba8f7d-delete_volume" by "delete_volume" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:39:16 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-5bdcfa72-a91d-41fd-94ed-baf3ba9ea4e6 tempest-VolumesTransfersV355Test-896932722 None] Lock "cinder-d5ec7510-c237-4bb4-bad4-9c4746ba8f7d-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:39:16 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-5bdcfa72-a91d-41fd-94ed-baf3ba9ea4e6 tempest-VolumesTransfersV355Test-896932722 None] Acquiring lock "cinder-quobyte-d5ec7510-c237-4bb4-bad4-9c4746ba8f7d" by "delete_volume" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:39:16 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-5bdcfa72-a91d-41fd-94ed-baf3ba9ea4e6 tempest-VolumesTransfersV355Test-896932722 None] Lock "cinder-quobyte-d5ec7510-c237-4bb4-bad4-9c4746ba8f7d" acquired by "delete_volume" :: waited 0.028s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:39:16 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[46708f56-2670-477c-a52a-8cba1a4942d5]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:39:16 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-5bdcfa72-a91d-41fd-94ed-baf3ba9ea4e6 tempest-VolumesTransfersV355Test-896932722 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-d5ec7510-c237-4bb4-bad4-9c4746ba8f7d {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:39:16 devstack sudo[101314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-d5ec7510-c237-4bb4-bad4-9c4746ba8f7d Aug 03 08:39:16 devstack sudo[101314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:39:16 devstack sudo[101314]: pam_unix(sudo:session): session closed for user root Aug 03 08:39:16 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-5bdcfa72-a91d-41fd-94ed-baf3ba9ea4e6 tempest-VolumesTransfersV355Test-896932722 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-d5ec7510-c237-4bb4-bad4-9c4746ba8f7d" returned: 0 in 0.503s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:39:16 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-5bdcfa72-a91d-41fd-94ed-baf3ba9ea4e6 tempest-VolumesTransfersV355Test-896932722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-d5ec7510-c237-4bb4-bad4-9c4746ba8f7d {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:39:16 devstack sudo[101319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-d5ec7510-c237-4bb4-bad4-9c4746ba8f7d Aug 03 08:39:16 devstack sudo[101319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:39:17 devstack sudo[101319]: pam_unix(sudo:session): session closed for user root Aug 03 08:39:17 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-5bdcfa72-a91d-41fd-94ed-baf3ba9ea4e6 tempest-VolumesTransfersV355Test-896932722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-d5ec7510-c237-4bb4-bad4-9c4746ba8f7d" returned: 0 in 0.384s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:39:17 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-5bdcfa72-a91d-41fd-94ed-baf3ba9ea4e6 tempest-VolumesTransfersV355Test-896932722 None] Lock "cinder-quobyte-d5ec7510-c237-4bb4-bad4-9c4746ba8f7d" released by "delete_volume" :: held 0.949s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:39:17 devstack cinder-volume[88899]: DEBUG cinder.quota [None req-5bdcfa72-a91d-41fd-94ed-baf3ba9ea4e6 tempest-VolumesTransfersV355Test-896932722 None] Created reservations ['b9a7ea1f-e601-4c71-b770-4da1bfb05bc8', '2ac1738c-8001-4584-89b5-ca5f91686ee5', '88d87a0a-e8cd-4e79-8e4b-9980ac17cf93', '16dfde20-d263-43d0-aeec-5224847a8033'] {{(pid=88899) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 08:39:17 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-5bdcfa72-a91d-41fd-94ed-baf3ba9ea4e6 tempest-VolumesTransfersV355Test-896932722 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:39:17 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-5bdcfa72-a91d-41fd-94ed-baf3ba9ea4e6 tempest-VolumesTransfersV355Test-896932722 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:39:17 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-5bdcfa72-a91d-41fd-94ed-baf3ba9ea4e6 tempest-VolumesTransfersV355Test-896932722 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:39:17 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-5bdcfa72-a91d-41fd-94ed-baf3ba9ea4e6 tempest-VolumesTransfersV355Test-896932722 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:39:17 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-5bdcfa72-a91d-41fd-94ed-baf3ba9ea4e6 tempest-VolumesTransfersV355Test-896932722 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:39:17 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-5bdcfa72-a91d-41fd-94ed-baf3ba9ea4e6 tempest-VolumesTransfersV355Test-896932722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:39:17 devstack sudo[101322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a Aug 03 08:39:17 devstack sudo[101322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:39:17 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-4a508137-af1a-494b-a6ee-01947f1c78d9 tempest-GroupsTest-63405649 None] Acquiring lock "cinder-quobyte-eb2657de-305f-4763-a5d1-8b7fb7d744c7" by "delete_volume" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:39:17 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-4a508137-af1a-494b-a6ee-01947f1c78d9 tempest-GroupsTest-63405649 None] Lock "cinder-quobyte-eb2657de-305f-4763-a5d1-8b7fb7d744c7" acquired by "delete_volume" :: waited 0.035s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:39:17 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[7457a538-60e1-43d0-92a7-177c53800909]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:39:17 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-4a508137-af1a-494b-a6ee-01947f1c78d9 tempest-GroupsTest-63405649 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-eb2657de-305f-4763-a5d1-8b7fb7d744c7 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:39:17 devstack sudo[101324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-eb2657de-305f-4763-a5d1-8b7fb7d744c7 Aug 03 08:39:17 devstack sudo[101324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:39:17 devstack sudo[101322]: pam_unix(sudo:session): session closed for user root Aug 03 08:39:17 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-5bdcfa72-a91d-41fd-94ed-baf3ba9ea4e6 tempest-VolumesTransfersV355Test-896932722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a" returned: 0 in 0.509s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:39:17 devstack cinder-volume[88899]: DEBUG cinder.manager [None req-5bdcfa72-a91d-41fd-94ed-baf3ba9ea4e6 tempest-VolumesTransfersV355Test-896932722 None] Notifying Schedulers of capabilities ... {{(pid=88899) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 08:39:17 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-5bdcfa72-a91d-41fd-94ed-baf3ba9ea4e6 tempest-VolumesTransfersV355Test-896932722 None] Deleted volume successfully. Aug 03 08:39:17 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-5bdcfa72-a91d-41fd-94ed-baf3ba9ea4e6 tempest-VolumesTransfersV355Test-896932722 None] Lock "cinder-d5ec7510-c237-4bb4-bad4-9c4746ba8f7d-delete_volume" released by "delete_volume" :: held 1.812s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:39:18 devstack sudo[101324]: pam_unix(sudo:session): session closed for user root Aug 03 08:39:18 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-4a508137-af1a-494b-a6ee-01947f1c78d9 tempest-GroupsTest-63405649 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-eb2657de-305f-4763-a5d1-8b7fb7d744c7" returned: 0 in 0.713s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:39:18 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-4a508137-af1a-494b-a6ee-01947f1c78d9 tempest-GroupsTest-63405649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-eb2657de-305f-4763-a5d1-8b7fb7d744c7 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:39:18 devstack sudo[101331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-eb2657de-305f-4763-a5d1-8b7fb7d744c7 Aug 03 08:39:18 devstack sudo[101331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:39:18 devstack cinder-volume[88899]: DEBUG cinder.volume.flows.manager.create_volume [None req-c2520daa-9ac8-4755-999c-cdcfc624557a tempest-VolumesTransfersV355Test-696244887 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88899) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 08:39:18 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-c2520daa-9ac8-4755-999c-cdcfc624557a tempest-VolumesTransfersV355Test-696244887 None] Flow 'volume_create_manager' (b5fbb4a7-bbfe-459a-860d-75ded034f44f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:39:18 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-c2520daa-9ac8-4755-999c-cdcfc624557a tempest-VolumesTransfersV355Test-696244887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9d2edaa-3490-4ec8-8455-07197758ae39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:39:18 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-c2520daa-9ac8-4755-999c-cdcfc624557a tempest-VolumesTransfersV355Test-696244887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9d2edaa-3490-4ec8-8455-07197758ae39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:39:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-206012914',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3c738163-c0b6-4cbc-bf65-72aee58ae5c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e7777f506dab4529a6411b54e64bcd76',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:39:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:39:18Z,use_quota=True,user_id='0d5ed631b8084461a51f8ca76ebb65a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8bde7129-1dc4-42ab-b852-ab32c61b4921),volume_type_id=8bde7129-1dc4-42ab-b852-ab32c61b4921)' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:39:18 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-c2520daa-9ac8-4755-999c-cdcfc624557a tempest-VolumesTransfersV355Test-696244887 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a771c9a-98d8-4151-ac72-0495f7a700ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:39:18 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-c2520daa-9ac8-4755-999c-cdcfc624557a tempest-VolumesTransfersV355Test-696244887 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a771c9a-98d8-4151-ac72-0495f7a700ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:39:18 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-c2520daa-9ac8-4755-999c-cdcfc624557a tempest-VolumesTransfersV355Test-696244887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ad292ff-1877-4bb4-a0a2-094bcbe6337d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:39:18 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-c2520daa-9ac8-4755-999c-cdcfc624557a tempest-VolumesTransfersV355Test-696244887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ad292ff-1877-4bb4-a0a2-094bcbe6337d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3c738163-c0b6-4cbc-bf65-72aee58ae5c8', 'volume_name': 'volume-3c738163-c0b6-4cbc-bf65-72aee58ae5c8', 'volume_size': 1}' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:39:18 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-c2520daa-9ac8-4755-999c-cdcfc624557a tempest-VolumesTransfersV355Test-696244887 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6eab2a0b-d10e-4f9e-be31-6e003a075e06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:39:18 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-c2520daa-9ac8-4755-999c-cdcfc624557a tempest-VolumesTransfersV355Test-696244887 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6eab2a0b-d10e-4f9e-be31-6e003a075e06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:39:18 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-c2520daa-9ac8-4755-999c-cdcfc624557a tempest-VolumesTransfersV355Test-696244887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a8855c10-f67d-4e99-b748-14c827de3e9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:39:18 devstack cinder-volume[88899]: INFO cinder.volume.flows.manager.create_volume [None req-c2520daa-9ac8-4755-999c-cdcfc624557a tempest-VolumesTransfersV355Test-696244887 None] Volume 3c738163-c0b6-4cbc-bf65-72aee58ae5c8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3c738163-c0b6-4cbc-bf65-72aee58ae5c8', 'volume_size': 1} Aug 03 08:39:18 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-c2520daa-9ac8-4755-999c-cdcfc624557a tempest-VolumesTransfersV355Test-696244887 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:39:18 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-c2520daa-9ac8-4755-999c-cdcfc624557a tempest-VolumesTransfersV355Test-696244887 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:39:18 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-c2520daa-9ac8-4755-999c-cdcfc624557a tempest-VolumesTransfersV355Test-696244887 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:39:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-206012914',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3c738163-c0b6-4cbc-bf65-72aee58ae5c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e7777f506dab4529a6411b54e64bcd76',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:39:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:39:18Z,use_quota=True,user_id='0d5ed631b8084461a51f8ca76ebb65a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8bde7129-1dc4-42ab-b852-ab32c61b4921),volume_type_id=8bde7129-1dc4-42ab-b852-ab32c61b4921)}" {{(pid=88899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 08:39:18 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-c2520daa-9ac8-4755-999c-cdcfc624557a tempest-VolumesTransfersV355Test-696244887 None] Creating volume 3c738163-c0b6-4cbc-bf65-72aee58ae5c8 {{(pid=88899) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 08:39:18 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-c2520daa-9ac8-4755-999c-cdcfc624557a tempest-VolumesTransfersV355Test-696244887 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:39:18 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-c2520daa-9ac8-4755-999c-cdcfc624557a tempest-VolumesTransfersV355Test-696244887 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:39:18 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-c2520daa-9ac8-4755-999c-cdcfc624557a tempest-VolumesTransfersV355Test-696244887 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:39:18 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-c2520daa-9ac8-4755-999c-cdcfc624557a tempest-VolumesTransfersV355Test-696244887 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:39:18 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-c2520daa-9ac8-4755-999c-cdcfc624557a tempest-VolumesTransfersV355Test-696244887 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:39:18 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-c2520daa-9ac8-4755-999c-cdcfc624557a tempest-VolumesTransfersV355Test-696244887 None] Selected osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385 as target Quobyte volume. {{(pid=88899) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 08:39:18 devstack cinder-volume[88899]: INFO cinder.volume.drivers.remotefs [None req-c2520daa-9ac8-4755-999c-cdcfc624557a tempest-VolumesTransfersV355Test-696244887 None] casted to osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385 Aug 03 08:39:18 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-c2520daa-9ac8-4755-999c-cdcfc624557a tempest-VolumesTransfersV355Test-696244887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-3c738163-c0b6-4cbc-bf65-72aee58ae5c8 1073741824 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:39:18 devstack sudo[101333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-3c738163-c0b6-4cbc-bf65-72aee58ae5c8 1073741824 Aug 03 08:39:18 devstack sudo[101333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:39:18 devstack sudo[101331]: pam_unix(sudo:session): session closed for user root Aug 03 08:39:18 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-4a508137-af1a-494b-a6ee-01947f1c78d9 tempest-GroupsTest-63405649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-eb2657de-305f-4763-a5d1-8b7fb7d744c7" returned: 0 in 0.306s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:39:18 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-4a508137-af1a-494b-a6ee-01947f1c78d9 tempest-GroupsTest-63405649 None] Lock "cinder-quobyte-eb2657de-305f-4763-a5d1-8b7fb7d744c7" released by "delete_volume" :: held 1.109s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:39:18 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-4a508137-af1a-494b-a6ee-01947f1c78d9 tempest-GroupsTest-63405649 None] Acquiring lock "cinder-quobyte-f3d1f434-93bb-41f0-85a5-9bdb8e0a0c9c" by "delete_volume" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:39:18 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-4a508137-af1a-494b-a6ee-01947f1c78d9 tempest-GroupsTest-63405649 None] Lock "cinder-quobyte-f3d1f434-93bb-41f0-85a5-9bdb8e0a0c9c" acquired by "delete_volume" :: waited 0.016s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:39:18 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8735e77-7908-4c60-b4ae-10c09f54be14]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:39:18 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-4a508137-af1a-494b-a6ee-01947f1c78d9 tempest-GroupsTest-63405649 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-f3d1f434-93bb-41f0-85a5-9bdb8e0a0c9c {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:39:18 devstack sudo[101336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-f3d1f434-93bb-41f0-85a5-9bdb8e0a0c9c Aug 03 08:39:18 devstack sudo[101336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:39:19 devstack sudo[101333]: pam_unix(sudo:session): session closed for user root Aug 03 08:39:19 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-c2520daa-9ac8-4755-999c-cdcfc624557a tempest-VolumesTransfersV355Test-696244887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-3c738163-c0b6-4cbc-bf65-72aee58ae5c8 1073741824" returned: 0 in 0.558s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:39:19 devstack sudo[101336]: pam_unix(sudo:session): session closed for user root Aug 03 08:39:19 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-4a508137-af1a-494b-a6ee-01947f1c78d9 tempest-GroupsTest-63405649 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-f3d1f434-93bb-41f0-85a5-9bdb8e0a0c9c" returned: 0 in 0.439s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:39:19 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-4a508137-af1a-494b-a6ee-01947f1c78d9 tempest-GroupsTest-63405649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-f3d1f434-93bb-41f0-85a5-9bdb8e0a0c9c {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:39:19 devstack sudo[101345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-f3d1f434-93bb-41f0-85a5-9bdb8e0a0c9c Aug 03 08:39:19 devstack sudo[101345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:39:19 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-c2520daa-9ac8-4755-999c-cdcfc624557a tempest-VolumesTransfersV355Test-696244887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-3c738163-c0b6-4cbc-bf65-72aee58ae5c8 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:39:19 devstack sudo[101347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-3c738163-c0b6-4cbc-bf65-72aee58ae5c8 Aug 03 08:39:19 devstack sudo[101347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:39:19 devstack sudo[101345]: pam_unix(sudo:session): session closed for user root Aug 03 08:39:19 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-4a508137-af1a-494b-a6ee-01947f1c78d9 tempest-GroupsTest-63405649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-f3d1f434-93bb-41f0-85a5-9bdb8e0a0c9c" returned: 0 in 0.335s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:39:19 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-4a508137-af1a-494b-a6ee-01947f1c78d9 tempest-GroupsTest-63405649 None] Lock "cinder-quobyte-f3d1f434-93bb-41f0-85a5-9bdb8e0a0c9c" released by "delete_volume" :: held 0.823s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:39:19 devstack sudo[101347]: pam_unix(sudo:session): session closed for user root Aug 03 08:39:19 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-c2520daa-9ac8-4755-999c-cdcfc624557a tempest-VolumesTransfersV355Test-696244887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-3c738163-c0b6-4cbc-bf65-72aee58ae5c8" returned: 0 in 0.396s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:39:19 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-c2520daa-9ac8-4755-999c-cdcfc624557a tempest-VolumesTransfersV355Test-696244887 None] <== create_volume: return (1059ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'} {{(pid=88899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 08:39:19 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-c2520daa-9ac8-4755-999c-cdcfc624557a tempest-VolumesTransfersV355Test-696244887 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.063s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:39:19 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-c2520daa-9ac8-4755-999c-cdcfc624557a tempest-VolumesTransfersV355Test-696244887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a8855c10-f67d-4e99-b748-14c827de3e9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3c738163-c0b6-4cbc-bf65-72aee58ae5c8', 'volume_size': 1}' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:39:19 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-c2520daa-9ac8-4755-999c-cdcfc624557a tempest-VolumesTransfersV355Test-696244887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (126b69dd-6f8f-457d-b072-3756aab2f232) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:39:19 devstack cinder-volume[88899]: DEBUG cinder.quota [None req-4a508137-af1a-494b-a6ee-01947f1c78d9 tempest-GroupsTest-63405649 None] Created reservations ['9dbe1482-154f-45e4-bfdb-aeebac2c3926'] {{(pid=88899) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 08:39:19 devstack cinder-volume[88899]: INFO cinder.volume.flows.manager.create_volume [None req-c2520daa-9ac8-4755-999c-cdcfc624557a tempest-VolumesTransfersV355Test-696244887 None] Volume volume-3c738163-c0b6-4cbc-bf65-72aee58ae5c8 (3c738163-c0b6-4cbc-bf65-72aee58ae5c8): created successfully Aug 03 08:39:19 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-c2520daa-9ac8-4755-999c-cdcfc624557a tempest-VolumesTransfersV355Test-696244887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (126b69dd-6f8f-457d-b072-3756aab2f232) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:39:19 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-c2520daa-9ac8-4755-999c-cdcfc624557a tempest-VolumesTransfersV355Test-696244887 None] Flow 'volume_create_manager' (b5fbb4a7-bbfe-459a-860d-75ded034f44f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:39:19 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-c2520daa-9ac8-4755-999c-cdcfc624557a tempest-VolumesTransfersV355Test-696244887 None] Created volume successfully. Aug 03 08:39:19 devstack cinder-volume[88899]: WARNING cinder.quota [None req-4a508137-af1a-494b-a6ee-01947f1c78d9 tempest-GroupsTest-63405649 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-84350052 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-84350052, it is now deprecated. Please use the default quota class for default quota. Aug 03 08:39:19 devstack cinder-volume[88899]: WARNING cinder.quota [None req-4a508137-af1a-494b-a6ee-01947f1c78d9 tempest-GroupsTest-63405649 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-84350052 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-84350052, it is now deprecated. Please use the default quota class for default quota. Aug 03 08:39:19 devstack cinder-volume[88899]: DEBUG cinder.volume.flows.manager.create_volume [None req-11a1d977-a9ce-4a47-8a88-f233d4841515 tempest-VolumesExtendTest-896546243 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88899) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 08:39:19 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-11a1d977-a9ce-4a47-8a88-f233d4841515 tempest-VolumesExtendTest-896546243 None] Flow 'volume_create_manager' (bb0dcb3f-cc0e-414c-9d38-33a0e287b2a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:39:19 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-11a1d977-a9ce-4a47-8a88-f233d4841515 tempest-VolumesExtendTest-896546243 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (364ef258-5048-47bb-b3ec-213409891ed0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:39:19 devstack cinder-volume[88899]: DEBUG cinder.quota [None req-4a508137-af1a-494b-a6ee-01947f1c78d9 tempest-GroupsTest-63405649 None] Created reservations ['f20a622a-146f-4c42-b523-c6fcb6f60f72', '57f3c1b3-71d2-467f-9e2a-4bbf68e39816', 'e2331da1-afc1-4dbd-8673-ebaddc0fc315', '31e06fca-6108-4590-bb8b-e7a0eb8ddfb4'] {{(pid=88899) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 08:39:19 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-11a1d977-a9ce-4a47-8a88-f233d4841515 tempest-VolumesExtendTest-896546243 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (364ef258-5048-47bb-b3ec-213409891ed0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:39:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1754539719',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f8fce77-d4ac-4b72-9d80-6bc3aabaa75e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='31966c7036e344cf8eabf444e342118a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:39:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:39:20Z,use_quota=True,user_id='6c5bc611eed84a0faea6d55f4bca6053',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8bde7129-1dc4-42ab-b852-ab32c61b4921),volume_type_id=8bde7129-1dc4-42ab-b852-ab32c61b4921)' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:39:19 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-11a1d977-a9ce-4a47-8a88-f233d4841515 tempest-VolumesExtendTest-896546243 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ae8ca6c-b0b8-420e-9e12-1dfb06d5f6fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:39:19 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-11a1d977-a9ce-4a47-8a88-f233d4841515 tempest-VolumesExtendTest-896546243 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ae8ca6c-b0b8-420e-9e12-1dfb06d5f6fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:39:19 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-11a1d977-a9ce-4a47-8a88-f233d4841515 tempest-VolumesExtendTest-896546243 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b3f1dc9d-3fb5-45e9-8063-9570cad80942) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:39:19 devstack cinder-volume[88899]: DEBUG cinder.image.glance [None req-11a1d977-a9ce-4a47-8a88-f233d4841515 tempest-VolumesExtendTest-896546243 None] Creating Keystone auth plugin from conf {{(pid=88899) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Aug 03 08:39:19 devstack cinder-volume[88899]: DEBUG cinder.quota [None req-4a508137-af1a-494b-a6ee-01947f1c78d9 tempest-GroupsTest-63405649 None] Created reservations ['ab01b629-7fd5-491f-9d01-d835edb2f64a', '6d9dd4ec-7314-49c2-a4d4-2733ec55b6d1', '2251bb5d-a009-4cf8-a93c-95acb16eb5dd', 'fd4da58f-28d0-4b74-a733-0e26532aee53'] {{(pid=88899) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 08:39:20 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-4a508137-af1a-494b-a6ee-01947f1c78d9 tempest-GroupsTest-63405649 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:39:20 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-4a508137-af1a-494b-a6ee-01947f1c78d9 tempest-GroupsTest-63405649 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:39:20 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-4a508137-af1a-494b-a6ee-01947f1c78d9 tempest-GroupsTest-63405649 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:39:20 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-4a508137-af1a-494b-a6ee-01947f1c78d9 tempest-GroupsTest-63405649 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:39:20 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-4a508137-af1a-494b-a6ee-01947f1c78d9 tempest-GroupsTest-63405649 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:39:20 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-4a508137-af1a-494b-a6ee-01947f1c78d9 tempest-GroupsTest-63405649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:39:20 devstack sudo[101368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a Aug 03 08:39:20 devstack sudo[101368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:39:20 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-11a1d977-a9ce-4a47-8a88-f233d4841515 tempest-VolumesExtendTest-896546243 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b3f1dc9d-3fb5-45e9-8063-9570cad80942) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '7f8fce77-d4ac-4b72-9d80-6bc3aabaa75e', 'volume_name': 'volume-7f8fce77-d4ac-4b72-9d80-6bc3aabaa75e', 'volume_size': 1, 'image_id': '37045a76-b9b1-4156-b15f-85c62a8616c3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/37045a76-b9b1-4156-b15f-85c62a8616c3', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'adee82974e9f41769efcb3f4a0eef199', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '37045a76-b9b1-4156-b15f-85c62a8616c3', 'created_at': datetime.datetime(2026, 8, 3, 6, 23, 4, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 3, 6, 23, 6, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/37045a76-b9b1-4156-b15f-85c62a8616c3/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:39:20 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-11a1d977-a9ce-4a47-8a88-f233d4841515 tempest-VolumesExtendTest-896546243 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ff6113f-2666-47bd-9a42-d9ef10488e29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:39:20 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-11a1d977-a9ce-4a47-8a88-f233d4841515 tempest-VolumesExtendTest-896546243 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ff6113f-2666-47bd-9a42-d9ef10488e29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:39:20 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-11a1d977-a9ce-4a47-8a88-f233d4841515 tempest-VolumesExtendTest-896546243 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e1e642bd-4cdd-4b11-a6d7-4de126cb1f96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:39:20 devstack cinder-volume[88899]: INFO cinder.volume.flows.manager.create_volume [None req-11a1d977-a9ce-4a47-8a88-f233d4841515 tempest-VolumesExtendTest-896546243 None] Volume 7f8fce77-d4ac-4b72-9d80-6bc3aabaa75e: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-7f8fce77-d4ac-4b72-9d80-6bc3aabaa75e', 'volume_size': 1, 'image_id': '37045a76-b9b1-4156-b15f-85c62a8616c3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/37045a76-b9b1-4156-b15f-85c62a8616c3', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'adee82974e9f41769efcb3f4a0eef199', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '37045a76-b9b1-4156-b15f-85c62a8616c3', 'created_at': datetime.datetime(2026, 8, 3, 6, 23, 4, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 3, 6, 23, 6, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/37045a76-b9b1-4156-b15f-85c62a8616c3/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Aug 03 08:39:20 devstack cinder-volume[88899]: DEBUG cinder.volume.flows.manager.create_volume [None req-11a1d977-a9ce-4a47-8a88-f233d4841515 tempest-VolumesExtendTest-896546243 None] Trying to clone 7f8fce77-d4ac-4b72-9d80-6bc3aabaa75e from image 37045a76-b9b1-4156-b15f-85c62a8616c3 at location (None, [{'url': 'file:///opt/stack/data/glance/images/37045a76-b9b1-4156-b15f-85c62a8616c3', 'metadata': {}}]). {{(pid=88899) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Aug 03 08:39:20 devstack sudo[101368]: pam_unix(sudo:session): session closed for user root Aug 03 08:39:20 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-4a508137-af1a-494b-a6ee-01947f1c78d9 tempest-GroupsTest-63405649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a" returned: 0 in 0.401s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:39:20 devstack cinder-volume[88899]: DEBUG cinder.manager [None req-4a508137-af1a-494b-a6ee-01947f1c78d9 tempest-GroupsTest-63405649 None] Notifying Schedulers of capabilities ... {{(pid=88899) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 08:39:20 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-4a508137-af1a-494b-a6ee-01947f1c78d9 tempest-GroupsTest-63405649 None] Delete group completed successfully. Aug 03 08:39:20 devstack cinder-volume[88899]: DEBUG cinder.image.image_utils [None req-11a1d977-a9ce-4a47-8a88-f233d4841515 tempest-VolumesExtendTest-896546243 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_37045a76-b9b1-4156-b15f-85c62a8616c3_pg76f0v6devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=88899) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Aug 03 08:39:20 devstack cinder-volume[88899]: INFO cinder.image.image_utils [None req-11a1d977-a9ce-4a47-8a88-f233d4841515 tempest-VolumesExtendTest-896546243 None] Image download 20.69 MB at 20.69 MB/s Aug 03 08:39:20 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc132d17-c3c7-4c55-bd97-23ba5c5856ea]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:39:20 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-11a1d977-a9ce-4a47-8a88-f233d4841515 tempest-VolumesExtendTest-896546243 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_37045a76-b9b1-4156-b15f-85c62a8616c3_pg76f0v6devstack@QuobyteHD {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:39:20 devstack sudo[101372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_37045a76-b9b1-4156-b15f-85c62a8616c3_pg76f0v6devstack@QuobyteHD Aug 03 08:39:20 devstack sudo[101372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:39:20 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-45931ca3-d843-4f6e-bd74-c89efb53cf23 tempest-VolumesTransfersV355Test-896932722 None] Acquiring lock "cinder-3c738163-c0b6-4cbc-bf65-72aee58ae5c8-delete_volume" by "delete_volume" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:39:20 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-45931ca3-d843-4f6e-bd74-c89efb53cf23 tempest-VolumesTransfersV355Test-896932722 None] Lock "cinder-3c738163-c0b6-4cbc-bf65-72aee58ae5c8-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:39:20 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-45931ca3-d843-4f6e-bd74-c89efb53cf23 tempest-VolumesTransfersV355Test-896932722 None] Acquiring lock "cinder-quobyte-3c738163-c0b6-4cbc-bf65-72aee58ae5c8" by "delete_volume" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:39:20 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-45931ca3-d843-4f6e-bd74-c89efb53cf23 tempest-VolumesTransfersV355Test-896932722 None] Lock "cinder-quobyte-3c738163-c0b6-4cbc-bf65-72aee58ae5c8" acquired by "delete_volume" :: waited 0.016s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:39:20 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8425a61-998d-4d52-97b9-908b964aafe0]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:39:20 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-45931ca3-d843-4f6e-bd74-c89efb53cf23 tempest-VolumesTransfersV355Test-896932722 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-3c738163-c0b6-4cbc-bf65-72aee58ae5c8 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:39:21 devstack sudo[101372]: pam_unix(sudo:session): session closed for user root Aug 03 08:39:21 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-11a1d977-a9ce-4a47-8a88-f233d4841515 tempest-VolumesExtendTest-896546243 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_37045a76-b9b1-4156-b15f-85c62a8616c3_pg76f0v6devstack@QuobyteHD" returned: 0 in 0.403s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:39:21 devstack cinder-volume[88899]: DEBUG cinder.image.image_utils [None req-11a1d977-a9ce-4a47-8a88-f233d4841515 tempest-VolumesExtendTest-896546243 None] Temporary image 37045a76-b9b1-4156-b15f-85c62a8616c3 is fetched for user 6c5bc611eed84a0faea6d55f4bca6053. {{(pid=88899) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Aug 03 08:39:21 devstack sudo[101374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-3c738163-c0b6-4cbc-bf65-72aee58ae5c8 Aug 03 08:39:21 devstack sudo[101374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:39:21 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d98f5ef-0591-43f5-bec3-ddb13a277249]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:39:21 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-11a1d977-a9ce-4a47-8a88-f233d4841515 tempest-VolumesExtendTest-896546243 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_37045a76-b9b1-4156-b15f-85c62a8616c3_pg76f0v6devstack@QuobyteHD {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:39:21 devstack sudo[101379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_37045a76-b9b1-4156-b15f-85c62a8616c3_pg76f0v6devstack@QuobyteHD Aug 03 08:39:21 devstack sudo[101379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:39:21 devstack sudo[101374]: pam_unix(sudo:session): session closed for user root Aug 03 08:39:21 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-45931ca3-d843-4f6e-bd74-c89efb53cf23 tempest-VolumesTransfersV355Test-896932722 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-3c738163-c0b6-4cbc-bf65-72aee58ae5c8" returned: 0 in 0.429s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:39:21 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-45931ca3-d843-4f6e-bd74-c89efb53cf23 tempest-VolumesTransfersV355Test-896932722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-3c738163-c0b6-4cbc-bf65-72aee58ae5c8 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:39:21 devstack sudo[101384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-3c738163-c0b6-4cbc-bf65-72aee58ae5c8 Aug 03 08:39:21 devstack sudo[101384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:39:21 devstack sudo[101379]: pam_unix(sudo:session): session closed for user root Aug 03 08:39:21 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-11a1d977-a9ce-4a47-8a88-f233d4841515 tempest-VolumesExtendTest-896546243 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_37045a76-b9b1-4156-b15f-85c62a8616c3_pg76f0v6devstack@QuobyteHD" returned: 0 in 0.356s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:39:21 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-11a1d977-a9ce-4a47-8a88-f233d4841515 tempest-VolumesExtendTest-896546243 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:39:21 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-11a1d977-a9ce-4a47-8a88-f233d4841515 tempest-VolumesExtendTest-896546243 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:39:21 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-11a1d977-a9ce-4a47-8a88-f233d4841515 tempest-VolumesExtendTest-896546243 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:39:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1754539719',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f8fce77-d4ac-4b72-9d80-6bc3aabaa75e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='31966c7036e344cf8eabf444e342118a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:39:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:39:20Z,use_quota=True,user_id='6c5bc611eed84a0faea6d55f4bca6053',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8bde7129-1dc4-42ab-b852-ab32c61b4921),volume_type_id=8bde7129-1dc4-42ab-b852-ab32c61b4921)}" {{(pid=88899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 08:39:21 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-11a1d977-a9ce-4a47-8a88-f233d4841515 tempest-VolumesExtendTest-896546243 None] Creating volume 7f8fce77-d4ac-4b72-9d80-6bc3aabaa75e {{(pid=88899) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 08:39:21 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-11a1d977-a9ce-4a47-8a88-f233d4841515 tempest-VolumesExtendTest-896546243 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:39:21 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-11a1d977-a9ce-4a47-8a88-f233d4841515 tempest-VolumesExtendTest-896546243 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:39:21 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-11a1d977-a9ce-4a47-8a88-f233d4841515 tempest-VolumesExtendTest-896546243 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:39:21 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-11a1d977-a9ce-4a47-8a88-f233d4841515 tempest-VolumesExtendTest-896546243 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:39:21 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-11a1d977-a9ce-4a47-8a88-f233d4841515 tempest-VolumesExtendTest-896546243 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:39:21 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-11a1d977-a9ce-4a47-8a88-f233d4841515 tempest-VolumesExtendTest-896546243 None] Selected osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385 as target Quobyte volume. {{(pid=88899) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 08:39:21 devstack cinder-volume[88899]: INFO cinder.volume.drivers.remotefs [None req-11a1d977-a9ce-4a47-8a88-f233d4841515 tempest-VolumesExtendTest-896546243 None] casted to osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385 Aug 03 08:39:21 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-11a1d977-a9ce-4a47-8a88-f233d4841515 tempest-VolumesExtendTest-896546243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-7f8fce77-d4ac-4b72-9d80-6bc3aabaa75e 1073741824 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:39:21 devstack sudo[101390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-7f8fce77-d4ac-4b72-9d80-6bc3aabaa75e 1073741824 Aug 03 08:39:21 devstack sudo[101390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:39:21 devstack sudo[101384]: pam_unix(sudo:session): session closed for user root Aug 03 08:39:21 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-45931ca3-d843-4f6e-bd74-c89efb53cf23 tempest-VolumesTransfersV355Test-896932722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-3c738163-c0b6-4cbc-bf65-72aee58ae5c8" returned: 0 in 0.317s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:39:21 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-45931ca3-d843-4f6e-bd74-c89efb53cf23 tempest-VolumesTransfersV355Test-896932722 None] Lock "cinder-quobyte-3c738163-c0b6-4cbc-bf65-72aee58ae5c8" released by "delete_volume" :: held 0.803s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:39:21 devstack cinder-volume[88899]: DEBUG cinder.quota [None req-45931ca3-d843-4f6e-bd74-c89efb53cf23 tempest-VolumesTransfersV355Test-896932722 None] Created reservations ['9827d1ab-41d8-4671-ac55-59fb50219f34', '2ff4af34-f648-48f7-9aea-e0d244f03ffd', '6dcaf882-0293-4645-bdbc-80ffe3eb8328', 'b2865489-98be-474e-920e-9b80734827bc'] {{(pid=88899) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 08:39:22 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-45931ca3-d843-4f6e-bd74-c89efb53cf23 tempest-VolumesTransfersV355Test-896932722 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:39:22 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-45931ca3-d843-4f6e-bd74-c89efb53cf23 tempest-VolumesTransfersV355Test-896932722 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:39:22 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-45931ca3-d843-4f6e-bd74-c89efb53cf23 tempest-VolumesTransfersV355Test-896932722 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:39:22 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-45931ca3-d843-4f6e-bd74-c89efb53cf23 tempest-VolumesTransfersV355Test-896932722 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:39:22 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-45931ca3-d843-4f6e-bd74-c89efb53cf23 tempest-VolumesTransfersV355Test-896932722 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:39:22 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-45931ca3-d843-4f6e-bd74-c89efb53cf23 tempest-VolumesTransfersV355Test-896932722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:39:22 devstack sudo[101397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a Aug 03 08:39:22 devstack sudo[101397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:39:22 devstack sudo[101390]: pam_unix(sudo:session): session closed for user root Aug 03 08:39:22 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-11a1d977-a9ce-4a47-8a88-f233d4841515 tempest-VolumesExtendTest-896546243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-7f8fce77-d4ac-4b72-9d80-6bc3aabaa75e 1073741824" returned: 0 in 0.598s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:39:22 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-11a1d977-a9ce-4a47-8a88-f233d4841515 tempest-VolumesExtendTest-896546243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-7f8fce77-d4ac-4b72-9d80-6bc3aabaa75e {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:39:22 devstack sudo[101399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-7f8fce77-d4ac-4b72-9d80-6bc3aabaa75e Aug 03 08:39:22 devstack sudo[101399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:39:22 devstack sudo[101397]: pam_unix(sudo:session): session closed for user root Aug 03 08:39:22 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-45931ca3-d843-4f6e-bd74-c89efb53cf23 tempest-VolumesTransfersV355Test-896932722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a" returned: 0 in 0.361s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:39:22 devstack cinder-volume[88899]: DEBUG cinder.manager [None req-45931ca3-d843-4f6e-bd74-c89efb53cf23 tempest-VolumesTransfersV355Test-896932722 None] Notifying Schedulers of capabilities ... {{(pid=88899) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 08:39:22 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-45931ca3-d843-4f6e-bd74-c89efb53cf23 tempest-VolumesTransfersV355Test-896932722 None] Deleted volume successfully. Aug 03 08:39:22 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-45931ca3-d843-4f6e-bd74-c89efb53cf23 tempest-VolumesTransfersV355Test-896932722 None] Lock "cinder-3c738163-c0b6-4cbc-bf65-72aee58ae5c8-delete_volume" released by "delete_volume" :: held 1.532s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:39:22 devstack sudo[101399]: pam_unix(sudo:session): session closed for user root Aug 03 08:39:22 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-11a1d977-a9ce-4a47-8a88-f233d4841515 tempest-VolumesExtendTest-896546243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-7f8fce77-d4ac-4b72-9d80-6bc3aabaa75e" returned: 0 in 0.347s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:39:22 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-11a1d977-a9ce-4a47-8a88-f233d4841515 tempest-VolumesExtendTest-896546243 None] <== create_volume: return (1011ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'} {{(pid=88899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 08:39:22 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-11a1d977-a9ce-4a47-8a88-f233d4841515 tempest-VolumesExtendTest-896546243 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.015s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:39:22 devstack cinder-volume[88899]: DEBUG dbcounter [-] [88899] Writing DB stats cinder:INSERT=62,cinder:UPDATE=160,cinder:SELECT=133,cinder:DELETE=12 {{(pid=88899) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 03 08:39:22 devstack cinder-volume[88899]: DEBUG cinder.volume.volume_utils [None req-11a1d977-a9ce-4a47-8a88-f233d4841515 tempest-VolumesExtendTest-896546243 None] Attempting download of 37045a76-b9b1-4156-b15f-85c62a8616c3 ((None, [{'url': 'file:///opt/stack/data/glance/images/37045a76-b9b1-4156-b15f-85c62a8616c3', 'metadata': {}}])) to volume 7f8fce77-d4ac-4b72-9d80-6bc3aabaa75e. {{(pid=88899) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Aug 03 08:39:22 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c6f5fde-436c-4169-91b2-3992c123220c]: (4, 'raw') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:39:22 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-11a1d977-a9ce-4a47-8a88-f233d4841515 tempest-VolumesExtendTest-896546243 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_37045a76-b9b1-4156-b15f-85c62a8616c3_zo6tao1i {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:39:22 devstack sudo[101403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_37045a76-b9b1-4156-b15f-85c62a8616c3_zo6tao1i Aug 03 08:39:22 devstack sudo[101403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:39:23 devstack sudo[101403]: pam_unix(sudo:session): session closed for user root Aug 03 08:39:23 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-11a1d977-a9ce-4a47-8a88-f233d4841515 tempest-VolumesExtendTest-896546243 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_37045a76-b9b1-4156-b15f-85c62a8616c3_zo6tao1i" returned: 0 in 0.420s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:39:23 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-11a1d977-a9ce-4a47-8a88-f233d4841515 tempest-VolumesExtendTest-896546243 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_37045a76-b9b1-4156-b15f-85c62a8616c3_zo6tao1i {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:39:23 devstack sudo[101407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_37045a76-b9b1-4156-b15f-85c62a8616c3_zo6tao1i Aug 03 08:39:23 devstack sudo[101407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:39:23 devstack sudo[101407]: pam_unix(sudo:session): session closed for user root Aug 03 08:39:23 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-11a1d977-a9ce-4a47-8a88-f233d4841515 tempest-VolumesExtendTest-896546243 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_37045a76-b9b1-4156-b15f-85c62a8616c3_zo6tao1i" returned: 1 in 0.384s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:39:23 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-11a1d977-a9ce-4a47-8a88-f233d4841515 tempest-VolumesExtendTest-896546243 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_37045a76-b9b1-4156-b15f-85c62a8616c3_zo6tao1i' failed. Not Retrying. {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 03 08:39:23 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[7394d51b-28af-4b24-af97-41edcac09965]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:39:23 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-11a1d977-a9ce-4a47-8a88-f233d4841515 tempest-VolumesExtendTest-896546243 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_37045a76-b9b1-4156-b15f-85c62a8616c3_pg76f0v6devstack@QuobyteHD {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:39:23 devstack sudo[101411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_37045a76-b9b1-4156-b15f-85c62a8616c3_pg76f0v6devstack@QuobyteHD Aug 03 08:39:23 devstack sudo[101411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:39:23 devstack sudo[101411]: pam_unix(sudo:session): session closed for user root Aug 03 08:39:23 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-11a1d977-a9ce-4a47-8a88-f233d4841515 tempest-VolumesExtendTest-896546243 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_37045a76-b9b1-4156-b15f-85c62a8616c3_pg76f0v6devstack@QuobyteHD" returned: 0 in 0.404s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:39:23 devstack cinder-volume[88899]: DEBUG cinder.image.image_utils [None req-11a1d977-a9ce-4a47-8a88-f233d4841515 tempest-VolumesExtendTest-896546243 None] 37045a76-b9b1-4156-b15f-85c62a8616c3 was qcow2, converting to qcow2 {{(pid=88899) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Aug 03 08:39:23 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-11a1d977-a9ce-4a47-8a88-f233d4841515 tempest-VolumesExtendTest-896546243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_37045a76-b9b1-4156-b15f-85c62a8616c3_pg76f0v6devstack@QuobyteHD /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-7f8fce77-d4ac-4b72-9d80-6bc3aabaa75e {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:39:23 devstack sudo[101416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_37045a76-b9b1-4156-b15f-85c62a8616c3_pg76f0v6devstack@QuobyteHD /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-7f8fce77-d4ac-4b72-9d80-6bc3aabaa75e Aug 03 08:39:23 devstack sudo[101416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:39:26 devstack sudo[101416]: pam_unix(sudo:session): session closed for user root Aug 03 08:39:26 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-11a1d977-a9ce-4a47-8a88-f233d4841515 tempest-VolumesExtendTest-896546243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_37045a76-b9b1-4156-b15f-85c62a8616c3_pg76f0v6devstack@QuobyteHD /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-7f8fce77-d4ac-4b72-9d80-6bc3aabaa75e" returned: 0 in 2.209s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:39:26 devstack cinder-volume[88899]: DEBUG cinder.image.image_utils [None req-11a1d977-a9ce-4a47-8a88-f233d4841515 tempest-VolumesExtendTest-896546243 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_37045a76-b9b1-4156-b15f-85c62a8616c3_pg76f0v6devstack@QuobyteHD, size 112.00 MB, duration 2.21 sec, destination /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-7f8fce77-d4ac-4b72-9d80-6bc3aabaa75e {{(pid=88899) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 03 08:39:26 devstack cinder-volume[88899]: INFO cinder.image.image_utils [None req-11a1d977-a9ce-4a47-8a88-f233d4841515 tempest-VolumesExtendTest-896546243 None] Converted 112.00 MB image at 50.69 MB/s Aug 03 08:39:26 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-11a1d977-a9ce-4a47-8a88-f233d4841515 tempest-VolumesExtendTest-896546243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-7f8fce77-d4ac-4b72-9d80-6bc3aabaa75e 1G {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:39:26 devstack sudo[101423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-7f8fce77-d4ac-4b72-9d80-6bc3aabaa75e 1G Aug 03 08:39:26 devstack sudo[101423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:39:26 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-cc45c873-5d78-4773-833b-c3353062c1b9 tempest-GroupsV314Test-504357875 None] Group tempest-GroupsV314Test-Group-1356796374: creating Aug 03 08:39:26 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-cc45c873-5d78-4773-833b-c3353062c1b9 tempest-GroupsV314Test-504357875 None] Group tempest-GroupsV314Test-Group-1356796374: created successfully Aug 03 08:39:26 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-cc45c873-5d78-4773-833b-c3353062c1b9 tempest-GroupsV314Test-504357875 None] Create group completed successfully. Aug 03 08:39:26 devstack sudo[101423]: pam_unix(sudo:session): session closed for user root Aug 03 08:39:26 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-11a1d977-a9ce-4a47-8a88-f233d4841515 tempest-VolumesExtendTest-896546243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-7f8fce77-d4ac-4b72-9d80-6bc3aabaa75e 1G" returned: 0 in 0.481s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:39:26 devstack cinder-volume[88899]: DEBUG cinder.volume.volume_utils [None req-11a1d977-a9ce-4a47-8a88-f233d4841515 tempest-VolumesExtendTest-896546243 None] Downloaded image 37045a76-b9b1-4156-b15f-85c62a8616c3 ((None, [{'url': 'file:///opt/stack/data/glance/images/37045a76-b9b1-4156-b15f-85c62a8616c3', 'metadata': {}}])) to volume 7f8fce77-d4ac-4b72-9d80-6bc3aabaa75e successfully. {{(pid=88899) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Aug 03 08:39:26 devstack cinder-volume[88899]: DEBUG cinder.image.image_utils [None req-11a1d977-a9ce-4a47-8a88-f233d4841515 tempest-VolumesExtendTest-896546243 None] Temporary image 37045a76-b9b1-4156-b15f-85c62a8616c3 for user 6c5bc611eed84a0faea6d55f4bca6053 is deleted. {{(pid=88899) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Aug 03 08:39:26 devstack cinder-volume[88899]: DEBUG cinder.volume.volume_utils [None req-11a1d977-a9ce-4a47-8a88-f233d4841515 tempest-VolumesExtendTest-896546243 None] Marking volume 7f8fce77-d4ac-4b72-9d80-6bc3aabaa75e as bootable. {{(pid=88899) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Aug 03 08:39:26 devstack cinder-volume[88899]: DEBUG cinder.volume.flows.manager.create_volume [None req-11a1d977-a9ce-4a47-8a88-f233d4841515 tempest-VolumesExtendTest-896546243 None] Copying metadata from image 37045a76-b9b1-4156-b15f-85c62a8616c3 to 7f8fce77-d4ac-4b72-9d80-6bc3aabaa75e. {{(pid=88899) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Aug 03 08:39:26 devstack cinder-volume[88899]: DEBUG cinder.volume.flows.manager.create_volume [None req-11a1d977-a9ce-4a47-8a88-f233d4841515 tempest-VolumesExtendTest-896546243 None] Creating volume glance metadata for volume 7f8fce77-d4ac-4b72-9d80-6bc3aabaa75e backed by image 37045a76-b9b1-4156-b15f-85c62a8616c3 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '37045a76-b9b1-4156-b15f-85c62a8616c3', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=88899) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Aug 03 08:39:26 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-11a1d977-a9ce-4a47-8a88-f233d4841515 tempest-VolumesExtendTest-896546243 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e1e642bd-4cdd-4b11-a6d7-4de126cb1f96) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7f8fce77-d4ac-4b72-9d80-6bc3aabaa75e', 'volume_size': 1, 'image_id': '37045a76-b9b1-4156-b15f-85c62a8616c3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/37045a76-b9b1-4156-b15f-85c62a8616c3', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'adee82974e9f41769efcb3f4a0eef199', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '37045a76-b9b1-4156-b15f-85c62a8616c3', 'created_at': datetime.datetime(2026, 8, 3, 6, 23, 4, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 3, 6, 23, 6, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/37045a76-b9b1-4156-b15f-85c62a8616c3/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:39:26 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-11a1d977-a9ce-4a47-8a88-f233d4841515 tempest-VolumesExtendTest-896546243 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33c7391f-9c64-4de3-9723-b74165b27901) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:39:26 devstack cinder-volume[88899]: INFO cinder.volume.flows.manager.create_volume [None req-11a1d977-a9ce-4a47-8a88-f233d4841515 tempest-VolumesExtendTest-896546243 None] Volume volume-7f8fce77-d4ac-4b72-9d80-6bc3aabaa75e (7f8fce77-d4ac-4b72-9d80-6bc3aabaa75e): created successfully Aug 03 08:39:26 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-11a1d977-a9ce-4a47-8a88-f233d4841515 tempest-VolumesExtendTest-896546243 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33c7391f-9c64-4de3-9723-b74165b27901) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:39:26 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-11a1d977-a9ce-4a47-8a88-f233d4841515 tempest-VolumesExtendTest-896546243 None] Flow 'volume_create_manager' (bb0dcb3f-cc0e-414c-9d38-33a0e287b2a8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:39:26 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-11a1d977-a9ce-4a47-8a88-f233d4841515 tempest-VolumesExtendTest-896546243 None] Created volume successfully. Aug 03 08:39:27 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-e4c2df9d-531b-4046-b9e2-8e7141151ea0 tempest-VolumesExtendTest-896546243 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:39:27 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-e4c2df9d-531b-4046-b9e2-8e7141151ea0 tempest-VolumesExtendTest-896546243 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:39:27 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[107ecf1f-f35d-4752-a2b8-37042f949ee4]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:39:27 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-e4c2df9d-531b-4046-b9e2-8e7141151ea0 tempest-VolumesExtendTest-896546243 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-7f8fce77-d4ac-4b72-9d80-6bc3aabaa75e {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:39:27 devstack sudo[101428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-7f8fce77-d4ac-4b72-9d80-6bc3aabaa75e Aug 03 08:39:27 devstack sudo[101428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:39:27 devstack sudo[101428]: pam_unix(sudo:session): session closed for user root Aug 03 08:39:27 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-e4c2df9d-531b-4046-b9e2-8e7141151ea0 tempest-VolumesExtendTest-896546243 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-7f8fce77-d4ac-4b72-9d80-6bc3aabaa75e" returned: 0 in 0.470s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:39:27 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-e4c2df9d-531b-4046-b9e2-8e7141151ea0 tempest-VolumesExtendTest-896546243 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-7f8fce77-d4ac-4b72-9d80-6bc3aabaa75e 2G {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:39:27 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-e4c2df9d-531b-4046-b9e2-8e7141151ea0 tempest-VolumesExtendTest-896546243 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-7f8fce77-d4ac-4b72-9d80-6bc3aabaa75e 2G" returned: 0 in 0.121s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:39:27 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-e4c2df9d-531b-4046-b9e2-8e7141151ea0 tempest-VolumesExtendTest-896546243 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.617s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:39:27 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-e4c2df9d-531b-4046-b9e2-8e7141151ea0 tempest-VolumesExtendTest-896546243 None] Extend volume completed successfully. Aug 03 08:39:28 devstack cinder-volume[88899]: DEBUG cinder.volume.flows.manager.create_volume [None req-d588fac6-fef5-40b4-8440-b1b1b8f3e8f8 tempest-GroupsV314Test-504357875 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88899) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 08:39:28 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-d588fac6-fef5-40b4-8440-b1b1b8f3e8f8 tempest-GroupsV314Test-504357875 None] Flow 'volume_create_manager' (8e100d0e-0bda-4732-81f4-8c44695cc7b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:39:28 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-d588fac6-fef5-40b4-8440-b1b1b8f3e8f8 tempest-GroupsV314Test-504357875 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8207bdd9-5eca-4a85-8d78-4e6deddad3ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:39:28 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-d588fac6-fef5-40b4-8440-b1b1b8f3e8f8 tempest-GroupsV314Test-504357875 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8207bdd9-5eca-4a85-8d78-4e6deddad3ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:39:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1264151349',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=85d3dac3-7a55-43a3-a524-ec1dd1712068,host='devstack@QuobyteHD#QuobyteHD',id=c9843ec6-095a-4da3-9723-813ab3aef973,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1e2ab571ad1e4e999d38dcaf560b1def',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:39:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:39:28Z,use_quota=True,user_id='58ec8a83833a44318f77ef91ade2b472',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(74dd8545-392e-4351-9903-438e2f23dca8),volume_type_id=74dd8545-392e-4351-9903-438e2f23dca8)' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:39:28 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-d588fac6-fef5-40b4-8440-b1b1b8f3e8f8 tempest-GroupsV314Test-504357875 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97452eb8-151a-4f24-a90f-d9d0088fd5e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:39:28 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-d588fac6-fef5-40b4-8440-b1b1b8f3e8f8 tempest-GroupsV314Test-504357875 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97452eb8-151a-4f24-a90f-d9d0088fd5e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:39:28 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-d588fac6-fef5-40b4-8440-b1b1b8f3e8f8 tempest-GroupsV314Test-504357875 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (145f8925-5c81-44dd-9e5f-ac91a96ae2b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:39:28 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-d588fac6-fef5-40b4-8440-b1b1b8f3e8f8 tempest-GroupsV314Test-504357875 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (145f8925-5c81-44dd-9e5f-ac91a96ae2b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c9843ec6-095a-4da3-9723-813ab3aef973', 'volume_name': 'volume-c9843ec6-095a-4da3-9723-813ab3aef973', 'volume_size': 1}' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:39:28 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-d588fac6-fef5-40b4-8440-b1b1b8f3e8f8 tempest-GroupsV314Test-504357875 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f890875d-e393-4147-81fc-c1a28f414002) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:39:28 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-d588fac6-fef5-40b4-8440-b1b1b8f3e8f8 tempest-GroupsV314Test-504357875 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f890875d-e393-4147-81fc-c1a28f414002) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:39:28 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-d588fac6-fef5-40b4-8440-b1b1b8f3e8f8 tempest-GroupsV314Test-504357875 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01eea011-17a9-4d5a-afc0-459f0c64a0d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:39:28 devstack cinder-volume[88899]: INFO cinder.volume.flows.manager.create_volume [None req-d588fac6-fef5-40b4-8440-b1b1b8f3e8f8 tempest-GroupsV314Test-504357875 None] Volume c9843ec6-095a-4da3-9723-813ab3aef973: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c9843ec6-095a-4da3-9723-813ab3aef973', 'volume_size': 1} Aug 03 08:39:28 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-d588fac6-fef5-40b4-8440-b1b1b8f3e8f8 tempest-GroupsV314Test-504357875 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:39:28 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-d588fac6-fef5-40b4-8440-b1b1b8f3e8f8 tempest-GroupsV314Test-504357875 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:39:28 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-d588fac6-fef5-40b4-8440-b1b1b8f3e8f8 tempest-GroupsV314Test-504357875 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=85d3dac3-7a55-43a3-a524-ec1dd1712068,created_at=2026-08-03T06:39:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1264151349',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=85d3dac3-7a55-43a3-a524-ec1dd1712068,host='devstack@QuobyteHD#QuobyteHD',id=c9843ec6-095a-4da3-9723-813ab3aef973,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1e2ab571ad1e4e999d38dcaf560b1def',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:39:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:39:28Z,use_quota=True,user_id='58ec8a83833a44318f77ef91ade2b472',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(74dd8545-392e-4351-9903-438e2f23dca8),volume_type_id=74dd8545-392e-4351-9903-438e2f23dca8)}" {{(pid=88899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 08:39:28 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-d588fac6-fef5-40b4-8440-b1b1b8f3e8f8 tempest-GroupsV314Test-504357875 None] Creating volume c9843ec6-095a-4da3-9723-813ab3aef973 {{(pid=88899) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 08:39:28 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-d588fac6-fef5-40b4-8440-b1b1b8f3e8f8 tempest-GroupsV314Test-504357875 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:39:28 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-d588fac6-fef5-40b4-8440-b1b1b8f3e8f8 tempest-GroupsV314Test-504357875 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:39:28 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-d588fac6-fef5-40b4-8440-b1b1b8f3e8f8 tempest-GroupsV314Test-504357875 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:39:28 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-d588fac6-fef5-40b4-8440-b1b1b8f3e8f8 tempest-GroupsV314Test-504357875 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:39:28 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-d588fac6-fef5-40b4-8440-b1b1b8f3e8f8 tempest-GroupsV314Test-504357875 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:39:28 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-d588fac6-fef5-40b4-8440-b1b1b8f3e8f8 tempest-GroupsV314Test-504357875 None] Selected osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385 as target Quobyte volume. {{(pid=88899) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 08:39:28 devstack cinder-volume[88899]: INFO cinder.volume.drivers.remotefs [None req-d588fac6-fef5-40b4-8440-b1b1b8f3e8f8 tempest-GroupsV314Test-504357875 None] casted to osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385 Aug 03 08:39:28 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-d588fac6-fef5-40b4-8440-b1b1b8f3e8f8 tempest-GroupsV314Test-504357875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c9843ec6-095a-4da3-9723-813ab3aef973 1073741824 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:39:28 devstack sudo[101438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c9843ec6-095a-4da3-9723-813ab3aef973 1073741824 Aug 03 08:39:28 devstack sudo[101438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:39:28 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-157ecd08-4f9d-4d98-91f4-f4a4d6e05e60 tempest-VolumesExtendTest-896546243 None] Acquiring lock "cinder-7f8fce77-d4ac-4b72-9d80-6bc3aabaa75e-delete_volume" by "delete_volume" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:39:28 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-157ecd08-4f9d-4d98-91f4-f4a4d6e05e60 tempest-VolumesExtendTest-896546243 None] Lock "cinder-7f8fce77-d4ac-4b72-9d80-6bc3aabaa75e-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:39:28 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-157ecd08-4f9d-4d98-91f4-f4a4d6e05e60 tempest-VolumesExtendTest-896546243 None] Acquiring lock "cinder-quobyte-7f8fce77-d4ac-4b72-9d80-6bc3aabaa75e" by "delete_volume" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:39:28 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-157ecd08-4f9d-4d98-91f4-f4a4d6e05e60 tempest-VolumesExtendTest-896546243 None] Lock "cinder-quobyte-7f8fce77-d4ac-4b72-9d80-6bc3aabaa75e" acquired by "delete_volume" :: waited 0.021s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:39:28 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad9d4d75-f508-45ed-a558-683480df1325]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:39:28 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-157ecd08-4f9d-4d98-91f4-f4a4d6e05e60 tempest-VolumesExtendTest-896546243 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-7f8fce77-d4ac-4b72-9d80-6bc3aabaa75e {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:39:28 devstack sudo[101438]: pam_unix(sudo:session): session closed for user root Aug 03 08:39:28 devstack sudo[101444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-7f8fce77-d4ac-4b72-9d80-6bc3aabaa75e Aug 03 08:39:28 devstack sudo[101444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:39:28 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-d588fac6-fef5-40b4-8440-b1b1b8f3e8f8 tempest-GroupsV314Test-504357875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c9843ec6-095a-4da3-9723-813ab3aef973 1073741824" returned: 0 in 0.526s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:39:28 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-d588fac6-fef5-40b4-8440-b1b1b8f3e8f8 tempest-GroupsV314Test-504357875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c9843ec6-095a-4da3-9723-813ab3aef973 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:39:28 devstack sudo[101446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c9843ec6-095a-4da3-9723-813ab3aef973 Aug 03 08:39:28 devstack sudo[101446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:39:29 devstack sudo[101444]: pam_unix(sudo:session): session closed for user root Aug 03 08:39:29 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-157ecd08-4f9d-4d98-91f4-f4a4d6e05e60 tempest-VolumesExtendTest-896546243 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-7f8fce77-d4ac-4b72-9d80-6bc3aabaa75e" returned: 0 in 0.417s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:39:29 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-157ecd08-4f9d-4d98-91f4-f4a4d6e05e60 tempest-VolumesExtendTest-896546243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-7f8fce77-d4ac-4b72-9d80-6bc3aabaa75e {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:39:29 devstack sudo[101451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-7f8fce77-d4ac-4b72-9d80-6bc3aabaa75e Aug 03 08:39:29 devstack sudo[101451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:39:29 devstack sudo[101446]: pam_unix(sudo:session): session closed for user root Aug 03 08:39:29 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-d588fac6-fef5-40b4-8440-b1b1b8f3e8f8 tempest-GroupsV314Test-504357875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c9843ec6-095a-4da3-9723-813ab3aef973" returned: 0 in 0.304s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:39:29 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-d588fac6-fef5-40b4-8440-b1b1b8f3e8f8 tempest-GroupsV314Test-504357875 None] <== create_volume: return (877ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'} {{(pid=88899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 08:39:29 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-d588fac6-fef5-40b4-8440-b1b1b8f3e8f8 tempest-GroupsV314Test-504357875 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.881s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:39:29 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-d588fac6-fef5-40b4-8440-b1b1b8f3e8f8 tempest-GroupsV314Test-504357875 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01eea011-17a9-4d5a-afc0-459f0c64a0d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c9843ec6-095a-4da3-9723-813ab3aef973', 'volume_size': 1}' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:39:29 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-d588fac6-fef5-40b4-8440-b1b1b8f3e8f8 tempest-GroupsV314Test-504357875 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79d5095f-6f10-4636-8a81-583ed0ba816d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:39:29 devstack cinder-volume[88899]: INFO cinder.volume.flows.manager.create_volume [None req-d588fac6-fef5-40b4-8440-b1b1b8f3e8f8 tempest-GroupsV314Test-504357875 None] Volume volume-c9843ec6-095a-4da3-9723-813ab3aef973 (c9843ec6-095a-4da3-9723-813ab3aef973): created successfully Aug 03 08:39:29 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-d588fac6-fef5-40b4-8440-b1b1b8f3e8f8 tempest-GroupsV314Test-504357875 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79d5095f-6f10-4636-8a81-583ed0ba816d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:39:29 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-d588fac6-fef5-40b4-8440-b1b1b8f3e8f8 tempest-GroupsV314Test-504357875 None] Flow 'volume_create_manager' (8e100d0e-0bda-4732-81f4-8c44695cc7b3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:39:29 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-d588fac6-fef5-40b4-8440-b1b1b8f3e8f8 tempest-GroupsV314Test-504357875 None] Created volume successfully. Aug 03 08:39:29 devstack sudo[101451]: pam_unix(sudo:session): session closed for user root Aug 03 08:39:29 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-157ecd08-4f9d-4d98-91f4-f4a4d6e05e60 tempest-VolumesExtendTest-896546243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-7f8fce77-d4ac-4b72-9d80-6bc3aabaa75e" returned: 0 in 0.295s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:39:29 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-157ecd08-4f9d-4d98-91f4-f4a4d6e05e60 tempest-VolumesExtendTest-896546243 None] Lock "cinder-quobyte-7f8fce77-d4ac-4b72-9d80-6bc3aabaa75e" released by "delete_volume" :: held 0.758s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:39:29 devstack cinder-volume[88899]: DEBUG cinder.quota [None req-157ecd08-4f9d-4d98-91f4-f4a4d6e05e60 tempest-VolumesExtendTest-896546243 None] Created reservations ['49ab5daa-0c45-4bc7-a74f-b4a9815097ba', '57095276-7b64-4598-ace6-d2718a23ee8d', '67bfa843-cff0-4b38-bb8d-d9e262619325', '031794a8-ead6-4f30-bc65-30fbbe07dbea'] {{(pid=88899) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 08:39:29 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-157ecd08-4f9d-4d98-91f4-f4a4d6e05e60 tempest-VolumesExtendTest-896546243 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:39:29 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-157ecd08-4f9d-4d98-91f4-f4a4d6e05e60 tempest-VolumesExtendTest-896546243 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:39:29 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-157ecd08-4f9d-4d98-91f4-f4a4d6e05e60 tempest-VolumesExtendTest-896546243 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:39:29 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-157ecd08-4f9d-4d98-91f4-f4a4d6e05e60 tempest-VolumesExtendTest-896546243 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:39:29 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-157ecd08-4f9d-4d98-91f4-f4a4d6e05e60 tempest-VolumesExtendTest-896546243 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:39:29 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-157ecd08-4f9d-4d98-91f4-f4a4d6e05e60 tempest-VolumesExtendTest-896546243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:39:29 devstack sudo[101455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a Aug 03 08:39:29 devstack sudo[101455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:39:30 devstack sudo[101455]: pam_unix(sudo:session): session closed for user root Aug 03 08:39:30 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-157ecd08-4f9d-4d98-91f4-f4a4d6e05e60 tempest-VolumesExtendTest-896546243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a" returned: 0 in 0.332s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:39:30 devstack cinder-volume[88899]: DEBUG cinder.manager [None req-157ecd08-4f9d-4d98-91f4-f4a4d6e05e60 tempest-VolumesExtendTest-896546243 None] Notifying Schedulers of capabilities ... {{(pid=88899) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 08:39:30 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-157ecd08-4f9d-4d98-91f4-f4a4d6e05e60 tempest-VolumesExtendTest-896546243 None] Deleted volume successfully. Aug 03 08:39:30 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-157ecd08-4f9d-4d98-91f4-f4a4d6e05e60 tempest-VolumesExtendTest-896546243 None] Lock "cinder-7f8fce77-d4ac-4b72-9d80-6bc3aabaa75e-delete_volume" released by "delete_volume" :: held 1.367s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:39:30 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-bf6e0d4f-c107-49a4-91b9-2744ca2d9102 tempest-GroupsV314Test-504357875 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:39:30 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-bf6e0d4f-c107-49a4-91b9-2744ca2d9102 tempest-GroupsV314Test-504357875 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:39:30 devstack cinder-volume[88899]: INFO cinder.volume.drivers.remotefs [None req-bf6e0d4f-c107-49a4-91b9-2744ca2d9102 tempest-GroupsV314Test-504357875 None] Cloning volume c9843ec6-095a-4da3-9723-813ab3aef973 to volume 5ff85ce2-839c-43c6-85ff-d1cd5747c916 Aug 03 08:39:30 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-bf6e0d4f-c107-49a4-91b9-2744ca2d9102 tempest-GroupsV314Test-504357875 None] Creating offline snapshot 66fbbf48-52aa-4aee-8631-4d96037d7fa2 of volume c9843ec6-095a-4da3-9723-813ab3aef973 {{(pid=88899) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 03 08:39:30 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[45666be9-c811-476e-86e2-7acc7b871739]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:39:30 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-bf6e0d4f-c107-49a4-91b9-2744ca2d9102 tempest-GroupsV314Test-504357875 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c9843ec6-095a-4da3-9723-813ab3aef973 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:39:30 devstack sudo[101461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c9843ec6-095a-4da3-9723-813ab3aef973 Aug 03 08:39:30 devstack sudo[101461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:39:30 devstack cinder-volume[88899]: DEBUG cinder.volume.flows.manager.create_volume [None req-b19127ab-783a-4eb5-a6b3-7ff5781a647d tempest-VolumesExtendTest-896546243 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88899) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 08:39:30 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-b19127ab-783a-4eb5-a6b3-7ff5781a647d tempest-VolumesExtendTest-896546243 None] Flow 'volume_create_manager' (24eb4a79-54b7-4eef-8bfe-82f8b407d2ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:39:30 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-b19127ab-783a-4eb5-a6b3-7ff5781a647d tempest-VolumesExtendTest-896546243 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2390fbcf-dab1-431a-a1a7-2c78380fefdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:39:30 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-b19127ab-783a-4eb5-a6b3-7ff5781a647d tempest-VolumesExtendTest-896546243 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2390fbcf-dab1-431a-a1a7-2c78380fefdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:39:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-338070560',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=589fa109-7818-430b-8b8c-fbaf705653b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='31966c7036e344cf8eabf444e342118a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:39:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:39:31Z,use_quota=True,user_id='6c5bc611eed84a0faea6d55f4bca6053',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8bde7129-1dc4-42ab-b852-ab32c61b4921),volume_type_id=8bde7129-1dc4-42ab-b852-ab32c61b4921)' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:39:30 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-b19127ab-783a-4eb5-a6b3-7ff5781a647d tempest-VolumesExtendTest-896546243 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f72e124c-3305-4bdd-8965-cbe512542776) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:39:30 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-b19127ab-783a-4eb5-a6b3-7ff5781a647d tempest-VolumesExtendTest-896546243 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f72e124c-3305-4bdd-8965-cbe512542776) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:39:30 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-b19127ab-783a-4eb5-a6b3-7ff5781a647d tempest-VolumesExtendTest-896546243 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc9c0d2c-fe6f-4636-b575-843cb44ba011) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:39:30 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-b19127ab-783a-4eb5-a6b3-7ff5781a647d tempest-VolumesExtendTest-896546243 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc9c0d2c-fe6f-4636-b575-843cb44ba011) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '589fa109-7818-430b-8b8c-fbaf705653b7', 'volume_name': 'volume-589fa109-7818-430b-8b8c-fbaf705653b7', 'volume_size': 1}' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:39:30 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-b19127ab-783a-4eb5-a6b3-7ff5781a647d tempest-VolumesExtendTest-896546243 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (186882c1-1d7c-43e7-ac97-79f927f89968) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:39:30 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-b19127ab-783a-4eb5-a6b3-7ff5781a647d tempest-VolumesExtendTest-896546243 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (186882c1-1d7c-43e7-ac97-79f927f89968) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:39:30 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-b19127ab-783a-4eb5-a6b3-7ff5781a647d tempest-VolumesExtendTest-896546243 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae22091f-d563-4a64-a614-861704c88b65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:39:30 devstack cinder-volume[88899]: INFO cinder.volume.flows.manager.create_volume [None req-b19127ab-783a-4eb5-a6b3-7ff5781a647d tempest-VolumesExtendTest-896546243 None] Volume 589fa109-7818-430b-8b8c-fbaf705653b7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-589fa109-7818-430b-8b8c-fbaf705653b7', 'volume_size': 1} Aug 03 08:39:30 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-b19127ab-783a-4eb5-a6b3-7ff5781a647d tempest-VolumesExtendTest-896546243 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:39:30 devstack sudo[101461]: pam_unix(sudo:session): session closed for user root Aug 03 08:39:30 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-bf6e0d4f-c107-49a4-91b9-2744ca2d9102 tempest-GroupsV314Test-504357875 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c9843ec6-095a-4da3-9723-813ab3aef973" returned: 0 in 0.543s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:39:30 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-bf6e0d4f-c107-49a4-91b9-2744ca2d9102 tempest-GroupsV314Test-504357875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c9843ec6-095a-4da3-9723-813ab3aef973,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c9843ec6-095a-4da3-9723-813ab3aef973.66fbbf48-52aa-4aee-8631-4d96037d7fa2 1G {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:39:31 devstack sudo[101466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c9843ec6-095a-4da3-9723-813ab3aef973,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c9843ec6-095a-4da3-9723-813ab3aef973.66fbbf48-52aa-4aee-8631-4d96037d7fa2 1G Aug 03 08:39:31 devstack sudo[101466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:39:31 devstack sudo[101466]: pam_unix(sudo:session): session closed for user root Aug 03 08:39:31 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-bf6e0d4f-c107-49a4-91b9-2744ca2d9102 tempest-GroupsV314Test-504357875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c9843ec6-095a-4da3-9723-813ab3aef973,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c9843ec6-095a-4da3-9723-813ab3aef973.66fbbf48-52aa-4aee-8631-4d96037d7fa2 1G" returned: 0 in 0.567s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:39:31 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-bf6e0d4f-c107-49a4-91b9-2744ca2d9102 tempest-GroupsV314Test-504357875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c9843ec6-095a-4da3-9723-813ab3aef973 -F qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c9843ec6-095a-4da3-9723-813ab3aef973.66fbbf48-52aa-4aee-8631-4d96037d7fa2 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:39:31 devstack sudo[101472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c9843ec6-095a-4da3-9723-813ab3aef973 -F qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c9843ec6-095a-4da3-9723-813ab3aef973.66fbbf48-52aa-4aee-8631-4d96037d7fa2 Aug 03 08:39:31 devstack sudo[101472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:39:31 devstack cinder-volume[88899]: DEBUG cinder.volume.flows.manager.create_volume [None req-64a2a063-43f2-4640-b96b-2ecf3abba198 tempest-SnapshotDataIntegrityTests-1494076589 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88899) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 08:39:31 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-64a2a063-43f2-4640-b96b-2ecf3abba198 tempest-SnapshotDataIntegrityTests-1494076589 None] Flow 'volume_create_manager' (ece0dc0c-3bc5-4cdb-b6b4-7023566b3c91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:39:31 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-64a2a063-43f2-4640-b96b-2ecf3abba198 tempest-SnapshotDataIntegrityTests-1494076589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d362cd7-bead-43f6-9a12-c35f96ee9cf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:39:31 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-64a2a063-43f2-4640-b96b-2ecf3abba198 tempest-SnapshotDataIntegrityTests-1494076589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d362cd7-bead-43f6-9a12-c35f96ee9cf0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:39:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDataIntegrityTests-volume-938922108',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6bafdd19-6d59-4557-a0e3-17d1fbfc1053,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7bfeec51147d4d6fb726c3d53fa691a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:39:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:39:32Z,use_quota=True,user_id='154fb6e7d02d4632a2d4958c8859e9a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8bde7129-1dc4-42ab-b852-ab32c61b4921),volume_type_id=8bde7129-1dc4-42ab-b852-ab32c61b4921)' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:39:31 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-64a2a063-43f2-4640-b96b-2ecf3abba198 tempest-SnapshotDataIntegrityTests-1494076589 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d38da5aa-1dcf-4ac2-bc10-a502cedf9cf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:39:31 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-64a2a063-43f2-4640-b96b-2ecf3abba198 tempest-SnapshotDataIntegrityTests-1494076589 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d38da5aa-1dcf-4ac2-bc10-a502cedf9cf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:39:31 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-64a2a063-43f2-4640-b96b-2ecf3abba198 tempest-SnapshotDataIntegrityTests-1494076589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (84430073-31d2-4552-98e2-359963760fc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:39:31 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-64a2a063-43f2-4640-b96b-2ecf3abba198 tempest-SnapshotDataIntegrityTests-1494076589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (84430073-31d2-4552-98e2-359963760fc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6bafdd19-6d59-4557-a0e3-17d1fbfc1053', 'volume_name': 'volume-6bafdd19-6d59-4557-a0e3-17d1fbfc1053', 'volume_size': 1}' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:39:31 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-64a2a063-43f2-4640-b96b-2ecf3abba198 tempest-SnapshotDataIntegrityTests-1494076589 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c3b3836-a6b5-406a-9f5b-6c9863542b47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:39:31 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-64a2a063-43f2-4640-b96b-2ecf3abba198 tempest-SnapshotDataIntegrityTests-1494076589 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c3b3836-a6b5-406a-9f5b-6c9863542b47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:39:31 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-64a2a063-43f2-4640-b96b-2ecf3abba198 tempest-SnapshotDataIntegrityTests-1494076589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c9f28fca-7674-46ee-8607-a6aa0282336b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:39:31 devstack cinder-volume[88899]: INFO cinder.volume.flows.manager.create_volume [None req-64a2a063-43f2-4640-b96b-2ecf3abba198 tempest-SnapshotDataIntegrityTests-1494076589 None] Volume 6bafdd19-6d59-4557-a0e3-17d1fbfc1053: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6bafdd19-6d59-4557-a0e3-17d1fbfc1053', 'volume_size': 1} Aug 03 08:39:31 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-64a2a063-43f2-4640-b96b-2ecf3abba198 tempest-SnapshotDataIntegrityTests-1494076589 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:39:31 devstack sudo[101472]: pam_unix(sudo:session): session closed for user root Aug 03 08:39:31 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-bf6e0d4f-c107-49a4-91b9-2744ca2d9102 tempest-GroupsV314Test-504357875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c9843ec6-095a-4da3-9723-813ab3aef973 -F qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c9843ec6-095a-4da3-9723-813ab3aef973.66fbbf48-52aa-4aee-8631-4d96037d7fa2" returned: 0 in 0.332s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:39:31 devstack cinder-volume[88899]: WARNING cinder.volume.drivers.remotefs [None req-bf6e0d4f-c107-49a4-91b9-2744ca2d9102 tempest-GroupsV314Test-504357875 None] /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c9843ec6-095a-4da3-9723-813ab3aef973.66fbbf48-52aa-4aee-8631-4d96037d7fa2 is being set with open permissions: ugo+rw: NotImplementedError Aug 03 08:39:31 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-bf6e0d4f-c107-49a4-91b9-2744ca2d9102 tempest-GroupsV314Test-504357875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c9843ec6-095a-4da3-9723-813ab3aef973.66fbbf48-52aa-4aee-8631-4d96037d7fa2 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:39:31 devstack sudo[101477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c9843ec6-095a-4da3-9723-813ab3aef973.66fbbf48-52aa-4aee-8631-4d96037d7fa2 Aug 03 08:39:31 devstack sudo[101477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:39:32 devstack sudo[101477]: pam_unix(sudo:session): session closed for user root Aug 03 08:39:32 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-bf6e0d4f-c107-49a4-91b9-2744ca2d9102 tempest-GroupsV314Test-504357875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c9843ec6-095a-4da3-9723-813ab3aef973.66fbbf48-52aa-4aee-8631-4d96037d7fa2" returned: 0 in 0.287s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:39:32 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-bf6e0d4f-c107-49a4-91b9-2744ca2d9102 tempest-GroupsV314Test-504357875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c9843ec6-095a-4da3-9723-813ab3aef973.info {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:39:32 devstack sudo[101480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c9843ec6-095a-4da3-9723-813ab3aef973.info Aug 03 08:39:32 devstack sudo[101480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:39:32 devstack sudo[101480]: pam_unix(sudo:session): session closed for user root Aug 03 08:39:32 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-bf6e0d4f-c107-49a4-91b9-2744ca2d9102 tempest-GroupsV314Test-504357875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c9843ec6-095a-4da3-9723-813ab3aef973.info" returned: 0 in 0.287s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:39:32 devstack cinder-volume[88899]: WARNING cinder.volume.drivers.remotefs [None req-bf6e0d4f-c107-49a4-91b9-2744ca2d9102 tempest-GroupsV314Test-504357875 None] /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c9843ec6-095a-4da3-9723-813ab3aef973.info is being set with open permissions: ugo+rw: NotImplementedError Aug 03 08:39:32 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-bf6e0d4f-c107-49a4-91b9-2744ca2d9102 tempest-GroupsV314Test-504357875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c9843ec6-095a-4da3-9723-813ab3aef973.info {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:39:32 devstack sudo[101483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c9843ec6-095a-4da3-9723-813ab3aef973.info Aug 03 08:39:32 devstack sudo[101483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:39:32 devstack sudo[101483]: pam_unix(sudo:session): session closed for user root Aug 03 08:39:32 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-bf6e0d4f-c107-49a4-91b9-2744ca2d9102 tempest-GroupsV314Test-504357875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c9843ec6-095a-4da3-9723-813ab3aef973.info" returned: 0 in 0.302s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:39:32 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-bf6e0d4f-c107-49a4-91b9-2744ca2d9102 tempest-GroupsV314Test-504357875 None] Acquiring lock "cinder-quobyte-5ff85ce2-839c-43c6-85ff-d1cd5747c916" by "_copy_volume_from_snapshot" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:39:32 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-bf6e0d4f-c107-49a4-91b9-2744ca2d9102 tempest-GroupsV314Test-504357875 None] Lock "cinder-quobyte-5ff85ce2-839c-43c6-85ff-d1cd5747c916" acquired by "_copy_volume_from_snapshot" :: waited 0.015s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:39:32 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-bf6e0d4f-c107-49a4-91b9-2744ca2d9102 tempest-GroupsV314Test-504357875 None] snapshot: 66fbbf48-52aa-4aee-8631-4d96037d7fa2, volume: 5ff85ce2-839c-43c6-85ff-d1cd5747c916, {{(pid=88899) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Aug 03 08:39:32 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-bf6e0d4f-c107-49a4-91b9-2744ca2d9102 tempest-GroupsV314Test-504357875 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:39:32 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-bf6e0d4f-c107-49a4-91b9-2744ca2d9102 tempest-GroupsV314Test-504357875 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:39:32 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-bf6e0d4f-c107-49a4-91b9-2744ca2d9102 tempest-GroupsV314Test-504357875 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:39:32 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-bf6e0d4f-c107-49a4-91b9-2744ca2d9102 tempest-GroupsV314Test-504357875 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:39:32 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-bf6e0d4f-c107-49a4-91b9-2744ca2d9102 tempest-GroupsV314Test-504357875 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:39:32 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f722d32-c141-4e5a-981a-7709394b70da]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:39:32 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-bf6e0d4f-c107-49a4-91b9-2744ca2d9102 tempest-GroupsV314Test-504357875 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c9843ec6-095a-4da3-9723-813ab3aef973.66fbbf48-52aa-4aee-8631-4d96037d7fa2 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:39:32 devstack sudo[101488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c9843ec6-095a-4da3-9723-813ab3aef973.66fbbf48-52aa-4aee-8631-4d96037d7fa2 Aug 03 08:39:32 devstack sudo[101488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:39:33 devstack sudo[101488]: pam_unix(sudo:session): session closed for user root Aug 03 08:39:33 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-bf6e0d4f-c107-49a4-91b9-2744ca2d9102 tempest-GroupsV314Test-504357875 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c9843ec6-095a-4da3-9723-813ab3aef973.66fbbf48-52aa-4aee-8631-4d96037d7fa2" returned: 0 in 0.375s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:39:33 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-bf6e0d4f-c107-49a4-91b9-2744ca2d9102 tempest-GroupsV314Test-504357875 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c9843ec6-095a-4da3-9723-813ab3aef973(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88899) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 03 08:39:33 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e4d2c4b-64d4-4724-9ddb-d170677cf1f6]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:39:33 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-bf6e0d4f-c107-49a4-91b9-2744ca2d9102 tempest-GroupsV314Test-504357875 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c9843ec6-095a-4da3-9723-813ab3aef973 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:39:33 devstack sudo[101494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c9843ec6-095a-4da3-9723-813ab3aef973 Aug 03 08:39:33 devstack sudo[101494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:39:33 devstack sudo[101494]: pam_unix(sudo:session): session closed for user root Aug 03 08:39:33 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-bf6e0d4f-c107-49a4-91b9-2744ca2d9102 tempest-GroupsV314Test-504357875 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c9843ec6-095a-4da3-9723-813ab3aef973" returned: 0 in 0.412s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:39:33 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-bf6e0d4f-c107-49a4-91b9-2744ca2d9102 tempest-GroupsV314Test-504357875 None] will copy from snapshot at /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c9843ec6-095a-4da3-9723-813ab3aef973 {{(pid=88899) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Aug 03 08:39:33 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-bf6e0d4f-c107-49a4-91b9-2744ca2d9102 tempest-GroupsV314Test-504357875 None] Creating direct copy from snapshot {{(pid=88899) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Aug 03 08:39:33 devstack cinder-volume[88899]: DEBUG cinder.utils [None req-bf6e0d4f-c107-49a4-91b9-2744ca2d9102 tempest-GroupsV314Test-504357875 None] Path /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-5ff85ce2-839c-43c6-85ff-d1cd5747c916 not found in is_blk_device check {{(pid=88899) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Aug 03 08:39:33 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-bf6e0d4f-c107-49a4-91b9-2744ca2d9102 tempest-GroupsV314Test-504357875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c9843ec6-095a-4da3-9723-813ab3aef973 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-5ff85ce2-839c-43c6-85ff-d1cd5747c916 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:39:33 devstack sudo[101499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c9843ec6-095a-4da3-9723-813ab3aef973 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-5ff85ce2-839c-43c6-85ff-d1cd5747c916 Aug 03 08:39:33 devstack sudo[101499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:39:38 devstack sudo[101499]: pam_unix(sudo:session): session closed for user root Aug 03 08:39:38 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-bf6e0d4f-c107-49a4-91b9-2744ca2d9102 tempest-GroupsV314Test-504357875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c9843ec6-095a-4da3-9723-813ab3aef973 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-5ff85ce2-839c-43c6-85ff-d1cd5747c916" returned: 0 in 5.229s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:39:38 devstack cinder-volume[88899]: DEBUG cinder.image.image_utils [None req-bf6e0d4f-c107-49a4-91b9-2744ca2d9102 tempest-GroupsV314Test-504357875 None] Image conversion details: src /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c9843ec6-095a-4da3-9723-813ab3aef973, size 1024.00 MB, duration 5.23 sec, destination /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-5ff85ce2-839c-43c6-85ff-d1cd5747c916 {{(pid=88899) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 03 08:39:38 devstack cinder-volume[88899]: INFO cinder.image.image_utils [None req-bf6e0d4f-c107-49a4-91b9-2744ca2d9102 tempest-GroupsV314Test-504357875 None] Converted 1024.00 MB image at 195.78 MB/s Aug 03 08:39:38 devstack cinder-volume[88899]: WARNING cinder.volume.drivers.remotefs [None req-bf6e0d4f-c107-49a4-91b9-2744ca2d9102 tempest-GroupsV314Test-504357875 None] /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-5ff85ce2-839c-43c6-85ff-d1cd5747c916 is being set with open permissions: ugo+rw: NotImplementedError Aug 03 08:39:38 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-bf6e0d4f-c107-49a4-91b9-2744ca2d9102 tempest-GroupsV314Test-504357875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-5ff85ce2-839c-43c6-85ff-d1cd5747c916 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:39:38 devstack sudo[101513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-5ff85ce2-839c-43c6-85ff-d1cd5747c916 Aug 03 08:39:38 devstack sudo[101513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:39:39 devstack sudo[101513]: pam_unix(sudo:session): session closed for user root Aug 03 08:39:39 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-bf6e0d4f-c107-49a4-91b9-2744ca2d9102 tempest-GroupsV314Test-504357875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-5ff85ce2-839c-43c6-85ff-d1cd5747c916" returned: 0 in 0.289s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:39:39 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-bf6e0d4f-c107-49a4-91b9-2744ca2d9102 tempest-GroupsV314Test-504357875 None] Lock "cinder-quobyte-5ff85ce2-839c-43c6-85ff-d1cd5747c916" released by "_copy_volume_from_snapshot" :: held 6.391s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:39:39 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-bf6e0d4f-c107-49a4-91b9-2744ca2d9102 tempest-GroupsV314Test-504357875 None] Acquiring lock "cinder-quobyte-66fbbf48-52aa-4aee-8631-4d96037d7fa2" by "_delete_snapshot" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:39:39 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-bf6e0d4f-c107-49a4-91b9-2744ca2d9102 tempest-GroupsV314Test-504357875 None] Lock "cinder-quobyte-66fbbf48-52aa-4aee-8631-4d96037d7fa2" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:39:39 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-bf6e0d4f-c107-49a4-91b9-2744ca2d9102 tempest-GroupsV314Test-504357875 None] Deleting offline snapshot 66fbbf48-52aa-4aee-8631-4d96037d7fa2 of volume c9843ec6-095a-4da3-9723-813ab3aef973 {{(pid=88899) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 03 08:39:39 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-bf6e0d4f-c107-49a4-91b9-2744ca2d9102 tempest-GroupsV314Test-504357875 None] snapshot_file for this snap is: volume-c9843ec6-095a-4da3-9723-813ab3aef973.66fbbf48-52aa-4aee-8631-4d96037d7fa2 {{(pid=88899) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 03 08:39:39 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd523e2e-691f-42cb-be64-f97c248bcaf4]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:39:39 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-bf6e0d4f-c107-49a4-91b9-2744ca2d9102 tempest-GroupsV314Test-504357875 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c9843ec6-095a-4da3-9723-813ab3aef973.66fbbf48-52aa-4aee-8631-4d96037d7fa2 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:39:39 devstack sudo[101516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c9843ec6-095a-4da3-9723-813ab3aef973.66fbbf48-52aa-4aee-8631-4d96037d7fa2 Aug 03 08:39:39 devstack sudo[101516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:39:39 devstack sudo[101516]: pam_unix(sudo:session): session closed for user root Aug 03 08:39:39 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-bf6e0d4f-c107-49a4-91b9-2744ca2d9102 tempest-GroupsV314Test-504357875 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c9843ec6-095a-4da3-9723-813ab3aef973.66fbbf48-52aa-4aee-8631-4d96037d7fa2" returned: 0 in 0.456s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:39:39 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-bf6e0d4f-c107-49a4-91b9-2744ca2d9102 tempest-GroupsV314Test-504357875 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c9843ec6-095a-4da3-9723-813ab3aef973(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88899) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 03 08:39:39 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[6984c471-a58f-422f-8e20-f98cde00f721]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:39:39 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-bf6e0d4f-c107-49a4-91b9-2744ca2d9102 tempest-GroupsV314Test-504357875 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c9843ec6-095a-4da3-9723-813ab3aef973 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:39:39 devstack sudo[101521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c9843ec6-095a-4da3-9723-813ab3aef973 Aug 03 08:39:39 devstack sudo[101521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:39:40 devstack sudo[101521]: pam_unix(sudo:session): session closed for user root Aug 03 08:39:40 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-bf6e0d4f-c107-49a4-91b9-2744ca2d9102 tempest-GroupsV314Test-504357875 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c9843ec6-095a-4da3-9723-813ab3aef973" returned: 0 in 0.727s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:39:40 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-bf6e0d4f-c107-49a4-91b9-2744ca2d9102 tempest-GroupsV314Test-504357875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c9843ec6-095a-4da3-9723-813ab3aef973.66fbbf48-52aa-4aee-8631-4d96037d7fa2 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:39:40 devstack sudo[101526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c9843ec6-095a-4da3-9723-813ab3aef973.66fbbf48-52aa-4aee-8631-4d96037d7fa2 Aug 03 08:39:40 devstack sudo[101526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:39:40 devstack sudo[101526]: pam_unix(sudo:session): session closed for user root Aug 03 08:39:40 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-bf6e0d4f-c107-49a4-91b9-2744ca2d9102 tempest-GroupsV314Test-504357875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c9843ec6-095a-4da3-9723-813ab3aef973.66fbbf48-52aa-4aee-8631-4d96037d7fa2" returned: 0 in 0.400s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:39:40 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-bf6e0d4f-c107-49a4-91b9-2744ca2d9102 tempest-GroupsV314Test-504357875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c9843ec6-095a-4da3-9723-813ab3aef973.66fbbf48-52aa-4aee-8631-4d96037d7fa2 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:39:40 devstack sudo[101531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c9843ec6-095a-4da3-9723-813ab3aef973.66fbbf48-52aa-4aee-8631-4d96037d7fa2 Aug 03 08:39:40 devstack sudo[101531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:39:41 devstack sudo[101531]: pam_unix(sudo:session): session closed for user root Aug 03 08:39:41 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-bf6e0d4f-c107-49a4-91b9-2744ca2d9102 tempest-GroupsV314Test-504357875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c9843ec6-095a-4da3-9723-813ab3aef973.66fbbf48-52aa-4aee-8631-4d96037d7fa2" returned: 0 in 0.305s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:39:41 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-bf6e0d4f-c107-49a4-91b9-2744ca2d9102 tempest-GroupsV314Test-504357875 None] Lock "cinder-quobyte-66fbbf48-52aa-4aee-8631-4d96037d7fa2" released by "_delete_snapshot" :: held 2.001s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:39:41 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-bf6e0d4f-c107-49a4-91b9-2744ca2d9102 tempest-GroupsV314Test-504357875 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 10.954s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:39:41 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-b19127ab-783a-4eb5-a6b3-7ff5781a647d tempest-VolumesExtendTest-896546243 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.459s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:39:41 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-b19127ab-783a-4eb5-a6b3-7ff5781a647d tempest-VolumesExtendTest-896546243 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:39:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-338070560',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=589fa109-7818-430b-8b8c-fbaf705653b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='31966c7036e344cf8eabf444e342118a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:39:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:39:31Z,use_quota=True,user_id='6c5bc611eed84a0faea6d55f4bca6053',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8bde7129-1dc4-42ab-b852-ab32c61b4921),volume_type_id=8bde7129-1dc4-42ab-b852-ab32c61b4921)}" {{(pid=88899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 08:39:41 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-b19127ab-783a-4eb5-a6b3-7ff5781a647d tempest-VolumesExtendTest-896546243 None] Creating volume 589fa109-7818-430b-8b8c-fbaf705653b7 {{(pid=88899) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 08:39:41 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-b19127ab-783a-4eb5-a6b3-7ff5781a647d tempest-VolumesExtendTest-896546243 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:39:41 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-b19127ab-783a-4eb5-a6b3-7ff5781a647d tempest-VolumesExtendTest-896546243 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:39:41 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-b19127ab-783a-4eb5-a6b3-7ff5781a647d tempest-VolumesExtendTest-896546243 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:39:41 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-b19127ab-783a-4eb5-a6b3-7ff5781a647d tempest-VolumesExtendTest-896546243 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:39:41 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-b19127ab-783a-4eb5-a6b3-7ff5781a647d tempest-VolumesExtendTest-896546243 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:39:41 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-b19127ab-783a-4eb5-a6b3-7ff5781a647d tempest-VolumesExtendTest-896546243 None] Selected osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385 as target Quobyte volume. {{(pid=88899) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 08:39:41 devstack cinder-volume[88899]: INFO cinder.volume.drivers.remotefs [None req-b19127ab-783a-4eb5-a6b3-7ff5781a647d tempest-VolumesExtendTest-896546243 None] casted to osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385 Aug 03 08:39:41 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-b19127ab-783a-4eb5-a6b3-7ff5781a647d tempest-VolumesExtendTest-896546243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-589fa109-7818-430b-8b8c-fbaf705653b7 1073741824 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:39:41 devstack sudo[101534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-589fa109-7818-430b-8b8c-fbaf705653b7 1073741824 Aug 03 08:39:41 devstack sudo[101534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:39:41 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-bf6e0d4f-c107-49a4-91b9-2744ca2d9102 tempest-GroupsV314Test-504357875 None] Create group from source-group-85d3dac3-7a55-43a3-a524-ec1dd1712068 completed successfully. Aug 03 08:39:41 devstack sudo[101534]: pam_unix(sudo:session): session closed for user root Aug 03 08:39:41 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-b19127ab-783a-4eb5-a6b3-7ff5781a647d tempest-VolumesExtendTest-896546243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-589fa109-7818-430b-8b8c-fbaf705653b7 1073741824" returned: 0 in 0.518s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:39:41 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-b19127ab-783a-4eb5-a6b3-7ff5781a647d tempest-VolumesExtendTest-896546243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-589fa109-7818-430b-8b8c-fbaf705653b7 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:39:41 devstack sudo[101540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-589fa109-7818-430b-8b8c-fbaf705653b7 Aug 03 08:39:41 devstack sudo[101540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:39:42 devstack sudo[101540]: pam_unix(sudo:session): session closed for user root Aug 03 08:39:42 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-b19127ab-783a-4eb5-a6b3-7ff5781a647d tempest-VolumesExtendTest-896546243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-589fa109-7818-430b-8b8c-fbaf705653b7" returned: 0 in 0.285s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:39:42 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-b19127ab-783a-4eb5-a6b3-7ff5781a647d tempest-VolumesExtendTest-896546243 None] <== create_volume: return (874ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'} {{(pid=88899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 08:39:42 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-b19127ab-783a-4eb5-a6b3-7ff5781a647d tempest-VolumesExtendTest-896546243 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.877s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:39:42 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-64a2a063-43f2-4640-b96b-2ecf3abba198 tempest-SnapshotDataIntegrityTests-1494076589 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.419s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:39:42 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-64a2a063-43f2-4640-b96b-2ecf3abba198 tempest-SnapshotDataIntegrityTests-1494076589 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:39:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDataIntegrityTests-volume-938922108',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6bafdd19-6d59-4557-a0e3-17d1fbfc1053,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7bfeec51147d4d6fb726c3d53fa691a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:39:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:39:32Z,use_quota=True,user_id='154fb6e7d02d4632a2d4958c8859e9a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8bde7129-1dc4-42ab-b852-ab32c61b4921),volume_type_id=8bde7129-1dc4-42ab-b852-ab32c61b4921)}" {{(pid=88899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 08:39:42 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-64a2a063-43f2-4640-b96b-2ecf3abba198 tempest-SnapshotDataIntegrityTests-1494076589 None] Creating volume 6bafdd19-6d59-4557-a0e3-17d1fbfc1053 {{(pid=88899) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 08:39:42 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-64a2a063-43f2-4640-b96b-2ecf3abba198 tempest-SnapshotDataIntegrityTests-1494076589 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:39:42 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-64a2a063-43f2-4640-b96b-2ecf3abba198 tempest-SnapshotDataIntegrityTests-1494076589 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:39:42 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-64a2a063-43f2-4640-b96b-2ecf3abba198 tempest-SnapshotDataIntegrityTests-1494076589 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:39:42 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-64a2a063-43f2-4640-b96b-2ecf3abba198 tempest-SnapshotDataIntegrityTests-1494076589 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:39:42 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-64a2a063-43f2-4640-b96b-2ecf3abba198 tempest-SnapshotDataIntegrityTests-1494076589 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:39:42 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-64a2a063-43f2-4640-b96b-2ecf3abba198 tempest-SnapshotDataIntegrityTests-1494076589 None] Selected osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385 as target Quobyte volume. {{(pid=88899) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 08:39:42 devstack cinder-volume[88899]: INFO cinder.volume.drivers.remotefs [None req-64a2a063-43f2-4640-b96b-2ecf3abba198 tempest-SnapshotDataIntegrityTests-1494076589 None] casted to osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385 Aug 03 08:39:42 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-64a2a063-43f2-4640-b96b-2ecf3abba198 tempest-SnapshotDataIntegrityTests-1494076589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-6bafdd19-6d59-4557-a0e3-17d1fbfc1053 1073741824 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:39:42 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-b19127ab-783a-4eb5-a6b3-7ff5781a647d tempest-VolumesExtendTest-896546243 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae22091f-d563-4a64-a614-861704c88b65) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-589fa109-7818-430b-8b8c-fbaf705653b7', 'volume_size': 1}' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:39:42 devstack sudo[101543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-6bafdd19-6d59-4557-a0e3-17d1fbfc1053 1073741824 Aug 03 08:39:42 devstack sudo[101543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:39:42 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-b19127ab-783a-4eb5-a6b3-7ff5781a647d tempest-VolumesExtendTest-896546243 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5566d099-cc0c-434a-b502-0a53d2b36dbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:39:42 devstack cinder-volume[88899]: INFO cinder.volume.flows.manager.create_volume [None req-b19127ab-783a-4eb5-a6b3-7ff5781a647d tempest-VolumesExtendTest-896546243 None] Volume volume-589fa109-7818-430b-8b8c-fbaf705653b7 (589fa109-7818-430b-8b8c-fbaf705653b7): created successfully Aug 03 08:39:42 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-b19127ab-783a-4eb5-a6b3-7ff5781a647d tempest-VolumesExtendTest-896546243 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5566d099-cc0c-434a-b502-0a53d2b36dbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:39:42 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-b19127ab-783a-4eb5-a6b3-7ff5781a647d tempest-VolumesExtendTest-896546243 None] Flow 'volume_create_manager' (24eb4a79-54b7-4eef-8bfe-82f8b407d2ab) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:39:42 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-b19127ab-783a-4eb5-a6b3-7ff5781a647d tempest-VolumesExtendTest-896546243 None] Created volume successfully. Aug 03 08:39:42 devstack sudo[101543]: pam_unix(sudo:session): session closed for user root Aug 03 08:39:42 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-64a2a063-43f2-4640-b96b-2ecf3abba198 tempest-SnapshotDataIntegrityTests-1494076589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-6bafdd19-6d59-4557-a0e3-17d1fbfc1053 1073741824" returned: 0 in 0.518s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:39:42 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-64a2a063-43f2-4640-b96b-2ecf3abba198 tempest-SnapshotDataIntegrityTests-1494076589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-6bafdd19-6d59-4557-a0e3-17d1fbfc1053 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:39:42 devstack sudo[101549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-6bafdd19-6d59-4557-a0e3-17d1fbfc1053 Aug 03 08:39:42 devstack sudo[101549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:39:43 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-e1051cbc-f0da-480a-882e-483a184398dc tempest-GroupsV314Test-504357875 None] Acquiring lock "cinder-quobyte-5ff85ce2-839c-43c6-85ff-d1cd5747c916" by "delete_volume" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:39:43 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-e1051cbc-f0da-480a-882e-483a184398dc tempest-GroupsV314Test-504357875 None] Lock "cinder-quobyte-5ff85ce2-839c-43c6-85ff-d1cd5747c916" acquired by "delete_volume" :: waited 0.040s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:39:43 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[e05d8939-dab0-45ca-9c24-3206a30c2d1a]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:39:43 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-e1051cbc-f0da-480a-882e-483a184398dc tempest-GroupsV314Test-504357875 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-5ff85ce2-839c-43c6-85ff-d1cd5747c916 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:39:43 devstack sudo[101549]: pam_unix(sudo:session): session closed for user root Aug 03 08:39:43 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-64a2a063-43f2-4640-b96b-2ecf3abba198 tempest-SnapshotDataIntegrityTests-1494076589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-6bafdd19-6d59-4557-a0e3-17d1fbfc1053" returned: 0 in 0.547s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:39:43 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-64a2a063-43f2-4640-b96b-2ecf3abba198 tempest-SnapshotDataIntegrityTests-1494076589 None] <== create_volume: return (1122ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'} {{(pid=88899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 08:39:43 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-64a2a063-43f2-4640-b96b-2ecf3abba198 tempest-SnapshotDataIntegrityTests-1494076589 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.127s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:39:43 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-5c19993e-6957-45f6-b4be-1815b69bafb7 tempest-VolumesExtendTest-896546243 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:39:43 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-5c19993e-6957-45f6-b4be-1815b69bafb7 tempest-VolumesExtendTest-896546243 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:39:43 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-64a2a063-43f2-4640-b96b-2ecf3abba198 tempest-SnapshotDataIntegrityTests-1494076589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c9f28fca-7674-46ee-8607-a6aa0282336b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6bafdd19-6d59-4557-a0e3-17d1fbfc1053', 'volume_size': 1}' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:39:43 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-64a2a063-43f2-4640-b96b-2ecf3abba198 tempest-SnapshotDataIntegrityTests-1494076589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (736da81f-0ecd-438b-a908-6d5907fe12a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:39:43 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-5c19993e-6957-45f6-b4be-1815b69bafb7 tempest-VolumesExtendTest-896546243 None] Creating offline snapshot 4a88c139-3477-489c-826d-4daa3006a0fe of volume 589fa109-7818-430b-8b8c-fbaf705653b7 {{(pid=88899) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 03 08:39:43 devstack sudo[101551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-5ff85ce2-839c-43c6-85ff-d1cd5747c916 Aug 03 08:39:43 devstack sudo[101551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:39:43 devstack cinder-volume[88899]: INFO cinder.volume.flows.manager.create_volume [None req-64a2a063-43f2-4640-b96b-2ecf3abba198 tempest-SnapshotDataIntegrityTests-1494076589 None] Volume volume-6bafdd19-6d59-4557-a0e3-17d1fbfc1053 (6bafdd19-6d59-4557-a0e3-17d1fbfc1053): created successfully Aug 03 08:39:43 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-64a2a063-43f2-4640-b96b-2ecf3abba198 tempest-SnapshotDataIntegrityTests-1494076589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (736da81f-0ecd-438b-a908-6d5907fe12a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:39:43 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-64a2a063-43f2-4640-b96b-2ecf3abba198 tempest-SnapshotDataIntegrityTests-1494076589 None] Flow 'volume_create_manager' (ece0dc0c-3bc5-4cdb-b6b4-7023566b3c91) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:39:43 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[61a19ae6-d26e-474e-8d5f-8de3af00aae6]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:39:43 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-5c19993e-6957-45f6-b4be-1815b69bafb7 tempest-VolumesExtendTest-896546243 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-589fa109-7818-430b-8b8c-fbaf705653b7 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:39:43 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-64a2a063-43f2-4640-b96b-2ecf3abba198 tempest-SnapshotDataIntegrityTests-1494076589 None] Created volume successfully. Aug 03 08:39:43 devstack sudo[101554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-589fa109-7818-430b-8b8c-fbaf705653b7 Aug 03 08:39:43 devstack sudo[101554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:39:43 devstack sudo[101551]: pam_unix(sudo:session): session closed for user root Aug 03 08:39:43 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-e1051cbc-f0da-480a-882e-483a184398dc tempest-GroupsV314Test-504357875 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-5ff85ce2-839c-43c6-85ff-d1cd5747c916" returned: 0 in 0.495s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:39:43 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-e1051cbc-f0da-480a-882e-483a184398dc tempest-GroupsV314Test-504357875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-5ff85ce2-839c-43c6-85ff-d1cd5747c916 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:39:43 devstack sudo[101559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-5ff85ce2-839c-43c6-85ff-d1cd5747c916 Aug 03 08:39:43 devstack sudo[101559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:39:43 devstack sudo[101554]: pam_unix(sudo:session): session closed for user root Aug 03 08:39:43 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-5c19993e-6957-45f6-b4be-1815b69bafb7 tempest-VolumesExtendTest-896546243 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-589fa109-7818-430b-8b8c-fbaf705653b7" returned: 0 in 0.496s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:39:43 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-5c19993e-6957-45f6-b4be-1815b69bafb7 tempest-VolumesExtendTest-896546243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-589fa109-7818-430b-8b8c-fbaf705653b7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-589fa109-7818-430b-8b8c-fbaf705653b7.4a88c139-3477-489c-826d-4daa3006a0fe 1G {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:39:43 devstack sudo[101564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-589fa109-7818-430b-8b8c-fbaf705653b7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-589fa109-7818-430b-8b8c-fbaf705653b7.4a88c139-3477-489c-826d-4daa3006a0fe 1G Aug 03 08:39:43 devstack sudo[101564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:39:44 devstack sudo[101559]: pam_unix(sudo:session): session closed for user root Aug 03 08:39:44 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-e1051cbc-f0da-480a-882e-483a184398dc tempest-GroupsV314Test-504357875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-5ff85ce2-839c-43c6-85ff-d1cd5747c916" returned: 0 in 0.358s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:39:44 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-e1051cbc-f0da-480a-882e-483a184398dc tempest-GroupsV314Test-504357875 None] Lock "cinder-quobyte-5ff85ce2-839c-43c6-85ff-d1cd5747c916" released by "delete_volume" :: held 0.992s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:39:44 devstack cinder-volume[88899]: DEBUG cinder.quota [None req-e1051cbc-f0da-480a-882e-483a184398dc tempest-GroupsV314Test-504357875 None] Created reservations ['200fdf04-482b-4979-ae51-519d39e824ff'] {{(pid=88899) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 08:39:44 devstack cinder-volume[88899]: WARNING cinder.quota [None req-e1051cbc-f0da-480a-882e-483a184398dc tempest-GroupsV314Test-504357875 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-500568086 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-500568086, it is now deprecated. Please use the default quota class for default quota. Aug 03 08:39:44 devstack cinder-volume[88899]: WARNING cinder.quota [None req-e1051cbc-f0da-480a-882e-483a184398dc tempest-GroupsV314Test-504357875 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-500568086 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-500568086, it is now deprecated. Please use the default quota class for default quota. Aug 03 08:39:44 devstack cinder-volume[88899]: DEBUG cinder.quota [None req-e1051cbc-f0da-480a-882e-483a184398dc tempest-GroupsV314Test-504357875 None] Created reservations ['0dfc99dd-bbab-401b-b45d-a4546fdc0569', 'dd205673-8f86-472b-ae73-8557a233c1fc', '8b7c38ec-4197-4137-a806-d1ff663353a3', 'f76e5f9a-b492-4fb0-b937-730a655c2368'] {{(pid=88899) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 08:39:44 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-e1051cbc-f0da-480a-882e-483a184398dc tempest-GroupsV314Test-504357875 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:39:44 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-e1051cbc-f0da-480a-882e-483a184398dc tempest-GroupsV314Test-504357875 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:39:44 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-e1051cbc-f0da-480a-882e-483a184398dc tempest-GroupsV314Test-504357875 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:39:44 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-e1051cbc-f0da-480a-882e-483a184398dc tempest-GroupsV314Test-504357875 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:39:44 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-e1051cbc-f0da-480a-882e-483a184398dc tempest-GroupsV314Test-504357875 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:39:44 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-e1051cbc-f0da-480a-882e-483a184398dc tempest-GroupsV314Test-504357875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:39:44 devstack sudo[101564]: pam_unix(sudo:session): session closed for user root Aug 03 08:39:44 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-5c19993e-6957-45f6-b4be-1815b69bafb7 tempest-VolumesExtendTest-896546243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-589fa109-7818-430b-8b8c-fbaf705653b7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-589fa109-7818-430b-8b8c-fbaf705653b7.4a88c139-3477-489c-826d-4daa3006a0fe 1G" returned: 0 in 0.526s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:39:44 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-5c19993e-6957-45f6-b4be-1815b69bafb7 tempest-VolumesExtendTest-896546243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-589fa109-7818-430b-8b8c-fbaf705653b7 -F qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-589fa109-7818-430b-8b8c-fbaf705653b7.4a88c139-3477-489c-826d-4daa3006a0fe {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:39:44 devstack sudo[101572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a Aug 03 08:39:44 devstack sudo[101572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:39:44 devstack sudo[101573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-589fa109-7818-430b-8b8c-fbaf705653b7 -F qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-589fa109-7818-430b-8b8c-fbaf705653b7.4a88c139-3477-489c-826d-4daa3006a0fe Aug 03 08:39:44 devstack sudo[101573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:39:44 devstack sudo[101572]: pam_unix(sudo:session): session closed for user root Aug 03 08:39:44 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-e1051cbc-f0da-480a-882e-483a184398dc tempest-GroupsV314Test-504357875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a" returned: 0 in 0.317s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:39:44 devstack cinder-volume[88899]: DEBUG cinder.manager [None req-e1051cbc-f0da-480a-882e-483a184398dc tempest-GroupsV314Test-504357875 None] Notifying Schedulers of capabilities ... {{(pid=88899) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 08:39:44 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-e1051cbc-f0da-480a-882e-483a184398dc tempest-GroupsV314Test-504357875 None] Delete group completed successfully. Aug 03 08:39:44 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-5e71580a-abef-4a3a-9a27-2999ac776c63 tempest-GroupsV314Test-504357875 None] Acquiring lock "cinder-quobyte-c9843ec6-095a-4da3-9723-813ab3aef973" by "delete_volume" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:39:44 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-5e71580a-abef-4a3a-9a27-2999ac776c63 tempest-GroupsV314Test-504357875 None] Lock "cinder-quobyte-c9843ec6-095a-4da3-9723-813ab3aef973" acquired by "delete_volume" :: waited 0.032s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:39:44 devstack sudo[101573]: pam_unix(sudo:session): session closed for user root Aug 03 08:39:44 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-5c19993e-6957-45f6-b4be-1815b69bafb7 tempest-VolumesExtendTest-896546243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-589fa109-7818-430b-8b8c-fbaf705653b7 -F qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-589fa109-7818-430b-8b8c-fbaf705653b7.4a88c139-3477-489c-826d-4daa3006a0fe" returned: 0 in 0.501s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:39:44 devstack cinder-volume[88899]: WARNING cinder.volume.drivers.remotefs [None req-5c19993e-6957-45f6-b4be-1815b69bafb7 tempest-VolumesExtendTest-896546243 None] /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-589fa109-7818-430b-8b8c-fbaf705653b7.4a88c139-3477-489c-826d-4daa3006a0fe is being set with open permissions: ugo+rw Aug 03 08:39:44 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-5c19993e-6957-45f6-b4be-1815b69bafb7 tempest-VolumesExtendTest-896546243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-589fa109-7818-430b-8b8c-fbaf705653b7.4a88c139-3477-489c-826d-4daa3006a0fe {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:39:44 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[023b37d5-5c3a-46b1-98e8-d945986ba430]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:39:44 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-5e71580a-abef-4a3a-9a27-2999ac776c63 tempest-GroupsV314Test-504357875 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c9843ec6-095a-4da3-9723-813ab3aef973 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:39:44 devstack sudo[101585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-589fa109-7818-430b-8b8c-fbaf705653b7.4a88c139-3477-489c-826d-4daa3006a0fe Aug 03 08:39:44 devstack sudo[101585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:39:45 devstack sudo[101586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c9843ec6-095a-4da3-9723-813ab3aef973 Aug 03 08:39:45 devstack sudo[101586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:39:45 devstack sudo[101585]: pam_unix(sudo:session): session closed for user root Aug 03 08:39:45 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-5c19993e-6957-45f6-b4be-1815b69bafb7 tempest-VolumesExtendTest-896546243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-589fa109-7818-430b-8b8c-fbaf705653b7.4a88c139-3477-489c-826d-4daa3006a0fe" returned: 0 in 0.325s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:39:45 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-5c19993e-6957-45f6-b4be-1815b69bafb7 tempest-VolumesExtendTest-896546243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-589fa109-7818-430b-8b8c-fbaf705653b7.info {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:39:45 devstack sudo[101592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-589fa109-7818-430b-8b8c-fbaf705653b7.info Aug 03 08:39:45 devstack sudo[101592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:39:45 devstack sudo[101586]: pam_unix(sudo:session): session closed for user root Aug 03 08:39:45 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-5e71580a-abef-4a3a-9a27-2999ac776c63 tempest-GroupsV314Test-504357875 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c9843ec6-095a-4da3-9723-813ab3aef973" returned: 0 in 0.448s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:39:45 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-5e71580a-abef-4a3a-9a27-2999ac776c63 tempest-GroupsV314Test-504357875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c9843ec6-095a-4da3-9723-813ab3aef973 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:39:45 devstack sudo[101595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c9843ec6-095a-4da3-9723-813ab3aef973 Aug 03 08:39:45 devstack sudo[101595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:39:45 devstack sudo[101592]: pam_unix(sudo:session): session closed for user root Aug 03 08:39:45 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-5c19993e-6957-45f6-b4be-1815b69bafb7 tempest-VolumesExtendTest-896546243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-589fa109-7818-430b-8b8c-fbaf705653b7.info" returned: 0 in 0.343s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:39:45 devstack cinder-volume[88899]: WARNING cinder.volume.drivers.remotefs [None req-5c19993e-6957-45f6-b4be-1815b69bafb7 tempest-VolumesExtendTest-896546243 None] /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-589fa109-7818-430b-8b8c-fbaf705653b7.info is being set with open permissions: ugo+rw Aug 03 08:39:45 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-5c19993e-6957-45f6-b4be-1815b69bafb7 tempest-VolumesExtendTest-896546243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-589fa109-7818-430b-8b8c-fbaf705653b7.info {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:39:45 devstack sudo[101598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-589fa109-7818-430b-8b8c-fbaf705653b7.info Aug 03 08:39:45 devstack sudo[101598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:39:45 devstack sudo[101595]: pam_unix(sudo:session): session closed for user root Aug 03 08:39:45 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-5e71580a-abef-4a3a-9a27-2999ac776c63 tempest-GroupsV314Test-504357875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c9843ec6-095a-4da3-9723-813ab3aef973" returned: 0 in 0.412s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:39:45 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-5e71580a-abef-4a3a-9a27-2999ac776c63 tempest-GroupsV314Test-504357875 None] Lock "cinder-quobyte-c9843ec6-095a-4da3-9723-813ab3aef973" released by "delete_volume" :: held 0.988s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:39:45 devstack cinder-volume[88899]: DEBUG cinder.quota [None req-5e71580a-abef-4a3a-9a27-2999ac776c63 tempest-GroupsV314Test-504357875 None] Created reservations ['c3cb0867-9fda-4615-bec7-b58fcd4401f4'] {{(pid=88899) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 08:39:46 devstack cinder-volume[88899]: DEBUG cinder.quota [None req-5e71580a-abef-4a3a-9a27-2999ac776c63 tempest-GroupsV314Test-504357875 None] Created reservations ['ff1adfc7-9a7b-40f0-99c6-be30d5f25627', '6f4a5aa8-c924-4aac-a1fe-538cfa3fb321', '97b53c04-2202-4ba9-b8ab-f8a17c0e0e53', 'd7b6062e-4098-4eae-9cf2-ea7886e3c147'] {{(pid=88899) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 08:39:46 devstack sudo[101598]: pam_unix(sudo:session): session closed for user root Aug 03 08:39:46 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-5c19993e-6957-45f6-b4be-1815b69bafb7 tempest-VolumesExtendTest-896546243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-589fa109-7818-430b-8b8c-fbaf705653b7.info" returned: 0 in 0.463s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:39:46 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-5c19993e-6957-45f6-b4be-1815b69bafb7 tempest-VolumesExtendTest-896546243 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.792s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:39:46 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [req-a8ee1baf-4956-44b6-a41f-96100aca103d req-ffd04025-b697-4a11-9725-a8df300ad9e6 tempest-SnapshotDataIntegrityTests-1494076589 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:39:46 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [req-a8ee1baf-4956-44b6-a41f-96100aca103d req-ffd04025-b697-4a11-9725-a8df300ad9e6 tempest-SnapshotDataIntegrityTests-1494076589 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:39:46 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-5c19993e-6957-45f6-b4be-1815b69bafb7 tempest-VolumesExtendTest-896546243 None] Create snapshot completed successfully Aug 03 08:39:46 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [req-a8ee1baf-4956-44b6-a41f-96100aca103d req-ffd04025-b697-4a11-9725-a8df300ad9e6 tempest-SnapshotDataIntegrityTests-1494076589 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.026s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:39:46 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-5e71580a-abef-4a3a-9a27-2999ac776c63 tempest-GroupsV314Test-504357875 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:39:46 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-5e71580a-abef-4a3a-9a27-2999ac776c63 tempest-GroupsV314Test-504357875 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:39:46 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-5e71580a-abef-4a3a-9a27-2999ac776c63 tempest-GroupsV314Test-504357875 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:39:46 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-5e71580a-abef-4a3a-9a27-2999ac776c63 tempest-GroupsV314Test-504357875 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:39:46 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-5e71580a-abef-4a3a-9a27-2999ac776c63 tempest-GroupsV314Test-504357875 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:39:46 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-5e71580a-abef-4a3a-9a27-2999ac776c63 tempest-GroupsV314Test-504357875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:39:46 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [req-a8ee1baf-4956-44b6-a41f-96100aca103d req-ffd04025-b697-4a11-9725-a8df300ad9e6 tempest-SnapshotDataIntegrityTests-1494076589 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385', 'name': 'volume-6bafdd19-6d59-4557-a0e3-17d1fbfc1053', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b5f7755c-735f-4d4a-aa6f-a0098b2eff12', 'enforce_multipath': True} {{(pid=88899) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 03 08:39:46 devstack sudo[101610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a Aug 03 08:39:46 devstack sudo[101610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:39:46 devstack cinder-volume[88899]: INFO cinder.volume.manager [req-a8ee1baf-4956-44b6-a41f-96100aca103d req-ffd04025-b697-4a11-9725-a8df300ad9e6 tempest-SnapshotDataIntegrityTests-1494076589 None] attachment_update completed successfully. Aug 03 08:39:46 devstack sudo[101610]: pam_unix(sudo:session): session closed for user root Aug 03 08:39:46 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-5ddb96b4-f186-4f3c-90f9-f204cdf82fd9 tempest-VolumesExtendTest-896546243 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:39:46 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-5ddb96b4-f186-4f3c-90f9-f204cdf82fd9 tempest-VolumesExtendTest-896546243 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:39:46 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-5e71580a-abef-4a3a-9a27-2999ac776c63 tempest-GroupsV314Test-504357875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a" returned: 0 in 0.381s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:39:46 devstack cinder-volume[88899]: DEBUG cinder.manager [None req-5e71580a-abef-4a3a-9a27-2999ac776c63 tempest-GroupsV314Test-504357875 None] Notifying Schedulers of capabilities ... {{(pid=88899) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 08:39:46 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-5e71580a-abef-4a3a-9a27-2999ac776c63 tempest-GroupsV314Test-504357875 None] Delete group completed successfully. Aug 03 08:39:46 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2f6d414-7808-499e-8713-4d4fe3337c3c]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:39:46 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-5ddb96b4-f186-4f3c-90f9-f204cdf82fd9 tempest-VolumesExtendTest-896546243 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-589fa109-7818-430b-8b8c-fbaf705653b7 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:39:46 devstack sudo[101678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-589fa109-7818-430b-8b8c-fbaf705653b7 Aug 03 08:39:46 devstack sudo[101678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:39:47 devstack sudo[101678]: pam_unix(sudo:session): session closed for user root Aug 03 08:39:47 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-5ddb96b4-f186-4f3c-90f9-f204cdf82fd9 tempest-VolumesExtendTest-896546243 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-589fa109-7818-430b-8b8c-fbaf705653b7" returned: 0 in 0.482s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:39:47 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-5ddb96b4-f186-4f3c-90f9-f204cdf82fd9 tempest-VolumesExtendTest-896546243 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-589fa109-7818-430b-8b8c-fbaf705653b7.4a88c139-3477-489c-826d-4daa3006a0fe 2G {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:39:47 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-5ddb96b4-f186-4f3c-90f9-f204cdf82fd9 tempest-VolumesExtendTest-896546243 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-589fa109-7818-430b-8b8c-fbaf705653b7.4a88c139-3477-489c-826d-4daa3006a0fe 2G" returned: 0 in 0.228s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:39:47 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-5ddb96b4-f186-4f3c-90f9-f204cdf82fd9 tempest-VolumesExtendTest-896546243 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.762s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:39:47 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-5ddb96b4-f186-4f3c-90f9-f204cdf82fd9 tempest-VolumesExtendTest-896546243 None] Extend volume completed successfully. Aug 03 08:39:48 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-b62f50b7-a3fe-468a-976c-8fada37c86a9 tempest-VolumesExtendTest-896546243 None] Acquiring lock "cinder-4a88c139-3477-489c-826d-4daa3006a0fe-delete_snapshot" by "delete_snapshot" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:39:48 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-b62f50b7-a3fe-468a-976c-8fada37c86a9 tempest-VolumesExtendTest-896546243 None] Lock "cinder-4a88c139-3477-489c-826d-4daa3006a0fe-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:39:48 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-b62f50b7-a3fe-468a-976c-8fada37c86a9 tempest-VolumesExtendTest-896546243 None] Acquiring lock "cinder-quobyte-589fa109-7818-430b-8b8c-fbaf705653b7" by "delete_snapshot" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:39:48 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-b62f50b7-a3fe-468a-976c-8fada37c86a9 tempest-VolumesExtendTest-896546243 None] Lock "cinder-quobyte-589fa109-7818-430b-8b8c-fbaf705653b7" acquired by "delete_snapshot" :: waited 0.022s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:39:48 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-b62f50b7-a3fe-468a-976c-8fada37c86a9 tempest-VolumesExtendTest-896546243 None] Acquiring lock "cinder-quobyte-4a88c139-3477-489c-826d-4daa3006a0fe" by "_delete_snapshot" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:39:48 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-b62f50b7-a3fe-468a-976c-8fada37c86a9 tempest-VolumesExtendTest-896546243 None] Lock "cinder-quobyte-4a88c139-3477-489c-826d-4daa3006a0fe" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:39:48 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-b62f50b7-a3fe-468a-976c-8fada37c86a9 tempest-VolumesExtendTest-896546243 None] Deleting offline snapshot 4a88c139-3477-489c-826d-4daa3006a0fe of volume 589fa109-7818-430b-8b8c-fbaf705653b7 {{(pid=88899) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 03 08:39:48 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-b62f50b7-a3fe-468a-976c-8fada37c86a9 tempest-VolumesExtendTest-896546243 None] snapshot_file for this snap is: volume-589fa109-7818-430b-8b8c-fbaf705653b7.4a88c139-3477-489c-826d-4daa3006a0fe {{(pid=88899) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 03 08:39:48 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[a007324b-8ffb-4102-aa30-14d5dab1e86d]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:39:48 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-b62f50b7-a3fe-468a-976c-8fada37c86a9 tempest-VolumesExtendTest-896546243 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-589fa109-7818-430b-8b8c-fbaf705653b7.4a88c139-3477-489c-826d-4daa3006a0fe {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:39:48 devstack sudo[102015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-589fa109-7818-430b-8b8c-fbaf705653b7.4a88c139-3477-489c-826d-4daa3006a0fe Aug 03 08:39:48 devstack sudo[102015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:39:48 devstack sudo[102015]: pam_unix(sudo:session): session closed for user root Aug 03 08:39:48 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-b62f50b7-a3fe-468a-976c-8fada37c86a9 tempest-VolumesExtendTest-896546243 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-589fa109-7818-430b-8b8c-fbaf705653b7.4a88c139-3477-489c-826d-4daa3006a0fe" returned: 0 in 0.564s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:39:48 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-b62f50b7-a3fe-468a-976c-8fada37c86a9 tempest-VolumesExtendTest-896546243 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-589fa109-7818-430b-8b8c-fbaf705653b7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88899) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 03 08:39:48 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[7929a552-696a-4a6d-bc5b-a64096a9bbbe]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:39:48 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-b62f50b7-a3fe-468a-976c-8fada37c86a9 tempest-VolumesExtendTest-896546243 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-589fa109-7818-430b-8b8c-fbaf705653b7 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:39:48 devstack sudo[102043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-589fa109-7818-430b-8b8c-fbaf705653b7 Aug 03 08:39:48 devstack sudo[102043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:39:49 devstack sudo[102043]: pam_unix(sudo:session): session closed for user root Aug 03 08:39:49 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-b62f50b7-a3fe-468a-976c-8fada37c86a9 tempest-VolumesExtendTest-896546243 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-589fa109-7818-430b-8b8c-fbaf705653b7" returned: 0 in 0.607s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:39:49 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-b62f50b7-a3fe-468a-976c-8fada37c86a9 tempest-VolumesExtendTest-896546243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-589fa109-7818-430b-8b8c-fbaf705653b7.4a88c139-3477-489c-826d-4daa3006a0fe {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:39:49 devstack sudo[102058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-589fa109-7818-430b-8b8c-fbaf705653b7.4a88c139-3477-489c-826d-4daa3006a0fe Aug 03 08:39:49 devstack sudo[102058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:39:49 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-6f8f9d03-7536-467d-91f8-5a573428eb05 tempest-SnapshotDataIntegrityTests-1494076589 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:39:49 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-6f8f9d03-7536-467d-91f8-5a573428eb05 tempest-SnapshotDataIntegrityTests-1494076589 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:39:49 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-6f8f9d03-7536-467d-91f8-5a573428eb05 tempest-SnapshotDataIntegrityTests-1494076589 None] Creating online snapshot 7eccf0d3-bff0-4d62-a704-dc41ced4a9ba of volume 6bafdd19-6d59-4557-a0e3-17d1fbfc1053 {{(pid=88899) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 03 08:39:49 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[3eea4835-db6d-4e95-8e26-4f9b33f9f1d1]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:39:49 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-6f8f9d03-7536-467d-91f8-5a573428eb05 tempest-SnapshotDataIntegrityTests-1494076589 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-6bafdd19-6d59-4557-a0e3-17d1fbfc1053 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:39:49 devstack sudo[102063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-6bafdd19-6d59-4557-a0e3-17d1fbfc1053 Aug 03 08:39:49 devstack sudo[102063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:39:50 devstack sudo[102058]: pam_unix(sudo:session): session closed for user root Aug 03 08:39:50 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-b62f50b7-a3fe-468a-976c-8fada37c86a9 tempest-VolumesExtendTest-896546243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-589fa109-7818-430b-8b8c-fbaf705653b7.4a88c139-3477-489c-826d-4daa3006a0fe" returned: 0 in 0.671s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:39:50 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-b62f50b7-a3fe-468a-976c-8fada37c86a9 tempest-VolumesExtendTest-896546243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-589fa109-7818-430b-8b8c-fbaf705653b7.4a88c139-3477-489c-826d-4daa3006a0fe {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:39:50 devstack sudo[102070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-589fa109-7818-430b-8b8c-fbaf705653b7.4a88c139-3477-489c-826d-4daa3006a0fe Aug 03 08:39:50 devstack sudo[102070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:39:50 devstack sudo[102063]: pam_unix(sudo:session): session closed for user root Aug 03 08:39:50 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-6f8f9d03-7536-467d-91f8-5a573428eb05 tempest-SnapshotDataIntegrityTests-1494076589 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-6bafdd19-6d59-4557-a0e3-17d1fbfc1053" returned: 0 in 0.587s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:39:50 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-6f8f9d03-7536-467d-91f8-5a573428eb05 tempest-SnapshotDataIntegrityTests-1494076589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-6bafdd19-6d59-4557-a0e3-17d1fbfc1053,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-6bafdd19-6d59-4557-a0e3-17d1fbfc1053.7eccf0d3-bff0-4d62-a704-dc41ced4a9ba 1G {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:39:50 devstack sudo[102076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-6bafdd19-6d59-4557-a0e3-17d1fbfc1053,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-6bafdd19-6d59-4557-a0e3-17d1fbfc1053.7eccf0d3-bff0-4d62-a704-dc41ced4a9ba 1G Aug 03 08:39:50 devstack sudo[102076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:39:50 devstack sudo[102070]: pam_unix(sudo:session): session closed for user root Aug 03 08:39:50 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-b62f50b7-a3fe-468a-976c-8fada37c86a9 tempest-VolumesExtendTest-896546243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-589fa109-7818-430b-8b8c-fbaf705653b7.4a88c139-3477-489c-826d-4daa3006a0fe" returned: 0 in 0.435s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:39:50 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-b62f50b7-a3fe-468a-976c-8fada37c86a9 tempest-VolumesExtendTest-896546243 None] Lock "cinder-quobyte-4a88c139-3477-489c-826d-4daa3006a0fe" released by "_delete_snapshot" :: held 2.460s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:39:50 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-b62f50b7-a3fe-468a-976c-8fada37c86a9 tempest-VolumesExtendTest-896546243 None] Lock "cinder-quobyte-589fa109-7818-430b-8b8c-fbaf705653b7" released by "delete_snapshot" :: held 2.494s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:39:50 devstack cinder-volume[88899]: DEBUG cinder.quota [None req-b62f50b7-a3fe-468a-976c-8fada37c86a9 tempest-VolumesExtendTest-896546243 None] Created reservations ['e628959a-346a-4a2c-b68b-3a2cf54f396f', 'd0a94085-0874-4976-b951-9121d32b10c3', '9be8442e-2a80-4f5a-8cdb-b8e85b6336e3', 'd63a927a-0182-4fda-89dc-c0a5d78e8566'] {{(pid=88899) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 08:39:50 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-b62f50b7-a3fe-468a-976c-8fada37c86a9 tempest-VolumesExtendTest-896546243 None] Delete snapshot completed successfully. Aug 03 08:39:50 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-b62f50b7-a3fe-468a-976c-8fada37c86a9 tempest-VolumesExtendTest-896546243 None] Lock "cinder-4a88c139-3477-489c-826d-4daa3006a0fe-delete_snapshot" released by "delete_snapshot" :: held 2.663s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:39:50 devstack sudo[102076]: pam_unix(sudo:session): session closed for user root Aug 03 08:39:50 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-6f8f9d03-7536-467d-91f8-5a573428eb05 tempest-SnapshotDataIntegrityTests-1494076589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-6bafdd19-6d59-4557-a0e3-17d1fbfc1053,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-6bafdd19-6d59-4557-a0e3-17d1fbfc1053.7eccf0d3-bff0-4d62-a704-dc41ced4a9ba 1G" returned: 0 in 0.523s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:39:50 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-6f8f9d03-7536-467d-91f8-5a573428eb05 tempest-SnapshotDataIntegrityTests-1494076589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6bafdd19-6d59-4557-a0e3-17d1fbfc1053 -F qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-6bafdd19-6d59-4557-a0e3-17d1fbfc1053.7eccf0d3-bff0-4d62-a704-dc41ced4a9ba {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:39:50 devstack sudo[102082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6bafdd19-6d59-4557-a0e3-17d1fbfc1053 -F qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-6bafdd19-6d59-4557-a0e3-17d1fbfc1053.7eccf0d3-bff0-4d62-a704-dc41ced4a9ba Aug 03 08:39:50 devstack sudo[102082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:39:51 devstack sudo[102082]: pam_unix(sudo:session): session closed for user root Aug 03 08:39:51 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-6f8f9d03-7536-467d-91f8-5a573428eb05 tempest-SnapshotDataIntegrityTests-1494076589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6bafdd19-6d59-4557-a0e3-17d1fbfc1053 -F qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-6bafdd19-6d59-4557-a0e3-17d1fbfc1053.7eccf0d3-bff0-4d62-a704-dc41ced4a9ba" returned: 0 in 0.442s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:39:51 devstack cinder-volume[88899]: WARNING cinder.volume.drivers.remotefs [None req-6f8f9d03-7536-467d-91f8-5a573428eb05 tempest-SnapshotDataIntegrityTests-1494076589 None] /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-6bafdd19-6d59-4557-a0e3-17d1fbfc1053.7eccf0d3-bff0-4d62-a704-dc41ced4a9ba is being set with open permissions: ugo+rw Aug 03 08:39:51 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-6f8f9d03-7536-467d-91f8-5a573428eb05 tempest-SnapshotDataIntegrityTests-1494076589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-6bafdd19-6d59-4557-a0e3-17d1fbfc1053.7eccf0d3-bff0-4d62-a704-dc41ced4a9ba {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:39:51 devstack sudo[102087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-6bafdd19-6d59-4557-a0e3-17d1fbfc1053.7eccf0d3-bff0-4d62-a704-dc41ced4a9ba Aug 03 08:39:51 devstack sudo[102087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:39:51 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-416f2c30-83c8-4fd0-8ee6-caaea11f56a9 tempest-VolumesExtendTest-896546243 None] Acquiring lock "cinder-589fa109-7818-430b-8b8c-fbaf705653b7-delete_volume" by "delete_volume" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:39:51 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-416f2c30-83c8-4fd0-8ee6-caaea11f56a9 tempest-VolumesExtendTest-896546243 None] Lock "cinder-589fa109-7818-430b-8b8c-fbaf705653b7-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:39:51 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-416f2c30-83c8-4fd0-8ee6-caaea11f56a9 tempest-VolumesExtendTest-896546243 None] Acquiring lock "cinder-quobyte-589fa109-7818-430b-8b8c-fbaf705653b7" by "delete_volume" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:39:51 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-416f2c30-83c8-4fd0-8ee6-caaea11f56a9 tempest-VolumesExtendTest-896546243 None] Lock "cinder-quobyte-589fa109-7818-430b-8b8c-fbaf705653b7" acquired by "delete_volume" :: waited 0.025s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:39:51 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[34cf6796-8c5e-48a4-bfec-19640672cd48]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:39:51 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-416f2c30-83c8-4fd0-8ee6-caaea11f56a9 tempest-VolumesExtendTest-896546243 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-589fa109-7818-430b-8b8c-fbaf705653b7 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:39:51 devstack sudo[102087]: pam_unix(sudo:session): session closed for user root Aug 03 08:39:51 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-6f8f9d03-7536-467d-91f8-5a573428eb05 tempest-SnapshotDataIntegrityTests-1494076589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-6bafdd19-6d59-4557-a0e3-17d1fbfc1053.7eccf0d3-bff0-4d62-a704-dc41ced4a9ba" returned: 0 in 0.373s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:39:51 devstack cinder-volume[88899]: DEBUG cinder.compute.nova [None req-6f8f9d03-7536-467d-91f8-5a573428eb05 tempest-SnapshotDataIntegrityTests-1494076589 None] Creating Keystone auth plugin from conf {{(pid=88899) novaclient /opt/stack/cinder/cinder/compute/nova.py:99}} Aug 03 08:39:51 devstack sudo[102090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-589fa109-7818-430b-8b8c-fbaf705653b7 Aug 03 08:39:51 devstack sudo[102090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:39:51 devstack cinder-volume[88899]: DEBUG oslo_service.periodic_task [None req-f948fb4a-c4d7-499f-b1bd-8d6be3de0b53 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88899) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 03 08:39:51 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-f948fb4a-c4d7-499f-b1bd-8d6be3de0b53 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:39:51 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-f948fb4a-c4d7-499f-b1bd-8d6be3de0b53 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:39:51 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-f948fb4a-c4d7-499f-b1bd-8d6be3de0b53 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:39:51 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-f948fb4a-c4d7-499f-b1bd-8d6be3de0b53 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:39:51 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-f948fb4a-c4d7-499f-b1bd-8d6be3de0b53 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:39:51 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-f948fb4a-c4d7-499f-b1bd-8d6be3de0b53 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:39:51 devstack sudo[102092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a Aug 03 08:39:51 devstack sudo[102092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:39:52 devstack cinder-volume[88899]: DEBUG novaclient.v2.client [None req-6f8f9d03-7536-467d-91f8-5a573428eb05 tempest-SnapshotDataIntegrityTests-1494076589 None] REQ: curl -g -i -X POST http://192.168.122.55/compute/v2.1/os-assisted-volume-snapshots -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}70716c5703e75372db7d7af0dd801bbf6577278835d71ffb15422c3988ffbfde" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-6f8f9d03-7536-467d-91f8-5a573428eb05" -H "X-Service-Token: {SHA256}c96e034f4f8a4d16079c50f41a6bc99d8f702fc5a9a0d1604994b54ce68306ce" -d '{"snapshot": {"volume_id": "6bafdd19-6d59-4557-a0e3-17d1fbfc1053", "create_info": {"type": "qcow2", "new_file": "volume-6bafdd19-6d59-4557-a0e3-17d1fbfc1053.7eccf0d3-bff0-4d62-a704-dc41ced4a9ba", "snapshot_id": "7eccf0d3-bff0-4d62-a704-dc41ced4a9ba"}}}' {{(pid=88899) _http_log_request /opt/stack/data/venv/lib/python3.12/site-packages/keystoneauth1/session.py:575}} Aug 03 08:39:52 devstack sudo[102090]: pam_unix(sudo:session): session closed for user root Aug 03 08:39:52 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-416f2c30-83c8-4fd0-8ee6-caaea11f56a9 tempest-VolumesExtendTest-896546243 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-589fa109-7818-430b-8b8c-fbaf705653b7" returned: 0 in 0.537s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:39:52 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-416f2c30-83c8-4fd0-8ee6-caaea11f56a9 tempest-VolumesExtendTest-896546243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-589fa109-7818-430b-8b8c-fbaf705653b7 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:39:52 devstack sudo[102092]: pam_unix(sudo:session): session closed for user root Aug 03 08:39:52 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-f948fb4a-c4d7-499f-b1bd-8d6be3de0b53 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a" returned: 0 in 0.342s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:39:52 devstack cinder-volume[88899]: DEBUG cinder.manager [None req-f948fb4a-c4d7-499f-b1bd-8d6be3de0b53 None None] Notifying Schedulers of capabilities ... {{(pid=88899) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 08:39:52 devstack cinder-volume[88899]: DEBUG oslo_service.periodic_task [None req-f948fb4a-c4d7-499f-b1bd-8d6be3de0b53 None None] Running periodic task VolumeManager._thread_info {{(pid=88899) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 03 08:39:52 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-f948fb4a-c4d7-499f-b1bd-8d6be3de0b53 None None] thread count: 28 {{(pid=88899) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 03 08:39:52 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-f948fb4a-c4d7-499f-b1bd-8d6be3de0b53 None None] thread info: [<_MainThread(MainThread, started 132234320248960)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88899) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 03 08:39:52 devstack sudo[102098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-589fa109-7818-430b-8b8c-fbaf705653b7 Aug 03 08:39:52 devstack sudo[102098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:39:52 devstack cinder-volume[88899]: DEBUG novaclient.v2.client [None req-6f8f9d03-7536-467d-91f8-5a573428eb05 tempest-SnapshotDataIntegrityTests-1494076589 None] RESP: [200] Connection: close Content-Length: 78 Content-Type: application/json Date: Mon, 03 Aug 2026 06:39:52 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.58 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-0a2d9277-0d2b-444c-9165-b6441dad5340 x-openstack-request-id: req-0a2d9277-0d2b-444c-9165-b6441dad5340 {{(pid=88899) _http_log_response /opt/stack/data/venv/lib/python3.12/site-packages/keystoneauth1/session.py:616}} Aug 03 08:39:52 devstack cinder-volume[88899]: DEBUG novaclient.v2.client [None req-6f8f9d03-7536-467d-91f8-5a573428eb05 tempest-SnapshotDataIntegrityTests-1494076589 None] RESP BODY: {"snapshot": {"id": null, "volumeId": "6bafdd19-6d59-4557-a0e3-17d1fbfc1053"}} {{(pid=88899) _http_log_response /opt/stack/data/venv/lib/python3.12/site-packages/keystoneauth1/session.py:651}} Aug 03 08:39:52 devstack cinder-volume[88899]: DEBUG novaclient.v2.client [None req-6f8f9d03-7536-467d-91f8-5a573428eb05 tempest-SnapshotDataIntegrityTests-1494076589 None] POST call to compute for http://192.168.122.55/compute/v2.1/os-assisted-volume-snapshots used request id req-0a2d9277-0d2b-444c-9165-b6441dad5340 {{(pid=88899) request /opt/stack/data/venv/lib/python3.12/site-packages/keystoneauth1/session.py:1076}} Aug 03 08:39:52 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-6f8f9d03-7536-467d-91f8-5a573428eb05 tempest-SnapshotDataIntegrityTests-1494076589 None] nova call result: None {{(pid=88899) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1910}} Aug 03 08:39:52 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-6f8f9d03-7536-467d-91f8-5a573428eb05 tempest-SnapshotDataIntegrityTests-1494076589 None] Status of snapshot 7eccf0d3-bff0-4d62-a704-dc41ced4a9ba is now creating {{(pid=88899) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Aug 03 08:39:52 devstack sudo[102098]: pam_unix(sudo:session): session closed for user root Aug 03 08:39:52 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-416f2c30-83c8-4fd0-8ee6-caaea11f56a9 tempest-VolumesExtendTest-896546243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-589fa109-7818-430b-8b8c-fbaf705653b7" returned: 0 in 0.338s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:39:52 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-416f2c30-83c8-4fd0-8ee6-caaea11f56a9 tempest-VolumesExtendTest-896546243 None] Lock "cinder-quobyte-589fa109-7818-430b-8b8c-fbaf705653b7" released by "delete_volume" :: held 0.979s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:39:52 devstack cinder-volume[88899]: DEBUG cinder.quota [None req-416f2c30-83c8-4fd0-8ee6-caaea11f56a9 tempest-VolumesExtendTest-896546243 None] Created reservations ['a54c38f5-70b8-4fd8-ab0c-23f6fd05a8b1', '29e41d04-43ee-49ff-8c2d-1813654ae479', '1fa5d714-1908-46b5-9a2a-59d2fdd99643', 'b3445d15-08a2-4064-b5f4-73cd15bf6536'] {{(pid=88899) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 08:39:52 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-416f2c30-83c8-4fd0-8ee6-caaea11f56a9 tempest-VolumesExtendTest-896546243 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:39:52 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-416f2c30-83c8-4fd0-8ee6-caaea11f56a9 tempest-VolumesExtendTest-896546243 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:39:52 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-416f2c30-83c8-4fd0-8ee6-caaea11f56a9 tempest-VolumesExtendTest-896546243 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:39:52 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-416f2c30-83c8-4fd0-8ee6-caaea11f56a9 tempest-VolumesExtendTest-896546243 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:39:52 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-416f2c30-83c8-4fd0-8ee6-caaea11f56a9 tempest-VolumesExtendTest-896546243 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:39:52 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-416f2c30-83c8-4fd0-8ee6-caaea11f56a9 tempest-VolumesExtendTest-896546243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:39:52 devstack sudo[102104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a Aug 03 08:39:52 devstack sudo[102104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:39:53 devstack sudo[102104]: pam_unix(sudo:session): session closed for user root Aug 03 08:39:53 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-416f2c30-83c8-4fd0-8ee6-caaea11f56a9 tempest-VolumesExtendTest-896546243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a" returned: 0 in 0.284s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:39:53 devstack cinder-volume[88899]: DEBUG cinder.manager [None req-416f2c30-83c8-4fd0-8ee6-caaea11f56a9 tempest-VolumesExtendTest-896546243 None] Notifying Schedulers of capabilities ... {{(pid=88899) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 08:39:53 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-416f2c30-83c8-4fd0-8ee6-caaea11f56a9 tempest-VolumesExtendTest-896546243 None] Deleted volume successfully. Aug 03 08:39:53 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-416f2c30-83c8-4fd0-8ee6-caaea11f56a9 tempest-VolumesExtendTest-896546243 None] Lock "cinder-589fa109-7818-430b-8b8c-fbaf705653b7-delete_volume" released by "delete_volume" :: held 1.647s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:39:53 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-6f8f9d03-7536-467d-91f8-5a573428eb05 tempest-SnapshotDataIntegrityTests-1494076589 None] Status of snapshot 7eccf0d3-bff0-4d62-a704-dc41ced4a9ba is now creating {{(pid=88899) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Aug 03 08:39:54 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-6f8f9d03-7536-467d-91f8-5a573428eb05 tempest-SnapshotDataIntegrityTests-1494076589 None] Status of snapshot 7eccf0d3-bff0-4d62-a704-dc41ced4a9ba is now creating {{(pid=88899) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Aug 03 08:39:55 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-be7f3ece-27e4-41bf-8f1f-f545ea1a0a53 tempest-GroupsV320Test-700697009 None] Group tempest-GroupsV320Test-Group-910101765: creating Aug 03 08:39:55 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-be7f3ece-27e4-41bf-8f1f-f545ea1a0a53 tempest-GroupsV320Test-700697009 None] Group tempest-GroupsV320Test-Group-910101765: created successfully Aug 03 08:39:55 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-be7f3ece-27e4-41bf-8f1f-f545ea1a0a53 tempest-GroupsV320Test-700697009 None] Create group completed successfully. Aug 03 08:39:55 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-6f8f9d03-7536-467d-91f8-5a573428eb05 tempest-SnapshotDataIntegrityTests-1494076589 None] Status of snapshot 7eccf0d3-bff0-4d62-a704-dc41ced4a9ba is now creating {{(pid=88899) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Aug 03 08:39:56 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-6f8f9d03-7536-467d-91f8-5a573428eb05 tempest-SnapshotDataIntegrityTests-1494076589 None] Status of snapshot 7eccf0d3-bff0-4d62-a704-dc41ced4a9ba is now creating {{(pid=88899) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Aug 03 08:39:56 devstack cinder-volume[88899]: DEBUG cinder.quota [None req-707012d7-f573-4595-a75e-564e08cb108d tempest-GroupsV320Test-700697009 None] Created reservations ['b575e9b2-5939-4698-9fda-2c9cd272aeb3'] {{(pid=88899) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 08:39:56 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-707012d7-f573-4595-a75e-564e08cb108d tempest-GroupsV320Test-700697009 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:39:56 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-707012d7-f573-4595-a75e-564e08cb108d tempest-GroupsV320Test-700697009 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:39:56 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-707012d7-f573-4595-a75e-564e08cb108d tempest-GroupsV320Test-700697009 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:39:56 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-707012d7-f573-4595-a75e-564e08cb108d tempest-GroupsV320Test-700697009 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:39:56 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-707012d7-f573-4595-a75e-564e08cb108d tempest-GroupsV320Test-700697009 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:39:56 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-707012d7-f573-4595-a75e-564e08cb108d tempest-GroupsV320Test-700697009 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:39:56 devstack sudo[102109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a Aug 03 08:39:56 devstack sudo[102109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:39:57 devstack sudo[102109]: pam_unix(sudo:session): session closed for user root Aug 03 08:39:57 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-707012d7-f573-4595-a75e-564e08cb108d tempest-GroupsV320Test-700697009 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a" returned: 0 in 0.329s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:39:57 devstack cinder-volume[88899]: DEBUG cinder.manager [None req-707012d7-f573-4595-a75e-564e08cb108d tempest-GroupsV320Test-700697009 None] Notifying Schedulers of capabilities ... {{(pid=88899) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 08:39:57 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-707012d7-f573-4595-a75e-564e08cb108d tempest-GroupsV320Test-700697009 None] Delete group completed successfully. Aug 03 08:39:57 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-6f8f9d03-7536-467d-91f8-5a573428eb05 tempest-SnapshotDataIntegrityTests-1494076589 None] Status of snapshot 7eccf0d3-bff0-4d62-a704-dc41ced4a9ba is now creating {{(pid=88899) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Aug 03 08:39:57 devstack cinder-volume[88899]: DEBUG cinder.volume.flows.manager.create_volume [None req-7570df7f-e965-4638-9aba-318fc24b899e tempest-VolumesNegativeTest-1000681371 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88899) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 08:39:57 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-7570df7f-e965-4638-9aba-318fc24b899e tempest-VolumesNegativeTest-1000681371 None] Flow 'volume_create_manager' (3c4954d5-d330-4aa9-94c3-d9f07419df04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:39:57 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-7570df7f-e965-4638-9aba-318fc24b899e tempest-VolumesNegativeTest-1000681371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee069219-8650-4eb2-bd85-20899348d253) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:39:57 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-7570df7f-e965-4638-9aba-318fc24b899e tempest-VolumesNegativeTest-1000681371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee069219-8650-4eb2-bd85-20899348d253) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:39:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-724344954',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0784ee2d-6c48-4ff6-b809-730aa314fbad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f503a12336d453d9061dbfb05d70131',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:39:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:39:58Z,use_quota=True,user_id='e42a8cbe692549ee833e88f5aaa8c6dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8bde7129-1dc4-42ab-b852-ab32c61b4921),volume_type_id=8bde7129-1dc4-42ab-b852-ab32c61b4921)' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:39:57 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-7570df7f-e965-4638-9aba-318fc24b899e tempest-VolumesNegativeTest-1000681371 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (051a77d4-d78c-48ad-a6a9-0bb44d7b7224) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:39:57 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-7570df7f-e965-4638-9aba-318fc24b899e tempest-VolumesNegativeTest-1000681371 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (051a77d4-d78c-48ad-a6a9-0bb44d7b7224) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:39:57 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-7570df7f-e965-4638-9aba-318fc24b899e tempest-VolumesNegativeTest-1000681371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f2128bc-f28a-4ace-b5e8-0c03e2d90cf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:39:57 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-7570df7f-e965-4638-9aba-318fc24b899e tempest-VolumesNegativeTest-1000681371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f2128bc-f28a-4ace-b5e8-0c03e2d90cf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0784ee2d-6c48-4ff6-b809-730aa314fbad', 'volume_name': 'volume-0784ee2d-6c48-4ff6-b809-730aa314fbad', 'volume_size': 1}' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:39:57 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-7570df7f-e965-4638-9aba-318fc24b899e tempest-VolumesNegativeTest-1000681371 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d6009036-d4c4-4f53-80cc-bf3a18c82f67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:39:57 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-7570df7f-e965-4638-9aba-318fc24b899e tempest-VolumesNegativeTest-1000681371 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d6009036-d4c4-4f53-80cc-bf3a18c82f67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:39:57 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-7570df7f-e965-4638-9aba-318fc24b899e tempest-VolumesNegativeTest-1000681371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (178e7f87-da1d-4a99-8959-3a06896c8ece) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:39:57 devstack cinder-volume[88899]: INFO cinder.volume.flows.manager.create_volume [None req-7570df7f-e965-4638-9aba-318fc24b899e tempest-VolumesNegativeTest-1000681371 None] Volume 0784ee2d-6c48-4ff6-b809-730aa314fbad: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0784ee2d-6c48-4ff6-b809-730aa314fbad', 'volume_size': 1} Aug 03 08:39:57 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-7570df7f-e965-4638-9aba-318fc24b899e tempest-VolumesNegativeTest-1000681371 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:39:58 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-6f8f9d03-7536-467d-91f8-5a573428eb05 tempest-SnapshotDataIntegrityTests-1494076589 None] Status of snapshot 7eccf0d3-bff0-4d62-a704-dc41ced4a9ba is now creating {{(pid=88899) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Aug 03 08:39:59 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-6f8f9d03-7536-467d-91f8-5a573428eb05 tempest-SnapshotDataIntegrityTests-1494076589 None] Status of snapshot 7eccf0d3-bff0-4d62-a704-dc41ced4a9ba is now creating {{(pid=88899) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Aug 03 08:40:00 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-6f8f9d03-7536-467d-91f8-5a573428eb05 tempest-SnapshotDataIntegrityTests-1494076589 None] Status of snapshot 7eccf0d3-bff0-4d62-a704-dc41ced4a9ba is now creating {{(pid=88899) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Aug 03 08:40:01 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-6f8f9d03-7536-467d-91f8-5a573428eb05 tempest-SnapshotDataIntegrityTests-1494076589 None] Status of snapshot 7eccf0d3-bff0-4d62-a704-dc41ced4a9ba is now creating {{(pid=88899) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Aug 03 08:40:02 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-6f8f9d03-7536-467d-91f8-5a573428eb05 tempest-SnapshotDataIntegrityTests-1494076589 None] Status of snapshot 7eccf0d3-bff0-4d62-a704-dc41ced4a9ba is now creating {{(pid=88899) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Aug 03 08:40:02 devstack cinder-volume[88899]: DEBUG cinder.volume.flows.manager.create_volume [None req-c294c96f-26e5-430f-856e-5d774b3b639d tempest-TestInstancesWithCinderVolumes-1639155420 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88899) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 08:40:02 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-c294c96f-26e5-430f-856e-5d774b3b639d tempest-TestInstancesWithCinderVolumes-1639155420 None] Flow 'volume_create_manager' (0d8197a2-9779-403f-9ddc-b4ef46dee2b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:40:02 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-c294c96f-26e5-430f-856e-5d774b3b639d tempest-TestInstancesWithCinderVolumes-1639155420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9c8ae4f-dc1b-47f4-a42a-1faa25ae848f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:40:02 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-c294c96f-26e5-430f-856e-5d774b3b639d tempest-TestInstancesWithCinderVolumes-1639155420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9c8ae4f-dc1b-47f4-a42a-1faa25ae848f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:40:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-745521128',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a673b8d7-ba1a-4e56-9cfa-9e35c6fc2587,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b944e91ca3ed4f51b4d01ed374a22fb4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:40:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:40:03Z,use_quota=True,user_id='b017255fb8b84248bd43451f4c58f1f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d8d028de-8c4e-4cc0-87da-7ab28c37d8c6),volume_type_id=d8d028de-8c4e-4cc0-87da-7ab28c37d8c6)' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:40:02 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-c294c96f-26e5-430f-856e-5d774b3b639d tempest-TestInstancesWithCinderVolumes-1639155420 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32f850a9-d576-44fc-aa32-ab950a447e25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:40:02 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-c294c96f-26e5-430f-856e-5d774b3b639d tempest-TestInstancesWithCinderVolumes-1639155420 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32f850a9-d576-44fc-aa32-ab950a447e25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:40:02 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-c294c96f-26e5-430f-856e-5d774b3b639d tempest-TestInstancesWithCinderVolumes-1639155420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2dd102d-1615-4ac7-8df2-acec30b0aa7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:40:02 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-c294c96f-26e5-430f-856e-5d774b3b639d tempest-TestInstancesWithCinderVolumes-1639155420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2dd102d-1615-4ac7-8df2-acec30b0aa7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a673b8d7-ba1a-4e56-9cfa-9e35c6fc2587', 'volume_name': 'volume-a673b8d7-ba1a-4e56-9cfa-9e35c6fc2587', 'volume_size': 1}' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:40:02 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-c294c96f-26e5-430f-856e-5d774b3b639d tempest-TestInstancesWithCinderVolumes-1639155420 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99dfa24c-275f-484d-a22c-3e4f6fba12a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:40:02 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-c294c96f-26e5-430f-856e-5d774b3b639d tempest-TestInstancesWithCinderVolumes-1639155420 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99dfa24c-275f-484d-a22c-3e4f6fba12a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:40:02 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-c294c96f-26e5-430f-856e-5d774b3b639d tempest-TestInstancesWithCinderVolumes-1639155420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f49101a-7e70-4939-a1be-d2810778928a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:40:02 devstack cinder-volume[88899]: INFO cinder.volume.flows.manager.create_volume [None req-c294c96f-26e5-430f-856e-5d774b3b639d tempest-TestInstancesWithCinderVolumes-1639155420 None] Volume a673b8d7-ba1a-4e56-9cfa-9e35c6fc2587: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a673b8d7-ba1a-4e56-9cfa-9e35c6fc2587', 'volume_size': 1} Aug 03 08:40:02 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-c294c96f-26e5-430f-856e-5d774b3b639d tempest-TestInstancesWithCinderVolumes-1639155420 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:40:03 devstack cinder-volume[88899]: DEBUG cinder.volume.flows.manager.create_volume [None req-d25ac67b-f888-402f-87f3-ea701acdc509 tempest-TestInstancesWithCinderVolumes-1639155420 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88899) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 08:40:03 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-d25ac67b-f888-402f-87f3-ea701acdc509 tempest-TestInstancesWithCinderVolumes-1639155420 None] Flow 'volume_create_manager' (e3fdc65a-af03-42b3-a41b-b4eeb321a318) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:40:03 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-d25ac67b-f888-402f-87f3-ea701acdc509 tempest-TestInstancesWithCinderVolumes-1639155420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6ad8993-5b98-42ef-a154-ff4347dff105) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:40:03 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-d25ac67b-f888-402f-87f3-ea701acdc509 tempest-TestInstancesWithCinderVolumes-1639155420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6ad8993-5b98-42ef-a154-ff4347dff105) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:40:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1399211073',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3261e91f-070b-4599-a2ac-b8ca735be47a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b944e91ca3ed4f51b4d01ed374a22fb4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:40:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:40:03Z,use_quota=True,user_id='b017255fb8b84248bd43451f4c58f1f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(556c57d7-580e-425f-ad42-0e4d245129da),volume_type_id=556c57d7-580e-425f-ad42-0e4d245129da)' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:40:03 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-d25ac67b-f888-402f-87f3-ea701acdc509 tempest-TestInstancesWithCinderVolumes-1639155420 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f4b6fd6-fe49-4db0-9429-52301359b03f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:40:03 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-d25ac67b-f888-402f-87f3-ea701acdc509 tempest-TestInstancesWithCinderVolumes-1639155420 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f4b6fd6-fe49-4db0-9429-52301359b03f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:40:03 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-d25ac67b-f888-402f-87f3-ea701acdc509 tempest-TestInstancesWithCinderVolumes-1639155420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9881f15-6677-425f-9752-f4ea084d3d01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:40:03 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-d25ac67b-f888-402f-87f3-ea701acdc509 tempest-TestInstancesWithCinderVolumes-1639155420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9881f15-6677-425f-9752-f4ea084d3d01) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3261e91f-070b-4599-a2ac-b8ca735be47a', 'volume_name': 'volume-3261e91f-070b-4599-a2ac-b8ca735be47a', 'volume_size': 1}' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:40:03 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-d25ac67b-f888-402f-87f3-ea701acdc509 tempest-TestInstancesWithCinderVolumes-1639155420 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6bee2a2f-3b2b-4624-9ff4-4a28be0b6019) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:40:03 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-d25ac67b-f888-402f-87f3-ea701acdc509 tempest-TestInstancesWithCinderVolumes-1639155420 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6bee2a2f-3b2b-4624-9ff4-4a28be0b6019) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:40:03 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-d25ac67b-f888-402f-87f3-ea701acdc509 tempest-TestInstancesWithCinderVolumes-1639155420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cbce7d0d-4450-403c-8c70-679341795154) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:40:03 devstack cinder-volume[88899]: INFO cinder.volume.flows.manager.create_volume [None req-d25ac67b-f888-402f-87f3-ea701acdc509 tempest-TestInstancesWithCinderVolumes-1639155420 None] Volume 3261e91f-070b-4599-a2ac-b8ca735be47a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3261e91f-070b-4599-a2ac-b8ca735be47a', 'volume_size': 1} Aug 03 08:40:03 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-d25ac67b-f888-402f-87f3-ea701acdc509 tempest-TestInstancesWithCinderVolumes-1639155420 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:40:03 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-6f8f9d03-7536-467d-91f8-5a573428eb05 tempest-SnapshotDataIntegrityTests-1494076589 None] Status of snapshot 7eccf0d3-bff0-4d62-a704-dc41ced4a9ba is now creating {{(pid=88899) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Aug 03 08:40:03 devstack cinder-volume[88899]: DEBUG cinder.volume.flows.manager.create_volume [None req-4ddd9b31-adf0-444d-bb29-7800d3f3b3e7 tempest-VolumeQuotasNegativeTestJSON-1983682387 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88899) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 08:40:03 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-4ddd9b31-adf0-444d-bb29-7800d3f3b3e7 tempest-VolumeQuotasNegativeTestJSON-1983682387 None] Flow 'volume_create_manager' (ba662208-79d7-4dc4-845f-da5fdd61a62e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:40:03 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-4ddd9b31-adf0-444d-bb29-7800d3f3b3e7 tempest-VolumeQuotasNegativeTestJSON-1983682387 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d153adc-4db3-4aa2-a9bb-1dd552f73597) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:40:03 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-4ddd9b31-adf0-444d-bb29-7800d3f3b3e7 tempest-VolumeQuotasNegativeTestJSON-1983682387 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d153adc-4db3-4aa2-a9bb-1dd552f73597) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:40:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-101895607',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b4502e9-9b53-40fa-8e77-8ceb06d7b7df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4a3e3d4931164f6689c505a74dea35df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:40:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:40:04Z,use_quota=True,user_id='f0604e86cb64461aba0c66dbb1d53d44',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8bde7129-1dc4-42ab-b852-ab32c61b4921),volume_type_id=8bde7129-1dc4-42ab-b852-ab32c61b4921)' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:40:03 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-4ddd9b31-adf0-444d-bb29-7800d3f3b3e7 tempest-VolumeQuotasNegativeTestJSON-1983682387 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4795ab2e-7c6d-495c-af31-7f6630cb6daf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:40:03 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-4ddd9b31-adf0-444d-bb29-7800d3f3b3e7 tempest-VolumeQuotasNegativeTestJSON-1983682387 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4795ab2e-7c6d-495c-af31-7f6630cb6daf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:40:03 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-4ddd9b31-adf0-444d-bb29-7800d3f3b3e7 tempest-VolumeQuotasNegativeTestJSON-1983682387 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (008d23b3-67ca-4668-ba60-fda91783ea38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:40:03 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-4ddd9b31-adf0-444d-bb29-7800d3f3b3e7 tempest-VolumeQuotasNegativeTestJSON-1983682387 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (008d23b3-67ca-4668-ba60-fda91783ea38) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0b4502e9-9b53-40fa-8e77-8ceb06d7b7df', 'volume_name': 'volume-0b4502e9-9b53-40fa-8e77-8ceb06d7b7df', 'volume_size': 1}' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:40:03 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-4ddd9b31-adf0-444d-bb29-7800d3f3b3e7 tempest-VolumeQuotasNegativeTestJSON-1983682387 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d02aa33b-b29e-4374-a63d-6d526845b1d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:40:03 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-4ddd9b31-adf0-444d-bb29-7800d3f3b3e7 tempest-VolumeQuotasNegativeTestJSON-1983682387 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d02aa33b-b29e-4374-a63d-6d526845b1d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:40:03 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-4ddd9b31-adf0-444d-bb29-7800d3f3b3e7 tempest-VolumeQuotasNegativeTestJSON-1983682387 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20e2d300-fc1c-4b8b-a48f-0a9e95816f26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:40:04 devstack cinder-volume[88899]: INFO cinder.volume.flows.manager.create_volume [None req-4ddd9b31-adf0-444d-bb29-7800d3f3b3e7 tempest-VolumeQuotasNegativeTestJSON-1983682387 None] Volume 0b4502e9-9b53-40fa-8e77-8ceb06d7b7df: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0b4502e9-9b53-40fa-8e77-8ceb06d7b7df', 'volume_size': 1} Aug 03 08:40:04 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-4ddd9b31-adf0-444d-bb29-7800d3f3b3e7 tempest-VolumeQuotasNegativeTestJSON-1983682387 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:40:04 devstack cinder-volume[88899]: DEBUG cinder.volume.flows.manager.create_volume [None req-c28949d0-7bc6-4f6b-b583-f11d7d68f648 tempest-TestInstancesWithCinderVolumes-1639155420 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88899) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 08:40:04 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-c28949d0-7bc6-4f6b-b583-f11d7d68f648 tempest-TestInstancesWithCinderVolumes-1639155420 None] Flow 'volume_create_manager' (4028a0ad-1531-4c7b-b398-f6d9c54ab732) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:40:04 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-c28949d0-7bc6-4f6b-b583-f11d7d68f648 tempest-TestInstancesWithCinderVolumes-1639155420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84011717-7c03-40b1-9dbb-9bddc7be72c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:40:04 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-c28949d0-7bc6-4f6b-b583-f11d7d68f648 tempest-TestInstancesWithCinderVolumes-1639155420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84011717-7c03-40b1-9dbb-9bddc7be72c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:40:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1770665643',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c98b2e5-cbce-462d-9175-448b45b0470b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b944e91ca3ed4f51b4d01ed374a22fb4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:40:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:40:04Z,use_quota=True,user_id='b017255fb8b84248bd43451f4c58f1f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42aa9940-6ea5-425a-8fa8-6ec4f8d8e6f0),volume_type_id=42aa9940-6ea5-425a-8fa8-6ec4f8d8e6f0)' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:40:04 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-c28949d0-7bc6-4f6b-b583-f11d7d68f648 tempest-TestInstancesWithCinderVolumes-1639155420 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (010c5a9f-43ac-4e70-9436-4ef65b030f91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:40:04 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-c28949d0-7bc6-4f6b-b583-f11d7d68f648 tempest-TestInstancesWithCinderVolumes-1639155420 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (010c5a9f-43ac-4e70-9436-4ef65b030f91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:40:04 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-c28949d0-7bc6-4f6b-b583-f11d7d68f648 tempest-TestInstancesWithCinderVolumes-1639155420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (316614e6-5463-4143-9d71-3e78c3c22a42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:40:04 devstack cinder-volume[88899]: DEBUG cinder.image.glance [None req-c28949d0-7bc6-4f6b-b583-f11d7d68f648 tempest-TestInstancesWithCinderVolumes-1639155420 None] Creating Keystone auth plugin from conf {{(pid=88899) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Aug 03 08:40:04 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-c28949d0-7bc6-4f6b-b583-f11d7d68f648 tempest-TestInstancesWithCinderVolumes-1639155420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (316614e6-5463-4143-9d71-3e78c3c22a42) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '4c98b2e5-cbce-462d-9175-448b45b0470b', 'volume_name': 'volume-4c98b2e5-cbce-462d-9175-448b45b0470b', 'volume_size': 1, 'image_id': 'ace51f9e-97ce-471c-870b-e9eaf443a954', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ace51f9e-97ce-471c-870b-e9eaf443a954', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--365444142', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b944e91ca3ed4f51b4d01ed374a22fb4', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'ace51f9e-97ce-471c-870b-e9eaf443a954', 'created_at': datetime.datetime(2026, 8, 3, 6, 40, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 3, 6, 40, 2, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ace51f9e-97ce-471c-870b-e9eaf443a954/file', 'properties': {}}, 'image_service': }' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:40:04 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-c28949d0-7bc6-4f6b-b583-f11d7d68f648 tempest-TestInstancesWithCinderVolumes-1639155420 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (92d25f76-751c-46be-9898-fd377af4a51b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:40:04 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-c28949d0-7bc6-4f6b-b583-f11d7d68f648 tempest-TestInstancesWithCinderVolumes-1639155420 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (92d25f76-751c-46be-9898-fd377af4a51b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:40:04 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-c28949d0-7bc6-4f6b-b583-f11d7d68f648 tempest-TestInstancesWithCinderVolumes-1639155420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a485eef9-f73e-40ce-8f8e-748abd6c0ddc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:40:04 devstack cinder-volume[88899]: INFO cinder.volume.flows.manager.create_volume [None req-c28949d0-7bc6-4f6b-b583-f11d7d68f648 tempest-TestInstancesWithCinderVolumes-1639155420 None] Volume 4c98b2e5-cbce-462d-9175-448b45b0470b: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-4c98b2e5-cbce-462d-9175-448b45b0470b', 'volume_size': 1, 'image_id': 'ace51f9e-97ce-471c-870b-e9eaf443a954', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ace51f9e-97ce-471c-870b-e9eaf443a954', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--365444142', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b944e91ca3ed4f51b4d01ed374a22fb4', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'ace51f9e-97ce-471c-870b-e9eaf443a954', 'created_at': datetime.datetime(2026, 8, 3, 6, 40, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 3, 6, 40, 2, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ace51f9e-97ce-471c-870b-e9eaf443a954/file', 'properties': {}}, 'image_service': } Aug 03 08:40:04 devstack cinder-volume[88899]: DEBUG cinder.volume.flows.manager.create_volume [None req-c28949d0-7bc6-4f6b-b583-f11d7d68f648 tempest-TestInstancesWithCinderVolumes-1639155420 None] Trying to clone 4c98b2e5-cbce-462d-9175-448b45b0470b from image ace51f9e-97ce-471c-870b-e9eaf443a954 at location (None, [{'url': 'file:///opt/stack/data/glance/images/ace51f9e-97ce-471c-870b-e9eaf443a954', 'metadata': {}}]). {{(pid=88899) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Aug 03 08:40:05 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-6f8f9d03-7536-467d-91f8-5a573428eb05 tempest-SnapshotDataIntegrityTests-1494076589 None] Status of snapshot 7eccf0d3-bff0-4d62-a704-dc41ced4a9ba is now creating {{(pid=88899) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Aug 03 08:40:07 devstack cinder-volume[88899]: DEBUG cinder.image.image_utils [None req-c28949d0-7bc6-4f6b-b583-f11d7d68f648 tempest-TestInstancesWithCinderVolumes-1639155420 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_ace51f9e-97ce-471c-870b-e9eaf443a954_qyx52k0wdevstack@QuobyteHD, size 20.69 MB, duration 3.00 sec {{(pid=88899) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Aug 03 08:40:07 devstack cinder-volume[88899]: INFO cinder.image.image_utils [None req-c28949d0-7bc6-4f6b-b583-f11d7d68f648 tempest-TestInstancesWithCinderVolumes-1639155420 None] Image download 20.69 MB at 6.90 MB/s Aug 03 08:40:07 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[53f917c2-4358-4a4b-a905-8f44c16a198f]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:40:07 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-c28949d0-7bc6-4f6b-b583-f11d7d68f648 tempest-TestInstancesWithCinderVolumes-1639155420 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ace51f9e-97ce-471c-870b-e9eaf443a954_qyx52k0wdevstack@QuobyteHD {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:40:07 devstack sudo[102177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ace51f9e-97ce-471c-870b-e9eaf443a954_qyx52k0wdevstack@QuobyteHD Aug 03 08:40:07 devstack sudo[102177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:40:07 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-6f8f9d03-7536-467d-91f8-5a573428eb05 tempest-SnapshotDataIntegrityTests-1494076589 None] Status of snapshot 7eccf0d3-bff0-4d62-a704-dc41ced4a9ba is now creating {{(pid=88899) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Aug 03 08:40:07 devstack sudo[102177]: pam_unix(sudo:session): session closed for user root Aug 03 08:40:07 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-c28949d0-7bc6-4f6b-b583-f11d7d68f648 tempest-TestInstancesWithCinderVolumes-1639155420 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ace51f9e-97ce-471c-870b-e9eaf443a954_qyx52k0wdevstack@QuobyteHD" returned: 0 in 0.332s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:40:07 devstack cinder-volume[88899]: DEBUG cinder.image.image_utils [None req-c28949d0-7bc6-4f6b-b583-f11d7d68f648 tempest-TestInstancesWithCinderVolumes-1639155420 None] Temporary image ace51f9e-97ce-471c-870b-e9eaf443a954 is fetched for user b017255fb8b84248bd43451f4c58f1f0. {{(pid=88899) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Aug 03 08:40:07 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb6ac02a-1431-442a-a6dc-ba95d00d6147]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:40:07 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-c28949d0-7bc6-4f6b-b583-f11d7d68f648 tempest-TestInstancesWithCinderVolumes-1639155420 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ace51f9e-97ce-471c-870b-e9eaf443a954_qyx52k0wdevstack@QuobyteHD {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:40:07 devstack sudo[102182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ace51f9e-97ce-471c-870b-e9eaf443a954_qyx52k0wdevstack@QuobyteHD Aug 03 08:40:07 devstack sudo[102182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:40:08 devstack sudo[102182]: pam_unix(sudo:session): session closed for user root Aug 03 08:40:08 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-c28949d0-7bc6-4f6b-b583-f11d7d68f648 tempest-TestInstancesWithCinderVolumes-1639155420 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ace51f9e-97ce-471c-870b-e9eaf443a954_qyx52k0wdevstack@QuobyteHD" returned: 0 in 0.346s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:40:08 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-c28949d0-7bc6-4f6b-b583-f11d7d68f648 tempest-TestInstancesWithCinderVolumes-1639155420 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:40:09 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-6f8f9d03-7536-467d-91f8-5a573428eb05 tempest-SnapshotDataIntegrityTests-1494076589 None] Status of snapshot 7eccf0d3-bff0-4d62-a704-dc41ced4a9ba is now creating {{(pid=88899) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Aug 03 08:40:11 devstack cinder-volume[88899]: DEBUG dbcounter [-] [88899] Writing DB stats cinder:SELECT=133,cinder:UPDATE=145,cinder:INSERT=35,cinder:DELETE=6 {{(pid=88899) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 03 08:40:11 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-6f8f9d03-7536-467d-91f8-5a573428eb05 tempest-SnapshotDataIntegrityTests-1494076589 None] Status of snapshot 7eccf0d3-bff0-4d62-a704-dc41ced4a9ba is now creating {{(pid=88899) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Aug 03 08:40:11 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-6f8f9d03-7536-467d-91f8-5a573428eb05 tempest-SnapshotDataIntegrityTests-1494076589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-6bafdd19-6d59-4557-a0e3-17d1fbfc1053.info {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:40:11 devstack sudo[102195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-6bafdd19-6d59-4557-a0e3-17d1fbfc1053.info Aug 03 08:40:11 devstack sudo[102195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:40:12 devstack sudo[102195]: pam_unix(sudo:session): session closed for user root Aug 03 08:40:12 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-6f8f9d03-7536-467d-91f8-5a573428eb05 tempest-SnapshotDataIntegrityTests-1494076589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-6bafdd19-6d59-4557-a0e3-17d1fbfc1053.info" returned: 0 in 0.261s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:40:12 devstack cinder-volume[88899]: WARNING cinder.volume.drivers.remotefs [None req-6f8f9d03-7536-467d-91f8-5a573428eb05 tempest-SnapshotDataIntegrityTests-1494076589 None] /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-6bafdd19-6d59-4557-a0e3-17d1fbfc1053.info is being set with open permissions: ugo+rw Aug 03 08:40:12 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-6f8f9d03-7536-467d-91f8-5a573428eb05 tempest-SnapshotDataIntegrityTests-1494076589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-6bafdd19-6d59-4557-a0e3-17d1fbfc1053.info {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:40:12 devstack sudo[102198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-6bafdd19-6d59-4557-a0e3-17d1fbfc1053.info Aug 03 08:40:12 devstack sudo[102198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:40:12 devstack sudo[102198]: pam_unix(sudo:session): session closed for user root Aug 03 08:40:12 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-6f8f9d03-7536-467d-91f8-5a573428eb05 tempest-SnapshotDataIntegrityTests-1494076589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-6bafdd19-6d59-4557-a0e3-17d1fbfc1053.info" returned: 0 in 0.249s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:40:12 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-6f8f9d03-7536-467d-91f8-5a573428eb05 tempest-SnapshotDataIntegrityTests-1494076589 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 22.567s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:40:12 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-7570df7f-e965-4638-9aba-318fc24b899e tempest-VolumesNegativeTest-1000681371 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 14.412s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:40:12 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-7570df7f-e965-4638-9aba-318fc24b899e tempest-VolumesNegativeTest-1000681371 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:39:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-724344954',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0784ee2d-6c48-4ff6-b809-730aa314fbad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f503a12336d453d9061dbfb05d70131',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:39:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:39:58Z,use_quota=True,user_id='e42a8cbe692549ee833e88f5aaa8c6dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8bde7129-1dc4-42ab-b852-ab32c61b4921),volume_type_id=8bde7129-1dc4-42ab-b852-ab32c61b4921)}" {{(pid=88899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 08:40:12 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-7570df7f-e965-4638-9aba-318fc24b899e tempest-VolumesNegativeTest-1000681371 None] Creating volume 0784ee2d-6c48-4ff6-b809-730aa314fbad {{(pid=88899) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 08:40:12 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-7570df7f-e965-4638-9aba-318fc24b899e tempest-VolumesNegativeTest-1000681371 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:40:12 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-7570df7f-e965-4638-9aba-318fc24b899e tempest-VolumesNegativeTest-1000681371 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:40:12 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-7570df7f-e965-4638-9aba-318fc24b899e tempest-VolumesNegativeTest-1000681371 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:40:12 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-7570df7f-e965-4638-9aba-318fc24b899e tempest-VolumesNegativeTest-1000681371 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:40:12 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-7570df7f-e965-4638-9aba-318fc24b899e tempest-VolumesNegativeTest-1000681371 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:40:12 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-7570df7f-e965-4638-9aba-318fc24b899e tempest-VolumesNegativeTest-1000681371 None] Selected osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385 as target Quobyte volume. {{(pid=88899) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 08:40:12 devstack cinder-volume[88899]: INFO cinder.volume.drivers.remotefs [None req-7570df7f-e965-4638-9aba-318fc24b899e tempest-VolumesNegativeTest-1000681371 None] casted to osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385 Aug 03 08:40:12 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-7570df7f-e965-4638-9aba-318fc24b899e tempest-VolumesNegativeTest-1000681371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-0784ee2d-6c48-4ff6-b809-730aa314fbad 1073741824 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:40:12 devstack sudo[102201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-0784ee2d-6c48-4ff6-b809-730aa314fbad 1073741824 Aug 03 08:40:12 devstack sudo[102201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:40:12 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-6f8f9d03-7536-467d-91f8-5a573428eb05 tempest-SnapshotDataIntegrityTests-1494076589 None] Create snapshot completed successfully Aug 03 08:40:12 devstack sudo[102201]: pam_unix(sudo:session): session closed for user root Aug 03 08:40:12 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-7570df7f-e965-4638-9aba-318fc24b899e tempest-VolumesNegativeTest-1000681371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-0784ee2d-6c48-4ff6-b809-730aa314fbad 1073741824" returned: 0 in 0.427s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:40:12 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-7570df7f-e965-4638-9aba-318fc24b899e tempest-VolumesNegativeTest-1000681371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-0784ee2d-6c48-4ff6-b809-730aa314fbad {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:40:12 devstack sudo[102206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-0784ee2d-6c48-4ff6-b809-730aa314fbad Aug 03 08:40:12 devstack sudo[102206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:40:13 devstack sudo[102206]: pam_unix(sudo:session): session closed for user root Aug 03 08:40:13 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-7570df7f-e965-4638-9aba-318fc24b899e tempest-VolumesNegativeTest-1000681371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-0784ee2d-6c48-4ff6-b809-730aa314fbad" returned: 0 in 0.255s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:40:13 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-7570df7f-e965-4638-9aba-318fc24b899e tempest-VolumesNegativeTest-1000681371 None] <== create_volume: return (724ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'} {{(pid=88899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 08:40:13 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-7570df7f-e965-4638-9aba-318fc24b899e tempest-VolumesNegativeTest-1000681371 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.728s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:40:13 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-c294c96f-26e5-430f-856e-5d774b3b639d tempest-TestInstancesWithCinderVolumes-1639155420 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.229s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:40:13 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-c294c96f-26e5-430f-856e-5d774b3b639d tempest-TestInstancesWithCinderVolumes-1639155420 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:40:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-745521128',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a673b8d7-ba1a-4e56-9cfa-9e35c6fc2587,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b944e91ca3ed4f51b4d01ed374a22fb4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:40:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:40:03Z,use_quota=True,user_id='b017255fb8b84248bd43451f4c58f1f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d8d028de-8c4e-4cc0-87da-7ab28c37d8c6),volume_type_id=d8d028de-8c4e-4cc0-87da-7ab28c37d8c6)}" {{(pid=88899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 08:40:13 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-c294c96f-26e5-430f-856e-5d774b3b639d tempest-TestInstancesWithCinderVolumes-1639155420 None] Creating volume a673b8d7-ba1a-4e56-9cfa-9e35c6fc2587 {{(pid=88899) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 08:40:13 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-c294c96f-26e5-430f-856e-5d774b3b639d tempest-TestInstancesWithCinderVolumes-1639155420 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:40:13 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-c294c96f-26e5-430f-856e-5d774b3b639d tempest-TestInstancesWithCinderVolumes-1639155420 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:40:13 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-c294c96f-26e5-430f-856e-5d774b3b639d tempest-TestInstancesWithCinderVolumes-1639155420 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:40:13 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-c294c96f-26e5-430f-856e-5d774b3b639d tempest-TestInstancesWithCinderVolumes-1639155420 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:40:13 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-c294c96f-26e5-430f-856e-5d774b3b639d tempest-TestInstancesWithCinderVolumes-1639155420 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:40:13 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-c294c96f-26e5-430f-856e-5d774b3b639d tempest-TestInstancesWithCinderVolumes-1639155420 None] Selected osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385 as target Quobyte volume. {{(pid=88899) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 08:40:13 devstack cinder-volume[88899]: INFO cinder.volume.drivers.remotefs [None req-c294c96f-26e5-430f-856e-5d774b3b639d tempest-TestInstancesWithCinderVolumes-1639155420 None] casted to osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385 Aug 03 08:40:13 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-c294c96f-26e5-430f-856e-5d774b3b639d tempest-TestInstancesWithCinderVolumes-1639155420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-a673b8d7-ba1a-4e56-9cfa-9e35c6fc2587 1073741824 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:40:13 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-7570df7f-e965-4638-9aba-318fc24b899e tempest-VolumesNegativeTest-1000681371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (178e7f87-da1d-4a99-8959-3a06896c8ece) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0784ee2d-6c48-4ff6-b809-730aa314fbad', 'volume_size': 1}' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:40:13 devstack sudo[102213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-a673b8d7-ba1a-4e56-9cfa-9e35c6fc2587 1073741824 Aug 03 08:40:13 devstack sudo[102213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:40:13 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-7570df7f-e965-4638-9aba-318fc24b899e tempest-VolumesNegativeTest-1000681371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53e745cb-4558-4fd9-95f0-b80c7d707aba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:40:13 devstack cinder-volume[88899]: INFO cinder.volume.flows.manager.create_volume [None req-7570df7f-e965-4638-9aba-318fc24b899e tempest-VolumesNegativeTest-1000681371 None] Volume volume-0784ee2d-6c48-4ff6-b809-730aa314fbad (0784ee2d-6c48-4ff6-b809-730aa314fbad): created successfully Aug 03 08:40:13 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-7570df7f-e965-4638-9aba-318fc24b899e tempest-VolumesNegativeTest-1000681371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53e745cb-4558-4fd9-95f0-b80c7d707aba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:40:13 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-7570df7f-e965-4638-9aba-318fc24b899e tempest-VolumesNegativeTest-1000681371 None] Flow 'volume_create_manager' (3c4954d5-d330-4aa9-94c3-d9f07419df04) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:40:13 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-7570df7f-e965-4638-9aba-318fc24b899e tempest-VolumesNegativeTest-1000681371 None] Created volume successfully. Aug 03 08:40:13 devstack sudo[102213]: pam_unix(sudo:session): session closed for user root Aug 03 08:40:13 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-c294c96f-26e5-430f-856e-5d774b3b639d tempest-TestInstancesWithCinderVolumes-1639155420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-a673b8d7-ba1a-4e56-9cfa-9e35c6fc2587 1073741824" returned: 0 in 0.510s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:40:13 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-c294c96f-26e5-430f-856e-5d774b3b639d tempest-TestInstancesWithCinderVolumes-1639155420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-a673b8d7-ba1a-4e56-9cfa-9e35c6fc2587 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:40:13 devstack sudo[102225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-a673b8d7-ba1a-4e56-9cfa-9e35c6fc2587 Aug 03 08:40:13 devstack sudo[102225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:40:13 devstack sudo[102225]: pam_unix(sudo:session): session closed for user root Aug 03 08:40:13 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-c294c96f-26e5-430f-856e-5d774b3b639d tempest-TestInstancesWithCinderVolumes-1639155420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-a673b8d7-ba1a-4e56-9cfa-9e35c6fc2587" returned: 0 in 0.313s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:40:13 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-c294c96f-26e5-430f-856e-5d774b3b639d tempest-TestInstancesWithCinderVolumes-1639155420 None] <== create_volume: return (876ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'} {{(pid=88899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 08:40:13 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-c294c96f-26e5-430f-856e-5d774b3b639d tempest-TestInstancesWithCinderVolumes-1639155420 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.879s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:40:13 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-d25ac67b-f888-402f-87f3-ea701acdc509 tempest-TestInstancesWithCinderVolumes-1639155420 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.683s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:40:13 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-d25ac67b-f888-402f-87f3-ea701acdc509 tempest-TestInstancesWithCinderVolumes-1639155420 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:40:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1399211073',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3261e91f-070b-4599-a2ac-b8ca735be47a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b944e91ca3ed4f51b4d01ed374a22fb4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:40:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:40:03Z,use_quota=True,user_id='b017255fb8b84248bd43451f4c58f1f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(556c57d7-580e-425f-ad42-0e4d245129da),volume_type_id=556c57d7-580e-425f-ad42-0e4d245129da)}" {{(pid=88899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 08:40:13 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-d25ac67b-f888-402f-87f3-ea701acdc509 tempest-TestInstancesWithCinderVolumes-1639155420 None] Creating volume 3261e91f-070b-4599-a2ac-b8ca735be47a {{(pid=88899) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 08:40:13 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-d25ac67b-f888-402f-87f3-ea701acdc509 tempest-TestInstancesWithCinderVolumes-1639155420 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:40:13 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-d25ac67b-f888-402f-87f3-ea701acdc509 tempest-TestInstancesWithCinderVolumes-1639155420 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:40:13 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-d25ac67b-f888-402f-87f3-ea701acdc509 tempest-TestInstancesWithCinderVolumes-1639155420 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:40:13 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-d25ac67b-f888-402f-87f3-ea701acdc509 tempest-TestInstancesWithCinderVolumes-1639155420 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:40:13 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-d25ac67b-f888-402f-87f3-ea701acdc509 tempest-TestInstancesWithCinderVolumes-1639155420 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:40:13 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-d25ac67b-f888-402f-87f3-ea701acdc509 tempest-TestInstancesWithCinderVolumes-1639155420 None] Selected osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385 as target Quobyte volume. {{(pid=88899) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 08:40:13 devstack cinder-volume[88899]: INFO cinder.volume.drivers.remotefs [None req-d25ac67b-f888-402f-87f3-ea701acdc509 tempest-TestInstancesWithCinderVolumes-1639155420 None] casted to osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385 Aug 03 08:40:13 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-d25ac67b-f888-402f-87f3-ea701acdc509 tempest-TestInstancesWithCinderVolumes-1639155420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-3261e91f-070b-4599-a2ac-b8ca735be47a 1073741824 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:40:13 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-7461d70f-5731-4fbb-bfd9-fc6d2f95c777 tempest-SnapshotDataIntegrityTests-1494076589 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:40:13 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-c294c96f-26e5-430f-856e-5d774b3b639d tempest-TestInstancesWithCinderVolumes-1639155420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f49101a-7e70-4939-a1be-d2810778928a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a673b8d7-ba1a-4e56-9cfa-9e35c6fc2587', 'volume_size': 1}' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:40:13 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-c294c96f-26e5-430f-856e-5d774b3b639d tempest-TestInstancesWithCinderVolumes-1639155420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa3291eb-be9d-4f89-a5b0-5b156612ca3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:40:13 devstack sudo[102228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-3261e91f-070b-4599-a2ac-b8ca735be47a 1073741824 Aug 03 08:40:13 devstack sudo[102228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:40:13 devstack cinder-volume[88899]: INFO cinder.volume.flows.manager.create_volume [None req-c294c96f-26e5-430f-856e-5d774b3b639d tempest-TestInstancesWithCinderVolumes-1639155420 None] Volume volume-a673b8d7-ba1a-4e56-9cfa-9e35c6fc2587 (a673b8d7-ba1a-4e56-9cfa-9e35c6fc2587): created successfully Aug 03 08:40:13 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-c294c96f-26e5-430f-856e-5d774b3b639d tempest-TestInstancesWithCinderVolumes-1639155420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa3291eb-be9d-4f89-a5b0-5b156612ca3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:40:13 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-c294c96f-26e5-430f-856e-5d774b3b639d tempest-TestInstancesWithCinderVolumes-1639155420 None] Flow 'volume_create_manager' (0d8197a2-9779-403f-9ddc-b4ef46dee2b8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:40:14 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-c294c96f-26e5-430f-856e-5d774b3b639d tempest-TestInstancesWithCinderVolumes-1639155420 None] Created volume successfully. Aug 03 08:40:14 devstack sudo[102228]: pam_unix(sudo:session): session closed for user root Aug 03 08:40:14 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-d25ac67b-f888-402f-87f3-ea701acdc509 tempest-TestInstancesWithCinderVolumes-1639155420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-3261e91f-070b-4599-a2ac-b8ca735be47a 1073741824" returned: 0 in 0.537s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:40:14 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-d25ac67b-f888-402f-87f3-ea701acdc509 tempest-TestInstancesWithCinderVolumes-1639155420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-3261e91f-070b-4599-a2ac-b8ca735be47a {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:40:14 devstack sudo[102237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-3261e91f-070b-4599-a2ac-b8ca735be47a Aug 03 08:40:14 devstack sudo[102237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:40:14 devstack sudo[102237]: pam_unix(sudo:session): session closed for user root Aug 03 08:40:14 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-d25ac67b-f888-402f-87f3-ea701acdc509 tempest-TestInstancesWithCinderVolumes-1639155420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-3261e91f-070b-4599-a2ac-b8ca735be47a" returned: 0 in 0.250s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:40:14 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-d25ac67b-f888-402f-87f3-ea701acdc509 tempest-TestInstancesWithCinderVolumes-1639155420 None] <== create_volume: return (838ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'} {{(pid=88899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 08:40:14 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-d25ac67b-f888-402f-87f3-ea701acdc509 tempest-TestInstancesWithCinderVolumes-1639155420 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.845s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:40:14 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-4ddd9b31-adf0-444d-bb29-7800d3f3b3e7 tempest-VolumeQuotasNegativeTestJSON-1983682387 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.768s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:40:14 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-4ddd9b31-adf0-444d-bb29-7800d3f3b3e7 tempest-VolumeQuotasNegativeTestJSON-1983682387 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:40:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-101895607',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b4502e9-9b53-40fa-8e77-8ceb06d7b7df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4a3e3d4931164f6689c505a74dea35df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:40:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:40:04Z,use_quota=True,user_id='f0604e86cb64461aba0c66dbb1d53d44',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8bde7129-1dc4-42ab-b852-ab32c61b4921),volume_type_id=8bde7129-1dc4-42ab-b852-ab32c61b4921)}" {{(pid=88899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 08:40:14 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-4ddd9b31-adf0-444d-bb29-7800d3f3b3e7 tempest-VolumeQuotasNegativeTestJSON-1983682387 None] Creating volume 0b4502e9-9b53-40fa-8e77-8ceb06d7b7df {{(pid=88899) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 08:40:14 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-4ddd9b31-adf0-444d-bb29-7800d3f3b3e7 tempest-VolumeQuotasNegativeTestJSON-1983682387 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:40:14 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-4ddd9b31-adf0-444d-bb29-7800d3f3b3e7 tempest-VolumeQuotasNegativeTestJSON-1983682387 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:40:14 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-4ddd9b31-adf0-444d-bb29-7800d3f3b3e7 tempest-VolumeQuotasNegativeTestJSON-1983682387 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:40:14 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-4ddd9b31-adf0-444d-bb29-7800d3f3b3e7 tempest-VolumeQuotasNegativeTestJSON-1983682387 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:40:14 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-4ddd9b31-adf0-444d-bb29-7800d3f3b3e7 tempest-VolumeQuotasNegativeTestJSON-1983682387 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:40:14 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-4ddd9b31-adf0-444d-bb29-7800d3f3b3e7 tempest-VolumeQuotasNegativeTestJSON-1983682387 None] Selected osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385 as target Quobyte volume. {{(pid=88899) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 08:40:14 devstack cinder-volume[88899]: INFO cinder.volume.drivers.remotefs [None req-4ddd9b31-adf0-444d-bb29-7800d3f3b3e7 tempest-VolumeQuotasNegativeTestJSON-1983682387 None] casted to osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385 Aug 03 08:40:14 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-4ddd9b31-adf0-444d-bb29-7800d3f3b3e7 tempest-VolumeQuotasNegativeTestJSON-1983682387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-0b4502e9-9b53-40fa-8e77-8ceb06d7b7df 1073741824 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:40:14 devstack sudo[102240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-0b4502e9-9b53-40fa-8e77-8ceb06d7b7df 1073741824 Aug 03 08:40:14 devstack sudo[102240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:40:14 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-d25ac67b-f888-402f-87f3-ea701acdc509 tempest-TestInstancesWithCinderVolumes-1639155420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cbce7d0d-4450-403c-8c70-679341795154) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3261e91f-070b-4599-a2ac-b8ca735be47a', 'volume_size': 1}' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:40:14 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-d25ac67b-f888-402f-87f3-ea701acdc509 tempest-TestInstancesWithCinderVolumes-1639155420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eadcc1cb-8aae-4a32-a844-20f66bec3121) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:40:14 devstack cinder-volume[88899]: INFO cinder.volume.flows.manager.create_volume [None req-d25ac67b-f888-402f-87f3-ea701acdc509 tempest-TestInstancesWithCinderVolumes-1639155420 None] Volume volume-3261e91f-070b-4599-a2ac-b8ca735be47a (3261e91f-070b-4599-a2ac-b8ca735be47a): created successfully Aug 03 08:40:14 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-d25ac67b-f888-402f-87f3-ea701acdc509 tempest-TestInstancesWithCinderVolumes-1639155420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eadcc1cb-8aae-4a32-a844-20f66bec3121) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:40:14 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-d25ac67b-f888-402f-87f3-ea701acdc509 tempest-TestInstancesWithCinderVolumes-1639155420 None] Flow 'volume_create_manager' (e3fdc65a-af03-42b3-a41b-b4eeb321a318) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:40:14 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-d25ac67b-f888-402f-87f3-ea701acdc509 tempest-TestInstancesWithCinderVolumes-1639155420 None] Created volume successfully. Aug 03 08:40:15 devstack sudo[102240]: pam_unix(sudo:session): session closed for user root Aug 03 08:40:15 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-4ddd9b31-adf0-444d-bb29-7800d3f3b3e7 tempest-VolumeQuotasNegativeTestJSON-1983682387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-0b4502e9-9b53-40fa-8e77-8ceb06d7b7df 1073741824" returned: 0 in 0.531s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:40:15 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-4ddd9b31-adf0-444d-bb29-7800d3f3b3e7 tempest-VolumeQuotasNegativeTestJSON-1983682387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-0b4502e9-9b53-40fa-8e77-8ceb06d7b7df {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:40:15 devstack sudo[102246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-0b4502e9-9b53-40fa-8e77-8ceb06d7b7df Aug 03 08:40:15 devstack sudo[102246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:40:15 devstack sudo[102246]: pam_unix(sudo:session): session closed for user root Aug 03 08:40:15 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-4ddd9b31-adf0-444d-bb29-7800d3f3b3e7 tempest-VolumeQuotasNegativeTestJSON-1983682387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-0b4502e9-9b53-40fa-8e77-8ceb06d7b7df" returned: 0 in 0.297s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:40:15 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-4ddd9b31-adf0-444d-bb29-7800d3f3b3e7 tempest-VolumeQuotasNegativeTestJSON-1983682387 None] <== create_volume: return (873ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'} {{(pid=88899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 08:40:15 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-4ddd9b31-adf0-444d-bb29-7800d3f3b3e7 tempest-VolumeQuotasNegativeTestJSON-1983682387 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.877s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:40:15 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-c28949d0-7bc6-4f6b-b583-f11d7d68f648 tempest-TestInstancesWithCinderVolumes-1639155420 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.460s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:40:15 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-c28949d0-7bc6-4f6b-b583-f11d7d68f648 tempest-TestInstancesWithCinderVolumes-1639155420 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:40:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1770665643',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c98b2e5-cbce-462d-9175-448b45b0470b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b944e91ca3ed4f51b4d01ed374a22fb4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:40:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:40:04Z,use_quota=True,user_id='b017255fb8b84248bd43451f4c58f1f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42aa9940-6ea5-425a-8fa8-6ec4f8d8e6f0),volume_type_id=42aa9940-6ea5-425a-8fa8-6ec4f8d8e6f0)}" {{(pid=88899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 08:40:15 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-c28949d0-7bc6-4f6b-b583-f11d7d68f648 tempest-TestInstancesWithCinderVolumes-1639155420 None] Creating volume 4c98b2e5-cbce-462d-9175-448b45b0470b {{(pid=88899) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 08:40:15 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-c28949d0-7bc6-4f6b-b583-f11d7d68f648 tempest-TestInstancesWithCinderVolumes-1639155420 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:40:15 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-c28949d0-7bc6-4f6b-b583-f11d7d68f648 tempest-TestInstancesWithCinderVolumes-1639155420 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:40:15 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-c28949d0-7bc6-4f6b-b583-f11d7d68f648 tempest-TestInstancesWithCinderVolumes-1639155420 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:40:15 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-c28949d0-7bc6-4f6b-b583-f11d7d68f648 tempest-TestInstancesWithCinderVolumes-1639155420 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:40:15 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-c28949d0-7bc6-4f6b-b583-f11d7d68f648 tempest-TestInstancesWithCinderVolumes-1639155420 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:40:15 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-c28949d0-7bc6-4f6b-b583-f11d7d68f648 tempest-TestInstancesWithCinderVolumes-1639155420 None] Selected osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385 as target Quobyte volume. {{(pid=88899) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 08:40:15 devstack cinder-volume[88899]: INFO cinder.volume.drivers.remotefs [None req-c28949d0-7bc6-4f6b-b583-f11d7d68f648 tempest-TestInstancesWithCinderVolumes-1639155420 None] casted to osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385 Aug 03 08:40:15 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-c28949d0-7bc6-4f6b-b583-f11d7d68f648 tempest-TestInstancesWithCinderVolumes-1639155420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-4c98b2e5-cbce-462d-9175-448b45b0470b 1073741824 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:40:15 devstack sudo[102249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-4c98b2e5-cbce-462d-9175-448b45b0470b 1073741824 Aug 03 08:40:15 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-4ddd9b31-adf0-444d-bb29-7800d3f3b3e7 tempest-VolumeQuotasNegativeTestJSON-1983682387 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20e2d300-fc1c-4b8b-a48f-0a9e95816f26) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0b4502e9-9b53-40fa-8e77-8ceb06d7b7df', 'volume_size': 1}' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:40:15 devstack sudo[102249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:40:15 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-4ddd9b31-adf0-444d-bb29-7800d3f3b3e7 tempest-VolumeQuotasNegativeTestJSON-1983682387 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6fe2389c-580e-45c3-b0db-beca0abaf5af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:40:15 devstack cinder-volume[88899]: INFO cinder.volume.flows.manager.create_volume [None req-4ddd9b31-adf0-444d-bb29-7800d3f3b3e7 tempest-VolumeQuotasNegativeTestJSON-1983682387 None] Volume volume-0b4502e9-9b53-40fa-8e77-8ceb06d7b7df (0b4502e9-9b53-40fa-8e77-8ceb06d7b7df): created successfully Aug 03 08:40:15 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-4ddd9b31-adf0-444d-bb29-7800d3f3b3e7 tempest-VolumeQuotasNegativeTestJSON-1983682387 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6fe2389c-580e-45c3-b0db-beca0abaf5af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:40:15 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-4ddd9b31-adf0-444d-bb29-7800d3f3b3e7 tempest-VolumeQuotasNegativeTestJSON-1983682387 None] Flow 'volume_create_manager' (ba662208-79d7-4dc4-845f-da5fdd61a62e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:40:15 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-4ddd9b31-adf0-444d-bb29-7800d3f3b3e7 tempest-VolumeQuotasNegativeTestJSON-1983682387 None] Created volume successfully. Aug 03 08:40:16 devstack sudo[102249]: pam_unix(sudo:session): session closed for user root Aug 03 08:40:16 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-c28949d0-7bc6-4f6b-b583-f11d7d68f648 tempest-TestInstancesWithCinderVolumes-1639155420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-4c98b2e5-cbce-462d-9175-448b45b0470b 1073741824" returned: 0 in 0.626s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:40:16 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-c28949d0-7bc6-4f6b-b583-f11d7d68f648 tempest-TestInstancesWithCinderVolumes-1639155420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-4c98b2e5-cbce-462d-9175-448b45b0470b {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:40:16 devstack sudo[102265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-4c98b2e5-cbce-462d-9175-448b45b0470b Aug 03 08:40:16 devstack sudo[102265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:40:16 devstack sudo[102265]: pam_unix(sudo:session): session closed for user root Aug 03 08:40:16 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-c28949d0-7bc6-4f6b-b583-f11d7d68f648 tempest-TestInstancesWithCinderVolumes-1639155420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-4c98b2e5-cbce-462d-9175-448b45b0470b" returned: 0 in 0.349s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:40:16 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-c28949d0-7bc6-4f6b-b583-f11d7d68f648 tempest-TestInstancesWithCinderVolumes-1639155420 None] <== create_volume: return (1054ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'} {{(pid=88899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 08:40:16 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-c28949d0-7bc6-4f6b-b583-f11d7d68f648 tempest-TestInstancesWithCinderVolumes-1639155420 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.060s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:40:16 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-7461d70f-5731-4fbb-bfd9-fc6d2f95c777 tempest-SnapshotDataIntegrityTests-1494076589 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.766s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:40:16 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-7461d70f-5731-4fbb-bfd9-fc6d2f95c777 tempest-SnapshotDataIntegrityTests-1494076589 None] Creating online snapshot ef70e01c-7a59-4ac6-a705-f98e01473350 of volume 6bafdd19-6d59-4557-a0e3-17d1fbfc1053 {{(pid=88899) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 03 08:40:16 devstack cinder-volume[88899]: DEBUG cinder.volume.volume_utils [None req-c28949d0-7bc6-4f6b-b583-f11d7d68f648 tempest-TestInstancesWithCinderVolumes-1639155420 None] Attempting download of ace51f9e-97ce-471c-870b-e9eaf443a954 ((None, [{'url': 'file:///opt/stack/data/glance/images/ace51f9e-97ce-471c-870b-e9eaf443a954', 'metadata': {}}])) to volume 4c98b2e5-cbce-462d-9175-448b45b0470b. {{(pid=88899) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Aug 03 08:40:16 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea52a1bd-5abb-495f-aead-6d9591c680d4]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:40:16 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-7461d70f-5731-4fbb-bfd9-fc6d2f95c777 tempest-SnapshotDataIntegrityTests-1494076589 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-6bafdd19-6d59-4557-a0e3-17d1fbfc1053.7eccf0d3-bff0-4d62-a704-dc41ced4a9ba {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:40:16 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[2278fba1-ab0d-4efe-a0f1-77bfc01b47cc]: (4, 'raw') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:40:16 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-c28949d0-7bc6-4f6b-b583-f11d7d68f648 tempest-TestInstancesWithCinderVolumes-1639155420 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ace51f9e-97ce-471c-870b-e9eaf443a954_2jpd12e8 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:40:16 devstack sudo[102273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-6bafdd19-6d59-4557-a0e3-17d1fbfc1053.7eccf0d3-bff0-4d62-a704-dc41ced4a9ba Aug 03 08:40:17 devstack sudo[102273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:40:17 devstack sudo[102274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ace51f9e-97ce-471c-870b-e9eaf443a954_2jpd12e8 Aug 03 08:40:17 devstack sudo[102274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:40:17 devstack sudo[102273]: pam_unix(sudo:session): session closed for user root Aug 03 08:40:17 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-7461d70f-5731-4fbb-bfd9-fc6d2f95c777 tempest-SnapshotDataIntegrityTests-1494076589 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-6bafdd19-6d59-4557-a0e3-17d1fbfc1053.7eccf0d3-bff0-4d62-a704-dc41ced4a9ba" returned: 0 in 0.557s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:40:17 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-7461d70f-5731-4fbb-bfd9-fc6d2f95c777 tempest-SnapshotDataIntegrityTests-1494076589 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6bafdd19-6d59-4557-a0e3-17d1fbfc1053(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88899) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 03 08:40:17 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-7461d70f-5731-4fbb-bfd9-fc6d2f95c777 tempest-SnapshotDataIntegrityTests-1494076589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-6bafdd19-6d59-4557-a0e3-17d1fbfc1053.7eccf0d3-bff0-4d62-a704-dc41ced4a9ba,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-6bafdd19-6d59-4557-a0e3-17d1fbfc1053.ef70e01c-7a59-4ac6-a705-f98e01473350 1G {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:40:17 devstack sudo[102274]: pam_unix(sudo:session): session closed for user root Aug 03 08:40:17 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-c28949d0-7bc6-4f6b-b583-f11d7d68f648 tempest-TestInstancesWithCinderVolumes-1639155420 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ace51f9e-97ce-471c-870b-e9eaf443a954_2jpd12e8" returned: 0 in 0.520s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:40:17 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-c28949d0-7bc6-4f6b-b583-f11d7d68f648 tempest-TestInstancesWithCinderVolumes-1639155420 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ace51f9e-97ce-471c-870b-e9eaf443a954_2jpd12e8 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:40:17 devstack sudo[102283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-6bafdd19-6d59-4557-a0e3-17d1fbfc1053.7eccf0d3-bff0-4d62-a704-dc41ced4a9ba,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-6bafdd19-6d59-4557-a0e3-17d1fbfc1053.ef70e01c-7a59-4ac6-a705-f98e01473350 1G Aug 03 08:40:17 devstack sudo[102283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:40:17 devstack sudo[102285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ace51f9e-97ce-471c-870b-e9eaf443a954_2jpd12e8 Aug 03 08:40:17 devstack sudo[102285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:40:17 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-e46d30b7-2203-4d95-9605-54b858c7265c tempest-VolumeQuotasNegativeTestJSON-1983682387 None] Acquiring lock "cinder-0b4502e9-9b53-40fa-8e77-8ceb06d7b7df-delete_volume" by "delete_volume" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:40:17 devstack sudo[102285]: pam_unix(sudo:session): session closed for user root Aug 03 08:40:17 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-c28949d0-7bc6-4f6b-b583-f11d7d68f648 tempest-TestInstancesWithCinderVolumes-1639155420 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ace51f9e-97ce-471c-870b-e9eaf443a954_2jpd12e8" returned: 1 in 0.494s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:40:17 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-c28949d0-7bc6-4f6b-b583-f11d7d68f648 tempest-TestInstancesWithCinderVolumes-1639155420 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ace51f9e-97ce-471c-870b-e9eaf443a954_2jpd12e8' failed. Not Retrying. {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 03 08:40:17 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[35cec4d8-0c4f-40ff-849b-9fdc4edce37e]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:40:17 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-c28949d0-7bc6-4f6b-b583-f11d7d68f648 tempest-TestInstancesWithCinderVolumes-1639155420 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ace51f9e-97ce-471c-870b-e9eaf443a954_qyx52k0wdevstack@QuobyteHD {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:40:17 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-e46d30b7-2203-4d95-9605-54b858c7265c tempest-VolumeQuotasNegativeTestJSON-1983682387 None] Lock "cinder-0b4502e9-9b53-40fa-8e77-8ceb06d7b7df-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:40:18 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-e46d30b7-2203-4d95-9605-54b858c7265c tempest-VolumeQuotasNegativeTestJSON-1983682387 None] Acquiring lock "cinder-quobyte-0b4502e9-9b53-40fa-8e77-8ceb06d7b7df" by "delete_volume" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:40:18 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-e46d30b7-2203-4d95-9605-54b858c7265c tempest-VolumeQuotasNegativeTestJSON-1983682387 None] Lock "cinder-quobyte-0b4502e9-9b53-40fa-8e77-8ceb06d7b7df" acquired by "delete_volume" :: waited 0.029s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:40:18 devstack sudo[102283]: pam_unix(sudo:session): session closed for user root Aug 03 08:40:18 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-7461d70f-5731-4fbb-bfd9-fc6d2f95c777 tempest-SnapshotDataIntegrityTests-1494076589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-6bafdd19-6d59-4557-a0e3-17d1fbfc1053.7eccf0d3-bff0-4d62-a704-dc41ced4a9ba,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-6bafdd19-6d59-4557-a0e3-17d1fbfc1053.ef70e01c-7a59-4ac6-a705-f98e01473350 1G" returned: 0 in 0.660s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:40:18 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-7461d70f-5731-4fbb-bfd9-fc6d2f95c777 tempest-SnapshotDataIntegrityTests-1494076589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6bafdd19-6d59-4557-a0e3-17d1fbfc1053.7eccf0d3-bff0-4d62-a704-dc41ced4a9ba -F qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-6bafdd19-6d59-4557-a0e3-17d1fbfc1053.ef70e01c-7a59-4ac6-a705-f98e01473350 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:40:18 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b1d7617-53ae-46c5-b1d0-cf35825f452d]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:40:18 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-e46d30b7-2203-4d95-9605-54b858c7265c tempest-VolumeQuotasNegativeTestJSON-1983682387 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-0b4502e9-9b53-40fa-8e77-8ceb06d7b7df {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:40:18 devstack sudo[102293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ace51f9e-97ce-471c-870b-e9eaf443a954_qyx52k0wdevstack@QuobyteHD Aug 03 08:40:18 devstack sudo[102293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:40:18 devstack sudo[102295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6bafdd19-6d59-4557-a0e3-17d1fbfc1053.7eccf0d3-bff0-4d62-a704-dc41ced4a9ba -F qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-6bafdd19-6d59-4557-a0e3-17d1fbfc1053.ef70e01c-7a59-4ac6-a705-f98e01473350 Aug 03 08:40:18 devstack sudo[102295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:40:18 devstack sudo[102296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-0b4502e9-9b53-40fa-8e77-8ceb06d7b7df Aug 03 08:40:18 devstack sudo[102296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:40:18 devstack sudo[102293]: pam_unix(sudo:session): session closed for user root Aug 03 08:40:18 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-c28949d0-7bc6-4f6b-b583-f11d7d68f648 tempest-TestInstancesWithCinderVolumes-1639155420 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ace51f9e-97ce-471c-870b-e9eaf443a954_qyx52k0wdevstack@QuobyteHD" returned: 0 in 0.485s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:40:18 devstack cinder-volume[88899]: DEBUG cinder.image.image_utils [None req-c28949d0-7bc6-4f6b-b583-f11d7d68f648 tempest-TestInstancesWithCinderVolumes-1639155420 None] ace51f9e-97ce-471c-870b-e9eaf443a954 was qcow2, converting to qcow2 {{(pid=88899) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Aug 03 08:40:18 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-c28949d0-7bc6-4f6b-b583-f11d7d68f648 tempest-TestInstancesWithCinderVolumes-1639155420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_ace51f9e-97ce-471c-870b-e9eaf443a954_qyx52k0wdevstack@QuobyteHD /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-4c98b2e5-cbce-462d-9175-448b45b0470b {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:40:18 devstack sudo[102295]: pam_unix(sudo:session): session closed for user root Aug 03 08:40:18 devstack sudo[102306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_ace51f9e-97ce-471c-870b-e9eaf443a954_qyx52k0wdevstack@QuobyteHD /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-4c98b2e5-cbce-462d-9175-448b45b0470b Aug 03 08:40:18 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-7461d70f-5731-4fbb-bfd9-fc6d2f95c777 tempest-SnapshotDataIntegrityTests-1494076589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6bafdd19-6d59-4557-a0e3-17d1fbfc1053.7eccf0d3-bff0-4d62-a704-dc41ced4a9ba -F qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-6bafdd19-6d59-4557-a0e3-17d1fbfc1053.ef70e01c-7a59-4ac6-a705-f98e01473350" returned: 0 in 0.399s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:40:18 devstack cinder-volume[88899]: WARNING cinder.volume.drivers.remotefs [None req-7461d70f-5731-4fbb-bfd9-fc6d2f95c777 tempest-SnapshotDataIntegrityTests-1494076589 None] /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-6bafdd19-6d59-4557-a0e3-17d1fbfc1053.ef70e01c-7a59-4ac6-a705-f98e01473350 is being set with open permissions: ugo+rw Aug 03 08:40:18 devstack sudo[102306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:40:18 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-7461d70f-5731-4fbb-bfd9-fc6d2f95c777 tempest-SnapshotDataIntegrityTests-1494076589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-6bafdd19-6d59-4557-a0e3-17d1fbfc1053.ef70e01c-7a59-4ac6-a705-f98e01473350 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:40:18 devstack sudo[102308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-6bafdd19-6d59-4557-a0e3-17d1fbfc1053.ef70e01c-7a59-4ac6-a705-f98e01473350 Aug 03 08:40:18 devstack sudo[102308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:40:18 devstack sudo[102296]: pam_unix(sudo:session): session closed for user root Aug 03 08:40:18 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-e46d30b7-2203-4d95-9605-54b858c7265c tempest-VolumeQuotasNegativeTestJSON-1983682387 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-0b4502e9-9b53-40fa-8e77-8ceb06d7b7df" returned: 0 in 0.547s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:40:18 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-e46d30b7-2203-4d95-9605-54b858c7265c tempest-VolumeQuotasNegativeTestJSON-1983682387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-0b4502e9-9b53-40fa-8e77-8ceb06d7b7df {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:40:18 devstack sudo[102313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-0b4502e9-9b53-40fa-8e77-8ceb06d7b7df Aug 03 08:40:18 devstack sudo[102313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:40:18 devstack sudo[102308]: pam_unix(sudo:session): session closed for user root Aug 03 08:40:18 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-7461d70f-5731-4fbb-bfd9-fc6d2f95c777 tempest-SnapshotDataIntegrityTests-1494076589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-6bafdd19-6d59-4557-a0e3-17d1fbfc1053.ef70e01c-7a59-4ac6-a705-f98e01473350" returned: 0 in 0.399s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:40:18 devstack cinder-volume[88899]: DEBUG cinder.compute.nova [None req-7461d70f-5731-4fbb-bfd9-fc6d2f95c777 tempest-SnapshotDataIntegrityTests-1494076589 None] Creating Keystone auth plugin from conf {{(pid=88899) novaclient /opt/stack/cinder/cinder/compute/nova.py:99}} Aug 03 08:40:18 devstack sudo[102313]: pam_unix(sudo:session): session closed for user root Aug 03 08:40:18 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-e46d30b7-2203-4d95-9605-54b858c7265c tempest-VolumeQuotasNegativeTestJSON-1983682387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-0b4502e9-9b53-40fa-8e77-8ceb06d7b7df" returned: 0 in 0.350s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:40:19 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-e46d30b7-2203-4d95-9605-54b858c7265c tempest-VolumeQuotasNegativeTestJSON-1983682387 None] Lock "cinder-quobyte-0b4502e9-9b53-40fa-8e77-8ceb06d7b7df" released by "delete_volume" :: held 0.974s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:40:19 devstack cinder-volume[88899]: DEBUG cinder.quota [None req-e46d30b7-2203-4d95-9605-54b858c7265c tempest-VolumeQuotasNegativeTestJSON-1983682387 None] Created reservations ['f5476d17-20a8-48be-ba9e-b39369504e58', '45700a2b-6f19-4d58-b765-1f295b5a99aa', '6f8843e5-0c70-4204-9da8-a82452d98f5e', '4912ad5c-2257-4ffb-bd79-68446555de67'] {{(pid=88899) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 08:40:19 devstack cinder-volume[88899]: DEBUG novaclient.v2.client [None req-7461d70f-5731-4fbb-bfd9-fc6d2f95c777 tempest-SnapshotDataIntegrityTests-1494076589 None] REQ: curl -g -i -X POST http://192.168.122.55/compute/v2.1/os-assisted-volume-snapshots -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}c8cfe13bc83bf614901f027f3d0d80766658c1455f404d03de278c4884b425b1" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-7461d70f-5731-4fbb-bfd9-fc6d2f95c777" -H "X-Service-Token: {SHA256}c96e034f4f8a4d16079c50f41a6bc99d8f702fc5a9a0d1604994b54ce68306ce" -d '{"snapshot": {"volume_id": "6bafdd19-6d59-4557-a0e3-17d1fbfc1053", "create_info": {"type": "qcow2", "new_file": "volume-6bafdd19-6d59-4557-a0e3-17d1fbfc1053.ef70e01c-7a59-4ac6-a705-f98e01473350", "snapshot_id": "ef70e01c-7a59-4ac6-a705-f98e01473350"}}}' {{(pid=88899) _http_log_request /opt/stack/data/venv/lib/python3.12/site-packages/keystoneauth1/session.py:575}} Aug 03 08:40:19 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-e46d30b7-2203-4d95-9605-54b858c7265c tempest-VolumeQuotasNegativeTestJSON-1983682387 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:40:19 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-e46d30b7-2203-4d95-9605-54b858c7265c tempest-VolumeQuotasNegativeTestJSON-1983682387 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:40:19 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-e46d30b7-2203-4d95-9605-54b858c7265c tempest-VolumeQuotasNegativeTestJSON-1983682387 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:40:19 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-e46d30b7-2203-4d95-9605-54b858c7265c tempest-VolumeQuotasNegativeTestJSON-1983682387 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:40:19 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-e46d30b7-2203-4d95-9605-54b858c7265c tempest-VolumeQuotasNegativeTestJSON-1983682387 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:40:19 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-e46d30b7-2203-4d95-9605-54b858c7265c tempest-VolumeQuotasNegativeTestJSON-1983682387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:40:19 devstack sudo[102323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a Aug 03 08:40:19 devstack sudo[102323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:40:19 devstack cinder-volume[88899]: DEBUG novaclient.v2.client [None req-7461d70f-5731-4fbb-bfd9-fc6d2f95c777 tempest-SnapshotDataIntegrityTests-1494076589 None] RESP: [200] Connection: close Content-Length: 78 Content-Type: application/json Date: Mon, 03 Aug 2026 06:40:19 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.58 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-e2692200-6b15-49d1-bfc3-c70478a2cd1b x-openstack-request-id: req-e2692200-6b15-49d1-bfc3-c70478a2cd1b {{(pid=88899) _http_log_response /opt/stack/data/venv/lib/python3.12/site-packages/keystoneauth1/session.py:616}} Aug 03 08:40:19 devstack cinder-volume[88899]: DEBUG novaclient.v2.client [None req-7461d70f-5731-4fbb-bfd9-fc6d2f95c777 tempest-SnapshotDataIntegrityTests-1494076589 None] RESP BODY: {"snapshot": {"id": null, "volumeId": "6bafdd19-6d59-4557-a0e3-17d1fbfc1053"}} {{(pid=88899) _http_log_response /opt/stack/data/venv/lib/python3.12/site-packages/keystoneauth1/session.py:651}} Aug 03 08:40:19 devstack cinder-volume[88899]: DEBUG novaclient.v2.client [None req-7461d70f-5731-4fbb-bfd9-fc6d2f95c777 tempest-SnapshotDataIntegrityTests-1494076589 None] POST call to compute for http://192.168.122.55/compute/v2.1/os-assisted-volume-snapshots used request id req-e2692200-6b15-49d1-bfc3-c70478a2cd1b {{(pid=88899) request /opt/stack/data/venv/lib/python3.12/site-packages/keystoneauth1/session.py:1076}} Aug 03 08:40:19 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-7461d70f-5731-4fbb-bfd9-fc6d2f95c777 tempest-SnapshotDataIntegrityTests-1494076589 None] nova call result: None {{(pid=88899) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1910}} Aug 03 08:40:19 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-7461d70f-5731-4fbb-bfd9-fc6d2f95c777 tempest-SnapshotDataIntegrityTests-1494076589 None] Status of snapshot ef70e01c-7a59-4ac6-a705-f98e01473350 is now creating {{(pid=88899) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Aug 03 08:40:19 devstack sudo[102323]: pam_unix(sudo:session): session closed for user root Aug 03 08:40:19 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-e46d30b7-2203-4d95-9605-54b858c7265c tempest-VolumeQuotasNegativeTestJSON-1983682387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a" returned: 0 in 0.357s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:40:19 devstack cinder-volume[88899]: DEBUG cinder.manager [None req-e46d30b7-2203-4d95-9605-54b858c7265c tempest-VolumeQuotasNegativeTestJSON-1983682387 None] Notifying Schedulers of capabilities ... {{(pid=88899) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 08:40:19 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-e46d30b7-2203-4d95-9605-54b858c7265c tempest-VolumeQuotasNegativeTestJSON-1983682387 None] Deleted volume successfully. Aug 03 08:40:19 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-e46d30b7-2203-4d95-9605-54b858c7265c tempest-VolumeQuotasNegativeTestJSON-1983682387 None] Lock "cinder-0b4502e9-9b53-40fa-8e77-8ceb06d7b7df-delete_volume" released by "delete_volume" :: held 1.667s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:40:20 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-7461d70f-5731-4fbb-bfd9-fc6d2f95c777 tempest-SnapshotDataIntegrityTests-1494076589 None] Status of snapshot ef70e01c-7a59-4ac6-a705-f98e01473350 is now creating {{(pid=88899) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Aug 03 08:40:21 devstack sudo[102306]: pam_unix(sudo:session): session closed for user root Aug 03 08:40:21 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-c28949d0-7bc6-4f6b-b583-f11d7d68f648 tempest-TestInstancesWithCinderVolumes-1639155420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_ace51f9e-97ce-471c-870b-e9eaf443a954_qyx52k0wdevstack@QuobyteHD /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-4c98b2e5-cbce-462d-9175-448b45b0470b" returned: 0 in 2.703s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:40:21 devstack cinder-volume[88899]: DEBUG cinder.image.image_utils [None req-c28949d0-7bc6-4f6b-b583-f11d7d68f648 tempest-TestInstancesWithCinderVolumes-1639155420 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_ace51f9e-97ce-471c-870b-e9eaf443a954_qyx52k0wdevstack@QuobyteHD, size 112.00 MB, duration 2.70 sec, destination /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-4c98b2e5-cbce-462d-9175-448b45b0470b {{(pid=88899) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 03 08:40:21 devstack cinder-volume[88899]: INFO cinder.image.image_utils [None req-c28949d0-7bc6-4f6b-b583-f11d7d68f648 tempest-TestInstancesWithCinderVolumes-1639155420 None] Converted 112.00 MB image at 41.42 MB/s Aug 03 08:40:21 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-c28949d0-7bc6-4f6b-b583-f11d7d68f648 tempest-TestInstancesWithCinderVolumes-1639155420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-4c98b2e5-cbce-462d-9175-448b45b0470b 1G {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:40:21 devstack sudo[102380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-4c98b2e5-cbce-462d-9175-448b45b0470b 1G Aug 03 08:40:21 devstack sudo[102380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:40:21 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-7461d70f-5731-4fbb-bfd9-fc6d2f95c777 tempest-SnapshotDataIntegrityTests-1494076589 None] Status of snapshot ef70e01c-7a59-4ac6-a705-f98e01473350 is now creating {{(pid=88899) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Aug 03 08:40:21 devstack sudo[102380]: pam_unix(sudo:session): session closed for user root Aug 03 08:40:21 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-c28949d0-7bc6-4f6b-b583-f11d7d68f648 tempest-TestInstancesWithCinderVolumes-1639155420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-4c98b2e5-cbce-462d-9175-448b45b0470b 1G" returned: 0 in 0.385s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:40:21 devstack cinder-volume[88899]: DEBUG cinder.volume.volume_utils [None req-c28949d0-7bc6-4f6b-b583-f11d7d68f648 tempest-TestInstancesWithCinderVolumes-1639155420 None] Downloaded image ace51f9e-97ce-471c-870b-e9eaf443a954 ((None, [{'url': 'file:///opt/stack/data/glance/images/ace51f9e-97ce-471c-870b-e9eaf443a954', 'metadata': {}}])) to volume 4c98b2e5-cbce-462d-9175-448b45b0470b successfully. {{(pid=88899) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Aug 03 08:40:21 devstack cinder-volume[88899]: DEBUG cinder.image.image_utils [None req-c28949d0-7bc6-4f6b-b583-f11d7d68f648 tempest-TestInstancesWithCinderVolumes-1639155420 None] Temporary image ace51f9e-97ce-471c-870b-e9eaf443a954 for user b017255fb8b84248bd43451f4c58f1f0 is deleted. {{(pid=88899) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Aug 03 08:40:21 devstack cinder-volume[88899]: DEBUG cinder.volume.volume_utils [None req-c28949d0-7bc6-4f6b-b583-f11d7d68f648 tempest-TestInstancesWithCinderVolumes-1639155420 None] Marking volume 4c98b2e5-cbce-462d-9175-448b45b0470b as bootable. {{(pid=88899) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Aug 03 08:40:21 devstack cinder-volume[88899]: DEBUG cinder.volume.flows.manager.create_volume [None req-c28949d0-7bc6-4f6b-b583-f11d7d68f648 tempest-TestInstancesWithCinderVolumes-1639155420 None] Copying metadata from image ace51f9e-97ce-471c-870b-e9eaf443a954 to 4c98b2e5-cbce-462d-9175-448b45b0470b. {{(pid=88899) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Aug 03 08:40:21 devstack cinder-volume[88899]: DEBUG cinder.volume.flows.manager.create_volume [None req-c28949d0-7bc6-4f6b-b583-f11d7d68f648 tempest-TestInstancesWithCinderVolumes-1639155420 None] Creating volume glance metadata for volume 4c98b2e5-cbce-462d-9175-448b45b0470b backed by image ace51f9e-97ce-471c-870b-e9eaf443a954 with: {'image_id': 'ace51f9e-97ce-471c-870b-e9eaf443a954', 'image_name': 'tempest-scenario-img--365444142', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=88899) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Aug 03 08:40:21 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-c28949d0-7bc6-4f6b-b583-f11d7d68f648 tempest-TestInstancesWithCinderVolumes-1639155420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a485eef9-f73e-40ce-8f8e-748abd6c0ddc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4c98b2e5-cbce-462d-9175-448b45b0470b', 'volume_size': 1, 'image_id': 'ace51f9e-97ce-471c-870b-e9eaf443a954', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ace51f9e-97ce-471c-870b-e9eaf443a954', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--365444142', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b944e91ca3ed4f51b4d01ed374a22fb4', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'ace51f9e-97ce-471c-870b-e9eaf443a954', 'created_at': datetime.datetime(2026, 8, 3, 6, 40, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 3, 6, 40, 2, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ace51f9e-97ce-471c-870b-e9eaf443a954/file', 'properties': {}}, 'image_service': }' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:40:21 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-c28949d0-7bc6-4f6b-b583-f11d7d68f648 tempest-TestInstancesWithCinderVolumes-1639155420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5761ad56-994c-435c-b757-42f4603c86ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:40:21 devstack cinder-volume[88899]: INFO cinder.volume.flows.manager.create_volume [None req-c28949d0-7bc6-4f6b-b583-f11d7d68f648 tempest-TestInstancesWithCinderVolumes-1639155420 None] Volume volume-4c98b2e5-cbce-462d-9175-448b45b0470b (4c98b2e5-cbce-462d-9175-448b45b0470b): created successfully Aug 03 08:40:21 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-c28949d0-7bc6-4f6b-b583-f11d7d68f648 tempest-TestInstancesWithCinderVolumes-1639155420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5761ad56-994c-435c-b757-42f4603c86ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:40:21 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-c28949d0-7bc6-4f6b-b583-f11d7d68f648 tempest-TestInstancesWithCinderVolumes-1639155420 None] Flow 'volume_create_manager' (4028a0ad-1531-4c7b-b398-f6d9c54ab732) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:40:21 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-c28949d0-7bc6-4f6b-b583-f11d7d68f648 tempest-TestInstancesWithCinderVolumes-1639155420 None] Created volume successfully. Aug 03 08:40:22 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-7461d70f-5731-4fbb-bfd9-fc6d2f95c777 tempest-SnapshotDataIntegrityTests-1494076589 None] Status of snapshot ef70e01c-7a59-4ac6-a705-f98e01473350 is now creating {{(pid=88899) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Aug 03 08:40:23 devstack cinder-volume[88899]: DEBUG dbcounter [-] [88899] Writing DB stats cinder:UPDATE=102,cinder:SELECT=108,cinder:INSERT=31,cinder:DELETE=9 {{(pid=88899) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 03 08:40:23 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-7461d70f-5731-4fbb-bfd9-fc6d2f95c777 tempest-SnapshotDataIntegrityTests-1494076589 None] Status of snapshot ef70e01c-7a59-4ac6-a705-f98e01473350 is now creating {{(pid=88899) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Aug 03 08:40:24 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-7461d70f-5731-4fbb-bfd9-fc6d2f95c777 tempest-SnapshotDataIntegrityTests-1494076589 None] Status of snapshot ef70e01c-7a59-4ac6-a705-f98e01473350 is now creating {{(pid=88899) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Aug 03 08:40:24 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [req-4e01b6de-76de-4312-8324-dd4996d43e57 req-cc79e743-b71b-45fb-8022-49ecf4ac0287 tempest-TestInstancesWithCinderVolumes-1639155420 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:40:25 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-7461d70f-5731-4fbb-bfd9-fc6d2f95c777 tempest-SnapshotDataIntegrityTests-1494076589 None] Status of snapshot ef70e01c-7a59-4ac6-a705-f98e01473350 is now creating {{(pid=88899) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Aug 03 08:40:26 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-7461d70f-5731-4fbb-bfd9-fc6d2f95c777 tempest-SnapshotDataIntegrityTests-1494076589 None] Status of snapshot ef70e01c-7a59-4ac6-a705-f98e01473350 is now creating {{(pid=88899) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Aug 03 08:40:26 devstack cinder-volume[88899]: DEBUG cinder.volume.flows.manager.create_volume [None req-4d839f11-94ca-4747-9d96-cdbaf8c7858b tempest-VolumesListAdminTestJSON-152554352 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88899) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 08:40:26 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-4d839f11-94ca-4747-9d96-cdbaf8c7858b tempest-VolumesListAdminTestJSON-152554352 None] Flow 'volume_create_manager' (cbee97bb-984e-43f3-ae21-38336cf8870d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:40:26 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-4d839f11-94ca-4747-9d96-cdbaf8c7858b tempest-VolumesListAdminTestJSON-152554352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (861da97a-0362-4e8d-86fc-01e1ed4b1575) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:40:26 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-4d839f11-94ca-4747-9d96-cdbaf8c7858b tempest-VolumesListAdminTestJSON-152554352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (861da97a-0362-4e8d-86fc-01e1ed4b1575) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:40:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1958738749',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=11682be2-ca59-49ab-9a16-3455c03c57c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='598560cec493407696149ef2dd3a0221',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:40:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:40:27Z,use_quota=True,user_id='f0d01ae05aac49a2a1443ed4e11032cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8bde7129-1dc4-42ab-b852-ab32c61b4921),volume_type_id=8bde7129-1dc4-42ab-b852-ab32c61b4921)' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:40:26 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-4d839f11-94ca-4747-9d96-cdbaf8c7858b tempest-VolumesListAdminTestJSON-152554352 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4619a5f2-3560-48b6-b55e-e41ab1a38bfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:40:26 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-4d839f11-94ca-4747-9d96-cdbaf8c7858b tempest-VolumesListAdminTestJSON-152554352 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4619a5f2-3560-48b6-b55e-e41ab1a38bfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:40:26 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-4d839f11-94ca-4747-9d96-cdbaf8c7858b tempest-VolumesListAdminTestJSON-152554352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d549af20-6042-4e2e-b11a-4d118c71f17c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:40:26 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-4d839f11-94ca-4747-9d96-cdbaf8c7858b tempest-VolumesListAdminTestJSON-152554352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d549af20-6042-4e2e-b11a-4d118c71f17c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '11682be2-ca59-49ab-9a16-3455c03c57c1', 'volume_name': 'volume-11682be2-ca59-49ab-9a16-3455c03c57c1', 'volume_size': 1}' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:40:26 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-4d839f11-94ca-4747-9d96-cdbaf8c7858b tempest-VolumesListAdminTestJSON-152554352 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee4ede2f-66df-45e2-8b4c-adcedbfd4a17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:40:26 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-4d839f11-94ca-4747-9d96-cdbaf8c7858b tempest-VolumesListAdminTestJSON-152554352 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee4ede2f-66df-45e2-8b4c-adcedbfd4a17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:40:26 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-4d839f11-94ca-4747-9d96-cdbaf8c7858b tempest-VolumesListAdminTestJSON-152554352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (992dd47e-773a-4e8b-9bca-aa92c08d71cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:40:26 devstack cinder-volume[88899]: INFO cinder.volume.flows.manager.create_volume [None req-4d839f11-94ca-4747-9d96-cdbaf8c7858b tempest-VolumesListAdminTestJSON-152554352 None] Volume 11682be2-ca59-49ab-9a16-3455c03c57c1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-11682be2-ca59-49ab-9a16-3455c03c57c1', 'volume_size': 1} Aug 03 08:40:26 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-4d839f11-94ca-4747-9d96-cdbaf8c7858b tempest-VolumesListAdminTestJSON-152554352 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:40:27 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-7461d70f-5731-4fbb-bfd9-fc6d2f95c777 tempest-SnapshotDataIntegrityTests-1494076589 None] Status of snapshot ef70e01c-7a59-4ac6-a705-f98e01473350 is now creating {{(pid=88899) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Aug 03 08:40:28 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-7461d70f-5731-4fbb-bfd9-fc6d2f95c777 tempest-SnapshotDataIntegrityTests-1494076589 None] Status of snapshot ef70e01c-7a59-4ac6-a705-f98e01473350 is now creating {{(pid=88899) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Aug 03 08:40:29 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-7461d70f-5731-4fbb-bfd9-fc6d2f95c777 tempest-SnapshotDataIntegrityTests-1494076589 None] Status of snapshot ef70e01c-7a59-4ac6-a705-f98e01473350 is now creating {{(pid=88899) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Aug 03 08:40:30 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-7461d70f-5731-4fbb-bfd9-fc6d2f95c777 tempest-SnapshotDataIntegrityTests-1494076589 None] Status of snapshot ef70e01c-7a59-4ac6-a705-f98e01473350 is now creating {{(pid=88899) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Aug 03 08:40:32 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-7461d70f-5731-4fbb-bfd9-fc6d2f95c777 tempest-SnapshotDataIntegrityTests-1494076589 None] Status of snapshot ef70e01c-7a59-4ac6-a705-f98e01473350 is now creating {{(pid=88899) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Aug 03 08:40:34 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-7461d70f-5731-4fbb-bfd9-fc6d2f95c777 tempest-SnapshotDataIntegrityTests-1494076589 None] Status of snapshot ef70e01c-7a59-4ac6-a705-f98e01473350 is now creating {{(pid=88899) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Aug 03 08:40:36 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-7461d70f-5731-4fbb-bfd9-fc6d2f95c777 tempest-SnapshotDataIntegrityTests-1494076589 None] Status of snapshot ef70e01c-7a59-4ac6-a705-f98e01473350 is now creating {{(pid=88899) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Aug 03 08:40:36 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-7461d70f-5731-4fbb-bfd9-fc6d2f95c777 tempest-SnapshotDataIntegrityTests-1494076589 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 19.966s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:40:36 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [req-4e01b6de-76de-4312-8324-dd4996d43e57 req-cc79e743-b71b-45fb-8022-49ecf4ac0287 tempest-TestInstancesWithCinderVolumes-1639155420 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 11.763s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:40:36 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [req-4e01b6de-76de-4312-8324-dd4996d43e57 req-cc79e743-b71b-45fb-8022-49ecf4ac0287 tempest-TestInstancesWithCinderVolumes-1639155420 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.022s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:40:36 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-4d839f11-94ca-4747-9d96-cdbaf8c7858b tempest-VolumesListAdminTestJSON-152554352 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.911s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:40:36 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-4d839f11-94ca-4747-9d96-cdbaf8c7858b tempest-VolumesListAdminTestJSON-152554352 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:40:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1958738749',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=11682be2-ca59-49ab-9a16-3455c03c57c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='598560cec493407696149ef2dd3a0221',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:40:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:40:27Z,use_quota=True,user_id='f0d01ae05aac49a2a1443ed4e11032cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8bde7129-1dc4-42ab-b852-ab32c61b4921),volume_type_id=8bde7129-1dc4-42ab-b852-ab32c61b4921)}" {{(pid=88899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 08:40:36 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-4d839f11-94ca-4747-9d96-cdbaf8c7858b tempest-VolumesListAdminTestJSON-152554352 None] Creating volume 11682be2-ca59-49ab-9a16-3455c03c57c1 {{(pid=88899) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 08:40:36 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-4d839f11-94ca-4747-9d96-cdbaf8c7858b tempest-VolumesListAdminTestJSON-152554352 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:40:36 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-4d839f11-94ca-4747-9d96-cdbaf8c7858b tempest-VolumesListAdminTestJSON-152554352 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:40:36 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-4d839f11-94ca-4747-9d96-cdbaf8c7858b tempest-VolumesListAdminTestJSON-152554352 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:40:36 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-4d839f11-94ca-4747-9d96-cdbaf8c7858b tempest-VolumesListAdminTestJSON-152554352 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:40:36 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-4d839f11-94ca-4747-9d96-cdbaf8c7858b tempest-VolumesListAdminTestJSON-152554352 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:40:36 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-4d839f11-94ca-4747-9d96-cdbaf8c7858b tempest-VolumesListAdminTestJSON-152554352 None] Selected osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385 as target Quobyte volume. {{(pid=88899) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 08:40:36 devstack cinder-volume[88899]: INFO cinder.volume.drivers.remotefs [None req-4d839f11-94ca-4747-9d96-cdbaf8c7858b tempest-VolumesListAdminTestJSON-152554352 None] casted to osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385 Aug 03 08:40:36 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-4d839f11-94ca-4747-9d96-cdbaf8c7858b tempest-VolumesListAdminTestJSON-152554352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-11682be2-ca59-49ab-9a16-3455c03c57c1 1073741824 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:40:36 devstack sudo[102410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-11682be2-ca59-49ab-9a16-3455c03c57c1 1073741824 Aug 03 08:40:36 devstack sudo[102410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:40:36 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-7461d70f-5731-4fbb-bfd9-fc6d2f95c777 tempest-SnapshotDataIntegrityTests-1494076589 None] Create snapshot completed successfully Aug 03 08:40:36 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [req-4e01b6de-76de-4312-8324-dd4996d43e57 req-cc79e743-b71b-45fb-8022-49ecf4ac0287 tempest-TestInstancesWithCinderVolumes-1639155420 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385', 'name': 'volume-4c98b2e5-cbce-462d-9175-448b45b0470b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '7643fe97-59ec-4501-aba8-2b613040d52f', 'enforce_multipath': True} {{(pid=88899) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 03 08:40:36 devstack cinder-volume[88899]: INFO cinder.volume.manager [req-4e01b6de-76de-4312-8324-dd4996d43e57 req-cc79e743-b71b-45fb-8022-49ecf4ac0287 tempest-TestInstancesWithCinderVolumes-1639155420 None] attachment_update completed successfully. Aug 03 08:40:37 devstack sudo[102410]: pam_unix(sudo:session): session closed for user root Aug 03 08:40:37 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-4d839f11-94ca-4747-9d96-cdbaf8c7858b tempest-VolumesListAdminTestJSON-152554352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-11682be2-ca59-49ab-9a16-3455c03c57c1 1073741824" returned: 0 in 0.776s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:40:37 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-4d839f11-94ca-4747-9d96-cdbaf8c7858b tempest-VolumesListAdminTestJSON-152554352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-11682be2-ca59-49ab-9a16-3455c03c57c1 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:40:37 devstack sudo[102445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-11682be2-ca59-49ab-9a16-3455c03c57c1 Aug 03 08:40:37 devstack sudo[102445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:40:38 devstack sudo[102445]: pam_unix(sudo:session): session closed for user root Aug 03 08:40:38 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-4d839f11-94ca-4747-9d96-cdbaf8c7858b tempest-VolumesListAdminTestJSON-152554352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-11682be2-ca59-49ab-9a16-3455c03c57c1" returned: 0 in 0.541s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:40:38 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-4d839f11-94ca-4747-9d96-cdbaf8c7858b tempest-VolumesListAdminTestJSON-152554352 None] <== create_volume: return (1389ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'} {{(pid=88899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 08:40:38 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-4d839f11-94ca-4747-9d96-cdbaf8c7858b tempest-VolumesListAdminTestJSON-152554352 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.396s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:40:38 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-4d839f11-94ca-4747-9d96-cdbaf8c7858b tempest-VolumesListAdminTestJSON-152554352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (992dd47e-773a-4e8b-9bca-aa92c08d71cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-11682be2-ca59-49ab-9a16-3455c03c57c1', 'volume_size': 1}' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:40:38 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-4d839f11-94ca-4747-9d96-cdbaf8c7858b tempest-VolumesListAdminTestJSON-152554352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f8bb890-f36d-406f-aeaf-969516a73cb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:40:38 devstack cinder-volume[88899]: INFO cinder.volume.flows.manager.create_volume [None req-4d839f11-94ca-4747-9d96-cdbaf8c7858b tempest-VolumesListAdminTestJSON-152554352 None] Volume volume-11682be2-ca59-49ab-9a16-3455c03c57c1 (11682be2-ca59-49ab-9a16-3455c03c57c1): created successfully Aug 03 08:40:38 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-4d839f11-94ca-4747-9d96-cdbaf8c7858b tempest-VolumesListAdminTestJSON-152554352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f8bb890-f36d-406f-aeaf-969516a73cb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:40:38 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-4d839f11-94ca-4747-9d96-cdbaf8c7858b tempest-VolumesListAdminTestJSON-152554352 None] Flow 'volume_create_manager' (cbee97bb-984e-43f3-ae21-38336cf8870d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:40:38 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-4d839f11-94ca-4747-9d96-cdbaf8c7858b tempest-VolumesListAdminTestJSON-152554352 None] Created volume successfully. Aug 03 08:40:38 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-a0fd0b9c-84ab-4ece-bb71-60fb7b12462b tempest-SnapshotDataIntegrityTests-1494076589 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:40:38 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-a0fd0b9c-84ab-4ece-bb71-60fb7b12462b tempest-SnapshotDataIntegrityTests-1494076589 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:40:38 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-a0fd0b9c-84ab-4ece-bb71-60fb7b12462b tempest-SnapshotDataIntegrityTests-1494076589 None] Creating online snapshot dc60c96a-b480-4727-9d7c-db679775347c of volume 6bafdd19-6d59-4557-a0e3-17d1fbfc1053 {{(pid=88899) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 03 08:40:38 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[018a9bf1-c33c-4a34-a562-63532f8912cd]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:40:38 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-a0fd0b9c-84ab-4ece-bb71-60fb7b12462b tempest-SnapshotDataIntegrityTests-1494076589 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-6bafdd19-6d59-4557-a0e3-17d1fbfc1053.ef70e01c-7a59-4ac6-a705-f98e01473350 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:40:39 devstack sudo[102506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-6bafdd19-6d59-4557-a0e3-17d1fbfc1053.ef70e01c-7a59-4ac6-a705-f98e01473350 Aug 03 08:40:39 devstack sudo[102506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:40:39 devstack cinder-volume[88899]: DEBUG cinder.volume.flows.manager.create_volume [None req-3ae0b4a6-a816-42bd-9f7c-606c5701f923 tempest-VolumesListAdminTestJSON-152554352 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88899) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 08:40:39 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-3ae0b4a6-a816-42bd-9f7c-606c5701f923 tempest-VolumesListAdminTestJSON-152554352 None] Flow 'volume_create_manager' (1909f668-d3ae-422a-b856-26403c6f2bb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:40:39 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-3ae0b4a6-a816-42bd-9f7c-606c5701f923 tempest-VolumesListAdminTestJSON-152554352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a4b0058-3ae6-44d8-8bb7-930450cfa175) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:40:39 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-3ae0b4a6-a816-42bd-9f7c-606c5701f923 tempest-VolumesListAdminTestJSON-152554352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a4b0058-3ae6-44d8-8bb7-930450cfa175) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:40:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-2143048836',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a1bedb06-eb1d-4cff-acb4-ed92216cb38a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='598560cec493407696149ef2dd3a0221',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:40:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:40:39Z,use_quota=True,user_id='f0d01ae05aac49a2a1443ed4e11032cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8bde7129-1dc4-42ab-b852-ab32c61b4921),volume_type_id=8bde7129-1dc4-42ab-b852-ab32c61b4921)' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:40:39 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-3ae0b4a6-a816-42bd-9f7c-606c5701f923 tempest-VolumesListAdminTestJSON-152554352 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6bc0995e-9ba8-44fc-aba4-242ab847d4d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:40:39 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-3ae0b4a6-a816-42bd-9f7c-606c5701f923 tempest-VolumesListAdminTestJSON-152554352 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6bc0995e-9ba8-44fc-aba4-242ab847d4d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:40:39 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-3ae0b4a6-a816-42bd-9f7c-606c5701f923 tempest-VolumesListAdminTestJSON-152554352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (affcae09-3fd1-4a90-bf0f-024445610a28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:40:39 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-3ae0b4a6-a816-42bd-9f7c-606c5701f923 tempest-VolumesListAdminTestJSON-152554352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (affcae09-3fd1-4a90-bf0f-024445610a28) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a1bedb06-eb1d-4cff-acb4-ed92216cb38a', 'volume_name': 'volume-a1bedb06-eb1d-4cff-acb4-ed92216cb38a', 'volume_size': 1}' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:40:39 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-3ae0b4a6-a816-42bd-9f7c-606c5701f923 tempest-VolumesListAdminTestJSON-152554352 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d7b1c2d-f4bf-474c-8da0-7bac3a0304a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:40:39 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-3ae0b4a6-a816-42bd-9f7c-606c5701f923 tempest-VolumesListAdminTestJSON-152554352 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d7b1c2d-f4bf-474c-8da0-7bac3a0304a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:40:39 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-3ae0b4a6-a816-42bd-9f7c-606c5701f923 tempest-VolumesListAdminTestJSON-152554352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e242cf6a-afeb-4193-a57f-905ff9a0405d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:40:39 devstack cinder-volume[88899]: INFO cinder.volume.flows.manager.create_volume [None req-3ae0b4a6-a816-42bd-9f7c-606c5701f923 tempest-VolumesListAdminTestJSON-152554352 None] Volume a1bedb06-eb1d-4cff-acb4-ed92216cb38a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a1bedb06-eb1d-4cff-acb4-ed92216cb38a', 'volume_size': 1} Aug 03 08:40:39 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-3ae0b4a6-a816-42bd-9f7c-606c5701f923 tempest-VolumesListAdminTestJSON-152554352 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:40:39 devstack sudo[102506]: pam_unix(sudo:session): session closed for user root Aug 03 08:40:39 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-a0fd0b9c-84ab-4ece-bb71-60fb7b12462b tempest-SnapshotDataIntegrityTests-1494076589 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-6bafdd19-6d59-4557-a0e3-17d1fbfc1053.ef70e01c-7a59-4ac6-a705-f98e01473350" returned: 0 in 0.969s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:40:39 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-a0fd0b9c-84ab-4ece-bb71-60fb7b12462b tempest-SnapshotDataIntegrityTests-1494076589 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6bafdd19-6d59-4557-a0e3-17d1fbfc1053(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88899) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 03 08:40:39 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-a0fd0b9c-84ab-4ece-bb71-60fb7b12462b tempest-SnapshotDataIntegrityTests-1494076589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-6bafdd19-6d59-4557-a0e3-17d1fbfc1053.ef70e01c-7a59-4ac6-a705-f98e01473350,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-6bafdd19-6d59-4557-a0e3-17d1fbfc1053.dc60c96a-b480-4727-9d7c-db679775347c 1G {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:40:39 devstack sudo[102530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-6bafdd19-6d59-4557-a0e3-17d1fbfc1053.ef70e01c-7a59-4ac6-a705-f98e01473350,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-6bafdd19-6d59-4557-a0e3-17d1fbfc1053.dc60c96a-b480-4727-9d7c-db679775347c 1G Aug 03 08:40:39 devstack sudo[102530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:40:40 devstack sudo[102530]: pam_unix(sudo:session): session closed for user root Aug 03 08:40:40 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-a0fd0b9c-84ab-4ece-bb71-60fb7b12462b tempest-SnapshotDataIntegrityTests-1494076589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-6bafdd19-6d59-4557-a0e3-17d1fbfc1053.ef70e01c-7a59-4ac6-a705-f98e01473350,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-6bafdd19-6d59-4557-a0e3-17d1fbfc1053.dc60c96a-b480-4727-9d7c-db679775347c 1G" returned: 0 in 0.570s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:40:40 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-a0fd0b9c-84ab-4ece-bb71-60fb7b12462b tempest-SnapshotDataIntegrityTests-1494076589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6bafdd19-6d59-4557-a0e3-17d1fbfc1053.ef70e01c-7a59-4ac6-a705-f98e01473350 -F qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-6bafdd19-6d59-4557-a0e3-17d1fbfc1053.dc60c96a-b480-4727-9d7c-db679775347c {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:40:40 devstack sudo[102551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6bafdd19-6d59-4557-a0e3-17d1fbfc1053.ef70e01c-7a59-4ac6-a705-f98e01473350 -F qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-6bafdd19-6d59-4557-a0e3-17d1fbfc1053.dc60c96a-b480-4727-9d7c-db679775347c Aug 03 08:40:40 devstack sudo[102551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:40:40 devstack sudo[102551]: pam_unix(sudo:session): session closed for user root Aug 03 08:40:40 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-a0fd0b9c-84ab-4ece-bb71-60fb7b12462b tempest-SnapshotDataIntegrityTests-1494076589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6bafdd19-6d59-4557-a0e3-17d1fbfc1053.ef70e01c-7a59-4ac6-a705-f98e01473350 -F qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-6bafdd19-6d59-4557-a0e3-17d1fbfc1053.dc60c96a-b480-4727-9d7c-db679775347c" returned: 0 in 0.399s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:40:40 devstack cinder-volume[88899]: WARNING cinder.volume.drivers.remotefs [None req-a0fd0b9c-84ab-4ece-bb71-60fb7b12462b tempest-SnapshotDataIntegrityTests-1494076589 None] /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-6bafdd19-6d59-4557-a0e3-17d1fbfc1053.dc60c96a-b480-4727-9d7c-db679775347c is being set with open permissions: ugo+rw Aug 03 08:40:40 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-a0fd0b9c-84ab-4ece-bb71-60fb7b12462b tempest-SnapshotDataIntegrityTests-1494076589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-6bafdd19-6d59-4557-a0e3-17d1fbfc1053.dc60c96a-b480-4727-9d7c-db679775347c {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:40:40 devstack sudo[102558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-6bafdd19-6d59-4557-a0e3-17d1fbfc1053.dc60c96a-b480-4727-9d7c-db679775347c Aug 03 08:40:40 devstack sudo[102558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:40:41 devstack sudo[102558]: pam_unix(sudo:session): session closed for user root Aug 03 08:40:41 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-a0fd0b9c-84ab-4ece-bb71-60fb7b12462b tempest-SnapshotDataIntegrityTests-1494076589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-6bafdd19-6d59-4557-a0e3-17d1fbfc1053.dc60c96a-b480-4727-9d7c-db679775347c" returned: 0 in 0.324s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:40:41 devstack cinder-volume[88899]: DEBUG cinder.compute.nova [None req-a0fd0b9c-84ab-4ece-bb71-60fb7b12462b tempest-SnapshotDataIntegrityTests-1494076589 None] Creating Keystone auth plugin from conf {{(pid=88899) novaclient /opt/stack/cinder/cinder/compute/nova.py:99}} Aug 03 08:40:41 devstack cinder-volume[88899]: DEBUG novaclient.v2.client [None req-a0fd0b9c-84ab-4ece-bb71-60fb7b12462b tempest-SnapshotDataIntegrityTests-1494076589 None] REQ: curl -g -i -X POST http://192.168.122.55/compute/v2.1/os-assisted-volume-snapshots -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}aa3d7dd1c63d0ba73ac8229fc477a581de76a60ed7dd7641c3ac7e10c3dec190" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-a0fd0b9c-84ab-4ece-bb71-60fb7b12462b" -H "X-Service-Token: {SHA256}c96e034f4f8a4d16079c50f41a6bc99d8f702fc5a9a0d1604994b54ce68306ce" -d '{"snapshot": {"volume_id": "6bafdd19-6d59-4557-a0e3-17d1fbfc1053", "create_info": {"type": "qcow2", "new_file": "volume-6bafdd19-6d59-4557-a0e3-17d1fbfc1053.dc60c96a-b480-4727-9d7c-db679775347c", "snapshot_id": "dc60c96a-b480-4727-9d7c-db679775347c"}}}' {{(pid=88899) _http_log_request /opt/stack/data/venv/lib/python3.12/site-packages/keystoneauth1/session.py:575}} Aug 03 08:40:41 devstack cinder-volume[88899]: DEBUG novaclient.v2.client [None req-a0fd0b9c-84ab-4ece-bb71-60fb7b12462b tempest-SnapshotDataIntegrityTests-1494076589 None] RESP: [200] Connection: close Content-Length: 78 Content-Type: application/json Date: Mon, 03 Aug 2026 06:40:41 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.58 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-c0708fda-5d6e-4f38-ab19-14b955d91c8f x-openstack-request-id: req-c0708fda-5d6e-4f38-ab19-14b955d91c8f {{(pid=88899) _http_log_response /opt/stack/data/venv/lib/python3.12/site-packages/keystoneauth1/session.py:616}} Aug 03 08:40:41 devstack cinder-volume[88899]: DEBUG novaclient.v2.client [None req-a0fd0b9c-84ab-4ece-bb71-60fb7b12462b tempest-SnapshotDataIntegrityTests-1494076589 None] RESP BODY: {"snapshot": {"id": null, "volumeId": "6bafdd19-6d59-4557-a0e3-17d1fbfc1053"}} {{(pid=88899) _http_log_response /opt/stack/data/venv/lib/python3.12/site-packages/keystoneauth1/session.py:651}} Aug 03 08:40:41 devstack cinder-volume[88899]: DEBUG novaclient.v2.client [None req-a0fd0b9c-84ab-4ece-bb71-60fb7b12462b tempest-SnapshotDataIntegrityTests-1494076589 None] POST call to compute for http://192.168.122.55/compute/v2.1/os-assisted-volume-snapshots used request id req-c0708fda-5d6e-4f38-ab19-14b955d91c8f {{(pid=88899) request /opt/stack/data/venv/lib/python3.12/site-packages/keystoneauth1/session.py:1076}} Aug 03 08:40:41 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-a0fd0b9c-84ab-4ece-bb71-60fb7b12462b tempest-SnapshotDataIntegrityTests-1494076589 None] nova call result: None {{(pid=88899) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1910}} Aug 03 08:40:41 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-a0fd0b9c-84ab-4ece-bb71-60fb7b12462b tempest-SnapshotDataIntegrityTests-1494076589 None] Status of snapshot dc60c96a-b480-4727-9d7c-db679775347c is now creating {{(pid=88899) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Aug 03 08:40:42 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-a0fd0b9c-84ab-4ece-bb71-60fb7b12462b tempest-SnapshotDataIntegrityTests-1494076589 None] Status of snapshot dc60c96a-b480-4727-9d7c-db679775347c is now creating {{(pid=88899) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Aug 03 08:40:43 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-a0fd0b9c-84ab-4ece-bb71-60fb7b12462b tempest-SnapshotDataIntegrityTests-1494076589 None] Status of snapshot dc60c96a-b480-4727-9d7c-db679775347c is now creating {{(pid=88899) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Aug 03 08:40:44 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-a0fd0b9c-84ab-4ece-bb71-60fb7b12462b tempest-SnapshotDataIntegrityTests-1494076589 None] Status of snapshot dc60c96a-b480-4727-9d7c-db679775347c is now creating {{(pid=88899) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Aug 03 08:40:45 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-a0fd0b9c-84ab-4ece-bb71-60fb7b12462b tempest-SnapshotDataIntegrityTests-1494076589 None] Status of snapshot dc60c96a-b480-4727-9d7c-db679775347c is now creating {{(pid=88899) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Aug 03 08:40:46 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-a0fd0b9c-84ab-4ece-bb71-60fb7b12462b tempest-SnapshotDataIntegrityTests-1494076589 None] Status of snapshot dc60c96a-b480-4727-9d7c-db679775347c is now creating {{(pid=88899) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Aug 03 08:40:47 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-a0fd0b9c-84ab-4ece-bb71-60fb7b12462b tempest-SnapshotDataIntegrityTests-1494076589 None] Status of snapshot dc60c96a-b480-4727-9d7c-db679775347c is now creating {{(pid=88899) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Aug 03 08:40:48 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-a0fd0b9c-84ab-4ece-bb71-60fb7b12462b tempest-SnapshotDataIntegrityTests-1494076589 None] Status of snapshot dc60c96a-b480-4727-9d7c-db679775347c is now creating {{(pid=88899) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Aug 03 08:40:49 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-a0fd0b9c-84ab-4ece-bb71-60fb7b12462b tempest-SnapshotDataIntegrityTests-1494076589 None] Status of snapshot dc60c96a-b480-4727-9d7c-db679775347c is now creating {{(pid=88899) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Aug 03 08:40:50 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-a0fd0b9c-84ab-4ece-bb71-60fb7b12462b tempest-SnapshotDataIntegrityTests-1494076589 None] Status of snapshot dc60c96a-b480-4727-9d7c-db679775347c is now creating {{(pid=88899) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Aug 03 08:40:51 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-a0fd0b9c-84ab-4ece-bb71-60fb7b12462b tempest-SnapshotDataIntegrityTests-1494076589 None] Status of snapshot dc60c96a-b480-4727-9d7c-db679775347c is now creating {{(pid=88899) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Aug 03 08:40:51 devstack cinder-volume[88899]: DEBUG oslo_service.periodic_task [None req-f948fb4a-c4d7-499f-b1bd-8d6be3de0b53 None None] Running periodic task VolumeManager._thread_info {{(pid=88899) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 03 08:40:51 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-f948fb4a-c4d7-499f-b1bd-8d6be3de0b53 None None] thread count: 28 {{(pid=88899) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 03 08:40:51 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-f948fb4a-c4d7-499f-b1bd-8d6be3de0b53 None None] thread info: [<_MainThread(MainThread, started 132234320248960)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88899) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 03 08:40:52 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-0f8d2b27-c59e-43d1-aaa5-abf51caec9f9 tempest-VolumesNegativeTest-1000681371 None] Acquiring lock "cinder-0784ee2d-6c48-4ff6-b809-730aa314fbad-delete_volume" by "delete_volume" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:40:52 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-0f8d2b27-c59e-43d1-aaa5-abf51caec9f9 tempest-VolumesNegativeTest-1000681371 None] Lock "cinder-0784ee2d-6c48-4ff6-b809-730aa314fbad-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:40:52 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-0f8d2b27-c59e-43d1-aaa5-abf51caec9f9 tempest-VolumesNegativeTest-1000681371 None] Acquiring lock "cinder-quobyte-0784ee2d-6c48-4ff6-b809-730aa314fbad" by "delete_volume" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:40:52 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-0f8d2b27-c59e-43d1-aaa5-abf51caec9f9 tempest-VolumesNegativeTest-1000681371 None] Lock "cinder-quobyte-0784ee2d-6c48-4ff6-b809-730aa314fbad" acquired by "delete_volume" :: waited 0.019s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:40:52 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[47af46a3-2f4f-40bf-96c3-2c968bdf190e]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:40:52 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-0f8d2b27-c59e-43d1-aaa5-abf51caec9f9 tempest-VolumesNegativeTest-1000681371 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-0784ee2d-6c48-4ff6-b809-730aa314fbad {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:40:52 devstack sudo[102599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-0784ee2d-6c48-4ff6-b809-730aa314fbad Aug 03 08:40:52 devstack sudo[102599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:40:52 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-a0fd0b9c-84ab-4ece-bb71-60fb7b12462b tempest-SnapshotDataIntegrityTests-1494076589 None] Status of snapshot dc60c96a-b480-4727-9d7c-db679775347c is now creating {{(pid=88899) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Aug 03 08:40:52 devstack sudo[102599]: pam_unix(sudo:session): session closed for user root Aug 03 08:40:52 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-0f8d2b27-c59e-43d1-aaa5-abf51caec9f9 tempest-VolumesNegativeTest-1000681371 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-0784ee2d-6c48-4ff6-b809-730aa314fbad" returned: 0 in 0.415s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:40:52 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-0f8d2b27-c59e-43d1-aaa5-abf51caec9f9 tempest-VolumesNegativeTest-1000681371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-0784ee2d-6c48-4ff6-b809-730aa314fbad {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:40:52 devstack sudo[102604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-0784ee2d-6c48-4ff6-b809-730aa314fbad Aug 03 08:40:52 devstack sudo[102604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:40:53 devstack sudo[102604]: pam_unix(sudo:session): session closed for user root Aug 03 08:40:53 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-0f8d2b27-c59e-43d1-aaa5-abf51caec9f9 tempest-VolumesNegativeTest-1000681371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-0784ee2d-6c48-4ff6-b809-730aa314fbad" returned: 0 in 0.290s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:40:53 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-0f8d2b27-c59e-43d1-aaa5-abf51caec9f9 tempest-VolumesNegativeTest-1000681371 None] Lock "cinder-quobyte-0784ee2d-6c48-4ff6-b809-730aa314fbad" released by "delete_volume" :: held 0.748s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:40:53 devstack cinder-volume[88899]: DEBUG cinder.quota [None req-0f8d2b27-c59e-43d1-aaa5-abf51caec9f9 tempest-VolumesNegativeTest-1000681371 None] Created reservations ['d8f2bac3-cdcd-4065-a6cd-7652138afdbb', '3a2b97c8-69c3-4647-ab15-19c7f06800c7', '850b25ee-e60c-4ffd-86cb-443f938f133b', 'fca5c8d2-76b9-4f8a-b244-7f79243d407a'] {{(pid=88899) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 08:40:53 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-0f8d2b27-c59e-43d1-aaa5-abf51caec9f9 tempest-VolumesNegativeTest-1000681371 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:40:53 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-0f8d2b27-c59e-43d1-aaa5-abf51caec9f9 tempest-VolumesNegativeTest-1000681371 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:40:53 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-0f8d2b27-c59e-43d1-aaa5-abf51caec9f9 tempest-VolumesNegativeTest-1000681371 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:40:53 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-0f8d2b27-c59e-43d1-aaa5-abf51caec9f9 tempest-VolumesNegativeTest-1000681371 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:40:53 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-0f8d2b27-c59e-43d1-aaa5-abf51caec9f9 tempest-VolumesNegativeTest-1000681371 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:40:53 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-0f8d2b27-c59e-43d1-aaa5-abf51caec9f9 tempest-VolumesNegativeTest-1000681371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:40:53 devstack sudo[102607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a Aug 03 08:40:53 devstack sudo[102607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:40:53 devstack sudo[102607]: pam_unix(sudo:session): session closed for user root Aug 03 08:40:53 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-0f8d2b27-c59e-43d1-aaa5-abf51caec9f9 tempest-VolumesNegativeTest-1000681371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a" returned: 0 in 0.273s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:40:53 devstack cinder-volume[88899]: DEBUG cinder.manager [None req-0f8d2b27-c59e-43d1-aaa5-abf51caec9f9 tempest-VolumesNegativeTest-1000681371 None] Notifying Schedulers of capabilities ... {{(pid=88899) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 08:40:53 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-0f8d2b27-c59e-43d1-aaa5-abf51caec9f9 tempest-VolumesNegativeTest-1000681371 None] Deleted volume successfully. Aug 03 08:40:53 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-0f8d2b27-c59e-43d1-aaa5-abf51caec9f9 tempest-VolumesNegativeTest-1000681371 None] Lock "cinder-0784ee2d-6c48-4ff6-b809-730aa314fbad-delete_volume" released by "delete_volume" :: held 1.295s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:40:54 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-a0fd0b9c-84ab-4ece-bb71-60fb7b12462b tempest-SnapshotDataIntegrityTests-1494076589 None] Status of snapshot dc60c96a-b480-4727-9d7c-db679775347c is now creating {{(pid=88899) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Aug 03 08:40:56 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-a0fd0b9c-84ab-4ece-bb71-60fb7b12462b tempest-SnapshotDataIntegrityTests-1494076589 None] Status of snapshot dc60c96a-b480-4727-9d7c-db679775347c is now creating {{(pid=88899) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Aug 03 08:40:58 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-a0fd0b9c-84ab-4ece-bb71-60fb7b12462b tempest-SnapshotDataIntegrityTests-1494076589 None] Status of snapshot dc60c96a-b480-4727-9d7c-db679775347c is now creating {{(pid=88899) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Aug 03 08:41:00 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-a0fd0b9c-84ab-4ece-bb71-60fb7b12462b tempest-SnapshotDataIntegrityTests-1494076589 None] Status of snapshot dc60c96a-b480-4727-9d7c-db679775347c is now creating {{(pid=88899) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Aug 03 08:41:00 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-a0fd0b9c-84ab-4ece-bb71-60fb7b12462b tempest-SnapshotDataIntegrityTests-1494076589 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 22.319s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:41:00 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-3ae0b4a6-a816-42bd-9f7c-606c5701f923 tempest-VolumesListAdminTestJSON-152554352 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 21.176s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:41:00 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-3ae0b4a6-a816-42bd-9f7c-606c5701f923 tempest-VolumesListAdminTestJSON-152554352 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:40:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-2143048836',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a1bedb06-eb1d-4cff-acb4-ed92216cb38a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='598560cec493407696149ef2dd3a0221',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:40:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:40:39Z,use_quota=True,user_id='f0d01ae05aac49a2a1443ed4e11032cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8bde7129-1dc4-42ab-b852-ab32c61b4921),volume_type_id=8bde7129-1dc4-42ab-b852-ab32c61b4921)}" {{(pid=88899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 08:41:00 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-3ae0b4a6-a816-42bd-9f7c-606c5701f923 tempest-VolumesListAdminTestJSON-152554352 None] Creating volume a1bedb06-eb1d-4cff-acb4-ed92216cb38a {{(pid=88899) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 08:41:00 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-3ae0b4a6-a816-42bd-9f7c-606c5701f923 tempest-VolumesListAdminTestJSON-152554352 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:41:00 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-3ae0b4a6-a816-42bd-9f7c-606c5701f923 tempest-VolumesListAdminTestJSON-152554352 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:41:00 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-3ae0b4a6-a816-42bd-9f7c-606c5701f923 tempest-VolumesListAdminTestJSON-152554352 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:41:00 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-3ae0b4a6-a816-42bd-9f7c-606c5701f923 tempest-VolumesListAdminTestJSON-152554352 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:41:00 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-3ae0b4a6-a816-42bd-9f7c-606c5701f923 tempest-VolumesListAdminTestJSON-152554352 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:41:00 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-3ae0b4a6-a816-42bd-9f7c-606c5701f923 tempest-VolumesListAdminTestJSON-152554352 None] Selected osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385 as target Quobyte volume. {{(pid=88899) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 08:41:00 devstack cinder-volume[88899]: INFO cinder.volume.drivers.remotefs [None req-3ae0b4a6-a816-42bd-9f7c-606c5701f923 tempest-VolumesListAdminTestJSON-152554352 None] casted to osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385 Aug 03 08:41:00 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-3ae0b4a6-a816-42bd-9f7c-606c5701f923 tempest-VolumesListAdminTestJSON-152554352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-a1bedb06-eb1d-4cff-acb4-ed92216cb38a 1073741824 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:41:00 devstack sudo[102660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-a1bedb06-eb1d-4cff-acb4-ed92216cb38a 1073741824 Aug 03 08:41:00 devstack sudo[102660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:41:00 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-a0fd0b9c-84ab-4ece-bb71-60fb7b12462b tempest-SnapshotDataIntegrityTests-1494076589 None] Create snapshot completed successfully Aug 03 08:41:01 devstack sudo[102660]: pam_unix(sudo:session): session closed for user root Aug 03 08:41:01 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-3ae0b4a6-a816-42bd-9f7c-606c5701f923 tempest-VolumesListAdminTestJSON-152554352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-a1bedb06-eb1d-4cff-acb4-ed92216cb38a 1073741824" returned: 0 in 0.566s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:41:01 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-3ae0b4a6-a816-42bd-9f7c-606c5701f923 tempest-VolumesListAdminTestJSON-152554352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-a1bedb06-eb1d-4cff-acb4-ed92216cb38a {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:41:01 devstack sudo[102666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-a1bedb06-eb1d-4cff-acb4-ed92216cb38a Aug 03 08:41:01 devstack sudo[102666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:41:01 devstack sudo[102666]: pam_unix(sudo:session): session closed for user root Aug 03 08:41:01 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-3ae0b4a6-a816-42bd-9f7c-606c5701f923 tempest-VolumesListAdminTestJSON-152554352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-a1bedb06-eb1d-4cff-acb4-ed92216cb38a" returned: 0 in 0.291s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:41:01 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-3ae0b4a6-a816-42bd-9f7c-606c5701f923 tempest-VolumesListAdminTestJSON-152554352 None] <== create_volume: return (911ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'} {{(pid=88899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 08:41:01 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-3ae0b4a6-a816-42bd-9f7c-606c5701f923 tempest-VolumesListAdminTestJSON-152554352 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.915s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:41:01 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-3ae0b4a6-a816-42bd-9f7c-606c5701f923 tempest-VolumesListAdminTestJSON-152554352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e242cf6a-afeb-4193-a57f-905ff9a0405d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a1bedb06-eb1d-4cff-acb4-ed92216cb38a', 'volume_size': 1}' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:41:01 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-3ae0b4a6-a816-42bd-9f7c-606c5701f923 tempest-VolumesListAdminTestJSON-152554352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (74361c67-24d9-499f-aae1-9d1609e99798) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:41:01 devstack cinder-volume[88899]: INFO cinder.volume.flows.manager.create_volume [None req-3ae0b4a6-a816-42bd-9f7c-606c5701f923 tempest-VolumesListAdminTestJSON-152554352 None] Volume volume-a1bedb06-eb1d-4cff-acb4-ed92216cb38a (a1bedb06-eb1d-4cff-acb4-ed92216cb38a): created successfully Aug 03 08:41:01 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-3ae0b4a6-a816-42bd-9f7c-606c5701f923 tempest-VolumesListAdminTestJSON-152554352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (74361c67-24d9-499f-aae1-9d1609e99798) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:41:01 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-3ae0b4a6-a816-42bd-9f7c-606c5701f923 tempest-VolumesListAdminTestJSON-152554352 None] Flow 'volume_create_manager' (1909f668-d3ae-422a-b856-26403c6f2bb7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:41:01 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-3ae0b4a6-a816-42bd-9f7c-606c5701f923 tempest-VolumesListAdminTestJSON-152554352 None] Created volume successfully. Aug 03 08:41:02 devstack cinder-volume[88899]: INFO cinder.volume.manager [req-dde9b992-54cc-474d-a05c-1e519cf2b691 req-e3cb74dc-b02d-4155-a329-3c8b812a5102 tempest-SnapshotDataIntegrityTests-1494076589 None] Terminate volume connection completed successfully. Aug 03 08:41:02 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [req-dde9b992-54cc-474d-a05c-1e519cf2b691 req-e3cb74dc-b02d-4155-a329-3c8b812a5102 tempest-SnapshotDataIntegrityTests-1494076589 None] Deleting attachment b5f7755c-735f-4d4a-aa6f-a0098b2eff12. {{(pid=88899) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 03 08:41:03 devstack cinder-volume[88899]: DEBUG cinder.volume.flows.manager.create_volume [None req-778f8edc-10df-4118-a353-5bc9eb3701ad tempest-VolumesListAdminTestJSON-152554352 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88899) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 08:41:03 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-778f8edc-10df-4118-a353-5bc9eb3701ad tempest-VolumesListAdminTestJSON-152554352 None] Flow 'volume_create_manager' (2f5a2ad5-e658-4c27-a18b-59a13077dd6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:41:03 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-778f8edc-10df-4118-a353-5bc9eb3701ad tempest-VolumesListAdminTestJSON-152554352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5fe5742c-da04-48f2-865c-04f2ac871295) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:41:03 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-778f8edc-10df-4118-a353-5bc9eb3701ad tempest-VolumesListAdminTestJSON-152554352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5fe5742c-da04-48f2-865c-04f2ac871295) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:41:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-723631180',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e616df58-2556-4f48-b1ba-9a09710b8614,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='598560cec493407696149ef2dd3a0221',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:41:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:41:03Z,use_quota=True,user_id='f0d01ae05aac49a2a1443ed4e11032cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8bde7129-1dc4-42ab-b852-ab32c61b4921),volume_type_id=8bde7129-1dc4-42ab-b852-ab32c61b4921)' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:41:03 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-778f8edc-10df-4118-a353-5bc9eb3701ad tempest-VolumesListAdminTestJSON-152554352 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c18e4d1c-e35b-4e25-b877-cc176495735d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:41:03 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-778f8edc-10df-4118-a353-5bc9eb3701ad tempest-VolumesListAdminTestJSON-152554352 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c18e4d1c-e35b-4e25-b877-cc176495735d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:41:03 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-778f8edc-10df-4118-a353-5bc9eb3701ad tempest-VolumesListAdminTestJSON-152554352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a09fe7eb-324c-4fa8-9e7e-31953e2eac54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:41:03 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-778f8edc-10df-4118-a353-5bc9eb3701ad tempest-VolumesListAdminTestJSON-152554352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a09fe7eb-324c-4fa8-9e7e-31953e2eac54) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e616df58-2556-4f48-b1ba-9a09710b8614', 'volume_name': 'volume-e616df58-2556-4f48-b1ba-9a09710b8614', 'volume_size': 1}' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:41:03 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-778f8edc-10df-4118-a353-5bc9eb3701ad tempest-VolumesListAdminTestJSON-152554352 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (424899f6-5394-4b1a-a551-77930b31a75f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:41:03 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-778f8edc-10df-4118-a353-5bc9eb3701ad tempest-VolumesListAdminTestJSON-152554352 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (424899f6-5394-4b1a-a551-77930b31a75f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:41:03 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-778f8edc-10df-4118-a353-5bc9eb3701ad tempest-VolumesListAdminTestJSON-152554352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (34471dc1-e780-4a36-94b7-b79f6dd405a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:41:03 devstack cinder-volume[88899]: INFO cinder.volume.flows.manager.create_volume [None req-778f8edc-10df-4118-a353-5bc9eb3701ad tempest-VolumesListAdminTestJSON-152554352 None] Volume e616df58-2556-4f48-b1ba-9a09710b8614: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e616df58-2556-4f48-b1ba-9a09710b8614', 'volume_size': 1} Aug 03 08:41:03 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-778f8edc-10df-4118-a353-5bc9eb3701ad tempest-VolumesListAdminTestJSON-152554352 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:41:03 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-778f8edc-10df-4118-a353-5bc9eb3701ad tempest-VolumesListAdminTestJSON-152554352 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:41:03 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-778f8edc-10df-4118-a353-5bc9eb3701ad tempest-VolumesListAdminTestJSON-152554352 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:41:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-723631180',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e616df58-2556-4f48-b1ba-9a09710b8614,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='598560cec493407696149ef2dd3a0221',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:41:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:41:03Z,use_quota=True,user_id='f0d01ae05aac49a2a1443ed4e11032cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8bde7129-1dc4-42ab-b852-ab32c61b4921),volume_type_id=8bde7129-1dc4-42ab-b852-ab32c61b4921)}" {{(pid=88899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 08:41:03 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-778f8edc-10df-4118-a353-5bc9eb3701ad tempest-VolumesListAdminTestJSON-152554352 None] Creating volume e616df58-2556-4f48-b1ba-9a09710b8614 {{(pid=88899) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 08:41:03 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-778f8edc-10df-4118-a353-5bc9eb3701ad tempest-VolumesListAdminTestJSON-152554352 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:41:03 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-778f8edc-10df-4118-a353-5bc9eb3701ad tempest-VolumesListAdminTestJSON-152554352 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:41:03 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-778f8edc-10df-4118-a353-5bc9eb3701ad tempest-VolumesListAdminTestJSON-152554352 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:41:03 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-778f8edc-10df-4118-a353-5bc9eb3701ad tempest-VolumesListAdminTestJSON-152554352 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:41:03 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-778f8edc-10df-4118-a353-5bc9eb3701ad tempest-VolumesListAdminTestJSON-152554352 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:41:03 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-778f8edc-10df-4118-a353-5bc9eb3701ad tempest-VolumesListAdminTestJSON-152554352 None] Selected osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385 as target Quobyte volume. {{(pid=88899) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 08:41:03 devstack cinder-volume[88899]: INFO cinder.volume.drivers.remotefs [None req-778f8edc-10df-4118-a353-5bc9eb3701ad tempest-VolumesListAdminTestJSON-152554352 None] casted to osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385 Aug 03 08:41:03 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-778f8edc-10df-4118-a353-5bc9eb3701ad tempest-VolumesListAdminTestJSON-152554352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-e616df58-2556-4f48-b1ba-9a09710b8614 1073741824 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:41:03 devstack sudo[102674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-e616df58-2556-4f48-b1ba-9a09710b8614 1073741824 Aug 03 08:41:03 devstack sudo[102674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:41:03 devstack cinder-volume[88899]: DEBUG cinder.volume.flows.manager.create_volume [None req-be3cecf7-e7ba-4df8-9384-d985fae6bede tempest-SnapshotDataIntegrityTests-1494076589 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88899) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 08:41:03 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-be3cecf7-e7ba-4df8-9384-d985fae6bede tempest-SnapshotDataIntegrityTests-1494076589 None] Flow 'volume_create_manager' (c73545e4-3f0e-403c-8be2-6c2f2de856bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:41:03 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-be3cecf7-e7ba-4df8-9384-d985fae6bede tempest-SnapshotDataIntegrityTests-1494076589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e201efe-ad9f-4836-ba77-0f677672378f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:41:03 devstack sudo[102674]: pam_unix(sudo:session): session closed for user root Aug 03 08:41:03 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-be3cecf7-e7ba-4df8-9384-d985fae6bede tempest-SnapshotDataIntegrityTests-1494076589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e201efe-ad9f-4836-ba77-0f677672378f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:41:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDataIntegrityTests-volume-1996418714',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ee47f81-8d6d-4795-9014-8b0f37bd3d78,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7bfeec51147d4d6fb726c3d53fa691a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:41:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=7eccf0d3-bff0-4d62-a704-dc41ced4a9ba,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:41:04Z,use_quota=True,user_id='154fb6e7d02d4632a2d4958c8859e9a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8bde7129-1dc4-42ab-b852-ab32c61b4921),volume_type_id=8bde7129-1dc4-42ab-b852-ab32c61b4921)' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:41:03 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-be3cecf7-e7ba-4df8-9384-d985fae6bede tempest-SnapshotDataIntegrityTests-1494076589 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0276aadc-d4df-4322-82c4-60da53b9ad36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:41:03 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-be3cecf7-e7ba-4df8-9384-d985fae6bede tempest-SnapshotDataIntegrityTests-1494076589 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0276aadc-d4df-4322-82c4-60da53b9ad36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:41:03 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-be3cecf7-e7ba-4df8-9384-d985fae6bede tempest-SnapshotDataIntegrityTests-1494076589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5516351e-dea7-4029-92fd-9de59811bcb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:41:04 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-be3cecf7-e7ba-4df8-9384-d985fae6bede tempest-SnapshotDataIntegrityTests-1494076589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5516351e-dea7-4029-92fd-9de59811bcb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '6ee47f81-8d6d-4795-9014-8b0f37bd3d78', 'volume_name': 'volume-6ee47f81-8d6d-4795-9014-8b0f37bd3d78', 'volume_size': 1, 'snapshot_id': '7eccf0d3-bff0-4d62-a704-dc41ced4a9ba'}' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:41:04 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-be3cecf7-e7ba-4df8-9384-d985fae6bede tempest-SnapshotDataIntegrityTests-1494076589 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (182bcb4a-c662-4737-8832-0c80fba1358a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:41:04 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-be3cecf7-e7ba-4df8-9384-d985fae6bede tempest-SnapshotDataIntegrityTests-1494076589 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (182bcb4a-c662-4737-8832-0c80fba1358a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:41:04 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-be3cecf7-e7ba-4df8-9384-d985fae6bede tempest-SnapshotDataIntegrityTests-1494076589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9273807a-bd32-4df8-a912-f4d01a8a2c5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:41:04 devstack cinder-volume[88899]: INFO cinder.volume.flows.manager.create_volume [None req-be3cecf7-e7ba-4df8-9384-d985fae6bede tempest-SnapshotDataIntegrityTests-1494076589 None] Volume 6ee47f81-8d6d-4795-9014-8b0f37bd3d78: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-6ee47f81-8d6d-4795-9014-8b0f37bd3d78', 'volume_size': 1, 'snapshot_id': '7eccf0d3-bff0-4d62-a704-dc41ced4a9ba'} Aug 03 08:41:04 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-778f8edc-10df-4118-a353-5bc9eb3701ad tempest-VolumesListAdminTestJSON-152554352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-e616df58-2556-4f48-b1ba-9a09710b8614 1073741824" returned: 0 in 0.702s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:41:04 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-be3cecf7-e7ba-4df8-9384-d985fae6bede tempest-SnapshotDataIntegrityTests-1494076589 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:41:04 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-778f8edc-10df-4118-a353-5bc9eb3701ad tempest-VolumesListAdminTestJSON-152554352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-e616df58-2556-4f48-b1ba-9a09710b8614 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:41:04 devstack sudo[102680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-e616df58-2556-4f48-b1ba-9a09710b8614 Aug 03 08:41:04 devstack sudo[102680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:41:04 devstack sudo[102680]: pam_unix(sudo:session): session closed for user root Aug 03 08:41:04 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-778f8edc-10df-4118-a353-5bc9eb3701ad tempest-VolumesListAdminTestJSON-152554352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-e616df58-2556-4f48-b1ba-9a09710b8614" returned: 0 in 0.284s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:41:04 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-778f8edc-10df-4118-a353-5bc9eb3701ad tempest-VolumesListAdminTestJSON-152554352 None] <== create_volume: return (1053ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'} {{(pid=88899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 08:41:04 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-778f8edc-10df-4118-a353-5bc9eb3701ad tempest-VolumesListAdminTestJSON-152554352 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.068s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:41:04 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-be3cecf7-e7ba-4df8-9384-d985fae6bede tempest-SnapshotDataIntegrityTests-1494076589 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.318s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:41:04 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-be3cecf7-e7ba-4df8-9384-d985fae6bede tempest-SnapshotDataIntegrityTests-1494076589 None] Acquiring lock "cinder-quobyte-7eccf0d3-bff0-4d62-a704-dc41ced4a9ba-6ee47f81-8d6d-4795-9014-8b0f37bd3d78" by "_create_volume_from_snapshot" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:41:04 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-778f8edc-10df-4118-a353-5bc9eb3701ad tempest-VolumesListAdminTestJSON-152554352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (34471dc1-e780-4a36-94b7-b79f6dd405a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e616df58-2556-4f48-b1ba-9a09710b8614', 'volume_size': 1}' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:41:04 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-778f8edc-10df-4118-a353-5bc9eb3701ad tempest-VolumesListAdminTestJSON-152554352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2bffd970-334d-4b12-8cec-bf5430fa71fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:41:04 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-be3cecf7-e7ba-4df8-9384-d985fae6bede tempest-SnapshotDataIntegrityTests-1494076589 None] Lock "cinder-quobyte-7eccf0d3-bff0-4d62-a704-dc41ced4a9ba-6ee47f81-8d6d-4795-9014-8b0f37bd3d78" acquired by "_create_volume_from_snapshot" :: waited 0.045s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:41:04 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-be3cecf7-e7ba-4df8-9384-d985fae6bede tempest-SnapshotDataIntegrityTests-1494076589 None] Creating volume 6ee47f81-8d6d-4795-9014-8b0f37bd3d78 from snapshot 7eccf0d3-bff0-4d62-a704-dc41ced4a9ba {{(pid=88899) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Aug 03 08:41:04 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-be3cecf7-e7ba-4df8-9384-d985fae6bede tempest-SnapshotDataIntegrityTests-1494076589 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:41:04 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-be3cecf7-e7ba-4df8-9384-d985fae6bede tempest-SnapshotDataIntegrityTests-1494076589 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:41:04 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-be3cecf7-e7ba-4df8-9384-d985fae6bede tempest-SnapshotDataIntegrityTests-1494076589 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:41:04 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-be3cecf7-e7ba-4df8-9384-d985fae6bede tempest-SnapshotDataIntegrityTests-1494076589 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:41:04 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-be3cecf7-e7ba-4df8-9384-d985fae6bede tempest-SnapshotDataIntegrityTests-1494076589 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:41:04 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-be3cecf7-e7ba-4df8-9384-d985fae6bede tempest-SnapshotDataIntegrityTests-1494076589 None] Selected osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385 as target Quobyte volume. {{(pid=88899) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 08:41:04 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-be3cecf7-e7ba-4df8-9384-d985fae6bede tempest-SnapshotDataIntegrityTests-1494076589 None] Acquiring lock "cinder-quobyte-6ee47f81-8d6d-4795-9014-8b0f37bd3d78" by "_copy_volume_from_snapshot" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:41:04 devstack cinder-volume[88899]: INFO cinder.volume.flows.manager.create_volume [None req-778f8edc-10df-4118-a353-5bc9eb3701ad tempest-VolumesListAdminTestJSON-152554352 None] Volume volume-e616df58-2556-4f48-b1ba-9a09710b8614 (e616df58-2556-4f48-b1ba-9a09710b8614): created successfully Aug 03 08:41:04 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-778f8edc-10df-4118-a353-5bc9eb3701ad tempest-VolumesListAdminTestJSON-152554352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2bffd970-334d-4b12-8cec-bf5430fa71fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:41:04 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-778f8edc-10df-4118-a353-5bc9eb3701ad tempest-VolumesListAdminTestJSON-152554352 None] Flow 'volume_create_manager' (2f5a2ad5-e658-4c27-a18b-59a13077dd6e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:41:04 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-be3cecf7-e7ba-4df8-9384-d985fae6bede tempest-SnapshotDataIntegrityTests-1494076589 None] Lock "cinder-quobyte-6ee47f81-8d6d-4795-9014-8b0f37bd3d78" acquired by "_copy_volume_from_snapshot" :: waited 0.041s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:41:04 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-be3cecf7-e7ba-4df8-9384-d985fae6bede tempest-SnapshotDataIntegrityTests-1494076589 None] snapshot: 7eccf0d3-bff0-4d62-a704-dc41ced4a9ba, volume: 6ee47f81-8d6d-4795-9014-8b0f37bd3d78, {{(pid=88899) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Aug 03 08:41:04 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-778f8edc-10df-4118-a353-5bc9eb3701ad tempest-VolumesListAdminTestJSON-152554352 None] Created volume successfully. Aug 03 08:41:04 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-be3cecf7-e7ba-4df8-9384-d985fae6bede tempest-SnapshotDataIntegrityTests-1494076589 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:41:04 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-be3cecf7-e7ba-4df8-9384-d985fae6bede tempest-SnapshotDataIntegrityTests-1494076589 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:41:04 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-be3cecf7-e7ba-4df8-9384-d985fae6bede tempest-SnapshotDataIntegrityTests-1494076589 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:41:04 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-be3cecf7-e7ba-4df8-9384-d985fae6bede tempest-SnapshotDataIntegrityTests-1494076589 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:41:04 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-be3cecf7-e7ba-4df8-9384-d985fae6bede tempest-SnapshotDataIntegrityTests-1494076589 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:41:04 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[e05c0c5b-7e44-461d-a77c-6749464443da]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:41:04 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-be3cecf7-e7ba-4df8-9384-d985fae6bede tempest-SnapshotDataIntegrityTests-1494076589 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-6bafdd19-6d59-4557-a0e3-17d1fbfc1053.7eccf0d3-bff0-4d62-a704-dc41ced4a9ba {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:41:04 devstack sudo[102683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-6bafdd19-6d59-4557-a0e3-17d1fbfc1053.7eccf0d3-bff0-4d62-a704-dc41ced4a9ba Aug 03 08:41:04 devstack sudo[102683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:41:05 devstack sudo[102683]: pam_unix(sudo:session): session closed for user root Aug 03 08:41:05 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-be3cecf7-e7ba-4df8-9384-d985fae6bede tempest-SnapshotDataIntegrityTests-1494076589 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-6bafdd19-6d59-4557-a0e3-17d1fbfc1053.7eccf0d3-bff0-4d62-a704-dc41ced4a9ba" returned: 0 in 0.459s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:41:05 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-be3cecf7-e7ba-4df8-9384-d985fae6bede tempest-SnapshotDataIntegrityTests-1494076589 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6bafdd19-6d59-4557-a0e3-17d1fbfc1053(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88899) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 03 08:41:05 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[28440e97-786e-4440-8e0e-137c971c455f]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:41:05 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-be3cecf7-e7ba-4df8-9384-d985fae6bede tempest-SnapshotDataIntegrityTests-1494076589 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-6bafdd19-6d59-4557-a0e3-17d1fbfc1053 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:41:05 devstack sudo[102690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-6bafdd19-6d59-4557-a0e3-17d1fbfc1053 Aug 03 08:41:05 devstack sudo[102690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:41:05 devstack sudo[102690]: pam_unix(sudo:session): session closed for user root Aug 03 08:41:05 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-be3cecf7-e7ba-4df8-9384-d985fae6bede tempest-SnapshotDataIntegrityTests-1494076589 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-6bafdd19-6d59-4557-a0e3-17d1fbfc1053" returned: 0 in 0.462s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:41:05 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-be3cecf7-e7ba-4df8-9384-d985fae6bede tempest-SnapshotDataIntegrityTests-1494076589 None] will copy from snapshot at /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-6bafdd19-6d59-4557-a0e3-17d1fbfc1053 {{(pid=88899) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Aug 03 08:41:05 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-be3cecf7-e7ba-4df8-9384-d985fae6bede tempest-SnapshotDataIntegrityTests-1494076589 None] Creating direct copy from snapshot {{(pid=88899) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Aug 03 08:41:05 devstack cinder-volume[88899]: DEBUG cinder.utils [None req-be3cecf7-e7ba-4df8-9384-d985fae6bede tempest-SnapshotDataIntegrityTests-1494076589 None] Path /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-6ee47f81-8d6d-4795-9014-8b0f37bd3d78 not found in is_blk_device check {{(pid=88899) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Aug 03 08:41:05 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-be3cecf7-e7ba-4df8-9384-d985fae6bede tempest-SnapshotDataIntegrityTests-1494076589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-6bafdd19-6d59-4557-a0e3-17d1fbfc1053 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-6ee47f81-8d6d-4795-9014-8b0f37bd3d78 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:41:05 devstack sudo[102696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-6bafdd19-6d59-4557-a0e3-17d1fbfc1053 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-6ee47f81-8d6d-4795-9014-8b0f37bd3d78 Aug 03 08:41:05 devstack sudo[102696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:41:06 devstack cinder-volume[88899]: DEBUG cinder.volume.flows.manager.create_volume [None req-50456d74-fa21-45fd-a06b-4096dbc0bc18 tempest-VolumesListAdminTestJSON-867525406 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88899) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 08:41:06 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-50456d74-fa21-45fd-a06b-4096dbc0bc18 tempest-VolumesListAdminTestJSON-867525406 None] Flow 'volume_create_manager' (5e6668d3-69a2-4ddc-b415-bbdd0e2ead6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:41:06 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-50456d74-fa21-45fd-a06b-4096dbc0bc18 tempest-VolumesListAdminTestJSON-867525406 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9aeb773-cac7-4eca-917b-db272510530b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:41:06 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-50456d74-fa21-45fd-a06b-4096dbc0bc18 tempest-VolumesListAdminTestJSON-867525406 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9aeb773-cac7-4eca-917b-db272510530b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:41:06Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9758b36e-77ce-4d2a-8761-d46603133a94,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='27b14347bb624587b4862982b014bc53',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:41:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:41:06Z,use_quota=True,user_id='b9a347f020dd45029424004f3370af45',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8bde7129-1dc4-42ab-b852-ab32c61b4921),volume_type_id=8bde7129-1dc4-42ab-b852-ab32c61b4921)' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:41:06 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-50456d74-fa21-45fd-a06b-4096dbc0bc18 tempest-VolumesListAdminTestJSON-867525406 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c2d7e41f-2fa7-4d4c-900e-641df273cba4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:41:06 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-50456d74-fa21-45fd-a06b-4096dbc0bc18 tempest-VolumesListAdminTestJSON-867525406 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c2d7e41f-2fa7-4d4c-900e-641df273cba4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:41:06 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-50456d74-fa21-45fd-a06b-4096dbc0bc18 tempest-VolumesListAdminTestJSON-867525406 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30ae8dee-dd03-43de-8f99-503bc76e9493) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:41:06 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-50456d74-fa21-45fd-a06b-4096dbc0bc18 tempest-VolumesListAdminTestJSON-867525406 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30ae8dee-dd03-43de-8f99-503bc76e9493) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9758b36e-77ce-4d2a-8761-d46603133a94', 'volume_name': 'volume-9758b36e-77ce-4d2a-8761-d46603133a94', 'volume_size': 1}' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:41:07 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-50456d74-fa21-45fd-a06b-4096dbc0bc18 tempest-VolumesListAdminTestJSON-867525406 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f792690f-016e-4d4d-a88b-be1be22e4ea4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:41:07 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-50456d74-fa21-45fd-a06b-4096dbc0bc18 tempest-VolumesListAdminTestJSON-867525406 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f792690f-016e-4d4d-a88b-be1be22e4ea4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:41:07 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-50456d74-fa21-45fd-a06b-4096dbc0bc18 tempest-VolumesListAdminTestJSON-867525406 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3586962d-c607-4f8b-82d8-db6a4ab66cfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:41:07 devstack cinder-volume[88899]: INFO cinder.volume.flows.manager.create_volume [None req-50456d74-fa21-45fd-a06b-4096dbc0bc18 tempest-VolumesListAdminTestJSON-867525406 None] Volume 9758b36e-77ce-4d2a-8761-d46603133a94: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9758b36e-77ce-4d2a-8761-d46603133a94', 'volume_size': 1} Aug 03 08:41:07 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-50456d74-fa21-45fd-a06b-4096dbc0bc18 tempest-VolumesListAdminTestJSON-867525406 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:41:11 devstack cinder-volume[88899]: DEBUG dbcounter [-] [88899] Writing DB stats cinder:SELECT=58,cinder:UPDATE=39,cinder:DELETE=7,cinder:INSERT=11 {{(pid=88899) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 03 08:41:11 devstack cinder-volume[88899]: DEBUG cinder.volume.flows.manager.create_volume [None req-4e04e3bf-8c27-4afe-8c72-6e6298848980 tempest-VolumesSnapshotTestJSON-561529062 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88899) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 08:41:11 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-4e04e3bf-8c27-4afe-8c72-6e6298848980 tempest-VolumesSnapshotTestJSON-561529062 None] Flow 'volume_create_manager' (5ca33b4d-a675-4886-a364-5f3dbc429213) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:41:11 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-4e04e3bf-8c27-4afe-8c72-6e6298848980 tempest-VolumesSnapshotTestJSON-561529062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (605aca2c-8c9f-4c31-bdf4-27dfdde8f81c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:41:12 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-4e04e3bf-8c27-4afe-8c72-6e6298848980 tempest-VolumesSnapshotTestJSON-561529062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (605aca2c-8c9f-4c31-bdf4-27dfdde8f81c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:41:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-2145296551',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d5138b8c-810b-4a8a-8abf-750f26d9a2e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6aadf5593f7c43d59bf60392e0f4bf5d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:41:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:41:12Z,use_quota=True,user_id='527c161cc21048f0a677fee8087ea52a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8bde7129-1dc4-42ab-b852-ab32c61b4921),volume_type_id=8bde7129-1dc4-42ab-b852-ab32c61b4921)' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:41:12 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-4e04e3bf-8c27-4afe-8c72-6e6298848980 tempest-VolumesSnapshotTestJSON-561529062 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50113fdf-a4c7-463e-b8dc-419b1dccf9bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:41:12 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-4e04e3bf-8c27-4afe-8c72-6e6298848980 tempest-VolumesSnapshotTestJSON-561529062 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50113fdf-a4c7-463e-b8dc-419b1dccf9bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:41:12 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-4e04e3bf-8c27-4afe-8c72-6e6298848980 tempest-VolumesSnapshotTestJSON-561529062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca0c0baa-3c7d-4458-b2e8-e5377c64df8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:41:12 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-4e04e3bf-8c27-4afe-8c72-6e6298848980 tempest-VolumesSnapshotTestJSON-561529062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca0c0baa-3c7d-4458-b2e8-e5377c64df8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd5138b8c-810b-4a8a-8abf-750f26d9a2e6', 'volume_name': 'volume-d5138b8c-810b-4a8a-8abf-750f26d9a2e6', 'volume_size': 1}' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:41:12 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-4e04e3bf-8c27-4afe-8c72-6e6298848980 tempest-VolumesSnapshotTestJSON-561529062 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e3b3ac0-c167-4179-81af-28edde32e3f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:41:12 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-4e04e3bf-8c27-4afe-8c72-6e6298848980 tempest-VolumesSnapshotTestJSON-561529062 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e3b3ac0-c167-4179-81af-28edde32e3f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:41:12 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-4e04e3bf-8c27-4afe-8c72-6e6298848980 tempest-VolumesSnapshotTestJSON-561529062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04781507-38dd-46b8-9456-559478796a91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:41:12 devstack cinder-volume[88899]: INFO cinder.volume.flows.manager.create_volume [None req-4e04e3bf-8c27-4afe-8c72-6e6298848980 tempest-VolumesSnapshotTestJSON-561529062 None] Volume d5138b8c-810b-4a8a-8abf-750f26d9a2e6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d5138b8c-810b-4a8a-8abf-750f26d9a2e6', 'volume_size': 1} Aug 03 08:41:12 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-4e04e3bf-8c27-4afe-8c72-6e6298848980 tempest-VolumesSnapshotTestJSON-561529062 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:41:12 devstack sudo[102696]: pam_unix(sudo:session): session closed for user root Aug 03 08:41:12 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-be3cecf7-e7ba-4df8-9384-d985fae6bede tempest-SnapshotDataIntegrityTests-1494076589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-6bafdd19-6d59-4557-a0e3-17d1fbfc1053 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-6ee47f81-8d6d-4795-9014-8b0f37bd3d78" returned: 0 in 6.573s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:41:12 devstack cinder-volume[88899]: DEBUG cinder.image.image_utils [None req-be3cecf7-e7ba-4df8-9384-d985fae6bede tempest-SnapshotDataIntegrityTests-1494076589 None] Image conversion details: src /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-6bafdd19-6d59-4557-a0e3-17d1fbfc1053, size 1024.00 MB, duration 6.57 sec, destination /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-6ee47f81-8d6d-4795-9014-8b0f37bd3d78 {{(pid=88899) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 03 08:41:12 devstack cinder-volume[88899]: INFO cinder.image.image_utils [None req-be3cecf7-e7ba-4df8-9384-d985fae6bede tempest-SnapshotDataIntegrityTests-1494076589 None] Converted 1024.00 MB image at 155.78 MB/s Aug 03 08:41:12 devstack cinder-volume[88899]: WARNING cinder.volume.drivers.remotefs [None req-be3cecf7-e7ba-4df8-9384-d985fae6bede tempest-SnapshotDataIntegrityTests-1494076589 None] /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-6ee47f81-8d6d-4795-9014-8b0f37bd3d78 is being set with open permissions: ugo+rw Aug 03 08:41:12 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-be3cecf7-e7ba-4df8-9384-d985fae6bede tempest-SnapshotDataIntegrityTests-1494076589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-6ee47f81-8d6d-4795-9014-8b0f37bd3d78 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:41:12 devstack sudo[102741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-6ee47f81-8d6d-4795-9014-8b0f37bd3d78 Aug 03 08:41:12 devstack sudo[102741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:41:12 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [req-f82e1ae7-7e02-4ebc-b768-552ca90846dd req-14ee1bb2-e776-4cb6-a87d-f392292bbd8c tempest-TestInstancesWithCinderVolumes-1639155420 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:41:12 devstack sudo[102741]: pam_unix(sudo:session): session closed for user root Aug 03 08:41:12 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-be3cecf7-e7ba-4df8-9384-d985fae6bede tempest-SnapshotDataIntegrityTests-1494076589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-6ee47f81-8d6d-4795-9014-8b0f37bd3d78" returned: 0 in 0.273s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:41:12 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-be3cecf7-e7ba-4df8-9384-d985fae6bede tempest-SnapshotDataIntegrityTests-1494076589 None] Lock "cinder-quobyte-6ee47f81-8d6d-4795-9014-8b0f37bd3d78" released by "_copy_volume_from_snapshot" :: held 7.889s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:41:12 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-be3cecf7-e7ba-4df8-9384-d985fae6bede tempest-SnapshotDataIntegrityTests-1494076589 None] Lock "cinder-quobyte-7eccf0d3-bff0-4d62-a704-dc41ced4a9ba-6ee47f81-8d6d-4795-9014-8b0f37bd3d78" released by "_create_volume_from_snapshot" :: held 7.987s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:41:12 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-be3cecf7-e7ba-4df8-9384-d985fae6bede tempest-SnapshotDataIntegrityTests-1494076589 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.036s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:41:12 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-50456d74-fa21-45fd-a06b-4096dbc0bc18 tempest-VolumesListAdminTestJSON-867525406 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.375s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:41:12 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-50456d74-fa21-45fd-a06b-4096dbc0bc18 tempest-VolumesListAdminTestJSON-867525406 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:41:06Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9758b36e-77ce-4d2a-8761-d46603133a94,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='27b14347bb624587b4862982b014bc53',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:41:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:41:06Z,use_quota=True,user_id='b9a347f020dd45029424004f3370af45',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8bde7129-1dc4-42ab-b852-ab32c61b4921),volume_type_id=8bde7129-1dc4-42ab-b852-ab32c61b4921)}" {{(pid=88899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 08:41:12 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-50456d74-fa21-45fd-a06b-4096dbc0bc18 tempest-VolumesListAdminTestJSON-867525406 None] Creating volume 9758b36e-77ce-4d2a-8761-d46603133a94 {{(pid=88899) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 08:41:12 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-50456d74-fa21-45fd-a06b-4096dbc0bc18 tempest-VolumesListAdminTestJSON-867525406 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:41:12 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-50456d74-fa21-45fd-a06b-4096dbc0bc18 tempest-VolumesListAdminTestJSON-867525406 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:41:12 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-50456d74-fa21-45fd-a06b-4096dbc0bc18 tempest-VolumesListAdminTestJSON-867525406 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:41:12 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-50456d74-fa21-45fd-a06b-4096dbc0bc18 tempest-VolumesListAdminTestJSON-867525406 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:41:12 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-50456d74-fa21-45fd-a06b-4096dbc0bc18 tempest-VolumesListAdminTestJSON-867525406 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:41:12 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-50456d74-fa21-45fd-a06b-4096dbc0bc18 tempest-VolumesListAdminTestJSON-867525406 None] Selected osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385 as target Quobyte volume. {{(pid=88899) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 08:41:12 devstack cinder-volume[88899]: INFO cinder.volume.drivers.remotefs [None req-50456d74-fa21-45fd-a06b-4096dbc0bc18 tempest-VolumesListAdminTestJSON-867525406 None] casted to osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385 Aug 03 08:41:12 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-50456d74-fa21-45fd-a06b-4096dbc0bc18 tempest-VolumesListAdminTestJSON-867525406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-9758b36e-77ce-4d2a-8761-d46603133a94 1073741824 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:41:12 devstack sudo[102744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-9758b36e-77ce-4d2a-8761-d46603133a94 1073741824 Aug 03 08:41:12 devstack sudo[102744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:41:12 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-be3cecf7-e7ba-4df8-9384-d985fae6bede tempest-SnapshotDataIntegrityTests-1494076589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9273807a-bd32-4df8-a912-f4d01a8a2c5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6ee47f81-8d6d-4795-9014-8b0f37bd3d78', 'volume_size': 1, 'snapshot_id': '7eccf0d3-bff0-4d62-a704-dc41ced4a9ba'}' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:41:12 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-be3cecf7-e7ba-4df8-9384-d985fae6bede tempest-SnapshotDataIntegrityTests-1494076589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (535449ca-e9b3-4f90-9e90-5d3c44360c93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:41:12 devstack cinder-volume[88899]: INFO cinder.volume.flows.manager.create_volume [None req-be3cecf7-e7ba-4df8-9384-d985fae6bede tempest-SnapshotDataIntegrityTests-1494076589 None] Volume volume-6ee47f81-8d6d-4795-9014-8b0f37bd3d78 (6ee47f81-8d6d-4795-9014-8b0f37bd3d78): created successfully Aug 03 08:41:12 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-be3cecf7-e7ba-4df8-9384-d985fae6bede tempest-SnapshotDataIntegrityTests-1494076589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (535449ca-e9b3-4f90-9e90-5d3c44360c93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:41:12 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-be3cecf7-e7ba-4df8-9384-d985fae6bede tempest-SnapshotDataIntegrityTests-1494076589 None] Flow 'volume_create_manager' (c73545e4-3f0e-403c-8be2-6c2f2de856bf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:41:12 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-be3cecf7-e7ba-4df8-9384-d985fae6bede tempest-SnapshotDataIntegrityTests-1494076589 None] Created volume successfully. Aug 03 08:41:12 devstack sudo[102744]: pam_unix(sudo:session): session closed for user root Aug 03 08:41:12 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-50456d74-fa21-45fd-a06b-4096dbc0bc18 tempest-VolumesListAdminTestJSON-867525406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-9758b36e-77ce-4d2a-8761-d46603133a94 1073741824" returned: 0 in 0.543s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:41:13 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-50456d74-fa21-45fd-a06b-4096dbc0bc18 tempest-VolumesListAdminTestJSON-867525406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-9758b36e-77ce-4d2a-8761-d46603133a94 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:41:13 devstack sudo[102753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-9758b36e-77ce-4d2a-8761-d46603133a94 Aug 03 08:41:13 devstack sudo[102753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:41:13 devstack sudo[102753]: pam_unix(sudo:session): session closed for user root Aug 03 08:41:13 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-50456d74-fa21-45fd-a06b-4096dbc0bc18 tempest-VolumesListAdminTestJSON-867525406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-9758b36e-77ce-4d2a-8761-d46603133a94" returned: 0 in 0.335s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:41:13 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-50456d74-fa21-45fd-a06b-4096dbc0bc18 tempest-VolumesListAdminTestJSON-867525406 None] <== create_volume: return (938ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'} {{(pid=88899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 08:41:13 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-50456d74-fa21-45fd-a06b-4096dbc0bc18 tempest-VolumesListAdminTestJSON-867525406 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.944s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:41:13 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-4e04e3bf-8c27-4afe-8c72-6e6298848980 tempest-VolumesSnapshotTestJSON-561529062 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.297s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:41:13 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-4e04e3bf-8c27-4afe-8c72-6e6298848980 tempest-VolumesSnapshotTestJSON-561529062 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:41:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-2145296551',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d5138b8c-810b-4a8a-8abf-750f26d9a2e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6aadf5593f7c43d59bf60392e0f4bf5d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:41:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:41:12Z,use_quota=True,user_id='527c161cc21048f0a677fee8087ea52a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8bde7129-1dc4-42ab-b852-ab32c61b4921),volume_type_id=8bde7129-1dc4-42ab-b852-ab32c61b4921)}" {{(pid=88899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 08:41:13 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-4e04e3bf-8c27-4afe-8c72-6e6298848980 tempest-VolumesSnapshotTestJSON-561529062 None] Creating volume d5138b8c-810b-4a8a-8abf-750f26d9a2e6 {{(pid=88899) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 08:41:13 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-4e04e3bf-8c27-4afe-8c72-6e6298848980 tempest-VolumesSnapshotTestJSON-561529062 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:41:13 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-4e04e3bf-8c27-4afe-8c72-6e6298848980 tempest-VolumesSnapshotTestJSON-561529062 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:41:13 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-4e04e3bf-8c27-4afe-8c72-6e6298848980 tempest-VolumesSnapshotTestJSON-561529062 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:41:13 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-4e04e3bf-8c27-4afe-8c72-6e6298848980 tempest-VolumesSnapshotTestJSON-561529062 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:41:13 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-4e04e3bf-8c27-4afe-8c72-6e6298848980 tempest-VolumesSnapshotTestJSON-561529062 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:41:13 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-4e04e3bf-8c27-4afe-8c72-6e6298848980 tempest-VolumesSnapshotTestJSON-561529062 None] Selected osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385 as target Quobyte volume. {{(pid=88899) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 08:41:13 devstack cinder-volume[88899]: INFO cinder.volume.drivers.remotefs [None req-4e04e3bf-8c27-4afe-8c72-6e6298848980 tempest-VolumesSnapshotTestJSON-561529062 None] casted to osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385 Aug 03 08:41:13 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-4e04e3bf-8c27-4afe-8c72-6e6298848980 tempest-VolumesSnapshotTestJSON-561529062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-d5138b8c-810b-4a8a-8abf-750f26d9a2e6 1073741824 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:41:13 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-50456d74-fa21-45fd-a06b-4096dbc0bc18 tempest-VolumesListAdminTestJSON-867525406 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3586962d-c607-4f8b-82d8-db6a4ab66cfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9758b36e-77ce-4d2a-8761-d46603133a94', 'volume_size': 1}' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:41:13 devstack sudo[102760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-d5138b8c-810b-4a8a-8abf-750f26d9a2e6 1073741824 Aug 03 08:41:13 devstack sudo[102760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:41:13 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-50456d74-fa21-45fd-a06b-4096dbc0bc18 tempest-VolumesListAdminTestJSON-867525406 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce18014d-3696-46e3-8155-6ccc7ad8300e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:41:13 devstack cinder-volume[88899]: INFO cinder.volume.flows.manager.create_volume [None req-50456d74-fa21-45fd-a06b-4096dbc0bc18 tempest-VolumesListAdminTestJSON-867525406 None] Volume volume-9758b36e-77ce-4d2a-8761-d46603133a94 (9758b36e-77ce-4d2a-8761-d46603133a94): created successfully Aug 03 08:41:13 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-50456d74-fa21-45fd-a06b-4096dbc0bc18 tempest-VolumesListAdminTestJSON-867525406 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce18014d-3696-46e3-8155-6ccc7ad8300e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:41:13 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-50456d74-fa21-45fd-a06b-4096dbc0bc18 tempest-VolumesListAdminTestJSON-867525406 None] Flow 'volume_create_manager' (5e6668d3-69a2-4ddc-b415-bbdd0e2ead6e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:41:13 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-50456d74-fa21-45fd-a06b-4096dbc0bc18 tempest-VolumesListAdminTestJSON-867525406 None] Created volume successfully. Aug 03 08:41:13 devstack sudo[102760]: pam_unix(sudo:session): session closed for user root Aug 03 08:41:13 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-4e04e3bf-8c27-4afe-8c72-6e6298848980 tempest-VolumesSnapshotTestJSON-561529062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-d5138b8c-810b-4a8a-8abf-750f26d9a2e6 1073741824" returned: 0 in 0.462s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:41:13 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-4e04e3bf-8c27-4afe-8c72-6e6298848980 tempest-VolumesSnapshotTestJSON-561529062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-d5138b8c-810b-4a8a-8abf-750f26d9a2e6 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:41:13 devstack sudo[102772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-d5138b8c-810b-4a8a-8abf-750f26d9a2e6 Aug 03 08:41:13 devstack sudo[102772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:41:13 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-5c55156a-1681-4bef-8f5f-7e9584c08856 tempest-VolumesListAdminTestJSON-867525406 None] Acquiring lock "cinder-9758b36e-77ce-4d2a-8761-d46603133a94-delete_volume" by "delete_volume" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:41:13 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-5c55156a-1681-4bef-8f5f-7e9584c08856 tempest-VolumesListAdminTestJSON-867525406 None] Lock "cinder-9758b36e-77ce-4d2a-8761-d46603133a94-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:41:14 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-5c55156a-1681-4bef-8f5f-7e9584c08856 tempest-VolumesListAdminTestJSON-867525406 None] Acquiring lock "cinder-quobyte-9758b36e-77ce-4d2a-8761-d46603133a94" by "delete_volume" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:41:14 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-5c55156a-1681-4bef-8f5f-7e9584c08856 tempest-VolumesListAdminTestJSON-867525406 None] Lock "cinder-quobyte-9758b36e-77ce-4d2a-8761-d46603133a94" acquired by "delete_volume" :: waited 0.018s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:41:14 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f1017fc-7b07-4e22-a204-a1e8d8e3f5ec]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:41:14 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-5c55156a-1681-4bef-8f5f-7e9584c08856 tempest-VolumesListAdminTestJSON-867525406 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-9758b36e-77ce-4d2a-8761-d46603133a94 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:41:14 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [req-93a623c8-8c6d-48cb-b3a0-1ceb96ae128d req-361dc846-f473-4d64-bdd8-dca96e890328 tempest-SnapshotDataIntegrityTests-1494076589 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:41:14 devstack sudo[102772]: pam_unix(sudo:session): session closed for user root Aug 03 08:41:14 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-4e04e3bf-8c27-4afe-8c72-6e6298848980 tempest-VolumesSnapshotTestJSON-561529062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-d5138b8c-810b-4a8a-8abf-750f26d9a2e6" returned: 0 in 0.308s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:41:14 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-4e04e3bf-8c27-4afe-8c72-6e6298848980 tempest-VolumesSnapshotTestJSON-561529062 None] <== create_volume: return (822ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'} {{(pid=88899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 08:41:14 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-4e04e3bf-8c27-4afe-8c72-6e6298848980 tempest-VolumesSnapshotTestJSON-561529062 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.826s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:41:14 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [req-f82e1ae7-7e02-4ebc-b768-552ca90846dd req-14ee1bb2-e776-4cb6-a87d-f392292bbd8c tempest-TestInstancesWithCinderVolumes-1639155420 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.989s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:41:14 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-4e04e3bf-8c27-4afe-8c72-6e6298848980 tempest-VolumesSnapshotTestJSON-561529062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04781507-38dd-46b8-9456-559478796a91) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d5138b8c-810b-4a8a-8abf-750f26d9a2e6', 'volume_size': 1}' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:41:14 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-4e04e3bf-8c27-4afe-8c72-6e6298848980 tempest-VolumesSnapshotTestJSON-561529062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (433b7b23-d3e4-4430-8ac2-b1137be265dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:41:14 devstack sudo[102776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-9758b36e-77ce-4d2a-8761-d46603133a94 Aug 03 08:41:14 devstack sudo[102776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:41:14 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [req-f82e1ae7-7e02-4ebc-b768-552ca90846dd req-14ee1bb2-e776-4cb6-a87d-f392292bbd8c tempest-TestInstancesWithCinderVolumes-1639155420 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.028s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:41:14 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [req-93a623c8-8c6d-48cb-b3a0-1ceb96ae128d req-361dc846-f473-4d64-bdd8-dca96e890328 tempest-SnapshotDataIntegrityTests-1494076589 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.096s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:41:14 devstack cinder-volume[88899]: INFO cinder.volume.flows.manager.create_volume [None req-4e04e3bf-8c27-4afe-8c72-6e6298848980 tempest-VolumesSnapshotTestJSON-561529062 None] Volume volume-d5138b8c-810b-4a8a-8abf-750f26d9a2e6 (d5138b8c-810b-4a8a-8abf-750f26d9a2e6): created successfully Aug 03 08:41:14 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-4e04e3bf-8c27-4afe-8c72-6e6298848980 tempest-VolumesSnapshotTestJSON-561529062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (433b7b23-d3e4-4430-8ac2-b1137be265dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:41:14 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-4e04e3bf-8c27-4afe-8c72-6e6298848980 tempest-VolumesSnapshotTestJSON-561529062 None] Flow 'volume_create_manager' (5ca33b4d-a675-4886-a364-5f3dbc429213) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:41:14 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [req-93a623c8-8c6d-48cb-b3a0-1ceb96ae128d req-361dc846-f473-4d64-bdd8-dca96e890328 tempest-SnapshotDataIntegrityTests-1494076589 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.032s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:41:14 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-4e04e3bf-8c27-4afe-8c72-6e6298848980 tempest-VolumesSnapshotTestJSON-561529062 None] Created volume successfully. Aug 03 08:41:14 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [req-f82e1ae7-7e02-4ebc-b768-552ca90846dd req-14ee1bb2-e776-4cb6-a87d-f392292bbd8c tempest-TestInstancesWithCinderVolumes-1639155420 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385', 'name': 'volume-a673b8d7-ba1a-4e56-9cfa-9e35c6fc2587', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'deb3bd3e-1bff-4036-8661-f7389b79b2b1', 'enforce_multipath': True} {{(pid=88899) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 03 08:41:14 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [req-93a623c8-8c6d-48cb-b3a0-1ceb96ae128d req-361dc846-f473-4d64-bdd8-dca96e890328 tempest-SnapshotDataIntegrityTests-1494076589 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385', 'name': 'volume-6ee47f81-8d6d-4795-9014-8b0f37bd3d78', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '291f00d5-e252-4c71-a475-f6cbd32cd33e', 'enforce_multipath': True} {{(pid=88899) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 03 08:41:14 devstack cinder-volume[88899]: INFO cinder.volume.manager [req-f82e1ae7-7e02-4ebc-b768-552ca90846dd req-14ee1bb2-e776-4cb6-a87d-f392292bbd8c tempest-TestInstancesWithCinderVolumes-1639155420 None] attachment_update completed successfully. Aug 03 08:41:14 devstack cinder-volume[88899]: INFO cinder.volume.manager [req-93a623c8-8c6d-48cb-b3a0-1ceb96ae128d req-361dc846-f473-4d64-bdd8-dca96e890328 tempest-SnapshotDataIntegrityTests-1494076589 None] attachment_update completed successfully. Aug 03 08:41:14 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-960861c8-9e9d-43b9-909e-412123f94bcc tempest-VolumesListAdminTestJSON-152554352 None] Acquiring lock "cinder-e616df58-2556-4f48-b1ba-9a09710b8614-delete_volume" by "delete_volume" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:41:14 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-960861c8-9e9d-43b9-909e-412123f94bcc tempest-VolumesListAdminTestJSON-152554352 None] Lock "cinder-e616df58-2556-4f48-b1ba-9a09710b8614-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:41:14 devstack sudo[102776]: pam_unix(sudo:session): session closed for user root Aug 03 08:41:14 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-5c55156a-1681-4bef-8f5f-7e9584c08856 tempest-VolumesListAdminTestJSON-867525406 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-9758b36e-77ce-4d2a-8761-d46603133a94" returned: 0 in 0.440s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:41:14 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-5c55156a-1681-4bef-8f5f-7e9584c08856 tempest-VolumesListAdminTestJSON-867525406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-9758b36e-77ce-4d2a-8761-d46603133a94 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:41:14 devstack sudo[102785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-9758b36e-77ce-4d2a-8761-d46603133a94 Aug 03 08:41:14 devstack sudo[102785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:41:14 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-960861c8-9e9d-43b9-909e-412123f94bcc tempest-VolumesListAdminTestJSON-152554352 None] Acquiring lock "cinder-quobyte-e616df58-2556-4f48-b1ba-9a09710b8614" by "delete_volume" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:41:14 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-960861c8-9e9d-43b9-909e-412123f94bcc tempest-VolumesListAdminTestJSON-152554352 None] Lock "cinder-quobyte-e616df58-2556-4f48-b1ba-9a09710b8614" acquired by "delete_volume" :: waited 0.018s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:41:14 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[26b11223-90eb-4dfe-a03d-e33f56ecfe0b]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:41:14 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-960861c8-9e9d-43b9-909e-412123f94bcc tempest-VolumesListAdminTestJSON-152554352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-e616df58-2556-4f48-b1ba-9a09710b8614 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:41:14 devstack sudo[102789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-e616df58-2556-4f48-b1ba-9a09710b8614 Aug 03 08:41:14 devstack sudo[102789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:41:14 devstack sudo[102785]: pam_unix(sudo:session): session closed for user root Aug 03 08:41:14 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-5c55156a-1681-4bef-8f5f-7e9584c08856 tempest-VolumesListAdminTestJSON-867525406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-9758b36e-77ce-4d2a-8761-d46603133a94" returned: 0 in 0.304s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:41:14 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-5c55156a-1681-4bef-8f5f-7e9584c08856 tempest-VolumesListAdminTestJSON-867525406 None] Lock "cinder-quobyte-9758b36e-77ce-4d2a-8761-d46603133a94" released by "delete_volume" :: held 0.806s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:41:14 devstack cinder-volume[88899]: DEBUG cinder.quota [None req-5c55156a-1681-4bef-8f5f-7e9584c08856 tempest-VolumesListAdminTestJSON-867525406 None] Created reservations ['f15a9c49-23b8-4f0b-85bb-70d95446d254', '52ff7a13-fb10-4b59-a171-519e3dfd4262', '2975349d-0825-433c-8a5e-2c6c718ec281', 'fb2584c0-e6f9-4d8a-b3b1-00de25900b6b'] {{(pid=88899) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 08:41:15 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-5c55156a-1681-4bef-8f5f-7e9584c08856 tempest-VolumesListAdminTestJSON-867525406 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:41:15 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-5c55156a-1681-4bef-8f5f-7e9584c08856 tempest-VolumesListAdminTestJSON-867525406 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:41:15 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-5c55156a-1681-4bef-8f5f-7e9584c08856 tempest-VolumesListAdminTestJSON-867525406 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:41:15 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-5c55156a-1681-4bef-8f5f-7e9584c08856 tempest-VolumesListAdminTestJSON-867525406 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:41:15 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-5c55156a-1681-4bef-8f5f-7e9584c08856 tempest-VolumesListAdminTestJSON-867525406 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:41:15 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-5c55156a-1681-4bef-8f5f-7e9584c08856 tempest-VolumesListAdminTestJSON-867525406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:41:15 devstack sudo[102799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a Aug 03 08:41:15 devstack sudo[102799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:41:15 devstack sudo[102789]: pam_unix(sudo:session): session closed for user root Aug 03 08:41:15 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-960861c8-9e9d-43b9-909e-412123f94bcc tempest-VolumesListAdminTestJSON-152554352 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-e616df58-2556-4f48-b1ba-9a09710b8614" returned: 0 in 0.606s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:41:15 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-960861c8-9e9d-43b9-909e-412123f94bcc tempest-VolumesListAdminTestJSON-152554352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-e616df58-2556-4f48-b1ba-9a09710b8614 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:41:15 devstack sudo[102803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-e616df58-2556-4f48-b1ba-9a09710b8614 Aug 03 08:41:15 devstack sudo[102803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:41:15 devstack sudo[102799]: pam_unix(sudo:session): session closed for user root Aug 03 08:41:15 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-5c55156a-1681-4bef-8f5f-7e9584c08856 tempest-VolumesListAdminTestJSON-867525406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a" returned: 0 in 0.452s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:41:15 devstack cinder-volume[88899]: DEBUG cinder.manager [None req-5c55156a-1681-4bef-8f5f-7e9584c08856 tempest-VolumesListAdminTestJSON-867525406 None] Notifying Schedulers of capabilities ... {{(pid=88899) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 08:41:15 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-5c55156a-1681-4bef-8f5f-7e9584c08856 tempest-VolumesListAdminTestJSON-867525406 None] Deleted volume successfully. Aug 03 08:41:15 devstack sudo[102803]: pam_unix(sudo:session): session closed for user root Aug 03 08:41:15 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-960861c8-9e9d-43b9-909e-412123f94bcc tempest-VolumesListAdminTestJSON-152554352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-e616df58-2556-4f48-b1ba-9a09710b8614" returned: 0 in 0.438s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:41:15 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-5c55156a-1681-4bef-8f5f-7e9584c08856 tempest-VolumesListAdminTestJSON-867525406 None] Lock "cinder-9758b36e-77ce-4d2a-8761-d46603133a94-delete_volume" released by "delete_volume" :: held 1.704s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:41:15 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-960861c8-9e9d-43b9-909e-412123f94bcc tempest-VolumesListAdminTestJSON-152554352 None] Lock "cinder-quobyte-e616df58-2556-4f48-b1ba-9a09710b8614" released by "delete_volume" :: held 1.106s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:41:15 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-96e87a88-701e-45ef-a984-fef660ed640e tempest-VolumesSnapshotTestJSON-561529062 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:41:15 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-96e87a88-701e-45ef-a984-fef660ed640e tempest-VolumesSnapshotTestJSON-561529062 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:41:15 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-96e87a88-701e-45ef-a984-fef660ed640e tempest-VolumesSnapshotTestJSON-561529062 None] Creating offline snapshot c95e6608-fab3-4b4f-821d-8f4ebcea81cc of volume d5138b8c-810b-4a8a-8abf-750f26d9a2e6 {{(pid=88899) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 03 08:41:15 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbd201ea-4ca2-4de8-b9b5-e464aafac656]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:41:15 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-96e87a88-701e-45ef-a984-fef660ed640e tempest-VolumesSnapshotTestJSON-561529062 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-d5138b8c-810b-4a8a-8abf-750f26d9a2e6 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:41:15 devstack cinder-volume[88899]: DEBUG cinder.quota [None req-960861c8-9e9d-43b9-909e-412123f94bcc tempest-VolumesListAdminTestJSON-152554352 None] Created reservations ['4da27c0f-b712-49ee-ba3b-4fddd02c4ded', '4d3c9cef-b972-4c4b-a088-f5a68c0b7fc7', 'e50fecba-31bc-4fa0-90f0-815c41a45f5d', 'f1f709e4-1344-46b9-88c8-476290b2956f'] {{(pid=88899) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 08:41:15 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-960861c8-9e9d-43b9-909e-412123f94bcc tempest-VolumesListAdminTestJSON-152554352 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:41:15 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-960861c8-9e9d-43b9-909e-412123f94bcc tempest-VolumesListAdminTestJSON-152554352 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:41:15 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-960861c8-9e9d-43b9-909e-412123f94bcc tempest-VolumesListAdminTestJSON-152554352 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:41:15 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-960861c8-9e9d-43b9-909e-412123f94bcc tempest-VolumesListAdminTestJSON-152554352 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:41:15 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-960861c8-9e9d-43b9-909e-412123f94bcc tempest-VolumesListAdminTestJSON-152554352 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:41:15 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-960861c8-9e9d-43b9-909e-412123f94bcc tempest-VolumesListAdminTestJSON-152554352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:41:15 devstack sudo[102814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a Aug 03 08:41:15 devstack sudo[102814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:41:15 devstack sudo[102807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-d5138b8c-810b-4a8a-8abf-750f26d9a2e6 Aug 03 08:41:15 devstack sudo[102807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:41:16 devstack sudo[102814]: pam_unix(sudo:session): session closed for user root Aug 03 08:41:16 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-960861c8-9e9d-43b9-909e-412123f94bcc tempest-VolumesListAdminTestJSON-152554352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a" returned: 0 in 0.304s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:41:16 devstack cinder-volume[88899]: DEBUG cinder.manager [None req-960861c8-9e9d-43b9-909e-412123f94bcc tempest-VolumesListAdminTestJSON-152554352 None] Notifying Schedulers of capabilities ... {{(pid=88899) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 08:41:16 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-960861c8-9e9d-43b9-909e-412123f94bcc tempest-VolumesListAdminTestJSON-152554352 None] Deleted volume successfully. Aug 03 08:41:16 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-960861c8-9e9d-43b9-909e-412123f94bcc tempest-VolumesListAdminTestJSON-152554352 None] Lock "cinder-e616df58-2556-4f48-b1ba-9a09710b8614-delete_volume" released by "delete_volume" :: held 1.727s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:41:16 devstack sudo[102807]: pam_unix(sudo:session): session closed for user root Aug 03 08:41:16 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-96e87a88-701e-45ef-a984-fef660ed640e tempest-VolumesSnapshotTestJSON-561529062 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-d5138b8c-810b-4a8a-8abf-750f26d9a2e6" returned: 0 in 0.487s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:41:16 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-96e87a88-701e-45ef-a984-fef660ed640e tempest-VolumesSnapshotTestJSON-561529062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-d5138b8c-810b-4a8a-8abf-750f26d9a2e6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-d5138b8c-810b-4a8a-8abf-750f26d9a2e6.c95e6608-fab3-4b4f-821d-8f4ebcea81cc 1G {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:41:16 devstack sudo[102829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-d5138b8c-810b-4a8a-8abf-750f26d9a2e6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-d5138b8c-810b-4a8a-8abf-750f26d9a2e6.c95e6608-fab3-4b4f-821d-8f4ebcea81cc 1G Aug 03 08:41:16 devstack sudo[102829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:41:16 devstack sudo[102829]: pam_unix(sudo:session): session closed for user root Aug 03 08:41:16 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-96e87a88-701e-45ef-a984-fef660ed640e tempest-VolumesSnapshotTestJSON-561529062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-d5138b8c-810b-4a8a-8abf-750f26d9a2e6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-d5138b8c-810b-4a8a-8abf-750f26d9a2e6.c95e6608-fab3-4b4f-821d-8f4ebcea81cc 1G" returned: 0 in 0.511s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:41:16 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-96e87a88-701e-45ef-a984-fef660ed640e tempest-VolumesSnapshotTestJSON-561529062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d5138b8c-810b-4a8a-8abf-750f26d9a2e6 -F qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-d5138b8c-810b-4a8a-8abf-750f26d9a2e6.c95e6608-fab3-4b4f-821d-8f4ebcea81cc {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:41:16 devstack sudo[102849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d5138b8c-810b-4a8a-8abf-750f26d9a2e6 -F qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-d5138b8c-810b-4a8a-8abf-750f26d9a2e6.c95e6608-fab3-4b4f-821d-8f4ebcea81cc Aug 03 08:41:16 devstack sudo[102849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:41:16 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-7d5a1ee6-ca6a-4dab-a01c-79077761f358 tempest-VolumesListAdminTestJSON-152554352 None] Acquiring lock "cinder-a1bedb06-eb1d-4cff-acb4-ed92216cb38a-delete_volume" by "delete_volume" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:41:16 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-7d5a1ee6-ca6a-4dab-a01c-79077761f358 tempest-VolumesListAdminTestJSON-152554352 None] Lock "cinder-a1bedb06-eb1d-4cff-acb4-ed92216cb38a-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:41:17 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [req-d4c4f056-af91-47e1-9bd4-60a4feea6f67 req-145ff69f-e073-4442-aba3-a80118350a50 tempest-TestInstancesWithCinderVolumes-1639155420 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:41:17 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-7d5a1ee6-ca6a-4dab-a01c-79077761f358 tempest-VolumesListAdminTestJSON-152554352 None] Acquiring lock "cinder-quobyte-a1bedb06-eb1d-4cff-acb4-ed92216cb38a" by "delete_volume" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:41:17 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-7d5a1ee6-ca6a-4dab-a01c-79077761f358 tempest-VolumesListAdminTestJSON-152554352 None] Lock "cinder-quobyte-a1bedb06-eb1d-4cff-acb4-ed92216cb38a" acquired by "delete_volume" :: waited 0.017s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:41:17 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[0033d2e9-efeb-4cf8-9af7-912143e66cb2]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:41:17 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-7d5a1ee6-ca6a-4dab-a01c-79077761f358 tempest-VolumesListAdminTestJSON-152554352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-a1bedb06-eb1d-4cff-acb4-ed92216cb38a {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:41:17 devstack sudo[102849]: pam_unix(sudo:session): session closed for user root Aug 03 08:41:17 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-96e87a88-701e-45ef-a984-fef660ed640e tempest-VolumesSnapshotTestJSON-561529062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d5138b8c-810b-4a8a-8abf-750f26d9a2e6 -F qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-d5138b8c-810b-4a8a-8abf-750f26d9a2e6.c95e6608-fab3-4b4f-821d-8f4ebcea81cc" returned: 0 in 0.359s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:41:17 devstack cinder-volume[88899]: WARNING cinder.volume.drivers.remotefs [None req-96e87a88-701e-45ef-a984-fef660ed640e tempest-VolumesSnapshotTestJSON-561529062 None] /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-d5138b8c-810b-4a8a-8abf-750f26d9a2e6.c95e6608-fab3-4b4f-821d-8f4ebcea81cc is being set with open permissions: ugo+rw Aug 03 08:41:17 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-96e87a88-701e-45ef-a984-fef660ed640e tempest-VolumesSnapshotTestJSON-561529062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-d5138b8c-810b-4a8a-8abf-750f26d9a2e6.c95e6608-fab3-4b4f-821d-8f4ebcea81cc {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:41:17 devstack sudo[102867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-d5138b8c-810b-4a8a-8abf-750f26d9a2e6.c95e6608-fab3-4b4f-821d-8f4ebcea81cc Aug 03 08:41:17 devstack sudo[102867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:41:17 devstack sudo[102863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-a1bedb06-eb1d-4cff-acb4-ed92216cb38a Aug 03 08:41:17 devstack sudo[102863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:41:17 devstack sudo[102867]: pam_unix(sudo:session): session closed for user root Aug 03 08:41:17 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-96e87a88-701e-45ef-a984-fef660ed640e tempest-VolumesSnapshotTestJSON-561529062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-d5138b8c-810b-4a8a-8abf-750f26d9a2e6.c95e6608-fab3-4b4f-821d-8f4ebcea81cc" returned: 0 in 0.283s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:41:17 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-96e87a88-701e-45ef-a984-fef660ed640e tempest-VolumesSnapshotTestJSON-561529062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-d5138b8c-810b-4a8a-8abf-750f26d9a2e6.info {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:41:17 devstack sudo[102863]: pam_unix(sudo:session): session closed for user root Aug 03 08:41:17 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-7d5a1ee6-ca6a-4dab-a01c-79077761f358 tempest-VolumesListAdminTestJSON-152554352 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-a1bedb06-eb1d-4cff-acb4-ed92216cb38a" returned: 0 in 0.402s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:41:17 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-7d5a1ee6-ca6a-4dab-a01c-79077761f358 tempest-VolumesListAdminTestJSON-152554352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-a1bedb06-eb1d-4cff-acb4-ed92216cb38a {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:41:17 devstack sudo[102874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-d5138b8c-810b-4a8a-8abf-750f26d9a2e6.info Aug 03 08:41:17 devstack sudo[102874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:41:17 devstack sudo[102875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-a1bedb06-eb1d-4cff-acb4-ed92216cb38a Aug 03 08:41:17 devstack sudo[102875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:41:17 devstack sudo[102874]: pam_unix(sudo:session): session closed for user root Aug 03 08:41:17 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-96e87a88-701e-45ef-a984-fef660ed640e tempest-VolumesSnapshotTestJSON-561529062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-d5138b8c-810b-4a8a-8abf-750f26d9a2e6.info" returned: 0 in 0.303s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:41:17 devstack cinder-volume[88899]: WARNING cinder.volume.drivers.remotefs [None req-96e87a88-701e-45ef-a984-fef660ed640e tempest-VolumesSnapshotTestJSON-561529062 None] /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-d5138b8c-810b-4a8a-8abf-750f26d9a2e6.info is being set with open permissions: ugo+rw Aug 03 08:41:17 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-96e87a88-701e-45ef-a984-fef660ed640e tempest-VolumesSnapshotTestJSON-561529062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-d5138b8c-810b-4a8a-8abf-750f26d9a2e6.info {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:41:17 devstack sudo[102875]: pam_unix(sudo:session): session closed for user root Aug 03 08:41:17 devstack sudo[102880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-d5138b8c-810b-4a8a-8abf-750f26d9a2e6.info Aug 03 08:41:17 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-7d5a1ee6-ca6a-4dab-a01c-79077761f358 tempest-VolumesListAdminTestJSON-152554352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-a1bedb06-eb1d-4cff-acb4-ed92216cb38a" returned: 0 in 0.313s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:41:17 devstack sudo[102880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:41:17 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-7d5a1ee6-ca6a-4dab-a01c-79077761f358 tempest-VolumesListAdminTestJSON-152554352 None] Lock "cinder-quobyte-a1bedb06-eb1d-4cff-acb4-ed92216cb38a" released by "delete_volume" :: held 0.765s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:41:17 devstack cinder-volume[88899]: DEBUG cinder.quota [None req-7d5a1ee6-ca6a-4dab-a01c-79077761f358 tempest-VolumesListAdminTestJSON-152554352 None] Created reservations ['ecf7f2fe-a59c-47cf-96f1-d631df058854', '338055db-ee36-4bc3-bdcd-f18b7a0b2227', 'effb5a86-5d19-4964-b747-72882595487e', '88bcb9e4-0ecb-4728-bfda-186a69f19f89'] {{(pid=88899) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 08:41:17 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-7d5a1ee6-ca6a-4dab-a01c-79077761f358 tempest-VolumesListAdminTestJSON-152554352 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:41:17 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-7d5a1ee6-ca6a-4dab-a01c-79077761f358 tempest-VolumesListAdminTestJSON-152554352 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:41:17 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-7d5a1ee6-ca6a-4dab-a01c-79077761f358 tempest-VolumesListAdminTestJSON-152554352 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:41:17 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-7d5a1ee6-ca6a-4dab-a01c-79077761f358 tempest-VolumesListAdminTestJSON-152554352 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:41:17 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-7d5a1ee6-ca6a-4dab-a01c-79077761f358 tempest-VolumesListAdminTestJSON-152554352 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:41:17 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-7d5a1ee6-ca6a-4dab-a01c-79077761f358 tempest-VolumesListAdminTestJSON-152554352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:41:17 devstack sudo[102885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a Aug 03 08:41:17 devstack sudo[102885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:41:18 devstack sudo[102880]: pam_unix(sudo:session): session closed for user root Aug 03 08:41:18 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-96e87a88-701e-45ef-a984-fef660ed640e tempest-VolumesSnapshotTestJSON-561529062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-d5138b8c-810b-4a8a-8abf-750f26d9a2e6.info" returned: 0 in 0.274s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:41:18 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-96e87a88-701e-45ef-a984-fef660ed640e tempest-VolumesSnapshotTestJSON-561529062 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.343s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:41:18 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [req-d4c4f056-af91-47e1-9bd4-60a4feea6f67 req-145ff69f-e073-4442-aba3-a80118350a50 tempest-TestInstancesWithCinderVolumes-1639155420 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.050s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:41:18 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [req-d4c4f056-af91-47e1-9bd4-60a4feea6f67 req-145ff69f-e073-4442-aba3-a80118350a50 tempest-TestInstancesWithCinderVolumes-1639155420 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.033s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:41:18 devstack cinder-volume[88899]: INFO cinder.volume.manager [req-c3ec15e4-aefd-4e85-bafb-598948aefb02 req-49a1889c-dff4-4c2c-83e1-61f6ec94730f tempest-SnapshotDataIntegrityTests-1494076589 None] Terminate volume connection completed successfully. Aug 03 08:41:18 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [req-c3ec15e4-aefd-4e85-bafb-598948aefb02 req-49a1889c-dff4-4c2c-83e1-61f6ec94730f tempest-SnapshotDataIntegrityTests-1494076589 None] Deleting attachment 291f00d5-e252-4c71-a475-f6cbd32cd33e. {{(pid=88899) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 03 08:41:18 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [req-d4c4f056-af91-47e1-9bd4-60a4feea6f67 req-145ff69f-e073-4442-aba3-a80118350a50 tempest-TestInstancesWithCinderVolumes-1639155420 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385', 'name': 'volume-3261e91f-070b-4599-a2ac-b8ca735be47a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '907cea8c-d01a-4155-9792-0bc000a4be86', 'enforce_multipath': True} {{(pid=88899) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 03 08:41:18 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-96e87a88-701e-45ef-a984-fef660ed640e tempest-VolumesSnapshotTestJSON-561529062 None] Create snapshot completed successfully Aug 03 08:41:18 devstack cinder-volume[88899]: INFO cinder.volume.manager [req-d4c4f056-af91-47e1-9bd4-60a4feea6f67 req-145ff69f-e073-4442-aba3-a80118350a50 tempest-TestInstancesWithCinderVolumes-1639155420 None] attachment_update completed successfully. Aug 03 08:41:18 devstack sudo[102885]: pam_unix(sudo:session): session closed for user root Aug 03 08:41:18 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-7d5a1ee6-ca6a-4dab-a01c-79077761f358 tempest-VolumesListAdminTestJSON-152554352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a" returned: 0 in 0.287s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:41:18 devstack cinder-volume[88899]: DEBUG cinder.manager [None req-7d5a1ee6-ca6a-4dab-a01c-79077761f358 tempest-VolumesListAdminTestJSON-152554352 None] Notifying Schedulers of capabilities ... {{(pid=88899) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 08:41:18 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-7d5a1ee6-ca6a-4dab-a01c-79077761f358 tempest-VolumesListAdminTestJSON-152554352 None] Deleted volume successfully. Aug 03 08:41:18 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-7d5a1ee6-ca6a-4dab-a01c-79077761f358 tempest-VolumesListAdminTestJSON-152554352 None] Lock "cinder-a1bedb06-eb1d-4cff-acb4-ed92216cb38a-delete_volume" released by "delete_volume" :: held 1.288s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:41:18 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-3572c50b-a2ed-45ef-871a-5e6179ab7ff7 tempest-VolumesListAdminTestJSON-152554352 None] Acquiring lock "cinder-11682be2-ca59-49ab-9a16-3455c03c57c1-delete_volume" by "delete_volume" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:41:18 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-3572c50b-a2ed-45ef-871a-5e6179ab7ff7 tempest-VolumesListAdminTestJSON-152554352 None] Lock "cinder-11682be2-ca59-49ab-9a16-3455c03c57c1-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:41:18 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-3572c50b-a2ed-45ef-871a-5e6179ab7ff7 tempest-VolumesListAdminTestJSON-152554352 None] Acquiring lock "cinder-quobyte-11682be2-ca59-49ab-9a16-3455c03c57c1" by "delete_volume" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:41:18 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-3572c50b-a2ed-45ef-871a-5e6179ab7ff7 tempest-VolumesListAdminTestJSON-152554352 None] Lock "cinder-quobyte-11682be2-ca59-49ab-9a16-3455c03c57c1" acquired by "delete_volume" :: waited 0.017s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:41:18 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[6334cc31-d6bb-4501-bda5-7f7b74885c49]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:41:18 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-3572c50b-a2ed-45ef-871a-5e6179ab7ff7 tempest-VolumesListAdminTestJSON-152554352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-11682be2-ca59-49ab-9a16-3455c03c57c1 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:41:18 devstack sudo[102898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-11682be2-ca59-49ab-9a16-3455c03c57c1 Aug 03 08:41:18 devstack sudo[102898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:41:18 devstack sudo[102898]: pam_unix(sudo:session): session closed for user root Aug 03 08:41:18 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-3572c50b-a2ed-45ef-871a-5e6179ab7ff7 tempest-VolumesListAdminTestJSON-152554352 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-11682be2-ca59-49ab-9a16-3455c03c57c1" returned: 0 in 0.434s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:41:18 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-3572c50b-a2ed-45ef-871a-5e6179ab7ff7 tempest-VolumesListAdminTestJSON-152554352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-11682be2-ca59-49ab-9a16-3455c03c57c1 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:41:18 devstack sudo[102904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-11682be2-ca59-49ab-9a16-3455c03c57c1 Aug 03 08:41:18 devstack sudo[102904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:41:19 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-6437146e-3c29-4512-90a3-25b097026f9f tempest-VolumesSnapshotTestJSON-561529062 None] Acquiring lock "cinder-c95e6608-fab3-4b4f-821d-8f4ebcea81cc-delete_snapshot" by "delete_snapshot" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:41:19 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-6437146e-3c29-4512-90a3-25b097026f9f tempest-VolumesSnapshotTestJSON-561529062 None] Lock "cinder-c95e6608-fab3-4b4f-821d-8f4ebcea81cc-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:41:19 devstack sudo[102904]: pam_unix(sudo:session): session closed for user root Aug 03 08:41:19 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-3572c50b-a2ed-45ef-871a-5e6179ab7ff7 tempest-VolumesListAdminTestJSON-152554352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-11682be2-ca59-49ab-9a16-3455c03c57c1" returned: 0 in 0.384s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:41:19 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-3572c50b-a2ed-45ef-871a-5e6179ab7ff7 tempest-VolumesListAdminTestJSON-152554352 None] Lock "cinder-quobyte-11682be2-ca59-49ab-9a16-3455c03c57c1" released by "delete_volume" :: held 0.865s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:41:19 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-6437146e-3c29-4512-90a3-25b097026f9f tempest-VolumesSnapshotTestJSON-561529062 None] Acquiring lock "cinder-quobyte-d5138b8c-810b-4a8a-8abf-750f26d9a2e6" by "delete_snapshot" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:41:19 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-6437146e-3c29-4512-90a3-25b097026f9f tempest-VolumesSnapshotTestJSON-561529062 None] Lock "cinder-quobyte-d5138b8c-810b-4a8a-8abf-750f26d9a2e6" acquired by "delete_snapshot" :: waited 0.019s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:41:19 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-6437146e-3c29-4512-90a3-25b097026f9f tempest-VolumesSnapshotTestJSON-561529062 None] Acquiring lock "cinder-quobyte-c95e6608-fab3-4b4f-821d-8f4ebcea81cc" by "_delete_snapshot" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:41:19 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-6437146e-3c29-4512-90a3-25b097026f9f tempest-VolumesSnapshotTestJSON-561529062 None] Lock "cinder-quobyte-c95e6608-fab3-4b4f-821d-8f4ebcea81cc" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:41:19 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-6437146e-3c29-4512-90a3-25b097026f9f tempest-VolumesSnapshotTestJSON-561529062 None] Deleting offline snapshot c95e6608-fab3-4b4f-821d-8f4ebcea81cc of volume d5138b8c-810b-4a8a-8abf-750f26d9a2e6 {{(pid=88899) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 03 08:41:19 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-6437146e-3c29-4512-90a3-25b097026f9f tempest-VolumesSnapshotTestJSON-561529062 None] snapshot_file for this snap is: volume-d5138b8c-810b-4a8a-8abf-750f26d9a2e6.c95e6608-fab3-4b4f-821d-8f4ebcea81cc {{(pid=88899) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 03 08:41:19 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[af770f47-6bcb-4af0-84a8-6360363598e1]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:41:19 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-6437146e-3c29-4512-90a3-25b097026f9f tempest-VolumesSnapshotTestJSON-561529062 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-d5138b8c-810b-4a8a-8abf-750f26d9a2e6.c95e6608-fab3-4b4f-821d-8f4ebcea81cc {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:41:19 devstack cinder-volume[88899]: DEBUG cinder.quota [None req-3572c50b-a2ed-45ef-871a-5e6179ab7ff7 tempest-VolumesListAdminTestJSON-152554352 None] Created reservations ['68b71b47-bfc4-4fec-8928-1c16fe3213d3', 'a8384953-ef86-49dd-b67c-ec76c3a60a4c', 'df992688-6e9e-4730-89a0-238a74eb41ae', 'bf628381-c2e5-4440-841b-26732d3626df'] {{(pid=88899) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 08:41:19 devstack cinder-volume[88899]: DEBUG cinder.volume.flows.manager.create_volume [None req-2b3ab4da-bbda-429e-8b2d-aa458a6bb11f tempest-SnapshotDataIntegrityTests-1494076589 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88899) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 08:41:19 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-2b3ab4da-bbda-429e-8b2d-aa458a6bb11f tempest-SnapshotDataIntegrityTests-1494076589 None] Flow 'volume_create_manager' (acc0b6ff-0e6b-4bb0-b42a-3b2ced433ba4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:41:19 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-2b3ab4da-bbda-429e-8b2d-aa458a6bb11f tempest-SnapshotDataIntegrityTests-1494076589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a1e409b2-78d4-4023-abfe-8930afc398d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:41:19 devstack sudo[102907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-d5138b8c-810b-4a8a-8abf-750f26d9a2e6.c95e6608-fab3-4b4f-821d-8f4ebcea81cc Aug 03 08:41:19 devstack sudo[102907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:41:19 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-2b3ab4da-bbda-429e-8b2d-aa458a6bb11f tempest-SnapshotDataIntegrityTests-1494076589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a1e409b2-78d4-4023-abfe-8930afc398d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:41:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDataIntegrityTests-volume-2034174107',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1454300a-671f-43ed-b381-beb1ed81c411,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7bfeec51147d4d6fb726c3d53fa691a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:41:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=ef70e01c-7a59-4ac6-a705-f98e01473350,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:41:19Z,use_quota=True,user_id='154fb6e7d02d4632a2d4958c8859e9a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8bde7129-1dc4-42ab-b852-ab32c61b4921),volume_type_id=8bde7129-1dc4-42ab-b852-ab32c61b4921)' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:41:19 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-2b3ab4da-bbda-429e-8b2d-aa458a6bb11f tempest-SnapshotDataIntegrityTests-1494076589 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b7f2e28-93f4-497b-9363-749d73ceaa8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:41:19 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-2b3ab4da-bbda-429e-8b2d-aa458a6bb11f tempest-SnapshotDataIntegrityTests-1494076589 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b7f2e28-93f4-497b-9363-749d73ceaa8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:41:19 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-2b3ab4da-bbda-429e-8b2d-aa458a6bb11f tempest-SnapshotDataIntegrityTests-1494076589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (375652fe-2d0c-45c9-9337-0e66525c4157) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:41:19 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-2b3ab4da-bbda-429e-8b2d-aa458a6bb11f tempest-SnapshotDataIntegrityTests-1494076589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (375652fe-2d0c-45c9-9337-0e66525c4157) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '1454300a-671f-43ed-b381-beb1ed81c411', 'volume_name': 'volume-1454300a-671f-43ed-b381-beb1ed81c411', 'volume_size': 1, 'snapshot_id': 'ef70e01c-7a59-4ac6-a705-f98e01473350'}' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:41:19 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-2b3ab4da-bbda-429e-8b2d-aa458a6bb11f tempest-SnapshotDataIntegrityTests-1494076589 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c47f19f0-6c64-4362-b348-8586cf84fffd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:41:19 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-2b3ab4da-bbda-429e-8b2d-aa458a6bb11f tempest-SnapshotDataIntegrityTests-1494076589 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c47f19f0-6c64-4362-b348-8586cf84fffd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:41:19 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-2b3ab4da-bbda-429e-8b2d-aa458a6bb11f tempest-SnapshotDataIntegrityTests-1494076589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c0b85f72-8cac-4a30-807c-00fb95c948f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:41:19 devstack cinder-volume[88899]: INFO cinder.volume.flows.manager.create_volume [None req-2b3ab4da-bbda-429e-8b2d-aa458a6bb11f tempest-SnapshotDataIntegrityTests-1494076589 None] Volume 1454300a-671f-43ed-b381-beb1ed81c411: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-1454300a-671f-43ed-b381-beb1ed81c411', 'volume_size': 1, 'snapshot_id': 'ef70e01c-7a59-4ac6-a705-f98e01473350'} Aug 03 08:41:19 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-2b3ab4da-bbda-429e-8b2d-aa458a6bb11f tempest-SnapshotDataIntegrityTests-1494076589 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:41:19 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-2b3ab4da-bbda-429e-8b2d-aa458a6bb11f tempest-SnapshotDataIntegrityTests-1494076589 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:41:19 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-2b3ab4da-bbda-429e-8b2d-aa458a6bb11f tempest-SnapshotDataIntegrityTests-1494076589 None] Acquiring lock "cinder-quobyte-ef70e01c-7a59-4ac6-a705-f98e01473350-1454300a-671f-43ed-b381-beb1ed81c411" by "_create_volume_from_snapshot" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:41:19 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-2b3ab4da-bbda-429e-8b2d-aa458a6bb11f tempest-SnapshotDataIntegrityTests-1494076589 None] Lock "cinder-quobyte-ef70e01c-7a59-4ac6-a705-f98e01473350-1454300a-671f-43ed-b381-beb1ed81c411" acquired by "_create_volume_from_snapshot" :: waited 0.021s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:41:19 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-2b3ab4da-bbda-429e-8b2d-aa458a6bb11f tempest-SnapshotDataIntegrityTests-1494076589 None] Creating volume 1454300a-671f-43ed-b381-beb1ed81c411 from snapshot ef70e01c-7a59-4ac6-a705-f98e01473350 {{(pid=88899) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Aug 03 08:41:19 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-2b3ab4da-bbda-429e-8b2d-aa458a6bb11f tempest-SnapshotDataIntegrityTests-1494076589 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:41:19 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-2b3ab4da-bbda-429e-8b2d-aa458a6bb11f tempest-SnapshotDataIntegrityTests-1494076589 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:41:19 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-2b3ab4da-bbda-429e-8b2d-aa458a6bb11f tempest-SnapshotDataIntegrityTests-1494076589 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:41:19 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-2b3ab4da-bbda-429e-8b2d-aa458a6bb11f tempest-SnapshotDataIntegrityTests-1494076589 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:41:19 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-2b3ab4da-bbda-429e-8b2d-aa458a6bb11f tempest-SnapshotDataIntegrityTests-1494076589 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:41:19 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-2b3ab4da-bbda-429e-8b2d-aa458a6bb11f tempest-SnapshotDataIntegrityTests-1494076589 None] Selected osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385 as target Quobyte volume. {{(pid=88899) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 08:41:19 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-2b3ab4da-bbda-429e-8b2d-aa458a6bb11f tempest-SnapshotDataIntegrityTests-1494076589 None] Acquiring lock "cinder-quobyte-1454300a-671f-43ed-b381-beb1ed81c411" by "_copy_volume_from_snapshot" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:41:19 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-3572c50b-a2ed-45ef-871a-5e6179ab7ff7 tempest-VolumesListAdminTestJSON-152554352 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:41:19 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-3572c50b-a2ed-45ef-871a-5e6179ab7ff7 tempest-VolumesListAdminTestJSON-152554352 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:41:19 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-3572c50b-a2ed-45ef-871a-5e6179ab7ff7 tempest-VolumesListAdminTestJSON-152554352 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:41:19 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-3572c50b-a2ed-45ef-871a-5e6179ab7ff7 tempest-VolumesListAdminTestJSON-152554352 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:41:19 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-3572c50b-a2ed-45ef-871a-5e6179ab7ff7 tempest-VolumesListAdminTestJSON-152554352 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:41:19 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-3572c50b-a2ed-45ef-871a-5e6179ab7ff7 tempest-VolumesListAdminTestJSON-152554352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:41:19 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-2b3ab4da-bbda-429e-8b2d-aa458a6bb11f tempest-SnapshotDataIntegrityTests-1494076589 None] Lock "cinder-quobyte-1454300a-671f-43ed-b381-beb1ed81c411" acquired by "_copy_volume_from_snapshot" :: waited 0.034s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:41:19 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-2b3ab4da-bbda-429e-8b2d-aa458a6bb11f tempest-SnapshotDataIntegrityTests-1494076589 None] snapshot: ef70e01c-7a59-4ac6-a705-f98e01473350, volume: 1454300a-671f-43ed-b381-beb1ed81c411, {{(pid=88899) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Aug 03 08:41:19 devstack sudo[102909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a Aug 03 08:41:19 devstack sudo[102909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:41:19 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-2b3ab4da-bbda-429e-8b2d-aa458a6bb11f tempest-SnapshotDataIntegrityTests-1494076589 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:41:19 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-2b3ab4da-bbda-429e-8b2d-aa458a6bb11f tempest-SnapshotDataIntegrityTests-1494076589 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:41:19 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-2b3ab4da-bbda-429e-8b2d-aa458a6bb11f tempest-SnapshotDataIntegrityTests-1494076589 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:41:19 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-2b3ab4da-bbda-429e-8b2d-aa458a6bb11f tempest-SnapshotDataIntegrityTests-1494076589 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:41:19 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-2b3ab4da-bbda-429e-8b2d-aa458a6bb11f tempest-SnapshotDataIntegrityTests-1494076589 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:41:19 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa368459-aac2-4acb-9fcf-e76c65eb7d27]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:41:19 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-2b3ab4da-bbda-429e-8b2d-aa458a6bb11f tempest-SnapshotDataIntegrityTests-1494076589 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-6bafdd19-6d59-4557-a0e3-17d1fbfc1053.ef70e01c-7a59-4ac6-a705-f98e01473350 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:41:19 devstack sudo[102907]: pam_unix(sudo:session): session closed for user root Aug 03 08:41:19 devstack sudo[102911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-6bafdd19-6d59-4557-a0e3-17d1fbfc1053.ef70e01c-7a59-4ac6-a705-f98e01473350 Aug 03 08:41:19 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-6437146e-3c29-4512-90a3-25b097026f9f tempest-VolumesSnapshotTestJSON-561529062 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-d5138b8c-810b-4a8a-8abf-750f26d9a2e6.c95e6608-fab3-4b4f-821d-8f4ebcea81cc" returned: 0 in 0.422s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:41:19 devstack sudo[102911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:41:19 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-6437146e-3c29-4512-90a3-25b097026f9f tempest-VolumesSnapshotTestJSON-561529062 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d5138b8c-810b-4a8a-8abf-750f26d9a2e6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88899) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 03 08:41:19 devstack sudo[102909]: pam_unix(sudo:session): session closed for user root Aug 03 08:41:19 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[f949c20a-ae47-44fa-b6af-63037d48aedf]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:41:19 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-6437146e-3c29-4512-90a3-25b097026f9f tempest-VolumesSnapshotTestJSON-561529062 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-d5138b8c-810b-4a8a-8abf-750f26d9a2e6 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:41:19 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-3572c50b-a2ed-45ef-871a-5e6179ab7ff7 tempest-VolumesListAdminTestJSON-152554352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a" returned: 0 in 0.282s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:41:19 devstack cinder-volume[88899]: DEBUG cinder.manager [None req-3572c50b-a2ed-45ef-871a-5e6179ab7ff7 tempest-VolumesListAdminTestJSON-152554352 None] Notifying Schedulers of capabilities ... {{(pid=88899) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 08:41:19 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-3572c50b-a2ed-45ef-871a-5e6179ab7ff7 tempest-VolumesListAdminTestJSON-152554352 None] Deleted volume successfully. Aug 03 08:41:19 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-3572c50b-a2ed-45ef-871a-5e6179ab7ff7 tempest-VolumesListAdminTestJSON-152554352 None] Lock "cinder-11682be2-ca59-49ab-9a16-3455c03c57c1-delete_volume" released by "delete_volume" :: held 1.573s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:41:20 devstack sudo[102917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-d5138b8c-810b-4a8a-8abf-750f26d9a2e6 Aug 03 08:41:20 devstack sudo[102917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:41:20 devstack sudo[102911]: pam_unix(sudo:session): session closed for user root Aug 03 08:41:20 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-2b3ab4da-bbda-429e-8b2d-aa458a6bb11f tempest-SnapshotDataIntegrityTests-1494076589 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-6bafdd19-6d59-4557-a0e3-17d1fbfc1053.ef70e01c-7a59-4ac6-a705-f98e01473350" returned: 0 in 0.442s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:41:20 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-2b3ab4da-bbda-429e-8b2d-aa458a6bb11f tempest-SnapshotDataIntegrityTests-1494076589 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6bafdd19-6d59-4557-a0e3-17d1fbfc1053(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88899) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 03 08:41:20 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a46fe67-f6f4-40a1-906a-3b45fcbc3fba]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:41:20 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-2b3ab4da-bbda-429e-8b2d-aa458a6bb11f tempest-SnapshotDataIntegrityTests-1494076589 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-6bafdd19-6d59-4557-a0e3-17d1fbfc1053.7eccf0d3-bff0-4d62-a704-dc41ced4a9ba {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:41:20 devstack sudo[102926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-6bafdd19-6d59-4557-a0e3-17d1fbfc1053.7eccf0d3-bff0-4d62-a704-dc41ced4a9ba Aug 03 08:41:20 devstack sudo[102926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:41:20 devstack sudo[102917]: pam_unix(sudo:session): session closed for user root Aug 03 08:41:20 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-6437146e-3c29-4512-90a3-25b097026f9f tempest-VolumesSnapshotTestJSON-561529062 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-d5138b8c-810b-4a8a-8abf-750f26d9a2e6" returned: 0 in 0.427s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:41:20 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-6437146e-3c29-4512-90a3-25b097026f9f tempest-VolumesSnapshotTestJSON-561529062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-d5138b8c-810b-4a8a-8abf-750f26d9a2e6.c95e6608-fab3-4b4f-821d-8f4ebcea81cc {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:41:20 devstack sudo[102934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-d5138b8c-810b-4a8a-8abf-750f26d9a2e6.c95e6608-fab3-4b4f-821d-8f4ebcea81cc Aug 03 08:41:20 devstack sudo[102934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:41:20 devstack sudo[102926]: pam_unix(sudo:session): session closed for user root Aug 03 08:41:20 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-2b3ab4da-bbda-429e-8b2d-aa458a6bb11f tempest-SnapshotDataIntegrityTests-1494076589 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-6bafdd19-6d59-4557-a0e3-17d1fbfc1053.7eccf0d3-bff0-4d62-a704-dc41ced4a9ba" returned: 0 in 0.397s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:41:20 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-2b3ab4da-bbda-429e-8b2d-aa458a6bb11f tempest-SnapshotDataIntegrityTests-1494076589 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6bafdd19-6d59-4557-a0e3-17d1fbfc1053(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88899) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 03 08:41:20 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-2b3ab4da-bbda-429e-8b2d-aa458a6bb11f tempest-SnapshotDataIntegrityTests-1494076589 None] will copy from snapshot at /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-6bafdd19-6d59-4557-a0e3-17d1fbfc1053.7eccf0d3-bff0-4d62-a704-dc41ced4a9ba {{(pid=88899) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Aug 03 08:41:20 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-2b3ab4da-bbda-429e-8b2d-aa458a6bb11f tempest-SnapshotDataIntegrityTests-1494076589 None] Creating direct copy from snapshot {{(pid=88899) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Aug 03 08:41:20 devstack cinder-volume[88899]: DEBUG cinder.utils [None req-2b3ab4da-bbda-429e-8b2d-aa458a6bb11f tempest-SnapshotDataIntegrityTests-1494076589 None] Path /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-1454300a-671f-43ed-b381-beb1ed81c411 not found in is_blk_device check {{(pid=88899) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Aug 03 08:41:20 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-2b3ab4da-bbda-429e-8b2d-aa458a6bb11f tempest-SnapshotDataIntegrityTests-1494076589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-6bafdd19-6d59-4557-a0e3-17d1fbfc1053.7eccf0d3-bff0-4d62-a704-dc41ced4a9ba /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-1454300a-671f-43ed-b381-beb1ed81c411 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:41:20 devstack sudo[102943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-6bafdd19-6d59-4557-a0e3-17d1fbfc1053.7eccf0d3-bff0-4d62-a704-dc41ced4a9ba /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-1454300a-671f-43ed-b381-beb1ed81c411 Aug 03 08:41:20 devstack sudo[102943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:41:20 devstack sudo[102934]: pam_unix(sudo:session): session closed for user root Aug 03 08:41:20 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-6437146e-3c29-4512-90a3-25b097026f9f tempest-VolumesSnapshotTestJSON-561529062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-d5138b8c-810b-4a8a-8abf-750f26d9a2e6.c95e6608-fab3-4b4f-821d-8f4ebcea81cc" returned: 0 in 0.390s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:41:20 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-6437146e-3c29-4512-90a3-25b097026f9f tempest-VolumesSnapshotTestJSON-561529062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-d5138b8c-810b-4a8a-8abf-750f26d9a2e6.c95e6608-fab3-4b4f-821d-8f4ebcea81cc {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:41:20 devstack sudo[102946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-d5138b8c-810b-4a8a-8abf-750f26d9a2e6.c95e6608-fab3-4b4f-821d-8f4ebcea81cc Aug 03 08:41:20 devstack sudo[102946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:41:21 devstack sudo[102946]: pam_unix(sudo:session): session closed for user root Aug 03 08:41:21 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-6437146e-3c29-4512-90a3-25b097026f9f tempest-VolumesSnapshotTestJSON-561529062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-d5138b8c-810b-4a8a-8abf-750f26d9a2e6.c95e6608-fab3-4b4f-821d-8f4ebcea81cc" returned: 0 in 0.299s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:41:21 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-6437146e-3c29-4512-90a3-25b097026f9f tempest-VolumesSnapshotTestJSON-561529062 None] Lock "cinder-quobyte-c95e6608-fab3-4b4f-821d-8f4ebcea81cc" released by "_delete_snapshot" :: held 1.704s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:41:21 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-6437146e-3c29-4512-90a3-25b097026f9f tempest-VolumesSnapshotTestJSON-561529062 None] Lock "cinder-quobyte-d5138b8c-810b-4a8a-8abf-750f26d9a2e6" released by "delete_snapshot" :: held 1.731s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:41:21 devstack cinder-volume[88899]: DEBUG cinder.quota [None req-6437146e-3c29-4512-90a3-25b097026f9f tempest-VolumesSnapshotTestJSON-561529062 None] Created reservations ['8d859d07-b320-40cb-ba6e-005ffb3fc3d0', 'c0d30197-1a57-4f1b-96ea-6c5d2bdf00d9', '02ea39d4-caa1-4ea5-8802-b943d107f08d', 'f58ee501-5912-4af8-b4a7-fdb945fd7388'] {{(pid=88899) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 08:41:21 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-6437146e-3c29-4512-90a3-25b097026f9f tempest-VolumesSnapshotTestJSON-561529062 None] Delete snapshot completed successfully. Aug 03 08:41:21 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-6437146e-3c29-4512-90a3-25b097026f9f tempest-VolumesSnapshotTestJSON-561529062 None] Lock "cinder-c95e6608-fab3-4b4f-821d-8f4ebcea81cc-delete_snapshot" released by "delete_snapshot" :: held 2.005s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:41:22 devstack cinder-volume[88899]: DEBUG cinder.volume.flows.manager.create_volume [None req-166b8a10-8686-4b74-86f4-6460d0622c33 tempest-VolumesSnapshotTestJSON-561529062 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88899) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 08:41:23 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-166b8a10-8686-4b74-86f4-6460d0622c33 tempest-VolumesSnapshotTestJSON-561529062 None] Flow 'volume_create_manager' (576600fe-e20c-4802-a196-087a44903340) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:41:23 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-166b8a10-8686-4b74-86f4-6460d0622c33 tempest-VolumesSnapshotTestJSON-561529062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (214bae6c-671d-4f98-99d2-3cc82c798f9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:41:23 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-166b8a10-8686-4b74-86f4-6460d0622c33 tempest-VolumesSnapshotTestJSON-561529062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (214bae6c-671d-4f98-99d2-3cc82c798f9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:41:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1403822823',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c073db67-acb0-46be-8945-65f8938b3575,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6aadf5593f7c43d59bf60392e0f4bf5d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:41:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:41:23Z,use_quota=True,user_id='527c161cc21048f0a677fee8087ea52a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8bde7129-1dc4-42ab-b852-ab32c61b4921),volume_type_id=8bde7129-1dc4-42ab-b852-ab32c61b4921)' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:41:23 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-166b8a10-8686-4b74-86f4-6460d0622c33 tempest-VolumesSnapshotTestJSON-561529062 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28f59ccc-026a-41cd-bd4a-29621ed23e42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:41:23 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-166b8a10-8686-4b74-86f4-6460d0622c33 tempest-VolumesSnapshotTestJSON-561529062 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28f59ccc-026a-41cd-bd4a-29621ed23e42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:41:23 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-166b8a10-8686-4b74-86f4-6460d0622c33 tempest-VolumesSnapshotTestJSON-561529062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (663cdcba-bdab-4a28-8515-0b800ac4ac5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:41:23 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-166b8a10-8686-4b74-86f4-6460d0622c33 tempest-VolumesSnapshotTestJSON-561529062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (663cdcba-bdab-4a28-8515-0b800ac4ac5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c073db67-acb0-46be-8945-65f8938b3575', 'volume_name': 'volume-c073db67-acb0-46be-8945-65f8938b3575', 'volume_size': 1}' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:41:23 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-166b8a10-8686-4b74-86f4-6460d0622c33 tempest-VolumesSnapshotTestJSON-561529062 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (26c699b0-a494-4902-90f5-bebdee6c89b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:41:23 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-166b8a10-8686-4b74-86f4-6460d0622c33 tempest-VolumesSnapshotTestJSON-561529062 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (26c699b0-a494-4902-90f5-bebdee6c89b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:41:23 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-166b8a10-8686-4b74-86f4-6460d0622c33 tempest-VolumesSnapshotTestJSON-561529062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de9b9213-8f0f-487c-b967-81c747473eb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:41:23 devstack cinder-volume[88899]: INFO cinder.volume.flows.manager.create_volume [None req-166b8a10-8686-4b74-86f4-6460d0622c33 tempest-VolumesSnapshotTestJSON-561529062 None] Volume c073db67-acb0-46be-8945-65f8938b3575: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c073db67-acb0-46be-8945-65f8938b3575', 'volume_size': 1} Aug 03 08:41:23 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-166b8a10-8686-4b74-86f4-6460d0622c33 tempest-VolumesSnapshotTestJSON-561529062 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:41:26 devstack sudo[102943]: pam_unix(sudo:session): session closed for user root Aug 03 08:41:26 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-2b3ab4da-bbda-429e-8b2d-aa458a6bb11f tempest-SnapshotDataIntegrityTests-1494076589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-6bafdd19-6d59-4557-a0e3-17d1fbfc1053.7eccf0d3-bff0-4d62-a704-dc41ced4a9ba /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-1454300a-671f-43ed-b381-beb1ed81c411" returned: 0 in 5.882s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:41:26 devstack cinder-volume[88899]: DEBUG cinder.image.image_utils [None req-2b3ab4da-bbda-429e-8b2d-aa458a6bb11f tempest-SnapshotDataIntegrityTests-1494076589 None] Image conversion details: src /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-6bafdd19-6d59-4557-a0e3-17d1fbfc1053.7eccf0d3-bff0-4d62-a704-dc41ced4a9ba, size 1024.00 MB, duration 5.88 sec, destination /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-1454300a-671f-43ed-b381-beb1ed81c411 {{(pid=88899) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 03 08:41:26 devstack cinder-volume[88899]: INFO cinder.image.image_utils [None req-2b3ab4da-bbda-429e-8b2d-aa458a6bb11f tempest-SnapshotDataIntegrityTests-1494076589 None] Converted 1024.00 MB image at 174.06 MB/s Aug 03 08:41:26 devstack cinder-volume[88899]: WARNING cinder.volume.drivers.remotefs [None req-2b3ab4da-bbda-429e-8b2d-aa458a6bb11f tempest-SnapshotDataIntegrityTests-1494076589 None] /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-1454300a-671f-43ed-b381-beb1ed81c411 is being set with open permissions: ugo+rw Aug 03 08:41:26 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-2b3ab4da-bbda-429e-8b2d-aa458a6bb11f tempest-SnapshotDataIntegrityTests-1494076589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-1454300a-671f-43ed-b381-beb1ed81c411 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:41:26 devstack sudo[102987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-1454300a-671f-43ed-b381-beb1ed81c411 Aug 03 08:41:26 devstack sudo[102987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:41:26 devstack cinder-volume[88899]: DEBUG dbcounter [-] [88899] Writing DB stats cinder:SELECT=115,cinder:UPDATE=71,cinder:INSERT=14,cinder:DELETE=2 {{(pid=88899) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 03 08:41:26 devstack cinder-volume[88899]: INFO cinder.volume.manager [req-c910a8fb-2992-4134-9d2b-baf28e7f8c25 req-5432d2f9-4bd8-47f5-8fdb-a5a8e497253d tempest-TestInstancesWithCinderVolumes-1639155420 None] Terminate volume connection completed successfully. Aug 03 08:41:26 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [req-c910a8fb-2992-4134-9d2b-baf28e7f8c25 req-5432d2f9-4bd8-47f5-8fdb-a5a8e497253d tempest-TestInstancesWithCinderVolumes-1639155420 None] Deleting attachment deb3bd3e-1bff-4036-8661-f7389b79b2b1. {{(pid=88899) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 03 08:41:26 devstack sudo[102987]: pam_unix(sudo:session): session closed for user root Aug 03 08:41:26 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-2b3ab4da-bbda-429e-8b2d-aa458a6bb11f tempest-SnapshotDataIntegrityTests-1494076589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-1454300a-671f-43ed-b381-beb1ed81c411" returned: 0 in 0.278s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:41:26 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-2b3ab4da-bbda-429e-8b2d-aa458a6bb11f tempest-SnapshotDataIntegrityTests-1494076589 None] Lock "cinder-quobyte-1454300a-671f-43ed-b381-beb1ed81c411" released by "_copy_volume_from_snapshot" :: held 7.093s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:41:26 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-2b3ab4da-bbda-429e-8b2d-aa458a6bb11f tempest-SnapshotDataIntegrityTests-1494076589 None] Lock "cinder-quobyte-ef70e01c-7a59-4ac6-a705-f98e01473350-1454300a-671f-43ed-b381-beb1ed81c411" released by "_create_volume_from_snapshot" :: held 7.176s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:41:26 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-2b3ab4da-bbda-429e-8b2d-aa458a6bb11f tempest-SnapshotDataIntegrityTests-1494076589 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.198s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:41:26 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-166b8a10-8686-4b74-86f4-6460d0622c33 tempest-VolumesSnapshotTestJSON-561529062 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.601s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:41:26 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-166b8a10-8686-4b74-86f4-6460d0622c33 tempest-VolumesSnapshotTestJSON-561529062 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:41:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1403822823',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c073db67-acb0-46be-8945-65f8938b3575,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6aadf5593f7c43d59bf60392e0f4bf5d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:41:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:41:23Z,use_quota=True,user_id='527c161cc21048f0a677fee8087ea52a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8bde7129-1dc4-42ab-b852-ab32c61b4921),volume_type_id=8bde7129-1dc4-42ab-b852-ab32c61b4921)}" {{(pid=88899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 08:41:26 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-166b8a10-8686-4b74-86f4-6460d0622c33 tempest-VolumesSnapshotTestJSON-561529062 None] Creating volume c073db67-acb0-46be-8945-65f8938b3575 {{(pid=88899) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 08:41:26 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-166b8a10-8686-4b74-86f4-6460d0622c33 tempest-VolumesSnapshotTestJSON-561529062 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:41:26 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-166b8a10-8686-4b74-86f4-6460d0622c33 tempest-VolumesSnapshotTestJSON-561529062 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:41:26 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-166b8a10-8686-4b74-86f4-6460d0622c33 tempest-VolumesSnapshotTestJSON-561529062 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:41:26 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-166b8a10-8686-4b74-86f4-6460d0622c33 tempest-VolumesSnapshotTestJSON-561529062 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:41:26 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-166b8a10-8686-4b74-86f4-6460d0622c33 tempest-VolumesSnapshotTestJSON-561529062 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:41:26 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-166b8a10-8686-4b74-86f4-6460d0622c33 tempest-VolumesSnapshotTestJSON-561529062 None] Selected osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385 as target Quobyte volume. {{(pid=88899) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 08:41:26 devstack cinder-volume[88899]: INFO cinder.volume.drivers.remotefs [None req-166b8a10-8686-4b74-86f4-6460d0622c33 tempest-VolumesSnapshotTestJSON-561529062 None] casted to osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385 Aug 03 08:41:26 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-166b8a10-8686-4b74-86f4-6460d0622c33 tempest-VolumesSnapshotTestJSON-561529062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c073db67-acb0-46be-8945-65f8938b3575 1073741824 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:41:26 devstack sudo[102990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c073db67-acb0-46be-8945-65f8938b3575 1073741824 Aug 03 08:41:26 devstack sudo[102990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:41:26 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-2b3ab4da-bbda-429e-8b2d-aa458a6bb11f tempest-SnapshotDataIntegrityTests-1494076589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c0b85f72-8cac-4a30-807c-00fb95c948f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1454300a-671f-43ed-b381-beb1ed81c411', 'volume_size': 1, 'snapshot_id': 'ef70e01c-7a59-4ac6-a705-f98e01473350'}' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:41:26 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-2b3ab4da-bbda-429e-8b2d-aa458a6bb11f tempest-SnapshotDataIntegrityTests-1494076589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b97a2eb-2df2-486b-8f22-8cd23d2a69a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:41:26 devstack cinder-volume[88899]: INFO cinder.volume.flows.manager.create_volume [None req-2b3ab4da-bbda-429e-8b2d-aa458a6bb11f tempest-SnapshotDataIntegrityTests-1494076589 None] Volume volume-1454300a-671f-43ed-b381-beb1ed81c411 (1454300a-671f-43ed-b381-beb1ed81c411): created successfully Aug 03 08:41:26 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-2b3ab4da-bbda-429e-8b2d-aa458a6bb11f tempest-SnapshotDataIntegrityTests-1494076589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b97a2eb-2df2-486b-8f22-8cd23d2a69a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:41:26 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-2b3ab4da-bbda-429e-8b2d-aa458a6bb11f tempest-SnapshotDataIntegrityTests-1494076589 None] Flow 'volume_create_manager' (acc0b6ff-0e6b-4bb0-b42a-3b2ced433ba4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:41:26 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-2b3ab4da-bbda-429e-8b2d-aa458a6bb11f tempest-SnapshotDataIntegrityTests-1494076589 None] Created volume successfully. Aug 03 08:41:27 devstack sudo[102990]: pam_unix(sudo:session): session closed for user root Aug 03 08:41:27 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-166b8a10-8686-4b74-86f4-6460d0622c33 tempest-VolumesSnapshotTestJSON-561529062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c073db67-acb0-46be-8945-65f8938b3575 1073741824" returned: 0 in 0.478s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:41:27 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-166b8a10-8686-4b74-86f4-6460d0622c33 tempest-VolumesSnapshotTestJSON-561529062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c073db67-acb0-46be-8945-65f8938b3575 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:41:27 devstack sudo[102998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c073db67-acb0-46be-8945-65f8938b3575 Aug 03 08:41:27 devstack sudo[102998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:41:27 devstack sudo[102998]: pam_unix(sudo:session): session closed for user root Aug 03 08:41:27 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-166b8a10-8686-4b74-86f4-6460d0622c33 tempest-VolumesSnapshotTestJSON-561529062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c073db67-acb0-46be-8945-65f8938b3575" returned: 0 in 0.277s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:41:27 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-166b8a10-8686-4b74-86f4-6460d0622c33 tempest-VolumesSnapshotTestJSON-561529062 None] <== create_volume: return (802ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'} {{(pid=88899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 08:41:27 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-166b8a10-8686-4b74-86f4-6460d0622c33 tempest-VolumesSnapshotTestJSON-561529062 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.805s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:41:27 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-166b8a10-8686-4b74-86f4-6460d0622c33 tempest-VolumesSnapshotTestJSON-561529062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de9b9213-8f0f-487c-b967-81c747473eb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c073db67-acb0-46be-8945-65f8938b3575', 'volume_size': 1}' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:41:27 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-166b8a10-8686-4b74-86f4-6460d0622c33 tempest-VolumesSnapshotTestJSON-561529062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (30e1f99b-9f7d-478a-867d-152ebed2aefe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:41:27 devstack cinder-volume[88899]: INFO cinder.volume.flows.manager.create_volume [None req-166b8a10-8686-4b74-86f4-6460d0622c33 tempest-VolumesSnapshotTestJSON-561529062 None] Volume volume-c073db67-acb0-46be-8945-65f8938b3575 (c073db67-acb0-46be-8945-65f8938b3575): created successfully Aug 03 08:41:27 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-166b8a10-8686-4b74-86f4-6460d0622c33 tempest-VolumesSnapshotTestJSON-561529062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (30e1f99b-9f7d-478a-867d-152ebed2aefe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:41:27 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-166b8a10-8686-4b74-86f4-6460d0622c33 tempest-VolumesSnapshotTestJSON-561529062 None] Flow 'volume_create_manager' (576600fe-e20c-4802-a196-087a44903340) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:41:27 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-166b8a10-8686-4b74-86f4-6460d0622c33 tempest-VolumesSnapshotTestJSON-561529062 None] Created volume successfully. Aug 03 08:41:27 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-194a0f1a-ccee-4b33-a739-eb18232d5f01 tempest-TestInstancesWithCinderVolumes-1639155420 None] Acquiring lock "cinder-a673b8d7-ba1a-4e56-9cfa-9e35c6fc2587-delete_volume" by "delete_volume" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:41:27 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-194a0f1a-ccee-4b33-a739-eb18232d5f01 tempest-TestInstancesWithCinderVolumes-1639155420 None] Lock "cinder-a673b8d7-ba1a-4e56-9cfa-9e35c6fc2587-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:41:27 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-194a0f1a-ccee-4b33-a739-eb18232d5f01 tempest-TestInstancesWithCinderVolumes-1639155420 None] Acquiring lock "cinder-quobyte-a673b8d7-ba1a-4e56-9cfa-9e35c6fc2587" by "delete_volume" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:41:27 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-194a0f1a-ccee-4b33-a739-eb18232d5f01 tempest-TestInstancesWithCinderVolumes-1639155420 None] Lock "cinder-quobyte-a673b8d7-ba1a-4e56-9cfa-9e35c6fc2587" acquired by "delete_volume" :: waited 0.020s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:41:27 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[2022fa57-f849-4958-acec-9c7e84613734]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:41:27 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-194a0f1a-ccee-4b33-a739-eb18232d5f01 tempest-TestInstancesWithCinderVolumes-1639155420 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-a673b8d7-ba1a-4e56-9cfa-9e35c6fc2587 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:41:28 devstack sudo[103010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-a673b8d7-ba1a-4e56-9cfa-9e35c6fc2587 Aug 03 08:41:28 devstack sudo[103010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:41:28 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [req-847ac00a-9bec-4a65-82b6-5629166f42aa req-36d36b4a-6422-4dc8-8155-e5f896075d20 tempest-SnapshotDataIntegrityTests-1494076589 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:41:28 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [req-847ac00a-9bec-4a65-82b6-5629166f42aa req-36d36b4a-6422-4dc8-8155-e5f896075d20 tempest-SnapshotDataIntegrityTests-1494076589 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:41:28 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [req-847ac00a-9bec-4a65-82b6-5629166f42aa req-36d36b4a-6422-4dc8-8155-e5f896075d20 tempest-SnapshotDataIntegrityTests-1494076589 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.015s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:41:28 devstack sudo[103010]: pam_unix(sudo:session): session closed for user root Aug 03 08:41:28 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [req-847ac00a-9bec-4a65-82b6-5629166f42aa req-36d36b4a-6422-4dc8-8155-e5f896075d20 tempest-SnapshotDataIntegrityTests-1494076589 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385', 'name': 'volume-1454300a-671f-43ed-b381-beb1ed81c411', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c3a4d1be-1516-4f50-ac97-dded9ca7c5a7', 'enforce_multipath': True} {{(pid=88899) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 03 08:41:28 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-194a0f1a-ccee-4b33-a739-eb18232d5f01 tempest-TestInstancesWithCinderVolumes-1639155420 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-a673b8d7-ba1a-4e56-9cfa-9e35c6fc2587" returned: 0 in 0.543s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:41:28 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-194a0f1a-ccee-4b33-a739-eb18232d5f01 tempest-TestInstancesWithCinderVolumes-1639155420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-a673b8d7-ba1a-4e56-9cfa-9e35c6fc2587 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:41:28 devstack sudo[103024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-a673b8d7-ba1a-4e56-9cfa-9e35c6fc2587 Aug 03 08:41:28 devstack sudo[103024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:41:28 devstack cinder-volume[88899]: INFO cinder.volume.manager [req-847ac00a-9bec-4a65-82b6-5629166f42aa req-36d36b4a-6422-4dc8-8155-e5f896075d20 tempest-SnapshotDataIntegrityTests-1494076589 None] attachment_update completed successfully. Aug 03 08:41:28 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-d0504f89-d540-434f-90f9-d8d65f7a4103 tempest-VolumesSnapshotTestJSON-561529062 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:41:28 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-d0504f89-d540-434f-90f9-d8d65f7a4103 tempest-VolumesSnapshotTestJSON-561529062 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.009s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:41:28 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-d0504f89-d540-434f-90f9-d8d65f7a4103 tempest-VolumesSnapshotTestJSON-561529062 None] Creating offline snapshot 891ebb26-a193-42f0-acd4-3734c162d2f8 of volume c073db67-acb0-46be-8945-65f8938b3575 {{(pid=88899) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 03 08:41:28 devstack sudo[103024]: pam_unix(sudo:session): session closed for user root Aug 03 08:41:28 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-194a0f1a-ccee-4b33-a739-eb18232d5f01 tempest-TestInstancesWithCinderVolumes-1639155420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-a673b8d7-ba1a-4e56-9cfa-9e35c6fc2587" returned: 0 in 0.387s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:41:28 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[7778fabc-fd79-4dd3-8f2c-2954fd00d1e7]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:41:28 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-d0504f89-d540-434f-90f9-d8d65f7a4103 tempest-VolumesSnapshotTestJSON-561529062 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c073db67-acb0-46be-8945-65f8938b3575 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:41:28 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-194a0f1a-ccee-4b33-a739-eb18232d5f01 tempest-TestInstancesWithCinderVolumes-1639155420 None] Lock "cinder-quobyte-a673b8d7-ba1a-4e56-9cfa-9e35c6fc2587" released by "delete_volume" :: held 1.005s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:41:28 devstack cinder-volume[88899]: WARNING cinder.quota [None req-194a0f1a-ccee-4b33-a739-eb18232d5f01 tempest-TestInstancesWithCinderVolumes-1639155420 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2119193985-775042773 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2119193985-775042773, it is now deprecated. Please use the default quota class for default quota. Aug 03 08:41:28 devstack cinder-volume[88899]: WARNING cinder.quota [None req-194a0f1a-ccee-4b33-a739-eb18232d5f01 tempest-TestInstancesWithCinderVolumes-1639155420 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2119193985-775042773 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2119193985-775042773, it is now deprecated. Please use the default quota class for default quota. Aug 03 08:41:28 devstack cinder-volume[88899]: DEBUG cinder.quota [None req-194a0f1a-ccee-4b33-a739-eb18232d5f01 tempest-TestInstancesWithCinderVolumes-1639155420 None] Created reservations ['998258d0-5bc5-426a-b93b-f667b3a9ef3e', 'c7745edf-d92b-4ce3-b923-ed9b264b190d', '29ce514c-9b9a-4cc4-8f10-f96b10474563', 'eec2c6ec-4786-4383-b1af-db63792a1415'] {{(pid=88899) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 08:41:29 devstack sudo[103031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c073db67-acb0-46be-8945-65f8938b3575 Aug 03 08:41:29 devstack sudo[103031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:41:29 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-194a0f1a-ccee-4b33-a739-eb18232d5f01 tempest-TestInstancesWithCinderVolumes-1639155420 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:41:29 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-194a0f1a-ccee-4b33-a739-eb18232d5f01 tempest-TestInstancesWithCinderVolumes-1639155420 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:41:29 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-194a0f1a-ccee-4b33-a739-eb18232d5f01 tempest-TestInstancesWithCinderVolumes-1639155420 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:41:29 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-194a0f1a-ccee-4b33-a739-eb18232d5f01 tempest-TestInstancesWithCinderVolumes-1639155420 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:41:29 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-194a0f1a-ccee-4b33-a739-eb18232d5f01 tempest-TestInstancesWithCinderVolumes-1639155420 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:41:29 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-194a0f1a-ccee-4b33-a739-eb18232d5f01 tempest-TestInstancesWithCinderVolumes-1639155420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:41:29 devstack sudo[103034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a Aug 03 08:41:29 devstack sudo[103034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:41:29 devstack sudo[103031]: pam_unix(sudo:session): session closed for user root Aug 03 08:41:29 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-d0504f89-d540-434f-90f9-d8d65f7a4103 tempest-VolumesSnapshotTestJSON-561529062 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c073db67-acb0-46be-8945-65f8938b3575" returned: 0 in 0.584s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:41:29 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-d0504f89-d540-434f-90f9-d8d65f7a4103 tempest-VolumesSnapshotTestJSON-561529062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c073db67-acb0-46be-8945-65f8938b3575,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c073db67-acb0-46be-8945-65f8938b3575.891ebb26-a193-42f0-acd4-3734c162d2f8 1G {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:41:29 devstack sudo[103034]: pam_unix(sudo:session): session closed for user root Aug 03 08:41:29 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-194a0f1a-ccee-4b33-a739-eb18232d5f01 tempest-TestInstancesWithCinderVolumes-1639155420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a" returned: 0 in 0.435s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:41:29 devstack cinder-volume[88899]: DEBUG cinder.manager [None req-194a0f1a-ccee-4b33-a739-eb18232d5f01 tempest-TestInstancesWithCinderVolumes-1639155420 None] Notifying Schedulers of capabilities ... {{(pid=88899) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 08:41:29 devstack sudo[103040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c073db67-acb0-46be-8945-65f8938b3575,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c073db67-acb0-46be-8945-65f8938b3575.891ebb26-a193-42f0-acd4-3734c162d2f8 1G Aug 03 08:41:29 devstack sudo[103040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:41:29 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-194a0f1a-ccee-4b33-a739-eb18232d5f01 tempest-TestInstancesWithCinderVolumes-1639155420 None] Deleted volume successfully. Aug 03 08:41:29 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-194a0f1a-ccee-4b33-a739-eb18232d5f01 tempest-TestInstancesWithCinderVolumes-1639155420 None] Lock "cinder-a673b8d7-ba1a-4e56-9cfa-9e35c6fc2587-delete_volume" released by "delete_volume" :: held 1.741s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:41:29 devstack sudo[103040]: pam_unix(sudo:session): session closed for user root Aug 03 08:41:29 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-d0504f89-d540-434f-90f9-d8d65f7a4103 tempest-VolumesSnapshotTestJSON-561529062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c073db67-acb0-46be-8945-65f8938b3575,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c073db67-acb0-46be-8945-65f8938b3575.891ebb26-a193-42f0-acd4-3734c162d2f8 1G" returned: 0 in 0.502s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:41:29 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-d0504f89-d540-434f-90f9-d8d65f7a4103 tempest-VolumesSnapshotTestJSON-561529062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c073db67-acb0-46be-8945-65f8938b3575 -F qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c073db67-acb0-46be-8945-65f8938b3575.891ebb26-a193-42f0-acd4-3734c162d2f8 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:41:29 devstack sudo[103046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c073db67-acb0-46be-8945-65f8938b3575 -F qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c073db67-acb0-46be-8945-65f8938b3575.891ebb26-a193-42f0-acd4-3734c162d2f8 Aug 03 08:41:29 devstack sudo[103046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:41:30 devstack sudo[103046]: pam_unix(sudo:session): session closed for user root Aug 03 08:41:30 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-d0504f89-d540-434f-90f9-d8d65f7a4103 tempest-VolumesSnapshotTestJSON-561529062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c073db67-acb0-46be-8945-65f8938b3575 -F qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c073db67-acb0-46be-8945-65f8938b3575.891ebb26-a193-42f0-acd4-3734c162d2f8" returned: 0 in 0.368s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:41:30 devstack cinder-volume[88899]: WARNING cinder.volume.drivers.remotefs [None req-d0504f89-d540-434f-90f9-d8d65f7a4103 tempest-VolumesSnapshotTestJSON-561529062 None] /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c073db67-acb0-46be-8945-65f8938b3575.891ebb26-a193-42f0-acd4-3734c162d2f8 is being set with open permissions: ugo+rw Aug 03 08:41:30 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-d0504f89-d540-434f-90f9-d8d65f7a4103 tempest-VolumesSnapshotTestJSON-561529062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c073db67-acb0-46be-8945-65f8938b3575.891ebb26-a193-42f0-acd4-3734c162d2f8 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:41:30 devstack sudo[103054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c073db67-acb0-46be-8945-65f8938b3575.891ebb26-a193-42f0-acd4-3734c162d2f8 Aug 03 08:41:30 devstack sudo[103054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:41:30 devstack cinder-volume[88899]: DEBUG cinder.volume.flows.manager.create_volume [None req-b024f54c-0c3c-4a8c-8826-ce4e32d75f0d tempest-VolumesTransfersTest-1472630776 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88899) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 08:41:30 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-b024f54c-0c3c-4a8c-8826-ce4e32d75f0d tempest-VolumesTransfersTest-1472630776 None] Flow 'volume_create_manager' (d3179701-6a1e-4f9b-9056-e64af1e5fbe6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:41:30 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-b024f54c-0c3c-4a8c-8826-ce4e32d75f0d tempest-VolumesTransfersTest-1472630776 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (394ea1c4-16eb-499d-9e98-36a9f917a5d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:41:30 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-b024f54c-0c3c-4a8c-8826-ce4e32d75f0d tempest-VolumesTransfersTest-1472630776 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (394ea1c4-16eb-499d-9e98-36a9f917a5d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:41:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-2096208275',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6229a77c-50e5-4265-9ffd-132977b8214e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c8df4d6f49d4b848d62b5a3367bf468',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:41:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:41:30Z,use_quota=True,user_id='0a806fec176740fd8b3f6a8b48e35d2c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8bde7129-1dc4-42ab-b852-ab32c61b4921),volume_type_id=8bde7129-1dc4-42ab-b852-ab32c61b4921)' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:41:30 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-b024f54c-0c3c-4a8c-8826-ce4e32d75f0d tempest-VolumesTransfersTest-1472630776 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (158b6249-d983-41c9-9187-48c19724995e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:41:30 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-b024f54c-0c3c-4a8c-8826-ce4e32d75f0d tempest-VolumesTransfersTest-1472630776 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (158b6249-d983-41c9-9187-48c19724995e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:41:30 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-b024f54c-0c3c-4a8c-8826-ce4e32d75f0d tempest-VolumesTransfersTest-1472630776 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4247864-d1e2-459b-a7bb-87ba8dd354b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:41:30 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-b024f54c-0c3c-4a8c-8826-ce4e32d75f0d tempest-VolumesTransfersTest-1472630776 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4247864-d1e2-459b-a7bb-87ba8dd354b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6229a77c-50e5-4265-9ffd-132977b8214e', 'volume_name': 'volume-6229a77c-50e5-4265-9ffd-132977b8214e', 'volume_size': 1}' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:41:30 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-b024f54c-0c3c-4a8c-8826-ce4e32d75f0d tempest-VolumesTransfersTest-1472630776 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b46fd5b-cd7c-42b0-aa10-ee19eec739f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:41:30 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-b024f54c-0c3c-4a8c-8826-ce4e32d75f0d tempest-VolumesTransfersTest-1472630776 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b46fd5b-cd7c-42b0-aa10-ee19eec739f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:41:30 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-b024f54c-0c3c-4a8c-8826-ce4e32d75f0d tempest-VolumesTransfersTest-1472630776 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (efcb8276-9c71-427f-9875-19c4ff73c257) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:41:30 devstack cinder-volume[88899]: INFO cinder.volume.flows.manager.create_volume [None req-b024f54c-0c3c-4a8c-8826-ce4e32d75f0d tempest-VolumesTransfersTest-1472630776 None] Volume 6229a77c-50e5-4265-9ffd-132977b8214e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6229a77c-50e5-4265-9ffd-132977b8214e', 'volume_size': 1} Aug 03 08:41:30 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-b024f54c-0c3c-4a8c-8826-ce4e32d75f0d tempest-VolumesTransfersTest-1472630776 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:41:30 devstack sudo[103054]: pam_unix(sudo:session): session closed for user root Aug 03 08:41:30 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-d0504f89-d540-434f-90f9-d8d65f7a4103 tempest-VolumesSnapshotTestJSON-561529062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c073db67-acb0-46be-8945-65f8938b3575.891ebb26-a193-42f0-acd4-3734c162d2f8" returned: 0 in 0.296s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:41:30 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-d0504f89-d540-434f-90f9-d8d65f7a4103 tempest-VolumesSnapshotTestJSON-561529062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c073db67-acb0-46be-8945-65f8938b3575.info {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:41:30 devstack sudo[103069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c073db67-acb0-46be-8945-65f8938b3575.info Aug 03 08:41:30 devstack sudo[103069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:41:30 devstack sudo[103069]: pam_unix(sudo:session): session closed for user root Aug 03 08:41:30 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-d0504f89-d540-434f-90f9-d8d65f7a4103 tempest-VolumesSnapshotTestJSON-561529062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c073db67-acb0-46be-8945-65f8938b3575.info" returned: 0 in 0.277s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:41:30 devstack cinder-volume[88899]: WARNING cinder.volume.drivers.remotefs [None req-d0504f89-d540-434f-90f9-d8d65f7a4103 tempest-VolumesSnapshotTestJSON-561529062 None] /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c073db67-acb0-46be-8945-65f8938b3575.info is being set with open permissions: ugo+rw Aug 03 08:41:30 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-d0504f89-d540-434f-90f9-d8d65f7a4103 tempest-VolumesSnapshotTestJSON-561529062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c073db67-acb0-46be-8945-65f8938b3575.info {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:41:30 devstack sudo[103084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c073db67-acb0-46be-8945-65f8938b3575.info Aug 03 08:41:30 devstack sudo[103084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:41:31 devstack sudo[103084]: pam_unix(sudo:session): session closed for user root Aug 03 08:41:31 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-d0504f89-d540-434f-90f9-d8d65f7a4103 tempest-VolumesSnapshotTestJSON-561529062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c073db67-acb0-46be-8945-65f8938b3575.info" returned: 0 in 0.259s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:41:31 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-d0504f89-d540-434f-90f9-d8d65f7a4103 tempest-VolumesSnapshotTestJSON-561529062 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.399s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:41:31 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-b024f54c-0c3c-4a8c-8826-ce4e32d75f0d tempest-VolumesTransfersTest-1472630776 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.644s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:41:31 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-b024f54c-0c3c-4a8c-8826-ce4e32d75f0d tempest-VolumesTransfersTest-1472630776 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:41:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-2096208275',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6229a77c-50e5-4265-9ffd-132977b8214e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c8df4d6f49d4b848d62b5a3367bf468',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:41:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:41:30Z,use_quota=True,user_id='0a806fec176740fd8b3f6a8b48e35d2c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8bde7129-1dc4-42ab-b852-ab32c61b4921),volume_type_id=8bde7129-1dc4-42ab-b852-ab32c61b4921)}" {{(pid=88899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 08:41:31 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-b024f54c-0c3c-4a8c-8826-ce4e32d75f0d tempest-VolumesTransfersTest-1472630776 None] Creating volume 6229a77c-50e5-4265-9ffd-132977b8214e {{(pid=88899) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 08:41:31 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-b024f54c-0c3c-4a8c-8826-ce4e32d75f0d tempest-VolumesTransfersTest-1472630776 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:41:31 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-b024f54c-0c3c-4a8c-8826-ce4e32d75f0d tempest-VolumesTransfersTest-1472630776 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:41:31 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-b024f54c-0c3c-4a8c-8826-ce4e32d75f0d tempest-VolumesTransfersTest-1472630776 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:41:31 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-b024f54c-0c3c-4a8c-8826-ce4e32d75f0d tempest-VolumesTransfersTest-1472630776 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:41:31 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-b024f54c-0c3c-4a8c-8826-ce4e32d75f0d tempest-VolumesTransfersTest-1472630776 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:41:31 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-b024f54c-0c3c-4a8c-8826-ce4e32d75f0d tempest-VolumesTransfersTest-1472630776 None] Selected osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385 as target Quobyte volume. {{(pid=88899) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 08:41:31 devstack cinder-volume[88899]: INFO cinder.volume.drivers.remotefs [None req-b024f54c-0c3c-4a8c-8826-ce4e32d75f0d tempest-VolumesTransfersTest-1472630776 None] casted to osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385 Aug 03 08:41:31 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-b024f54c-0c3c-4a8c-8826-ce4e32d75f0d tempest-VolumesTransfersTest-1472630776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-6229a77c-50e5-4265-9ffd-132977b8214e 1073741824 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:41:31 devstack sudo[103097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-6229a77c-50e5-4265-9ffd-132977b8214e 1073741824 Aug 03 08:41:31 devstack sudo[103097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:41:31 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-d0504f89-d540-434f-90f9-d8d65f7a4103 tempest-VolumesSnapshotTestJSON-561529062 None] Create snapshot completed successfully Aug 03 08:41:31 devstack sudo[103097]: pam_unix(sudo:session): session closed for user root Aug 03 08:41:31 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-b024f54c-0c3c-4a8c-8826-ce4e32d75f0d tempest-VolumesTransfersTest-1472630776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-6229a77c-50e5-4265-9ffd-132977b8214e 1073741824" returned: 0 in 0.486s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:41:31 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-b024f54c-0c3c-4a8c-8826-ce4e32d75f0d tempest-VolumesTransfersTest-1472630776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-6229a77c-50e5-4265-9ffd-132977b8214e {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:41:31 devstack sudo[103111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-6229a77c-50e5-4265-9ffd-132977b8214e Aug 03 08:41:31 devstack sudo[103111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:41:32 devstack sudo[103111]: pam_unix(sudo:session): session closed for user root Aug 03 08:41:32 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-b024f54c-0c3c-4a8c-8826-ce4e32d75f0d tempest-VolumesTransfersTest-1472630776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-6229a77c-50e5-4265-9ffd-132977b8214e" returned: 0 in 0.345s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:41:32 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-b024f54c-0c3c-4a8c-8826-ce4e32d75f0d tempest-VolumesTransfersTest-1472630776 None] <== create_volume: return (883ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'} {{(pid=88899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 08:41:32 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-b024f54c-0c3c-4a8c-8826-ce4e32d75f0d tempest-VolumesTransfersTest-1472630776 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.886s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:41:32 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-b024f54c-0c3c-4a8c-8826-ce4e32d75f0d tempest-VolumesTransfersTest-1472630776 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (efcb8276-9c71-427f-9875-19c4ff73c257) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6229a77c-50e5-4265-9ffd-132977b8214e', 'volume_size': 1}' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:41:32 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-b024f54c-0c3c-4a8c-8826-ce4e32d75f0d tempest-VolumesTransfersTest-1472630776 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f6271813-f497-4804-b74b-069a2a6fbb5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:41:32 devstack cinder-volume[88899]: INFO cinder.volume.flows.manager.create_volume [None req-b024f54c-0c3c-4a8c-8826-ce4e32d75f0d tempest-VolumesTransfersTest-1472630776 None] Volume volume-6229a77c-50e5-4265-9ffd-132977b8214e (6229a77c-50e5-4265-9ffd-132977b8214e): created successfully Aug 03 08:41:32 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-b024f54c-0c3c-4a8c-8826-ce4e32d75f0d tempest-VolumesTransfersTest-1472630776 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f6271813-f497-4804-b74b-069a2a6fbb5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:41:32 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-b024f54c-0c3c-4a8c-8826-ce4e32d75f0d tempest-VolumesTransfersTest-1472630776 None] Flow 'volume_create_manager' (d3179701-6a1e-4f9b-9056-e64af1e5fbe6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:41:32 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-b024f54c-0c3c-4a8c-8826-ce4e32d75f0d tempest-VolumesTransfersTest-1472630776 None] Created volume successfully. Aug 03 08:41:32 devstack cinder-volume[88899]: INFO cinder.volume.manager [req-62bfca2e-4ace-494e-9ec3-e5ed9fd60552 req-5dae952e-8176-4c0b-84d6-012985f8c3fd tempest-SnapshotDataIntegrityTests-1494076589 None] Terminate volume connection completed successfully. Aug 03 08:41:32 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [req-62bfca2e-4ace-494e-9ec3-e5ed9fd60552 req-5dae952e-8176-4c0b-84d6-012985f8c3fd tempest-SnapshotDataIntegrityTests-1494076589 None] Deleting attachment c3a4d1be-1516-4f50-ac97-dded9ca7c5a7. {{(pid=88899) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 03 08:41:32 devstack cinder-volume[88899]: DEBUG cinder.volume.flows.manager.create_volume [None req-e2b93606-da04-4ad9-9819-77844fa51a96 tempest-VolumesSnapshotTestJSON-561529062 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88899) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 08:41:32 devstack cinder-volume[88899]: INFO cinder.volume.manager [req-1fcfbbb5-2db7-4055-b948-e77143ab769e req-5e204492-14ea-41d8-943e-623f12fca678 tempest-TestInstancesWithCinderVolumes-1639155420 None] Terminate volume connection completed successfully. Aug 03 08:41:32 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [req-1fcfbbb5-2db7-4055-b948-e77143ab769e req-5e204492-14ea-41d8-943e-623f12fca678 tempest-TestInstancesWithCinderVolumes-1639155420 None] Deleting attachment 907cea8c-d01a-4155-9792-0bc000a4be86. {{(pid=88899) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 03 08:41:32 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-e2b93606-da04-4ad9-9819-77844fa51a96 tempest-VolumesSnapshotTestJSON-561529062 None] Flow 'volume_create_manager' (08d038d3-87f1-46ad-bf04-2b23ab7b573f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:41:32 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-e2b93606-da04-4ad9-9819-77844fa51a96 tempest-VolumesSnapshotTestJSON-561529062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (39ea9e63-380a-4832-b9e4-4771ee3781fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:41:32 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-e2b93606-da04-4ad9-9819-77844fa51a96 tempest-VolumesSnapshotTestJSON-561529062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (39ea9e63-380a-4832-b9e4-4771ee3781fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:41:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-598888870',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9070576f-23fa-4b92-81a6-cb5fe094607e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6aadf5593f7c43d59bf60392e0f4bf5d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:41:33Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=891ebb26-a193-42f0-acd4-3734c162d2f8,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:41:33Z,use_quota=True,user_id='527c161cc21048f0a677fee8087ea52a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8bde7129-1dc4-42ab-b852-ab32c61b4921),volume_type_id=8bde7129-1dc4-42ab-b852-ab32c61b4921)' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:41:32 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-e2b93606-da04-4ad9-9819-77844fa51a96 tempest-VolumesSnapshotTestJSON-561529062 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (71aa6c74-79ee-4935-bd94-99e56a0f3b50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:41:32 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-e2b93606-da04-4ad9-9819-77844fa51a96 tempest-VolumesSnapshotTestJSON-561529062 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (71aa6c74-79ee-4935-bd94-99e56a0f3b50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:41:32 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-e2b93606-da04-4ad9-9819-77844fa51a96 tempest-VolumesSnapshotTestJSON-561529062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (46922d5f-ec70-44a6-8f49-564964fed264) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:41:32 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-e2b93606-da04-4ad9-9819-77844fa51a96 tempest-VolumesSnapshotTestJSON-561529062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (46922d5f-ec70-44a6-8f49-564964fed264) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '9070576f-23fa-4b92-81a6-cb5fe094607e', 'volume_name': 'volume-9070576f-23fa-4b92-81a6-cb5fe094607e', 'volume_size': 2, 'snapshot_id': '891ebb26-a193-42f0-acd4-3734c162d2f8'}' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:41:32 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-e2b93606-da04-4ad9-9819-77844fa51a96 tempest-VolumesSnapshotTestJSON-561529062 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78ffdcf0-176a-430d-a94a-a28fce258423) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:41:32 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-e2b93606-da04-4ad9-9819-77844fa51a96 tempest-VolumesSnapshotTestJSON-561529062 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78ffdcf0-176a-430d-a94a-a28fce258423) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:41:32 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-e2b93606-da04-4ad9-9819-77844fa51a96 tempest-VolumesSnapshotTestJSON-561529062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a82a3615-c5d2-409d-a24f-0bbd1a806d9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:41:32 devstack cinder-volume[88899]: INFO cinder.volume.flows.manager.create_volume [None req-e2b93606-da04-4ad9-9819-77844fa51a96 tempest-VolumesSnapshotTestJSON-561529062 None] Volume 9070576f-23fa-4b92-81a6-cb5fe094607e: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-9070576f-23fa-4b92-81a6-cb5fe094607e', 'volume_size': 2, 'snapshot_id': '891ebb26-a193-42f0-acd4-3734c162d2f8'} Aug 03 08:41:32 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-e2b93606-da04-4ad9-9819-77844fa51a96 tempest-VolumesSnapshotTestJSON-561529062 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:41:32 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-e2b93606-da04-4ad9-9819-77844fa51a96 tempest-VolumesSnapshotTestJSON-561529062 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:41:32 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-e2b93606-da04-4ad9-9819-77844fa51a96 tempest-VolumesSnapshotTestJSON-561529062 None] Acquiring lock "cinder-quobyte-891ebb26-a193-42f0-acd4-3734c162d2f8-9070576f-23fa-4b92-81a6-cb5fe094607e" by "_create_volume_from_snapshot" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:41:32 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-e2b93606-da04-4ad9-9819-77844fa51a96 tempest-VolumesSnapshotTestJSON-561529062 None] Lock "cinder-quobyte-891ebb26-a193-42f0-acd4-3734c162d2f8-9070576f-23fa-4b92-81a6-cb5fe094607e" acquired by "_create_volume_from_snapshot" :: waited 0.014s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:41:32 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-e2b93606-da04-4ad9-9819-77844fa51a96 tempest-VolumesSnapshotTestJSON-561529062 None] Creating volume 9070576f-23fa-4b92-81a6-cb5fe094607e from snapshot 891ebb26-a193-42f0-acd4-3734c162d2f8 {{(pid=88899) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Aug 03 08:41:32 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-e2b93606-da04-4ad9-9819-77844fa51a96 tempest-VolumesSnapshotTestJSON-561529062 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:41:32 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-e2b93606-da04-4ad9-9819-77844fa51a96 tempest-VolumesSnapshotTestJSON-561529062 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:41:32 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-e2b93606-da04-4ad9-9819-77844fa51a96 tempest-VolumesSnapshotTestJSON-561529062 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:41:32 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-e2b93606-da04-4ad9-9819-77844fa51a96 tempest-VolumesSnapshotTestJSON-561529062 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:41:32 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-e2b93606-da04-4ad9-9819-77844fa51a96 tempest-VolumesSnapshotTestJSON-561529062 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:41:32 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-e2b93606-da04-4ad9-9819-77844fa51a96 tempest-VolumesSnapshotTestJSON-561529062 None] Selected osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385 as target Quobyte volume. {{(pid=88899) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 08:41:32 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-e2b93606-da04-4ad9-9819-77844fa51a96 tempest-VolumesSnapshotTestJSON-561529062 None] Acquiring lock "cinder-quobyte-9070576f-23fa-4b92-81a6-cb5fe094607e" by "_copy_volume_from_snapshot" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:41:32 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-e2b93606-da04-4ad9-9819-77844fa51a96 tempest-VolumesSnapshotTestJSON-561529062 None] Lock "cinder-quobyte-9070576f-23fa-4b92-81a6-cb5fe094607e" acquired by "_copy_volume_from_snapshot" :: waited 0.022s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:41:32 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-e2b93606-da04-4ad9-9819-77844fa51a96 tempest-VolumesSnapshotTestJSON-561529062 None] snapshot: 891ebb26-a193-42f0-acd4-3734c162d2f8, volume: 9070576f-23fa-4b92-81a6-cb5fe094607e, {{(pid=88899) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Aug 03 08:41:32 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-e2b93606-da04-4ad9-9819-77844fa51a96 tempest-VolumesSnapshotTestJSON-561529062 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:41:32 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-e2b93606-da04-4ad9-9819-77844fa51a96 tempest-VolumesSnapshotTestJSON-561529062 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:41:32 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-e2b93606-da04-4ad9-9819-77844fa51a96 tempest-VolumesSnapshotTestJSON-561529062 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:41:32 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-e2b93606-da04-4ad9-9819-77844fa51a96 tempest-VolumesSnapshotTestJSON-561529062 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:41:32 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-e2b93606-da04-4ad9-9819-77844fa51a96 tempest-VolumesSnapshotTestJSON-561529062 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:41:32 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a2de407-1e8a-4845-af69-a5cbcd96c278]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:41:32 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-e2b93606-da04-4ad9-9819-77844fa51a96 tempest-VolumesSnapshotTestJSON-561529062 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c073db67-acb0-46be-8945-65f8938b3575.891ebb26-a193-42f0-acd4-3734c162d2f8 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:41:33 devstack sudo[103127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c073db67-acb0-46be-8945-65f8938b3575.891ebb26-a193-42f0-acd4-3734c162d2f8 Aug 03 08:41:33 devstack sudo[103127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:41:33 devstack sudo[103127]: pam_unix(sudo:session): session closed for user root Aug 03 08:41:33 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-e2b93606-da04-4ad9-9819-77844fa51a96 tempest-VolumesSnapshotTestJSON-561529062 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c073db67-acb0-46be-8945-65f8938b3575.891ebb26-a193-42f0-acd4-3734c162d2f8" returned: 0 in 0.489s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:41:33 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-e2b93606-da04-4ad9-9819-77844fa51a96 tempest-VolumesSnapshotTestJSON-561529062 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c073db67-acb0-46be-8945-65f8938b3575(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88899) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 03 08:41:33 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ece1386-4225-4a8c-a62d-bd0b543b01f5]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:41:33 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-e2b93606-da04-4ad9-9819-77844fa51a96 tempest-VolumesSnapshotTestJSON-561529062 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c073db67-acb0-46be-8945-65f8938b3575 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:41:33 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-18df2469-4b75-436b-ad29-4ea3146686fe tempest-VolumesTransfersTest-300029068 None] Transfer volume completed successfully. Aug 03 08:41:33 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-b7498ce9-75f8-4242-81b5-bf3365890e80 tempest-TestInstancesWithCinderVolumes-1639155420 None] Acquiring lock "cinder-3261e91f-070b-4599-a2ac-b8ca735be47a-delete_volume" by "delete_volume" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:41:33 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-b7498ce9-75f8-4242-81b5-bf3365890e80 tempest-TestInstancesWithCinderVolumes-1639155420 None] Lock "cinder-3261e91f-070b-4599-a2ac-b8ca735be47a-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:41:33 devstack sudo[103132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c073db67-acb0-46be-8945-65f8938b3575 Aug 03 08:41:33 devstack sudo[103132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:41:33 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-b7498ce9-75f8-4242-81b5-bf3365890e80 tempest-TestInstancesWithCinderVolumes-1639155420 None] Acquiring lock "cinder-quobyte-3261e91f-070b-4599-a2ac-b8ca735be47a" by "delete_volume" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:41:33 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-b7498ce9-75f8-4242-81b5-bf3365890e80 tempest-TestInstancesWithCinderVolumes-1639155420 None] Lock "cinder-quobyte-3261e91f-070b-4599-a2ac-b8ca735be47a" acquired by "delete_volume" :: waited 0.044s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:41:33 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[834df12b-0525-4629-b164-22b32278b4db]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:41:33 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-b7498ce9-75f8-4242-81b5-bf3365890e80 tempest-TestInstancesWithCinderVolumes-1639155420 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-3261e91f-070b-4599-a2ac-b8ca735be47a {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:41:33 devstack cinder-volume[88899]: DEBUG cinder.volume.flows.manager.create_volume [None req-473d2973-bfc1-423e-8240-1c7fad7a89d5 tempest-SnapshotDataIntegrityTests-1494076589 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88899) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 08:41:33 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-473d2973-bfc1-423e-8240-1c7fad7a89d5 tempest-SnapshotDataIntegrityTests-1494076589 None] Flow 'volume_create_manager' (93b4a84d-be42-4697-98f0-d1bc9860e337) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:41:33 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-473d2973-bfc1-423e-8240-1c7fad7a89d5 tempest-SnapshotDataIntegrityTests-1494076589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f1d8312-6cbd-4184-8b32-fab01f5c3290) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:41:33 devstack sudo[103134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-3261e91f-070b-4599-a2ac-b8ca735be47a Aug 03 08:41:33 devstack sudo[103134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:41:33 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-473d2973-bfc1-423e-8240-1c7fad7a89d5 tempest-SnapshotDataIntegrityTests-1494076589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f1d8312-6cbd-4184-8b32-fab01f5c3290) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:41:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDataIntegrityTests-volume-1998459378',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f28a481-fd0c-4bd1-a9f3-ab47e3526b07,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7bfeec51147d4d6fb726c3d53fa691a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:41:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=dc60c96a-b480-4727-9d7c-db679775347c,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:41:34Z,use_quota=True,user_id='154fb6e7d02d4632a2d4958c8859e9a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8bde7129-1dc4-42ab-b852-ab32c61b4921),volume_type_id=8bde7129-1dc4-42ab-b852-ab32c61b4921)' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:41:33 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-473d2973-bfc1-423e-8240-1c7fad7a89d5 tempest-SnapshotDataIntegrityTests-1494076589 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a866980-fe0c-42ba-bafd-c24e3e46e1fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:41:33 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-473d2973-bfc1-423e-8240-1c7fad7a89d5 tempest-SnapshotDataIntegrityTests-1494076589 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a866980-fe0c-42ba-bafd-c24e3e46e1fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:41:33 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-473d2973-bfc1-423e-8240-1c7fad7a89d5 tempest-SnapshotDataIntegrityTests-1494076589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3599b69e-8254-43a9-bed7-bc6c1ce249d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:41:33 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-473d2973-bfc1-423e-8240-1c7fad7a89d5 tempest-SnapshotDataIntegrityTests-1494076589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3599b69e-8254-43a9-bed7-bc6c1ce249d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '3f28a481-fd0c-4bd1-a9f3-ab47e3526b07', 'volume_name': 'volume-3f28a481-fd0c-4bd1-a9f3-ab47e3526b07', 'volume_size': 1, 'snapshot_id': 'dc60c96a-b480-4727-9d7c-db679775347c'}' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:41:33 devstack sudo[103132]: pam_unix(sudo:session): session closed for user root Aug 03 08:41:33 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-473d2973-bfc1-423e-8240-1c7fad7a89d5 tempest-SnapshotDataIntegrityTests-1494076589 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a1cce27-3fc4-4452-bb08-7fec2abc8914) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:41:33 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-473d2973-bfc1-423e-8240-1c7fad7a89d5 tempest-SnapshotDataIntegrityTests-1494076589 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a1cce27-3fc4-4452-bb08-7fec2abc8914) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:41:33 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-473d2973-bfc1-423e-8240-1c7fad7a89d5 tempest-SnapshotDataIntegrityTests-1494076589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (73bd7d14-da14-4907-9e6b-8c86de4aa31a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:41:33 devstack cinder-volume[88899]: INFO cinder.volume.flows.manager.create_volume [None req-473d2973-bfc1-423e-8240-1c7fad7a89d5 tempest-SnapshotDataIntegrityTests-1494076589 None] Volume 3f28a481-fd0c-4bd1-a9f3-ab47e3526b07: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-3f28a481-fd0c-4bd1-a9f3-ab47e3526b07', 'volume_size': 1, 'snapshot_id': 'dc60c96a-b480-4727-9d7c-db679775347c'} Aug 03 08:41:33 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-e2b93606-da04-4ad9-9819-77844fa51a96 tempest-VolumesSnapshotTestJSON-561529062 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c073db67-acb0-46be-8945-65f8938b3575" returned: 0 in 0.565s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:41:33 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-e2b93606-da04-4ad9-9819-77844fa51a96 tempest-VolumesSnapshotTestJSON-561529062 None] will copy from snapshot at /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c073db67-acb0-46be-8945-65f8938b3575 {{(pid=88899) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Aug 03 08:41:33 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-e2b93606-da04-4ad9-9819-77844fa51a96 tempest-VolumesSnapshotTestJSON-561529062 None] Creating direct copy from snapshot {{(pid=88899) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Aug 03 08:41:34 devstack cinder-volume[88899]: DEBUG cinder.utils [None req-e2b93606-da04-4ad9-9819-77844fa51a96 tempest-VolumesSnapshotTestJSON-561529062 None] Path /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-9070576f-23fa-4b92-81a6-cb5fe094607e not found in is_blk_device check {{(pid=88899) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Aug 03 08:41:34 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-e2b93606-da04-4ad9-9819-77844fa51a96 tempest-VolumesSnapshotTestJSON-561529062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c073db67-acb0-46be-8945-65f8938b3575 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-9070576f-23fa-4b92-81a6-cb5fe094607e {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:41:34 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-473d2973-bfc1-423e-8240-1c7fad7a89d5 tempest-SnapshotDataIntegrityTests-1494076589 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:41:34 devstack sudo[103139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c073db67-acb0-46be-8945-65f8938b3575 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-9070576f-23fa-4b92-81a6-cb5fe094607e Aug 03 08:41:34 devstack sudo[103139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:41:34 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-96cc5603-d441-4133-9ef0-1e0f005e98f2 tempest-VolumesTransfersTest-1183163314 None] Acquiring lock "cinder-6229a77c-50e5-4265-9ffd-132977b8214e-delete_volume" by "delete_volume" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:41:34 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-96cc5603-d441-4133-9ef0-1e0f005e98f2 tempest-VolumesTransfersTest-1183163314 None] Lock "cinder-6229a77c-50e5-4265-9ffd-132977b8214e-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:41:34 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-96cc5603-d441-4133-9ef0-1e0f005e98f2 tempest-VolumesTransfersTest-1183163314 None] Acquiring lock "cinder-quobyte-6229a77c-50e5-4265-9ffd-132977b8214e" by "delete_volume" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:41:34 devstack sudo[103134]: pam_unix(sudo:session): session closed for user root Aug 03 08:41:34 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-b7498ce9-75f8-4242-81b5-bf3365890e80 tempest-TestInstancesWithCinderVolumes-1639155420 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-3261e91f-070b-4599-a2ac-b8ca735be47a" returned: 0 in 0.543s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:41:34 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-b7498ce9-75f8-4242-81b5-bf3365890e80 tempest-TestInstancesWithCinderVolumes-1639155420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-3261e91f-070b-4599-a2ac-b8ca735be47a {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:41:34 devstack sudo[103145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-3261e91f-070b-4599-a2ac-b8ca735be47a Aug 03 08:41:34 devstack sudo[103145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:41:34 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-96cc5603-d441-4133-9ef0-1e0f005e98f2 tempest-VolumesTransfersTest-1183163314 None] Lock "cinder-quobyte-6229a77c-50e5-4265-9ffd-132977b8214e" acquired by "delete_volume" :: waited 0.037s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:41:34 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[9460badc-f90e-48a5-8a0e-de3825dec6b1]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:41:34 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-96cc5603-d441-4133-9ef0-1e0f005e98f2 tempest-VolumesTransfersTest-1183163314 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-6229a77c-50e5-4265-9ffd-132977b8214e {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:41:34 devstack sudo[103149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-6229a77c-50e5-4265-9ffd-132977b8214e Aug 03 08:41:34 devstack sudo[103149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:41:34 devstack sudo[103145]: pam_unix(sudo:session): session closed for user root Aug 03 08:41:34 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-b7498ce9-75f8-4242-81b5-bf3365890e80 tempest-TestInstancesWithCinderVolumes-1639155420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-3261e91f-070b-4599-a2ac-b8ca735be47a" returned: 0 in 0.280s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:41:34 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-b7498ce9-75f8-4242-81b5-bf3365890e80 tempest-TestInstancesWithCinderVolumes-1639155420 None] Lock "cinder-quobyte-3261e91f-070b-4599-a2ac-b8ca735be47a" released by "delete_volume" :: held 0.900s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:41:34 devstack cinder-volume[88899]: WARNING cinder.quota [None req-b7498ce9-75f8-4242-81b5-bf3365890e80 tempest-TestInstancesWithCinderVolumes-1639155420 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-327842746-2004804670 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-327842746-2004804670, it is now deprecated. Please use the default quota class for default quota. Aug 03 08:41:34 devstack cinder-volume[88899]: WARNING cinder.quota [None req-b7498ce9-75f8-4242-81b5-bf3365890e80 tempest-TestInstancesWithCinderVolumes-1639155420 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-327842746-2004804670 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-327842746-2004804670, it is now deprecated. Please use the default quota class for default quota. Aug 03 08:41:34 devstack cinder-volume[88899]: DEBUG cinder.quota [None req-b7498ce9-75f8-4242-81b5-bf3365890e80 tempest-TestInstancesWithCinderVolumes-1639155420 None] Created reservations ['65e9dfd7-5fc1-43ee-9aa2-647602d53ba4', '3b867888-ebac-49ca-b4be-3f185029ee44', '8efcccd9-35f1-4918-90a7-2a9d1f1fc50f', '4babbaa5-269b-4100-abc7-fc1d10e28448'] {{(pid=88899) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 08:41:34 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-b7498ce9-75f8-4242-81b5-bf3365890e80 tempest-TestInstancesWithCinderVolumes-1639155420 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:41:34 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-b7498ce9-75f8-4242-81b5-bf3365890e80 tempest-TestInstancesWithCinderVolumes-1639155420 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:41:34 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-b7498ce9-75f8-4242-81b5-bf3365890e80 tempest-TestInstancesWithCinderVolumes-1639155420 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:41:34 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-b7498ce9-75f8-4242-81b5-bf3365890e80 tempest-TestInstancesWithCinderVolumes-1639155420 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:41:34 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-b7498ce9-75f8-4242-81b5-bf3365890e80 tempest-TestInstancesWithCinderVolumes-1639155420 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:41:34 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-b7498ce9-75f8-4242-81b5-bf3365890e80 tempest-TestInstancesWithCinderVolumes-1639155420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:41:34 devstack sudo[103161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a Aug 03 08:41:34 devstack sudo[103161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:41:34 devstack sudo[103149]: pam_unix(sudo:session): session closed for user root Aug 03 08:41:34 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-96cc5603-d441-4133-9ef0-1e0f005e98f2 tempest-VolumesTransfersTest-1183163314 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-6229a77c-50e5-4265-9ffd-132977b8214e" returned: 0 in 0.644s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:41:35 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-96cc5603-d441-4133-9ef0-1e0f005e98f2 tempest-VolumesTransfersTest-1183163314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-6229a77c-50e5-4265-9ffd-132977b8214e {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:41:35 devstack sudo[103164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-6229a77c-50e5-4265-9ffd-132977b8214e Aug 03 08:41:35 devstack sudo[103164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:41:35 devstack sudo[103161]: pam_unix(sudo:session): session closed for user root Aug 03 08:41:35 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-b7498ce9-75f8-4242-81b5-bf3365890e80 tempest-TestInstancesWithCinderVolumes-1639155420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a" returned: 0 in 0.758s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:41:35 devstack cinder-volume[88899]: DEBUG cinder.manager [None req-b7498ce9-75f8-4242-81b5-bf3365890e80 tempest-TestInstancesWithCinderVolumes-1639155420 None] Notifying Schedulers of capabilities ... {{(pid=88899) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 08:41:35 devstack sudo[103164]: pam_unix(sudo:session): session closed for user root Aug 03 08:41:35 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-96cc5603-d441-4133-9ef0-1e0f005e98f2 tempest-VolumesTransfersTest-1183163314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-6229a77c-50e5-4265-9ffd-132977b8214e" returned: 0 in 0.593s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:41:35 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-b7498ce9-75f8-4242-81b5-bf3365890e80 tempest-TestInstancesWithCinderVolumes-1639155420 None] Deleted volume successfully. Aug 03 08:41:35 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-96cc5603-d441-4133-9ef0-1e0f005e98f2 tempest-VolumesTransfersTest-1183163314 None] Lock "cinder-quobyte-6229a77c-50e5-4265-9ffd-132977b8214e" released by "delete_volume" :: held 1.332s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:41:35 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-b7498ce9-75f8-4242-81b5-bf3365890e80 tempest-TestInstancesWithCinderVolumes-1639155420 None] Lock "cinder-3261e91f-070b-4599-a2ac-b8ca735be47a-delete_volume" released by "delete_volume" :: held 2.130s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:41:35 devstack cinder-volume[88899]: DEBUG cinder.quota [None req-96cc5603-d441-4133-9ef0-1e0f005e98f2 tempest-VolumesTransfersTest-1183163314 None] Created reservations ['2564330b-c719-4b36-a966-5760e80c0695', 'd9cf7c72-8776-4048-aa7b-c149651d212e', 'aa75975d-7027-48f2-a719-89f32f8abda7', 'a9a080da-2bf7-4637-8454-953e26352736'] {{(pid=88899) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 08:41:35 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-96cc5603-d441-4133-9ef0-1e0f005e98f2 tempest-VolumesTransfersTest-1183163314 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:41:35 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-96cc5603-d441-4133-9ef0-1e0f005e98f2 tempest-VolumesTransfersTest-1183163314 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:41:35 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-96cc5603-d441-4133-9ef0-1e0f005e98f2 tempest-VolumesTransfersTest-1183163314 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:41:35 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-96cc5603-d441-4133-9ef0-1e0f005e98f2 tempest-VolumesTransfersTest-1183163314 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:41:35 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-96cc5603-d441-4133-9ef0-1e0f005e98f2 tempest-VolumesTransfersTest-1183163314 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:41:35 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-96cc5603-d441-4133-9ef0-1e0f005e98f2 tempest-VolumesTransfersTest-1183163314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:41:36 devstack sudo[103168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a Aug 03 08:41:36 devstack sudo[103168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:41:36 devstack sudo[103168]: pam_unix(sudo:session): session closed for user root Aug 03 08:41:36 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-96cc5603-d441-4133-9ef0-1e0f005e98f2 tempest-VolumesTransfersTest-1183163314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a" returned: 0 in 0.369s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:41:36 devstack cinder-volume[88899]: DEBUG cinder.manager [None req-96cc5603-d441-4133-9ef0-1e0f005e98f2 tempest-VolumesTransfersTest-1183163314 None] Notifying Schedulers of capabilities ... {{(pid=88899) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 08:41:36 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-96cc5603-d441-4133-9ef0-1e0f005e98f2 tempest-VolumesTransfersTest-1183163314 None] Deleted volume successfully. Aug 03 08:41:36 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-96cc5603-d441-4133-9ef0-1e0f005e98f2 tempest-VolumesTransfersTest-1183163314 None] Lock "cinder-6229a77c-50e5-4265-9ffd-132977b8214e-delete_volume" released by "delete_volume" :: held 2.164s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:41:38 devstack cinder-volume[88899]: DEBUG cinder.volume.flows.manager.create_volume [None req-8b5e78ac-1bf2-4c7d-b51c-93dc85f17dd5 tempest-VolumesTransfersTest-1472630776 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88899) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 08:41:38 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-8b5e78ac-1bf2-4c7d-b51c-93dc85f17dd5 tempest-VolumesTransfersTest-1472630776 None] Flow 'volume_create_manager' (53189c5a-fc15-4959-b5a3-acc56ca4ece3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:41:38 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-8b5e78ac-1bf2-4c7d-b51c-93dc85f17dd5 tempest-VolumesTransfersTest-1472630776 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5a81d19-60df-4eab-aa7f-e848bba798bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:41:38 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-8b5e78ac-1bf2-4c7d-b51c-93dc85f17dd5 tempest-VolumesTransfersTest-1472630776 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5a81d19-60df-4eab-aa7f-e848bba798bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:41:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-244353549',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b055a791-e7ce-4b60-a2a0-f1863bf5a182,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c8df4d6f49d4b848d62b5a3367bf468',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:41:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:41:38Z,use_quota=True,user_id='0a806fec176740fd8b3f6a8b48e35d2c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8bde7129-1dc4-42ab-b852-ab32c61b4921),volume_type_id=8bde7129-1dc4-42ab-b852-ab32c61b4921)' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:41:38 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-8b5e78ac-1bf2-4c7d-b51c-93dc85f17dd5 tempest-VolumesTransfersTest-1472630776 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86b58f59-ca67-439b-9dff-da5412093078) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:41:38 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-8b5e78ac-1bf2-4c7d-b51c-93dc85f17dd5 tempest-VolumesTransfersTest-1472630776 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86b58f59-ca67-439b-9dff-da5412093078) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:41:38 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-8b5e78ac-1bf2-4c7d-b51c-93dc85f17dd5 tempest-VolumesTransfersTest-1472630776 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37b6cc9b-08ac-4394-8e9c-b57567d302e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:41:38 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-8b5e78ac-1bf2-4c7d-b51c-93dc85f17dd5 tempest-VolumesTransfersTest-1472630776 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37b6cc9b-08ac-4394-8e9c-b57567d302e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b055a791-e7ce-4b60-a2a0-f1863bf5a182', 'volume_name': 'volume-b055a791-e7ce-4b60-a2a0-f1863bf5a182', 'volume_size': 1}' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:41:38 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-8b5e78ac-1bf2-4c7d-b51c-93dc85f17dd5 tempest-VolumesTransfersTest-1472630776 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9e0d327-b5fe-4f54-8568-4c66390742fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:41:38 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-8b5e78ac-1bf2-4c7d-b51c-93dc85f17dd5 tempest-VolumesTransfersTest-1472630776 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9e0d327-b5fe-4f54-8568-4c66390742fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:41:38 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-8b5e78ac-1bf2-4c7d-b51c-93dc85f17dd5 tempest-VolumesTransfersTest-1472630776 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d274b71-781c-4eca-8c60-31bc3d1875fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:41:38 devstack cinder-volume[88899]: INFO cinder.volume.flows.manager.create_volume [None req-8b5e78ac-1bf2-4c7d-b51c-93dc85f17dd5 tempest-VolumesTransfersTest-1472630776 None] Volume b055a791-e7ce-4b60-a2a0-f1863bf5a182: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b055a791-e7ce-4b60-a2a0-f1863bf5a182', 'volume_size': 1} Aug 03 08:41:38 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-8b5e78ac-1bf2-4c7d-b51c-93dc85f17dd5 tempest-VolumesTransfersTest-1472630776 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:41:39 devstack sudo[103139]: pam_unix(sudo:session): session closed for user root Aug 03 08:41:39 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-e2b93606-da04-4ad9-9819-77844fa51a96 tempest-VolumesSnapshotTestJSON-561529062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c073db67-acb0-46be-8945-65f8938b3575 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-9070576f-23fa-4b92-81a6-cb5fe094607e" returned: 0 in 5.986s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:41:39 devstack cinder-volume[88899]: DEBUG cinder.image.image_utils [None req-e2b93606-da04-4ad9-9819-77844fa51a96 tempest-VolumesSnapshotTestJSON-561529062 None] Image conversion details: src /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c073db67-acb0-46be-8945-65f8938b3575, size 1024.00 MB, duration 5.99 sec, destination /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-9070576f-23fa-4b92-81a6-cb5fe094607e {{(pid=88899) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 03 08:41:39 devstack cinder-volume[88899]: INFO cinder.image.image_utils [None req-e2b93606-da04-4ad9-9819-77844fa51a96 tempest-VolumesSnapshotTestJSON-561529062 None] Converted 1024.00 MB image at 171.03 MB/s Aug 03 08:41:39 devstack cinder-volume[88899]: WARNING cinder.volume.drivers.remotefs [None req-e2b93606-da04-4ad9-9819-77844fa51a96 tempest-VolumesSnapshotTestJSON-561529062 None] /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-9070576f-23fa-4b92-81a6-cb5fe094607e is being set with open permissions: ugo+rw Aug 03 08:41:39 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-e2b93606-da04-4ad9-9819-77844fa51a96 tempest-VolumesSnapshotTestJSON-561529062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-9070576f-23fa-4b92-81a6-cb5fe094607e {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:41:40 devstack sudo[103182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-9070576f-23fa-4b92-81a6-cb5fe094607e Aug 03 08:41:40 devstack sudo[103182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:41:40 devstack sudo[103182]: pam_unix(sudo:session): session closed for user root Aug 03 08:41:40 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-e2b93606-da04-4ad9-9819-77844fa51a96 tempest-VolumesSnapshotTestJSON-561529062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-9070576f-23fa-4b92-81a6-cb5fe094607e" returned: 0 in 0.440s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:41:40 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-e2b93606-da04-4ad9-9819-77844fa51a96 tempest-VolumesSnapshotTestJSON-561529062 None] Lock "cinder-quobyte-9070576f-23fa-4b92-81a6-cb5fe094607e" released by "_copy_volume_from_snapshot" :: held 7.608s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:41:40 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-e2b93606-da04-4ad9-9819-77844fa51a96 tempest-VolumesSnapshotTestJSON-561529062 None] Lock "cinder-quobyte-891ebb26-a193-42f0-acd4-3734c162d2f8-9070576f-23fa-4b92-81a6-cb5fe094607e" released by "_create_volume_from_snapshot" :: held 7.696s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:41:40 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-e2b93606-da04-4ad9-9819-77844fa51a96 tempest-VolumesSnapshotTestJSON-561529062 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.711s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:41:40 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-473d2973-bfc1-423e-8240-1c7fad7a89d5 tempest-SnapshotDataIntegrityTests-1494076589 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 6.479s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:41:40 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-473d2973-bfc1-423e-8240-1c7fad7a89d5 tempest-SnapshotDataIntegrityTests-1494076589 None] Acquiring lock "cinder-quobyte-dc60c96a-b480-4727-9d7c-db679775347c-3f28a481-fd0c-4bd1-a9f3-ab47e3526b07" by "_create_volume_from_snapshot" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:41:40 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-473d2973-bfc1-423e-8240-1c7fad7a89d5 tempest-SnapshotDataIntegrityTests-1494076589 None] Lock "cinder-quobyte-dc60c96a-b480-4727-9d7c-db679775347c-3f28a481-fd0c-4bd1-a9f3-ab47e3526b07" acquired by "_create_volume_from_snapshot" :: waited 0.025s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:41:40 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-473d2973-bfc1-423e-8240-1c7fad7a89d5 tempest-SnapshotDataIntegrityTests-1494076589 None] Creating volume 3f28a481-fd0c-4bd1-a9f3-ab47e3526b07 from snapshot dc60c96a-b480-4727-9d7c-db679775347c {{(pid=88899) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Aug 03 08:41:40 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-473d2973-bfc1-423e-8240-1c7fad7a89d5 tempest-SnapshotDataIntegrityTests-1494076589 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:41:40 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-473d2973-bfc1-423e-8240-1c7fad7a89d5 tempest-SnapshotDataIntegrityTests-1494076589 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:41:40 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-473d2973-bfc1-423e-8240-1c7fad7a89d5 tempest-SnapshotDataIntegrityTests-1494076589 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:41:40 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-473d2973-bfc1-423e-8240-1c7fad7a89d5 tempest-SnapshotDataIntegrityTests-1494076589 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:41:40 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-473d2973-bfc1-423e-8240-1c7fad7a89d5 tempest-SnapshotDataIntegrityTests-1494076589 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:41:40 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-473d2973-bfc1-423e-8240-1c7fad7a89d5 tempest-SnapshotDataIntegrityTests-1494076589 None] Selected osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385 as target Quobyte volume. {{(pid=88899) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 08:41:40 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-473d2973-bfc1-423e-8240-1c7fad7a89d5 tempest-SnapshotDataIntegrityTests-1494076589 None] Acquiring lock "cinder-quobyte-3f28a481-fd0c-4bd1-a9f3-ab47e3526b07" by "_copy_volume_from_snapshot" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:41:40 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-e2b93606-da04-4ad9-9819-77844fa51a96 tempest-VolumesSnapshotTestJSON-561529062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a82a3615-c5d2-409d-a24f-0bbd1a806d9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9070576f-23fa-4b92-81a6-cb5fe094607e', 'volume_size': 2, 'snapshot_id': '891ebb26-a193-42f0-acd4-3734c162d2f8'}' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:41:40 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-e2b93606-da04-4ad9-9819-77844fa51a96 tempest-VolumesSnapshotTestJSON-561529062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (abb76600-703d-4877-836a-86395ecfb894) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:41:40 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-473d2973-bfc1-423e-8240-1c7fad7a89d5 tempest-SnapshotDataIntegrityTests-1494076589 None] Lock "cinder-quobyte-3f28a481-fd0c-4bd1-a9f3-ab47e3526b07" acquired by "_copy_volume_from_snapshot" :: waited 0.034s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:41:40 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-473d2973-bfc1-423e-8240-1c7fad7a89d5 tempest-SnapshotDataIntegrityTests-1494076589 None] snapshot: dc60c96a-b480-4727-9d7c-db679775347c, volume: 3f28a481-fd0c-4bd1-a9f3-ab47e3526b07, {{(pid=88899) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Aug 03 08:41:40 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-473d2973-bfc1-423e-8240-1c7fad7a89d5 tempest-SnapshotDataIntegrityTests-1494076589 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:41:40 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-473d2973-bfc1-423e-8240-1c7fad7a89d5 tempest-SnapshotDataIntegrityTests-1494076589 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:41:40 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-473d2973-bfc1-423e-8240-1c7fad7a89d5 tempest-SnapshotDataIntegrityTests-1494076589 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:41:40 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-473d2973-bfc1-423e-8240-1c7fad7a89d5 tempest-SnapshotDataIntegrityTests-1494076589 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:41:40 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-473d2973-bfc1-423e-8240-1c7fad7a89d5 tempest-SnapshotDataIntegrityTests-1494076589 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:41:40 devstack cinder-volume[88899]: INFO cinder.volume.flows.manager.create_volume [None req-e2b93606-da04-4ad9-9819-77844fa51a96 tempest-VolumesSnapshotTestJSON-561529062 None] Volume volume-9070576f-23fa-4b92-81a6-cb5fe094607e (9070576f-23fa-4b92-81a6-cb5fe094607e): created successfully Aug 03 08:41:40 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-e2b93606-da04-4ad9-9819-77844fa51a96 tempest-VolumesSnapshotTestJSON-561529062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (abb76600-703d-4877-836a-86395ecfb894) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:41:40 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-e2b93606-da04-4ad9-9819-77844fa51a96 tempest-VolumesSnapshotTestJSON-561529062 None] Flow 'volume_create_manager' (08d038d3-87f1-46ad-bf04-2b23ab7b573f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:41:40 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[659caf67-b8b8-4725-81a1-4847bde1d398]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:41:40 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-473d2973-bfc1-423e-8240-1c7fad7a89d5 tempest-SnapshotDataIntegrityTests-1494076589 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-6bafdd19-6d59-4557-a0e3-17d1fbfc1053.dc60c96a-b480-4727-9d7c-db679775347c {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:41:40 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-e2b93606-da04-4ad9-9819-77844fa51a96 tempest-VolumesSnapshotTestJSON-561529062 None] Created volume successfully. Aug 03 08:41:40 devstack sudo[103203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-6bafdd19-6d59-4557-a0e3-17d1fbfc1053.dc60c96a-b480-4727-9d7c-db679775347c Aug 03 08:41:40 devstack sudo[103203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:41:40 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-1c790f7d-8741-47c3-a667-6cacae31d173 tempest-VolumesSnapshotTestJSON-561529062 None] Acquiring lock "cinder-9070576f-23fa-4b92-81a6-cb5fe094607e-delete_volume" by "delete_volume" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:41:40 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-1c790f7d-8741-47c3-a667-6cacae31d173 tempest-VolumesSnapshotTestJSON-561529062 None] Lock "cinder-9070576f-23fa-4b92-81a6-cb5fe094607e-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:41:41 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-1c790f7d-8741-47c3-a667-6cacae31d173 tempest-VolumesSnapshotTestJSON-561529062 None] Acquiring lock "cinder-quobyte-9070576f-23fa-4b92-81a6-cb5fe094607e" by "delete_volume" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:41:41 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-1c790f7d-8741-47c3-a667-6cacae31d173 tempest-VolumesSnapshotTestJSON-561529062 None] Lock "cinder-quobyte-9070576f-23fa-4b92-81a6-cb5fe094607e" acquired by "delete_volume" :: waited 0.036s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:41:41 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[477c0111-5679-4322-8b6a-a788a450a922]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:41:41 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-1c790f7d-8741-47c3-a667-6cacae31d173 tempest-VolumesSnapshotTestJSON-561529062 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-9070576f-23fa-4b92-81a6-cb5fe094607e {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:41:41 devstack sudo[103203]: pam_unix(sudo:session): session closed for user root Aug 03 08:41:41 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-473d2973-bfc1-423e-8240-1c7fad7a89d5 tempest-SnapshotDataIntegrityTests-1494076589 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-6bafdd19-6d59-4557-a0e3-17d1fbfc1053.dc60c96a-b480-4727-9d7c-db679775347c" returned: 0 in 0.546s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:41:41 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-473d2973-bfc1-423e-8240-1c7fad7a89d5 tempest-SnapshotDataIntegrityTests-1494076589 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6bafdd19-6d59-4557-a0e3-17d1fbfc1053(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88899) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 03 08:41:41 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6f57328-ccd0-40ad-9cab-b88e194d77bc]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:41:41 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-473d2973-bfc1-423e-8240-1c7fad7a89d5 tempest-SnapshotDataIntegrityTests-1494076589 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-6bafdd19-6d59-4557-a0e3-17d1fbfc1053.ef70e01c-7a59-4ac6-a705-f98e01473350 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:41:41 devstack sudo[103208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-9070576f-23fa-4b92-81a6-cb5fe094607e Aug 03 08:41:41 devstack sudo[103208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:41:41 devstack sudo[103210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-6bafdd19-6d59-4557-a0e3-17d1fbfc1053.ef70e01c-7a59-4ac6-a705-f98e01473350 Aug 03 08:41:41 devstack sudo[103210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:41:41 devstack cinder-volume[88899]: INFO cinder.volume.manager [req-1afdad61-a29d-4c30-adc2-b303f906acdc req-4061e2e2-6ffe-42f9-8387-b4101805565c tempest-TestInstancesWithCinderVolumes-1639155420 None] Terminate volume connection completed successfully. Aug 03 08:41:41 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [req-1afdad61-a29d-4c30-adc2-b303f906acdc req-4061e2e2-6ffe-42f9-8387-b4101805565c tempest-TestInstancesWithCinderVolumes-1639155420 None] Deleting attachment 7643fe97-59ec-4501-aba8-2b613040d52f. {{(pid=88899) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 03 08:41:41 devstack sudo[103208]: pam_unix(sudo:session): session closed for user root Aug 03 08:41:41 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-1c790f7d-8741-47c3-a667-6cacae31d173 tempest-VolumesSnapshotTestJSON-561529062 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-9070576f-23fa-4b92-81a6-cb5fe094607e" returned: 0 in 0.480s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:41:41 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-1c790f7d-8741-47c3-a667-6cacae31d173 tempest-VolumesSnapshotTestJSON-561529062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-9070576f-23fa-4b92-81a6-cb5fe094607e {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:41:41 devstack sudo[103219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-9070576f-23fa-4b92-81a6-cb5fe094607e Aug 03 08:41:41 devstack sudo[103219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:41:41 devstack sudo[103210]: pam_unix(sudo:session): session closed for user root Aug 03 08:41:41 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-473d2973-bfc1-423e-8240-1c7fad7a89d5 tempest-SnapshotDataIntegrityTests-1494076589 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-6bafdd19-6d59-4557-a0e3-17d1fbfc1053.ef70e01c-7a59-4ac6-a705-f98e01473350" returned: 0 in 0.480s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:41:41 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-473d2973-bfc1-423e-8240-1c7fad7a89d5 tempest-SnapshotDataIntegrityTests-1494076589 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6bafdd19-6d59-4557-a0e3-17d1fbfc1053(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88899) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 03 08:41:41 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-473d2973-bfc1-423e-8240-1c7fad7a89d5 tempest-SnapshotDataIntegrityTests-1494076589 None] will copy from snapshot at /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-6bafdd19-6d59-4557-a0e3-17d1fbfc1053.ef70e01c-7a59-4ac6-a705-f98e01473350 {{(pid=88899) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Aug 03 08:41:41 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-473d2973-bfc1-423e-8240-1c7fad7a89d5 tempest-SnapshotDataIntegrityTests-1494076589 None] Creating direct copy from snapshot {{(pid=88899) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Aug 03 08:41:41 devstack cinder-volume[88899]: DEBUG cinder.utils [None req-473d2973-bfc1-423e-8240-1c7fad7a89d5 tempest-SnapshotDataIntegrityTests-1494076589 None] Path /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-3f28a481-fd0c-4bd1-a9f3-ab47e3526b07 not found in is_blk_device check {{(pid=88899) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Aug 03 08:41:41 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-473d2973-bfc1-423e-8240-1c7fad7a89d5 tempest-SnapshotDataIntegrityTests-1494076589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-6bafdd19-6d59-4557-a0e3-17d1fbfc1053.ef70e01c-7a59-4ac6-a705-f98e01473350 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-3f28a481-fd0c-4bd1-a9f3-ab47e3526b07 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:41:41 devstack sudo[103222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-6bafdd19-6d59-4557-a0e3-17d1fbfc1053.ef70e01c-7a59-4ac6-a705-f98e01473350 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-3f28a481-fd0c-4bd1-a9f3-ab47e3526b07 Aug 03 08:41:41 devstack sudo[103222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:41:41 devstack sudo[103219]: pam_unix(sudo:session): session closed for user root Aug 03 08:41:41 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-1c790f7d-8741-47c3-a667-6cacae31d173 tempest-VolumesSnapshotTestJSON-561529062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-9070576f-23fa-4b92-81a6-cb5fe094607e" returned: 0 in 0.297s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:41:41 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-1c790f7d-8741-47c3-a667-6cacae31d173 tempest-VolumesSnapshotTestJSON-561529062 None] Lock "cinder-quobyte-9070576f-23fa-4b92-81a6-cb5fe094607e" released by "delete_volume" :: held 0.856s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:41:42 devstack cinder-volume[88899]: DEBUG cinder.quota [None req-1c790f7d-8741-47c3-a667-6cacae31d173 tempest-VolumesSnapshotTestJSON-561529062 None] Created reservations ['e69ee394-3894-4777-91ae-cf669c317b68', '9642fd43-220f-4cc8-baba-16b5fd039283', 'dc54a84b-9439-4bed-a847-876fc752a878', '7a3657c8-6664-4808-aabc-bfd28c024ee6'] {{(pid=88899) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 08:41:42 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-1c790f7d-8741-47c3-a667-6cacae31d173 tempest-VolumesSnapshotTestJSON-561529062 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:41:42 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-1c790f7d-8741-47c3-a667-6cacae31d173 tempest-VolumesSnapshotTestJSON-561529062 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:41:42 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-1c790f7d-8741-47c3-a667-6cacae31d173 tempest-VolumesSnapshotTestJSON-561529062 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:41:42 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-1c790f7d-8741-47c3-a667-6cacae31d173 tempest-VolumesSnapshotTestJSON-561529062 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:41:42 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-1c790f7d-8741-47c3-a667-6cacae31d173 tempest-VolumesSnapshotTestJSON-561529062 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:41:42 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-1c790f7d-8741-47c3-a667-6cacae31d173 tempest-VolumesSnapshotTestJSON-561529062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:41:42 devstack sudo[103228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a Aug 03 08:41:42 devstack sudo[103228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:41:42 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-b3cd4aa4-0f48-4e7d-91e5-3c5dd274d6a6 tempest-VolumesSnapshotTestJSON-561529062 None] Acquiring lock "cinder-891ebb26-a193-42f0-acd4-3734c162d2f8-delete_snapshot" by "delete_snapshot" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:41:42 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-b3cd4aa4-0f48-4e7d-91e5-3c5dd274d6a6 tempest-VolumesSnapshotTestJSON-561529062 None] Lock "cinder-891ebb26-a193-42f0-acd4-3734c162d2f8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.037s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:41:42 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-b3cd4aa4-0f48-4e7d-91e5-3c5dd274d6a6 tempest-VolumesSnapshotTestJSON-561529062 None] Acquiring lock "cinder-quobyte-c073db67-acb0-46be-8945-65f8938b3575" by "delete_snapshot" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:41:42 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-b3cd4aa4-0f48-4e7d-91e5-3c5dd274d6a6 tempest-VolumesSnapshotTestJSON-561529062 None] Lock "cinder-quobyte-c073db67-acb0-46be-8945-65f8938b3575" acquired by "delete_snapshot" :: waited 0.019s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:41:42 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-b3cd4aa4-0f48-4e7d-91e5-3c5dd274d6a6 tempest-VolumesSnapshotTestJSON-561529062 None] Acquiring lock "cinder-quobyte-891ebb26-a193-42f0-acd4-3734c162d2f8" by "_delete_snapshot" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:41:42 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-b3cd4aa4-0f48-4e7d-91e5-3c5dd274d6a6 tempest-VolumesSnapshotTestJSON-561529062 None] Lock "cinder-quobyte-891ebb26-a193-42f0-acd4-3734c162d2f8" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:41:42 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-b3cd4aa4-0f48-4e7d-91e5-3c5dd274d6a6 tempest-VolumesSnapshotTestJSON-561529062 None] Deleting offline snapshot 891ebb26-a193-42f0-acd4-3734c162d2f8 of volume c073db67-acb0-46be-8945-65f8938b3575 {{(pid=88899) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 03 08:41:42 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-b3cd4aa4-0f48-4e7d-91e5-3c5dd274d6a6 tempest-VolumesSnapshotTestJSON-561529062 None] snapshot_file for this snap is: volume-c073db67-acb0-46be-8945-65f8938b3575.891ebb26-a193-42f0-acd4-3734c162d2f8 {{(pid=88899) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 03 08:41:42 devstack sudo[103228]: pam_unix(sudo:session): session closed for user root Aug 03 08:41:42 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[edc81093-ee0f-43ff-848c-89a7f4eca6ba]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:41:42 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-b3cd4aa4-0f48-4e7d-91e5-3c5dd274d6a6 tempest-VolumesSnapshotTestJSON-561529062 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c073db67-acb0-46be-8945-65f8938b3575.891ebb26-a193-42f0-acd4-3734c162d2f8 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:41:42 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-1c790f7d-8741-47c3-a667-6cacae31d173 tempest-VolumesSnapshotTestJSON-561529062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a" returned: 0 in 0.321s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:41:42 devstack cinder-volume[88899]: DEBUG cinder.manager [None req-1c790f7d-8741-47c3-a667-6cacae31d173 tempest-VolumesSnapshotTestJSON-561529062 None] Notifying Schedulers of capabilities ... {{(pid=88899) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 08:41:42 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-1c790f7d-8741-47c3-a667-6cacae31d173 tempest-VolumesSnapshotTestJSON-561529062 None] Deleted volume successfully. Aug 03 08:41:42 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-06a5634f-1e49-47df-9dc9-54fa50b64537 tempest-TestInstancesWithCinderVolumes-1639155420 None] Acquiring lock "cinder-4c98b2e5-cbce-462d-9175-448b45b0470b-delete_volume" by "delete_volume" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:41:42 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-1c790f7d-8741-47c3-a667-6cacae31d173 tempest-VolumesSnapshotTestJSON-561529062 None] Lock "cinder-9070576f-23fa-4b92-81a6-cb5fe094607e-delete_volume" released by "delete_volume" :: held 1.469s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:41:42 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-06a5634f-1e49-47df-9dc9-54fa50b64537 tempest-TestInstancesWithCinderVolumes-1639155420 None] Lock "cinder-4c98b2e5-cbce-462d-9175-448b45b0470b-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:41:42 devstack sudo[103231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c073db67-acb0-46be-8945-65f8938b3575.891ebb26-a193-42f0-acd4-3734c162d2f8 Aug 03 08:41:42 devstack sudo[103231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:41:42 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-06a5634f-1e49-47df-9dc9-54fa50b64537 tempest-TestInstancesWithCinderVolumes-1639155420 None] Acquiring lock "cinder-quobyte-4c98b2e5-cbce-462d-9175-448b45b0470b" by "delete_volume" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:41:42 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-06a5634f-1e49-47df-9dc9-54fa50b64537 tempest-TestInstancesWithCinderVolumes-1639155420 None] Lock "cinder-quobyte-4c98b2e5-cbce-462d-9175-448b45b0470b" acquired by "delete_volume" :: waited 0.017s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:41:42 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d205671-84e0-4841-a777-f38115aa6163]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:41:42 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-06a5634f-1e49-47df-9dc9-54fa50b64537 tempest-TestInstancesWithCinderVolumes-1639155420 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-4c98b2e5-cbce-462d-9175-448b45b0470b {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:41:42 devstack sudo[103233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-4c98b2e5-cbce-462d-9175-448b45b0470b Aug 03 08:41:42 devstack sudo[103233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:41:42 devstack sudo[103231]: pam_unix(sudo:session): session closed for user root Aug 03 08:41:42 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-b3cd4aa4-0f48-4e7d-91e5-3c5dd274d6a6 tempest-VolumesSnapshotTestJSON-561529062 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c073db67-acb0-46be-8945-65f8938b3575.891ebb26-a193-42f0-acd4-3734c162d2f8" returned: 0 in 0.471s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:41:42 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-b3cd4aa4-0f48-4e7d-91e5-3c5dd274d6a6 tempest-VolumesSnapshotTestJSON-561529062 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c073db67-acb0-46be-8945-65f8938b3575(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88899) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 03 08:41:42 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5c42db2-3908-4878-8547-26f40b76e130]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:41:42 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-b3cd4aa4-0f48-4e7d-91e5-3c5dd274d6a6 tempest-VolumesSnapshotTestJSON-561529062 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c073db67-acb0-46be-8945-65f8938b3575 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:41:43 devstack sudo[103246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c073db67-acb0-46be-8945-65f8938b3575 Aug 03 08:41:43 devstack sudo[103246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:41:43 devstack sudo[103233]: pam_unix(sudo:session): session closed for user root Aug 03 08:41:43 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-06a5634f-1e49-47df-9dc9-54fa50b64537 tempest-TestInstancesWithCinderVolumes-1639155420 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-4c98b2e5-cbce-462d-9175-448b45b0470b" returned: 0 in 0.989s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:41:43 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-06a5634f-1e49-47df-9dc9-54fa50b64537 tempest-TestInstancesWithCinderVolumes-1639155420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-4c98b2e5-cbce-462d-9175-448b45b0470b {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:41:43 devstack sudo[103252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-4c98b2e5-cbce-462d-9175-448b45b0470b Aug 03 08:41:43 devstack sudo[103252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:41:44 devstack sudo[103252]: pam_unix(sudo:session): session closed for user root Aug 03 08:41:44 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-06a5634f-1e49-47df-9dc9-54fa50b64537 tempest-TestInstancesWithCinderVolumes-1639155420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-4c98b2e5-cbce-462d-9175-448b45b0470b" returned: 0 in 0.546s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:41:44 devstack sudo[103246]: pam_unix(sudo:session): session closed for user root Aug 03 08:41:44 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-b3cd4aa4-0f48-4e7d-91e5-3c5dd274d6a6 tempest-VolumesSnapshotTestJSON-561529062 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c073db67-acb0-46be-8945-65f8938b3575" returned: 0 in 1.249s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:41:44 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-b3cd4aa4-0f48-4e7d-91e5-3c5dd274d6a6 tempest-VolumesSnapshotTestJSON-561529062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c073db67-acb0-46be-8945-65f8938b3575.891ebb26-a193-42f0-acd4-3734c162d2f8 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:41:44 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-06a5634f-1e49-47df-9dc9-54fa50b64537 tempest-TestInstancesWithCinderVolumes-1639155420 None] Lock "cinder-quobyte-4c98b2e5-cbce-462d-9175-448b45b0470b" released by "delete_volume" :: held 1.634s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:41:44 devstack sudo[103258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c073db67-acb0-46be-8945-65f8938b3575.891ebb26-a193-42f0-acd4-3734c162d2f8 Aug 03 08:41:44 devstack sudo[103258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:41:44 devstack cinder-volume[88899]: WARNING cinder.quota [None req-06a5634f-1e49-47df-9dc9-54fa50b64537 tempest-TestInstancesWithCinderVolumes-1639155420 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1267884582-894251143 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1267884582-894251143, it is now deprecated. Please use the default quota class for default quota. Aug 03 08:41:44 devstack cinder-volume[88899]: WARNING cinder.quota [None req-06a5634f-1e49-47df-9dc9-54fa50b64537 tempest-TestInstancesWithCinderVolumes-1639155420 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1267884582-894251143 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1267884582-894251143, it is now deprecated. Please use the default quota class for default quota. Aug 03 08:41:44 devstack cinder-volume[88899]: DEBUG cinder.quota [None req-06a5634f-1e49-47df-9dc9-54fa50b64537 tempest-TestInstancesWithCinderVolumes-1639155420 None] Created reservations ['1ca0475f-160d-4d0a-b3cf-7c5e1076fe45', '195073d6-ca6e-49ed-a686-b8e1072bc018', 'f6d212dd-26a9-4106-9044-f7529ee9e95d', '6e90e802-c979-4d4c-b843-55844ef7d122'] {{(pid=88899) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 08:41:44 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-06a5634f-1e49-47df-9dc9-54fa50b64537 tempest-TestInstancesWithCinderVolumes-1639155420 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:41:44 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-06a5634f-1e49-47df-9dc9-54fa50b64537 tempest-TestInstancesWithCinderVolumes-1639155420 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:41:44 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-06a5634f-1e49-47df-9dc9-54fa50b64537 tempest-TestInstancesWithCinderVolumes-1639155420 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:41:44 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-06a5634f-1e49-47df-9dc9-54fa50b64537 tempest-TestInstancesWithCinderVolumes-1639155420 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:41:44 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-06a5634f-1e49-47df-9dc9-54fa50b64537 tempest-TestInstancesWithCinderVolumes-1639155420 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:41:44 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-06a5634f-1e49-47df-9dc9-54fa50b64537 tempest-TestInstancesWithCinderVolumes-1639155420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:41:44 devstack sudo[103260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a Aug 03 08:41:44 devstack sudo[103260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:41:44 devstack sudo[103260]: pam_unix(sudo:session): session closed for user root Aug 03 08:41:44 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-06a5634f-1e49-47df-9dc9-54fa50b64537 tempest-TestInstancesWithCinderVolumes-1639155420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a" returned: 0 in 0.405s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:41:44 devstack cinder-volume[88899]: DEBUG cinder.manager [None req-06a5634f-1e49-47df-9dc9-54fa50b64537 tempest-TestInstancesWithCinderVolumes-1639155420 None] Notifying Schedulers of capabilities ... {{(pid=88899) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 08:41:45 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-06a5634f-1e49-47df-9dc9-54fa50b64537 tempest-TestInstancesWithCinderVolumes-1639155420 None] Deleted volume successfully. Aug 03 08:41:45 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-06a5634f-1e49-47df-9dc9-54fa50b64537 tempest-TestInstancesWithCinderVolumes-1639155420 None] Lock "cinder-4c98b2e5-cbce-462d-9175-448b45b0470b-delete_volume" released by "delete_volume" :: held 2.589s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:41:45 devstack sudo[103258]: pam_unix(sudo:session): session closed for user root Aug 03 08:41:45 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-b3cd4aa4-0f48-4e7d-91e5-3c5dd274d6a6 tempest-VolumesSnapshotTestJSON-561529062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c073db67-acb0-46be-8945-65f8938b3575.891ebb26-a193-42f0-acd4-3734c162d2f8" returned: 0 in 1.061s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:41:45 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-b3cd4aa4-0f48-4e7d-91e5-3c5dd274d6a6 tempest-VolumesSnapshotTestJSON-561529062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c073db67-acb0-46be-8945-65f8938b3575.891ebb26-a193-42f0-acd4-3734c162d2f8 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:41:45 devstack sudo[103266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c073db67-acb0-46be-8945-65f8938b3575.891ebb26-a193-42f0-acd4-3734c162d2f8 Aug 03 08:41:45 devstack sudo[103266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:41:45 devstack sudo[103266]: pam_unix(sudo:session): session closed for user root Aug 03 08:41:45 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-b3cd4aa4-0f48-4e7d-91e5-3c5dd274d6a6 tempest-VolumesSnapshotTestJSON-561529062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c073db67-acb0-46be-8945-65f8938b3575.891ebb26-a193-42f0-acd4-3734c162d2f8" returned: 0 in 0.575s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:41:45 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-b3cd4aa4-0f48-4e7d-91e5-3c5dd274d6a6 tempest-VolumesSnapshotTestJSON-561529062 None] Lock "cinder-quobyte-891ebb26-a193-42f0-acd4-3734c162d2f8" released by "_delete_snapshot" :: held 3.547s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:41:45 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-b3cd4aa4-0f48-4e7d-91e5-3c5dd274d6a6 tempest-VolumesSnapshotTestJSON-561529062 None] Lock "cinder-quobyte-c073db67-acb0-46be-8945-65f8938b3575" released by "delete_snapshot" :: held 3.597s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:41:46 devstack cinder-volume[88899]: DEBUG cinder.quota [None req-b3cd4aa4-0f48-4e7d-91e5-3c5dd274d6a6 tempest-VolumesSnapshotTestJSON-561529062 None] Created reservations ['70ffb030-0e19-4f80-a95e-ba925a1579f1', '5bc7de20-c0e9-4fb6-88ef-101f0792acd7', 'd45ba9a3-e635-4365-ad56-5ef7b65f5fa2', '21255bf9-183f-4d3a-9d09-7402d0fb5fbb'] {{(pid=88899) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 08:41:46 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-b3cd4aa4-0f48-4e7d-91e5-3c5dd274d6a6 tempest-VolumesSnapshotTestJSON-561529062 None] Delete snapshot completed successfully. Aug 03 08:41:46 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-b3cd4aa4-0f48-4e7d-91e5-3c5dd274d6a6 tempest-VolumesSnapshotTestJSON-561529062 None] Lock "cinder-891ebb26-a193-42f0-acd4-3734c162d2f8-delete_snapshot" released by "delete_snapshot" :: held 4.006s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:41:46 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-b2cf768e-d80a-4d74-bb75-8d05b10e7a41 tempest-VolumesSnapshotTestJSON-561529062 None] Acquiring lock "cinder-c073db67-acb0-46be-8945-65f8938b3575-delete_volume" by "delete_volume" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:41:47 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-b2cf768e-d80a-4d74-bb75-8d05b10e7a41 tempest-VolumesSnapshotTestJSON-561529062 None] Lock "cinder-c073db67-acb0-46be-8945-65f8938b3575-delete_volume" acquired by "delete_volume" :: waited 0.057s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:41:47 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-b2cf768e-d80a-4d74-bb75-8d05b10e7a41 tempest-VolumesSnapshotTestJSON-561529062 None] Acquiring lock "cinder-quobyte-c073db67-acb0-46be-8945-65f8938b3575" by "delete_volume" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:41:47 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-b2cf768e-d80a-4d74-bb75-8d05b10e7a41 tempest-VolumesSnapshotTestJSON-561529062 None] Lock "cinder-quobyte-c073db67-acb0-46be-8945-65f8938b3575" acquired by "delete_volume" :: waited 0.041s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:41:47 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[d71bcfe1-4fbb-45d7-808e-386c1deb7b5d]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:41:47 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-b2cf768e-d80a-4d74-bb75-8d05b10e7a41 tempest-VolumesSnapshotTestJSON-561529062 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c073db67-acb0-46be-8945-65f8938b3575 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:41:47 devstack sudo[103269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c073db67-acb0-46be-8945-65f8938b3575 Aug 03 08:41:47 devstack sudo[103269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:41:47 devstack sudo[103222]: pam_unix(sudo:session): session closed for user root Aug 03 08:41:47 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-473d2973-bfc1-423e-8240-1c7fad7a89d5 tempest-SnapshotDataIntegrityTests-1494076589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-6bafdd19-6d59-4557-a0e3-17d1fbfc1053.ef70e01c-7a59-4ac6-a705-f98e01473350 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-3f28a481-fd0c-4bd1-a9f3-ab47e3526b07" returned: 0 in 5.862s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:41:47 devstack cinder-volume[88899]: DEBUG cinder.image.image_utils [None req-473d2973-bfc1-423e-8240-1c7fad7a89d5 tempest-SnapshotDataIntegrityTests-1494076589 None] Image conversion details: src /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-6bafdd19-6d59-4557-a0e3-17d1fbfc1053.ef70e01c-7a59-4ac6-a705-f98e01473350, size 1024.00 MB, duration 5.86 sec, destination /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-3f28a481-fd0c-4bd1-a9f3-ab47e3526b07 {{(pid=88899) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 03 08:41:47 devstack cinder-volume[88899]: INFO cinder.image.image_utils [None req-473d2973-bfc1-423e-8240-1c7fad7a89d5 tempest-SnapshotDataIntegrityTests-1494076589 None] Converted 1024.00 MB image at 174.65 MB/s Aug 03 08:41:47 devstack cinder-volume[88899]: WARNING cinder.volume.drivers.remotefs [None req-473d2973-bfc1-423e-8240-1c7fad7a89d5 tempest-SnapshotDataIntegrityTests-1494076589 None] /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-3f28a481-fd0c-4bd1-a9f3-ab47e3526b07 is being set with open permissions: ugo+rw Aug 03 08:41:47 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-473d2973-bfc1-423e-8240-1c7fad7a89d5 tempest-SnapshotDataIntegrityTests-1494076589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-3f28a481-fd0c-4bd1-a9f3-ab47e3526b07 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:41:47 devstack sudo[103271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-3f28a481-fd0c-4bd1-a9f3-ab47e3526b07 Aug 03 08:41:47 devstack sudo[103271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:41:47 devstack sudo[103269]: pam_unix(sudo:session): session closed for user root Aug 03 08:41:47 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-b2cf768e-d80a-4d74-bb75-8d05b10e7a41 tempest-VolumesSnapshotTestJSON-561529062 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c073db67-acb0-46be-8945-65f8938b3575" returned: 0 in 0.476s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:41:47 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-b2cf768e-d80a-4d74-bb75-8d05b10e7a41 tempest-VolumesSnapshotTestJSON-561529062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c073db67-acb0-46be-8945-65f8938b3575 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:41:47 devstack sudo[103271]: pam_unix(sudo:session): session closed for user root Aug 03 08:41:47 devstack sudo[103277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c073db67-acb0-46be-8945-65f8938b3575 Aug 03 08:41:47 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-473d2973-bfc1-423e-8240-1c7fad7a89d5 tempest-SnapshotDataIntegrityTests-1494076589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-3f28a481-fd0c-4bd1-a9f3-ab47e3526b07" returned: 0 in 0.273s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:41:47 devstack sudo[103277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:41:47 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-473d2973-bfc1-423e-8240-1c7fad7a89d5 tempest-SnapshotDataIntegrityTests-1494076589 None] Lock "cinder-quobyte-3f28a481-fd0c-4bd1-a9f3-ab47e3526b07" released by "_copy_volume_from_snapshot" :: held 7.295s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:41:47 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-473d2973-bfc1-423e-8240-1c7fad7a89d5 tempest-SnapshotDataIntegrityTests-1494076589 None] Lock "cinder-quobyte-dc60c96a-b480-4727-9d7c-db679775347c-3f28a481-fd0c-4bd1-a9f3-ab47e3526b07" released by "_create_volume_from_snapshot" :: held 7.390s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:41:47 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-473d2973-bfc1-423e-8240-1c7fad7a89d5 tempest-SnapshotDataIntegrityTests-1494076589 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.417s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:41:47 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-8b5e78ac-1bf2-4c7d-b51c-93dc85f17dd5 tempest-VolumesTransfersTest-1472630776 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.547s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:41:47 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-8b5e78ac-1bf2-4c7d-b51c-93dc85f17dd5 tempest-VolumesTransfersTest-1472630776 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:41:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-244353549',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b055a791-e7ce-4b60-a2a0-f1863bf5a182,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c8df4d6f49d4b848d62b5a3367bf468',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:41:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:41:38Z,use_quota=True,user_id='0a806fec176740fd8b3f6a8b48e35d2c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8bde7129-1dc4-42ab-b852-ab32c61b4921),volume_type_id=8bde7129-1dc4-42ab-b852-ab32c61b4921)}" {{(pid=88899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 08:41:47 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-8b5e78ac-1bf2-4c7d-b51c-93dc85f17dd5 tempest-VolumesTransfersTest-1472630776 None] Creating volume b055a791-e7ce-4b60-a2a0-f1863bf5a182 {{(pid=88899) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 08:41:47 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-8b5e78ac-1bf2-4c7d-b51c-93dc85f17dd5 tempest-VolumesTransfersTest-1472630776 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:41:47 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-8b5e78ac-1bf2-4c7d-b51c-93dc85f17dd5 tempest-VolumesTransfersTest-1472630776 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:41:47 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-8b5e78ac-1bf2-4c7d-b51c-93dc85f17dd5 tempest-VolumesTransfersTest-1472630776 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:41:47 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-8b5e78ac-1bf2-4c7d-b51c-93dc85f17dd5 tempest-VolumesTransfersTest-1472630776 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:41:47 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-8b5e78ac-1bf2-4c7d-b51c-93dc85f17dd5 tempest-VolumesTransfersTest-1472630776 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:41:47 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-8b5e78ac-1bf2-4c7d-b51c-93dc85f17dd5 tempest-VolumesTransfersTest-1472630776 None] Selected osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385 as target Quobyte volume. {{(pid=88899) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 08:41:47 devstack cinder-volume[88899]: INFO cinder.volume.drivers.remotefs [None req-8b5e78ac-1bf2-4c7d-b51c-93dc85f17dd5 tempest-VolumesTransfersTest-1472630776 None] casted to osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385 Aug 03 08:41:47 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-8b5e78ac-1bf2-4c7d-b51c-93dc85f17dd5 tempest-VolumesTransfersTest-1472630776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-b055a791-e7ce-4b60-a2a0-f1863bf5a182 1073741824 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:41:47 devstack sudo[103279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-b055a791-e7ce-4b60-a2a0-f1863bf5a182 1073741824 Aug 03 08:41:47 devstack sudo[103279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:41:47 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-473d2973-bfc1-423e-8240-1c7fad7a89d5 tempest-SnapshotDataIntegrityTests-1494076589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (73bd7d14-da14-4907-9e6b-8c86de4aa31a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3f28a481-fd0c-4bd1-a9f3-ab47e3526b07', 'volume_size': 1, 'snapshot_id': 'dc60c96a-b480-4727-9d7c-db679775347c'}' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:41:47 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-473d2973-bfc1-423e-8240-1c7fad7a89d5 tempest-SnapshotDataIntegrityTests-1494076589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad5ea2ba-4735-4b2f-b111-3610e37f1f6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:41:48 devstack cinder-volume[88899]: INFO cinder.volume.flows.manager.create_volume [None req-473d2973-bfc1-423e-8240-1c7fad7a89d5 tempest-SnapshotDataIntegrityTests-1494076589 None] Volume volume-3f28a481-fd0c-4bd1-a9f3-ab47e3526b07 (3f28a481-fd0c-4bd1-a9f3-ab47e3526b07): created successfully Aug 03 08:41:48 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-473d2973-bfc1-423e-8240-1c7fad7a89d5 tempest-SnapshotDataIntegrityTests-1494076589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad5ea2ba-4735-4b2f-b111-3610e37f1f6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:41:48 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-473d2973-bfc1-423e-8240-1c7fad7a89d5 tempest-SnapshotDataIntegrityTests-1494076589 None] Flow 'volume_create_manager' (93b4a84d-be42-4697-98f0-d1bc9860e337) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:41:48 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-473d2973-bfc1-423e-8240-1c7fad7a89d5 tempest-SnapshotDataIntegrityTests-1494076589 None] Created volume successfully. Aug 03 08:41:48 devstack sudo[103277]: pam_unix(sudo:session): session closed for user root Aug 03 08:41:48 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-b2cf768e-d80a-4d74-bb75-8d05b10e7a41 tempest-VolumesSnapshotTestJSON-561529062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c073db67-acb0-46be-8945-65f8938b3575" returned: 0 in 0.374s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:41:48 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-b2cf768e-d80a-4d74-bb75-8d05b10e7a41 tempest-VolumesSnapshotTestJSON-561529062 None] Lock "cinder-quobyte-c073db67-acb0-46be-8945-65f8938b3575" released by "delete_volume" :: held 0.981s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:41:48 devstack cinder-volume[88899]: DEBUG cinder.quota [None req-b2cf768e-d80a-4d74-bb75-8d05b10e7a41 tempest-VolumesSnapshotTestJSON-561529062 None] Created reservations ['745b75f3-1143-4c4d-a34b-ee520b802f4d', 'bad4622d-fdca-4caf-b3e8-8aab2847b98f', 'cf5ad58a-ab3e-47d5-bb35-2aadf68bad47', '68c93e1a-2671-49c1-8680-1cafba6663b2'] {{(pid=88899) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 08:41:48 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-b2cf768e-d80a-4d74-bb75-8d05b10e7a41 tempest-VolumesSnapshotTestJSON-561529062 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:41:48 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-b2cf768e-d80a-4d74-bb75-8d05b10e7a41 tempest-VolumesSnapshotTestJSON-561529062 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:41:48 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-b2cf768e-d80a-4d74-bb75-8d05b10e7a41 tempest-VolumesSnapshotTestJSON-561529062 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:41:48 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-b2cf768e-d80a-4d74-bb75-8d05b10e7a41 tempest-VolumesSnapshotTestJSON-561529062 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:41:48 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-b2cf768e-d80a-4d74-bb75-8d05b10e7a41 tempest-VolumesSnapshotTestJSON-561529062 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:41:48 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-b2cf768e-d80a-4d74-bb75-8d05b10e7a41 tempest-VolumesSnapshotTestJSON-561529062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:41:48 devstack sudo[103288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a Aug 03 08:41:48 devstack sudo[103288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:41:48 devstack sudo[103279]: pam_unix(sudo:session): session closed for user root Aug 03 08:41:48 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-8b5e78ac-1bf2-4c7d-b51c-93dc85f17dd5 tempest-VolumesTransfersTest-1472630776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-b055a791-e7ce-4b60-a2a0-f1863bf5a182 1073741824" returned: 0 in 0.668s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:41:48 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-8b5e78ac-1bf2-4c7d-b51c-93dc85f17dd5 tempest-VolumesTransfersTest-1472630776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-b055a791-e7ce-4b60-a2a0-f1863bf5a182 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:41:48 devstack sudo[103294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-b055a791-e7ce-4b60-a2a0-f1863bf5a182 Aug 03 08:41:48 devstack sudo[103294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:41:48 devstack sudo[103288]: pam_unix(sudo:session): session closed for user root Aug 03 08:41:48 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-b2cf768e-d80a-4d74-bb75-8d05b10e7a41 tempest-VolumesSnapshotTestJSON-561529062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a" returned: 0 in 0.347s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:41:48 devstack cinder-volume[88899]: DEBUG cinder.manager [None req-b2cf768e-d80a-4d74-bb75-8d05b10e7a41 tempest-VolumesSnapshotTestJSON-561529062 None] Notifying Schedulers of capabilities ... {{(pid=88899) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 08:41:48 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-b2cf768e-d80a-4d74-bb75-8d05b10e7a41 tempest-VolumesSnapshotTestJSON-561529062 None] Deleted volume successfully. Aug 03 08:41:48 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-b2cf768e-d80a-4d74-bb75-8d05b10e7a41 tempest-VolumesSnapshotTestJSON-561529062 None] Lock "cinder-c073db67-acb0-46be-8945-65f8938b3575-delete_volume" released by "delete_volume" :: held 1.757s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:41:48 devstack sudo[103294]: pam_unix(sudo:session): session closed for user root Aug 03 08:41:48 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-8b5e78ac-1bf2-4c7d-b51c-93dc85f17dd5 tempest-VolumesTransfersTest-1472630776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-b055a791-e7ce-4b60-a2a0-f1863bf5a182" returned: 0 in 0.303s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:41:48 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-8b5e78ac-1bf2-4c7d-b51c-93dc85f17dd5 tempest-VolumesTransfersTest-1472630776 None] <== create_volume: return (1030ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'} {{(pid=88899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 08:41:48 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-8b5e78ac-1bf2-4c7d-b51c-93dc85f17dd5 tempest-VolumesTransfersTest-1472630776 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.033s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:41:48 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-8b5e78ac-1bf2-4c7d-b51c-93dc85f17dd5 tempest-VolumesTransfersTest-1472630776 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d274b71-781c-4eca-8c60-31bc3d1875fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b055a791-e7ce-4b60-a2a0-f1863bf5a182', 'volume_size': 1}' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:41:48 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-8b5e78ac-1bf2-4c7d-b51c-93dc85f17dd5 tempest-VolumesTransfersTest-1472630776 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60800ebe-9651-4bf9-acda-257f0faf9001) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:41:49 devstack cinder-volume[88899]: INFO cinder.volume.flows.manager.create_volume [None req-8b5e78ac-1bf2-4c7d-b51c-93dc85f17dd5 tempest-VolumesTransfersTest-1472630776 None] Volume volume-b055a791-e7ce-4b60-a2a0-f1863bf5a182 (b055a791-e7ce-4b60-a2a0-f1863bf5a182): created successfully Aug 03 08:41:49 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-8b5e78ac-1bf2-4c7d-b51c-93dc85f17dd5 tempest-VolumesTransfersTest-1472630776 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60800ebe-9651-4bf9-acda-257f0faf9001) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:41:49 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-8b5e78ac-1bf2-4c7d-b51c-93dc85f17dd5 tempest-VolumesTransfersTest-1472630776 None] Flow 'volume_create_manager' (53189c5a-fc15-4959-b5a3-acc56ca4ece3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:41:49 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-8b5e78ac-1bf2-4c7d-b51c-93dc85f17dd5 tempest-VolumesTransfersTest-1472630776 None] Created volume successfully. Aug 03 08:41:49 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [req-6142397a-5fc0-45c7-b845-fd27c55ef84f req-fa83f29d-9c82-4921-8351-04e2714cd5ba tempest-SnapshotDataIntegrityTests-1494076589 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:41:49 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [req-6142397a-5fc0-45c7-b845-fd27c55ef84f req-fa83f29d-9c82-4921-8351-04e2714cd5ba tempest-SnapshotDataIntegrityTests-1494076589 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:41:49 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [req-6142397a-5fc0-45c7-b845-fd27c55ef84f req-fa83f29d-9c82-4921-8351-04e2714cd5ba tempest-SnapshotDataIntegrityTests-1494076589 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.016s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:41:49 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [req-6142397a-5fc0-45c7-b845-fd27c55ef84f req-fa83f29d-9c82-4921-8351-04e2714cd5ba tempest-SnapshotDataIntegrityTests-1494076589 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385', 'name': 'volume-3f28a481-fd0c-4bd1-a9f3-ab47e3526b07', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '1371eac9-0281-439c-94ff-fed7223232a2', 'enforce_multipath': True} {{(pid=88899) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 03 08:41:49 devstack cinder-volume[88899]: INFO cinder.volume.manager [req-6142397a-5fc0-45c7-b845-fd27c55ef84f req-fa83f29d-9c82-4921-8351-04e2714cd5ba tempest-SnapshotDataIntegrityTests-1494076589 None] attachment_update completed successfully. Aug 03 08:41:49 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-25a15d36-0e4f-4051-b057-9aba0536bdb1 tempest-VolumesTransfersTest-1183163314 None] Acquiring lock "cinder-b055a791-e7ce-4b60-a2a0-f1863bf5a182-delete_volume" by "delete_volume" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:41:50 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-25a15d36-0e4f-4051-b057-9aba0536bdb1 tempest-VolumesTransfersTest-1183163314 None] Lock "cinder-b055a791-e7ce-4b60-a2a0-f1863bf5a182-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:41:50 devstack cinder-volume[88899]: DEBUG cinder.volume.flows.manager.create_volume [None req-d7934a25-cd12-4331-8f38-23ad9ce5c55d tempest-VolumesSnapshotTestJSON-561529062 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88899) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 08:41:50 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-d7934a25-cd12-4331-8f38-23ad9ce5c55d tempest-VolumesSnapshotTestJSON-561529062 None] Flow 'volume_create_manager' (26461824-7d7f-4f4f-a921-362831dc18d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:41:50 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-d7934a25-cd12-4331-8f38-23ad9ce5c55d tempest-VolumesSnapshotTestJSON-561529062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88297353-49a7-4458-b8b8-6e5499b77a9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:41:50 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-25a15d36-0e4f-4051-b057-9aba0536bdb1 tempest-VolumesTransfersTest-1183163314 None] Acquiring lock "cinder-quobyte-b055a791-e7ce-4b60-a2a0-f1863bf5a182" by "delete_volume" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:41:50 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-d7934a25-cd12-4331-8f38-23ad9ce5c55d tempest-VolumesSnapshotTestJSON-561529062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88297353-49a7-4458-b8b8-6e5499b77a9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:41:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-2098558747',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=55080d4b-cfd5-4bbb-afe1-98e6b08b61c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6aadf5593f7c43d59bf60392e0f4bf5d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:41:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:41:50Z,use_quota=True,user_id='527c161cc21048f0a677fee8087ea52a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8bde7129-1dc4-42ab-b852-ab32c61b4921),volume_type_id=8bde7129-1dc4-42ab-b852-ab32c61b4921)' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:41:50 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-d7934a25-cd12-4331-8f38-23ad9ce5c55d tempest-VolumesSnapshotTestJSON-561529062 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac2f2dec-cb50-4413-b258-37b52f5629b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:41:50 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-d7934a25-cd12-4331-8f38-23ad9ce5c55d tempest-VolumesSnapshotTestJSON-561529062 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac2f2dec-cb50-4413-b258-37b52f5629b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:41:50 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-d7934a25-cd12-4331-8f38-23ad9ce5c55d tempest-VolumesSnapshotTestJSON-561529062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d1702224-745a-429e-bbb0-438d899cca7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:41:50 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-d7934a25-cd12-4331-8f38-23ad9ce5c55d tempest-VolumesSnapshotTestJSON-561529062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d1702224-745a-429e-bbb0-438d899cca7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '55080d4b-cfd5-4bbb-afe1-98e6b08b61c4', 'volume_name': 'volume-55080d4b-cfd5-4bbb-afe1-98e6b08b61c4', 'volume_size': 1}' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:41:50 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-d7934a25-cd12-4331-8f38-23ad9ce5c55d tempest-VolumesSnapshotTestJSON-561529062 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c22bfc16-a711-4bbd-83ec-243aa35c0267) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:41:50 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-d7934a25-cd12-4331-8f38-23ad9ce5c55d tempest-VolumesSnapshotTestJSON-561529062 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c22bfc16-a711-4bbd-83ec-243aa35c0267) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:41:50 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-d7934a25-cd12-4331-8f38-23ad9ce5c55d tempest-VolumesSnapshotTestJSON-561529062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8eb6fec8-3b1b-4eb8-929f-155e9b17b794) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:41:50 devstack cinder-volume[88899]: INFO cinder.volume.flows.manager.create_volume [None req-d7934a25-cd12-4331-8f38-23ad9ce5c55d tempest-VolumesSnapshotTestJSON-561529062 None] Volume 55080d4b-cfd5-4bbb-afe1-98e6b08b61c4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-55080d4b-cfd5-4bbb-afe1-98e6b08b61c4', 'volume_size': 1} Aug 03 08:41:50 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-d7934a25-cd12-4331-8f38-23ad9ce5c55d tempest-VolumesSnapshotTestJSON-561529062 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:41:50 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-d7934a25-cd12-4331-8f38-23ad9ce5c55d tempest-VolumesSnapshotTestJSON-561529062 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:41:50 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-d7934a25-cd12-4331-8f38-23ad9ce5c55d tempest-VolumesSnapshotTestJSON-561529062 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:41:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-2098558747',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=55080d4b-cfd5-4bbb-afe1-98e6b08b61c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6aadf5593f7c43d59bf60392e0f4bf5d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:41:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:41:50Z,use_quota=True,user_id='527c161cc21048f0a677fee8087ea52a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8bde7129-1dc4-42ab-b852-ab32c61b4921),volume_type_id=8bde7129-1dc4-42ab-b852-ab32c61b4921)}" {{(pid=88899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 08:41:50 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-d7934a25-cd12-4331-8f38-23ad9ce5c55d tempest-VolumesSnapshotTestJSON-561529062 None] Creating volume 55080d4b-cfd5-4bbb-afe1-98e6b08b61c4 {{(pid=88899) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 08:41:50 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-d7934a25-cd12-4331-8f38-23ad9ce5c55d tempest-VolumesSnapshotTestJSON-561529062 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:41:50 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-d7934a25-cd12-4331-8f38-23ad9ce5c55d tempest-VolumesSnapshotTestJSON-561529062 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:41:50 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-d7934a25-cd12-4331-8f38-23ad9ce5c55d tempest-VolumesSnapshotTestJSON-561529062 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:41:50 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-d7934a25-cd12-4331-8f38-23ad9ce5c55d tempest-VolumesSnapshotTestJSON-561529062 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:41:50 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-d7934a25-cd12-4331-8f38-23ad9ce5c55d tempest-VolumesSnapshotTestJSON-561529062 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:41:50 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-d7934a25-cd12-4331-8f38-23ad9ce5c55d tempest-VolumesSnapshotTestJSON-561529062 None] Selected osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385 as target Quobyte volume. {{(pid=88899) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 08:41:50 devstack cinder-volume[88899]: INFO cinder.volume.drivers.remotefs [None req-d7934a25-cd12-4331-8f38-23ad9ce5c55d tempest-VolumesSnapshotTestJSON-561529062 None] casted to osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385 Aug 03 08:41:50 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-d7934a25-cd12-4331-8f38-23ad9ce5c55d tempest-VolumesSnapshotTestJSON-561529062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-55080d4b-cfd5-4bbb-afe1-98e6b08b61c4 1073741824 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:41:50 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-25a15d36-0e4f-4051-b057-9aba0536bdb1 tempest-VolumesTransfersTest-1183163314 None] Lock "cinder-quobyte-b055a791-e7ce-4b60-a2a0-f1863bf5a182" acquired by "delete_volume" :: waited 0.100s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:41:50 devstack sudo[103691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-55080d4b-cfd5-4bbb-afe1-98e6b08b61c4 1073741824 Aug 03 08:41:50 devstack sudo[103691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:41:50 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ed0a2e2-b55c-499c-876b-f8ddf5781f97]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:41:50 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-25a15d36-0e4f-4051-b057-9aba0536bdb1 tempest-VolumesTransfersTest-1183163314 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-b055a791-e7ce-4b60-a2a0-f1863bf5a182 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:41:50 devstack sudo[103695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-b055a791-e7ce-4b60-a2a0-f1863bf5a182 Aug 03 08:41:50 devstack sudo[103695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:41:50 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-25a15d36-0e4f-4051-b057-9aba0536bdb1 tempest-VolumesTransfersTest-1183163314 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-b055a791-e7ce-4b60-a2a0-f1863bf5a182" returned: 0 in 0.619s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:41:50 devstack sudo[103695]: pam_unix(sudo:session): session closed for user root Aug 03 08:41:50 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-25a15d36-0e4f-4051-b057-9aba0536bdb1 tempest-VolumesTransfersTest-1183163314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-b055a791-e7ce-4b60-a2a0-f1863bf5a182 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:41:51 devstack sudo[103710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-b055a791-e7ce-4b60-a2a0-f1863bf5a182 Aug 03 08:41:51 devstack sudo[103710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:41:51 devstack sudo[103691]: pam_unix(sudo:session): session closed for user root Aug 03 08:41:51 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-d7934a25-cd12-4331-8f38-23ad9ce5c55d tempest-VolumesSnapshotTestJSON-561529062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-55080d4b-cfd5-4bbb-afe1-98e6b08b61c4 1073741824" returned: 0 in 0.862s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:41:51 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-d7934a25-cd12-4331-8f38-23ad9ce5c55d tempest-VolumesSnapshotTestJSON-561529062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-55080d4b-cfd5-4bbb-afe1-98e6b08b61c4 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:41:51 devstack sudo[103714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-55080d4b-cfd5-4bbb-afe1-98e6b08b61c4 Aug 03 08:41:51 devstack sudo[103714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:41:51 devstack sudo[103710]: pam_unix(sudo:session): session closed for user root Aug 03 08:41:51 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-25a15d36-0e4f-4051-b057-9aba0536bdb1 tempest-VolumesTransfersTest-1183163314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-b055a791-e7ce-4b60-a2a0-f1863bf5a182" returned: 0 in 0.422s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:41:51 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-25a15d36-0e4f-4051-b057-9aba0536bdb1 tempest-VolumesTransfersTest-1183163314 None] Lock "cinder-quobyte-b055a791-e7ce-4b60-a2a0-f1863bf5a182" released by "delete_volume" :: held 1.151s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:41:51 devstack cinder-volume[88899]: DEBUG cinder.quota [None req-25a15d36-0e4f-4051-b057-9aba0536bdb1 tempest-VolumesTransfersTest-1183163314 None] Created reservations ['76eba746-8e0a-4140-bd47-8a758dc0aad5', 'f9362d00-4445-4148-9000-4ca49006878d', '065a2665-dada-4550-900d-c463c1da99d2', '4ae80d2a-4da1-4292-8fe7-e75c4fd1a4ab'] {{(pid=88899) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 08:41:51 devstack sudo[103714]: pam_unix(sudo:session): session closed for user root Aug 03 08:41:51 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-d7934a25-cd12-4331-8f38-23ad9ce5c55d tempest-VolumesSnapshotTestJSON-561529062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-55080d4b-cfd5-4bbb-afe1-98e6b08b61c4" returned: 0 in 0.350s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:41:51 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-d7934a25-cd12-4331-8f38-23ad9ce5c55d tempest-VolumesSnapshotTestJSON-561529062 None] <== create_volume: return (1272ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'} {{(pid=88899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 08:41:51 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-d7934a25-cd12-4331-8f38-23ad9ce5c55d tempest-VolumesSnapshotTestJSON-561529062 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.275s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:41:51 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-d7934a25-cd12-4331-8f38-23ad9ce5c55d tempest-VolumesSnapshotTestJSON-561529062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8eb6fec8-3b1b-4eb8-929f-155e9b17b794) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-55080d4b-cfd5-4bbb-afe1-98e6b08b61c4', 'volume_size': 1}' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:41:51 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-d7934a25-cd12-4331-8f38-23ad9ce5c55d tempest-VolumesSnapshotTestJSON-561529062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f17709df-1b2b-4f76-843d-9ca32aae3655) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:41:51 devstack cinder-volume[88899]: INFO cinder.volume.flows.manager.create_volume [None req-d7934a25-cd12-4331-8f38-23ad9ce5c55d tempest-VolumesSnapshotTestJSON-561529062 None] Volume volume-55080d4b-cfd5-4bbb-afe1-98e6b08b61c4 (55080d4b-cfd5-4bbb-afe1-98e6b08b61c4): created successfully Aug 03 08:41:51 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-d7934a25-cd12-4331-8f38-23ad9ce5c55d tempest-VolumesSnapshotTestJSON-561529062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f17709df-1b2b-4f76-843d-9ca32aae3655) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:41:51 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-d7934a25-cd12-4331-8f38-23ad9ce5c55d tempest-VolumesSnapshotTestJSON-561529062 None] Flow 'volume_create_manager' (26461824-7d7f-4f4f-a921-362831dc18d8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:41:51 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-d7934a25-cd12-4331-8f38-23ad9ce5c55d tempest-VolumesSnapshotTestJSON-561529062 None] Created volume successfully. Aug 03 08:41:51 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-25a15d36-0e4f-4051-b057-9aba0536bdb1 tempest-VolumesTransfersTest-1183163314 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:41:51 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-25a15d36-0e4f-4051-b057-9aba0536bdb1 tempest-VolumesTransfersTest-1183163314 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:41:51 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-25a15d36-0e4f-4051-b057-9aba0536bdb1 tempest-VolumesTransfersTest-1183163314 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:41:51 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-25a15d36-0e4f-4051-b057-9aba0536bdb1 tempest-VolumesTransfersTest-1183163314 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:41:51 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-25a15d36-0e4f-4051-b057-9aba0536bdb1 tempest-VolumesTransfersTest-1183163314 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:41:51 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-25a15d36-0e4f-4051-b057-9aba0536bdb1 tempest-VolumesTransfersTest-1183163314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:41:51 devstack sudo[103723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a Aug 03 08:41:51 devstack sudo[103723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:41:51 devstack sudo[103723]: pam_unix(sudo:session): session closed for user root Aug 03 08:41:51 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-25a15d36-0e4f-4051-b057-9aba0536bdb1 tempest-VolumesTransfersTest-1183163314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a" returned: 0 in 0.276s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:41:51 devstack cinder-volume[88899]: DEBUG cinder.manager [None req-25a15d36-0e4f-4051-b057-9aba0536bdb1 tempest-VolumesTransfersTest-1183163314 None] Notifying Schedulers of capabilities ... {{(pid=88899) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 08:41:51 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-25a15d36-0e4f-4051-b057-9aba0536bdb1 tempest-VolumesTransfersTest-1183163314 None] Deleted volume successfully. Aug 03 08:41:51 devstack cinder-volume[88899]: DEBUG oslo_service.periodic_task [None req-f948fb4a-c4d7-499f-b1bd-8d6be3de0b53 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88899) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 03 08:41:51 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-f948fb4a-c4d7-499f-b1bd-8d6be3de0b53 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:41:51 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-f948fb4a-c4d7-499f-b1bd-8d6be3de0b53 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:41:51 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-f948fb4a-c4d7-499f-b1bd-8d6be3de0b53 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:41:51 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-f948fb4a-c4d7-499f-b1bd-8d6be3de0b53 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:41:51 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-f948fb4a-c4d7-499f-b1bd-8d6be3de0b53 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:41:51 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-f948fb4a-c4d7-499f-b1bd-8d6be3de0b53 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:41:51 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-25a15d36-0e4f-4051-b057-9aba0536bdb1 tempest-VolumesTransfersTest-1183163314 None] Lock "cinder-b055a791-e7ce-4b60-a2a0-f1863bf5a182-delete_volume" released by "delete_volume" :: held 1.932s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:41:51 devstack sudo[103732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a Aug 03 08:41:51 devstack sudo[103732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:41:52 devstack sudo[103732]: pam_unix(sudo:session): session closed for user root Aug 03 08:41:52 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-f948fb4a-c4d7-499f-b1bd-8d6be3de0b53 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a" returned: 0 in 0.412s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:41:52 devstack cinder-volume[88899]: DEBUG cinder.manager [None req-f948fb4a-c4d7-499f-b1bd-8d6be3de0b53 None None] Notifying Schedulers of capabilities ... {{(pid=88899) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 08:41:52 devstack cinder-volume[88899]: DEBUG oslo_service.periodic_task [None req-f948fb4a-c4d7-499f-b1bd-8d6be3de0b53 None None] Running periodic task VolumeManager._thread_info {{(pid=88899) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 03 08:41:52 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-f948fb4a-c4d7-499f-b1bd-8d6be3de0b53 None None] thread count: 28 {{(pid=88899) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 03 08:41:52 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-f948fb4a-c4d7-499f-b1bd-8d6be3de0b53 None None] thread info: [<_MainThread(MainThread, started 132234320248960)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88899) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 03 08:41:52 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-2a83c38a-149e-48e7-a497-e42798a9e12d tempest-VolumesSnapshotTestJSON-561529062 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:41:52 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-2a83c38a-149e-48e7-a497-e42798a9e12d tempest-VolumesSnapshotTestJSON-561529062 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:41:52 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-2a83c38a-149e-48e7-a497-e42798a9e12d tempest-VolumesSnapshotTestJSON-561529062 None] Creating offline snapshot a72840a6-8012-4314-9e1a-ca69b1b03111 of volume 55080d4b-cfd5-4bbb-afe1-98e6b08b61c4 {{(pid=88899) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 03 08:41:52 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[4009a9a8-1506-4c2e-a104-1786623ae905]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:41:52 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-2a83c38a-149e-48e7-a497-e42798a9e12d tempest-VolumesSnapshotTestJSON-561529062 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-55080d4b-cfd5-4bbb-afe1-98e6b08b61c4 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:41:52 devstack sudo[103746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-55080d4b-cfd5-4bbb-afe1-98e6b08b61c4 Aug 03 08:41:52 devstack sudo[103746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:41:52 devstack sudo[103746]: pam_unix(sudo:session): session closed for user root Aug 03 08:41:52 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-2a83c38a-149e-48e7-a497-e42798a9e12d tempest-VolumesSnapshotTestJSON-561529062 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-55080d4b-cfd5-4bbb-afe1-98e6b08b61c4" returned: 0 in 0.461s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:41:52 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-2a83c38a-149e-48e7-a497-e42798a9e12d tempest-VolumesSnapshotTestJSON-561529062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-55080d4b-cfd5-4bbb-afe1-98e6b08b61c4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-55080d4b-cfd5-4bbb-afe1-98e6b08b61c4.a72840a6-8012-4314-9e1a-ca69b1b03111 1G {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:41:53 devstack sudo[103753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-55080d4b-cfd5-4bbb-afe1-98e6b08b61c4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-55080d4b-cfd5-4bbb-afe1-98e6b08b61c4.a72840a6-8012-4314-9e1a-ca69b1b03111 1G Aug 03 08:41:53 devstack sudo[103753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:41:53 devstack sudo[103753]: pam_unix(sudo:session): session closed for user root Aug 03 08:41:53 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-2a83c38a-149e-48e7-a497-e42798a9e12d tempest-VolumesSnapshotTestJSON-561529062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-55080d4b-cfd5-4bbb-afe1-98e6b08b61c4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-55080d4b-cfd5-4bbb-afe1-98e6b08b61c4.a72840a6-8012-4314-9e1a-ca69b1b03111 1G" returned: 0 in 0.630s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:41:53 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-2a83c38a-149e-48e7-a497-e42798a9e12d tempest-VolumesSnapshotTestJSON-561529062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-55080d4b-cfd5-4bbb-afe1-98e6b08b61c4 -F qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-55080d4b-cfd5-4bbb-afe1-98e6b08b61c4.a72840a6-8012-4314-9e1a-ca69b1b03111 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:41:53 devstack sudo[103762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-55080d4b-cfd5-4bbb-afe1-98e6b08b61c4 -F qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-55080d4b-cfd5-4bbb-afe1-98e6b08b61c4.a72840a6-8012-4314-9e1a-ca69b1b03111 Aug 03 08:41:53 devstack sudo[103762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:41:53 devstack cinder-volume[88899]: INFO cinder.volume.manager [req-7ebfd471-d4e4-4522-9adc-4ca8f29cfc53 req-6985ca45-8f1b-42d3-954f-1e03b0961848 tempest-SnapshotDataIntegrityTests-1494076589 None] Terminate volume connection completed successfully. Aug 03 08:41:53 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [req-7ebfd471-d4e4-4522-9adc-4ca8f29cfc53 req-6985ca45-8f1b-42d3-954f-1e03b0961848 tempest-SnapshotDataIntegrityTests-1494076589 None] Deleting attachment 1371eac9-0281-439c-94ff-fed7223232a2. {{(pid=88899) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 03 08:41:53 devstack sudo[103762]: pam_unix(sudo:session): session closed for user root Aug 03 08:41:54 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-2a83c38a-149e-48e7-a497-e42798a9e12d tempest-VolumesSnapshotTestJSON-561529062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-55080d4b-cfd5-4bbb-afe1-98e6b08b61c4 -F qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-55080d4b-cfd5-4bbb-afe1-98e6b08b61c4.a72840a6-8012-4314-9e1a-ca69b1b03111" returned: 0 in 0.387s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:41:54 devstack cinder-volume[88899]: WARNING cinder.volume.drivers.remotefs [None req-2a83c38a-149e-48e7-a497-e42798a9e12d tempest-VolumesSnapshotTestJSON-561529062 None] /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-55080d4b-cfd5-4bbb-afe1-98e6b08b61c4.a72840a6-8012-4314-9e1a-ca69b1b03111 is being set with open permissions: ugo+rw Aug 03 08:41:54 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-2a83c38a-149e-48e7-a497-e42798a9e12d tempest-VolumesSnapshotTestJSON-561529062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-55080d4b-cfd5-4bbb-afe1-98e6b08b61c4.a72840a6-8012-4314-9e1a-ca69b1b03111 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:41:54 devstack sudo[103794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-55080d4b-cfd5-4bbb-afe1-98e6b08b61c4.a72840a6-8012-4314-9e1a-ca69b1b03111 Aug 03 08:41:54 devstack sudo[103794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:41:54 devstack sudo[103794]: pam_unix(sudo:session): session closed for user root Aug 03 08:41:54 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-2a83c38a-149e-48e7-a497-e42798a9e12d tempest-VolumesSnapshotTestJSON-561529062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-55080d4b-cfd5-4bbb-afe1-98e6b08b61c4.a72840a6-8012-4314-9e1a-ca69b1b03111" returned: 0 in 0.376s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:41:54 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-2a83c38a-149e-48e7-a497-e42798a9e12d tempest-VolumesSnapshotTestJSON-561529062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-55080d4b-cfd5-4bbb-afe1-98e6b08b61c4.info {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:41:54 devstack sudo[103798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-55080d4b-cfd5-4bbb-afe1-98e6b08b61c4.info Aug 03 08:41:54 devstack sudo[103798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:41:54 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-502c3ffa-c079-48c9-a509-f5b59a9048d1 tempest-SnapshotDataIntegrityTests-1494076589 None] Acquiring lock "cinder-3f28a481-fd0c-4bd1-a9f3-ab47e3526b07-delete_volume" by "delete_volume" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:41:54 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-502c3ffa-c079-48c9-a509-f5b59a9048d1 tempest-SnapshotDataIntegrityTests-1494076589 None] Lock "cinder-3f28a481-fd0c-4bd1-a9f3-ab47e3526b07-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:41:54 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-502c3ffa-c079-48c9-a509-f5b59a9048d1 tempest-SnapshotDataIntegrityTests-1494076589 None] Acquiring lock "cinder-quobyte-3f28a481-fd0c-4bd1-a9f3-ab47e3526b07" by "delete_volume" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:41:54 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-502c3ffa-c079-48c9-a509-f5b59a9048d1 tempest-SnapshotDataIntegrityTests-1494076589 None] Lock "cinder-quobyte-3f28a481-fd0c-4bd1-a9f3-ab47e3526b07" acquired by "delete_volume" :: waited 0.017s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:41:54 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[49829592-83c9-44f4-8d78-b02ea20019c8]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:41:54 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-502c3ffa-c079-48c9-a509-f5b59a9048d1 tempest-SnapshotDataIntegrityTests-1494076589 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-3f28a481-fd0c-4bd1-a9f3-ab47e3526b07 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:41:54 devstack sudo[103798]: pam_unix(sudo:session): session closed for user root Aug 03 08:41:54 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-2a83c38a-149e-48e7-a497-e42798a9e12d tempest-VolumesSnapshotTestJSON-561529062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-55080d4b-cfd5-4bbb-afe1-98e6b08b61c4.info" returned: 0 in 0.321s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:41:54 devstack cinder-volume[88899]: WARNING cinder.volume.drivers.remotefs [None req-2a83c38a-149e-48e7-a497-e42798a9e12d tempest-VolumesSnapshotTestJSON-561529062 None] /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-55080d4b-cfd5-4bbb-afe1-98e6b08b61c4.info is being set with open permissions: ugo+rw Aug 03 08:41:54 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-2a83c38a-149e-48e7-a497-e42798a9e12d tempest-VolumesSnapshotTestJSON-561529062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-55080d4b-cfd5-4bbb-afe1-98e6b08b61c4.info {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:41:54 devstack sudo[103802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-55080d4b-cfd5-4bbb-afe1-98e6b08b61c4.info Aug 03 08:41:54 devstack sudo[103802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:41:54 devstack sudo[103801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-3f28a481-fd0c-4bd1-a9f3-ab47e3526b07 Aug 03 08:41:54 devstack sudo[103801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:41:55 devstack sudo[103802]: pam_unix(sudo:session): session closed for user root Aug 03 08:41:55 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-2a83c38a-149e-48e7-a497-e42798a9e12d tempest-VolumesSnapshotTestJSON-561529062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-55080d4b-cfd5-4bbb-afe1-98e6b08b61c4.info" returned: 0 in 0.401s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:41:55 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-2a83c38a-149e-48e7-a497-e42798a9e12d tempest-VolumesSnapshotTestJSON-561529062 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.709s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:41:55 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-2a83c38a-149e-48e7-a497-e42798a9e12d tempest-VolumesSnapshotTestJSON-561529062 None] Create snapshot completed successfully Aug 03 08:41:55 devstack sudo[103801]: pam_unix(sudo:session): session closed for user root Aug 03 08:41:55 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-502c3ffa-c079-48c9-a509-f5b59a9048d1 tempest-SnapshotDataIntegrityTests-1494076589 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-3f28a481-fd0c-4bd1-a9f3-ab47e3526b07" returned: 0 in 0.555s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:41:55 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-502c3ffa-c079-48c9-a509-f5b59a9048d1 tempest-SnapshotDataIntegrityTests-1494076589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-3f28a481-fd0c-4bd1-a9f3-ab47e3526b07 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:41:55 devstack sudo[103809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-3f28a481-fd0c-4bd1-a9f3-ab47e3526b07 Aug 03 08:41:55 devstack sudo[103809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:41:55 devstack sudo[103809]: pam_unix(sudo:session): session closed for user root Aug 03 08:41:55 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-502c3ffa-c079-48c9-a509-f5b59a9048d1 tempest-SnapshotDataIntegrityTests-1494076589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-3f28a481-fd0c-4bd1-a9f3-ab47e3526b07" returned: 0 in 0.294s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:41:55 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-502c3ffa-c079-48c9-a509-f5b59a9048d1 tempest-SnapshotDataIntegrityTests-1494076589 None] Lock "cinder-quobyte-3f28a481-fd0c-4bd1-a9f3-ab47e3526b07" released by "delete_volume" :: held 0.902s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:41:55 devstack cinder-volume[88899]: DEBUG cinder.quota [None req-502c3ffa-c079-48c9-a509-f5b59a9048d1 tempest-SnapshotDataIntegrityTests-1494076589 None] Created reservations ['7cc138d7-f8f5-4ec1-a759-af2a79f1e877', 'd117b543-7ceb-4ec1-8f8b-02402b9ae1a1', 'b1ace2e1-01af-4ee5-9ea6-e0a58d6d3c0b', '4ecdccb0-0e96-42d3-b075-8775457bd3a8'] {{(pid=88899) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 08:41:55 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-502c3ffa-c079-48c9-a509-f5b59a9048d1 tempest-SnapshotDataIntegrityTests-1494076589 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:41:55 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-502c3ffa-c079-48c9-a509-f5b59a9048d1 tempest-SnapshotDataIntegrityTests-1494076589 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:41:55 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-502c3ffa-c079-48c9-a509-f5b59a9048d1 tempest-SnapshotDataIntegrityTests-1494076589 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:41:55 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-502c3ffa-c079-48c9-a509-f5b59a9048d1 tempest-SnapshotDataIntegrityTests-1494076589 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:41:55 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-502c3ffa-c079-48c9-a509-f5b59a9048d1 tempest-SnapshotDataIntegrityTests-1494076589 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:41:55 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-502c3ffa-c079-48c9-a509-f5b59a9048d1 tempest-SnapshotDataIntegrityTests-1494076589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:41:55 devstack sudo[103812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a Aug 03 08:41:55 devstack sudo[103812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:41:56 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-d29403d1-0060-4e7a-aaa6-4caa566e4f9b tempest-SnapshotDataIntegrityTests-1494076589 None] Acquiring lock "cinder-1454300a-671f-43ed-b381-beb1ed81c411-delete_volume" by "delete_volume" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:41:56 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-d29403d1-0060-4e7a-aaa6-4caa566e4f9b tempest-SnapshotDataIntegrityTests-1494076589 None] Lock "cinder-1454300a-671f-43ed-b381-beb1ed81c411-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:41:56 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-d29403d1-0060-4e7a-aaa6-4caa566e4f9b tempest-SnapshotDataIntegrityTests-1494076589 None] Acquiring lock "cinder-quobyte-1454300a-671f-43ed-b381-beb1ed81c411" by "delete_volume" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:41:56 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-d29403d1-0060-4e7a-aaa6-4caa566e4f9b tempest-SnapshotDataIntegrityTests-1494076589 None] Lock "cinder-quobyte-1454300a-671f-43ed-b381-beb1ed81c411" acquired by "delete_volume" :: waited 0.024s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:41:56 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[54b8677c-511a-4efc-9fc9-da867232340c]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:41:56 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-d29403d1-0060-4e7a-aaa6-4caa566e4f9b tempest-SnapshotDataIntegrityTests-1494076589 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-1454300a-671f-43ed-b381-beb1ed81c411 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:41:56 devstack sudo[103812]: pam_unix(sudo:session): session closed for user root Aug 03 08:41:56 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-502c3ffa-c079-48c9-a509-f5b59a9048d1 tempest-SnapshotDataIntegrityTests-1494076589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a" returned: 0 in 0.479s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:41:56 devstack cinder-volume[88899]: DEBUG cinder.manager [None req-502c3ffa-c079-48c9-a509-f5b59a9048d1 tempest-SnapshotDataIntegrityTests-1494076589 None] Notifying Schedulers of capabilities ... {{(pid=88899) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 08:41:56 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-502c3ffa-c079-48c9-a509-f5b59a9048d1 tempest-SnapshotDataIntegrityTests-1494076589 None] Deleted volume successfully. Aug 03 08:41:56 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-502c3ffa-c079-48c9-a509-f5b59a9048d1 tempest-SnapshotDataIntegrityTests-1494076589 None] Lock "cinder-3f28a481-fd0c-4bd1-a9f3-ab47e3526b07-delete_volume" released by "delete_volume" :: held 1.794s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:41:56 devstack sudo[103815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-1454300a-671f-43ed-b381-beb1ed81c411 Aug 03 08:41:56 devstack sudo[103815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:41:56 devstack cinder-volume[88899]: DEBUG cinder.volume.flows.manager.create_volume [None req-f4d377ba-6f97-46bc-ad77-8c5389dddd08 tempest-VolumesSnapshotTestJSON-561529062 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88899) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 08:41:56 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-f4d377ba-6f97-46bc-ad77-8c5389dddd08 tempest-VolumesSnapshotTestJSON-561529062 None] Flow 'volume_create_manager' (164fd76b-d3a1-49eb-9996-10994a58de16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:41:56 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-f4d377ba-6f97-46bc-ad77-8c5389dddd08 tempest-VolumesSnapshotTestJSON-561529062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (30db82fc-95ba-424a-9419-0ef831a33a1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:41:56 devstack sudo[103815]: pam_unix(sudo:session): session closed for user root Aug 03 08:41:56 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-f4d377ba-6f97-46bc-ad77-8c5389dddd08 tempest-VolumesSnapshotTestJSON-561529062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (30db82fc-95ba-424a-9419-0ef831a33a1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:41:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1580261191',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aaaaf2bc-140f-4ba4-8329-e78e548aa21b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6aadf5593f7c43d59bf60392e0f4bf5d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:41:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=a72840a6-8012-4314-9e1a-ca69b1b03111,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:41:57Z,use_quota=True,user_id='527c161cc21048f0a677fee8087ea52a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8bde7129-1dc4-42ab-b852-ab32c61b4921),volume_type_id=8bde7129-1dc4-42ab-b852-ab32c61b4921)' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:41:56 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-f4d377ba-6f97-46bc-ad77-8c5389dddd08 tempest-VolumesSnapshotTestJSON-561529062 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a84608d-0a29-44ca-af32-311d101b53fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:41:56 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-f4d377ba-6f97-46bc-ad77-8c5389dddd08 tempest-VolumesSnapshotTestJSON-561529062 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a84608d-0a29-44ca-af32-311d101b53fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:41:56 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-f4d377ba-6f97-46bc-ad77-8c5389dddd08 tempest-VolumesSnapshotTestJSON-561529062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a754bd80-d216-4b74-a6e4-87be62a9c6ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:41:56 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-f4d377ba-6f97-46bc-ad77-8c5389dddd08 tempest-VolumesSnapshotTestJSON-561529062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a754bd80-d216-4b74-a6e4-87be62a9c6ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'aaaaf2bc-140f-4ba4-8329-e78e548aa21b', 'volume_name': 'volume-aaaaf2bc-140f-4ba4-8329-e78e548aa21b', 'volume_size': 1, 'snapshot_id': 'a72840a6-8012-4314-9e1a-ca69b1b03111'}' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:41:56 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-f4d377ba-6f97-46bc-ad77-8c5389dddd08 tempest-VolumesSnapshotTestJSON-561529062 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e48883d-9e35-463a-afc6-6ed53ac4f49d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:41:56 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-f4d377ba-6f97-46bc-ad77-8c5389dddd08 tempest-VolumesSnapshotTestJSON-561529062 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e48883d-9e35-463a-afc6-6ed53ac4f49d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:41:56 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-f4d377ba-6f97-46bc-ad77-8c5389dddd08 tempest-VolumesSnapshotTestJSON-561529062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b5b4e65-cf7a-4761-99b5-3163ce40e2cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:41:56 devstack cinder-volume[88899]: INFO cinder.volume.flows.manager.create_volume [None req-f4d377ba-6f97-46bc-ad77-8c5389dddd08 tempest-VolumesSnapshotTestJSON-561529062 None] Volume aaaaf2bc-140f-4ba4-8329-e78e548aa21b: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-aaaaf2bc-140f-4ba4-8329-e78e548aa21b', 'volume_size': 1, 'snapshot_id': 'a72840a6-8012-4314-9e1a-ca69b1b03111'} Aug 03 08:41:56 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-d29403d1-0060-4e7a-aaa6-4caa566e4f9b tempest-SnapshotDataIntegrityTests-1494076589 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-1454300a-671f-43ed-b381-beb1ed81c411" returned: 0 in 0.636s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:41:56 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-d29403d1-0060-4e7a-aaa6-4caa566e4f9b tempest-SnapshotDataIntegrityTests-1494076589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-1454300a-671f-43ed-b381-beb1ed81c411 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:41:56 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-f4d377ba-6f97-46bc-ad77-8c5389dddd08 tempest-VolumesSnapshotTestJSON-561529062 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:41:56 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-f4d377ba-6f97-46bc-ad77-8c5389dddd08 tempest-VolumesSnapshotTestJSON-561529062 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:41:56 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-f4d377ba-6f97-46bc-ad77-8c5389dddd08 tempest-VolumesSnapshotTestJSON-561529062 None] Acquiring lock "cinder-quobyte-a72840a6-8012-4314-9e1a-ca69b1b03111-aaaaf2bc-140f-4ba4-8329-e78e548aa21b" by "_create_volume_from_snapshot" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:41:56 devstack sudo[103820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-1454300a-671f-43ed-b381-beb1ed81c411 Aug 03 08:41:56 devstack sudo[103820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:41:56 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-f4d377ba-6f97-46bc-ad77-8c5389dddd08 tempest-VolumesSnapshotTestJSON-561529062 None] Lock "cinder-quobyte-a72840a6-8012-4314-9e1a-ca69b1b03111-aaaaf2bc-140f-4ba4-8329-e78e548aa21b" acquired by "_create_volume_from_snapshot" :: waited 0.024s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:41:56 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-f4d377ba-6f97-46bc-ad77-8c5389dddd08 tempest-VolumesSnapshotTestJSON-561529062 None] Creating volume aaaaf2bc-140f-4ba4-8329-e78e548aa21b from snapshot a72840a6-8012-4314-9e1a-ca69b1b03111 {{(pid=88899) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Aug 03 08:41:56 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-f4d377ba-6f97-46bc-ad77-8c5389dddd08 tempest-VolumesSnapshotTestJSON-561529062 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:41:56 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-f4d377ba-6f97-46bc-ad77-8c5389dddd08 tempest-VolumesSnapshotTestJSON-561529062 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:41:56 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-f4d377ba-6f97-46bc-ad77-8c5389dddd08 tempest-VolumesSnapshotTestJSON-561529062 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:41:56 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-f4d377ba-6f97-46bc-ad77-8c5389dddd08 tempest-VolumesSnapshotTestJSON-561529062 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:41:56 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-f4d377ba-6f97-46bc-ad77-8c5389dddd08 tempest-VolumesSnapshotTestJSON-561529062 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:41:56 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-f4d377ba-6f97-46bc-ad77-8c5389dddd08 tempest-VolumesSnapshotTestJSON-561529062 None] Selected osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385 as target Quobyte volume. {{(pid=88899) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 08:41:56 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-f4d377ba-6f97-46bc-ad77-8c5389dddd08 tempest-VolumesSnapshotTestJSON-561529062 None] Acquiring lock "cinder-quobyte-aaaaf2bc-140f-4ba4-8329-e78e548aa21b" by "_copy_volume_from_snapshot" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:41:56 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-f4d377ba-6f97-46bc-ad77-8c5389dddd08 tempest-VolumesSnapshotTestJSON-561529062 None] Lock "cinder-quobyte-aaaaf2bc-140f-4ba4-8329-e78e548aa21b" acquired by "_copy_volume_from_snapshot" :: waited 0.035s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:41:56 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-f4d377ba-6f97-46bc-ad77-8c5389dddd08 tempest-VolumesSnapshotTestJSON-561529062 None] snapshot: a72840a6-8012-4314-9e1a-ca69b1b03111, volume: aaaaf2bc-140f-4ba4-8329-e78e548aa21b, {{(pid=88899) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Aug 03 08:41:57 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-f4d377ba-6f97-46bc-ad77-8c5389dddd08 tempest-VolumesSnapshotTestJSON-561529062 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:41:57 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-f4d377ba-6f97-46bc-ad77-8c5389dddd08 tempest-VolumesSnapshotTestJSON-561529062 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:41:57 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-f4d377ba-6f97-46bc-ad77-8c5389dddd08 tempest-VolumesSnapshotTestJSON-561529062 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:41:57 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-f4d377ba-6f97-46bc-ad77-8c5389dddd08 tempest-VolumesSnapshotTestJSON-561529062 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:41:57 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-f4d377ba-6f97-46bc-ad77-8c5389dddd08 tempest-VolumesSnapshotTestJSON-561529062 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:41:57 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[675ddb3b-be25-45dc-ac81-ad2e759b7ada]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:41:57 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-f4d377ba-6f97-46bc-ad77-8c5389dddd08 tempest-VolumesSnapshotTestJSON-561529062 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-55080d4b-cfd5-4bbb-afe1-98e6b08b61c4.a72840a6-8012-4314-9e1a-ca69b1b03111 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:41:57 devstack sudo[103822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-55080d4b-cfd5-4bbb-afe1-98e6b08b61c4.a72840a6-8012-4314-9e1a-ca69b1b03111 Aug 03 08:41:57 devstack sudo[103822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:41:57 devstack sudo[103820]: pam_unix(sudo:session): session closed for user root Aug 03 08:41:57 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-d29403d1-0060-4e7a-aaa6-4caa566e4f9b tempest-SnapshotDataIntegrityTests-1494076589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-1454300a-671f-43ed-b381-beb1ed81c411" returned: 0 in 0.370s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:41:57 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-d29403d1-0060-4e7a-aaa6-4caa566e4f9b tempest-SnapshotDataIntegrityTests-1494076589 None] Lock "cinder-quobyte-1454300a-671f-43ed-b381-beb1ed81c411" released by "delete_volume" :: held 1.083s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:41:57 devstack cinder-volume[88899]: DEBUG cinder.quota [None req-d29403d1-0060-4e7a-aaa6-4caa566e4f9b tempest-SnapshotDataIntegrityTests-1494076589 None] Created reservations ['05cdf566-f356-4e65-bf30-68f0f7c2ff9b', '29d7aee8-e7e0-4c1f-b54b-e2543a5e6b93', '69b1c86c-dcae-4ce8-8957-067c3169e37b', '3a06aba7-1699-4d76-9dfe-701a84733270'] {{(pid=88899) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 08:41:57 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-d29403d1-0060-4e7a-aaa6-4caa566e4f9b tempest-SnapshotDataIntegrityTests-1494076589 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:41:57 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-d29403d1-0060-4e7a-aaa6-4caa566e4f9b tempest-SnapshotDataIntegrityTests-1494076589 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:41:57 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-d29403d1-0060-4e7a-aaa6-4caa566e4f9b tempest-SnapshotDataIntegrityTests-1494076589 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:41:57 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-d29403d1-0060-4e7a-aaa6-4caa566e4f9b tempest-SnapshotDataIntegrityTests-1494076589 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:41:57 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-d29403d1-0060-4e7a-aaa6-4caa566e4f9b tempest-SnapshotDataIntegrityTests-1494076589 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:41:57 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-d29403d1-0060-4e7a-aaa6-4caa566e4f9b tempest-SnapshotDataIntegrityTests-1494076589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:41:57 devstack sudo[103825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a Aug 03 08:41:57 devstack sudo[103825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:41:57 devstack sudo[103822]: pam_unix(sudo:session): session closed for user root Aug 03 08:41:57 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-f4d377ba-6f97-46bc-ad77-8c5389dddd08 tempest-VolumesSnapshotTestJSON-561529062 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-55080d4b-cfd5-4bbb-afe1-98e6b08b61c4.a72840a6-8012-4314-9e1a-ca69b1b03111" returned: 0 in 0.503s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:41:57 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-f4d377ba-6f97-46bc-ad77-8c5389dddd08 tempest-VolumesSnapshotTestJSON-561529062 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-55080d4b-cfd5-4bbb-afe1-98e6b08b61c4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88899) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 03 08:41:57 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[43dce399-8a0f-4b32-bf07-227b1339fd2a]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:41:57 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-f4d377ba-6f97-46bc-ad77-8c5389dddd08 tempest-VolumesSnapshotTestJSON-561529062 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-55080d4b-cfd5-4bbb-afe1-98e6b08b61c4 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:41:57 devstack sudo[103825]: pam_unix(sudo:session): session closed for user root Aug 03 08:41:57 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-d29403d1-0060-4e7a-aaa6-4caa566e4f9b tempest-SnapshotDataIntegrityTests-1494076589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a" returned: 0 in 0.302s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:41:57 devstack cinder-volume[88899]: DEBUG cinder.manager [None req-d29403d1-0060-4e7a-aaa6-4caa566e4f9b tempest-SnapshotDataIntegrityTests-1494076589 None] Notifying Schedulers of capabilities ... {{(pid=88899) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 08:41:57 devstack sudo[103832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-55080d4b-cfd5-4bbb-afe1-98e6b08b61c4 Aug 03 08:41:57 devstack sudo[103832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:41:57 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-d29403d1-0060-4e7a-aaa6-4caa566e4f9b tempest-SnapshotDataIntegrityTests-1494076589 None] Deleted volume successfully. Aug 03 08:41:57 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-d29403d1-0060-4e7a-aaa6-4caa566e4f9b tempest-SnapshotDataIntegrityTests-1494076589 None] Lock "cinder-1454300a-671f-43ed-b381-beb1ed81c411-delete_volume" released by "delete_volume" :: held 1.737s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:41:58 devstack sudo[103832]: pam_unix(sudo:session): session closed for user root Aug 03 08:41:58 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-f4d377ba-6f97-46bc-ad77-8c5389dddd08 tempest-VolumesSnapshotTestJSON-561529062 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-55080d4b-cfd5-4bbb-afe1-98e6b08b61c4" returned: 0 in 0.604s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:41:58 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-f4d377ba-6f97-46bc-ad77-8c5389dddd08 tempest-VolumesSnapshotTestJSON-561529062 None] will copy from snapshot at /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-55080d4b-cfd5-4bbb-afe1-98e6b08b61c4 {{(pid=88899) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Aug 03 08:41:58 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-f4d377ba-6f97-46bc-ad77-8c5389dddd08 tempest-VolumesSnapshotTestJSON-561529062 None] Creating direct copy from snapshot {{(pid=88899) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Aug 03 08:41:58 devstack cinder-volume[88899]: DEBUG cinder.utils [None req-f4d377ba-6f97-46bc-ad77-8c5389dddd08 tempest-VolumesSnapshotTestJSON-561529062 None] Path /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-aaaaf2bc-140f-4ba4-8329-e78e548aa21b not found in is_blk_device check {{(pid=88899) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Aug 03 08:41:58 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-f4d377ba-6f97-46bc-ad77-8c5389dddd08 tempest-VolumesSnapshotTestJSON-561529062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-55080d4b-cfd5-4bbb-afe1-98e6b08b61c4 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-aaaaf2bc-140f-4ba4-8329-e78e548aa21b {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:41:58 devstack sudo[103840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-55080d4b-cfd5-4bbb-afe1-98e6b08b61c4 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-aaaaf2bc-140f-4ba4-8329-e78e548aa21b Aug 03 08:41:58 devstack sudo[103840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:41:58 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-72cc0e15-3966-4b39-abdb-aae0c4770652 tempest-SnapshotDataIntegrityTests-1494076589 None] Acquiring lock "cinder-6ee47f81-8d6d-4795-9014-8b0f37bd3d78-delete_volume" by "delete_volume" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:41:58 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-72cc0e15-3966-4b39-abdb-aae0c4770652 tempest-SnapshotDataIntegrityTests-1494076589 None] Lock "cinder-6ee47f81-8d6d-4795-9014-8b0f37bd3d78-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:41:58 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-72cc0e15-3966-4b39-abdb-aae0c4770652 tempest-SnapshotDataIntegrityTests-1494076589 None] Acquiring lock "cinder-quobyte-6ee47f81-8d6d-4795-9014-8b0f37bd3d78" by "delete_volume" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:41:58 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-72cc0e15-3966-4b39-abdb-aae0c4770652 tempest-SnapshotDataIntegrityTests-1494076589 None] Lock "cinder-quobyte-6ee47f81-8d6d-4795-9014-8b0f37bd3d78" acquired by "delete_volume" :: waited 0.032s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:41:58 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5e24c7f-34c1-4679-a747-a02fd7e28a04]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:41:58 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-72cc0e15-3966-4b39-abdb-aae0c4770652 tempest-SnapshotDataIntegrityTests-1494076589 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-6ee47f81-8d6d-4795-9014-8b0f37bd3d78 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:41:58 devstack sudo[103881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-6ee47f81-8d6d-4795-9014-8b0f37bd3d78 Aug 03 08:41:58 devstack sudo[103881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:41:59 devstack sudo[103881]: pam_unix(sudo:session): session closed for user root Aug 03 08:41:59 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-72cc0e15-3966-4b39-abdb-aae0c4770652 tempest-SnapshotDataIntegrityTests-1494076589 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-6ee47f81-8d6d-4795-9014-8b0f37bd3d78" returned: 0 in 0.962s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:41:59 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-72cc0e15-3966-4b39-abdb-aae0c4770652 tempest-SnapshotDataIntegrityTests-1494076589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-6ee47f81-8d6d-4795-9014-8b0f37bd3d78 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:41:59 devstack sudo[103893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-6ee47f81-8d6d-4795-9014-8b0f37bd3d78 Aug 03 08:41:59 devstack sudo[103893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:42:00 devstack sudo[103893]: pam_unix(sudo:session): session closed for user root Aug 03 08:42:00 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-72cc0e15-3966-4b39-abdb-aae0c4770652 tempest-SnapshotDataIntegrityTests-1494076589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-6ee47f81-8d6d-4795-9014-8b0f37bd3d78" returned: 0 in 0.737s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:42:00 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-72cc0e15-3966-4b39-abdb-aae0c4770652 tempest-SnapshotDataIntegrityTests-1494076589 None] Lock "cinder-quobyte-6ee47f81-8d6d-4795-9014-8b0f37bd3d78" released by "delete_volume" :: held 1.796s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:42:00 devstack cinder-volume[88899]: DEBUG cinder.quota [None req-72cc0e15-3966-4b39-abdb-aae0c4770652 tempest-SnapshotDataIntegrityTests-1494076589 None] Created reservations ['ff91be97-1079-43c1-9eff-8406884eef55', 'cf20b336-54c3-462a-8304-f83145f1bbc3', 'ba934488-18d6-464a-9715-8de696cda52e', 'd3563c74-adac-4318-8de9-07235b6b0643'] {{(pid=88899) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 08:42:00 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-72cc0e15-3966-4b39-abdb-aae0c4770652 tempest-SnapshotDataIntegrityTests-1494076589 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:42:00 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-72cc0e15-3966-4b39-abdb-aae0c4770652 tempest-SnapshotDataIntegrityTests-1494076589 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:42:00 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-72cc0e15-3966-4b39-abdb-aae0c4770652 tempest-SnapshotDataIntegrityTests-1494076589 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:42:00 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-72cc0e15-3966-4b39-abdb-aae0c4770652 tempest-SnapshotDataIntegrityTests-1494076589 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:42:00 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-72cc0e15-3966-4b39-abdb-aae0c4770652 tempest-SnapshotDataIntegrityTests-1494076589 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:42:00 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-72cc0e15-3966-4b39-abdb-aae0c4770652 tempest-SnapshotDataIntegrityTests-1494076589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:42:00 devstack sudo[103898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a Aug 03 08:42:00 devstack sudo[103898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:42:01 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-e707a498-d1b7-4aa7-a29b-b09e6e08a77a tempest-SnapshotDataIntegrityTests-1494076589 None] Acquiring lock "cinder-dc60c96a-b480-4727-9d7c-db679775347c-delete_snapshot" by "delete_snapshot" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:42:01 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-e707a498-d1b7-4aa7-a29b-b09e6e08a77a tempest-SnapshotDataIntegrityTests-1494076589 None] Lock "cinder-dc60c96a-b480-4727-9d7c-db679775347c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:42:01 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-e707a498-d1b7-4aa7-a29b-b09e6e08a77a tempest-SnapshotDataIntegrityTests-1494076589 None] Acquiring lock "cinder-quobyte-6bafdd19-6d59-4557-a0e3-17d1fbfc1053" by "delete_snapshot" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:42:01 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-e707a498-d1b7-4aa7-a29b-b09e6e08a77a tempest-SnapshotDataIntegrityTests-1494076589 None] Lock "cinder-quobyte-6bafdd19-6d59-4557-a0e3-17d1fbfc1053" acquired by "delete_snapshot" :: waited 0.024s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:42:01 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-e707a498-d1b7-4aa7-a29b-b09e6e08a77a tempest-SnapshotDataIntegrityTests-1494076589 None] Acquiring lock "cinder-quobyte-dc60c96a-b480-4727-9d7c-db679775347c" by "_delete_snapshot" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:42:01 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-e707a498-d1b7-4aa7-a29b-b09e6e08a77a tempest-SnapshotDataIntegrityTests-1494076589 None] Lock "cinder-quobyte-dc60c96a-b480-4727-9d7c-db679775347c" acquired by "_delete_snapshot" :: waited 0.041s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:42:01 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-e707a498-d1b7-4aa7-a29b-b09e6e08a77a tempest-SnapshotDataIntegrityTests-1494076589 None] Deleting offline snapshot dc60c96a-b480-4727-9d7c-db679775347c of volume 6bafdd19-6d59-4557-a0e3-17d1fbfc1053 {{(pid=88899) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 03 08:42:01 devstack sudo[103898]: pam_unix(sudo:session): session closed for user root Aug 03 08:42:01 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-e707a498-d1b7-4aa7-a29b-b09e6e08a77a tempest-SnapshotDataIntegrityTests-1494076589 None] snapshot_file for this snap is: volume-6bafdd19-6d59-4557-a0e3-17d1fbfc1053.dc60c96a-b480-4727-9d7c-db679775347c {{(pid=88899) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 03 08:42:01 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-72cc0e15-3966-4b39-abdb-aae0c4770652 tempest-SnapshotDataIntegrityTests-1494076589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a" returned: 0 in 0.530s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:42:01 devstack cinder-volume[88899]: DEBUG cinder.manager [None req-72cc0e15-3966-4b39-abdb-aae0c4770652 tempest-SnapshotDataIntegrityTests-1494076589 None] Notifying Schedulers of capabilities ... {{(pid=88899) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 08:42:01 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5beddca-5221-4e57-9585-d818c79a6f61]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:42:01 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-e707a498-d1b7-4aa7-a29b-b09e6e08a77a tempest-SnapshotDataIntegrityTests-1494076589 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-6bafdd19-6d59-4557-a0e3-17d1fbfc1053.dc60c96a-b480-4727-9d7c-db679775347c {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:42:01 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-72cc0e15-3966-4b39-abdb-aae0c4770652 tempest-SnapshotDataIntegrityTests-1494076589 None] Deleted volume successfully. Aug 03 08:42:01 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-72cc0e15-3966-4b39-abdb-aae0c4770652 tempest-SnapshotDataIntegrityTests-1494076589 None] Lock "cinder-6ee47f81-8d6d-4795-9014-8b0f37bd3d78-delete_volume" released by "delete_volume" :: held 2.864s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:42:01 devstack sudo[103901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-6bafdd19-6d59-4557-a0e3-17d1fbfc1053.dc60c96a-b480-4727-9d7c-db679775347c Aug 03 08:42:01 devstack sudo[103901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:42:02 devstack sudo[103901]: pam_unix(sudo:session): session closed for user root Aug 03 08:42:02 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-e707a498-d1b7-4aa7-a29b-b09e6e08a77a tempest-SnapshotDataIntegrityTests-1494076589 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-6bafdd19-6d59-4557-a0e3-17d1fbfc1053.dc60c96a-b480-4727-9d7c-db679775347c" returned: 0 in 0.831s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:42:02 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-e707a498-d1b7-4aa7-a29b-b09e6e08a77a tempest-SnapshotDataIntegrityTests-1494076589 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6bafdd19-6d59-4557-a0e3-17d1fbfc1053(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88899) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 03 08:42:02 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc9182de-a0f7-4028-adf5-d4f0fd310ebe]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:42:02 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-e707a498-d1b7-4aa7-a29b-b09e6e08a77a tempest-SnapshotDataIntegrityTests-1494076589 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-6bafdd19-6d59-4557-a0e3-17d1fbfc1053.ef70e01c-7a59-4ac6-a705-f98e01473350 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:42:02 devstack sudo[103906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-6bafdd19-6d59-4557-a0e3-17d1fbfc1053.ef70e01c-7a59-4ac6-a705-f98e01473350 Aug 03 08:42:02 devstack sudo[103906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:42:02 devstack sudo[103906]: pam_unix(sudo:session): session closed for user root Aug 03 08:42:02 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-e707a498-d1b7-4aa7-a29b-b09e6e08a77a tempest-SnapshotDataIntegrityTests-1494076589 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-6bafdd19-6d59-4557-a0e3-17d1fbfc1053.ef70e01c-7a59-4ac6-a705-f98e01473350" returned: 0 in 0.655s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:42:02 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-e707a498-d1b7-4aa7-a29b-b09e6e08a77a tempest-SnapshotDataIntegrityTests-1494076589 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6bafdd19-6d59-4557-a0e3-17d1fbfc1053(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88899) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 03 08:42:02 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-e707a498-d1b7-4aa7-a29b-b09e6e08a77a tempest-SnapshotDataIntegrityTests-1494076589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-6bafdd19-6d59-4557-a0e3-17d1fbfc1053.dc60c96a-b480-4727-9d7c-db679775347c {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:42:03 devstack sudo[103911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-6bafdd19-6d59-4557-a0e3-17d1fbfc1053.dc60c96a-b480-4727-9d7c-db679775347c Aug 03 08:42:03 devstack sudo[103911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:42:04 devstack sudo[103911]: pam_unix(sudo:session): session closed for user root Aug 03 08:42:04 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-e707a498-d1b7-4aa7-a29b-b09e6e08a77a tempest-SnapshotDataIntegrityTests-1494076589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-6bafdd19-6d59-4557-a0e3-17d1fbfc1053.dc60c96a-b480-4727-9d7c-db679775347c" returned: 0 in 1.196s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:42:04 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-e707a498-d1b7-4aa7-a29b-b09e6e08a77a tempest-SnapshotDataIntegrityTests-1494076589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-6bafdd19-6d59-4557-a0e3-17d1fbfc1053.dc60c96a-b480-4727-9d7c-db679775347c {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:42:04 devstack sudo[103917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-6bafdd19-6d59-4557-a0e3-17d1fbfc1053.dc60c96a-b480-4727-9d7c-db679775347c Aug 03 08:42:04 devstack sudo[103917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:42:04 devstack sudo[103840]: pam_unix(sudo:session): session closed for user root Aug 03 08:42:04 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-f4d377ba-6f97-46bc-ad77-8c5389dddd08 tempest-VolumesSnapshotTestJSON-561529062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-55080d4b-cfd5-4bbb-afe1-98e6b08b61c4 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-aaaaf2bc-140f-4ba4-8329-e78e548aa21b" returned: 0 in 6.558s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:42:04 devstack cinder-volume[88899]: DEBUG cinder.image.image_utils [None req-f4d377ba-6f97-46bc-ad77-8c5389dddd08 tempest-VolumesSnapshotTestJSON-561529062 None] Image conversion details: src /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-55080d4b-cfd5-4bbb-afe1-98e6b08b61c4, size 1024.00 MB, duration 6.56 sec, destination /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-aaaaf2bc-140f-4ba4-8329-e78e548aa21b {{(pid=88899) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 03 08:42:04 devstack cinder-volume[88899]: INFO cinder.image.image_utils [None req-f4d377ba-6f97-46bc-ad77-8c5389dddd08 tempest-VolumesSnapshotTestJSON-561529062 None] Converted 1024.00 MB image at 156.11 MB/s Aug 03 08:42:04 devstack cinder-volume[88899]: WARNING cinder.volume.drivers.remotefs [None req-f4d377ba-6f97-46bc-ad77-8c5389dddd08 tempest-VolumesSnapshotTestJSON-561529062 None] /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-aaaaf2bc-140f-4ba4-8329-e78e548aa21b is being set with open permissions: ugo+rw Aug 03 08:42:04 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-f4d377ba-6f97-46bc-ad77-8c5389dddd08 tempest-VolumesSnapshotTestJSON-561529062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-aaaaf2bc-140f-4ba4-8329-e78e548aa21b {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:42:04 devstack sudo[103921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-aaaaf2bc-140f-4ba4-8329-e78e548aa21b Aug 03 08:42:04 devstack sudo[103921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:42:04 devstack sudo[103917]: pam_unix(sudo:session): session closed for user root Aug 03 08:42:04 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-e707a498-d1b7-4aa7-a29b-b09e6e08a77a tempest-SnapshotDataIntegrityTests-1494076589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-6bafdd19-6d59-4557-a0e3-17d1fbfc1053.dc60c96a-b480-4727-9d7c-db679775347c" returned: 0 in 0.672s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:42:04 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-e707a498-d1b7-4aa7-a29b-b09e6e08a77a tempest-SnapshotDataIntegrityTests-1494076589 None] Lock "cinder-quobyte-dc60c96a-b480-4727-9d7c-db679775347c" released by "_delete_snapshot" :: held 3.607s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:42:04 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-e707a498-d1b7-4aa7-a29b-b09e6e08a77a tempest-SnapshotDataIntegrityTests-1494076589 None] Lock "cinder-quobyte-6bafdd19-6d59-4557-a0e3-17d1fbfc1053" released by "delete_snapshot" :: held 3.666s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:42:04 devstack cinder-volume[88899]: DEBUG cinder.quota [None req-e707a498-d1b7-4aa7-a29b-b09e6e08a77a tempest-SnapshotDataIntegrityTests-1494076589 None] Created reservations ['3a8f348f-e67c-4273-83da-c64f609c7a44', '91719ca3-d673-4b52-943c-4fe3f5cd08fb', 'ac3dbcdd-3968-4a7c-ac34-6440ef96d440', 'e279381a-274a-4f69-be03-89b6a7e24356'] {{(pid=88899) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 08:42:05 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-e707a498-d1b7-4aa7-a29b-b09e6e08a77a tempest-SnapshotDataIntegrityTests-1494076589 None] Delete snapshot completed successfully. Aug 03 08:42:05 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-e707a498-d1b7-4aa7-a29b-b09e6e08a77a tempest-SnapshotDataIntegrityTests-1494076589 None] Lock "cinder-dc60c96a-b480-4727-9d7c-db679775347c-delete_snapshot" released by "delete_snapshot" :: held 3.903s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:42:05 devstack sudo[103921]: pam_unix(sudo:session): session closed for user root Aug 03 08:42:05 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-f4d377ba-6f97-46bc-ad77-8c5389dddd08 tempest-VolumesSnapshotTestJSON-561529062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-aaaaf2bc-140f-4ba4-8329-e78e548aa21b" returned: 0 in 0.352s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:42:05 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-f4d377ba-6f97-46bc-ad77-8c5389dddd08 tempest-VolumesSnapshotTestJSON-561529062 None] Lock "cinder-quobyte-aaaaf2bc-140f-4ba4-8329-e78e548aa21b" released by "_copy_volume_from_snapshot" :: held 8.141s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:42:05 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-f4d377ba-6f97-46bc-ad77-8c5389dddd08 tempest-VolumesSnapshotTestJSON-561529062 None] Lock "cinder-quobyte-a72840a6-8012-4314-9e1a-ca69b1b03111-aaaaf2bc-140f-4ba4-8329-e78e548aa21b" released by "_create_volume_from_snapshot" :: held 8.237s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:42:05 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-f4d377ba-6f97-46bc-ad77-8c5389dddd08 tempest-VolumesSnapshotTestJSON-561529062 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.263s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:42:05 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-f4d377ba-6f97-46bc-ad77-8c5389dddd08 tempest-VolumesSnapshotTestJSON-561529062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b5b4e65-cf7a-4761-99b5-3163ce40e2cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aaaaf2bc-140f-4ba4-8329-e78e548aa21b', 'volume_size': 1, 'snapshot_id': 'a72840a6-8012-4314-9e1a-ca69b1b03111'}' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:42:05 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-f4d377ba-6f97-46bc-ad77-8c5389dddd08 tempest-VolumesSnapshotTestJSON-561529062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (72781a14-a54e-49a4-8c3d-e99c322e4c9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:42:05 devstack cinder-volume[88899]: INFO cinder.volume.flows.manager.create_volume [None req-f4d377ba-6f97-46bc-ad77-8c5389dddd08 tempest-VolumesSnapshotTestJSON-561529062 None] Volume volume-aaaaf2bc-140f-4ba4-8329-e78e548aa21b (aaaaf2bc-140f-4ba4-8329-e78e548aa21b): created successfully Aug 03 08:42:05 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-f4d377ba-6f97-46bc-ad77-8c5389dddd08 tempest-VolumesSnapshotTestJSON-561529062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (72781a14-a54e-49a4-8c3d-e99c322e4c9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:42:05 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-f4d377ba-6f97-46bc-ad77-8c5389dddd08 tempest-VolumesSnapshotTestJSON-561529062 None] Flow 'volume_create_manager' (164fd76b-d3a1-49eb-9996-10994a58de16) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:42:05 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-f4d377ba-6f97-46bc-ad77-8c5389dddd08 tempest-VolumesSnapshotTestJSON-561529062 None] Created volume successfully. Aug 03 08:42:05 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-91ef4aea-52ec-4564-9456-b6ae91eda508 tempest-SnapshotDataIntegrityTests-1494076589 None] Acquiring lock "cinder-ef70e01c-7a59-4ac6-a705-f98e01473350-delete_snapshot" by "delete_snapshot" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:42:05 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-91ef4aea-52ec-4564-9456-b6ae91eda508 tempest-SnapshotDataIntegrityTests-1494076589 None] Lock "cinder-ef70e01c-7a59-4ac6-a705-f98e01473350-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:42:05 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-91ef4aea-52ec-4564-9456-b6ae91eda508 tempest-SnapshotDataIntegrityTests-1494076589 None] Acquiring lock "cinder-quobyte-6bafdd19-6d59-4557-a0e3-17d1fbfc1053" by "delete_snapshot" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:42:05 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-91ef4aea-52ec-4564-9456-b6ae91eda508 tempest-SnapshotDataIntegrityTests-1494076589 None] Lock "cinder-quobyte-6bafdd19-6d59-4557-a0e3-17d1fbfc1053" acquired by "delete_snapshot" :: waited 0.022s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:42:05 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-91ef4aea-52ec-4564-9456-b6ae91eda508 tempest-SnapshotDataIntegrityTests-1494076589 None] Acquiring lock "cinder-quobyte-ef70e01c-7a59-4ac6-a705-f98e01473350" by "_delete_snapshot" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:42:05 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-91ef4aea-52ec-4564-9456-b6ae91eda508 tempest-SnapshotDataIntegrityTests-1494076589 None] Lock "cinder-quobyte-ef70e01c-7a59-4ac6-a705-f98e01473350" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:42:05 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-91ef4aea-52ec-4564-9456-b6ae91eda508 tempest-SnapshotDataIntegrityTests-1494076589 None] Deleting offline snapshot ef70e01c-7a59-4ac6-a705-f98e01473350 of volume 6bafdd19-6d59-4557-a0e3-17d1fbfc1053 {{(pid=88899) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 03 08:42:05 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-91ef4aea-52ec-4564-9456-b6ae91eda508 tempest-SnapshotDataIntegrityTests-1494076589 None] snapshot_file for this snap is: volume-6bafdd19-6d59-4557-a0e3-17d1fbfc1053.ef70e01c-7a59-4ac6-a705-f98e01473350 {{(pid=88899) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 03 08:42:05 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bc8c736-4417-4552-ae16-e5867753d69e]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:42:05 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-91ef4aea-52ec-4564-9456-b6ae91eda508 tempest-SnapshotDataIntegrityTests-1494076589 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-6bafdd19-6d59-4557-a0e3-17d1fbfc1053.ef70e01c-7a59-4ac6-a705-f98e01473350 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:42:05 devstack sudo[103924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-6bafdd19-6d59-4557-a0e3-17d1fbfc1053.ef70e01c-7a59-4ac6-a705-f98e01473350 Aug 03 08:42:05 devstack sudo[103924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:42:06 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-5bbe5e83-72f7-4759-bf4b-9c18be828cd7 tempest-VolumesSnapshotTestJSON-561529062 None] Acquiring lock "cinder-aaaaf2bc-140f-4ba4-8329-e78e548aa21b-delete_volume" by "delete_volume" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:42:06 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-5bbe5e83-72f7-4759-bf4b-9c18be828cd7 tempest-VolumesSnapshotTestJSON-561529062 None] Lock "cinder-aaaaf2bc-140f-4ba4-8329-e78e548aa21b-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:42:06 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-5bbe5e83-72f7-4759-bf4b-9c18be828cd7 tempest-VolumesSnapshotTestJSON-561529062 None] Acquiring lock "cinder-quobyte-aaaaf2bc-140f-4ba4-8329-e78e548aa21b" by "delete_volume" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:42:06 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-5bbe5e83-72f7-4759-bf4b-9c18be828cd7 tempest-VolumesSnapshotTestJSON-561529062 None] Lock "cinder-quobyte-aaaaf2bc-140f-4ba4-8329-e78e548aa21b" acquired by "delete_volume" :: waited 0.019s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:42:06 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0f5f180-1d99-4d54-83e6-f27aeb7ca796]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:42:06 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-5bbe5e83-72f7-4759-bf4b-9c18be828cd7 tempest-VolumesSnapshotTestJSON-561529062 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-aaaaf2bc-140f-4ba4-8329-e78e548aa21b {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:42:06 devstack sudo[103924]: pam_unix(sudo:session): session closed for user root Aug 03 08:42:06 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-91ef4aea-52ec-4564-9456-b6ae91eda508 tempest-SnapshotDataIntegrityTests-1494076589 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-6bafdd19-6d59-4557-a0e3-17d1fbfc1053.ef70e01c-7a59-4ac6-a705-f98e01473350" returned: 0 in 0.528s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:42:06 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-91ef4aea-52ec-4564-9456-b6ae91eda508 tempest-SnapshotDataIntegrityTests-1494076589 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6bafdd19-6d59-4557-a0e3-17d1fbfc1053(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88899) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 03 08:42:06 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[21ae70c4-bfc0-4a41-8381-e8602401575e]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:42:06 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-91ef4aea-52ec-4564-9456-b6ae91eda508 tempest-SnapshotDataIntegrityTests-1494076589 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-6bafdd19-6d59-4557-a0e3-17d1fbfc1053.7eccf0d3-bff0-4d62-a704-dc41ced4a9ba {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:42:06 devstack sudo[103930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-aaaaf2bc-140f-4ba4-8329-e78e548aa21b Aug 03 08:42:06 devstack sudo[103930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:42:06 devstack sudo[103931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-6bafdd19-6d59-4557-a0e3-17d1fbfc1053.7eccf0d3-bff0-4d62-a704-dc41ced4a9ba Aug 03 08:42:06 devstack sudo[103931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:42:06 devstack sudo[103930]: pam_unix(sudo:session): session closed for user root Aug 03 08:42:06 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-5bbe5e83-72f7-4759-bf4b-9c18be828cd7 tempest-VolumesSnapshotTestJSON-561529062 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-aaaaf2bc-140f-4ba4-8329-e78e548aa21b" returned: 0 in 0.416s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:42:06 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-5bbe5e83-72f7-4759-bf4b-9c18be828cd7 tempest-VolumesSnapshotTestJSON-561529062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-aaaaf2bc-140f-4ba4-8329-e78e548aa21b {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:42:06 devstack sudo[103938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-aaaaf2bc-140f-4ba4-8329-e78e548aa21b Aug 03 08:42:06 devstack sudo[103938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:42:06 devstack sudo[103931]: pam_unix(sudo:session): session closed for user root Aug 03 08:42:06 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-91ef4aea-52ec-4564-9456-b6ae91eda508 tempest-SnapshotDataIntegrityTests-1494076589 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-6bafdd19-6d59-4557-a0e3-17d1fbfc1053.7eccf0d3-bff0-4d62-a704-dc41ced4a9ba" returned: 0 in 0.458s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:42:06 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-91ef4aea-52ec-4564-9456-b6ae91eda508 tempest-SnapshotDataIntegrityTests-1494076589 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6bafdd19-6d59-4557-a0e3-17d1fbfc1053(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88899) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 03 08:42:06 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-91ef4aea-52ec-4564-9456-b6ae91eda508 tempest-SnapshotDataIntegrityTests-1494076589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-6bafdd19-6d59-4557-a0e3-17d1fbfc1053.ef70e01c-7a59-4ac6-a705-f98e01473350 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:42:06 devstack sudo[103943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-6bafdd19-6d59-4557-a0e3-17d1fbfc1053.ef70e01c-7a59-4ac6-a705-f98e01473350 Aug 03 08:42:06 devstack sudo[103943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:42:06 devstack sudo[103938]: pam_unix(sudo:session): session closed for user root Aug 03 08:42:06 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-5bbe5e83-72f7-4759-bf4b-9c18be828cd7 tempest-VolumesSnapshotTestJSON-561529062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-aaaaf2bc-140f-4ba4-8329-e78e548aa21b" returned: 0 in 0.304s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:42:06 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-5bbe5e83-72f7-4759-bf4b-9c18be828cd7 tempest-VolumesSnapshotTestJSON-561529062 None] Lock "cinder-quobyte-aaaaf2bc-140f-4ba4-8329-e78e548aa21b" released by "delete_volume" :: held 0.786s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:42:07 devstack cinder-volume[88899]: DEBUG cinder.quota [None req-5bbe5e83-72f7-4759-bf4b-9c18be828cd7 tempest-VolumesSnapshotTestJSON-561529062 None] Created reservations ['e58a9cbe-dec7-4f47-8d1b-95aac2097789', '3672a9c1-12fb-4db0-9951-0ab861e29568', '0e0ce8b4-189c-4ca4-98d3-bf604bc13dc9', 'accbee84-20f1-4fa1-b0d1-ccde00cb59d4'] {{(pid=88899) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 08:42:07 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-5bbe5e83-72f7-4759-bf4b-9c18be828cd7 tempest-VolumesSnapshotTestJSON-561529062 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:42:07 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-5bbe5e83-72f7-4759-bf4b-9c18be828cd7 tempest-VolumesSnapshotTestJSON-561529062 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:42:07 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-5bbe5e83-72f7-4759-bf4b-9c18be828cd7 tempest-VolumesSnapshotTestJSON-561529062 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:42:07 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-5bbe5e83-72f7-4759-bf4b-9c18be828cd7 tempest-VolumesSnapshotTestJSON-561529062 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:42:07 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-5bbe5e83-72f7-4759-bf4b-9c18be828cd7 tempest-VolumesSnapshotTestJSON-561529062 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:42:07 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-5bbe5e83-72f7-4759-bf4b-9c18be828cd7 tempest-VolumesSnapshotTestJSON-561529062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:42:07 devstack sudo[103949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a Aug 03 08:42:07 devstack sudo[103949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:42:07 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-355a9cb6-2299-4cbe-98ae-edcc5e9e183f tempest-VolumesSnapshotTestJSON-561529062 None] Acquiring lock "cinder-a72840a6-8012-4314-9e1a-ca69b1b03111-delete_snapshot" by "delete_snapshot" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:42:07 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-355a9cb6-2299-4cbe-98ae-edcc5e9e183f tempest-VolumesSnapshotTestJSON-561529062 None] Lock "cinder-a72840a6-8012-4314-9e1a-ca69b1b03111-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:42:07 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-355a9cb6-2299-4cbe-98ae-edcc5e9e183f tempest-VolumesSnapshotTestJSON-561529062 None] Acquiring lock "cinder-quobyte-55080d4b-cfd5-4bbb-afe1-98e6b08b61c4" by "delete_snapshot" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:42:07 devstack sudo[103943]: pam_unix(sudo:session): session closed for user root Aug 03 08:42:07 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-91ef4aea-52ec-4564-9456-b6ae91eda508 tempest-SnapshotDataIntegrityTests-1494076589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-6bafdd19-6d59-4557-a0e3-17d1fbfc1053.ef70e01c-7a59-4ac6-a705-f98e01473350" returned: 0 in 0.705s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:42:07 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-91ef4aea-52ec-4564-9456-b6ae91eda508 tempest-SnapshotDataIntegrityTests-1494076589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-6bafdd19-6d59-4557-a0e3-17d1fbfc1053.ef70e01c-7a59-4ac6-a705-f98e01473350 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:42:07 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-355a9cb6-2299-4cbe-98ae-edcc5e9e183f tempest-VolumesSnapshotTestJSON-561529062 None] Lock "cinder-quobyte-55080d4b-cfd5-4bbb-afe1-98e6b08b61c4" acquired by "delete_snapshot" :: waited 0.042s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:42:07 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-355a9cb6-2299-4cbe-98ae-edcc5e9e183f tempest-VolumesSnapshotTestJSON-561529062 None] Acquiring lock "cinder-quobyte-a72840a6-8012-4314-9e1a-ca69b1b03111" by "_delete_snapshot" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:42:07 devstack sudo[103956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-6bafdd19-6d59-4557-a0e3-17d1fbfc1053.ef70e01c-7a59-4ac6-a705-f98e01473350 Aug 03 08:42:07 devstack sudo[103956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:42:07 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-355a9cb6-2299-4cbe-98ae-edcc5e9e183f tempest-VolumesSnapshotTestJSON-561529062 None] Lock "cinder-quobyte-a72840a6-8012-4314-9e1a-ca69b1b03111" acquired by "_delete_snapshot" :: waited 0.033s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:42:07 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-355a9cb6-2299-4cbe-98ae-edcc5e9e183f tempest-VolumesSnapshotTestJSON-561529062 None] Deleting offline snapshot a72840a6-8012-4314-9e1a-ca69b1b03111 of volume 55080d4b-cfd5-4bbb-afe1-98e6b08b61c4 {{(pid=88899) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 03 08:42:07 devstack sudo[103949]: pam_unix(sudo:session): session closed for user root Aug 03 08:42:07 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-355a9cb6-2299-4cbe-98ae-edcc5e9e183f tempest-VolumesSnapshotTestJSON-561529062 None] snapshot_file for this snap is: volume-55080d4b-cfd5-4bbb-afe1-98e6b08b61c4.a72840a6-8012-4314-9e1a-ca69b1b03111 {{(pid=88899) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 03 08:42:07 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-5bbe5e83-72f7-4759-bf4b-9c18be828cd7 tempest-VolumesSnapshotTestJSON-561529062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a" returned: 0 in 0.428s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:42:07 devstack cinder-volume[88899]: DEBUG cinder.manager [None req-5bbe5e83-72f7-4759-bf4b-9c18be828cd7 tempest-VolumesSnapshotTestJSON-561529062 None] Notifying Schedulers of capabilities ... {{(pid=88899) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 08:42:07 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdc53429-07f9-414b-a7bc-96dd6c7d2403]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:42:07 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-5bbe5e83-72f7-4759-bf4b-9c18be828cd7 tempest-VolumesSnapshotTestJSON-561529062 None] Deleted volume successfully. Aug 03 08:42:07 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-355a9cb6-2299-4cbe-98ae-edcc5e9e183f tempest-VolumesSnapshotTestJSON-561529062 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-55080d4b-cfd5-4bbb-afe1-98e6b08b61c4.a72840a6-8012-4314-9e1a-ca69b1b03111 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:42:07 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-5bbe5e83-72f7-4759-bf4b-9c18be828cd7 tempest-VolumesSnapshotTestJSON-561529062 None] Lock "cinder-aaaaf2bc-140f-4ba4-8329-e78e548aa21b-delete_volume" released by "delete_volume" :: held 1.573s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:42:07 devstack sudo[103959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-55080d4b-cfd5-4bbb-afe1-98e6b08b61c4.a72840a6-8012-4314-9e1a-ca69b1b03111 Aug 03 08:42:07 devstack sudo[103959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:42:07 devstack sudo[103956]: pam_unix(sudo:session): session closed for user root Aug 03 08:42:07 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-91ef4aea-52ec-4564-9456-b6ae91eda508 tempest-SnapshotDataIntegrityTests-1494076589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-6bafdd19-6d59-4557-a0e3-17d1fbfc1053.ef70e01c-7a59-4ac6-a705-f98e01473350" returned: 0 in 0.432s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:42:07 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-91ef4aea-52ec-4564-9456-b6ae91eda508 tempest-SnapshotDataIntegrityTests-1494076589 None] Lock "cinder-quobyte-ef70e01c-7a59-4ac6-a705-f98e01473350" released by "_delete_snapshot" :: held 2.248s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:42:07 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-91ef4aea-52ec-4564-9456-b6ae91eda508 tempest-SnapshotDataIntegrityTests-1494076589 None] Lock "cinder-quobyte-6bafdd19-6d59-4557-a0e3-17d1fbfc1053" released by "delete_snapshot" :: held 2.275s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:42:08 devstack cinder-volume[88899]: DEBUG cinder.quota [None req-91ef4aea-52ec-4564-9456-b6ae91eda508 tempest-SnapshotDataIntegrityTests-1494076589 None] Created reservations ['5d15f265-145b-4326-b11e-7f585153b033', '86871440-1ef5-4ec2-924e-2c40ac6b019f', 'fd8d22b4-ca8c-46e1-97d3-f4944c1ddee0', '708be932-bc52-46a9-b5da-d240553cae17'] {{(pid=88899) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 08:42:08 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-91ef4aea-52ec-4564-9456-b6ae91eda508 tempest-SnapshotDataIntegrityTests-1494076589 None] Delete snapshot completed successfully. Aug 03 08:42:08 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-91ef4aea-52ec-4564-9456-b6ae91eda508 tempest-SnapshotDataIntegrityTests-1494076589 None] Lock "cinder-ef70e01c-7a59-4ac6-a705-f98e01473350-delete_snapshot" released by "delete_snapshot" :: held 2.454s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:42:08 devstack sudo[103959]: pam_unix(sudo:session): session closed for user root Aug 03 08:42:08 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-355a9cb6-2299-4cbe-98ae-edcc5e9e183f tempest-VolumesSnapshotTestJSON-561529062 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-55080d4b-cfd5-4bbb-afe1-98e6b08b61c4.a72840a6-8012-4314-9e1a-ca69b1b03111" returned: 0 in 0.502s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:42:08 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-355a9cb6-2299-4cbe-98ae-edcc5e9e183f tempest-VolumesSnapshotTestJSON-561529062 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-55080d4b-cfd5-4bbb-afe1-98e6b08b61c4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88899) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 03 08:42:08 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[e757a53e-46f7-40ce-8656-11f892762a50]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:42:08 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-355a9cb6-2299-4cbe-98ae-edcc5e9e183f tempest-VolumesSnapshotTestJSON-561529062 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-55080d4b-cfd5-4bbb-afe1-98e6b08b61c4 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:42:08 devstack sudo[103966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-55080d4b-cfd5-4bbb-afe1-98e6b08b61c4 Aug 03 08:42:08 devstack sudo[103966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:42:08 devstack sudo[103966]: pam_unix(sudo:session): session closed for user root Aug 03 08:42:08 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-355a9cb6-2299-4cbe-98ae-edcc5e9e183f tempest-VolumesSnapshotTestJSON-561529062 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-55080d4b-cfd5-4bbb-afe1-98e6b08b61c4" returned: 0 in 0.584s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:42:08 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-355a9cb6-2299-4cbe-98ae-edcc5e9e183f tempest-VolumesSnapshotTestJSON-561529062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-55080d4b-cfd5-4bbb-afe1-98e6b08b61c4.a72840a6-8012-4314-9e1a-ca69b1b03111 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:42:08 devstack sudo[103972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-55080d4b-cfd5-4bbb-afe1-98e6b08b61c4.a72840a6-8012-4314-9e1a-ca69b1b03111 Aug 03 08:42:08 devstack sudo[103972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:42:08 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-b0762ef2-3f9d-4c01-80e2-9a77b27c248c tempest-SnapshotDataIntegrityTests-1494076589 None] Acquiring lock "cinder-7eccf0d3-bff0-4d62-a704-dc41ced4a9ba-delete_snapshot" by "delete_snapshot" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:42:08 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-b0762ef2-3f9d-4c01-80e2-9a77b27c248c tempest-SnapshotDataIntegrityTests-1494076589 None] Lock "cinder-7eccf0d3-bff0-4d62-a704-dc41ced4a9ba-delete_snapshot" acquired by "delete_snapshot" :: waited 0.057s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:42:08 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-b0762ef2-3f9d-4c01-80e2-9a77b27c248c tempest-SnapshotDataIntegrityTests-1494076589 None] Acquiring lock "cinder-quobyte-6bafdd19-6d59-4557-a0e3-17d1fbfc1053" by "delete_snapshot" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:42:08 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-b0762ef2-3f9d-4c01-80e2-9a77b27c248c tempest-SnapshotDataIntegrityTests-1494076589 None] Lock "cinder-quobyte-6bafdd19-6d59-4557-a0e3-17d1fbfc1053" acquired by "delete_snapshot" :: waited 0.020s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:42:08 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-b0762ef2-3f9d-4c01-80e2-9a77b27c248c tempest-SnapshotDataIntegrityTests-1494076589 None] Acquiring lock "cinder-quobyte-7eccf0d3-bff0-4d62-a704-dc41ced4a9ba" by "_delete_snapshot" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:42:08 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-b0762ef2-3f9d-4c01-80e2-9a77b27c248c tempest-SnapshotDataIntegrityTests-1494076589 None] Lock "cinder-quobyte-7eccf0d3-bff0-4d62-a704-dc41ced4a9ba" acquired by "_delete_snapshot" :: waited 0.033s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:42:08 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-b0762ef2-3f9d-4c01-80e2-9a77b27c248c tempest-SnapshotDataIntegrityTests-1494076589 None] Deleting offline snapshot 7eccf0d3-bff0-4d62-a704-dc41ced4a9ba of volume 6bafdd19-6d59-4557-a0e3-17d1fbfc1053 {{(pid=88899) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 03 08:42:09 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-b0762ef2-3f9d-4c01-80e2-9a77b27c248c tempest-SnapshotDataIntegrityTests-1494076589 None] snapshot_file for this snap is: volume-6bafdd19-6d59-4557-a0e3-17d1fbfc1053.7eccf0d3-bff0-4d62-a704-dc41ced4a9ba {{(pid=88899) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 03 08:42:09 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[caba303d-2421-44c3-b103-ed9d498bc636]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:42:09 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-b0762ef2-3f9d-4c01-80e2-9a77b27c248c tempest-SnapshotDataIntegrityTests-1494076589 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-6bafdd19-6d59-4557-a0e3-17d1fbfc1053.7eccf0d3-bff0-4d62-a704-dc41ced4a9ba {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:42:09 devstack sudo[103976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-6bafdd19-6d59-4557-a0e3-17d1fbfc1053.7eccf0d3-bff0-4d62-a704-dc41ced4a9ba Aug 03 08:42:09 devstack sudo[103976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:42:09 devstack sudo[103972]: pam_unix(sudo:session): session closed for user root Aug 03 08:42:09 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-355a9cb6-2299-4cbe-98ae-edcc5e9e183f tempest-VolumesSnapshotTestJSON-561529062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-55080d4b-cfd5-4bbb-afe1-98e6b08b61c4.a72840a6-8012-4314-9e1a-ca69b1b03111" returned: 0 in 0.561s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:42:09 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-355a9cb6-2299-4cbe-98ae-edcc5e9e183f tempest-VolumesSnapshotTestJSON-561529062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-55080d4b-cfd5-4bbb-afe1-98e6b08b61c4.a72840a6-8012-4314-9e1a-ca69b1b03111 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:42:09 devstack sudo[103979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-55080d4b-cfd5-4bbb-afe1-98e6b08b61c4.a72840a6-8012-4314-9e1a-ca69b1b03111 Aug 03 08:42:09 devstack sudo[103979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:42:09 devstack sudo[103979]: pam_unix(sudo:session): session closed for user root Aug 03 08:42:09 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-355a9cb6-2299-4cbe-98ae-edcc5e9e183f tempest-VolumesSnapshotTestJSON-561529062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-55080d4b-cfd5-4bbb-afe1-98e6b08b61c4.a72840a6-8012-4314-9e1a-ca69b1b03111" returned: 0 in 0.310s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:42:09 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-355a9cb6-2299-4cbe-98ae-edcc5e9e183f tempest-VolumesSnapshotTestJSON-561529062 None] Lock "cinder-quobyte-a72840a6-8012-4314-9e1a-ca69b1b03111" released by "_delete_snapshot" :: held 2.127s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:42:09 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-355a9cb6-2299-4cbe-98ae-edcc5e9e183f tempest-VolumesSnapshotTestJSON-561529062 None] Lock "cinder-quobyte-55080d4b-cfd5-4bbb-afe1-98e6b08b61c4" released by "delete_snapshot" :: held 2.175s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:42:09 devstack sudo[103976]: pam_unix(sudo:session): session closed for user root Aug 03 08:42:09 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-b0762ef2-3f9d-4c01-80e2-9a77b27c248c tempest-SnapshotDataIntegrityTests-1494076589 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-6bafdd19-6d59-4557-a0e3-17d1fbfc1053.7eccf0d3-bff0-4d62-a704-dc41ced4a9ba" returned: 0 in 0.610s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:42:09 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-b0762ef2-3f9d-4c01-80e2-9a77b27c248c tempest-SnapshotDataIntegrityTests-1494076589 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6bafdd19-6d59-4557-a0e3-17d1fbfc1053(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88899) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 03 08:42:09 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8f9d83d-00f0-43cf-b985-35abde4a14d3]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:42:09 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-b0762ef2-3f9d-4c01-80e2-9a77b27c248c tempest-SnapshotDataIntegrityTests-1494076589 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-6bafdd19-6d59-4557-a0e3-17d1fbfc1053 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:42:09 devstack cinder-volume[88899]: DEBUG cinder.quota [None req-355a9cb6-2299-4cbe-98ae-edcc5e9e183f tempest-VolumesSnapshotTestJSON-561529062 None] Created reservations ['c0eb5cff-58d1-442b-93ab-c54cf2ff1783', 'ce9cf9cf-9fdb-428e-95fc-25cfffcc0fe4', 'b0ad5e50-a04c-434e-ae31-869fbfdc9036', 'cd77778c-dc01-4ca6-a77c-6da84a043b44'] {{(pid=88899) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 08:42:09 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-355a9cb6-2299-4cbe-98ae-edcc5e9e183f tempest-VolumesSnapshotTestJSON-561529062 None] Delete snapshot completed successfully. Aug 03 08:42:09 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-355a9cb6-2299-4cbe-98ae-edcc5e9e183f tempest-VolumesSnapshotTestJSON-561529062 None] Lock "cinder-a72840a6-8012-4314-9e1a-ca69b1b03111-delete_snapshot" released by "delete_snapshot" :: held 2.428s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:42:09 devstack sudo[103985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-6bafdd19-6d59-4557-a0e3-17d1fbfc1053 Aug 03 08:42:09 devstack sudo[103985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:42:10 devstack sudo[103985]: pam_unix(sudo:session): session closed for user root Aug 03 08:42:10 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-b0762ef2-3f9d-4c01-80e2-9a77b27c248c tempest-SnapshotDataIntegrityTests-1494076589 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-6bafdd19-6d59-4557-a0e3-17d1fbfc1053" returned: 0 in 0.479s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:42:10 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-b0762ef2-3f9d-4c01-80e2-9a77b27c248c tempest-SnapshotDataIntegrityTests-1494076589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-6bafdd19-6d59-4557-a0e3-17d1fbfc1053.7eccf0d3-bff0-4d62-a704-dc41ced4a9ba {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:42:10 devstack sudo[103990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-6bafdd19-6d59-4557-a0e3-17d1fbfc1053.7eccf0d3-bff0-4d62-a704-dc41ced4a9ba Aug 03 08:42:10 devstack sudo[103990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:42:10 devstack sudo[103990]: pam_unix(sudo:session): session closed for user root Aug 03 08:42:10 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-b0762ef2-3f9d-4c01-80e2-9a77b27c248c tempest-SnapshotDataIntegrityTests-1494076589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-6bafdd19-6d59-4557-a0e3-17d1fbfc1053.7eccf0d3-bff0-4d62-a704-dc41ced4a9ba" returned: 0 in 0.498s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:42:10 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-b0762ef2-3f9d-4c01-80e2-9a77b27c248c tempest-SnapshotDataIntegrityTests-1494076589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-6bafdd19-6d59-4557-a0e3-17d1fbfc1053.7eccf0d3-bff0-4d62-a704-dc41ced4a9ba {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:42:10 devstack sudo[104000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-6bafdd19-6d59-4557-a0e3-17d1fbfc1053.7eccf0d3-bff0-4d62-a704-dc41ced4a9ba Aug 03 08:42:10 devstack sudo[104000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:42:10 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-4dad38d7-afce-4205-9f82-0915998e2397 tempest-VolumesSnapshotTestJSON-561529062 None] Acquiring lock "cinder-55080d4b-cfd5-4bbb-afe1-98e6b08b61c4-delete_volume" by "delete_volume" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:42:10 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-4dad38d7-afce-4205-9f82-0915998e2397 tempest-VolumesSnapshotTestJSON-561529062 None] Lock "cinder-55080d4b-cfd5-4bbb-afe1-98e6b08b61c4-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:42:10 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-4dad38d7-afce-4205-9f82-0915998e2397 tempest-VolumesSnapshotTestJSON-561529062 None] Acquiring lock "cinder-quobyte-55080d4b-cfd5-4bbb-afe1-98e6b08b61c4" by "delete_volume" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:42:10 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-4dad38d7-afce-4205-9f82-0915998e2397 tempest-VolumesSnapshotTestJSON-561529062 None] Lock "cinder-quobyte-55080d4b-cfd5-4bbb-afe1-98e6b08b61c4" acquired by "delete_volume" :: waited 0.030s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:42:11 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4e39266-86be-4574-8c50-7f6ba8d7c434]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:42:11 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-4dad38d7-afce-4205-9f82-0915998e2397 tempest-VolumesSnapshotTestJSON-561529062 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-55080d4b-cfd5-4bbb-afe1-98e6b08b61c4 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:42:11 devstack sudo[104000]: pam_unix(sudo:session): session closed for user root Aug 03 08:42:11 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-b0762ef2-3f9d-4c01-80e2-9a77b27c248c tempest-SnapshotDataIntegrityTests-1494076589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-6bafdd19-6d59-4557-a0e3-17d1fbfc1053.7eccf0d3-bff0-4d62-a704-dc41ced4a9ba" returned: 0 in 0.402s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:42:11 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-b0762ef2-3f9d-4c01-80e2-9a77b27c248c tempest-SnapshotDataIntegrityTests-1494076589 None] Lock "cinder-quobyte-7eccf0d3-bff0-4d62-a704-dc41ced4a9ba" released by "_delete_snapshot" :: held 2.193s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:42:11 devstack sudo[104009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-55080d4b-cfd5-4bbb-afe1-98e6b08b61c4 Aug 03 08:42:11 devstack sudo[104009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:42:11 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-b0762ef2-3f9d-4c01-80e2-9a77b27c248c tempest-SnapshotDataIntegrityTests-1494076589 None] Lock "cinder-quobyte-6bafdd19-6d59-4557-a0e3-17d1fbfc1053" released by "delete_snapshot" :: held 2.240s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:42:11 devstack cinder-volume[88899]: DEBUG cinder.quota [None req-b0762ef2-3f9d-4c01-80e2-9a77b27c248c tempest-SnapshotDataIntegrityTests-1494076589 None] Created reservations ['e6bf8720-4d70-491f-86d9-db3ec62a9646', 'f9cc0d6d-1353-4c08-9263-9191b88e5077', '8c9d7458-b11b-4157-8ec3-c7e8ec1398a5', '94fffbe1-1032-486a-beea-d8db5b852ba8'] {{(pid=88899) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 08:42:11 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-b0762ef2-3f9d-4c01-80e2-9a77b27c248c tempest-SnapshotDataIntegrityTests-1494076589 None] Delete snapshot completed successfully. Aug 03 08:42:11 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-b0762ef2-3f9d-4c01-80e2-9a77b27c248c tempest-SnapshotDataIntegrityTests-1494076589 None] Lock "cinder-7eccf0d3-bff0-4d62-a704-dc41ced4a9ba-delete_snapshot" released by "delete_snapshot" :: held 2.443s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:42:11 devstack sudo[104009]: pam_unix(sudo:session): session closed for user root Aug 03 08:42:11 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-4dad38d7-afce-4205-9f82-0915998e2397 tempest-VolumesSnapshotTestJSON-561529062 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-55080d4b-cfd5-4bbb-afe1-98e6b08b61c4" returned: 0 in 0.456s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:42:11 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-4dad38d7-afce-4205-9f82-0915998e2397 tempest-VolumesSnapshotTestJSON-561529062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-55080d4b-cfd5-4bbb-afe1-98e6b08b61c4 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:42:11 devstack sudo[104014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-55080d4b-cfd5-4bbb-afe1-98e6b08b61c4 Aug 03 08:42:11 devstack sudo[104014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:42:11 devstack sudo[104014]: pam_unix(sudo:session): session closed for user root Aug 03 08:42:11 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-4dad38d7-afce-4205-9f82-0915998e2397 tempest-VolumesSnapshotTestJSON-561529062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-55080d4b-cfd5-4bbb-afe1-98e6b08b61c4" returned: 0 in 0.391s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:42:11 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-4dad38d7-afce-4205-9f82-0915998e2397 tempest-VolumesSnapshotTestJSON-561529062 None] Lock "cinder-quobyte-55080d4b-cfd5-4bbb-afe1-98e6b08b61c4" released by "delete_volume" :: held 0.961s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:42:12 devstack cinder-volume[88899]: DEBUG cinder.quota [None req-4dad38d7-afce-4205-9f82-0915998e2397 tempest-VolumesSnapshotTestJSON-561529062 None] Created reservations ['99ccaea4-0597-4599-ac47-5cc1ef104d2d', '91f5cbb8-edd9-4a7b-992c-d6ac4cdc400d', '35c65494-8eb9-4a52-a136-f7a36d8a70a4', '214c9d52-4dff-49ed-9973-04dfb415acf7'] {{(pid=88899) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 08:42:12 devstack cinder-volume[88899]: DEBUG dbcounter [-] [88899] Writing DB stats cinder:SELECT=186,cinder:UPDATE=203,cinder:INSERT=58,cinder:DELETE=16 {{(pid=88899) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 03 08:42:12 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-4dad38d7-afce-4205-9f82-0915998e2397 tempest-VolumesSnapshotTestJSON-561529062 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:42:12 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-4dad38d7-afce-4205-9f82-0915998e2397 tempest-VolumesSnapshotTestJSON-561529062 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:42:12 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-4dad38d7-afce-4205-9f82-0915998e2397 tempest-VolumesSnapshotTestJSON-561529062 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:42:12 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-4dad38d7-afce-4205-9f82-0915998e2397 tempest-VolumesSnapshotTestJSON-561529062 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:42:12 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-4dad38d7-afce-4205-9f82-0915998e2397 tempest-VolumesSnapshotTestJSON-561529062 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:42:12 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-4dad38d7-afce-4205-9f82-0915998e2397 tempest-VolumesSnapshotTestJSON-561529062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:42:12 devstack sudo[104017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a Aug 03 08:42:12 devstack sudo[104017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:42:12 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-6ebd19ff-30bd-42a0-a26e-de040729cf32 tempest-SnapshotDataIntegrityTests-1494076589 None] Acquiring lock "cinder-6bafdd19-6d59-4557-a0e3-17d1fbfc1053-delete_volume" by "delete_volume" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:42:12 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-6ebd19ff-30bd-42a0-a26e-de040729cf32 tempest-SnapshotDataIntegrityTests-1494076589 None] Lock "cinder-6bafdd19-6d59-4557-a0e3-17d1fbfc1053-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:42:12 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-6ebd19ff-30bd-42a0-a26e-de040729cf32 tempest-SnapshotDataIntegrityTests-1494076589 None] Acquiring lock "cinder-quobyte-6bafdd19-6d59-4557-a0e3-17d1fbfc1053" by "delete_volume" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:42:12 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-6ebd19ff-30bd-42a0-a26e-de040729cf32 tempest-SnapshotDataIntegrityTests-1494076589 None] Lock "cinder-quobyte-6bafdd19-6d59-4557-a0e3-17d1fbfc1053" acquired by "delete_volume" :: waited 0.024s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:42:12 devstack sudo[104017]: pam_unix(sudo:session): session closed for user root Aug 03 08:42:12 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-4dad38d7-afce-4205-9f82-0915998e2397 tempest-VolumesSnapshotTestJSON-561529062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a" returned: 0 in 0.456s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:42:12 devstack cinder-volume[88899]: DEBUG cinder.manager [None req-4dad38d7-afce-4205-9f82-0915998e2397 tempest-VolumesSnapshotTestJSON-561529062 None] Notifying Schedulers of capabilities ... {{(pid=88899) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 08:42:12 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[96a1a364-fe36-4517-9991-d991492f5c58]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:42:12 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-6ebd19ff-30bd-42a0-a26e-de040729cf32 tempest-SnapshotDataIntegrityTests-1494076589 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-6bafdd19-6d59-4557-a0e3-17d1fbfc1053 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:42:12 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-4dad38d7-afce-4205-9f82-0915998e2397 tempest-VolumesSnapshotTestJSON-561529062 None] Deleted volume successfully. Aug 03 08:42:12 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-4dad38d7-afce-4205-9f82-0915998e2397 tempest-VolumesSnapshotTestJSON-561529062 None] Lock "cinder-55080d4b-cfd5-4bbb-afe1-98e6b08b61c4-delete_volume" released by "delete_volume" :: held 1.811s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:42:12 devstack sudo[104020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-6bafdd19-6d59-4557-a0e3-17d1fbfc1053 Aug 03 08:42:12 devstack sudo[104020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:42:13 devstack sudo[104020]: pam_unix(sudo:session): session closed for user root Aug 03 08:42:13 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-6ebd19ff-30bd-42a0-a26e-de040729cf32 tempest-SnapshotDataIntegrityTests-1494076589 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-6bafdd19-6d59-4557-a0e3-17d1fbfc1053" returned: 0 in 0.546s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:42:13 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-6ebd19ff-30bd-42a0-a26e-de040729cf32 tempest-SnapshotDataIntegrityTests-1494076589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-6bafdd19-6d59-4557-a0e3-17d1fbfc1053 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:42:13 devstack sudo[104025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-6bafdd19-6d59-4557-a0e3-17d1fbfc1053 Aug 03 08:42:13 devstack sudo[104025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:42:13 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-2bfd1397-6c19-49d8-9c2e-90887e87468c tempest-VolumesSnapshotTestJSON-561529062 None] Acquiring lock "cinder-d5138b8c-810b-4a8a-8abf-750f26d9a2e6-delete_volume" by "delete_volume" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:42:13 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-2bfd1397-6c19-49d8-9c2e-90887e87468c tempest-VolumesSnapshotTestJSON-561529062 None] Lock "cinder-d5138b8c-810b-4a8a-8abf-750f26d9a2e6-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:42:13 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-2bfd1397-6c19-49d8-9c2e-90887e87468c tempest-VolumesSnapshotTestJSON-561529062 None] Acquiring lock "cinder-quobyte-d5138b8c-810b-4a8a-8abf-750f26d9a2e6" by "delete_volume" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:42:13 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-2bfd1397-6c19-49d8-9c2e-90887e87468c tempest-VolumesSnapshotTestJSON-561529062 None] Lock "cinder-quobyte-d5138b8c-810b-4a8a-8abf-750f26d9a2e6" acquired by "delete_volume" :: waited 0.019s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:42:13 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[27cdb385-c29d-450f-a8bb-72687661dbc5]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:42:13 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-2bfd1397-6c19-49d8-9c2e-90887e87468c tempest-VolumesSnapshotTestJSON-561529062 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-d5138b8c-810b-4a8a-8abf-750f26d9a2e6 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:42:13 devstack sudo[104025]: pam_unix(sudo:session): session closed for user root Aug 03 08:42:13 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-6ebd19ff-30bd-42a0-a26e-de040729cf32 tempest-SnapshotDataIntegrityTests-1494076589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-6bafdd19-6d59-4557-a0e3-17d1fbfc1053" returned: 0 in 0.388s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:42:13 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-6ebd19ff-30bd-42a0-a26e-de040729cf32 tempest-SnapshotDataIntegrityTests-1494076589 None] Lock "cinder-quobyte-6bafdd19-6d59-4557-a0e3-17d1fbfc1053" released by "delete_volume" :: held 1.061s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:42:13 devstack cinder-volume[88899]: DEBUG cinder.quota [None req-6ebd19ff-30bd-42a0-a26e-de040729cf32 tempest-SnapshotDataIntegrityTests-1494076589 None] Created reservations ['fe005fbc-75ea-4d85-8ba5-65e2e55ca48f', 'e40bc094-a72b-448b-b870-331caa665c49', '5ddcb36f-ddeb-4fbc-bc50-e545c72affeb', 'bb788df7-67a4-4f81-8583-3b46570b6377'] {{(pid=88899) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 08:42:13 devstack sudo[104028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-d5138b8c-810b-4a8a-8abf-750f26d9a2e6 Aug 03 08:42:13 devstack sudo[104028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:42:13 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-6ebd19ff-30bd-42a0-a26e-de040729cf32 tempest-SnapshotDataIntegrityTests-1494076589 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:42:13 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-6ebd19ff-30bd-42a0-a26e-de040729cf32 tempest-SnapshotDataIntegrityTests-1494076589 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:42:13 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-6ebd19ff-30bd-42a0-a26e-de040729cf32 tempest-SnapshotDataIntegrityTests-1494076589 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:42:13 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-6ebd19ff-30bd-42a0-a26e-de040729cf32 tempest-SnapshotDataIntegrityTests-1494076589 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:42:13 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-6ebd19ff-30bd-42a0-a26e-de040729cf32 tempest-SnapshotDataIntegrityTests-1494076589 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:42:13 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-6ebd19ff-30bd-42a0-a26e-de040729cf32 tempest-SnapshotDataIntegrityTests-1494076589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:42:13 devstack sudo[104030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a Aug 03 08:42:13 devstack sudo[104030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:42:14 devstack sudo[104028]: pam_unix(sudo:session): session closed for user root Aug 03 08:42:14 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-2bfd1397-6c19-49d8-9c2e-90887e87468c tempest-VolumesSnapshotTestJSON-561529062 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-d5138b8c-810b-4a8a-8abf-750f26d9a2e6" returned: 0 in 0.573s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:42:14 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-2bfd1397-6c19-49d8-9c2e-90887e87468c tempest-VolumesSnapshotTestJSON-561529062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-d5138b8c-810b-4a8a-8abf-750f26d9a2e6 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:42:14 devstack sudo[104036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-d5138b8c-810b-4a8a-8abf-750f26d9a2e6 Aug 03 08:42:14 devstack sudo[104036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:42:14 devstack sudo[104030]: pam_unix(sudo:session): session closed for user root Aug 03 08:42:14 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-6ebd19ff-30bd-42a0-a26e-de040729cf32 tempest-SnapshotDataIntegrityTests-1494076589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a" returned: 0 in 0.360s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:42:14 devstack cinder-volume[88899]: DEBUG cinder.manager [None req-6ebd19ff-30bd-42a0-a26e-de040729cf32 tempest-SnapshotDataIntegrityTests-1494076589 None] Notifying Schedulers of capabilities ... {{(pid=88899) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 08:42:14 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-6ebd19ff-30bd-42a0-a26e-de040729cf32 tempest-SnapshotDataIntegrityTests-1494076589 None] Deleted volume successfully. Aug 03 08:42:14 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-6ebd19ff-30bd-42a0-a26e-de040729cf32 tempest-SnapshotDataIntegrityTests-1494076589 None] Lock "cinder-6bafdd19-6d59-4557-a0e3-17d1fbfc1053-delete_volume" released by "delete_volume" :: held 1.753s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:42:14 devstack sudo[104036]: pam_unix(sudo:session): session closed for user root Aug 03 08:42:14 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-2bfd1397-6c19-49d8-9c2e-90887e87468c tempest-VolumesSnapshotTestJSON-561529062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-d5138b8c-810b-4a8a-8abf-750f26d9a2e6" returned: 0 in 0.350s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:42:14 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-2bfd1397-6c19-49d8-9c2e-90887e87468c tempest-VolumesSnapshotTestJSON-561529062 None] Lock "cinder-quobyte-d5138b8c-810b-4a8a-8abf-750f26d9a2e6" released by "delete_volume" :: held 1.025s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:42:14 devstack cinder-volume[88899]: DEBUG cinder.quota [None req-2bfd1397-6c19-49d8-9c2e-90887e87468c tempest-VolumesSnapshotTestJSON-561529062 None] Created reservations ['9ef8eb29-56db-46ee-aa98-aa17a6571f3c', '10877bb8-cc66-440f-b239-5cb32a93eda1', '53fc7771-9af2-4ead-87a0-192e8cc1c61a', 'a8734c0a-4810-4922-8c28-71c3f8a22fa6'] {{(pid=88899) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 08:42:14 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-2bfd1397-6c19-49d8-9c2e-90887e87468c tempest-VolumesSnapshotTestJSON-561529062 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:42:14 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-2bfd1397-6c19-49d8-9c2e-90887e87468c tempest-VolumesSnapshotTestJSON-561529062 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:42:14 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-2bfd1397-6c19-49d8-9c2e-90887e87468c tempest-VolumesSnapshotTestJSON-561529062 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:42:14 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-2bfd1397-6c19-49d8-9c2e-90887e87468c tempest-VolumesSnapshotTestJSON-561529062 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:42:14 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-2bfd1397-6c19-49d8-9c2e-90887e87468c tempest-VolumesSnapshotTestJSON-561529062 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:42:14 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-2bfd1397-6c19-49d8-9c2e-90887e87468c tempest-VolumesSnapshotTestJSON-561529062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:42:14 devstack sudo[104039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a Aug 03 08:42:14 devstack sudo[104039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:42:15 devstack sudo[104039]: pam_unix(sudo:session): session closed for user root Aug 03 08:42:15 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-2bfd1397-6c19-49d8-9c2e-90887e87468c tempest-VolumesSnapshotTestJSON-561529062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a" returned: 0 in 0.364s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:42:15 devstack cinder-volume[88899]: DEBUG cinder.manager [None req-2bfd1397-6c19-49d8-9c2e-90887e87468c tempest-VolumesSnapshotTestJSON-561529062 None] Notifying Schedulers of capabilities ... {{(pid=88899) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 08:42:15 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-2bfd1397-6c19-49d8-9c2e-90887e87468c tempest-VolumesSnapshotTestJSON-561529062 None] Deleted volume successfully. Aug 03 08:42:15 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-2bfd1397-6c19-49d8-9c2e-90887e87468c tempest-VolumesSnapshotTestJSON-561529062 None] Lock "cinder-d5138b8c-810b-4a8a-8abf-750f26d9a2e6-delete_volume" released by "delete_volume" :: held 1.719s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:42:17 devstack cinder-volume[88899]: DEBUG cinder.volume.flows.manager.create_volume [None req-29b43ddd-8f09-4de9-8a27-dd9cf13f9263 tempest-VolumesActionsTest-1152451848 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88899) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 08:42:17 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-29b43ddd-8f09-4de9-8a27-dd9cf13f9263 tempest-VolumesActionsTest-1152451848 None] Flow 'volume_create_manager' (4fa15cfd-138e-4dd8-9ddc-849b6c790fce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:42:17 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-29b43ddd-8f09-4de9-8a27-dd9cf13f9263 tempest-VolumesActionsTest-1152451848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41237e98-06b2-4018-a0e6-dab3c47714d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:42:17 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-29b43ddd-8f09-4de9-8a27-dd9cf13f9263 tempest-VolumesActionsTest-1152451848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41237e98-06b2-4018-a0e6-dab3c47714d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:42:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-500507534',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=46dbdec8-5da6-4028-832e-bb6b43a7390d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a84bd93afe1f48ff8a40a5ce55d665bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:42:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:42:17Z,use_quota=True,user_id='54656f51c03943a79e1e7d824397464f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8bde7129-1dc4-42ab-b852-ab32c61b4921),volume_type_id=8bde7129-1dc4-42ab-b852-ab32c61b4921)' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:42:17 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-29b43ddd-8f09-4de9-8a27-dd9cf13f9263 tempest-VolumesActionsTest-1152451848 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1859024-39b5-4a2e-b3a6-298c0efebfb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:42:17 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-29b43ddd-8f09-4de9-8a27-dd9cf13f9263 tempest-VolumesActionsTest-1152451848 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1859024-39b5-4a2e-b3a6-298c0efebfb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:42:17 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-29b43ddd-8f09-4de9-8a27-dd9cf13f9263 tempest-VolumesActionsTest-1152451848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (95cf9b80-cf4b-4bfd-bf05-4d4b647ecbee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:42:17 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-29b43ddd-8f09-4de9-8a27-dd9cf13f9263 tempest-VolumesActionsTest-1152451848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (95cf9b80-cf4b-4bfd-bf05-4d4b647ecbee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '46dbdec8-5da6-4028-832e-bb6b43a7390d', 'volume_name': 'volume-46dbdec8-5da6-4028-832e-bb6b43a7390d', 'volume_size': 1}' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:42:17 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-29b43ddd-8f09-4de9-8a27-dd9cf13f9263 tempest-VolumesActionsTest-1152451848 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02347646-4103-4b09-bf83-4e7e6734d4d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:42:17 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-29b43ddd-8f09-4de9-8a27-dd9cf13f9263 tempest-VolumesActionsTest-1152451848 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02347646-4103-4b09-bf83-4e7e6734d4d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:42:17 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-29b43ddd-8f09-4de9-8a27-dd9cf13f9263 tempest-VolumesActionsTest-1152451848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd03a25d-92a0-4fa9-9c8f-0a17003014fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:42:17 devstack cinder-volume[88899]: INFO cinder.volume.flows.manager.create_volume [None req-29b43ddd-8f09-4de9-8a27-dd9cf13f9263 tempest-VolumesActionsTest-1152451848 None] Volume 46dbdec8-5da6-4028-832e-bb6b43a7390d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-46dbdec8-5da6-4028-832e-bb6b43a7390d', 'volume_size': 1} Aug 03 08:42:17 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-29b43ddd-8f09-4de9-8a27-dd9cf13f9263 tempest-VolumesActionsTest-1152451848 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:42:17 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-29b43ddd-8f09-4de9-8a27-dd9cf13f9263 tempest-VolumesActionsTest-1152451848 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:42:17 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-29b43ddd-8f09-4de9-8a27-dd9cf13f9263 tempest-VolumesActionsTest-1152451848 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:42:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-500507534',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=46dbdec8-5da6-4028-832e-bb6b43a7390d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a84bd93afe1f48ff8a40a5ce55d665bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:42:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:42:17Z,use_quota=True,user_id='54656f51c03943a79e1e7d824397464f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8bde7129-1dc4-42ab-b852-ab32c61b4921),volume_type_id=8bde7129-1dc4-42ab-b852-ab32c61b4921)}" {{(pid=88899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 08:42:17 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-29b43ddd-8f09-4de9-8a27-dd9cf13f9263 tempest-VolumesActionsTest-1152451848 None] Creating volume 46dbdec8-5da6-4028-832e-bb6b43a7390d {{(pid=88899) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 08:42:17 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-29b43ddd-8f09-4de9-8a27-dd9cf13f9263 tempest-VolumesActionsTest-1152451848 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:42:17 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-29b43ddd-8f09-4de9-8a27-dd9cf13f9263 tempest-VolumesActionsTest-1152451848 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:42:17 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-29b43ddd-8f09-4de9-8a27-dd9cf13f9263 tempest-VolumesActionsTest-1152451848 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:42:17 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-29b43ddd-8f09-4de9-8a27-dd9cf13f9263 tempest-VolumesActionsTest-1152451848 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:42:17 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-29b43ddd-8f09-4de9-8a27-dd9cf13f9263 tempest-VolumesActionsTest-1152451848 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:42:17 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-29b43ddd-8f09-4de9-8a27-dd9cf13f9263 tempest-VolumesActionsTest-1152451848 None] Selected osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385 as target Quobyte volume. {{(pid=88899) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 08:42:17 devstack cinder-volume[88899]: INFO cinder.volume.drivers.remotefs [None req-29b43ddd-8f09-4de9-8a27-dd9cf13f9263 tempest-VolumesActionsTest-1152451848 None] casted to osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385 Aug 03 08:42:17 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-29b43ddd-8f09-4de9-8a27-dd9cf13f9263 tempest-VolumesActionsTest-1152451848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-46dbdec8-5da6-4028-832e-bb6b43a7390d 1073741824 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:42:17 devstack sudo[104065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-46dbdec8-5da6-4028-832e-bb6b43a7390d 1073741824 Aug 03 08:42:17 devstack sudo[104065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:42:17 devstack sudo[104065]: pam_unix(sudo:session): session closed for user root Aug 03 08:42:17 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-29b43ddd-8f09-4de9-8a27-dd9cf13f9263 tempest-VolumesActionsTest-1152451848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-46dbdec8-5da6-4028-832e-bb6b43a7390d 1073741824" returned: 0 in 0.569s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:42:17 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-29b43ddd-8f09-4de9-8a27-dd9cf13f9263 tempest-VolumesActionsTest-1152451848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-46dbdec8-5da6-4028-832e-bb6b43a7390d {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:42:17 devstack sudo[104071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-46dbdec8-5da6-4028-832e-bb6b43a7390d Aug 03 08:42:17 devstack sudo[104071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:42:18 devstack sudo[104071]: pam_unix(sudo:session): session closed for user root Aug 03 08:42:18 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-29b43ddd-8f09-4de9-8a27-dd9cf13f9263 tempest-VolumesActionsTest-1152451848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-46dbdec8-5da6-4028-832e-bb6b43a7390d" returned: 0 in 0.316s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:42:18 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-29b43ddd-8f09-4de9-8a27-dd9cf13f9263 tempest-VolumesActionsTest-1152451848 None] <== create_volume: return (945ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'} {{(pid=88899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 08:42:18 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-29b43ddd-8f09-4de9-8a27-dd9cf13f9263 tempest-VolumesActionsTest-1152451848 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.951s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:42:18 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-29b43ddd-8f09-4de9-8a27-dd9cf13f9263 tempest-VolumesActionsTest-1152451848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd03a25d-92a0-4fa9-9c8f-0a17003014fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-46dbdec8-5da6-4028-832e-bb6b43a7390d', 'volume_size': 1}' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:42:18 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-29b43ddd-8f09-4de9-8a27-dd9cf13f9263 tempest-VolumesActionsTest-1152451848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aae3a913-9060-46fe-aedc-e474a5c9b3c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:42:18 devstack cinder-volume[88899]: INFO cinder.volume.flows.manager.create_volume [None req-29b43ddd-8f09-4de9-8a27-dd9cf13f9263 tempest-VolumesActionsTest-1152451848 None] Volume volume-46dbdec8-5da6-4028-832e-bb6b43a7390d (46dbdec8-5da6-4028-832e-bb6b43a7390d): created successfully Aug 03 08:42:18 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-29b43ddd-8f09-4de9-8a27-dd9cf13f9263 tempest-VolumesActionsTest-1152451848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aae3a913-9060-46fe-aedc-e474a5c9b3c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:42:18 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-29b43ddd-8f09-4de9-8a27-dd9cf13f9263 tempest-VolumesActionsTest-1152451848 None] Flow 'volume_create_manager' (4fa15cfd-138e-4dd8-9ddc-849b6c790fce) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:42:18 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-29b43ddd-8f09-4de9-8a27-dd9cf13f9263 tempest-VolumesActionsTest-1152451848 None] Created volume successfully. Aug 03 08:42:28 devstack cinder-volume[88899]: DEBUG dbcounter [-] [88899] Writing DB stats cinder:UPDATE=23,cinder:SELECT=11,cinder:INSERT=6,cinder:DELETE=2 {{(pid=88899) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 03 08:42:28 devstack cinder-volume[88899]: DEBUG dbcounter [-] [88899] Writing DB stats cinder:SELECT=141,cinder:INSERT=38,cinder:UPDATE=178,cinder:DELETE=14 {{(pid=88899) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 03 08:42:47 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-afd36821-a57e-47aa-82a0-04c01048815e tempest-VolumesActionsTest-1152451848 None] Acquiring lock "cinder-46dbdec8-5da6-4028-832e-bb6b43a7390d" by "attach_volume" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:42:47 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-afd36821-a57e-47aa-82a0-04c01048815e tempest-VolumesActionsTest-1152451848 None] Lock "cinder-46dbdec8-5da6-4028-832e-bb6b43a7390d" acquired by "attach_volume" :: waited 0.030s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:42:47 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-afd36821-a57e-47aa-82a0-04c01048815e tempest-VolumesActionsTest-1152451848 None] Attaching volume 46dbdec8-5da6-4028-832e-bb6b43a7390d to instance 5c0784e2-3401-458a-889a-a4613a8bafbb at mountpoint /dev/vdb on host None. Aug 03 08:42:47 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-afd36821-a57e-47aa-82a0-04c01048815e tempest-VolumesActionsTest-1152451848 None] Attach volume completed successfully. Aug 03 08:42:47 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-afd36821-a57e-47aa-82a0-04c01048815e tempest-VolumesActionsTest-1152451848 None] Lock "cinder-46dbdec8-5da6-4028-832e-bb6b43a7390d" released by "attach_volume" :: held 0.129s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:42:47 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-df28b553-95e5-4f14-bbac-8e71cc3a1f17 tempest-VolumesActionsTest-1152451848 None] Acquiring lock "cinder-46dbdec8-5da6-4028-832e-bb6b43a7390d-detach_volume" by "detach_volume" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:42:47 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-df28b553-95e5-4f14-bbac-8e71cc3a1f17 tempest-VolumesActionsTest-1152451848 None] Lock "cinder-46dbdec8-5da6-4028-832e-bb6b43a7390d-detach_volume" acquired by "detach_volume" :: waited 0.040s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:42:47 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-df28b553-95e5-4f14-bbac-8e71cc3a1f17 tempest-VolumesActionsTest-1152451848 None] Detaching volume 46dbdec8-5da6-4028-832e-bb6b43a7390d from instance 5c0784e2-3401-458a-889a-a4613a8bafbb. Aug 03 08:42:47 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-df28b553-95e5-4f14-bbac-8e71cc3a1f17 tempest-VolumesActionsTest-1152451848 None] Detach volume completed successfully. Aug 03 08:42:47 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-df28b553-95e5-4f14-bbac-8e71cc3a1f17 tempest-VolumesActionsTest-1152451848 None] Lock "cinder-46dbdec8-5da6-4028-832e-bb6b43a7390d-detach_volume" released by "detach_volume" :: held 0.122s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:42:51 devstack cinder-volume[88899]: DEBUG oslo_service.periodic_task [None req-f948fb4a-c4d7-499f-b1bd-8d6be3de0b53 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88899) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 03 08:42:51 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-f948fb4a-c4d7-499f-b1bd-8d6be3de0b53 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:42:51 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-f948fb4a-c4d7-499f-b1bd-8d6be3de0b53 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:42:51 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-f948fb4a-c4d7-499f-b1bd-8d6be3de0b53 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:42:51 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-f948fb4a-c4d7-499f-b1bd-8d6be3de0b53 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:42:51 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-f948fb4a-c4d7-499f-b1bd-8d6be3de0b53 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:42:51 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-f948fb4a-c4d7-499f-b1bd-8d6be3de0b53 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:42:52 devstack sudo[104355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a Aug 03 08:42:52 devstack sudo[104355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:42:52 devstack sudo[104355]: pam_unix(sudo:session): session closed for user root Aug 03 08:42:52 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-f948fb4a-c4d7-499f-b1bd-8d6be3de0b53 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a" returned: 0 in 0.538s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:42:52 devstack cinder-volume[88899]: DEBUG cinder.manager [None req-f948fb4a-c4d7-499f-b1bd-8d6be3de0b53 None None] Notifying Schedulers of capabilities ... {{(pid=88899) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 08:42:52 devstack cinder-volume[88899]: DEBUG oslo_service.periodic_task [None req-f948fb4a-c4d7-499f-b1bd-8d6be3de0b53 None None] Running periodic task VolumeManager._thread_info {{(pid=88899) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 03 08:42:52 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-f948fb4a-c4d7-499f-b1bd-8d6be3de0b53 None None] thread count: 28 {{(pid=88899) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 03 08:42:52 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-f948fb4a-c4d7-499f-b1bd-8d6be3de0b53 None None] thread info: [<_MainThread(MainThread, started 132234320248960)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88899) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 03 08:42:54 devstack cinder-volume[88899]: DEBUG cinder.volume.flows.manager.create_volume [None req-0b842df7-04b5-4687-8274-a6adf3f2c5a1 tempest-TestMinimumBasicScenario-933065941 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88899) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 08:42:54 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-0b842df7-04b5-4687-8274-a6adf3f2c5a1 tempest-TestMinimumBasicScenario-933065941 None] Flow 'volume_create_manager' (5e5e6eeb-59d2-4bf6-bd8c-87796e309c41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:42:54 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-0b842df7-04b5-4687-8274-a6adf3f2c5a1 tempest-TestMinimumBasicScenario-933065941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27a1638b-a032-46ca-9ac5-b242ee01d23c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:42:54 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-0b842df7-04b5-4687-8274-a6adf3f2c5a1 tempest-TestMinimumBasicScenario-933065941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27a1638b-a032-46ca-9ac5-b242ee01d23c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:42:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1582303675',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2dd20c13-f7ea-4655-9c44-496636093ce2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8d32d8502bd24083ae13570b7d5f3db0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:42:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:42:54Z,use_quota=True,user_id='cf166fd662f7479b84fbc1917a50e0b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8bde7129-1dc4-42ab-b852-ab32c61b4921),volume_type_id=8bde7129-1dc4-42ab-b852-ab32c61b4921)' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:42:54 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-0b842df7-04b5-4687-8274-a6adf3f2c5a1 tempest-TestMinimumBasicScenario-933065941 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f079e317-0d07-47ba-b7a8-b7bd4fc1a893) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:42:54 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-0b842df7-04b5-4687-8274-a6adf3f2c5a1 tempest-TestMinimumBasicScenario-933065941 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f079e317-0d07-47ba-b7a8-b7bd4fc1a893) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:42:54 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-0b842df7-04b5-4687-8274-a6adf3f2c5a1 tempest-TestMinimumBasicScenario-933065941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (50b7a8fc-932b-4966-b351-c87e70982f3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:42:54 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-0b842df7-04b5-4687-8274-a6adf3f2c5a1 tempest-TestMinimumBasicScenario-933065941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (50b7a8fc-932b-4966-b351-c87e70982f3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2dd20c13-f7ea-4655-9c44-496636093ce2', 'volume_name': 'volume-2dd20c13-f7ea-4655-9c44-496636093ce2', 'volume_size': 1}' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:42:54 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-0b842df7-04b5-4687-8274-a6adf3f2c5a1 tempest-TestMinimumBasicScenario-933065941 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79ed70cc-2e9c-49bc-9331-f6cc310870d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:42:54 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-0b842df7-04b5-4687-8274-a6adf3f2c5a1 tempest-TestMinimumBasicScenario-933065941 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79ed70cc-2e9c-49bc-9331-f6cc310870d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:42:54 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-0b842df7-04b5-4687-8274-a6adf3f2c5a1 tempest-TestMinimumBasicScenario-933065941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7aaf342-1021-4989-ba7d-87075c138813) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:42:54 devstack cinder-volume[88899]: INFO cinder.volume.flows.manager.create_volume [None req-0b842df7-04b5-4687-8274-a6adf3f2c5a1 tempest-TestMinimumBasicScenario-933065941 None] Volume 2dd20c13-f7ea-4655-9c44-496636093ce2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2dd20c13-f7ea-4655-9c44-496636093ce2', 'volume_size': 1} Aug 03 08:42:54 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-0b842df7-04b5-4687-8274-a6adf3f2c5a1 tempest-TestMinimumBasicScenario-933065941 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:42:54 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-0b842df7-04b5-4687-8274-a6adf3f2c5a1 tempest-TestMinimumBasicScenario-933065941 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:42:54 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-0b842df7-04b5-4687-8274-a6adf3f2c5a1 tempest-TestMinimumBasicScenario-933065941 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:42:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1582303675',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2dd20c13-f7ea-4655-9c44-496636093ce2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8d32d8502bd24083ae13570b7d5f3db0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:42:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:42:54Z,use_quota=True,user_id='cf166fd662f7479b84fbc1917a50e0b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8bde7129-1dc4-42ab-b852-ab32c61b4921),volume_type_id=8bde7129-1dc4-42ab-b852-ab32c61b4921)}" {{(pid=88899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 08:42:54 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-0b842df7-04b5-4687-8274-a6adf3f2c5a1 tempest-TestMinimumBasicScenario-933065941 None] Creating volume 2dd20c13-f7ea-4655-9c44-496636093ce2 {{(pid=88899) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 08:42:54 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-0b842df7-04b5-4687-8274-a6adf3f2c5a1 tempest-TestMinimumBasicScenario-933065941 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:42:54 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-0b842df7-04b5-4687-8274-a6adf3f2c5a1 tempest-TestMinimumBasicScenario-933065941 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:42:54 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-0b842df7-04b5-4687-8274-a6adf3f2c5a1 tempest-TestMinimumBasicScenario-933065941 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:42:54 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-0b842df7-04b5-4687-8274-a6adf3f2c5a1 tempest-TestMinimumBasicScenario-933065941 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:42:54 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-0b842df7-04b5-4687-8274-a6adf3f2c5a1 tempest-TestMinimumBasicScenario-933065941 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:42:54 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-0b842df7-04b5-4687-8274-a6adf3f2c5a1 tempest-TestMinimumBasicScenario-933065941 None] Selected osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385 as target Quobyte volume. {{(pid=88899) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 08:42:54 devstack cinder-volume[88899]: INFO cinder.volume.drivers.remotefs [None req-0b842df7-04b5-4687-8274-a6adf3f2c5a1 tempest-TestMinimumBasicScenario-933065941 None] casted to osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385 Aug 03 08:42:54 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-0b842df7-04b5-4687-8274-a6adf3f2c5a1 tempest-TestMinimumBasicScenario-933065941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-2dd20c13-f7ea-4655-9c44-496636093ce2 1073741824 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:42:54 devstack sudo[104361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-2dd20c13-f7ea-4655-9c44-496636093ce2 1073741824 Aug 03 08:42:54 devstack sudo[104361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:42:55 devstack sudo[104361]: pam_unix(sudo:session): session closed for user root Aug 03 08:42:55 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-0b842df7-04b5-4687-8274-a6adf3f2c5a1 tempest-TestMinimumBasicScenario-933065941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-2dd20c13-f7ea-4655-9c44-496636093ce2 1073741824" returned: 0 in 0.578s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:42:55 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-0b842df7-04b5-4687-8274-a6adf3f2c5a1 tempest-TestMinimumBasicScenario-933065941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-2dd20c13-f7ea-4655-9c44-496636093ce2 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:42:55 devstack sudo[104367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-2dd20c13-f7ea-4655-9c44-496636093ce2 Aug 03 08:42:55 devstack sudo[104367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:42:55 devstack sudo[104367]: pam_unix(sudo:session): session closed for user root Aug 03 08:42:55 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-0b842df7-04b5-4687-8274-a6adf3f2c5a1 tempest-TestMinimumBasicScenario-933065941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-2dd20c13-f7ea-4655-9c44-496636093ce2" returned: 0 in 0.383s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:42:55 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-0b842df7-04b5-4687-8274-a6adf3f2c5a1 tempest-TestMinimumBasicScenario-933065941 None] <== create_volume: return (1025ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'} {{(pid=88899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 08:42:55 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-0b842df7-04b5-4687-8274-a6adf3f2c5a1 tempest-TestMinimumBasicScenario-933065941 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.028s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:42:55 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-0b842df7-04b5-4687-8274-a6adf3f2c5a1 tempest-TestMinimumBasicScenario-933065941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7aaf342-1021-4989-ba7d-87075c138813) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2dd20c13-f7ea-4655-9c44-496636093ce2', 'volume_size': 1}' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:42:55 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-0b842df7-04b5-4687-8274-a6adf3f2c5a1 tempest-TestMinimumBasicScenario-933065941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (956280eb-7f52-47d3-9b73-3664667f7f83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:42:55 devstack cinder-volume[88899]: INFO cinder.volume.flows.manager.create_volume [None req-0b842df7-04b5-4687-8274-a6adf3f2c5a1 tempest-TestMinimumBasicScenario-933065941 None] Volume volume-2dd20c13-f7ea-4655-9c44-496636093ce2 (2dd20c13-f7ea-4655-9c44-496636093ce2): created successfully Aug 03 08:42:55 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-0b842df7-04b5-4687-8274-a6adf3f2c5a1 tempest-TestMinimumBasicScenario-933065941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (956280eb-7f52-47d3-9b73-3664667f7f83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:42:55 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-0b842df7-04b5-4687-8274-a6adf3f2c5a1 tempest-TestMinimumBasicScenario-933065941 None] Flow 'volume_create_manager' (5e5e6eeb-59d2-4bf6-bd8c-87796e309c41) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:42:55 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-0b842df7-04b5-4687-8274-a6adf3f2c5a1 tempest-TestMinimumBasicScenario-933065941 None] Created volume successfully. Aug 03 08:42:58 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [req-c2537a50-fd1e-47e8-bc32-f500a480e80e req-68e3bd84-8546-44e1-921f-3c8112a1a796 tempest-TestMinimumBasicScenario-933065941 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:42:58 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [req-c2537a50-fd1e-47e8-bc32-f500a480e80e req-68e3bd84-8546-44e1-921f-3c8112a1a796 tempest-TestMinimumBasicScenario-933065941 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:42:58 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [req-c2537a50-fd1e-47e8-bc32-f500a480e80e req-68e3bd84-8546-44e1-921f-3c8112a1a796 tempest-TestMinimumBasicScenario-933065941 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.023s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:42:58 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [req-c2537a50-fd1e-47e8-bc32-f500a480e80e req-68e3bd84-8546-44e1-921f-3c8112a1a796 tempest-TestMinimumBasicScenario-933065941 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385', 'name': 'volume-2dd20c13-f7ea-4655-9c44-496636093ce2', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '4e1d090d-82fb-4c5e-be62-4d7ea22ebd32', 'enforce_multipath': True} {{(pid=88899) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 03 08:42:58 devstack cinder-volume[88899]: INFO cinder.volume.manager [req-c2537a50-fd1e-47e8-bc32-f500a480e80e req-68e3bd84-8546-44e1-921f-3c8112a1a796 tempest-TestMinimumBasicScenario-933065941 None] attachment_update completed successfully. Aug 03 08:43:08 devstack cinder-volume[88899]: DEBUG dbcounter [-] [88899] Writing DB stats cinder:SELECT=16,cinder:INSERT=3,cinder:UPDATE=4,cinder:DELETE=1 {{(pid=88899) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 03 08:43:08 devstack cinder-volume[88899]: DEBUG dbcounter [-] [88899] Writing DB stats cinder:SELECT=14,cinder:UPDATE=11 {{(pid=88899) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 03 08:43:08 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-a7ed00d3-060f-4e13-a1ca-cc62e9e932d8 tempest-VolumesActionsTest-1152451848 None] Acquiring lock "cinder-46dbdec8-5da6-4028-832e-bb6b43a7390d" by "attach_volume" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:43:08 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-a7ed00d3-060f-4e13-a1ca-cc62e9e932d8 tempest-VolumesActionsTest-1152451848 None] Lock "cinder-46dbdec8-5da6-4028-832e-bb6b43a7390d" acquired by "attach_volume" :: waited 0.032s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:43:09 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-a7ed00d3-060f-4e13-a1ca-cc62e9e932d8 tempest-VolumesActionsTest-1152451848 None] Attaching volume 46dbdec8-5da6-4028-832e-bb6b43a7390d to instance 370d86f2-521e-407a-af3d-c90ff2202002 at mountpoint /dev/vdb on host None. Aug 03 08:43:09 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-a7ed00d3-060f-4e13-a1ca-cc62e9e932d8 tempest-VolumesActionsTest-1152451848 None] Attach volume completed successfully. Aug 03 08:43:09 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-a7ed00d3-060f-4e13-a1ca-cc62e9e932d8 tempest-VolumesActionsTest-1152451848 None] Lock "cinder-46dbdec8-5da6-4028-832e-bb6b43a7390d" released by "attach_volume" :: held 0.194s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:43:09 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-85fe041e-8be3-454d-9b8c-aa126c0dec8d tempest-VolumesActionsTest-1152451848 None] Acquiring lock "cinder-46dbdec8-5da6-4028-832e-bb6b43a7390d-detach_volume" by "detach_volume" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:43:09 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-85fe041e-8be3-454d-9b8c-aa126c0dec8d tempest-VolumesActionsTest-1152451848 None] Lock "cinder-46dbdec8-5da6-4028-832e-bb6b43a7390d-detach_volume" acquired by "detach_volume" :: waited 0.027s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:43:09 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-85fe041e-8be3-454d-9b8c-aa126c0dec8d tempest-VolumesActionsTest-1152451848 None] Detaching volume 46dbdec8-5da6-4028-832e-bb6b43a7390d from instance 370d86f2-521e-407a-af3d-c90ff2202002. Aug 03 08:43:09 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-85fe041e-8be3-454d-9b8c-aa126c0dec8d tempest-VolumesActionsTest-1152451848 None] Detach volume completed successfully. Aug 03 08:43:09 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-85fe041e-8be3-454d-9b8c-aa126c0dec8d tempest-VolumesActionsTest-1152451848 None] Lock "cinder-46dbdec8-5da6-4028-832e-bb6b43a7390d-detach_volume" released by "detach_volume" :: held 0.102s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:43:15 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-f3393d46-68ce-4a34-94c0-ac4a904aafcd tempest-VolumesActionsTest-1152451848 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:43:15 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-f3393d46-68ce-4a34-94c0-ac4a904aafcd tempest-VolumesActionsTest-1152451848 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:43:15 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[346931f4-4cd2-495c-86f5-f4afb0bf7fd3]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:43:15 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-f3393d46-68ce-4a34-94c0-ac4a904aafcd tempest-VolumesActionsTest-1152451848 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-46dbdec8-5da6-4028-832e-bb6b43a7390d {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:43:15 devstack sudo[104978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-46dbdec8-5da6-4028-832e-bb6b43a7390d Aug 03 08:43:15 devstack sudo[104978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:43:15 devstack sudo[104978]: pam_unix(sudo:session): session closed for user root Aug 03 08:43:15 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-f3393d46-68ce-4a34-94c0-ac4a904aafcd tempest-VolumesActionsTest-1152451848 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-46dbdec8-5da6-4028-832e-bb6b43a7390d" returned: 0 in 0.405s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:43:15 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[39bb1013-f4d2-4984-8218-30d6158f08cf]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:43:15 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-f3393d46-68ce-4a34-94c0-ac4a904aafcd tempest-VolumesActionsTest-1152451848 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-46dbdec8-5da6-4028-832e-bb6b43a7390d {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:43:15 devstack sudo[104985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-46dbdec8-5da6-4028-832e-bb6b43a7390d Aug 03 08:43:15 devstack sudo[104985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:43:16 devstack sudo[104985]: pam_unix(sudo:session): session closed for user root Aug 03 08:43:16 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-f3393d46-68ce-4a34-94c0-ac4a904aafcd tempest-VolumesActionsTest-1152451848 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-46dbdec8-5da6-4028-832e-bb6b43a7390d" returned: 0 in 0.533s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:43:16 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-f3393d46-68ce-4a34-94c0-ac4a904aafcd tempest-VolumesActionsTest-1152451848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-46dbdec8-5da6-4028-832e-bb6b43a7390d /opt/stack/data/cinder/conversion/46dbdec8-5da6-4028-832e-bb6b43a7390d.temp_image.4d0f71ef-4c04-42e8-bd5f-cd83db591f2e7c1yplzs.img {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:43:16 devstack sudo[104991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-46dbdec8-5da6-4028-832e-bb6b43a7390d /opt/stack/data/cinder/conversion/46dbdec8-5da6-4028-832e-bb6b43a7390d.temp_image.4d0f71ef-4c04-42e8-bd5f-cd83db591f2e7c1yplzs.img Aug 03 08:43:16 devstack sudo[104991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:43:19 devstack cinder-volume[88899]: DEBUG dbcounter [-] [88899] Writing DB stats cinder:SELECT=5,cinder:UPDATE=5,cinder:INSERT=1 {{(pid=88899) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 03 08:43:22 devstack sudo[104991]: pam_unix(sudo:session): session closed for user root Aug 03 08:43:22 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-f3393d46-68ce-4a34-94c0-ac4a904aafcd tempest-VolumesActionsTest-1152451848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-46dbdec8-5da6-4028-832e-bb6b43a7390d /opt/stack/data/cinder/conversion/46dbdec8-5da6-4028-832e-bb6b43a7390d.temp_image.4d0f71ef-4c04-42e8-bd5f-cd83db591f2e7c1yplzs.img" returned: 0 in 6.406s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:43:22 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[d25516e6-df70-4ac8-9e6e-e41dc4997829]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:43:22 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-f3393d46-68ce-4a34-94c0-ac4a904aafcd tempest-VolumesActionsTest-1152451848 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-46dbdec8-5da6-4028-832e-bb6b43a7390d {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:43:22 devstack sudo[105136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-46dbdec8-5da6-4028-832e-bb6b43a7390d Aug 03 08:43:22 devstack sudo[105136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:43:23 devstack sudo[105136]: pam_unix(sudo:session): session closed for user root Aug 03 08:43:23 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-f3393d46-68ce-4a34-94c0-ac4a904aafcd tempest-VolumesActionsTest-1152451848 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-46dbdec8-5da6-4028-832e-bb6b43a7390d" returned: 0 in 0.585s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:43:23 devstack cinder-volume[88899]: DEBUG cinder.image.image_utils [None req-f3393d46-68ce-4a34-94c0-ac4a904aafcd tempest-VolumesActionsTest-1152451848 None] Image conversion details: src /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-46dbdec8-5da6-4028-832e-bb6b43a7390d, size 1024.00 MB, duration 6.41 sec, destination /opt/stack/data/cinder/conversion/46dbdec8-5da6-4028-832e-bb6b43a7390d.temp_image.4d0f71ef-4c04-42e8-bd5f-cd83db591f2e7c1yplzs.img {{(pid=88899) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 03 08:43:23 devstack cinder-volume[88899]: INFO cinder.image.image_utils [None req-f3393d46-68ce-4a34-94c0-ac4a904aafcd tempest-VolumesActionsTest-1152451848 None] Converted 1024.00 MB image at 159.84 MB/s Aug 03 08:43:23 devstack cinder-volume[88899]: DEBUG cinder.image.image_utils [None req-f3393d46-68ce-4a34-94c0-ac4a904aafcd tempest-VolumesActionsTest-1152451848 None] 4d0f71ef-4c04-42e8-bd5f-cd83db591f2e was raw, no need to convert to raw {{(pid=88899) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}} Aug 03 08:43:33 devstack cinder-volume[88899]: DEBUG dbcounter [-] [88899] Writing DB stats cinder:INSERT=1,cinder:SELECT=11,cinder:UPDATE=1 {{(pid=88899) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 03 08:43:45 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-f3393d46-68ce-4a34-94c0-ac4a904aafcd tempest-VolumesActionsTest-1152451848 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 30.355s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:43:45 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-f3393d46-68ce-4a34-94c0-ac4a904aafcd tempest-VolumesActionsTest-1152451848 None] Uploaded volume to glance image-id: 4d0f71ef-4c04-42e8-bd5f-cd83db591f2e. {{(pid=88899) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Aug 03 08:43:45 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-f3393d46-68ce-4a34-94c0-ac4a904aafcd tempest-VolumesActionsTest-1152451848 None] Copy volume to image completed successfully. Aug 03 08:43:47 devstack cinder-volume[88899]: DEBUG cinder.volume.flows.manager.create_volume [None req-4988436c-f2c7-47f5-b84c-423d68454665 tempest-TestServerVolumeAttachScenarioOldVersion-2074048030 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88899) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 08:43:47 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-4988436c-f2c7-47f5-b84c-423d68454665 tempest-TestServerVolumeAttachScenarioOldVersion-2074048030 None] Flow 'volume_create_manager' (6bc07859-9b16-43ec-ad45-298adc8fce6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:43:47 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-4988436c-f2c7-47f5-b84c-423d68454665 tempest-TestServerVolumeAttachScenarioOldVersion-2074048030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a11e746-b3e9-4ed9-bacf-ac56b0f6a5c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:43:47 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-4988436c-f2c7-47f5-b84c-423d68454665 tempest-TestServerVolumeAttachScenarioOldVersion-2074048030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a11e746-b3e9-4ed9-bacf-ac56b0f6a5c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:43:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-652375244',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c95b91e-fef7-427a-868c-a3deac459fcb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='738bc33b5bba49e69864725ab7ca5b2f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:43:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:43:47Z,use_quota=True,user_id='9698e766c68142489d02c5a7e26ba940',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8bde7129-1dc4-42ab-b852-ab32c61b4921),volume_type_id=8bde7129-1dc4-42ab-b852-ab32c61b4921)' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:43:47 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-4988436c-f2c7-47f5-b84c-423d68454665 tempest-TestServerVolumeAttachScenarioOldVersion-2074048030 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (270387fd-7ad9-4d8c-b4a2-976bd0ed981c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:43:47 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-4988436c-f2c7-47f5-b84c-423d68454665 tempest-TestServerVolumeAttachScenarioOldVersion-2074048030 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (270387fd-7ad9-4d8c-b4a2-976bd0ed981c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:43:47 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-4988436c-f2c7-47f5-b84c-423d68454665 tempest-TestServerVolumeAttachScenarioOldVersion-2074048030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b5b4f4c-d0bb-410b-b5fe-8cc0da1648d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:43:47 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-4988436c-f2c7-47f5-b84c-423d68454665 tempest-TestServerVolumeAttachScenarioOldVersion-2074048030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b5b4f4c-d0bb-410b-b5fe-8cc0da1648d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7c95b91e-fef7-427a-868c-a3deac459fcb', 'volume_name': 'volume-7c95b91e-fef7-427a-868c-a3deac459fcb', 'volume_size': 1}' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:43:47 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-4988436c-f2c7-47f5-b84c-423d68454665 tempest-TestServerVolumeAttachScenarioOldVersion-2074048030 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db451fc5-c84c-4b25-a818-0e3f224ed606) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:43:47 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-4988436c-f2c7-47f5-b84c-423d68454665 tempest-TestServerVolumeAttachScenarioOldVersion-2074048030 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db451fc5-c84c-4b25-a818-0e3f224ed606) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:43:47 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-4988436c-f2c7-47f5-b84c-423d68454665 tempest-TestServerVolumeAttachScenarioOldVersion-2074048030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6697684f-e914-4135-b2a2-9127f1b0f828) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:43:47 devstack cinder-volume[88899]: INFO cinder.volume.flows.manager.create_volume [None req-4988436c-f2c7-47f5-b84c-423d68454665 tempest-TestServerVolumeAttachScenarioOldVersion-2074048030 None] Volume 7c95b91e-fef7-427a-868c-a3deac459fcb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7c95b91e-fef7-427a-868c-a3deac459fcb', 'volume_size': 1} Aug 03 08:43:47 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-4988436c-f2c7-47f5-b84c-423d68454665 tempest-TestServerVolumeAttachScenarioOldVersion-2074048030 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:43:47 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-4988436c-f2c7-47f5-b84c-423d68454665 tempest-TestServerVolumeAttachScenarioOldVersion-2074048030 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:43:47 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-4988436c-f2c7-47f5-b84c-423d68454665 tempest-TestServerVolumeAttachScenarioOldVersion-2074048030 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:43:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-652375244',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c95b91e-fef7-427a-868c-a3deac459fcb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='738bc33b5bba49e69864725ab7ca5b2f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:43:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:43:47Z,use_quota=True,user_id='9698e766c68142489d02c5a7e26ba940',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8bde7129-1dc4-42ab-b852-ab32c61b4921),volume_type_id=8bde7129-1dc4-42ab-b852-ab32c61b4921)}" {{(pid=88899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 08:43:47 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-4988436c-f2c7-47f5-b84c-423d68454665 tempest-TestServerVolumeAttachScenarioOldVersion-2074048030 None] Creating volume 7c95b91e-fef7-427a-868c-a3deac459fcb {{(pid=88899) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 08:43:47 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-4988436c-f2c7-47f5-b84c-423d68454665 tempest-TestServerVolumeAttachScenarioOldVersion-2074048030 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:43:47 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-4988436c-f2c7-47f5-b84c-423d68454665 tempest-TestServerVolumeAttachScenarioOldVersion-2074048030 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:43:47 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-4988436c-f2c7-47f5-b84c-423d68454665 tempest-TestServerVolumeAttachScenarioOldVersion-2074048030 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:43:47 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-4988436c-f2c7-47f5-b84c-423d68454665 tempest-TestServerVolumeAttachScenarioOldVersion-2074048030 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:43:47 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-4988436c-f2c7-47f5-b84c-423d68454665 tempest-TestServerVolumeAttachScenarioOldVersion-2074048030 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:43:47 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-4988436c-f2c7-47f5-b84c-423d68454665 tempest-TestServerVolumeAttachScenarioOldVersion-2074048030 None] Selected osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385 as target Quobyte volume. {{(pid=88899) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 08:43:47 devstack cinder-volume[88899]: INFO cinder.volume.drivers.remotefs [None req-4988436c-f2c7-47f5-b84c-423d68454665 tempest-TestServerVolumeAttachScenarioOldVersion-2074048030 None] casted to osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385 Aug 03 08:43:47 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-4988436c-f2c7-47f5-b84c-423d68454665 tempest-TestServerVolumeAttachScenarioOldVersion-2074048030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-7c95b91e-fef7-427a-868c-a3deac459fcb 1073741824 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:43:47 devstack sudo[105205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-7c95b91e-fef7-427a-868c-a3deac459fcb 1073741824 Aug 03 08:43:47 devstack sudo[105205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:43:47 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-04b5c575-f1dd-4d5b-b677-e3158baa9d7c tempest-VolumesActionsTest-1152451848 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:43:47 devstack sudo[105205]: pam_unix(sudo:session): session closed for user root Aug 03 08:43:47 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-4988436c-f2c7-47f5-b84c-423d68454665 tempest-TestServerVolumeAttachScenarioOldVersion-2074048030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-7c95b91e-fef7-427a-868c-a3deac459fcb 1073741824" returned: 0 in 0.435s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:43:47 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-4988436c-f2c7-47f5-b84c-423d68454665 tempest-TestServerVolumeAttachScenarioOldVersion-2074048030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-7c95b91e-fef7-427a-868c-a3deac459fcb {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:43:47 devstack sudo[105211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-7c95b91e-fef7-427a-868c-a3deac459fcb Aug 03 08:43:47 devstack sudo[105211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:43:47 devstack sudo[105211]: pam_unix(sudo:session): session closed for user root Aug 03 08:43:47 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-4988436c-f2c7-47f5-b84c-423d68454665 tempest-TestServerVolumeAttachScenarioOldVersion-2074048030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-7c95b91e-fef7-427a-868c-a3deac459fcb" returned: 0 in 0.292s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:43:47 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-4988436c-f2c7-47f5-b84c-423d68454665 tempest-TestServerVolumeAttachScenarioOldVersion-2074048030 None] <== create_volume: return (774ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'} {{(pid=88899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 08:43:47 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-4988436c-f2c7-47f5-b84c-423d68454665 tempest-TestServerVolumeAttachScenarioOldVersion-2074048030 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.777s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:43:47 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-04b5c575-f1dd-4d5b-b677-e3158baa9d7c tempest-VolumesActionsTest-1152451848 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.740s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:43:47 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-4988436c-f2c7-47f5-b84c-423d68454665 tempest-TestServerVolumeAttachScenarioOldVersion-2074048030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6697684f-e914-4135-b2a2-9127f1b0f828) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7c95b91e-fef7-427a-868c-a3deac459fcb', 'volume_size': 1}' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:43:47 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-4988436c-f2c7-47f5-b84c-423d68454665 tempest-TestServerVolumeAttachScenarioOldVersion-2074048030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0aaa51ec-d4f8-463e-a0b9-dff179becb00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:43:47 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e934b9f-e289-4301-84e7-6edf6a582aeb]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:43:47 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-04b5c575-f1dd-4d5b-b677-e3158baa9d7c tempest-VolumesActionsTest-1152451848 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-46dbdec8-5da6-4028-832e-bb6b43a7390d {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:43:47 devstack cinder-volume[88899]: INFO cinder.volume.flows.manager.create_volume [None req-4988436c-f2c7-47f5-b84c-423d68454665 tempest-TestServerVolumeAttachScenarioOldVersion-2074048030 None] Volume volume-7c95b91e-fef7-427a-868c-a3deac459fcb (7c95b91e-fef7-427a-868c-a3deac459fcb): created successfully Aug 03 08:43:47 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-4988436c-f2c7-47f5-b84c-423d68454665 tempest-TestServerVolumeAttachScenarioOldVersion-2074048030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0aaa51ec-d4f8-463e-a0b9-dff179becb00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:43:48 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-4988436c-f2c7-47f5-b84c-423d68454665 tempest-TestServerVolumeAttachScenarioOldVersion-2074048030 None] Flow 'volume_create_manager' (6bc07859-9b16-43ec-ad45-298adc8fce6a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:43:48 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-4988436c-f2c7-47f5-b84c-423d68454665 tempest-TestServerVolumeAttachScenarioOldVersion-2074048030 None] Created volume successfully. Aug 03 08:43:48 devstack sudo[105214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-46dbdec8-5da6-4028-832e-bb6b43a7390d Aug 03 08:43:48 devstack sudo[105214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:43:48 devstack sudo[105214]: pam_unix(sudo:session): session closed for user root Aug 03 08:43:48 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-04b5c575-f1dd-4d5b-b677-e3158baa9d7c tempest-VolumesActionsTest-1152451848 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-46dbdec8-5da6-4028-832e-bb6b43a7390d" returned: 0 in 0.432s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:43:48 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[35db0aef-794c-4c8c-9191-352a024f0eff]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:43:48 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-04b5c575-f1dd-4d5b-b677-e3158baa9d7c tempest-VolumesActionsTest-1152451848 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-46dbdec8-5da6-4028-832e-bb6b43a7390d {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:43:48 devstack sudo[105221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-46dbdec8-5da6-4028-832e-bb6b43a7390d Aug 03 08:43:48 devstack sudo[105221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:43:48 devstack sudo[105221]: pam_unix(sudo:session): session closed for user root Aug 03 08:43:48 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-04b5c575-f1dd-4d5b-b677-e3158baa9d7c tempest-VolumesActionsTest-1152451848 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-46dbdec8-5da6-4028-832e-bb6b43a7390d" returned: 0 in 0.347s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:43:48 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-04b5c575-f1dd-4d5b-b677-e3158baa9d7c tempest-VolumesActionsTest-1152451848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-46dbdec8-5da6-4028-832e-bb6b43a7390d /opt/stack/data/cinder/conversion/46dbdec8-5da6-4028-832e-bb6b43a7390d.temp_image.907c4408-b689-489e-ac8a-bf792b0174f7c456fi77.img {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:43:48 devstack sudo[105226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-46dbdec8-5da6-4028-832e-bb6b43a7390d /opt/stack/data/cinder/conversion/46dbdec8-5da6-4028-832e-bb6b43a7390d.temp_image.907c4408-b689-489e-ac8a-bf792b0174f7c456fi77.img Aug 03 08:43:48 devstack sudo[105226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:43:51 devstack cinder-volume[88899]: DEBUG oslo_service.periodic_task [None req-f948fb4a-c4d7-499f-b1bd-8d6be3de0b53 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88899) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 03 08:43:51 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-f948fb4a-c4d7-499f-b1bd-8d6be3de0b53 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:43:51 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-f948fb4a-c4d7-499f-b1bd-8d6be3de0b53 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:43:51 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-f948fb4a-c4d7-499f-b1bd-8d6be3de0b53 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:43:51 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-f948fb4a-c4d7-499f-b1bd-8d6be3de0b53 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:43:51 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-f948fb4a-c4d7-499f-b1bd-8d6be3de0b53 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:43:51 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-f948fb4a-c4d7-499f-b1bd-8d6be3de0b53 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:43:52 devstack sudo[105251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a Aug 03 08:43:52 devstack sudo[105251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:43:52 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [req-b8ca2ac4-0d63-462d-bc7d-1be9ab3f2701 req-f9f20c37-755d-43c3-9383-572a6c269f01 tempest-TestServerVolumeAttachScenarioOldVersion-2074048030 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:43:52 devstack sudo[105251]: pam_unix(sudo:session): session closed for user root Aug 03 08:43:52 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-f948fb4a-c4d7-499f-b1bd-8d6be3de0b53 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a" returned: 0 in 0.715s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:43:52 devstack cinder-volume[88899]: DEBUG cinder.manager [None req-f948fb4a-c4d7-499f-b1bd-8d6be3de0b53 None None] Notifying Schedulers of capabilities ... {{(pid=88899) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 08:43:52 devstack cinder-volume[88899]: DEBUG oslo_service.periodic_task [None req-f948fb4a-c4d7-499f-b1bd-8d6be3de0b53 None None] Running periodic task VolumeManager._thread_info {{(pid=88899) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 03 08:43:52 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-f948fb4a-c4d7-499f-b1bd-8d6be3de0b53 None None] thread count: 28 {{(pid=88899) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 03 08:43:52 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-f948fb4a-c4d7-499f-b1bd-8d6be3de0b53 None None] thread info: [<_MainThread(MainThread, started 132234320248960)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88899) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 03 08:43:53 devstack sudo[105226]: pam_unix(sudo:session): session closed for user root Aug 03 08:43:53 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-04b5c575-f1dd-4d5b-b677-e3158baa9d7c tempest-VolumesActionsTest-1152451848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-46dbdec8-5da6-4028-832e-bb6b43a7390d /opt/stack/data/cinder/conversion/46dbdec8-5da6-4028-832e-bb6b43a7390d.temp_image.907c4408-b689-489e-ac8a-bf792b0174f7c456fi77.img" returned: 0 in 4.810s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:43:53 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[67a61099-9ede-4a6c-b422-8680eda3d4b5]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:43:53 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-04b5c575-f1dd-4d5b-b677-e3158baa9d7c tempest-VolumesActionsTest-1152451848 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-46dbdec8-5da6-4028-832e-bb6b43a7390d {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:43:53 devstack sudo[105265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-46dbdec8-5da6-4028-832e-bb6b43a7390d Aug 03 08:43:53 devstack sudo[105265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:43:54 devstack sudo[105265]: pam_unix(sudo:session): session closed for user root Aug 03 08:43:54 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-04b5c575-f1dd-4d5b-b677-e3158baa9d7c tempest-VolumesActionsTest-1152451848 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-46dbdec8-5da6-4028-832e-bb6b43a7390d" returned: 0 in 0.564s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:43:54 devstack cinder-volume[88899]: DEBUG cinder.image.image_utils [None req-04b5c575-f1dd-4d5b-b677-e3158baa9d7c tempest-VolumesActionsTest-1152451848 None] Image conversion details: src /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-46dbdec8-5da6-4028-832e-bb6b43a7390d, size 1024.00 MB, duration 4.81 sec, destination /opt/stack/data/cinder/conversion/46dbdec8-5da6-4028-832e-bb6b43a7390d.temp_image.907c4408-b689-489e-ac8a-bf792b0174f7c456fi77.img {{(pid=88899) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 03 08:43:54 devstack cinder-volume[88899]: INFO cinder.image.image_utils [None req-04b5c575-f1dd-4d5b-b677-e3158baa9d7c tempest-VolumesActionsTest-1152451848 None] Converted 1024.00 MB image at 212.85 MB/s Aug 03 08:43:54 devstack cinder-volume[88899]: DEBUG cinder.image.image_utils [None req-04b5c575-f1dd-4d5b-b677-e3158baa9d7c tempest-VolumesActionsTest-1152451848 None] 907c4408-b689-489e-ac8a-bf792b0174f7 was raw, converting to qcow2 {{(pid=88899) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1179}} Aug 03 08:43:54 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac671223-0b70-4357-aa52-4cf71ef909e3]: (4, 'raw') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:43:54 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-04b5c575-f1dd-4d5b-b677-e3158baa9d7c tempest-VolumesActionsTest-1152451848 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/46dbdec8-5da6-4028-832e-bb6b43a7390d.temp_image.907c4408-b689-489e-ac8a-bf792b0174f7c456fi77.img {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:43:54 devstack sudo[105273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/46dbdec8-5da6-4028-832e-bb6b43a7390d.temp_image.907c4408-b689-489e-ac8a-bf792b0174f7c456fi77.img Aug 03 08:43:54 devstack sudo[105273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:43:54 devstack sudo[105273]: pam_unix(sudo:session): session closed for user root Aug 03 08:43:54 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-04b5c575-f1dd-4d5b-b677-e3158baa9d7c tempest-VolumesActionsTest-1152451848 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/46dbdec8-5da6-4028-832e-bb6b43a7390d.temp_image.907c4408-b689-489e-ac8a-bf792b0174f7c456fi77.img" returned: 0 in 0.369s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:43:54 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-04b5c575-f1dd-4d5b-b677-e3158baa9d7c tempest-VolumesActionsTest-1152451848 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/46dbdec8-5da6-4028-832e-bb6b43a7390d.temp_image.907c4408-b689-489e-ac8a-bf792b0174f7c456fi77.img {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:43:54 devstack sudo[105277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/46dbdec8-5da6-4028-832e-bb6b43a7390d.temp_image.907c4408-b689-489e-ac8a-bf792b0174f7c456fi77.img Aug 03 08:43:54 devstack sudo[105277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:43:54 devstack sudo[105277]: pam_unix(sudo:session): session closed for user root Aug 03 08:43:54 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-04b5c575-f1dd-4d5b-b677-e3158baa9d7c tempest-VolumesActionsTest-1152451848 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/46dbdec8-5da6-4028-832e-bb6b43a7390d.temp_image.907c4408-b689-489e-ac8a-bf792b0174f7c456fi77.img" returned: 1 in 0.317s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:43:54 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-04b5c575-f1dd-4d5b-b677-e3158baa9d7c tempest-VolumesActionsTest-1152451848 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/46dbdec8-5da6-4028-832e-bb6b43a7390d.temp_image.907c4408-b689-489e-ac8a-bf792b0174f7c456fi77.img' failed. Not Retrying. {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 03 08:43:54 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-04b5c575-f1dd-4d5b-b677-e3158baa9d7c tempest-VolumesActionsTest-1152451848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/46dbdec8-5da6-4028-832e-bb6b43a7390d.temp_image.907c4408-b689-489e-ac8a-bf792b0174f7c456fi77.img /opt/stack/data/cinder/conversion/vol_upload_t24l64mi {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:43:54 devstack sudo[105282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/46dbdec8-5da6-4028-832e-bb6b43a7390d.temp_image.907c4408-b689-489e-ac8a-bf792b0174f7c456fi77.img /opt/stack/data/cinder/conversion/vol_upload_t24l64mi Aug 03 08:43:54 devstack sudo[105282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:43:55 devstack sudo[105282]: pam_unix(sudo:session): session closed for user root Aug 03 08:43:55 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-04b5c575-f1dd-4d5b-b677-e3158baa9d7c tempest-VolumesActionsTest-1152451848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/46dbdec8-5da6-4028-832e-bb6b43a7390d.temp_image.907c4408-b689-489e-ac8a-bf792b0174f7c456fi77.img /opt/stack/data/cinder/conversion/vol_upload_t24l64mi" returned: 0 in 0.263s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:43:55 devstack cinder-volume[88899]: DEBUG cinder.image.image_utils [None req-04b5c575-f1dd-4d5b-b677-e3158baa9d7c tempest-VolumesActionsTest-1152451848 None] Image conversion details: src /opt/stack/data/cinder/conversion/46dbdec8-5da6-4028-832e-bb6b43a7390d.temp_image.907c4408-b689-489e-ac8a-bf792b0174f7c456fi77.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_t24l64mi {{(pid=88899) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 03 08:43:55 devstack cinder-volume[88899]: INFO cinder.image.image_utils [None req-04b5c575-f1dd-4d5b-b677-e3158baa9d7c tempest-VolumesActionsTest-1152451848 None] Converted 1024.00 MB image at 1024.00 MB/s Aug 03 08:43:55 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[c701ca24-38fc-463c-b054-a5249049e9d6]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:43:55 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-04b5c575-f1dd-4d5b-b677-e3158baa9d7c tempest-VolumesActionsTest-1152451848 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_t24l64mi {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:43:55 devstack sudo[105287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_t24l64mi Aug 03 08:43:55 devstack sudo[105287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:43:55 devstack sudo[105287]: pam_unix(sudo:session): session closed for user root Aug 03 08:43:55 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-04b5c575-f1dd-4d5b-b677-e3158baa9d7c tempest-VolumesActionsTest-1152451848 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_t24l64mi" returned: 0 in 0.323s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:43:56 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-04b5c575-f1dd-4d5b-b677-e3158baa9d7c tempest-VolumesActionsTest-1152451848 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 8.795s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:43:56 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-04b5c575-f1dd-4d5b-b677-e3158baa9d7c tempest-VolumesActionsTest-1152451848 None] Uploaded volume to glance image-id: 907c4408-b689-489e-ac8a-bf792b0174f7. {{(pid=88899) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Aug 03 08:43:56 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [req-b8ca2ac4-0d63-462d-bc7d-1be9ab3f2701 req-f9f20c37-755d-43c3-9383-572a6c269f01 tempest-TestServerVolumeAttachScenarioOldVersion-2074048030 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 4.435s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:43:56 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [req-b8ca2ac4-0d63-462d-bc7d-1be9ab3f2701 req-f9f20c37-755d-43c3-9383-572a6c269f01 tempest-TestServerVolumeAttachScenarioOldVersion-2074048030 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.026s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:43:56 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-04b5c575-f1dd-4d5b-b677-e3158baa9d7c tempest-VolumesActionsTest-1152451848 None] Copy volume to image completed successfully. Aug 03 08:43:56 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [req-b8ca2ac4-0d63-462d-bc7d-1be9ab3f2701 req-f9f20c37-755d-43c3-9383-572a6c269f01 tempest-TestServerVolumeAttachScenarioOldVersion-2074048030 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385', 'name': 'volume-7c95b91e-fef7-427a-868c-a3deac459fcb', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f4729374-e047-4879-923f-5d45b98d30c4', 'enforce_multipath': True} {{(pid=88899) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 03 08:43:56 devstack cinder-volume[88899]: INFO cinder.volume.manager [req-b8ca2ac4-0d63-462d-bc7d-1be9ab3f2701 req-f9f20c37-755d-43c3-9383-572a6c269f01 tempest-TestServerVolumeAttachScenarioOldVersion-2074048030 None] attachment_update completed successfully. Aug 03 08:43:58 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-0ad9a5e4-dca9-4f22-9b86-ca1f19a06c48 tempest-VolumesActionsTest-1152451848 None] Acquiring lock "cinder-46dbdec8-5da6-4028-832e-bb6b43a7390d-delete_volume" by "delete_volume" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:43:58 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-0ad9a5e4-dca9-4f22-9b86-ca1f19a06c48 tempest-VolumesActionsTest-1152451848 None] Lock "cinder-46dbdec8-5da6-4028-832e-bb6b43a7390d-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:43:58 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-0ad9a5e4-dca9-4f22-9b86-ca1f19a06c48 tempest-VolumesActionsTest-1152451848 None] Acquiring lock "cinder-quobyte-46dbdec8-5da6-4028-832e-bb6b43a7390d" by "delete_volume" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:43:58 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-0ad9a5e4-dca9-4f22-9b86-ca1f19a06c48 tempest-VolumesActionsTest-1152451848 None] Lock "cinder-quobyte-46dbdec8-5da6-4028-832e-bb6b43a7390d" acquired by "delete_volume" :: waited 0.020s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:43:58 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c2069fb-0a37-46d5-be36-1cbd1bf27be2]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:43:58 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-0ad9a5e4-dca9-4f22-9b86-ca1f19a06c48 tempest-VolumesActionsTest-1152451848 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-46dbdec8-5da6-4028-832e-bb6b43a7390d {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:43:58 devstack sudo[105298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-46dbdec8-5da6-4028-832e-bb6b43a7390d Aug 03 08:43:58 devstack sudo[105298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:43:58 devstack sudo[105298]: pam_unix(sudo:session): session closed for user root Aug 03 08:43:58 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-0ad9a5e4-dca9-4f22-9b86-ca1f19a06c48 tempest-VolumesActionsTest-1152451848 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-46dbdec8-5da6-4028-832e-bb6b43a7390d" returned: 0 in 0.410s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:43:58 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-0ad9a5e4-dca9-4f22-9b86-ca1f19a06c48 tempest-VolumesActionsTest-1152451848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-46dbdec8-5da6-4028-832e-bb6b43a7390d {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:43:58 devstack sudo[105303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-46dbdec8-5da6-4028-832e-bb6b43a7390d Aug 03 08:43:58 devstack sudo[105303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:43:59 devstack sudo[105303]: pam_unix(sudo:session): session closed for user root Aug 03 08:43:59 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-0ad9a5e4-dca9-4f22-9b86-ca1f19a06c48 tempest-VolumesActionsTest-1152451848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-46dbdec8-5da6-4028-832e-bb6b43a7390d" returned: 0 in 0.255s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:43:59 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-0ad9a5e4-dca9-4f22-9b86-ca1f19a06c48 tempest-VolumesActionsTest-1152451848 None] Lock "cinder-quobyte-46dbdec8-5da6-4028-832e-bb6b43a7390d" released by "delete_volume" :: held 0.710s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:43:59 devstack cinder-volume[88899]: DEBUG cinder.quota [None req-0ad9a5e4-dca9-4f22-9b86-ca1f19a06c48 tempest-VolumesActionsTest-1152451848 None] Created reservations ['3bc56a3e-a91f-4fb0-b2e1-bfb4e8a569e6', '49d68386-0cda-4353-9ac3-2f1caef1edd8', 'd5e5609c-b8f9-4224-93b0-ca4f82d60109', '75f7da46-1593-4992-940d-6c5b6feae0e4'] {{(pid=88899) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 08:43:59 devstack cinder-volume[88899]: INFO cinder.volume.manager [req-9e1c8610-50bb-4d58-aee2-b60eb7b3dbd8 req-08d3dcfd-3fe7-445d-a461-2c7c0ee8ffdf tempest-TestServerVolumeAttachScenarioOldVersion-2074048030 None] Terminate volume connection completed successfully. Aug 03 08:43:59 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [req-9e1c8610-50bb-4d58-aee2-b60eb7b3dbd8 req-08d3dcfd-3fe7-445d-a461-2c7c0ee8ffdf tempest-TestServerVolumeAttachScenarioOldVersion-2074048030 None] Deleting attachment f4729374-e047-4879-923f-5d45b98d30c4. {{(pid=88899) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 03 08:43:59 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-0ad9a5e4-dca9-4f22-9b86-ca1f19a06c48 tempest-VolumesActionsTest-1152451848 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:43:59 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-0ad9a5e4-dca9-4f22-9b86-ca1f19a06c48 tempest-VolumesActionsTest-1152451848 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:43:59 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-0ad9a5e4-dca9-4f22-9b86-ca1f19a06c48 tempest-VolumesActionsTest-1152451848 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:43:59 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-0ad9a5e4-dca9-4f22-9b86-ca1f19a06c48 tempest-VolumesActionsTest-1152451848 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:43:59 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-0ad9a5e4-dca9-4f22-9b86-ca1f19a06c48 tempest-VolumesActionsTest-1152451848 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:43:59 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-0ad9a5e4-dca9-4f22-9b86-ca1f19a06c48 tempest-VolumesActionsTest-1152451848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:43:59 devstack sudo[105311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a Aug 03 08:43:59 devstack sudo[105311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:43:59 devstack sudo[105311]: pam_unix(sudo:session): session closed for user root Aug 03 08:43:59 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-0ad9a5e4-dca9-4f22-9b86-ca1f19a06c48 tempest-VolumesActionsTest-1152451848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a" returned: 0 in 0.289s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:43:59 devstack cinder-volume[88899]: DEBUG cinder.manager [None req-0ad9a5e4-dca9-4f22-9b86-ca1f19a06c48 tempest-VolumesActionsTest-1152451848 None] Notifying Schedulers of capabilities ... {{(pid=88899) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 08:43:59 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-0ad9a5e4-dca9-4f22-9b86-ca1f19a06c48 tempest-VolumesActionsTest-1152451848 None] Deleted volume successfully. Aug 03 08:43:59 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-0ad9a5e4-dca9-4f22-9b86-ca1f19a06c48 tempest-VolumesActionsTest-1152451848 None] Lock "cinder-46dbdec8-5da6-4028-832e-bb6b43a7390d-delete_volume" released by "delete_volume" :: held 1.267s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:43:59 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-ffd56248-ab2f-42d8-8063-5ce01094ffd0 tempest-TestServerVolumeAttachScenarioOldVersion-2074048030 None] Acquiring lock "cinder-7c95b91e-fef7-427a-868c-a3deac459fcb-delete_volume" by "delete_volume" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:44:00 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-ffd56248-ab2f-42d8-8063-5ce01094ffd0 tempest-TestServerVolumeAttachScenarioOldVersion-2074048030 None] Lock "cinder-7c95b91e-fef7-427a-868c-a3deac459fcb-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:44:00 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-ffd56248-ab2f-42d8-8063-5ce01094ffd0 tempest-TestServerVolumeAttachScenarioOldVersion-2074048030 None] Acquiring lock "cinder-quobyte-7c95b91e-fef7-427a-868c-a3deac459fcb" by "delete_volume" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:44:00 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-ffd56248-ab2f-42d8-8063-5ce01094ffd0 tempest-TestServerVolumeAttachScenarioOldVersion-2074048030 None] Lock "cinder-quobyte-7c95b91e-fef7-427a-868c-a3deac459fcb" acquired by "delete_volume" :: waited 0.019s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:44:00 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[401e3106-501f-4032-b58d-69c8d69ab33f]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:44:00 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-ffd56248-ab2f-42d8-8063-5ce01094ffd0 tempest-TestServerVolumeAttachScenarioOldVersion-2074048030 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-7c95b91e-fef7-427a-868c-a3deac459fcb {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:44:00 devstack sudo[105314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-7c95b91e-fef7-427a-868c-a3deac459fcb Aug 03 08:44:00 devstack sudo[105314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:44:00 devstack sudo[105314]: pam_unix(sudo:session): session closed for user root Aug 03 08:44:00 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-ffd56248-ab2f-42d8-8063-5ce01094ffd0 tempest-TestServerVolumeAttachScenarioOldVersion-2074048030 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-7c95b91e-fef7-427a-868c-a3deac459fcb" returned: 0 in 0.433s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:44:00 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-ffd56248-ab2f-42d8-8063-5ce01094ffd0 tempest-TestServerVolumeAttachScenarioOldVersion-2074048030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-7c95b91e-fef7-427a-868c-a3deac459fcb {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:44:00 devstack sudo[105320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-7c95b91e-fef7-427a-868c-a3deac459fcb Aug 03 08:44:00 devstack sudo[105320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:44:00 devstack sudo[105320]: pam_unix(sudo:session): session closed for user root Aug 03 08:44:00 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-ffd56248-ab2f-42d8-8063-5ce01094ffd0 tempest-TestServerVolumeAttachScenarioOldVersion-2074048030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-7c95b91e-fef7-427a-868c-a3deac459fcb" returned: 0 in 0.248s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:44:00 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-ffd56248-ab2f-42d8-8063-5ce01094ffd0 tempest-TestServerVolumeAttachScenarioOldVersion-2074048030 None] Lock "cinder-quobyte-7c95b91e-fef7-427a-868c-a3deac459fcb" released by "delete_volume" :: held 0.723s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:44:00 devstack cinder-volume[88899]: DEBUG cinder.quota [None req-ffd56248-ab2f-42d8-8063-5ce01094ffd0 tempest-TestServerVolumeAttachScenarioOldVersion-2074048030 None] Created reservations ['190a5703-c525-419d-807b-9f59d8cd166c', 'eac85d52-8e97-4580-ad12-3458b89b4e30', 'da381a0c-62a0-43ad-bf30-c1508a5cf542', '04f1e9cc-0180-4fa7-9e70-e2c90a28e010'] {{(pid=88899) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 08:44:00 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-ffd56248-ab2f-42d8-8063-5ce01094ffd0 tempest-TestServerVolumeAttachScenarioOldVersion-2074048030 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:44:00 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-ffd56248-ab2f-42d8-8063-5ce01094ffd0 tempest-TestServerVolumeAttachScenarioOldVersion-2074048030 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:44:00 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-ffd56248-ab2f-42d8-8063-5ce01094ffd0 tempest-TestServerVolumeAttachScenarioOldVersion-2074048030 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:44:00 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-ffd56248-ab2f-42d8-8063-5ce01094ffd0 tempest-TestServerVolumeAttachScenarioOldVersion-2074048030 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:44:00 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-ffd56248-ab2f-42d8-8063-5ce01094ffd0 tempest-TestServerVolumeAttachScenarioOldVersion-2074048030 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:44:00 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-ffd56248-ab2f-42d8-8063-5ce01094ffd0 tempest-TestServerVolumeAttachScenarioOldVersion-2074048030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:44:00 devstack sudo[105323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a Aug 03 08:44:00 devstack sudo[105323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:44:01 devstack sudo[105323]: pam_unix(sudo:session): session closed for user root Aug 03 08:44:01 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-ffd56248-ab2f-42d8-8063-5ce01094ffd0 tempest-TestServerVolumeAttachScenarioOldVersion-2074048030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a" returned: 0 in 0.314s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:44:01 devstack cinder-volume[88899]: DEBUG cinder.manager [None req-ffd56248-ab2f-42d8-8063-5ce01094ffd0 tempest-TestServerVolumeAttachScenarioOldVersion-2074048030 None] Notifying Schedulers of capabilities ... {{(pid=88899) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 08:44:01 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-ffd56248-ab2f-42d8-8063-5ce01094ffd0 tempest-TestServerVolumeAttachScenarioOldVersion-2074048030 None] Deleted volume successfully. Aug 03 08:44:01 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-ffd56248-ab2f-42d8-8063-5ce01094ffd0 tempest-TestServerVolumeAttachScenarioOldVersion-2074048030 None] Lock "cinder-7c95b91e-fef7-427a-868c-a3deac459fcb-delete_volume" released by "delete_volume" :: held 1.284s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:44:06 devstack cinder-volume[88899]: INFO cinder.volume.manager [req-5c8d557a-f406-45e1-9206-67fda9848f09 req-c23c817b-05a5-4539-9de5-9eea86cc828d tempest-TestMinimumBasicScenario-933065941 None] Terminate volume connection completed successfully. Aug 03 08:44:06 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [req-5c8d557a-f406-45e1-9206-67fda9848f09 req-c23c817b-05a5-4539-9de5-9eea86cc828d tempest-TestMinimumBasicScenario-933065941 None] Deleting attachment 4e1d090d-82fb-4c5e-be62-4d7ea22ebd32. {{(pid=88899) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 03 08:44:07 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-c0cb85d7-06d3-4ed1-95b7-a6fbc36a5b5e tempest-TestMinimumBasicScenario-933065941 None] Acquiring lock "cinder-2dd20c13-f7ea-4655-9c44-496636093ce2-delete_volume" by "delete_volume" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:44:07 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-c0cb85d7-06d3-4ed1-95b7-a6fbc36a5b5e tempest-TestMinimumBasicScenario-933065941 None] Lock "cinder-2dd20c13-f7ea-4655-9c44-496636093ce2-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:44:07 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-c0cb85d7-06d3-4ed1-95b7-a6fbc36a5b5e tempest-TestMinimumBasicScenario-933065941 None] Acquiring lock "cinder-quobyte-2dd20c13-f7ea-4655-9c44-496636093ce2" by "delete_volume" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:44:07 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-c0cb85d7-06d3-4ed1-95b7-a6fbc36a5b5e tempest-TestMinimumBasicScenario-933065941 None] Lock "cinder-quobyte-2dd20c13-f7ea-4655-9c44-496636093ce2" acquired by "delete_volume" :: waited 0.029s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:44:07 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[15835818-1534-4769-91a9-2731ebe59609]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:44:07 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-c0cb85d7-06d3-4ed1-95b7-a6fbc36a5b5e tempest-TestMinimumBasicScenario-933065941 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-2dd20c13-f7ea-4655-9c44-496636093ce2 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:44:07 devstack sudo[105406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-2dd20c13-f7ea-4655-9c44-496636093ce2 Aug 03 08:44:07 devstack sudo[105406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:44:07 devstack sudo[105406]: pam_unix(sudo:session): session closed for user root Aug 03 08:44:07 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-c0cb85d7-06d3-4ed1-95b7-a6fbc36a5b5e tempest-TestMinimumBasicScenario-933065941 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-2dd20c13-f7ea-4655-9c44-496636093ce2" returned: 0 in 0.530s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:44:07 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-c0cb85d7-06d3-4ed1-95b7-a6fbc36a5b5e tempest-TestMinimumBasicScenario-933065941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-2dd20c13-f7ea-4655-9c44-496636093ce2 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:44:07 devstack sudo[105411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-2dd20c13-f7ea-4655-9c44-496636093ce2 Aug 03 08:44:07 devstack sudo[105411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:44:08 devstack cinder-volume[88899]: DEBUG cinder.volume.flows.manager.create_volume [None req-826e2649-8e5e-4031-bfcd-cccbf9dd8610 tempest-VolumesGetTest-1176098524 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88899) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 08:44:08 devstack sudo[105411]: pam_unix(sudo:session): session closed for user root Aug 03 08:44:08 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-826e2649-8e5e-4031-bfcd-cccbf9dd8610 tempest-VolumesGetTest-1176098524 None] Flow 'volume_create_manager' (dc138834-5ff9-425b-b3b1-d9818448338a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:44:08 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-826e2649-8e5e-4031-bfcd-cccbf9dd8610 tempest-VolumesGetTest-1176098524 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b60588a2-8f44-49cb-878f-ff58304f51d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:44:08 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-c0cb85d7-06d3-4ed1-95b7-a6fbc36a5b5e tempest-TestMinimumBasicScenario-933065941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-2dd20c13-f7ea-4655-9c44-496636093ce2" returned: 0 in 0.348s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:44:08 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-826e2649-8e5e-4031-bfcd-cccbf9dd8610 tempest-VolumesGetTest-1176098524 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b60588a2-8f44-49cb-878f-ff58304f51d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:44:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-331565226',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d29d549-9678-44c8-816a-6c0dfd4d3392,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='070ec6e114534bca93d5d121647b843c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:44:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:44:08Z,use_quota=True,user_id='e38f947f25c6490eb48ca43abf9ef753',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8bde7129-1dc4-42ab-b852-ab32c61b4921),volume_type_id=8bde7129-1dc4-42ab-b852-ab32c61b4921)' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:44:08 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-826e2649-8e5e-4031-bfcd-cccbf9dd8610 tempest-VolumesGetTest-1176098524 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87cec156-a4bf-4a37-993e-4a9f77a68837) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:44:08 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-826e2649-8e5e-4031-bfcd-cccbf9dd8610 tempest-VolumesGetTest-1176098524 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87cec156-a4bf-4a37-993e-4a9f77a68837) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:44:08 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-826e2649-8e5e-4031-bfcd-cccbf9dd8610 tempest-VolumesGetTest-1176098524 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1403d458-c045-4406-ae9e-6def9636cbe2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:44:08 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-826e2649-8e5e-4031-bfcd-cccbf9dd8610 tempest-VolumesGetTest-1176098524 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1403d458-c045-4406-ae9e-6def9636cbe2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3d29d549-9678-44c8-816a-6c0dfd4d3392', 'volume_name': 'volume-3d29d549-9678-44c8-816a-6c0dfd4d3392', 'volume_size': 1}' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:44:08 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-826e2649-8e5e-4031-bfcd-cccbf9dd8610 tempest-VolumesGetTest-1176098524 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (42a506cf-6595-48dd-a071-97240cd1e696) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:44:08 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-826e2649-8e5e-4031-bfcd-cccbf9dd8610 tempest-VolumesGetTest-1176098524 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (42a506cf-6595-48dd-a071-97240cd1e696) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:44:08 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-826e2649-8e5e-4031-bfcd-cccbf9dd8610 tempest-VolumesGetTest-1176098524 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b0e1e26-a321-44f8-9339-451dbcc8d4b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:44:08 devstack cinder-volume[88899]: INFO cinder.volume.flows.manager.create_volume [None req-826e2649-8e5e-4031-bfcd-cccbf9dd8610 tempest-VolumesGetTest-1176098524 None] Volume 3d29d549-9678-44c8-816a-6c0dfd4d3392: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3d29d549-9678-44c8-816a-6c0dfd4d3392', 'volume_size': 1} Aug 03 08:44:08 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-826e2649-8e5e-4031-bfcd-cccbf9dd8610 tempest-VolumesGetTest-1176098524 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:44:08 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-826e2649-8e5e-4031-bfcd-cccbf9dd8610 tempest-VolumesGetTest-1176098524 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:44:08 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-826e2649-8e5e-4031-bfcd-cccbf9dd8610 tempest-VolumesGetTest-1176098524 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:44:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-331565226',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d29d549-9678-44c8-816a-6c0dfd4d3392,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='070ec6e114534bca93d5d121647b843c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:44:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:44:08Z,use_quota=True,user_id='e38f947f25c6490eb48ca43abf9ef753',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8bde7129-1dc4-42ab-b852-ab32c61b4921),volume_type_id=8bde7129-1dc4-42ab-b852-ab32c61b4921)}" {{(pid=88899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 08:44:08 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-826e2649-8e5e-4031-bfcd-cccbf9dd8610 tempest-VolumesGetTest-1176098524 None] Creating volume 3d29d549-9678-44c8-816a-6c0dfd4d3392 {{(pid=88899) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 08:44:08 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-826e2649-8e5e-4031-bfcd-cccbf9dd8610 tempest-VolumesGetTest-1176098524 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:44:08 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-826e2649-8e5e-4031-bfcd-cccbf9dd8610 tempest-VolumesGetTest-1176098524 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:44:08 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-826e2649-8e5e-4031-bfcd-cccbf9dd8610 tempest-VolumesGetTest-1176098524 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:44:08 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-826e2649-8e5e-4031-bfcd-cccbf9dd8610 tempest-VolumesGetTest-1176098524 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:44:08 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-826e2649-8e5e-4031-bfcd-cccbf9dd8610 tempest-VolumesGetTest-1176098524 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:44:08 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-826e2649-8e5e-4031-bfcd-cccbf9dd8610 tempest-VolumesGetTest-1176098524 None] Selected osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385 as target Quobyte volume. {{(pid=88899) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 08:44:08 devstack cinder-volume[88899]: INFO cinder.volume.drivers.remotefs [None req-826e2649-8e5e-4031-bfcd-cccbf9dd8610 tempest-VolumesGetTest-1176098524 None] casted to osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385 Aug 03 08:44:08 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-826e2649-8e5e-4031-bfcd-cccbf9dd8610 tempest-VolumesGetTest-1176098524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-3d29d549-9678-44c8-816a-6c0dfd4d3392 1073741824 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:44:08 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-c0cb85d7-06d3-4ed1-95b7-a6fbc36a5b5e tempest-TestMinimumBasicScenario-933065941 None] Lock "cinder-quobyte-2dd20c13-f7ea-4655-9c44-496636093ce2" released by "delete_volume" :: held 1.022s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:44:08 devstack sudo[105415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-3d29d549-9678-44c8-816a-6c0dfd4d3392 1073741824 Aug 03 08:44:08 devstack sudo[105415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:44:08 devstack cinder-volume[88899]: DEBUG cinder.quota [None req-c0cb85d7-06d3-4ed1-95b7-a6fbc36a5b5e tempest-TestMinimumBasicScenario-933065941 None] Created reservations ['6025e54a-804f-4829-8b5d-05e391a6ed36', 'c1c6cc95-6f2b-464b-bb1a-3da3f0db36e0', 'd89c29e8-fbb5-45e3-b3b8-fed1935a50f2', 'd794f483-59e9-4525-9a1e-8fcbc85b9e3e'] {{(pid=88899) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 08:44:08 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-c0cb85d7-06d3-4ed1-95b7-a6fbc36a5b5e tempest-TestMinimumBasicScenario-933065941 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:44:08 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-c0cb85d7-06d3-4ed1-95b7-a6fbc36a5b5e tempest-TestMinimumBasicScenario-933065941 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:44:08 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-c0cb85d7-06d3-4ed1-95b7-a6fbc36a5b5e tempest-TestMinimumBasicScenario-933065941 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:44:08 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-c0cb85d7-06d3-4ed1-95b7-a6fbc36a5b5e tempest-TestMinimumBasicScenario-933065941 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:44:08 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-c0cb85d7-06d3-4ed1-95b7-a6fbc36a5b5e tempest-TestMinimumBasicScenario-933065941 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:44:08 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-c0cb85d7-06d3-4ed1-95b7-a6fbc36a5b5e tempest-TestMinimumBasicScenario-933065941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:44:08 devstack sudo[105418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a Aug 03 08:44:08 devstack sudo[105418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:44:08 devstack sudo[105418]: pam_unix(sudo:session): session closed for user root Aug 03 08:44:08 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-c0cb85d7-06d3-4ed1-95b7-a6fbc36a5b5e tempest-TestMinimumBasicScenario-933065941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a" returned: 0 in 0.275s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:44:08 devstack cinder-volume[88899]: DEBUG cinder.manager [None req-c0cb85d7-06d3-4ed1-95b7-a6fbc36a5b5e tempest-TestMinimumBasicScenario-933065941 None] Notifying Schedulers of capabilities ... {{(pid=88899) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 08:44:08 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-c0cb85d7-06d3-4ed1-95b7-a6fbc36a5b5e tempest-TestMinimumBasicScenario-933065941 None] Deleted volume successfully. Aug 03 08:44:08 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-c0cb85d7-06d3-4ed1-95b7-a6fbc36a5b5e tempest-TestMinimumBasicScenario-933065941 None] Lock "cinder-2dd20c13-f7ea-4655-9c44-496636093ce2-delete_volume" released by "delete_volume" :: held 1.599s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:44:08 devstack sudo[105415]: pam_unix(sudo:session): session closed for user root Aug 03 08:44:08 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-826e2649-8e5e-4031-bfcd-cccbf9dd8610 tempest-VolumesGetTest-1176098524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-3d29d549-9678-44c8-816a-6c0dfd4d3392 1073741824" returned: 0 in 0.530s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:44:08 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-826e2649-8e5e-4031-bfcd-cccbf9dd8610 tempest-VolumesGetTest-1176098524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-3d29d549-9678-44c8-816a-6c0dfd4d3392 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:44:08 devstack sudo[105424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-3d29d549-9678-44c8-816a-6c0dfd4d3392 Aug 03 08:44:08 devstack sudo[105424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:44:09 devstack sudo[105424]: pam_unix(sudo:session): session closed for user root Aug 03 08:44:09 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-826e2649-8e5e-4031-bfcd-cccbf9dd8610 tempest-VolumesGetTest-1176098524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-3d29d549-9678-44c8-816a-6c0dfd4d3392" returned: 0 in 0.286s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:44:09 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-826e2649-8e5e-4031-bfcd-cccbf9dd8610 tempest-VolumesGetTest-1176098524 None] <== create_volume: return (864ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'} {{(pid=88899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 08:44:09 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-826e2649-8e5e-4031-bfcd-cccbf9dd8610 tempest-VolumesGetTest-1176098524 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.867s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:44:09 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-826e2649-8e5e-4031-bfcd-cccbf9dd8610 tempest-VolumesGetTest-1176098524 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b0e1e26-a321-44f8-9339-451dbcc8d4b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3d29d549-9678-44c8-816a-6c0dfd4d3392', 'volume_size': 1}' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:44:09 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-826e2649-8e5e-4031-bfcd-cccbf9dd8610 tempest-VolumesGetTest-1176098524 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f54b0e8-5809-4309-8910-67f795df1da8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:44:09 devstack cinder-volume[88899]: INFO cinder.volume.flows.manager.create_volume [None req-826e2649-8e5e-4031-bfcd-cccbf9dd8610 tempest-VolumesGetTest-1176098524 None] Volume volume-3d29d549-9678-44c8-816a-6c0dfd4d3392 (3d29d549-9678-44c8-816a-6c0dfd4d3392): created successfully Aug 03 08:44:09 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-826e2649-8e5e-4031-bfcd-cccbf9dd8610 tempest-VolumesGetTest-1176098524 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f54b0e8-5809-4309-8910-67f795df1da8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:44:09 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-826e2649-8e5e-4031-bfcd-cccbf9dd8610 tempest-VolumesGetTest-1176098524 None] Flow 'volume_create_manager' (dc138834-5ff9-425b-b3b1-d9818448338a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:44:09 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-826e2649-8e5e-4031-bfcd-cccbf9dd8610 tempest-VolumesGetTest-1176098524 None] Created volume successfully. Aug 03 08:44:11 devstack cinder-volume[88899]: DEBUG cinder.volume.flows.manager.create_volume [None req-015e3ac8-7d93-4a33-95ce-9e2ae08518d4 tempest-VolumesGetTest-1176098524 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88899) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 08:44:11 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-015e3ac8-7d93-4a33-95ce-9e2ae08518d4 tempest-VolumesGetTest-1176098524 None] Flow 'volume_create_manager' (78d7c502-beca-434e-a7a1-9f69ee3d88b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:44:11 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-015e3ac8-7d93-4a33-95ce-9e2ae08518d4 tempest-VolumesGetTest-1176098524 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2dbb74a-f130-4f1e-aaa6-c15630e9bcab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:44:11 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-015e3ac8-7d93-4a33-95ce-9e2ae08518d4 tempest-VolumesGetTest-1176098524 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2dbb74a-f130-4f1e-aaa6-c15630e9bcab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:44:11Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1777861769',display_name='tempest-VolumesGetTest-Volume-668800433',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cef6d5f6-2ac3-4084-bc43-939abf1f2bc4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='070ec6e114534bca93d5d121647b843c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:44:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:44:11Z,use_quota=True,user_id='e38f947f25c6490eb48ca43abf9ef753',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8bde7129-1dc4-42ab-b852-ab32c61b4921),volume_type_id=8bde7129-1dc4-42ab-b852-ab32c61b4921)' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:44:11 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-015e3ac8-7d93-4a33-95ce-9e2ae08518d4 tempest-VolumesGetTest-1176098524 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56f9c4f5-9514-4577-b147-d42f3d949e8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:44:11 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-015e3ac8-7d93-4a33-95ce-9e2ae08518d4 tempest-VolumesGetTest-1176098524 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56f9c4f5-9514-4577-b147-d42f3d949e8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:44:11 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-015e3ac8-7d93-4a33-95ce-9e2ae08518d4 tempest-VolumesGetTest-1176098524 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ad9d8d9-dff6-49fc-a7ce-ed80dd040e37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:44:11 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-015e3ac8-7d93-4a33-95ce-9e2ae08518d4 tempest-VolumesGetTest-1176098524 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ad9d8d9-dff6-49fc-a7ce-ed80dd040e37) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cef6d5f6-2ac3-4084-bc43-939abf1f2bc4', 'volume_name': 'volume-cef6d5f6-2ac3-4084-bc43-939abf1f2bc4', 'volume_size': 1}' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:44:11 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-015e3ac8-7d93-4a33-95ce-9e2ae08518d4 tempest-VolumesGetTest-1176098524 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0c4e54e-31ca-4110-a7e8-29d7cbd6be3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:44:11 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-015e3ac8-7d93-4a33-95ce-9e2ae08518d4 tempest-VolumesGetTest-1176098524 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0c4e54e-31ca-4110-a7e8-29d7cbd6be3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:44:11 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-015e3ac8-7d93-4a33-95ce-9e2ae08518d4 tempest-VolumesGetTest-1176098524 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f55e7c12-4dfb-459b-91e7-196fdab5e9f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:44:11 devstack cinder-volume[88899]: INFO cinder.volume.flows.manager.create_volume [None req-015e3ac8-7d93-4a33-95ce-9e2ae08518d4 tempest-VolumesGetTest-1176098524 None] Volume cef6d5f6-2ac3-4084-bc43-939abf1f2bc4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cef6d5f6-2ac3-4084-bc43-939abf1f2bc4', 'volume_size': 1} Aug 03 08:44:11 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-015e3ac8-7d93-4a33-95ce-9e2ae08518d4 tempest-VolumesGetTest-1176098524 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:44:11 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-015e3ac8-7d93-4a33-95ce-9e2ae08518d4 tempest-VolumesGetTest-1176098524 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:44:11 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-015e3ac8-7d93-4a33-95ce-9e2ae08518d4 tempest-VolumesGetTest-1176098524 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:44:11Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1777861769',display_name='tempest-VolumesGetTest-Volume-668800433',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cef6d5f6-2ac3-4084-bc43-939abf1f2bc4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='070ec6e114534bca93d5d121647b843c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:44:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:44:11Z,use_quota=True,user_id='e38f947f25c6490eb48ca43abf9ef753',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8bde7129-1dc4-42ab-b852-ab32c61b4921),volume_type_id=8bde7129-1dc4-42ab-b852-ab32c61b4921)}" {{(pid=88899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 08:44:11 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-015e3ac8-7d93-4a33-95ce-9e2ae08518d4 tempest-VolumesGetTest-1176098524 None] Creating volume cef6d5f6-2ac3-4084-bc43-939abf1f2bc4 {{(pid=88899) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 08:44:11 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-015e3ac8-7d93-4a33-95ce-9e2ae08518d4 tempest-VolumesGetTest-1176098524 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:44:11 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-015e3ac8-7d93-4a33-95ce-9e2ae08518d4 tempest-VolumesGetTest-1176098524 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:44:11 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-015e3ac8-7d93-4a33-95ce-9e2ae08518d4 tempest-VolumesGetTest-1176098524 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:44:11 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-015e3ac8-7d93-4a33-95ce-9e2ae08518d4 tempest-VolumesGetTest-1176098524 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:44:11 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-015e3ac8-7d93-4a33-95ce-9e2ae08518d4 tempest-VolumesGetTest-1176098524 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:44:11 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-015e3ac8-7d93-4a33-95ce-9e2ae08518d4 tempest-VolumesGetTest-1176098524 None] Selected osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385 as target Quobyte volume. {{(pid=88899) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 08:44:11 devstack cinder-volume[88899]: INFO cinder.volume.drivers.remotefs [None req-015e3ac8-7d93-4a33-95ce-9e2ae08518d4 tempest-VolumesGetTest-1176098524 None] casted to osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385 Aug 03 08:44:11 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-015e3ac8-7d93-4a33-95ce-9e2ae08518d4 tempest-VolumesGetTest-1176098524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-cef6d5f6-2ac3-4084-bc43-939abf1f2bc4 1073741824 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:44:11 devstack sudo[105460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-cef6d5f6-2ac3-4084-bc43-939abf1f2bc4 1073741824 Aug 03 08:44:11 devstack sudo[105460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:44:11 devstack sudo[105460]: pam_unix(sudo:session): session closed for user root Aug 03 08:44:11 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-015e3ac8-7d93-4a33-95ce-9e2ae08518d4 tempest-VolumesGetTest-1176098524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-cef6d5f6-2ac3-4084-bc43-939abf1f2bc4 1073741824" returned: 0 in 0.533s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:44:11 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-015e3ac8-7d93-4a33-95ce-9e2ae08518d4 tempest-VolumesGetTest-1176098524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-cef6d5f6-2ac3-4084-bc43-939abf1f2bc4 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:44:12 devstack sudo[105466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-cef6d5f6-2ac3-4084-bc43-939abf1f2bc4 Aug 03 08:44:12 devstack sudo[105466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:44:12 devstack sudo[105466]: pam_unix(sudo:session): session closed for user root Aug 03 08:44:12 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-015e3ac8-7d93-4a33-95ce-9e2ae08518d4 tempest-VolumesGetTest-1176098524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-cef6d5f6-2ac3-4084-bc43-939abf1f2bc4" returned: 0 in 0.291s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:44:12 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-015e3ac8-7d93-4a33-95ce-9e2ae08518d4 tempest-VolumesGetTest-1176098524 None] <== create_volume: return (878ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'} {{(pid=88899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 08:44:12 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-015e3ac8-7d93-4a33-95ce-9e2ae08518d4 tempest-VolumesGetTest-1176098524 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.881s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:44:12 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-015e3ac8-7d93-4a33-95ce-9e2ae08518d4 tempest-VolumesGetTest-1176098524 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f55e7c12-4dfb-459b-91e7-196fdab5e9f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cef6d5f6-2ac3-4084-bc43-939abf1f2bc4', 'volume_size': 1}' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:44:12 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-015e3ac8-7d93-4a33-95ce-9e2ae08518d4 tempest-VolumesGetTest-1176098524 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95d6c8fe-b901-40f1-b5ce-88dc5cc4e887) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:44:12 devstack cinder-volume[88899]: INFO cinder.volume.flows.manager.create_volume [None req-015e3ac8-7d93-4a33-95ce-9e2ae08518d4 tempest-VolumesGetTest-1176098524 None] Volume volume-cef6d5f6-2ac3-4084-bc43-939abf1f2bc4 (cef6d5f6-2ac3-4084-bc43-939abf1f2bc4): created successfully Aug 03 08:44:12 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-015e3ac8-7d93-4a33-95ce-9e2ae08518d4 tempest-VolumesGetTest-1176098524 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95d6c8fe-b901-40f1-b5ce-88dc5cc4e887) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:44:12 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-015e3ac8-7d93-4a33-95ce-9e2ae08518d4 tempest-VolumesGetTest-1176098524 None] Flow 'volume_create_manager' (78d7c502-beca-434e-a7a1-9f69ee3d88b7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:44:12 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-015e3ac8-7d93-4a33-95ce-9e2ae08518d4 tempest-VolumesGetTest-1176098524 None] Created volume successfully. Aug 03 08:44:13 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-efce5340-2d79-4211-b031-7300db0e292a tempest-VolumesGetTest-1176098524 None] Acquiring lock "cinder-cef6d5f6-2ac3-4084-bc43-939abf1f2bc4-delete_volume" by "delete_volume" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:44:13 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-efce5340-2d79-4211-b031-7300db0e292a tempest-VolumesGetTest-1176098524 None] Lock "cinder-cef6d5f6-2ac3-4084-bc43-939abf1f2bc4-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:44:13 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-efce5340-2d79-4211-b031-7300db0e292a tempest-VolumesGetTest-1176098524 None] Acquiring lock "cinder-quobyte-cef6d5f6-2ac3-4084-bc43-939abf1f2bc4" by "delete_volume" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:44:13 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-efce5340-2d79-4211-b031-7300db0e292a tempest-VolumesGetTest-1176098524 None] Lock "cinder-quobyte-cef6d5f6-2ac3-4084-bc43-939abf1f2bc4" acquired by "delete_volume" :: waited 0.016s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:44:13 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca02b089-a5a0-4103-b1d2-c6580e375e4a]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:44:13 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-efce5340-2d79-4211-b031-7300db0e292a tempest-VolumesGetTest-1176098524 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-cef6d5f6-2ac3-4084-bc43-939abf1f2bc4 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:44:13 devstack sudo[105470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-cef6d5f6-2ac3-4084-bc43-939abf1f2bc4 Aug 03 08:44:13 devstack sudo[105470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:44:14 devstack sudo[105470]: pam_unix(sudo:session): session closed for user root Aug 03 08:44:14 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-efce5340-2d79-4211-b031-7300db0e292a tempest-VolumesGetTest-1176098524 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-cef6d5f6-2ac3-4084-bc43-939abf1f2bc4" returned: 0 in 0.408s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:44:14 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-efce5340-2d79-4211-b031-7300db0e292a tempest-VolumesGetTest-1176098524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-cef6d5f6-2ac3-4084-bc43-939abf1f2bc4 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:44:14 devstack sudo[105475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-cef6d5f6-2ac3-4084-bc43-939abf1f2bc4 Aug 03 08:44:14 devstack sudo[105475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:44:14 devstack sudo[105475]: pam_unix(sudo:session): session closed for user root Aug 03 08:44:14 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-efce5340-2d79-4211-b031-7300db0e292a tempest-VolumesGetTest-1176098524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-cef6d5f6-2ac3-4084-bc43-939abf1f2bc4" returned: 0 in 0.300s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:44:14 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-efce5340-2d79-4211-b031-7300db0e292a tempest-VolumesGetTest-1176098524 None] Lock "cinder-quobyte-cef6d5f6-2ac3-4084-bc43-939abf1f2bc4" released by "delete_volume" :: held 0.764s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:44:14 devstack cinder-volume[88899]: DEBUG cinder.quota [None req-efce5340-2d79-4211-b031-7300db0e292a tempest-VolumesGetTest-1176098524 None] Created reservations ['7e933247-4a90-4b45-9303-0a2e2222f84d', 'c13e1426-54d6-4c31-af64-21e5e45064e9', 'f413ebf8-c3c3-4714-a860-42d5c456a0ad', '88a79839-70cf-478e-86dc-7769480e7ce3'] {{(pid=88899) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 08:44:14 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-efce5340-2d79-4211-b031-7300db0e292a tempest-VolumesGetTest-1176098524 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:44:14 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-efce5340-2d79-4211-b031-7300db0e292a tempest-VolumesGetTest-1176098524 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:44:14 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-efce5340-2d79-4211-b031-7300db0e292a tempest-VolumesGetTest-1176098524 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:44:14 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-efce5340-2d79-4211-b031-7300db0e292a tempest-VolumesGetTest-1176098524 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:44:14 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-efce5340-2d79-4211-b031-7300db0e292a tempest-VolumesGetTest-1176098524 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:44:14 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-efce5340-2d79-4211-b031-7300db0e292a tempest-VolumesGetTest-1176098524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:44:14 devstack sudo[105478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a Aug 03 08:44:14 devstack sudo[105478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:44:14 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-72b6f352-de3c-4bf6-b961-e55c4f0abe34 tempest-VolumesGetTest-1176098524 None] Acquiring lock "cinder-3d29d549-9678-44c8-816a-6c0dfd4d3392-delete_volume" by "delete_volume" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:44:14 devstack sudo[105478]: pam_unix(sudo:session): session closed for user root Aug 03 08:44:14 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-efce5340-2d79-4211-b031-7300db0e292a tempest-VolumesGetTest-1176098524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a" returned: 0 in 0.410s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:44:14 devstack cinder-volume[88899]: DEBUG cinder.manager [None req-efce5340-2d79-4211-b031-7300db0e292a tempest-VolumesGetTest-1176098524 None] Notifying Schedulers of capabilities ... {{(pid=88899) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 08:44:14 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-efce5340-2d79-4211-b031-7300db0e292a tempest-VolumesGetTest-1176098524 None] Deleted volume successfully. Aug 03 08:44:14 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-72b6f352-de3c-4bf6-b961-e55c4f0abe34 tempest-VolumesGetTest-1176098524 None] Lock "cinder-3d29d549-9678-44c8-816a-6c0dfd4d3392-delete_volume" acquired by "delete_volume" :: waited 0.079s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:44:15 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-efce5340-2d79-4211-b031-7300db0e292a tempest-VolumesGetTest-1176098524 None] Lock "cinder-cef6d5f6-2ac3-4084-bc43-939abf1f2bc4-delete_volume" released by "delete_volume" :: held 1.451s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:44:15 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-72b6f352-de3c-4bf6-b961-e55c4f0abe34 tempest-VolumesGetTest-1176098524 None] Acquiring lock "cinder-quobyte-3d29d549-9678-44c8-816a-6c0dfd4d3392" by "delete_volume" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:44:15 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-72b6f352-de3c-4bf6-b961-e55c4f0abe34 tempest-VolumesGetTest-1176098524 None] Lock "cinder-quobyte-3d29d549-9678-44c8-816a-6c0dfd4d3392" acquired by "delete_volume" :: waited 0.018s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:44:15 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7c00fb3-7791-4ee3-ab21-7d7f75119b0d]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:44:15 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-72b6f352-de3c-4bf6-b961-e55c4f0abe34 tempest-VolumesGetTest-1176098524 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-3d29d549-9678-44c8-816a-6c0dfd4d3392 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:44:15 devstack sudo[105481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-3d29d549-9678-44c8-816a-6c0dfd4d3392 Aug 03 08:44:15 devstack sudo[105481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:44:15 devstack sudo[105481]: pam_unix(sudo:session): session closed for user root Aug 03 08:44:15 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-72b6f352-de3c-4bf6-b961-e55c4f0abe34 tempest-VolumesGetTest-1176098524 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-3d29d549-9678-44c8-816a-6c0dfd4d3392" returned: 0 in 0.443s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:44:15 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-72b6f352-de3c-4bf6-b961-e55c4f0abe34 tempest-VolumesGetTest-1176098524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-3d29d549-9678-44c8-816a-6c0dfd4d3392 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:44:15 devstack sudo[105487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-3d29d549-9678-44c8-816a-6c0dfd4d3392 Aug 03 08:44:15 devstack sudo[105487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:44:15 devstack sudo[105487]: pam_unix(sudo:session): session closed for user root Aug 03 08:44:15 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-72b6f352-de3c-4bf6-b961-e55c4f0abe34 tempest-VolumesGetTest-1176098524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-3d29d549-9678-44c8-816a-6c0dfd4d3392" returned: 0 in 0.271s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:44:15 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-72b6f352-de3c-4bf6-b961-e55c4f0abe34 tempest-VolumesGetTest-1176098524 None] Lock "cinder-quobyte-3d29d549-9678-44c8-816a-6c0dfd4d3392" released by "delete_volume" :: held 0.766s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:44:15 devstack cinder-volume[88899]: DEBUG cinder.quota [None req-72b6f352-de3c-4bf6-b961-e55c4f0abe34 tempest-VolumesGetTest-1176098524 None] Created reservations ['4e9f038f-16aa-417d-927a-dfcf2f0d554b', '2ba6d443-89c1-435a-9b52-e329ff096822', '104c89f7-013b-4f7b-ab97-500dada1f9f4', '6504c406-f835-4525-bc32-8b72ff9c7434'] {{(pid=88899) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 08:44:15 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-72b6f352-de3c-4bf6-b961-e55c4f0abe34 tempest-VolumesGetTest-1176098524 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:44:15 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-72b6f352-de3c-4bf6-b961-e55c4f0abe34 tempest-VolumesGetTest-1176098524 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:44:15 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-72b6f352-de3c-4bf6-b961-e55c4f0abe34 tempest-VolumesGetTest-1176098524 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:44:15 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-72b6f352-de3c-4bf6-b961-e55c4f0abe34 tempest-VolumesGetTest-1176098524 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:44:15 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-72b6f352-de3c-4bf6-b961-e55c4f0abe34 tempest-VolumesGetTest-1176098524 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:44:15 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-72b6f352-de3c-4bf6-b961-e55c4f0abe34 tempest-VolumesGetTest-1176098524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:44:16 devstack sudo[105490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a Aug 03 08:44:16 devstack sudo[105490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:44:16 devstack sudo[105490]: pam_unix(sudo:session): session closed for user root Aug 03 08:44:16 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-72b6f352-de3c-4bf6-b961-e55c4f0abe34 tempest-VolumesGetTest-1176098524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a" returned: 0 in 0.415s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:44:16 devstack cinder-volume[88899]: DEBUG cinder.manager [None req-72b6f352-de3c-4bf6-b961-e55c4f0abe34 tempest-VolumesGetTest-1176098524 None] Notifying Schedulers of capabilities ... {{(pid=88899) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 08:44:16 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-72b6f352-de3c-4bf6-b961-e55c4f0abe34 tempest-VolumesGetTest-1176098524 None] Deleted volume successfully. Aug 03 08:44:16 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-72b6f352-de3c-4bf6-b961-e55c4f0abe34 tempest-VolumesGetTest-1176098524 None] Lock "cinder-3d29d549-9678-44c8-816a-6c0dfd4d3392-delete_volume" released by "delete_volume" :: held 1.496s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:44:16 devstack cinder-volume[88899]: DEBUG cinder.volume.flows.manager.create_volume [None req-a327b421-a4c7-4c2b-b496-6f82202f8a22 tempest-VolumesGetTest-1176098524 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88899) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 08:44:16 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-a327b421-a4c7-4c2b-b496-6f82202f8a22 tempest-VolumesGetTest-1176098524 None] Flow 'volume_create_manager' (031c666f-2ffd-406f-8b29-d7db2bcdef15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:44:16 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-a327b421-a4c7-4c2b-b496-6f82202f8a22 tempest-VolumesGetTest-1176098524 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79c8feb6-37c9-43f3-b5a3-cf2a55d95456) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:44:16 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-a327b421-a4c7-4c2b-b496-6f82202f8a22 tempest-VolumesGetTest-1176098524 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79c8feb6-37c9-43f3-b5a3-cf2a55d95456) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:44:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-180945778',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05bbb02d-4373-4cf9-9175-e03927f03823,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='070ec6e114534bca93d5d121647b843c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:44:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:44:17Z,use_quota=True,user_id='e38f947f25c6490eb48ca43abf9ef753',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8bde7129-1dc4-42ab-b852-ab32c61b4921),volume_type_id=8bde7129-1dc4-42ab-b852-ab32c61b4921)' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:44:17 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-a327b421-a4c7-4c2b-b496-6f82202f8a22 tempest-VolumesGetTest-1176098524 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd5aa29e-9a7f-4df0-a93a-ce3d38e32cd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:44:17 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-a327b421-a4c7-4c2b-b496-6f82202f8a22 tempest-VolumesGetTest-1176098524 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd5aa29e-9a7f-4df0-a93a-ce3d38e32cd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:44:17 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-a327b421-a4c7-4c2b-b496-6f82202f8a22 tempest-VolumesGetTest-1176098524 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c070dc10-44bf-40ce-9d0d-22ae589839d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:44:17 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-a327b421-a4c7-4c2b-b496-6f82202f8a22 tempest-VolumesGetTest-1176098524 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c070dc10-44bf-40ce-9d0d-22ae589839d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '05bbb02d-4373-4cf9-9175-e03927f03823', 'volume_name': 'volume-05bbb02d-4373-4cf9-9175-e03927f03823', 'volume_size': 1}' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:44:17 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-a327b421-a4c7-4c2b-b496-6f82202f8a22 tempest-VolumesGetTest-1176098524 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18eab2c1-55c7-40de-bcc3-c746d889b8a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:44:17 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-a327b421-a4c7-4c2b-b496-6f82202f8a22 tempest-VolumesGetTest-1176098524 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18eab2c1-55c7-40de-bcc3-c746d889b8a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:44:17 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-a327b421-a4c7-4c2b-b496-6f82202f8a22 tempest-VolumesGetTest-1176098524 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e4c33c5-4bb9-4ff6-9abc-2ef625aacb5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:44:17 devstack cinder-volume[88899]: INFO cinder.volume.flows.manager.create_volume [None req-a327b421-a4c7-4c2b-b496-6f82202f8a22 tempest-VolumesGetTest-1176098524 None] Volume 05bbb02d-4373-4cf9-9175-e03927f03823: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-05bbb02d-4373-4cf9-9175-e03927f03823', 'volume_size': 1} Aug 03 08:44:17 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-a327b421-a4c7-4c2b-b496-6f82202f8a22 tempest-VolumesGetTest-1176098524 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:44:17 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-a327b421-a4c7-4c2b-b496-6f82202f8a22 tempest-VolumesGetTest-1176098524 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:44:17 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-a327b421-a4c7-4c2b-b496-6f82202f8a22 tempest-VolumesGetTest-1176098524 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:44:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-180945778',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05bbb02d-4373-4cf9-9175-e03927f03823,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='070ec6e114534bca93d5d121647b843c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:44:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:44:17Z,use_quota=True,user_id='e38f947f25c6490eb48ca43abf9ef753',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8bde7129-1dc4-42ab-b852-ab32c61b4921),volume_type_id=8bde7129-1dc4-42ab-b852-ab32c61b4921)}" {{(pid=88899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 08:44:17 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-a327b421-a4c7-4c2b-b496-6f82202f8a22 tempest-VolumesGetTest-1176098524 None] Creating volume 05bbb02d-4373-4cf9-9175-e03927f03823 {{(pid=88899) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 08:44:17 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-a327b421-a4c7-4c2b-b496-6f82202f8a22 tempest-VolumesGetTest-1176098524 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:44:17 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-a327b421-a4c7-4c2b-b496-6f82202f8a22 tempest-VolumesGetTest-1176098524 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:44:17 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-a327b421-a4c7-4c2b-b496-6f82202f8a22 tempest-VolumesGetTest-1176098524 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:44:17 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-a327b421-a4c7-4c2b-b496-6f82202f8a22 tempest-VolumesGetTest-1176098524 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:44:17 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-a327b421-a4c7-4c2b-b496-6f82202f8a22 tempest-VolumesGetTest-1176098524 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:44:17 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-a327b421-a4c7-4c2b-b496-6f82202f8a22 tempest-VolumesGetTest-1176098524 None] Selected osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385 as target Quobyte volume. {{(pid=88899) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 08:44:17 devstack cinder-volume[88899]: INFO cinder.volume.drivers.remotefs [None req-a327b421-a4c7-4c2b-b496-6f82202f8a22 tempest-VolumesGetTest-1176098524 None] casted to osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385 Aug 03 08:44:17 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-a327b421-a4c7-4c2b-b496-6f82202f8a22 tempest-VolumesGetTest-1176098524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-05bbb02d-4373-4cf9-9175-e03927f03823 1073741824 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:44:17 devstack sudo[105494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-05bbb02d-4373-4cf9-9175-e03927f03823 1073741824 Aug 03 08:44:17 devstack sudo[105494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:44:17 devstack sudo[105494]: pam_unix(sudo:session): session closed for user root Aug 03 08:44:17 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-a327b421-a4c7-4c2b-b496-6f82202f8a22 tempest-VolumesGetTest-1176098524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-05bbb02d-4373-4cf9-9175-e03927f03823 1073741824" returned: 0 in 0.601s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:44:17 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-a327b421-a4c7-4c2b-b496-6f82202f8a22 tempest-VolumesGetTest-1176098524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-05bbb02d-4373-4cf9-9175-e03927f03823 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:44:17 devstack sudo[105500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-05bbb02d-4373-4cf9-9175-e03927f03823 Aug 03 08:44:17 devstack sudo[105500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:44:17 devstack sudo[105500]: pam_unix(sudo:session): session closed for user root Aug 03 08:44:17 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-a327b421-a4c7-4c2b-b496-6f82202f8a22 tempest-VolumesGetTest-1176098524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-05bbb02d-4373-4cf9-9175-e03927f03823" returned: 0 in 0.304s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:44:17 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-a327b421-a4c7-4c2b-b496-6f82202f8a22 tempest-VolumesGetTest-1176098524 None] <== create_volume: return (957ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'} {{(pid=88899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 08:44:17 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-a327b421-a4c7-4c2b-b496-6f82202f8a22 tempest-VolumesGetTest-1176098524 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.962s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:44:18 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-a327b421-a4c7-4c2b-b496-6f82202f8a22 tempest-VolumesGetTest-1176098524 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e4c33c5-4bb9-4ff6-9abc-2ef625aacb5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-05bbb02d-4373-4cf9-9175-e03927f03823', 'volume_size': 1}' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:44:18 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-a327b421-a4c7-4c2b-b496-6f82202f8a22 tempest-VolumesGetTest-1176098524 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49649e42-23ff-4238-bc34-2ddec9ee5513) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:44:18 devstack cinder-volume[88899]: INFO cinder.volume.flows.manager.create_volume [None req-a327b421-a4c7-4c2b-b496-6f82202f8a22 tempest-VolumesGetTest-1176098524 None] Volume volume-05bbb02d-4373-4cf9-9175-e03927f03823 (05bbb02d-4373-4cf9-9175-e03927f03823): created successfully Aug 03 08:44:18 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-a327b421-a4c7-4c2b-b496-6f82202f8a22 tempest-VolumesGetTest-1176098524 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49649e42-23ff-4238-bc34-2ddec9ee5513) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:44:18 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-a327b421-a4c7-4c2b-b496-6f82202f8a22 tempest-VolumesGetTest-1176098524 None] Flow 'volume_create_manager' (031c666f-2ffd-406f-8b29-d7db2bcdef15) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:44:18 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-a327b421-a4c7-4c2b-b496-6f82202f8a22 tempest-VolumesGetTest-1176098524 None] Created volume successfully. Aug 03 08:44:19 devstack cinder-volume[88899]: DEBUG cinder.volume.flows.manager.create_volume [None req-10eb0ac1-447b-4e79-9a25-a4067769d059 tempest-VolumesGetTest-1176098524 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88899) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 08:44:19 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-10eb0ac1-447b-4e79-9a25-a4067769d059 tempest-VolumesGetTest-1176098524 None] Flow 'volume_create_manager' (b9c82f14-e0ad-484f-8996-27c59e836761) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:44:19 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-10eb0ac1-447b-4e79-9a25-a4067769d059 tempest-VolumesGetTest-1176098524 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (02fc953e-fcf7-46ed-bc73-f99d992e1024) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:44:19 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-10eb0ac1-447b-4e79-9a25-a4067769d059 tempest-VolumesGetTest-1176098524 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (02fc953e-fcf7-46ed-bc73-f99d992e1024) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:44:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-933817972',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb44d2da-9cf8-4046-9a5d-836cfd22b778,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='070ec6e114534bca93d5d121647b843c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:44:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=05bbb02d-4373-4cf9-9175-e03927f03823,status='creating',terminated_at=None,updated_at=2026-08-03T06:44:19Z,use_quota=True,user_id='e38f947f25c6490eb48ca43abf9ef753',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8bde7129-1dc4-42ab-b852-ab32c61b4921),volume_type_id=8bde7129-1dc4-42ab-b852-ab32c61b4921)' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:44:19 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-10eb0ac1-447b-4e79-9a25-a4067769d059 tempest-VolumesGetTest-1176098524 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f4176f2-a2b0-4ae2-8ee3-ce67b1ce97fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:44:19 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-10eb0ac1-447b-4e79-9a25-a4067769d059 tempest-VolumesGetTest-1176098524 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f4176f2-a2b0-4ae2-8ee3-ce67b1ce97fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:44:19 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-10eb0ac1-447b-4e79-9a25-a4067769d059 tempest-VolumesGetTest-1176098524 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f47e0d00-27ce-420e-9c8a-0faad0bf4fd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:44:19 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-10eb0ac1-447b-4e79-9a25-a4067769d059 tempest-VolumesGetTest-1176098524 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f47e0d00-27ce-420e-9c8a-0faad0bf4fd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'eb44d2da-9cf8-4046-9a5d-836cfd22b778', 'volume_name': 'volume-eb44d2da-9cf8-4046-9a5d-836cfd22b778', 'volume_size': 1, 'source_volid': '05bbb02d-4373-4cf9-9175-e03927f03823', 'source_volstatus': 'available'}' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:44:19 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-10eb0ac1-447b-4e79-9a25-a4067769d059 tempest-VolumesGetTest-1176098524 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (48e5619a-d622-4617-a305-a05f7611b299) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:44:19 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-10eb0ac1-447b-4e79-9a25-a4067769d059 tempest-VolumesGetTest-1176098524 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (48e5619a-d622-4617-a305-a05f7611b299) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:44:19 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-10eb0ac1-447b-4e79-9a25-a4067769d059 tempest-VolumesGetTest-1176098524 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (243a3e68-faa4-4101-af3c-3112a2e439a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:44:19 devstack cinder-volume[88899]: INFO cinder.volume.flows.manager.create_volume [None req-10eb0ac1-447b-4e79-9a25-a4067769d059 tempest-VolumesGetTest-1176098524 None] Volume eb44d2da-9cf8-4046-9a5d-836cfd22b778: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-eb44d2da-9cf8-4046-9a5d-836cfd22b778', 'volume_size': 1, 'source_volid': '05bbb02d-4373-4cf9-9175-e03927f03823', 'source_volstatus': 'available'} Aug 03 08:44:19 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-10eb0ac1-447b-4e79-9a25-a4067769d059 tempest-VolumesGetTest-1176098524 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:44:19 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-10eb0ac1-447b-4e79-9a25-a4067769d059 tempest-VolumesGetTest-1176098524 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:44:19 devstack cinder-volume[88899]: INFO cinder.volume.drivers.remotefs [None req-10eb0ac1-447b-4e79-9a25-a4067769d059 tempest-VolumesGetTest-1176098524 None] Cloning volume 05bbb02d-4373-4cf9-9175-e03927f03823 to volume eb44d2da-9cf8-4046-9a5d-836cfd22b778 Aug 03 08:44:19 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-10eb0ac1-447b-4e79-9a25-a4067769d059 tempest-VolumesGetTest-1176098524 None] Creating offline snapshot 6fcead60-d52e-4784-a5bc-86ca7a7956b4 of volume 05bbb02d-4373-4cf9-9175-e03927f03823 {{(pid=88899) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 03 08:44:19 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e751e2b-f44d-44d9-950f-9aae20cafe7a]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:44:19 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-10eb0ac1-447b-4e79-9a25-a4067769d059 tempest-VolumesGetTest-1176098524 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-05bbb02d-4373-4cf9-9175-e03927f03823 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:44:19 devstack sudo[105506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-05bbb02d-4373-4cf9-9175-e03927f03823 Aug 03 08:44:19 devstack sudo[105506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:44:20 devstack sudo[105506]: pam_unix(sudo:session): session closed for user root Aug 03 08:44:20 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-10eb0ac1-447b-4e79-9a25-a4067769d059 tempest-VolumesGetTest-1176098524 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-05bbb02d-4373-4cf9-9175-e03927f03823" returned: 0 in 0.394s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:44:20 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-10eb0ac1-447b-4e79-9a25-a4067769d059 tempest-VolumesGetTest-1176098524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-05bbb02d-4373-4cf9-9175-e03927f03823,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-05bbb02d-4373-4cf9-9175-e03927f03823.6fcead60-d52e-4784-a5bc-86ca7a7956b4 1G {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:44:20 devstack sudo[105511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-05bbb02d-4373-4cf9-9175-e03927f03823,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-05bbb02d-4373-4cf9-9175-e03927f03823.6fcead60-d52e-4784-a5bc-86ca7a7956b4 1G Aug 03 08:44:20 devstack sudo[105511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:44:20 devstack cinder-volume[88899]: DEBUG cinder.volume.flows.manager.create_volume [None req-93cb646b-ef41-4436-b108-24bd534f2bb5 tempest-VolumeDependencyTests-1073688899 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88899) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 08:44:20 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-93cb646b-ef41-4436-b108-24bd534f2bb5 tempest-VolumeDependencyTests-1073688899 None] Flow 'volume_create_manager' (4de5ad30-e568-4ba2-927c-e5d3da570611) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:44:20 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-93cb646b-ef41-4436-b108-24bd534f2bb5 tempest-VolumeDependencyTests-1073688899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c52fd4d-c38d-4086-83e6-7ad01fa9f131) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:44:20 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-93cb646b-ef41-4436-b108-24bd534f2bb5 tempest-VolumeDependencyTests-1073688899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c52fd4d-c38d-4086-83e6-7ad01fa9f131) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:44:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-869536412',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=66ec0c6b-ba7c-4f8a-8c2a-6dbfd6262fc1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c2f62930ea114d94aae304e8ed339f9c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:44:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:44:20Z,use_quota=True,user_id='de61709cf33340bf9e956c0545be3966',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8bde7129-1dc4-42ab-b852-ab32c61b4921),volume_type_id=8bde7129-1dc4-42ab-b852-ab32c61b4921)' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:44:20 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-93cb646b-ef41-4436-b108-24bd534f2bb5 tempest-VolumeDependencyTests-1073688899 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee339e9c-260e-4a59-a980-a5cc8ae69b2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:44:20 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-93cb646b-ef41-4436-b108-24bd534f2bb5 tempest-VolumeDependencyTests-1073688899 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee339e9c-260e-4a59-a980-a5cc8ae69b2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:44:20 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-93cb646b-ef41-4436-b108-24bd534f2bb5 tempest-VolumeDependencyTests-1073688899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76f7c506-d8ba-447e-8a2d-f46cc31ab6a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:44:20 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-93cb646b-ef41-4436-b108-24bd534f2bb5 tempest-VolumeDependencyTests-1073688899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76f7c506-d8ba-447e-8a2d-f46cc31ab6a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '66ec0c6b-ba7c-4f8a-8c2a-6dbfd6262fc1', 'volume_name': 'volume-66ec0c6b-ba7c-4f8a-8c2a-6dbfd6262fc1', 'volume_size': 1}' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:44:20 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-93cb646b-ef41-4436-b108-24bd534f2bb5 tempest-VolumeDependencyTests-1073688899 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa470f3b-72b7-4dc2-bd1b-bc0fe151c6b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:44:20 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-93cb646b-ef41-4436-b108-24bd534f2bb5 tempest-VolumeDependencyTests-1073688899 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa470f3b-72b7-4dc2-bd1b-bc0fe151c6b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:44:20 devstack sudo[105511]: pam_unix(sudo:session): session closed for user root Aug 03 08:44:20 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-93cb646b-ef41-4436-b108-24bd534f2bb5 tempest-VolumeDependencyTests-1073688899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1c0d5c8-00bc-4e6a-b1a0-65f3b6fe0a2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:44:20 devstack cinder-volume[88899]: INFO cinder.volume.flows.manager.create_volume [None req-93cb646b-ef41-4436-b108-24bd534f2bb5 tempest-VolumeDependencyTests-1073688899 None] Volume 66ec0c6b-ba7c-4f8a-8c2a-6dbfd6262fc1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-66ec0c6b-ba7c-4f8a-8c2a-6dbfd6262fc1', 'volume_size': 1} Aug 03 08:44:20 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-93cb646b-ef41-4436-b108-24bd534f2bb5 tempest-VolumeDependencyTests-1073688899 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:44:20 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-10eb0ac1-447b-4e79-9a25-a4067769d059 tempest-VolumesGetTest-1176098524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-05bbb02d-4373-4cf9-9175-e03927f03823,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-05bbb02d-4373-4cf9-9175-e03927f03823.6fcead60-d52e-4784-a5bc-86ca7a7956b4 1G" returned: 0 in 0.512s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:44:20 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-10eb0ac1-447b-4e79-9a25-a4067769d059 tempest-VolumesGetTest-1176098524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-05bbb02d-4373-4cf9-9175-e03927f03823 -F qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-05bbb02d-4373-4cf9-9175-e03927f03823.6fcead60-d52e-4784-a5bc-86ca7a7956b4 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:44:20 devstack sudo[105517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-05bbb02d-4373-4cf9-9175-e03927f03823 -F qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-05bbb02d-4373-4cf9-9175-e03927f03823.6fcead60-d52e-4784-a5bc-86ca7a7956b4 Aug 03 08:44:20 devstack sudo[105517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:44:20 devstack sudo[105517]: pam_unix(sudo:session): session closed for user root Aug 03 08:44:20 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-10eb0ac1-447b-4e79-9a25-a4067769d059 tempest-VolumesGetTest-1176098524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-05bbb02d-4373-4cf9-9175-e03927f03823 -F qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-05bbb02d-4373-4cf9-9175-e03927f03823.6fcead60-d52e-4784-a5bc-86ca7a7956b4" returned: 0 in 0.344s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:44:20 devstack cinder-volume[88899]: WARNING cinder.volume.drivers.remotefs [None req-10eb0ac1-447b-4e79-9a25-a4067769d059 tempest-VolumesGetTest-1176098524 None] /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-05bbb02d-4373-4cf9-9175-e03927f03823.6fcead60-d52e-4784-a5bc-86ca7a7956b4 is being set with open permissions: ugo+rw Aug 03 08:44:20 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-10eb0ac1-447b-4e79-9a25-a4067769d059 tempest-VolumesGetTest-1176098524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-05bbb02d-4373-4cf9-9175-e03927f03823.6fcead60-d52e-4784-a5bc-86ca7a7956b4 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:44:20 devstack sudo[105522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-05bbb02d-4373-4cf9-9175-e03927f03823.6fcead60-d52e-4784-a5bc-86ca7a7956b4 Aug 03 08:44:20 devstack sudo[105522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:44:21 devstack sudo[105522]: pam_unix(sudo:session): session closed for user root Aug 03 08:44:21 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-10eb0ac1-447b-4e79-9a25-a4067769d059 tempest-VolumesGetTest-1176098524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-05bbb02d-4373-4cf9-9175-e03927f03823.6fcead60-d52e-4784-a5bc-86ca7a7956b4" returned: 0 in 0.276s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:44:21 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-10eb0ac1-447b-4e79-9a25-a4067769d059 tempest-VolumesGetTest-1176098524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-05bbb02d-4373-4cf9-9175-e03927f03823.info {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:44:21 devstack sudo[105525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-05bbb02d-4373-4cf9-9175-e03927f03823.info Aug 03 08:44:21 devstack sudo[105525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:44:21 devstack sudo[105525]: pam_unix(sudo:session): session closed for user root Aug 03 08:44:21 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-10eb0ac1-447b-4e79-9a25-a4067769d059 tempest-VolumesGetTest-1176098524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-05bbb02d-4373-4cf9-9175-e03927f03823.info" returned: 0 in 0.280s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:44:21 devstack cinder-volume[88899]: WARNING cinder.volume.drivers.remotefs [None req-10eb0ac1-447b-4e79-9a25-a4067769d059 tempest-VolumesGetTest-1176098524 None] /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-05bbb02d-4373-4cf9-9175-e03927f03823.info is being set with open permissions: ugo+rw Aug 03 08:44:21 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-10eb0ac1-447b-4e79-9a25-a4067769d059 tempest-VolumesGetTest-1176098524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-05bbb02d-4373-4cf9-9175-e03927f03823.info {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:44:21 devstack sudo[105528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-05bbb02d-4373-4cf9-9175-e03927f03823.info Aug 03 08:44:21 devstack sudo[105528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:44:21 devstack sudo[105528]: pam_unix(sudo:session): session closed for user root Aug 03 08:44:21 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-10eb0ac1-447b-4e79-9a25-a4067769d059 tempest-VolumesGetTest-1176098524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-05bbb02d-4373-4cf9-9175-e03927f03823.info" returned: 0 in 0.256s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:44:21 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-10eb0ac1-447b-4e79-9a25-a4067769d059 tempest-VolumesGetTest-1176098524 None] Acquiring lock "cinder-quobyte-eb44d2da-9cf8-4046-9a5d-836cfd22b778" by "_copy_volume_from_snapshot" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:44:21 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-10eb0ac1-447b-4e79-9a25-a4067769d059 tempest-VolumesGetTest-1176098524 None] Lock "cinder-quobyte-eb44d2da-9cf8-4046-9a5d-836cfd22b778" acquired by "_copy_volume_from_snapshot" :: waited 0.015s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:44:21 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-10eb0ac1-447b-4e79-9a25-a4067769d059 tempest-VolumesGetTest-1176098524 None] snapshot: 6fcead60-d52e-4784-a5bc-86ca7a7956b4, volume: eb44d2da-9cf8-4046-9a5d-836cfd22b778, {{(pid=88899) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Aug 03 08:44:21 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-10eb0ac1-447b-4e79-9a25-a4067769d059 tempest-VolumesGetTest-1176098524 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:44:21 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-10eb0ac1-447b-4e79-9a25-a4067769d059 tempest-VolumesGetTest-1176098524 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:44:21 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-10eb0ac1-447b-4e79-9a25-a4067769d059 tempest-VolumesGetTest-1176098524 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:44:21 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-10eb0ac1-447b-4e79-9a25-a4067769d059 tempest-VolumesGetTest-1176098524 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:44:21 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-10eb0ac1-447b-4e79-9a25-a4067769d059 tempest-VolumesGetTest-1176098524 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:44:21 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a8eb448-1c62-4665-be18-1665ec4c584b]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:44:21 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-10eb0ac1-447b-4e79-9a25-a4067769d059 tempest-VolumesGetTest-1176098524 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-05bbb02d-4373-4cf9-9175-e03927f03823.6fcead60-d52e-4784-a5bc-86ca7a7956b4 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:44:21 devstack sudo[105531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-05bbb02d-4373-4cf9-9175-e03927f03823.6fcead60-d52e-4784-a5bc-86ca7a7956b4 Aug 03 08:44:21 devstack sudo[105531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:44:22 devstack sudo[105531]: pam_unix(sudo:session): session closed for user root Aug 03 08:44:22 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-10eb0ac1-447b-4e79-9a25-a4067769d059 tempest-VolumesGetTest-1176098524 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-05bbb02d-4373-4cf9-9175-e03927f03823.6fcead60-d52e-4784-a5bc-86ca7a7956b4" returned: 0 in 0.406s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:44:22 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-10eb0ac1-447b-4e79-9a25-a4067769d059 tempest-VolumesGetTest-1176098524 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-05bbb02d-4373-4cf9-9175-e03927f03823(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88899) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 03 08:44:22 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[85954e9f-297e-47cc-881e-4783e62f4f64]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:44:22 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-10eb0ac1-447b-4e79-9a25-a4067769d059 tempest-VolumesGetTest-1176098524 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-05bbb02d-4373-4cf9-9175-e03927f03823 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:44:22 devstack sudo[105537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-05bbb02d-4373-4cf9-9175-e03927f03823 Aug 03 08:44:22 devstack sudo[105537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:44:22 devstack sudo[105537]: pam_unix(sudo:session): session closed for user root Aug 03 08:44:22 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-10eb0ac1-447b-4e79-9a25-a4067769d059 tempest-VolumesGetTest-1176098524 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-05bbb02d-4373-4cf9-9175-e03927f03823" returned: 0 in 0.378s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:44:22 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-10eb0ac1-447b-4e79-9a25-a4067769d059 tempest-VolumesGetTest-1176098524 None] will copy from snapshot at /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-05bbb02d-4373-4cf9-9175-e03927f03823 {{(pid=88899) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Aug 03 08:44:22 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-10eb0ac1-447b-4e79-9a25-a4067769d059 tempest-VolumesGetTest-1176098524 None] Creating direct copy from snapshot {{(pid=88899) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Aug 03 08:44:22 devstack cinder-volume[88899]: DEBUG cinder.utils [None req-10eb0ac1-447b-4e79-9a25-a4067769d059 tempest-VolumesGetTest-1176098524 None] Path /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-eb44d2da-9cf8-4046-9a5d-836cfd22b778 not found in is_blk_device check {{(pid=88899) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Aug 03 08:44:22 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-10eb0ac1-447b-4e79-9a25-a4067769d059 tempest-VolumesGetTest-1176098524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-05bbb02d-4373-4cf9-9175-e03927f03823 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-eb44d2da-9cf8-4046-9a5d-836cfd22b778 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:44:22 devstack sudo[105543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-05bbb02d-4373-4cf9-9175-e03927f03823 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-eb44d2da-9cf8-4046-9a5d-836cfd22b778 Aug 03 08:44:22 devstack sudo[105543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:44:27 devstack sudo[105543]: pam_unix(sudo:session): session closed for user root Aug 03 08:44:27 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-10eb0ac1-447b-4e79-9a25-a4067769d059 tempest-VolumesGetTest-1176098524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-05bbb02d-4373-4cf9-9175-e03927f03823 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-eb44d2da-9cf8-4046-9a5d-836cfd22b778" returned: 0 in 4.667s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:44:27 devstack cinder-volume[88899]: DEBUG cinder.image.image_utils [None req-10eb0ac1-447b-4e79-9a25-a4067769d059 tempest-VolumesGetTest-1176098524 None] Image conversion details: src /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-05bbb02d-4373-4cf9-9175-e03927f03823, size 1024.00 MB, duration 4.67 sec, destination /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-eb44d2da-9cf8-4046-9a5d-836cfd22b778 {{(pid=88899) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 03 08:44:27 devstack cinder-volume[88899]: INFO cinder.image.image_utils [None req-10eb0ac1-447b-4e79-9a25-a4067769d059 tempest-VolumesGetTest-1176098524 None] Converted 1024.00 MB image at 219.36 MB/s Aug 03 08:44:27 devstack cinder-volume[88899]: WARNING cinder.volume.drivers.remotefs [None req-10eb0ac1-447b-4e79-9a25-a4067769d059 tempest-VolumesGetTest-1176098524 None] /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-eb44d2da-9cf8-4046-9a5d-836cfd22b778 is being set with open permissions: ugo+rw Aug 03 08:44:27 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-10eb0ac1-447b-4e79-9a25-a4067769d059 tempest-VolumesGetTest-1176098524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-eb44d2da-9cf8-4046-9a5d-836cfd22b778 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:44:27 devstack sudo[105556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-eb44d2da-9cf8-4046-9a5d-836cfd22b778 Aug 03 08:44:27 devstack sudo[105556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:44:27 devstack sudo[105556]: pam_unix(sudo:session): session closed for user root Aug 03 08:44:27 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-10eb0ac1-447b-4e79-9a25-a4067769d059 tempest-VolumesGetTest-1176098524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-eb44d2da-9cf8-4046-9a5d-836cfd22b778" returned: 0 in 0.251s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:44:27 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-10eb0ac1-447b-4e79-9a25-a4067769d059 tempest-VolumesGetTest-1176098524 None] Lock "cinder-quobyte-eb44d2da-9cf8-4046-9a5d-836cfd22b778" released by "_copy_volume_from_snapshot" :: held 5.779s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:44:27 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-10eb0ac1-447b-4e79-9a25-a4067769d059 tempest-VolumesGetTest-1176098524 None] Acquiring lock "cinder-quobyte-6fcead60-d52e-4784-a5bc-86ca7a7956b4" by "_delete_snapshot" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:44:27 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-10eb0ac1-447b-4e79-9a25-a4067769d059 tempest-VolumesGetTest-1176098524 None] Lock "cinder-quobyte-6fcead60-d52e-4784-a5bc-86ca7a7956b4" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:44:27 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-10eb0ac1-447b-4e79-9a25-a4067769d059 tempest-VolumesGetTest-1176098524 None] Deleting offline snapshot 6fcead60-d52e-4784-a5bc-86ca7a7956b4 of volume 05bbb02d-4373-4cf9-9175-e03927f03823 {{(pid=88899) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 03 08:44:27 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-10eb0ac1-447b-4e79-9a25-a4067769d059 tempest-VolumesGetTest-1176098524 None] snapshot_file for this snap is: volume-05bbb02d-4373-4cf9-9175-e03927f03823.6fcead60-d52e-4784-a5bc-86ca7a7956b4 {{(pid=88899) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 03 08:44:27 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9511e32-4b81-46fd-a32d-91f9c79bbe9e]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:44:27 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-10eb0ac1-447b-4e79-9a25-a4067769d059 tempest-VolumesGetTest-1176098524 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-05bbb02d-4373-4cf9-9175-e03927f03823.6fcead60-d52e-4784-a5bc-86ca7a7956b4 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:44:27 devstack cinder-volume[88899]: DEBUG cinder.volume.flows.manager.create_volume [None req-fd16c1f7-84c9-4462-8e97-ca359ac98b18 tempest-CreateVolumesFromImageTest-1275891140 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88899) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 08:44:27 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-fd16c1f7-84c9-4462-8e97-ca359ac98b18 tempest-CreateVolumesFromImageTest-1275891140 None] Flow 'volume_create_manager' (2c92f62f-ef9c-4921-8e34-9e01e140fd58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:44:27 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-fd16c1f7-84c9-4462-8e97-ca359ac98b18 tempest-CreateVolumesFromImageTest-1275891140 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4498c7ca-fa3c-4bd1-9c05-bd8849bffa8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:44:27 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-fd16c1f7-84c9-4462-8e97-ca359ac98b18 tempest-CreateVolumesFromImageTest-1275891140 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4498c7ca-fa3c-4bd1-9c05-bd8849bffa8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:44:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-918288741',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e996a37-f86d-49d8-8f93-2cd097f1b134,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ccd948527e44353940b97b09d943986',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:44:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:44:28Z,use_quota=True,user_id='021babae627b4acdab15e33fea43f4ef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8bde7129-1dc4-42ab-b852-ab32c61b4921),volume_type_id=8bde7129-1dc4-42ab-b852-ab32c61b4921)' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:44:27 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-fd16c1f7-84c9-4462-8e97-ca359ac98b18 tempest-CreateVolumesFromImageTest-1275891140 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (418e820d-22e0-4fa6-ac0b-90500816fb57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:44:27 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-fd16c1f7-84c9-4462-8e97-ca359ac98b18 tempest-CreateVolumesFromImageTest-1275891140 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (418e820d-22e0-4fa6-ac0b-90500816fb57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:44:27 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-fd16c1f7-84c9-4462-8e97-ca359ac98b18 tempest-CreateVolumesFromImageTest-1275891140 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f3151459-9001-4ec2-ac94-f991ea4ebbed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:44:27 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-fd16c1f7-84c9-4462-8e97-ca359ac98b18 tempest-CreateVolumesFromImageTest-1275891140 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f3151459-9001-4ec2-ac94-f991ea4ebbed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1e996a37-f86d-49d8-8f93-2cd097f1b134', 'volume_name': 'volume-1e996a37-f86d-49d8-8f93-2cd097f1b134', 'volume_size': 1}' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:44:27 devstack sudo[105559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-05bbb02d-4373-4cf9-9175-e03927f03823.6fcead60-d52e-4784-a5bc-86ca7a7956b4 Aug 03 08:44:27 devstack sudo[105559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:44:27 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-fd16c1f7-84c9-4462-8e97-ca359ac98b18 tempest-CreateVolumesFromImageTest-1275891140 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b602963a-f2f9-4c99-b125-04f65e388985) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:44:27 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-fd16c1f7-84c9-4462-8e97-ca359ac98b18 tempest-CreateVolumesFromImageTest-1275891140 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b602963a-f2f9-4c99-b125-04f65e388985) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:44:27 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-fd16c1f7-84c9-4462-8e97-ca359ac98b18 tempest-CreateVolumesFromImageTest-1275891140 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba6ce061-7631-439e-b82e-c75b42034a67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:44:27 devstack cinder-volume[88899]: INFO cinder.volume.flows.manager.create_volume [None req-fd16c1f7-84c9-4462-8e97-ca359ac98b18 tempest-CreateVolumesFromImageTest-1275891140 None] Volume 1e996a37-f86d-49d8-8f93-2cd097f1b134: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1e996a37-f86d-49d8-8f93-2cd097f1b134', 'volume_size': 1} Aug 03 08:44:27 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-fd16c1f7-84c9-4462-8e97-ca359ac98b18 tempest-CreateVolumesFromImageTest-1275891140 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:44:28 devstack cinder-volume[88899]: DEBUG cinder.volume.flows.manager.create_volume [None req-59dbf581-f3a0-454d-addc-8be2ffb2c089 tempest-CreateVolumesFromImageTest-1275891140 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88899) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 08:44:28 devstack sudo[105559]: pam_unix(sudo:session): session closed for user root Aug 03 08:44:28 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-59dbf581-f3a0-454d-addc-8be2ffb2c089 tempest-CreateVolumesFromImageTest-1275891140 None] Flow 'volume_create_manager' (b1c39e08-9df4-4fa6-868d-1f323fa9f94d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:44:28 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-59dbf581-f3a0-454d-addc-8be2ffb2c089 tempest-CreateVolumesFromImageTest-1275891140 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9efe2c5-78a5-4f9c-a071-6266205eda44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:44:28 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-10eb0ac1-447b-4e79-9a25-a4067769d059 tempest-VolumesGetTest-1176098524 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-05bbb02d-4373-4cf9-9175-e03927f03823.6fcead60-d52e-4784-a5bc-86ca7a7956b4" returned: 0 in 0.443s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:44:28 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-10eb0ac1-447b-4e79-9a25-a4067769d059 tempest-VolumesGetTest-1176098524 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-05bbb02d-4373-4cf9-9175-e03927f03823(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88899) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 03 08:44:28 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-59dbf581-f3a0-454d-addc-8be2ffb2c089 tempest-CreateVolumesFromImageTest-1275891140 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9efe2c5-78a5-4f9c-a071-6266205eda44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:44:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1725897301',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2786cc73-cf36-4f63-9480-9c6c2a5db506,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ccd948527e44353940b97b09d943986',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:44:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:44:28Z,use_quota=True,user_id='021babae627b4acdab15e33fea43f4ef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8bde7129-1dc4-42ab-b852-ab32c61b4921),volume_type_id=8bde7129-1dc4-42ab-b852-ab32c61b4921)' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:44:28 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-59dbf581-f3a0-454d-addc-8be2ffb2c089 tempest-CreateVolumesFromImageTest-1275891140 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de2a7346-baa4-4a8b-a908-a0fb0384bc2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:44:28 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-59dbf581-f3a0-454d-addc-8be2ffb2c089 tempest-CreateVolumesFromImageTest-1275891140 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de2a7346-baa4-4a8b-a908-a0fb0384bc2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:44:28 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-59dbf581-f3a0-454d-addc-8be2ffb2c089 tempest-CreateVolumesFromImageTest-1275891140 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e1e439d-b2be-43a4-8514-1bbce36d718d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:44:28 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-59dbf581-f3a0-454d-addc-8be2ffb2c089 tempest-CreateVolumesFromImageTest-1275891140 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e1e439d-b2be-43a4-8514-1bbce36d718d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2786cc73-cf36-4f63-9480-9c6c2a5db506', 'volume_name': 'volume-2786cc73-cf36-4f63-9480-9c6c2a5db506', 'volume_size': 1}' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:44:28 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-59dbf581-f3a0-454d-addc-8be2ffb2c089 tempest-CreateVolumesFromImageTest-1275891140 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25d143c0-eb0e-4326-8717-99e695332b47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:44:28 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-59dbf581-f3a0-454d-addc-8be2ffb2c089 tempest-CreateVolumesFromImageTest-1275891140 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25d143c0-eb0e-4326-8717-99e695332b47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:44:28 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-59dbf581-f3a0-454d-addc-8be2ffb2c089 tempest-CreateVolumesFromImageTest-1275891140 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (79ded2b3-44a9-4b5e-ac8e-3fba1412b5c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:44:28 devstack cinder-volume[88899]: INFO cinder.volume.flows.manager.create_volume [None req-59dbf581-f3a0-454d-addc-8be2ffb2c089 tempest-CreateVolumesFromImageTest-1275891140 None] Volume 2786cc73-cf36-4f63-9480-9c6c2a5db506: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2786cc73-cf36-4f63-9480-9c6c2a5db506', 'volume_size': 1} Aug 03 08:44:28 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-59dbf581-f3a0-454d-addc-8be2ffb2c089 tempest-CreateVolumesFromImageTest-1275891140 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:44:28 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[6023916c-68fd-4b8f-9cb9-2a7b92eb6d0f]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:44:28 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-10eb0ac1-447b-4e79-9a25-a4067769d059 tempest-VolumesGetTest-1176098524 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-05bbb02d-4373-4cf9-9175-e03927f03823 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:44:28 devstack sudo[105564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-05bbb02d-4373-4cf9-9175-e03927f03823 Aug 03 08:44:28 devstack sudo[105564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:44:28 devstack cinder-volume[88899]: DEBUG cinder.volume.flows.manager.create_volume [None req-0eb27d2b-cd1c-466f-abcd-5b29d128bc8d tempest-CreateVolumesFromImageTest-1275891140 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88899) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 08:44:28 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-0eb27d2b-cd1c-466f-abcd-5b29d128bc8d tempest-CreateVolumesFromImageTest-1275891140 None] Flow 'volume_create_manager' (7ac837e4-7071-44a0-9a71-19d1ff260c5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:44:28 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-0eb27d2b-cd1c-466f-abcd-5b29d128bc8d tempest-CreateVolumesFromImageTest-1275891140 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c11a6ad-50cf-43a1-97ba-24c7c9957b81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:44:28 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-0eb27d2b-cd1c-466f-abcd-5b29d128bc8d tempest-CreateVolumesFromImageTest-1275891140 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c11a6ad-50cf-43a1-97ba-24c7c9957b81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:44:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-478578969',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fd20bdc6-ed08-4754-92f4-22caa9db0a58,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ccd948527e44353940b97b09d943986',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:44:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:44:28Z,use_quota=True,user_id='021babae627b4acdab15e33fea43f4ef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8bde7129-1dc4-42ab-b852-ab32c61b4921),volume_type_id=8bde7129-1dc4-42ab-b852-ab32c61b4921)' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:44:28 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-0eb27d2b-cd1c-466f-abcd-5b29d128bc8d tempest-CreateVolumesFromImageTest-1275891140 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d4d3df5-c82b-4871-9798-53a67e0b9f1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:44:28 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-0eb27d2b-cd1c-466f-abcd-5b29d128bc8d tempest-CreateVolumesFromImageTest-1275891140 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d4d3df5-c82b-4871-9798-53a67e0b9f1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:44:28 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-0eb27d2b-cd1c-466f-abcd-5b29d128bc8d tempest-CreateVolumesFromImageTest-1275891140 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34d4c2be-8799-4c20-be43-a4aafd729507) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:44:28 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-0eb27d2b-cd1c-466f-abcd-5b29d128bc8d tempest-CreateVolumesFromImageTest-1275891140 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34d4c2be-8799-4c20-be43-a4aafd729507) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fd20bdc6-ed08-4754-92f4-22caa9db0a58', 'volume_name': 'volume-fd20bdc6-ed08-4754-92f4-22caa9db0a58', 'volume_size': 1}' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:44:28 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-0eb27d2b-cd1c-466f-abcd-5b29d128bc8d tempest-CreateVolumesFromImageTest-1275891140 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70d2f7a1-825e-4c73-97ee-4990e9634638) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:44:28 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-0eb27d2b-cd1c-466f-abcd-5b29d128bc8d tempest-CreateVolumesFromImageTest-1275891140 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70d2f7a1-825e-4c73-97ee-4990e9634638) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:44:28 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-0eb27d2b-cd1c-466f-abcd-5b29d128bc8d tempest-CreateVolumesFromImageTest-1275891140 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (653cb92f-1be9-4de5-bcb8-0aa51a48acfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:44:28 devstack cinder-volume[88899]: INFO cinder.volume.flows.manager.create_volume [None req-0eb27d2b-cd1c-466f-abcd-5b29d128bc8d tempest-CreateVolumesFromImageTest-1275891140 None] Volume fd20bdc6-ed08-4754-92f4-22caa9db0a58: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fd20bdc6-ed08-4754-92f4-22caa9db0a58', 'volume_size': 1} Aug 03 08:44:28 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-0eb27d2b-cd1c-466f-abcd-5b29d128bc8d tempest-CreateVolumesFromImageTest-1275891140 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:44:28 devstack sudo[105564]: pam_unix(sudo:session): session closed for user root Aug 03 08:44:28 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-10eb0ac1-447b-4e79-9a25-a4067769d059 tempest-VolumesGetTest-1176098524 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-05bbb02d-4373-4cf9-9175-e03927f03823" returned: 0 in 0.583s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:44:28 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-10eb0ac1-447b-4e79-9a25-a4067769d059 tempest-VolumesGetTest-1176098524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-05bbb02d-4373-4cf9-9175-e03927f03823.6fcead60-d52e-4784-a5bc-86ca7a7956b4 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:44:28 devstack sudo[105570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-05bbb02d-4373-4cf9-9175-e03927f03823.6fcead60-d52e-4784-a5bc-86ca7a7956b4 Aug 03 08:44:28 devstack sudo[105570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:44:28 devstack cinder-volume[88899]: DEBUG cinder.volume.flows.manager.create_volume [None req-5e91d7e7-3463-48b6-8816-175e1b9695eb tempest-CreateVolumesFromImageTest-1275891140 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88899) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 08:44:28 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-5e91d7e7-3463-48b6-8816-175e1b9695eb tempest-CreateVolumesFromImageTest-1275891140 None] Flow 'volume_create_manager' (259329d1-efa5-4ef2-b4c1-7e024c581f02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:44:28 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-5e91d7e7-3463-48b6-8816-175e1b9695eb tempest-CreateVolumesFromImageTest-1275891140 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac99265a-d598-492e-a619-f7cc2c4292b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:44:28 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-5e91d7e7-3463-48b6-8816-175e1b9695eb tempest-CreateVolumesFromImageTest-1275891140 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac99265a-d598-492e-a619-f7cc2c4292b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:44:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-723613364',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6abd2d4f-1bae-4203-8134-fc4a1576503a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ccd948527e44353940b97b09d943986',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:44:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:44:29Z,use_quota=True,user_id='021babae627b4acdab15e33fea43f4ef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8bde7129-1dc4-42ab-b852-ab32c61b4921),volume_type_id=8bde7129-1dc4-42ab-b852-ab32c61b4921)' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:44:28 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-5e91d7e7-3463-48b6-8816-175e1b9695eb tempest-CreateVolumesFromImageTest-1275891140 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6409e653-2999-45cd-a5cb-e20c6ad86f6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:44:28 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-5e91d7e7-3463-48b6-8816-175e1b9695eb tempest-CreateVolumesFromImageTest-1275891140 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6409e653-2999-45cd-a5cb-e20c6ad86f6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:44:28 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-5e91d7e7-3463-48b6-8816-175e1b9695eb tempest-CreateVolumesFromImageTest-1275891140 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8113d5cf-b61f-4f88-939c-764755e03675) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:44:28 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-5e91d7e7-3463-48b6-8816-175e1b9695eb tempest-CreateVolumesFromImageTest-1275891140 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8113d5cf-b61f-4f88-939c-764755e03675) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6abd2d4f-1bae-4203-8134-fc4a1576503a', 'volume_name': 'volume-6abd2d4f-1bae-4203-8134-fc4a1576503a', 'volume_size': 1}' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:44:28 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-5e91d7e7-3463-48b6-8816-175e1b9695eb tempest-CreateVolumesFromImageTest-1275891140 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f35ee80-b77f-413d-b145-379115fb5b85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:44:28 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-5e91d7e7-3463-48b6-8816-175e1b9695eb tempest-CreateVolumesFromImageTest-1275891140 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f35ee80-b77f-413d-b145-379115fb5b85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:44:28 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-5e91d7e7-3463-48b6-8816-175e1b9695eb tempest-CreateVolumesFromImageTest-1275891140 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a40a9496-b16f-4087-8dd7-7af87f741a93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:44:28 devstack cinder-volume[88899]: INFO cinder.volume.flows.manager.create_volume [None req-5e91d7e7-3463-48b6-8816-175e1b9695eb tempest-CreateVolumesFromImageTest-1275891140 None] Volume 6abd2d4f-1bae-4203-8134-fc4a1576503a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6abd2d4f-1bae-4203-8134-fc4a1576503a', 'volume_size': 1} Aug 03 08:44:28 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-5e91d7e7-3463-48b6-8816-175e1b9695eb tempest-CreateVolumesFromImageTest-1275891140 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:44:29 devstack sudo[105570]: pam_unix(sudo:session): session closed for user root Aug 03 08:44:29 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-10eb0ac1-447b-4e79-9a25-a4067769d059 tempest-VolumesGetTest-1176098524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-05bbb02d-4373-4cf9-9175-e03927f03823.6fcead60-d52e-4784-a5bc-86ca7a7956b4" returned: 0 in 0.354s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:44:29 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-10eb0ac1-447b-4e79-9a25-a4067769d059 tempest-VolumesGetTest-1176098524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-05bbb02d-4373-4cf9-9175-e03927f03823.6fcead60-d52e-4784-a5bc-86ca7a7956b4 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:44:29 devstack sudo[105576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-05bbb02d-4373-4cf9-9175-e03927f03823.6fcead60-d52e-4784-a5bc-86ca7a7956b4 Aug 03 08:44:29 devstack sudo[105576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:44:29 devstack cinder-volume[88899]: DEBUG cinder.volume.flows.manager.create_volume [None req-befb3bb1-db59-420f-9a69-a2323691e1ab tempest-CreateVolumesFromImageTest-1275891140 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88899) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 08:44:29 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-befb3bb1-db59-420f-9a69-a2323691e1ab tempest-CreateVolumesFromImageTest-1275891140 None] Flow 'volume_create_manager' (429a7224-dfc2-4c31-b664-66d0d08ff6f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:44:29 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-befb3bb1-db59-420f-9a69-a2323691e1ab tempest-CreateVolumesFromImageTest-1275891140 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd8273da-1928-478f-a30c-4485930ca5c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:44:29 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-befb3bb1-db59-420f-9a69-a2323691e1ab tempest-CreateVolumesFromImageTest-1275891140 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd8273da-1928-478f-a30c-4485930ca5c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:44:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1801494515',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cfcec3b1-3e07-48b6-a8df-885b0c583f21,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ccd948527e44353940b97b09d943986',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:44:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:44:29Z,use_quota=True,user_id='021babae627b4acdab15e33fea43f4ef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8bde7129-1dc4-42ab-b852-ab32c61b4921),volume_type_id=8bde7129-1dc4-42ab-b852-ab32c61b4921)' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:44:29 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-befb3bb1-db59-420f-9a69-a2323691e1ab tempest-CreateVolumesFromImageTest-1275891140 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff6b97c7-1b74-445c-926b-79016af8ef74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:44:29 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-befb3bb1-db59-420f-9a69-a2323691e1ab tempest-CreateVolumesFromImageTest-1275891140 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff6b97c7-1b74-445c-926b-79016af8ef74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:44:29 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-befb3bb1-db59-420f-9a69-a2323691e1ab tempest-CreateVolumesFromImageTest-1275891140 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b9a0f2eb-dca0-49cd-8e47-747c2a35c5cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:44:29 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-befb3bb1-db59-420f-9a69-a2323691e1ab tempest-CreateVolumesFromImageTest-1275891140 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b9a0f2eb-dca0-49cd-8e47-747c2a35c5cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cfcec3b1-3e07-48b6-a8df-885b0c583f21', 'volume_name': 'volume-cfcec3b1-3e07-48b6-a8df-885b0c583f21', 'volume_size': 1}' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:44:29 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-befb3bb1-db59-420f-9a69-a2323691e1ab tempest-CreateVolumesFromImageTest-1275891140 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4fef3d3f-811d-4f77-9bfc-970fac0e88d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:44:29 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-befb3bb1-db59-420f-9a69-a2323691e1ab tempest-CreateVolumesFromImageTest-1275891140 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4fef3d3f-811d-4f77-9bfc-970fac0e88d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:44:29 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-befb3bb1-db59-420f-9a69-a2323691e1ab tempest-CreateVolumesFromImageTest-1275891140 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa5f1c71-cab3-41fa-8899-0c9ae0ff5d2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:44:29 devstack cinder-volume[88899]: INFO cinder.volume.flows.manager.create_volume [None req-befb3bb1-db59-420f-9a69-a2323691e1ab tempest-CreateVolumesFromImageTest-1275891140 None] Volume cfcec3b1-3e07-48b6-a8df-885b0c583f21: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cfcec3b1-3e07-48b6-a8df-885b0c583f21', 'volume_size': 1} Aug 03 08:44:29 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-befb3bb1-db59-420f-9a69-a2323691e1ab tempest-CreateVolumesFromImageTest-1275891140 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:44:29 devstack sudo[105576]: pam_unix(sudo:session): session closed for user root Aug 03 08:44:29 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-10eb0ac1-447b-4e79-9a25-a4067769d059 tempest-VolumesGetTest-1176098524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-05bbb02d-4373-4cf9-9175-e03927f03823.6fcead60-d52e-4784-a5bc-86ca7a7956b4" returned: 0 in 0.229s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:44:29 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-10eb0ac1-447b-4e79-9a25-a4067769d059 tempest-VolumesGetTest-1176098524 None] Lock "cinder-quobyte-6fcead60-d52e-4784-a5bc-86ca7a7956b4" released by "_delete_snapshot" :: held 1.771s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:44:29 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-10eb0ac1-447b-4e79-9a25-a4067769d059 tempest-VolumesGetTest-1176098524 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 9.817s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:44:29 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-93cb646b-ef41-4436-b108-24bd534f2bb5 tempest-VolumeDependencyTests-1073688899 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.849s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:44:29 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-93cb646b-ef41-4436-b108-24bd534f2bb5 tempest-VolumeDependencyTests-1073688899 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:44:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-869536412',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=66ec0c6b-ba7c-4f8a-8c2a-6dbfd6262fc1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c2f62930ea114d94aae304e8ed339f9c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:44:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:44:20Z,use_quota=True,user_id='de61709cf33340bf9e956c0545be3966',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8bde7129-1dc4-42ab-b852-ab32c61b4921),volume_type_id=8bde7129-1dc4-42ab-b852-ab32c61b4921)}" {{(pid=88899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 08:44:29 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-93cb646b-ef41-4436-b108-24bd534f2bb5 tempest-VolumeDependencyTests-1073688899 None] Creating volume 66ec0c6b-ba7c-4f8a-8c2a-6dbfd6262fc1 {{(pid=88899) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 08:44:29 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-93cb646b-ef41-4436-b108-24bd534f2bb5 tempest-VolumeDependencyTests-1073688899 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:44:29 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-93cb646b-ef41-4436-b108-24bd534f2bb5 tempest-VolumeDependencyTests-1073688899 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:44:29 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-93cb646b-ef41-4436-b108-24bd534f2bb5 tempest-VolumeDependencyTests-1073688899 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:44:29 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-93cb646b-ef41-4436-b108-24bd534f2bb5 tempest-VolumeDependencyTests-1073688899 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:44:29 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-93cb646b-ef41-4436-b108-24bd534f2bb5 tempest-VolumeDependencyTests-1073688899 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:44:29 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-93cb646b-ef41-4436-b108-24bd534f2bb5 tempest-VolumeDependencyTests-1073688899 None] Selected osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385 as target Quobyte volume. {{(pid=88899) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 08:44:29 devstack cinder-volume[88899]: INFO cinder.volume.drivers.remotefs [None req-93cb646b-ef41-4436-b108-24bd534f2bb5 tempest-VolumeDependencyTests-1073688899 None] casted to osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385 Aug 03 08:44:29 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-93cb646b-ef41-4436-b108-24bd534f2bb5 tempest-VolumeDependencyTests-1073688899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-66ec0c6b-ba7c-4f8a-8c2a-6dbfd6262fc1 1073741824 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:44:29 devstack sudo[105579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-66ec0c6b-ba7c-4f8a-8c2a-6dbfd6262fc1 1073741824 Aug 03 08:44:29 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-10eb0ac1-447b-4e79-9a25-a4067769d059 tempest-VolumesGetTest-1176098524 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (243a3e68-faa4-4101-af3c-3112a2e439a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eb44d2da-9cf8-4046-9a5d-836cfd22b778', 'volume_size': 1, 'source_volid': '05bbb02d-4373-4cf9-9175-e03927f03823', 'source_volstatus': 'available'}' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:44:29 devstack sudo[105579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:44:29 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-10eb0ac1-447b-4e79-9a25-a4067769d059 tempest-VolumesGetTest-1176098524 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07c18d87-0366-4be2-a03a-615a9ebf7dbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:44:29 devstack cinder-volume[88899]: INFO cinder.volume.flows.manager.create_volume [None req-10eb0ac1-447b-4e79-9a25-a4067769d059 tempest-VolumesGetTest-1176098524 None] Volume volume-eb44d2da-9cf8-4046-9a5d-836cfd22b778 (eb44d2da-9cf8-4046-9a5d-836cfd22b778): created successfully Aug 03 08:44:29 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-10eb0ac1-447b-4e79-9a25-a4067769d059 tempest-VolumesGetTest-1176098524 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07c18d87-0366-4be2-a03a-615a9ebf7dbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:44:29 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-10eb0ac1-447b-4e79-9a25-a4067769d059 tempest-VolumesGetTest-1176098524 None] Flow 'volume_create_manager' (b9c82f14-e0ad-484f-8996-27c59e836761) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:44:29 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-10eb0ac1-447b-4e79-9a25-a4067769d059 tempest-VolumesGetTest-1176098524 None] Created volume successfully. Aug 03 08:44:29 devstack sudo[105579]: pam_unix(sudo:session): session closed for user root Aug 03 08:44:29 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-93cb646b-ef41-4436-b108-24bd534f2bb5 tempest-VolumeDependencyTests-1073688899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-66ec0c6b-ba7c-4f8a-8c2a-6dbfd6262fc1 1073741824" returned: 0 in 0.397s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:44:29 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-93cb646b-ef41-4436-b108-24bd534f2bb5 tempest-VolumeDependencyTests-1073688899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-66ec0c6b-ba7c-4f8a-8c2a-6dbfd6262fc1 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:44:29 devstack sudo[105584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-66ec0c6b-ba7c-4f8a-8c2a-6dbfd6262fc1 Aug 03 08:44:29 devstack sudo[105584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:44:30 devstack sudo[105584]: pam_unix(sudo:session): session closed for user root Aug 03 08:44:30 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-93cb646b-ef41-4436-b108-24bd534f2bb5 tempest-VolumeDependencyTests-1073688899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-66ec0c6b-ba7c-4f8a-8c2a-6dbfd6262fc1" returned: 0 in 0.245s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:44:30 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-93cb646b-ef41-4436-b108-24bd534f2bb5 tempest-VolumeDependencyTests-1073688899 None] <== create_volume: return (678ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'} {{(pid=88899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 08:44:30 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-93cb646b-ef41-4436-b108-24bd534f2bb5 tempest-VolumeDependencyTests-1073688899 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.683s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:44:30 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-fd16c1f7-84c9-4462-8e97-ca359ac98b18 tempest-CreateVolumesFromImageTest-1275891140 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.290s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:44:30 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-fd16c1f7-84c9-4462-8e97-ca359ac98b18 tempest-CreateVolumesFromImageTest-1275891140 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:44:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-918288741',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e996a37-f86d-49d8-8f93-2cd097f1b134,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ccd948527e44353940b97b09d943986',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:44:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:44:28Z,use_quota=True,user_id='021babae627b4acdab15e33fea43f4ef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8bde7129-1dc4-42ab-b852-ab32c61b4921),volume_type_id=8bde7129-1dc4-42ab-b852-ab32c61b4921)}" {{(pid=88899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 08:44:30 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-fd16c1f7-84c9-4462-8e97-ca359ac98b18 tempest-CreateVolumesFromImageTest-1275891140 None] Creating volume 1e996a37-f86d-49d8-8f93-2cd097f1b134 {{(pid=88899) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 08:44:30 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-fd16c1f7-84c9-4462-8e97-ca359ac98b18 tempest-CreateVolumesFromImageTest-1275891140 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:44:30 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-fd16c1f7-84c9-4462-8e97-ca359ac98b18 tempest-CreateVolumesFromImageTest-1275891140 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:44:30 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-fd16c1f7-84c9-4462-8e97-ca359ac98b18 tempest-CreateVolumesFromImageTest-1275891140 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:44:30 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-fd16c1f7-84c9-4462-8e97-ca359ac98b18 tempest-CreateVolumesFromImageTest-1275891140 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:44:30 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-fd16c1f7-84c9-4462-8e97-ca359ac98b18 tempest-CreateVolumesFromImageTest-1275891140 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:44:30 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-fd16c1f7-84c9-4462-8e97-ca359ac98b18 tempest-CreateVolumesFromImageTest-1275891140 None] Selected osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385 as target Quobyte volume. {{(pid=88899) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 08:44:30 devstack cinder-volume[88899]: INFO cinder.volume.drivers.remotefs [None req-fd16c1f7-84c9-4462-8e97-ca359ac98b18 tempest-CreateVolumesFromImageTest-1275891140 None] casted to osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385 Aug 03 08:44:30 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-fd16c1f7-84c9-4462-8e97-ca359ac98b18 tempest-CreateVolumesFromImageTest-1275891140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-1e996a37-f86d-49d8-8f93-2cd097f1b134 1073741824 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:44:30 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-93cb646b-ef41-4436-b108-24bd534f2bb5 tempest-VolumeDependencyTests-1073688899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1c0d5c8-00bc-4e6a-b1a0-65f3b6fe0a2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-66ec0c6b-ba7c-4f8a-8c2a-6dbfd6262fc1', 'volume_size': 1}' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:44:30 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-93cb646b-ef41-4436-b108-24bd534f2bb5 tempest-VolumeDependencyTests-1073688899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (43d8807b-2a79-4061-a006-3c8072c4a3ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:44:30 devstack sudo[105587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-1e996a37-f86d-49d8-8f93-2cd097f1b134 1073741824 Aug 03 08:44:30 devstack sudo[105587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:44:30 devstack cinder-volume[88899]: INFO cinder.volume.flows.manager.create_volume [None req-93cb646b-ef41-4436-b108-24bd534f2bb5 tempest-VolumeDependencyTests-1073688899 None] Volume volume-66ec0c6b-ba7c-4f8a-8c2a-6dbfd6262fc1 (66ec0c6b-ba7c-4f8a-8c2a-6dbfd6262fc1): created successfully Aug 03 08:44:30 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-93cb646b-ef41-4436-b108-24bd534f2bb5 tempest-VolumeDependencyTests-1073688899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (43d8807b-2a79-4061-a006-3c8072c4a3ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:44:30 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-93cb646b-ef41-4436-b108-24bd534f2bb5 tempest-VolumeDependencyTests-1073688899 None] Flow 'volume_create_manager' (4de5ad30-e568-4ba2-927c-e5d3da570611) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:44:30 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-93cb646b-ef41-4436-b108-24bd534f2bb5 tempest-VolumeDependencyTests-1073688899 None] Created volume successfully. Aug 03 08:44:30 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-e7a8adb3-b2df-4065-83aa-137f21ec226a tempest-VolumeDependencyTests-1073688899 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:44:30 devstack sudo[105587]: pam_unix(sudo:session): session closed for user root Aug 03 08:44:30 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-fd16c1f7-84c9-4462-8e97-ca359ac98b18 tempest-CreateVolumesFromImageTest-1275891140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-1e996a37-f86d-49d8-8f93-2cd097f1b134 1073741824" returned: 0 in 0.503s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:44:30 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-fd16c1f7-84c9-4462-8e97-ca359ac98b18 tempest-CreateVolumesFromImageTest-1275891140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-1e996a37-f86d-49d8-8f93-2cd097f1b134 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:44:30 devstack sudo[105594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-1e996a37-f86d-49d8-8f93-2cd097f1b134 Aug 03 08:44:30 devstack sudo[105594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:44:30 devstack sudo[105594]: pam_unix(sudo:session): session closed for user root Aug 03 08:44:30 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-fd16c1f7-84c9-4462-8e97-ca359ac98b18 tempest-CreateVolumesFromImageTest-1275891140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-1e996a37-f86d-49d8-8f93-2cd097f1b134" returned: 0 in 0.246s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:44:30 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-fd16c1f7-84c9-4462-8e97-ca359ac98b18 tempest-CreateVolumesFromImageTest-1275891140 None] <== create_volume: return (788ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'} {{(pid=88899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 08:44:30 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-fd16c1f7-84c9-4462-8e97-ca359ac98b18 tempest-CreateVolumesFromImageTest-1275891140 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.791s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:44:30 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-59dbf581-f3a0-454d-addc-8be2ffb2c089 tempest-CreateVolumesFromImageTest-1275891140 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.717s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:44:30 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-59dbf581-f3a0-454d-addc-8be2ffb2c089 tempest-CreateVolumesFromImageTest-1275891140 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:44:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1725897301',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2786cc73-cf36-4f63-9480-9c6c2a5db506,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ccd948527e44353940b97b09d943986',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:44:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:44:28Z,use_quota=True,user_id='021babae627b4acdab15e33fea43f4ef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8bde7129-1dc4-42ab-b852-ab32c61b4921),volume_type_id=8bde7129-1dc4-42ab-b852-ab32c61b4921)}" {{(pid=88899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 08:44:30 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-59dbf581-f3a0-454d-addc-8be2ffb2c089 tempest-CreateVolumesFromImageTest-1275891140 None] Creating volume 2786cc73-cf36-4f63-9480-9c6c2a5db506 {{(pid=88899) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 08:44:30 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-59dbf581-f3a0-454d-addc-8be2ffb2c089 tempest-CreateVolumesFromImageTest-1275891140 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:44:30 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-59dbf581-f3a0-454d-addc-8be2ffb2c089 tempest-CreateVolumesFromImageTest-1275891140 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:44:30 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-59dbf581-f3a0-454d-addc-8be2ffb2c089 tempest-CreateVolumesFromImageTest-1275891140 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:44:30 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-59dbf581-f3a0-454d-addc-8be2ffb2c089 tempest-CreateVolumesFromImageTest-1275891140 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:44:30 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-59dbf581-f3a0-454d-addc-8be2ffb2c089 tempest-CreateVolumesFromImageTest-1275891140 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:44:30 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-59dbf581-f3a0-454d-addc-8be2ffb2c089 tempest-CreateVolumesFromImageTest-1275891140 None] Selected osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385 as target Quobyte volume. {{(pid=88899) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 08:44:30 devstack cinder-volume[88899]: INFO cinder.volume.drivers.remotefs [None req-59dbf581-f3a0-454d-addc-8be2ffb2c089 tempest-CreateVolumesFromImageTest-1275891140 None] casted to osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385 Aug 03 08:44:30 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-59dbf581-f3a0-454d-addc-8be2ffb2c089 tempest-CreateVolumesFromImageTest-1275891140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-2786cc73-cf36-4f63-9480-9c6c2a5db506 1073741824 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:44:30 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-fd16c1f7-84c9-4462-8e97-ca359ac98b18 tempest-CreateVolumesFromImageTest-1275891140 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba6ce061-7631-439e-b82e-c75b42034a67) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1e996a37-f86d-49d8-8f93-2cd097f1b134', 'volume_size': 1}' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:44:30 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-fd16c1f7-84c9-4462-8e97-ca359ac98b18 tempest-CreateVolumesFromImageTest-1275891140 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (938c7594-4bb2-4777-b528-97e335f38867) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:44:30 devstack sudo[105597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-2786cc73-cf36-4f63-9480-9c6c2a5db506 1073741824 Aug 03 08:44:30 devstack sudo[105597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:44:30 devstack cinder-volume[88899]: INFO cinder.volume.flows.manager.create_volume [None req-fd16c1f7-84c9-4462-8e97-ca359ac98b18 tempest-CreateVolumesFromImageTest-1275891140 None] Volume volume-1e996a37-f86d-49d8-8f93-2cd097f1b134 (1e996a37-f86d-49d8-8f93-2cd097f1b134): created successfully Aug 03 08:44:30 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-fd16c1f7-84c9-4462-8e97-ca359ac98b18 tempest-CreateVolumesFromImageTest-1275891140 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (938c7594-4bb2-4777-b528-97e335f38867) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:44:30 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-fd16c1f7-84c9-4462-8e97-ca359ac98b18 tempest-CreateVolumesFromImageTest-1275891140 None] Flow 'volume_create_manager' (2c92f62f-ef9c-4921-8e34-9e01e140fd58) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:44:30 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-fd16c1f7-84c9-4462-8e97-ca359ac98b18 tempest-CreateVolumesFromImageTest-1275891140 None] Created volume successfully. Aug 03 08:44:31 devstack cinder-volume[88899]: DEBUG cinder.volume.flows.manager.create_volume [None req-071ac36b-0c0d-4f88-a717-7409c2789166 tempest-VolumesGetTest-1176098524 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88899) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 08:44:31 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-071ac36b-0c0d-4f88-a717-7409c2789166 tempest-VolumesGetTest-1176098524 None] Flow 'volume_create_manager' (2068a896-3638-4875-a444-d86ce178d59d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:44:31 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-071ac36b-0c0d-4f88-a717-7409c2789166 tempest-VolumesGetTest-1176098524 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (147255b8-2925-459c-bc8d-15588ea85177) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:44:31 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-071ac36b-0c0d-4f88-a717-7409c2789166 tempest-VolumesGetTest-1176098524 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (147255b8-2925-459c-bc8d-15588ea85177) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:44:31Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-846255788',display_name='tempest-VolumesGetTest-Volume-1086997590',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=95d973e5-d7f3-4322-a2f7-ee300cd36ee0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='070ec6e114534bca93d5d121647b843c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:44:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:44:31Z,use_quota=True,user_id='e38f947f25c6490eb48ca43abf9ef753',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8bde7129-1dc4-42ab-b852-ab32c61b4921),volume_type_id=8bde7129-1dc4-42ab-b852-ab32c61b4921)' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:44:31 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-071ac36b-0c0d-4f88-a717-7409c2789166 tempest-VolumesGetTest-1176098524 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7334c5fc-c8b1-449b-a50b-c01fd1538bc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:44:31 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-071ac36b-0c0d-4f88-a717-7409c2789166 tempest-VolumesGetTest-1176098524 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7334c5fc-c8b1-449b-a50b-c01fd1538bc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:44:31 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-071ac36b-0c0d-4f88-a717-7409c2789166 tempest-VolumesGetTest-1176098524 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b9d71d52-0886-4a3c-8d32-b78c4dd24097) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:44:31 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-071ac36b-0c0d-4f88-a717-7409c2789166 tempest-VolumesGetTest-1176098524 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b9d71d52-0886-4a3c-8d32-b78c4dd24097) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '95d973e5-d7f3-4322-a2f7-ee300cd36ee0', 'volume_name': 'volume-95d973e5-d7f3-4322-a2f7-ee300cd36ee0', 'volume_size': 1}' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:44:31 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-071ac36b-0c0d-4f88-a717-7409c2789166 tempest-VolumesGetTest-1176098524 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39869509-82bb-49c3-a35e-d141e4c164ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:44:31 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-071ac36b-0c0d-4f88-a717-7409c2789166 tempest-VolumesGetTest-1176098524 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39869509-82bb-49c3-a35e-d141e4c164ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:44:31 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-071ac36b-0c0d-4f88-a717-7409c2789166 tempest-VolumesGetTest-1176098524 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ee4fe2a-8673-40fa-b9ce-9b2b840605d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:44:31 devstack cinder-volume[88899]: INFO cinder.volume.flows.manager.create_volume [None req-071ac36b-0c0d-4f88-a717-7409c2789166 tempest-VolumesGetTest-1176098524 None] Volume 95d973e5-d7f3-4322-a2f7-ee300cd36ee0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-95d973e5-d7f3-4322-a2f7-ee300cd36ee0', 'volume_size': 1} Aug 03 08:44:31 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-071ac36b-0c0d-4f88-a717-7409c2789166 tempest-VolumesGetTest-1176098524 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:44:31 devstack sudo[105597]: pam_unix(sudo:session): session closed for user root Aug 03 08:44:31 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-59dbf581-f3a0-454d-addc-8be2ffb2c089 tempest-CreateVolumesFromImageTest-1275891140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-2786cc73-cf36-4f63-9480-9c6c2a5db506 1073741824" returned: 0 in 0.488s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:44:31 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-59dbf581-f3a0-454d-addc-8be2ffb2c089 tempest-CreateVolumesFromImageTest-1275891140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-2786cc73-cf36-4f63-9480-9c6c2a5db506 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:44:31 devstack sudo[105602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-2786cc73-cf36-4f63-9480-9c6c2a5db506 Aug 03 08:44:31 devstack sudo[105602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:44:31 devstack sudo[105602]: pam_unix(sudo:session): session closed for user root Aug 03 08:44:31 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-59dbf581-f3a0-454d-addc-8be2ffb2c089 tempest-CreateVolumesFromImageTest-1275891140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-2786cc73-cf36-4f63-9480-9c6c2a5db506" returned: 0 in 0.242s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:44:31 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-59dbf581-f3a0-454d-addc-8be2ffb2c089 tempest-CreateVolumesFromImageTest-1275891140 None] <== create_volume: return (767ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'} {{(pid=88899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 08:44:31 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-59dbf581-f3a0-454d-addc-8be2ffb2c089 tempest-CreateVolumesFromImageTest-1275891140 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.770s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:44:31 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-0eb27d2b-cd1c-466f-abcd-5b29d128bc8d tempest-CreateVolumesFromImageTest-1275891140 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.149s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:44:31 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-0eb27d2b-cd1c-466f-abcd-5b29d128bc8d tempest-CreateVolumesFromImageTest-1275891140 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:44:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-478578969',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fd20bdc6-ed08-4754-92f4-22caa9db0a58,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ccd948527e44353940b97b09d943986',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:44:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:44:28Z,use_quota=True,user_id='021babae627b4acdab15e33fea43f4ef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8bde7129-1dc4-42ab-b852-ab32c61b4921),volume_type_id=8bde7129-1dc4-42ab-b852-ab32c61b4921)}" {{(pid=88899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 08:44:31 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-0eb27d2b-cd1c-466f-abcd-5b29d128bc8d tempest-CreateVolumesFromImageTest-1275891140 None] Creating volume fd20bdc6-ed08-4754-92f4-22caa9db0a58 {{(pid=88899) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 08:44:31 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-0eb27d2b-cd1c-466f-abcd-5b29d128bc8d tempest-CreateVolumesFromImageTest-1275891140 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:44:31 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-0eb27d2b-cd1c-466f-abcd-5b29d128bc8d tempest-CreateVolumesFromImageTest-1275891140 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:44:31 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-0eb27d2b-cd1c-466f-abcd-5b29d128bc8d tempest-CreateVolumesFromImageTest-1275891140 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:44:31 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-0eb27d2b-cd1c-466f-abcd-5b29d128bc8d tempest-CreateVolumesFromImageTest-1275891140 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:44:31 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-0eb27d2b-cd1c-466f-abcd-5b29d128bc8d tempest-CreateVolumesFromImageTest-1275891140 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:44:31 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-0eb27d2b-cd1c-466f-abcd-5b29d128bc8d tempest-CreateVolumesFromImageTest-1275891140 None] Selected osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385 as target Quobyte volume. {{(pid=88899) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 08:44:31 devstack cinder-volume[88899]: INFO cinder.volume.drivers.remotefs [None req-0eb27d2b-cd1c-466f-abcd-5b29d128bc8d tempest-CreateVolumesFromImageTest-1275891140 None] casted to osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385 Aug 03 08:44:31 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-0eb27d2b-cd1c-466f-abcd-5b29d128bc8d tempest-CreateVolumesFromImageTest-1275891140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-fd20bdc6-ed08-4754-92f4-22caa9db0a58 1073741824 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:44:31 devstack sudo[105605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-fd20bdc6-ed08-4754-92f4-22caa9db0a58 1073741824 Aug 03 08:44:31 devstack sudo[105605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:44:31 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-59dbf581-f3a0-454d-addc-8be2ffb2c089 tempest-CreateVolumesFromImageTest-1275891140 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (79ded2b3-44a9-4b5e-ac8e-3fba1412b5c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2786cc73-cf36-4f63-9480-9c6c2a5db506', 'volume_size': 1}' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:44:31 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-59dbf581-f3a0-454d-addc-8be2ffb2c089 tempest-CreateVolumesFromImageTest-1275891140 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bde4812b-ddd6-4166-8f7e-de1a99efcb81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:44:31 devstack cinder-volume[88899]: INFO cinder.volume.flows.manager.create_volume [None req-59dbf581-f3a0-454d-addc-8be2ffb2c089 tempest-CreateVolumesFromImageTest-1275891140 None] Volume volume-2786cc73-cf36-4f63-9480-9c6c2a5db506 (2786cc73-cf36-4f63-9480-9c6c2a5db506): created successfully Aug 03 08:44:31 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-59dbf581-f3a0-454d-addc-8be2ffb2c089 tempest-CreateVolumesFromImageTest-1275891140 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bde4812b-ddd6-4166-8f7e-de1a99efcb81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:44:31 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-59dbf581-f3a0-454d-addc-8be2ffb2c089 tempest-CreateVolumesFromImageTest-1275891140 None] Flow 'volume_create_manager' (b1c39e08-9df4-4fa6-868d-1f323fa9f94d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:44:31 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-59dbf581-f3a0-454d-addc-8be2ffb2c089 tempest-CreateVolumesFromImageTest-1275891140 None] Created volume successfully. Aug 03 08:44:32 devstack sudo[105605]: pam_unix(sudo:session): session closed for user root Aug 03 08:44:32 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-0eb27d2b-cd1c-466f-abcd-5b29d128bc8d tempest-CreateVolumesFromImageTest-1275891140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-fd20bdc6-ed08-4754-92f4-22caa9db0a58 1073741824" returned: 0 in 0.402s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:44:32 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-0eb27d2b-cd1c-466f-abcd-5b29d128bc8d tempest-CreateVolumesFromImageTest-1275891140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-fd20bdc6-ed08-4754-92f4-22caa9db0a58 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:44:32 devstack sudo[105610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-fd20bdc6-ed08-4754-92f4-22caa9db0a58 Aug 03 08:44:32 devstack sudo[105610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:44:32 devstack sudo[105610]: pam_unix(sudo:session): session closed for user root Aug 03 08:44:32 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-0eb27d2b-cd1c-466f-abcd-5b29d128bc8d tempest-CreateVolumesFromImageTest-1275891140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-fd20bdc6-ed08-4754-92f4-22caa9db0a58" returned: 0 in 0.252s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:44:32 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-0eb27d2b-cd1c-466f-abcd-5b29d128bc8d tempest-CreateVolumesFromImageTest-1275891140 None] <== create_volume: return (702ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'} {{(pid=88899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 08:44:32 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-0eb27d2b-cd1c-466f-abcd-5b29d128bc8d tempest-CreateVolumesFromImageTest-1275891140 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.705s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:44:32 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-5e91d7e7-3463-48b6-8816-175e1b9695eb tempest-CreateVolumesFromImageTest-1275891140 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.476s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:44:32 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-5e91d7e7-3463-48b6-8816-175e1b9695eb tempest-CreateVolumesFromImageTest-1275891140 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:44:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-723613364',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6abd2d4f-1bae-4203-8134-fc4a1576503a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ccd948527e44353940b97b09d943986',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:44:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:44:29Z,use_quota=True,user_id='021babae627b4acdab15e33fea43f4ef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8bde7129-1dc4-42ab-b852-ab32c61b4921),volume_type_id=8bde7129-1dc4-42ab-b852-ab32c61b4921)}" {{(pid=88899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 08:44:32 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-5e91d7e7-3463-48b6-8816-175e1b9695eb tempest-CreateVolumesFromImageTest-1275891140 None] Creating volume 6abd2d4f-1bae-4203-8134-fc4a1576503a {{(pid=88899) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 08:44:32 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-5e91d7e7-3463-48b6-8816-175e1b9695eb tempest-CreateVolumesFromImageTest-1275891140 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:44:32 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-5e91d7e7-3463-48b6-8816-175e1b9695eb tempest-CreateVolumesFromImageTest-1275891140 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:44:32 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-5e91d7e7-3463-48b6-8816-175e1b9695eb tempest-CreateVolumesFromImageTest-1275891140 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:44:32 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-5e91d7e7-3463-48b6-8816-175e1b9695eb tempest-CreateVolumesFromImageTest-1275891140 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:44:32 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-5e91d7e7-3463-48b6-8816-175e1b9695eb tempest-CreateVolumesFromImageTest-1275891140 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:44:32 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-5e91d7e7-3463-48b6-8816-175e1b9695eb tempest-CreateVolumesFromImageTest-1275891140 None] Selected osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385 as target Quobyte volume. {{(pid=88899) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 08:44:32 devstack cinder-volume[88899]: INFO cinder.volume.drivers.remotefs [None req-5e91d7e7-3463-48b6-8816-175e1b9695eb tempest-CreateVolumesFromImageTest-1275891140 None] casted to osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385 Aug 03 08:44:32 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-5e91d7e7-3463-48b6-8816-175e1b9695eb tempest-CreateVolumesFromImageTest-1275891140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-6abd2d4f-1bae-4203-8134-fc4a1576503a 1073741824 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:44:32 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-0eb27d2b-cd1c-466f-abcd-5b29d128bc8d tempest-CreateVolumesFromImageTest-1275891140 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (653cb92f-1be9-4de5-bcb8-0aa51a48acfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fd20bdc6-ed08-4754-92f4-22caa9db0a58', 'volume_size': 1}' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:44:32 devstack sudo[105613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-6abd2d4f-1bae-4203-8134-fc4a1576503a 1073741824 Aug 03 08:44:32 devstack sudo[105613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:44:32 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-0eb27d2b-cd1c-466f-abcd-5b29d128bc8d tempest-CreateVolumesFromImageTest-1275891140 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (534cae98-8995-44ec-be68-4423a5df1fc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:44:32 devstack cinder-volume[88899]: INFO cinder.volume.flows.manager.create_volume [None req-0eb27d2b-cd1c-466f-abcd-5b29d128bc8d tempest-CreateVolumesFromImageTest-1275891140 None] Volume volume-fd20bdc6-ed08-4754-92f4-22caa9db0a58 (fd20bdc6-ed08-4754-92f4-22caa9db0a58): created successfully Aug 03 08:44:32 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-0eb27d2b-cd1c-466f-abcd-5b29d128bc8d tempest-CreateVolumesFromImageTest-1275891140 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (534cae98-8995-44ec-be68-4423a5df1fc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:44:32 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-0eb27d2b-cd1c-466f-abcd-5b29d128bc8d tempest-CreateVolumesFromImageTest-1275891140 None] Flow 'volume_create_manager' (7ac837e4-7071-44a0-9a71-19d1ff260c5c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:44:32 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-0eb27d2b-cd1c-466f-abcd-5b29d128bc8d tempest-CreateVolumesFromImageTest-1275891140 None] Created volume successfully. Aug 03 08:44:32 devstack sudo[105613]: pam_unix(sudo:session): session closed for user root Aug 03 08:44:32 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-5e91d7e7-3463-48b6-8816-175e1b9695eb tempest-CreateVolumesFromImageTest-1275891140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-6abd2d4f-1bae-4203-8134-fc4a1576503a 1073741824" returned: 0 in 0.411s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:44:32 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-5e91d7e7-3463-48b6-8816-175e1b9695eb tempest-CreateVolumesFromImageTest-1275891140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-6abd2d4f-1bae-4203-8134-fc4a1576503a {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:44:32 devstack sudo[105621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-6abd2d4f-1bae-4203-8134-fc4a1576503a Aug 03 08:44:32 devstack sudo[105621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:44:33 devstack sudo[105621]: pam_unix(sudo:session): session closed for user root Aug 03 08:44:33 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-5e91d7e7-3463-48b6-8816-175e1b9695eb tempest-CreateVolumesFromImageTest-1275891140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-6abd2d4f-1bae-4203-8134-fc4a1576503a" returned: 0 in 0.240s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:44:33 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-5e91d7e7-3463-48b6-8816-175e1b9695eb tempest-CreateVolumesFromImageTest-1275891140 None] <== create_volume: return (689ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'} {{(pid=88899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 08:44:33 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-5e91d7e7-3463-48b6-8816-175e1b9695eb tempest-CreateVolumesFromImageTest-1275891140 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.692s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:44:33 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-befb3bb1-db59-420f-9a69-a2323691e1ab tempest-CreateVolumesFromImageTest-1275891140 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.759s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:44:33 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-befb3bb1-db59-420f-9a69-a2323691e1ab tempest-CreateVolumesFromImageTest-1275891140 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:44:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1801494515',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cfcec3b1-3e07-48b6-a8df-885b0c583f21,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ccd948527e44353940b97b09d943986',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:44:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:44:29Z,use_quota=True,user_id='021babae627b4acdab15e33fea43f4ef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8bde7129-1dc4-42ab-b852-ab32c61b4921),volume_type_id=8bde7129-1dc4-42ab-b852-ab32c61b4921)}" {{(pid=88899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 08:44:33 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-befb3bb1-db59-420f-9a69-a2323691e1ab tempest-CreateVolumesFromImageTest-1275891140 None] Creating volume cfcec3b1-3e07-48b6-a8df-885b0c583f21 {{(pid=88899) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 08:44:33 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-befb3bb1-db59-420f-9a69-a2323691e1ab tempest-CreateVolumesFromImageTest-1275891140 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:44:33 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-befb3bb1-db59-420f-9a69-a2323691e1ab tempest-CreateVolumesFromImageTest-1275891140 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:44:33 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-befb3bb1-db59-420f-9a69-a2323691e1ab tempest-CreateVolumesFromImageTest-1275891140 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:44:33 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-befb3bb1-db59-420f-9a69-a2323691e1ab tempest-CreateVolumesFromImageTest-1275891140 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:44:33 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-befb3bb1-db59-420f-9a69-a2323691e1ab tempest-CreateVolumesFromImageTest-1275891140 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:44:33 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-befb3bb1-db59-420f-9a69-a2323691e1ab tempest-CreateVolumesFromImageTest-1275891140 None] Selected osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385 as target Quobyte volume. {{(pid=88899) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 08:44:33 devstack cinder-volume[88899]: INFO cinder.volume.drivers.remotefs [None req-befb3bb1-db59-420f-9a69-a2323691e1ab tempest-CreateVolumesFromImageTest-1275891140 None] casted to osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385 Aug 03 08:44:33 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-befb3bb1-db59-420f-9a69-a2323691e1ab tempest-CreateVolumesFromImageTest-1275891140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-cfcec3b1-3e07-48b6-a8df-885b0c583f21 1073741824 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:44:33 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-5e91d7e7-3463-48b6-8816-175e1b9695eb tempest-CreateVolumesFromImageTest-1275891140 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a40a9496-b16f-4087-8dd7-7af87f741a93) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6abd2d4f-1bae-4203-8134-fc4a1576503a', 'volume_size': 1}' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:44:33 devstack sudo[105624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-cfcec3b1-3e07-48b6-a8df-885b0c583f21 1073741824 Aug 03 08:44:33 devstack sudo[105624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:44:33 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-5e91d7e7-3463-48b6-8816-175e1b9695eb tempest-CreateVolumesFromImageTest-1275891140 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb3e65d6-673c-4f23-960f-7ef4685544f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:44:33 devstack cinder-volume[88899]: INFO cinder.volume.flows.manager.create_volume [None req-5e91d7e7-3463-48b6-8816-175e1b9695eb tempest-CreateVolumesFromImageTest-1275891140 None] Volume volume-6abd2d4f-1bae-4203-8134-fc4a1576503a (6abd2d4f-1bae-4203-8134-fc4a1576503a): created successfully Aug 03 08:44:33 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-5e91d7e7-3463-48b6-8816-175e1b9695eb tempest-CreateVolumesFromImageTest-1275891140 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb3e65d6-673c-4f23-960f-7ef4685544f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:44:33 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-5e91d7e7-3463-48b6-8816-175e1b9695eb tempest-CreateVolumesFromImageTest-1275891140 None] Flow 'volume_create_manager' (259329d1-efa5-4ef2-b4c1-7e024c581f02) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:44:33 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-5e91d7e7-3463-48b6-8816-175e1b9695eb tempest-CreateVolumesFromImageTest-1275891140 None] Created volume successfully. Aug 03 08:44:33 devstack sudo[105624]: pam_unix(sudo:session): session closed for user root Aug 03 08:44:33 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-befb3bb1-db59-420f-9a69-a2323691e1ab tempest-CreateVolumesFromImageTest-1275891140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-cfcec3b1-3e07-48b6-a8df-885b0c583f21 1073741824" returned: 0 in 0.422s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:44:33 devstack cinder-volume[88899]: DEBUG dbcounter [-] [88899] Writing DB stats cinder:UPDATE=76,cinder:SELECT=60,cinder:INSERT=20,cinder:DELETE=7 {{(pid=88899) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 03 08:44:33 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-befb3bb1-db59-420f-9a69-a2323691e1ab tempest-CreateVolumesFromImageTest-1275891140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-cfcec3b1-3e07-48b6-a8df-885b0c583f21 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:44:33 devstack sudo[105630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-cfcec3b1-3e07-48b6-a8df-885b0c583f21 Aug 03 08:44:33 devstack sudo[105630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:44:33 devstack sudo[105630]: pam_unix(sudo:session): session closed for user root Aug 03 08:44:33 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-befb3bb1-db59-420f-9a69-a2323691e1ab tempest-CreateVolumesFromImageTest-1275891140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-cfcec3b1-3e07-48b6-a8df-885b0c583f21" returned: 0 in 0.247s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:44:33 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-befb3bb1-db59-420f-9a69-a2323691e1ab tempest-CreateVolumesFromImageTest-1275891140 None] <== create_volume: return (715ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'} {{(pid=88899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 08:44:33 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-befb3bb1-db59-420f-9a69-a2323691e1ab tempest-CreateVolumesFromImageTest-1275891140 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.717s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:44:33 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-e7a8adb3-b2df-4065-83aa-137f21ec226a tempest-VolumeDependencyTests-1073688899 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.295s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:44:33 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-befb3bb1-db59-420f-9a69-a2323691e1ab tempest-CreateVolumesFromImageTest-1275891140 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa5f1c71-cab3-41fa-8899-0c9ae0ff5d2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cfcec3b1-3e07-48b6-a8df-885b0c583f21', 'volume_size': 1}' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:44:33 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-befb3bb1-db59-420f-9a69-a2323691e1ab tempest-CreateVolumesFromImageTest-1275891140 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eccbc01c-f8c6-4c75-9c9a-5494fa1c37ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:44:33 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-e7a8adb3-b2df-4065-83aa-137f21ec226a tempest-VolumeDependencyTests-1073688899 None] Creating offline snapshot db77f550-d390-434b-8115-37b701c9c8bd of volume 66ec0c6b-ba7c-4f8a-8c2a-6dbfd6262fc1 {{(pid=88899) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 03 08:44:33 devstack cinder-volume[88899]: INFO cinder.volume.flows.manager.create_volume [None req-befb3bb1-db59-420f-9a69-a2323691e1ab tempest-CreateVolumesFromImageTest-1275891140 None] Volume volume-cfcec3b1-3e07-48b6-a8df-885b0c583f21 (cfcec3b1-3e07-48b6-a8df-885b0c583f21): created successfully Aug 03 08:44:33 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-befb3bb1-db59-420f-9a69-a2323691e1ab tempest-CreateVolumesFromImageTest-1275891140 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eccbc01c-f8c6-4c75-9c9a-5494fa1c37ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:44:33 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-befb3bb1-db59-420f-9a69-a2323691e1ab tempest-CreateVolumesFromImageTest-1275891140 None] Flow 'volume_create_manager' (429a7224-dfc2-4c31-b664-66d0d08ff6f3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:44:33 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bc54ac5-6ba1-472e-90dc-4848a918387c]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:44:33 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-e7a8adb3-b2df-4065-83aa-137f21ec226a tempest-VolumeDependencyTests-1073688899 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-66ec0c6b-ba7c-4f8a-8c2a-6dbfd6262fc1 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:44:33 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-befb3bb1-db59-420f-9a69-a2323691e1ab tempest-CreateVolumesFromImageTest-1275891140 None] Created volume successfully. Aug 03 08:44:33 devstack sudo[105633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-66ec0c6b-ba7c-4f8a-8c2a-6dbfd6262fc1 Aug 03 08:44:33 devstack sudo[105633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:44:34 devstack sudo[105633]: pam_unix(sudo:session): session closed for user root Aug 03 08:44:34 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-e7a8adb3-b2df-4065-83aa-137f21ec226a tempest-VolumeDependencyTests-1073688899 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-66ec0c6b-ba7c-4f8a-8c2a-6dbfd6262fc1" returned: 0 in 0.340s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:44:34 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-e7a8adb3-b2df-4065-83aa-137f21ec226a tempest-VolumeDependencyTests-1073688899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-66ec0c6b-ba7c-4f8a-8c2a-6dbfd6262fc1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-66ec0c6b-ba7c-4f8a-8c2a-6dbfd6262fc1.db77f550-d390-434b-8115-37b701c9c8bd 1G {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:44:34 devstack sudo[105638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-66ec0c6b-ba7c-4f8a-8c2a-6dbfd6262fc1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-66ec0c6b-ba7c-4f8a-8c2a-6dbfd6262fc1.db77f550-d390-434b-8115-37b701c9c8bd 1G Aug 03 08:44:34 devstack sudo[105638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:44:34 devstack sudo[105638]: pam_unix(sudo:session): session closed for user root Aug 03 08:44:34 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-e7a8adb3-b2df-4065-83aa-137f21ec226a tempest-VolumeDependencyTests-1073688899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-66ec0c6b-ba7c-4f8a-8c2a-6dbfd6262fc1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-66ec0c6b-ba7c-4f8a-8c2a-6dbfd6262fc1.db77f550-d390-434b-8115-37b701c9c8bd 1G" returned: 0 in 0.375s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:44:34 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-e7a8adb3-b2df-4065-83aa-137f21ec226a tempest-VolumeDependencyTests-1073688899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-66ec0c6b-ba7c-4f8a-8c2a-6dbfd6262fc1 -F qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-66ec0c6b-ba7c-4f8a-8c2a-6dbfd6262fc1.db77f550-d390-434b-8115-37b701c9c8bd {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:44:34 devstack sudo[105643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-66ec0c6b-ba7c-4f8a-8c2a-6dbfd6262fc1 -F qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-66ec0c6b-ba7c-4f8a-8c2a-6dbfd6262fc1.db77f550-d390-434b-8115-37b701c9c8bd Aug 03 08:44:34 devstack sudo[105643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:44:34 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-628f0f6d-ebea-4313-9024-17b63ebe58fc tempest-CreateVolumesFromImageTest-1275891140 None] Acquiring lock "cinder-cfcec3b1-3e07-48b6-a8df-885b0c583f21-delete_volume" by "delete_volume" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:44:34 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-628f0f6d-ebea-4313-9024-17b63ebe58fc tempest-CreateVolumesFromImageTest-1275891140 None] Lock "cinder-cfcec3b1-3e07-48b6-a8df-885b0c583f21-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:44:34 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-628f0f6d-ebea-4313-9024-17b63ebe58fc tempest-CreateVolumesFromImageTest-1275891140 None] Acquiring lock "cinder-quobyte-cfcec3b1-3e07-48b6-a8df-885b0c583f21" by "delete_volume" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:44:34 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-628f0f6d-ebea-4313-9024-17b63ebe58fc tempest-CreateVolumesFromImageTest-1275891140 None] Lock "cinder-quobyte-cfcec3b1-3e07-48b6-a8df-885b0c583f21" acquired by "delete_volume" :: waited 0.018s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:44:34 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ea85e7b-bf2c-4d04-bbe3-373b3c76735b]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:44:34 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-628f0f6d-ebea-4313-9024-17b63ebe58fc tempest-CreateVolumesFromImageTest-1275891140 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-cfcec3b1-3e07-48b6-a8df-885b0c583f21 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:44:34 devstack sudo[105643]: pam_unix(sudo:session): session closed for user root Aug 03 08:44:34 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-e7a8adb3-b2df-4065-83aa-137f21ec226a tempest-VolumeDependencyTests-1073688899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-66ec0c6b-ba7c-4f8a-8c2a-6dbfd6262fc1 -F qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-66ec0c6b-ba7c-4f8a-8c2a-6dbfd6262fc1.db77f550-d390-434b-8115-37b701c9c8bd" returned: 0 in 0.307s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:44:34 devstack cinder-volume[88899]: WARNING cinder.volume.drivers.remotefs [None req-e7a8adb3-b2df-4065-83aa-137f21ec226a tempest-VolumeDependencyTests-1073688899 None] /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-66ec0c6b-ba7c-4f8a-8c2a-6dbfd6262fc1.db77f550-d390-434b-8115-37b701c9c8bd is being set with open permissions: ugo+rw Aug 03 08:44:34 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-e7a8adb3-b2df-4065-83aa-137f21ec226a tempest-VolumeDependencyTests-1073688899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-66ec0c6b-ba7c-4f8a-8c2a-6dbfd6262fc1.db77f550-d390-434b-8115-37b701c9c8bd {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:44:34 devstack sudo[105649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-66ec0c6b-ba7c-4f8a-8c2a-6dbfd6262fc1.db77f550-d390-434b-8115-37b701c9c8bd Aug 03 08:44:34 devstack sudo[105649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:44:34 devstack sudo[105647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-cfcec3b1-3e07-48b6-a8df-885b0c583f21 Aug 03 08:44:34 devstack sudo[105647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:44:35 devstack sudo[105649]: pam_unix(sudo:session): session closed for user root Aug 03 08:44:35 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-e7a8adb3-b2df-4065-83aa-137f21ec226a tempest-VolumeDependencyTests-1073688899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-66ec0c6b-ba7c-4f8a-8c2a-6dbfd6262fc1.db77f550-d390-434b-8115-37b701c9c8bd" returned: 0 in 0.248s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:44:35 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-e7a8adb3-b2df-4065-83aa-137f21ec226a tempest-VolumeDependencyTests-1073688899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-66ec0c6b-ba7c-4f8a-8c2a-6dbfd6262fc1.info {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:44:35 devstack sudo[105647]: pam_unix(sudo:session): session closed for user root Aug 03 08:44:35 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-628f0f6d-ebea-4313-9024-17b63ebe58fc tempest-CreateVolumesFromImageTest-1275891140 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-cfcec3b1-3e07-48b6-a8df-885b0c583f21" returned: 0 in 0.377s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:44:35 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-628f0f6d-ebea-4313-9024-17b63ebe58fc tempest-CreateVolumesFromImageTest-1275891140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-cfcec3b1-3e07-48b6-a8df-885b0c583f21 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:44:35 devstack sudo[105656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-66ec0c6b-ba7c-4f8a-8c2a-6dbfd6262fc1.info Aug 03 08:44:35 devstack sudo[105656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:44:35 devstack sudo[105658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-cfcec3b1-3e07-48b6-a8df-885b0c583f21 Aug 03 08:44:35 devstack sudo[105658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:44:35 devstack sudo[105656]: pam_unix(sudo:session): session closed for user root Aug 03 08:44:35 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-e7a8adb3-b2df-4065-83aa-137f21ec226a tempest-VolumeDependencyTests-1073688899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-66ec0c6b-ba7c-4f8a-8c2a-6dbfd6262fc1.info" returned: 0 in 0.252s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:44:35 devstack cinder-volume[88899]: WARNING cinder.volume.drivers.remotefs [None req-e7a8adb3-b2df-4065-83aa-137f21ec226a tempest-VolumeDependencyTests-1073688899 None] /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-66ec0c6b-ba7c-4f8a-8c2a-6dbfd6262fc1.info is being set with open permissions: ugo+rw Aug 03 08:44:35 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-e7a8adb3-b2df-4065-83aa-137f21ec226a tempest-VolumeDependencyTests-1073688899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-66ec0c6b-ba7c-4f8a-8c2a-6dbfd6262fc1.info {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:44:35 devstack sudo[105658]: pam_unix(sudo:session): session closed for user root Aug 03 08:44:35 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-628f0f6d-ebea-4313-9024-17b63ebe58fc tempest-CreateVolumesFromImageTest-1275891140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-cfcec3b1-3e07-48b6-a8df-885b0c583f21" returned: 0 in 0.253s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:44:35 devstack sudo[105662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-66ec0c6b-ba7c-4f8a-8c2a-6dbfd6262fc1.info Aug 03 08:44:35 devstack sudo[105662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:44:35 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-628f0f6d-ebea-4313-9024-17b63ebe58fc tempest-CreateVolumesFromImageTest-1275891140 None] Lock "cinder-quobyte-cfcec3b1-3e07-48b6-a8df-885b0c583f21" released by "delete_volume" :: held 0.673s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:44:35 devstack cinder-volume[88899]: DEBUG cinder.quota [None req-628f0f6d-ebea-4313-9024-17b63ebe58fc tempest-CreateVolumesFromImageTest-1275891140 None] Created reservations ['cdecafb0-1876-43f1-8b7f-6e1402bfc740', 'e6b50b4b-b687-48ff-89f0-f5cce5ff86a7', '7b34685d-0013-42e7-9117-8f981404c2a5', '570c5184-f15a-4e28-a5ad-5c3385704ebc'] {{(pid=88899) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 08:44:35 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-628f0f6d-ebea-4313-9024-17b63ebe58fc tempest-CreateVolumesFromImageTest-1275891140 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:44:35 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-628f0f6d-ebea-4313-9024-17b63ebe58fc tempest-CreateVolumesFromImageTest-1275891140 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:44:35 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-628f0f6d-ebea-4313-9024-17b63ebe58fc tempest-CreateVolumesFromImageTest-1275891140 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:44:35 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-628f0f6d-ebea-4313-9024-17b63ebe58fc tempest-CreateVolumesFromImageTest-1275891140 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:44:35 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-628f0f6d-ebea-4313-9024-17b63ebe58fc tempest-CreateVolumesFromImageTest-1275891140 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:44:35 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-628f0f6d-ebea-4313-9024-17b63ebe58fc tempest-CreateVolumesFromImageTest-1275891140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:44:35 devstack sudo[105664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a Aug 03 08:44:35 devstack sudo[105664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:44:35 devstack sudo[105662]: pam_unix(sudo:session): session closed for user root Aug 03 08:44:35 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-e7a8adb3-b2df-4065-83aa-137f21ec226a tempest-VolumeDependencyTests-1073688899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-66ec0c6b-ba7c-4f8a-8c2a-6dbfd6262fc1.info" returned: 0 in 0.260s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:44:35 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-e7a8adb3-b2df-4065-83aa-137f21ec226a tempest-VolumeDependencyTests-1073688899 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.897s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:44:35 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-071ac36b-0c0d-4f88-a717-7409c2789166 tempest-VolumesGetTest-1176098524 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.318s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:44:35 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-071ac36b-0c0d-4f88-a717-7409c2789166 tempest-VolumesGetTest-1176098524 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:44:31Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-846255788',display_name='tempest-VolumesGetTest-Volume-1086997590',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=95d973e5-d7f3-4322-a2f7-ee300cd36ee0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='070ec6e114534bca93d5d121647b843c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:44:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:44:31Z,use_quota=True,user_id='e38f947f25c6490eb48ca43abf9ef753',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8bde7129-1dc4-42ab-b852-ab32c61b4921),volume_type_id=8bde7129-1dc4-42ab-b852-ab32c61b4921)}" {{(pid=88899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 08:44:35 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-071ac36b-0c0d-4f88-a717-7409c2789166 tempest-VolumesGetTest-1176098524 None] Creating volume 95d973e5-d7f3-4322-a2f7-ee300cd36ee0 {{(pid=88899) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 08:44:35 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-071ac36b-0c0d-4f88-a717-7409c2789166 tempest-VolumesGetTest-1176098524 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:44:35 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-071ac36b-0c0d-4f88-a717-7409c2789166 tempest-VolumesGetTest-1176098524 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:44:35 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-071ac36b-0c0d-4f88-a717-7409c2789166 tempest-VolumesGetTest-1176098524 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:44:35 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-071ac36b-0c0d-4f88-a717-7409c2789166 tempest-VolumesGetTest-1176098524 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:44:35 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-071ac36b-0c0d-4f88-a717-7409c2789166 tempest-VolumesGetTest-1176098524 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:44:35 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-071ac36b-0c0d-4f88-a717-7409c2789166 tempest-VolumesGetTest-1176098524 None] Selected osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385 as target Quobyte volume. {{(pid=88899) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 08:44:35 devstack cinder-volume[88899]: INFO cinder.volume.drivers.remotefs [None req-071ac36b-0c0d-4f88-a717-7409c2789166 tempest-VolumesGetTest-1176098524 None] casted to osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385 Aug 03 08:44:35 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-071ac36b-0c0d-4f88-a717-7409c2789166 tempest-VolumesGetTest-1176098524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-95d973e5-d7f3-4322-a2f7-ee300cd36ee0 1073741824 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:44:35 devstack sudo[105667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-95d973e5-d7f3-4322-a2f7-ee300cd36ee0 1073741824 Aug 03 08:44:35 devstack sudo[105667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:44:35 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-e7a8adb3-b2df-4065-83aa-137f21ec226a tempest-VolumeDependencyTests-1073688899 None] Create snapshot completed successfully Aug 03 08:44:35 devstack sudo[105664]: pam_unix(sudo:session): session closed for user root Aug 03 08:44:35 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-628f0f6d-ebea-4313-9024-17b63ebe58fc tempest-CreateVolumesFromImageTest-1275891140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a" returned: 0 in 0.253s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:44:35 devstack cinder-volume[88899]: DEBUG cinder.manager [None req-628f0f6d-ebea-4313-9024-17b63ebe58fc tempest-CreateVolumesFromImageTest-1275891140 None] Notifying Schedulers of capabilities ... {{(pid=88899) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 08:44:35 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-628f0f6d-ebea-4313-9024-17b63ebe58fc tempest-CreateVolumesFromImageTest-1275891140 None] Deleted volume successfully. Aug 03 08:44:35 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-628f0f6d-ebea-4313-9024-17b63ebe58fc tempest-CreateVolumesFromImageTest-1275891140 None] Lock "cinder-cfcec3b1-3e07-48b6-a8df-885b0c583f21-delete_volume" released by "delete_volume" :: held 1.124s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:44:35 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-7c40f3d1-c6fb-4109-a46a-9adfcd70c63f tempest-CreateVolumesFromImageTest-1275891140 None] Acquiring lock "cinder-6abd2d4f-1bae-4203-8134-fc4a1576503a-delete_volume" by "delete_volume" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:44:35 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-7c40f3d1-c6fb-4109-a46a-9adfcd70c63f tempest-CreateVolumesFromImageTest-1275891140 None] Lock "cinder-6abd2d4f-1bae-4203-8134-fc4a1576503a-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:44:35 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-7c40f3d1-c6fb-4109-a46a-9adfcd70c63f tempest-CreateVolumesFromImageTest-1275891140 None] Acquiring lock "cinder-quobyte-6abd2d4f-1bae-4203-8134-fc4a1576503a" by "delete_volume" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:44:35 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-7c40f3d1-c6fb-4109-a46a-9adfcd70c63f tempest-CreateVolumesFromImageTest-1275891140 None] Lock "cinder-quobyte-6abd2d4f-1bae-4203-8134-fc4a1576503a" acquired by "delete_volume" :: waited 0.019s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:44:35 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[6db64fc8-328e-4836-a185-4db01fc740a9]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:44:35 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-7c40f3d1-c6fb-4109-a46a-9adfcd70c63f tempest-CreateVolumesFromImageTest-1275891140 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-6abd2d4f-1bae-4203-8134-fc4a1576503a {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:44:36 devstack sudo[105673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-6abd2d4f-1bae-4203-8134-fc4a1576503a Aug 03 08:44:36 devstack sudo[105673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:44:36 devstack sudo[105667]: pam_unix(sudo:session): session closed for user root Aug 03 08:44:36 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-071ac36b-0c0d-4f88-a717-7409c2789166 tempest-VolumesGetTest-1176098524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-95d973e5-d7f3-4322-a2f7-ee300cd36ee0 1073741824" returned: 0 in 0.483s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:44:36 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-071ac36b-0c0d-4f88-a717-7409c2789166 tempest-VolumesGetTest-1176098524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-95d973e5-d7f3-4322-a2f7-ee300cd36ee0 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:44:36 devstack sudo[105676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-95d973e5-d7f3-4322-a2f7-ee300cd36ee0 Aug 03 08:44:36 devstack sudo[105676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:44:36 devstack sudo[105673]: pam_unix(sudo:session): session closed for user root Aug 03 08:44:36 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-7c40f3d1-c6fb-4109-a46a-9adfcd70c63f tempest-CreateVolumesFromImageTest-1275891140 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-6abd2d4f-1bae-4203-8134-fc4a1576503a" returned: 0 in 0.375s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:44:36 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-7c40f3d1-c6fb-4109-a46a-9adfcd70c63f tempest-CreateVolumesFromImageTest-1275891140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-6abd2d4f-1bae-4203-8134-fc4a1576503a {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:44:36 devstack sudo[105681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-6abd2d4f-1bae-4203-8134-fc4a1576503a Aug 03 08:44:36 devstack sudo[105681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:44:36 devstack sudo[105676]: pam_unix(sudo:session): session closed for user root Aug 03 08:44:36 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-071ac36b-0c0d-4f88-a717-7409c2789166 tempest-VolumesGetTest-1176098524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-95d973e5-d7f3-4322-a2f7-ee300cd36ee0" returned: 0 in 0.253s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:44:36 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-071ac36b-0c0d-4f88-a717-7409c2789166 tempest-VolumesGetTest-1176098524 None] <== create_volume: return (780ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'} {{(pid=88899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 08:44:36 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-071ac36b-0c0d-4f88-a717-7409c2789166 tempest-VolumesGetTest-1176098524 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.788s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:44:36 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-071ac36b-0c0d-4f88-a717-7409c2789166 tempest-VolumesGetTest-1176098524 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ee4fe2a-8673-40fa-b9ce-9b2b840605d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-95d973e5-d7f3-4322-a2f7-ee300cd36ee0', 'volume_size': 1}' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:44:36 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-071ac36b-0c0d-4f88-a717-7409c2789166 tempest-VolumesGetTest-1176098524 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b8e6bad-43c0-44b1-a5a6-bbd342bb4ecb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:44:36 devstack cinder-volume[88899]: INFO cinder.volume.flows.manager.create_volume [None req-071ac36b-0c0d-4f88-a717-7409c2789166 tempest-VolumesGetTest-1176098524 None] Volume volume-95d973e5-d7f3-4322-a2f7-ee300cd36ee0 (95d973e5-d7f3-4322-a2f7-ee300cd36ee0): created successfully Aug 03 08:44:36 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-071ac36b-0c0d-4f88-a717-7409c2789166 tempest-VolumesGetTest-1176098524 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b8e6bad-43c0-44b1-a5a6-bbd342bb4ecb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:44:36 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-071ac36b-0c0d-4f88-a717-7409c2789166 tempest-VolumesGetTest-1176098524 None] Flow 'volume_create_manager' (2068a896-3638-4875-a444-d86ce178d59d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:44:36 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-071ac36b-0c0d-4f88-a717-7409c2789166 tempest-VolumesGetTest-1176098524 None] Created volume successfully. Aug 03 08:44:36 devstack sudo[105681]: pam_unix(sudo:session): session closed for user root Aug 03 08:44:36 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-7c40f3d1-c6fb-4109-a46a-9adfcd70c63f tempest-CreateVolumesFromImageTest-1275891140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-6abd2d4f-1bae-4203-8134-fc4a1576503a" returned: 0 in 0.262s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:44:36 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-7c40f3d1-c6fb-4109-a46a-9adfcd70c63f tempest-CreateVolumesFromImageTest-1275891140 None] Lock "cinder-quobyte-6abd2d4f-1bae-4203-8134-fc4a1576503a" released by "delete_volume" :: held 0.682s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:44:36 devstack cinder-volume[88899]: DEBUG cinder.quota [None req-7c40f3d1-c6fb-4109-a46a-9adfcd70c63f tempest-CreateVolumesFromImageTest-1275891140 None] Created reservations ['77d5672a-0343-4431-8b0c-588cc4df00fc', '55abb911-a11a-4bf9-98f6-9904e236d249', '8066793d-998c-454d-b9a4-5f55255118d4', '5973c3eb-6333-4130-b7a0-3d5a0e1e0bd2'] {{(pid=88899) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 08:44:36 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-7c40f3d1-c6fb-4109-a46a-9adfcd70c63f tempest-CreateVolumesFromImageTest-1275891140 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:44:36 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-7c40f3d1-c6fb-4109-a46a-9adfcd70c63f tempest-CreateVolumesFromImageTest-1275891140 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:44:36 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-7c40f3d1-c6fb-4109-a46a-9adfcd70c63f tempest-CreateVolumesFromImageTest-1275891140 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:44:36 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-7c40f3d1-c6fb-4109-a46a-9adfcd70c63f tempest-CreateVolumesFromImageTest-1275891140 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:44:36 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-7c40f3d1-c6fb-4109-a46a-9adfcd70c63f tempest-CreateVolumesFromImageTest-1275891140 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:44:36 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-7c40f3d1-c6fb-4109-a46a-9adfcd70c63f tempest-CreateVolumesFromImageTest-1275891140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:44:36 devstack sudo[105685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a Aug 03 08:44:36 devstack sudo[105685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:44:37 devstack sudo[105685]: pam_unix(sudo:session): session closed for user root Aug 03 08:44:37 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-7c40f3d1-c6fb-4109-a46a-9adfcd70c63f tempest-CreateVolumesFromImageTest-1275891140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a" returned: 0 in 0.261s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:44:37 devstack cinder-volume[88899]: DEBUG cinder.manager [None req-7c40f3d1-c6fb-4109-a46a-9adfcd70c63f tempest-CreateVolumesFromImageTest-1275891140 None] Notifying Schedulers of capabilities ... {{(pid=88899) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 08:44:37 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-7c40f3d1-c6fb-4109-a46a-9adfcd70c63f tempest-CreateVolumesFromImageTest-1275891140 None] Deleted volume successfully. Aug 03 08:44:37 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-7c40f3d1-c6fb-4109-a46a-9adfcd70c63f tempest-CreateVolumesFromImageTest-1275891140 None] Lock "cinder-6abd2d4f-1bae-4203-8134-fc4a1576503a-delete_volume" released by "delete_volume" :: held 1.167s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:44:37 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-93f7339e-e916-4b5a-9803-9f40129b93b5 tempest-CreateVolumesFromImageTest-1275891140 None] Acquiring lock "cinder-fd20bdc6-ed08-4754-92f4-22caa9db0a58-delete_volume" by "delete_volume" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:44:37 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-93f7339e-e916-4b5a-9803-9f40129b93b5 tempest-CreateVolumesFromImageTest-1275891140 None] Lock "cinder-fd20bdc6-ed08-4754-92f4-22caa9db0a58-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:44:37 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-93f7339e-e916-4b5a-9803-9f40129b93b5 tempest-CreateVolumesFromImageTest-1275891140 None] Acquiring lock "cinder-quobyte-fd20bdc6-ed08-4754-92f4-22caa9db0a58" by "delete_volume" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:44:37 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-93f7339e-e916-4b5a-9803-9f40129b93b5 tempest-CreateVolumesFromImageTest-1275891140 None] Lock "cinder-quobyte-fd20bdc6-ed08-4754-92f4-22caa9db0a58" acquired by "delete_volume" :: waited 0.029s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:44:37 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[0510ba8e-bbbb-493b-ba76-481905a32d4e]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:44:37 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-93f7339e-e916-4b5a-9803-9f40129b93b5 tempest-CreateVolumesFromImageTest-1275891140 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-fd20bdc6-ed08-4754-92f4-22caa9db0a58 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:44:37 devstack cinder-volume[88899]: DEBUG cinder.volume.flows.manager.create_volume [None req-616b8258-5a48-45c3-a527-e6504d88608f tempest-VolumeDependencyTests-1073688899 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88899) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 08:44:37 devstack sudo[105688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-fd20bdc6-ed08-4754-92f4-22caa9db0a58 Aug 03 08:44:37 devstack sudo[105688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:44:37 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-616b8258-5a48-45c3-a527-e6504d88608f tempest-VolumeDependencyTests-1073688899 None] Flow 'volume_create_manager' (44ff50ea-a4f8-41c2-a187-c547a10adef4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:44:37 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-616b8258-5a48-45c3-a527-e6504d88608f tempest-VolumeDependencyTests-1073688899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (753fdb9f-cd6b-4de2-8090-5c798c0f55b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:44:37 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-616b8258-5a48-45c3-a527-e6504d88608f tempest-VolumeDependencyTests-1073688899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (753fdb9f-cd6b-4de2-8090-5c798c0f55b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:44:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1221901826',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e46018f8-fcf9-4900-a1d8-c08fccbd5379,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c2f62930ea114d94aae304e8ed339f9c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:44:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=db77f550-d390-434b-8115-37b701c9c8bd,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:44:37Z,use_quota=True,user_id='de61709cf33340bf9e956c0545be3966',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8bde7129-1dc4-42ab-b852-ab32c61b4921),volume_type_id=8bde7129-1dc4-42ab-b852-ab32c61b4921)' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:44:37 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-616b8258-5a48-45c3-a527-e6504d88608f tempest-VolumeDependencyTests-1073688899 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (89db2e7b-43cb-4850-9ded-4c29dd501026) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:44:37 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-616b8258-5a48-45c3-a527-e6504d88608f tempest-VolumeDependencyTests-1073688899 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (89db2e7b-43cb-4850-9ded-4c29dd501026) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:44:37 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-616b8258-5a48-45c3-a527-e6504d88608f tempest-VolumeDependencyTests-1073688899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5091ef68-dc90-4e6d-a575-a8886dc208f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:44:37 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-616b8258-5a48-45c3-a527-e6504d88608f tempest-VolumeDependencyTests-1073688899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5091ef68-dc90-4e6d-a575-a8886dc208f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'e46018f8-fcf9-4900-a1d8-c08fccbd5379', 'volume_name': 'volume-e46018f8-fcf9-4900-a1d8-c08fccbd5379', 'volume_size': 1, 'snapshot_id': 'db77f550-d390-434b-8115-37b701c9c8bd'}' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:44:37 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-616b8258-5a48-45c3-a527-e6504d88608f tempest-VolumeDependencyTests-1073688899 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb87b393-86de-4ec9-aabb-731d97ca6029) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:44:37 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-616b8258-5a48-45c3-a527-e6504d88608f tempest-VolumeDependencyTests-1073688899 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb87b393-86de-4ec9-aabb-731d97ca6029) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:44:37 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-616b8258-5a48-45c3-a527-e6504d88608f tempest-VolumeDependencyTests-1073688899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d4d2bc00-207e-46fb-a377-01d1df0ab69c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:44:37 devstack cinder-volume[88899]: INFO cinder.volume.flows.manager.create_volume [None req-616b8258-5a48-45c3-a527-e6504d88608f tempest-VolumeDependencyTests-1073688899 None] Volume e46018f8-fcf9-4900-a1d8-c08fccbd5379: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-e46018f8-fcf9-4900-a1d8-c08fccbd5379', 'volume_size': 1, 'snapshot_id': 'db77f550-d390-434b-8115-37b701c9c8bd'} Aug 03 08:44:37 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-616b8258-5a48-45c3-a527-e6504d88608f tempest-VolumeDependencyTests-1073688899 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:44:37 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-616b8258-5a48-45c3-a527-e6504d88608f tempest-VolumeDependencyTests-1073688899 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:44:37 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-616b8258-5a48-45c3-a527-e6504d88608f tempest-VolumeDependencyTests-1073688899 None] Acquiring lock "cinder-quobyte-db77f550-d390-434b-8115-37b701c9c8bd-e46018f8-fcf9-4900-a1d8-c08fccbd5379" by "_create_volume_from_snapshot" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:44:37 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-616b8258-5a48-45c3-a527-e6504d88608f tempest-VolumeDependencyTests-1073688899 None] Lock "cinder-quobyte-db77f550-d390-434b-8115-37b701c9c8bd-e46018f8-fcf9-4900-a1d8-c08fccbd5379" acquired by "_create_volume_from_snapshot" :: waited 0.013s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:44:37 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-616b8258-5a48-45c3-a527-e6504d88608f tempest-VolumeDependencyTests-1073688899 None] Creating volume e46018f8-fcf9-4900-a1d8-c08fccbd5379 from snapshot db77f550-d390-434b-8115-37b701c9c8bd {{(pid=88899) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Aug 03 08:44:37 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-616b8258-5a48-45c3-a527-e6504d88608f tempest-VolumeDependencyTests-1073688899 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:44:37 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-616b8258-5a48-45c3-a527-e6504d88608f tempest-VolumeDependencyTests-1073688899 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:44:37 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-616b8258-5a48-45c3-a527-e6504d88608f tempest-VolumeDependencyTests-1073688899 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:44:37 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-616b8258-5a48-45c3-a527-e6504d88608f tempest-VolumeDependencyTests-1073688899 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:44:37 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-616b8258-5a48-45c3-a527-e6504d88608f tempest-VolumeDependencyTests-1073688899 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:44:37 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-616b8258-5a48-45c3-a527-e6504d88608f tempest-VolumeDependencyTests-1073688899 None] Selected osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385 as target Quobyte volume. {{(pid=88899) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 08:44:37 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-616b8258-5a48-45c3-a527-e6504d88608f tempest-VolumeDependencyTests-1073688899 None] Acquiring lock "cinder-quobyte-e46018f8-fcf9-4900-a1d8-c08fccbd5379" by "_copy_volume_from_snapshot" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:44:37 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-616b8258-5a48-45c3-a527-e6504d88608f tempest-VolumeDependencyTests-1073688899 None] Lock "cinder-quobyte-e46018f8-fcf9-4900-a1d8-c08fccbd5379" acquired by "_copy_volume_from_snapshot" :: waited 0.012s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:44:37 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-616b8258-5a48-45c3-a527-e6504d88608f tempest-VolumeDependencyTests-1073688899 None] snapshot: db77f550-d390-434b-8115-37b701c9c8bd, volume: e46018f8-fcf9-4900-a1d8-c08fccbd5379, {{(pid=88899) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Aug 03 08:44:37 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-616b8258-5a48-45c3-a527-e6504d88608f tempest-VolumeDependencyTests-1073688899 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:44:37 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-616b8258-5a48-45c3-a527-e6504d88608f tempest-VolumeDependencyTests-1073688899 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:44:37 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-616b8258-5a48-45c3-a527-e6504d88608f tempest-VolumeDependencyTests-1073688899 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:44:37 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-616b8258-5a48-45c3-a527-e6504d88608f tempest-VolumeDependencyTests-1073688899 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:44:37 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-616b8258-5a48-45c3-a527-e6504d88608f tempest-VolumeDependencyTests-1073688899 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:44:37 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1fc56ac-df11-4009-86dc-ab445afc821a]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:44:37 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-616b8258-5a48-45c3-a527-e6504d88608f tempest-VolumeDependencyTests-1073688899 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-66ec0c6b-ba7c-4f8a-8c2a-6dbfd6262fc1.db77f550-d390-434b-8115-37b701c9c8bd {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:44:37 devstack sudo[105688]: pam_unix(sudo:session): session closed for user root Aug 03 08:44:37 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-93f7339e-e916-4b5a-9803-9f40129b93b5 tempest-CreateVolumesFromImageTest-1275891140 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-fd20bdc6-ed08-4754-92f4-22caa9db0a58" returned: 0 in 0.408s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:44:37 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-93f7339e-e916-4b5a-9803-9f40129b93b5 tempest-CreateVolumesFromImageTest-1275891140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-fd20bdc6-ed08-4754-92f4-22caa9db0a58 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:44:37 devstack sudo[105690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-66ec0c6b-ba7c-4f8a-8c2a-6dbfd6262fc1.db77f550-d390-434b-8115-37b701c9c8bd Aug 03 08:44:37 devstack sudo[105690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:44:37 devstack sudo[105695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-fd20bdc6-ed08-4754-92f4-22caa9db0a58 Aug 03 08:44:37 devstack sudo[105695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:44:37 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-4b9e19b7-c7ff-4643-b2ff-c06145c1064c tempest-VolumesGetTest-1176098524 None] Acquiring lock "cinder-95d973e5-d7f3-4322-a2f7-ee300cd36ee0-delete_volume" by "delete_volume" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:44:37 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-4b9e19b7-c7ff-4643-b2ff-c06145c1064c tempest-VolumesGetTest-1176098524 None] Lock "cinder-95d973e5-d7f3-4322-a2f7-ee300cd36ee0-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:44:37 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-4b9e19b7-c7ff-4643-b2ff-c06145c1064c tempest-VolumesGetTest-1176098524 None] Acquiring lock "cinder-quobyte-95d973e5-d7f3-4322-a2f7-ee300cd36ee0" by "delete_volume" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:44:37 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-4b9e19b7-c7ff-4643-b2ff-c06145c1064c tempest-VolumesGetTest-1176098524 None] Lock "cinder-quobyte-95d973e5-d7f3-4322-a2f7-ee300cd36ee0" acquired by "delete_volume" :: waited 0.019s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:44:37 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0887f45-1156-4270-b9d1-d0906abe9bbc]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:44:37 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-4b9e19b7-c7ff-4643-b2ff-c06145c1064c tempest-VolumesGetTest-1176098524 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-95d973e5-d7f3-4322-a2f7-ee300cd36ee0 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:44:37 devstack sudo[105690]: pam_unix(sudo:session): session closed for user root Aug 03 08:44:37 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-616b8258-5a48-45c3-a527-e6504d88608f tempest-VolumeDependencyTests-1073688899 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-66ec0c6b-ba7c-4f8a-8c2a-6dbfd6262fc1.db77f550-d390-434b-8115-37b701c9c8bd" returned: 0 in 0.414s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:44:37 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-616b8258-5a48-45c3-a527-e6504d88608f tempest-VolumeDependencyTests-1073688899 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-66ec0c6b-ba7c-4f8a-8c2a-6dbfd6262fc1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88899) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 03 08:44:37 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dee6570-a7e7-48f7-b2f6-ba07d267ee49]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:44:37 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-616b8258-5a48-45c3-a527-e6504d88608f tempest-VolumeDependencyTests-1073688899 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-66ec0c6b-ba7c-4f8a-8c2a-6dbfd6262fc1 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:44:37 devstack sudo[105695]: pam_unix(sudo:session): session closed for user root Aug 03 08:44:37 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-93f7339e-e916-4b5a-9803-9f40129b93b5 tempest-CreateVolumesFromImageTest-1275891140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-fd20bdc6-ed08-4754-92f4-22caa9db0a58" returned: 0 in 0.313s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:44:37 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-93f7339e-e916-4b5a-9803-9f40129b93b5 tempest-CreateVolumesFromImageTest-1275891140 None] Lock "cinder-quobyte-fd20bdc6-ed08-4754-92f4-22caa9db0a58" released by "delete_volume" :: held 0.765s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:44:37 devstack sudo[105700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-95d973e5-d7f3-4322-a2f7-ee300cd36ee0 Aug 03 08:44:37 devstack sudo[105700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:44:38 devstack cinder-volume[88899]: DEBUG cinder.quota [None req-93f7339e-e916-4b5a-9803-9f40129b93b5 tempest-CreateVolumesFromImageTest-1275891140 None] Created reservations ['398060a8-2218-45fe-912e-56d16fc54c01', 'e5798481-3ccc-483e-95d1-fe18babcee68', '426e949c-870c-46ff-a3bf-ded0a00bbe1f', 'ee49386e-2b53-4dbc-a95a-753c0093cfb6'] {{(pid=88899) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 08:44:38 devstack sudo[105702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-66ec0c6b-ba7c-4f8a-8c2a-6dbfd6262fc1 Aug 03 08:44:38 devstack sudo[105702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:44:38 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-93f7339e-e916-4b5a-9803-9f40129b93b5 tempest-CreateVolumesFromImageTest-1275891140 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:44:38 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-93f7339e-e916-4b5a-9803-9f40129b93b5 tempest-CreateVolumesFromImageTest-1275891140 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.009s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:44:38 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-93f7339e-e916-4b5a-9803-9f40129b93b5 tempest-CreateVolumesFromImageTest-1275891140 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:44:38 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-93f7339e-e916-4b5a-9803-9f40129b93b5 tempest-CreateVolumesFromImageTest-1275891140 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:44:38 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-93f7339e-e916-4b5a-9803-9f40129b93b5 tempest-CreateVolumesFromImageTest-1275891140 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:44:38 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-93f7339e-e916-4b5a-9803-9f40129b93b5 tempest-CreateVolumesFromImageTest-1275891140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:44:38 devstack sudo[105705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a Aug 03 08:44:38 devstack sudo[105705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:44:38 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-068f0fc6-da65-4098-9499-96fb94942d84 tempest-CreateVolumesFromImageTest-1275891140 None] Acquiring lock "cinder-2786cc73-cf36-4f63-9480-9c6c2a5db506-delete_volume" by "delete_volume" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:44:38 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-068f0fc6-da65-4098-9499-96fb94942d84 tempest-CreateVolumesFromImageTest-1275891140 None] Lock "cinder-2786cc73-cf36-4f63-9480-9c6c2a5db506-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:44:38 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-068f0fc6-da65-4098-9499-96fb94942d84 tempest-CreateVolumesFromImageTest-1275891140 None] Acquiring lock "cinder-quobyte-2786cc73-cf36-4f63-9480-9c6c2a5db506" by "delete_volume" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:44:38 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-068f0fc6-da65-4098-9499-96fb94942d84 tempest-CreateVolumesFromImageTest-1275891140 None] Lock "cinder-quobyte-2786cc73-cf36-4f63-9480-9c6c2a5db506" acquired by "delete_volume" :: waited 0.020s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:44:38 devstack sudo[105700]: pam_unix(sudo:session): session closed for user root Aug 03 08:44:38 devstack sudo[105702]: pam_unix(sudo:session): session closed for user root Aug 03 08:44:38 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-4b9e19b7-c7ff-4643-b2ff-c06145c1064c tempest-VolumesGetTest-1176098524 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-95d973e5-d7f3-4322-a2f7-ee300cd36ee0" returned: 0 in 0.541s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:44:38 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-4b9e19b7-c7ff-4643-b2ff-c06145c1064c tempest-VolumesGetTest-1176098524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-95d973e5-d7f3-4322-a2f7-ee300cd36ee0 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:44:38 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-616b8258-5a48-45c3-a527-e6504d88608f tempest-VolumeDependencyTests-1073688899 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-66ec0c6b-ba7c-4f8a-8c2a-6dbfd6262fc1" returned: 0 in 0.494s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:44:38 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-616b8258-5a48-45c3-a527-e6504d88608f tempest-VolumeDependencyTests-1073688899 None] will copy from snapshot at /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-66ec0c6b-ba7c-4f8a-8c2a-6dbfd6262fc1 {{(pid=88899) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Aug 03 08:44:38 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-616b8258-5a48-45c3-a527-e6504d88608f tempest-VolumeDependencyTests-1073688899 None] Creating direct copy from snapshot {{(pid=88899) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Aug 03 08:44:38 devstack cinder-volume[88899]: DEBUG cinder.utils [None req-616b8258-5a48-45c3-a527-e6504d88608f tempest-VolumeDependencyTests-1073688899 None] Path /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-e46018f8-fcf9-4900-a1d8-c08fccbd5379 not found in is_blk_device check {{(pid=88899) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Aug 03 08:44:38 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-616b8258-5a48-45c3-a527-e6504d88608f tempest-VolumeDependencyTests-1073688899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-66ec0c6b-ba7c-4f8a-8c2a-6dbfd6262fc1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-e46018f8-fcf9-4900-a1d8-c08fccbd5379 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:44:38 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3a6065c-5e0d-49f0-a0d3-e42197f7a434]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:44:38 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-068f0fc6-da65-4098-9499-96fb94942d84 tempest-CreateVolumesFromImageTest-1275891140 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-2786cc73-cf36-4f63-9480-9c6c2a5db506 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:44:38 devstack sudo[105714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-95d973e5-d7f3-4322-a2f7-ee300cd36ee0 Aug 03 08:44:38 devstack sudo[105714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:44:38 devstack sudo[105715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-66ec0c6b-ba7c-4f8a-8c2a-6dbfd6262fc1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-e46018f8-fcf9-4900-a1d8-c08fccbd5379 Aug 03 08:44:38 devstack sudo[105715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:44:38 devstack sudo[105705]: pam_unix(sudo:session): session closed for user root Aug 03 08:44:38 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-93f7339e-e916-4b5a-9803-9f40129b93b5 tempest-CreateVolumesFromImageTest-1275891140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a" returned: 0 in 0.322s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:44:38 devstack cinder-volume[88899]: DEBUG cinder.manager [None req-93f7339e-e916-4b5a-9803-9f40129b93b5 tempest-CreateVolumesFromImageTest-1275891140 None] Notifying Schedulers of capabilities ... {{(pid=88899) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 08:44:38 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-93f7339e-e916-4b5a-9803-9f40129b93b5 tempest-CreateVolumesFromImageTest-1275891140 None] Deleted volume successfully. Aug 03 08:44:38 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-93f7339e-e916-4b5a-9803-9f40129b93b5 tempest-CreateVolumesFromImageTest-1275891140 None] Lock "cinder-fd20bdc6-ed08-4754-92f4-22caa9db0a58-delete_volume" released by "delete_volume" :: held 1.422s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:44:38 devstack sudo[105718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-2786cc73-cf36-4f63-9480-9c6c2a5db506 Aug 03 08:44:38 devstack sudo[105718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:44:38 devstack sudo[105714]: pam_unix(sudo:session): session closed for user root Aug 03 08:44:38 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-4b9e19b7-c7ff-4643-b2ff-c06145c1064c tempest-VolumesGetTest-1176098524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-95d973e5-d7f3-4322-a2f7-ee300cd36ee0" returned: 0 in 0.288s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:44:38 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-4b9e19b7-c7ff-4643-b2ff-c06145c1064c tempest-VolumesGetTest-1176098524 None] Lock "cinder-quobyte-95d973e5-d7f3-4322-a2f7-ee300cd36ee0" released by "delete_volume" :: held 0.867s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:44:38 devstack cinder-volume[88899]: DEBUG cinder.quota [None req-4b9e19b7-c7ff-4643-b2ff-c06145c1064c tempest-VolumesGetTest-1176098524 None] Created reservations ['17a070aa-06ab-4dc5-8b85-6f3cda7dd91a', '6806c614-700d-4d00-af25-3a5a3137dbc6', '421b0652-d257-4ac2-b5e8-d20e75ab090a', 'e0095019-0d79-4925-9c3b-3067dae08b21'] {{(pid=88899) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 08:44:38 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-4b9e19b7-c7ff-4643-b2ff-c06145c1064c tempest-VolumesGetTest-1176098524 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:44:38 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-4b9e19b7-c7ff-4643-b2ff-c06145c1064c tempest-VolumesGetTest-1176098524 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:44:38 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-4b9e19b7-c7ff-4643-b2ff-c06145c1064c tempest-VolumesGetTest-1176098524 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:44:38 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-4b9e19b7-c7ff-4643-b2ff-c06145c1064c tempest-VolumesGetTest-1176098524 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:44:38 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-4b9e19b7-c7ff-4643-b2ff-c06145c1064c tempest-VolumesGetTest-1176098524 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:44:38 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-4b9e19b7-c7ff-4643-b2ff-c06145c1064c tempest-VolumesGetTest-1176098524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:44:38 devstack sudo[105718]: pam_unix(sudo:session): session closed for user root Aug 03 08:44:38 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-068f0fc6-da65-4098-9499-96fb94942d84 tempest-CreateVolumesFromImageTest-1275891140 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-2786cc73-cf36-4f63-9480-9c6c2a5db506" returned: 0 in 0.422s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:44:38 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-068f0fc6-da65-4098-9499-96fb94942d84 tempest-CreateVolumesFromImageTest-1275891140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-2786cc73-cf36-4f63-9480-9c6c2a5db506 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:44:38 devstack sudo[105730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a Aug 03 08:44:38 devstack sudo[105730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:44:38 devstack sudo[105731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-2786cc73-cf36-4f63-9480-9c6c2a5db506 Aug 03 08:44:38 devstack sudo[105731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:44:39 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-b81cc714-b8d9-4478-9fd2-7c86c6161481 tempest-VolumesGetTest-1176098524 None] Acquiring lock "cinder-eb44d2da-9cf8-4046-9a5d-836cfd22b778-delete_volume" by "delete_volume" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:44:39 devstack sudo[105730]: pam_unix(sudo:session): session closed for user root Aug 03 08:44:39 devstack sudo[105731]: pam_unix(sudo:session): session closed for user root Aug 03 08:44:39 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-4b9e19b7-c7ff-4643-b2ff-c06145c1064c tempest-VolumesGetTest-1176098524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a" returned: 0 in 0.388s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:44:39 devstack cinder-volume[88899]: DEBUG cinder.manager [None req-4b9e19b7-c7ff-4643-b2ff-c06145c1064c tempest-VolumesGetTest-1176098524 None] Notifying Schedulers of capabilities ... {{(pid=88899) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 08:44:39 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-b81cc714-b8d9-4478-9fd2-7c86c6161481 tempest-VolumesGetTest-1176098524 None] Lock "cinder-eb44d2da-9cf8-4046-9a5d-836cfd22b778-delete_volume" acquired by "delete_volume" :: waited 0.055s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:44:39 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-4b9e19b7-c7ff-4643-b2ff-c06145c1064c tempest-VolumesGetTest-1176098524 None] Deleted volume successfully. Aug 03 08:44:39 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-068f0fc6-da65-4098-9499-96fb94942d84 tempest-CreateVolumesFromImageTest-1275891140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-2786cc73-cf36-4f63-9480-9c6c2a5db506" returned: 0 in 0.417s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:44:39 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-068f0fc6-da65-4098-9499-96fb94942d84 tempest-CreateVolumesFromImageTest-1275891140 None] Lock "cinder-quobyte-2786cc73-cf36-4f63-9480-9c6c2a5db506" released by "delete_volume" :: held 0.934s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:44:39 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-4b9e19b7-c7ff-4643-b2ff-c06145c1064c tempest-VolumesGetTest-1176098524 None] Lock "cinder-95d973e5-d7f3-4322-a2f7-ee300cd36ee0-delete_volume" released by "delete_volume" :: held 1.566s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:44:39 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-b81cc714-b8d9-4478-9fd2-7c86c6161481 tempest-VolumesGetTest-1176098524 None] Acquiring lock "cinder-quobyte-eb44d2da-9cf8-4046-9a5d-836cfd22b778" by "delete_volume" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:44:39 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-b81cc714-b8d9-4478-9fd2-7c86c6161481 tempest-VolumesGetTest-1176098524 None] Lock "cinder-quobyte-eb44d2da-9cf8-4046-9a5d-836cfd22b778" acquired by "delete_volume" :: waited 0.033s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:44:39 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[91cc69e8-4fb9-4f90-91ff-a46f918a7a50]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:44:39 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-b81cc714-b8d9-4478-9fd2-7c86c6161481 tempest-VolumesGetTest-1176098524 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-eb44d2da-9cf8-4046-9a5d-836cfd22b778 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:44:39 devstack cinder-volume[88899]: DEBUG cinder.quota [None req-068f0fc6-da65-4098-9499-96fb94942d84 tempest-CreateVolumesFromImageTest-1275891140 None] Created reservations ['aa7d437f-6bd4-4953-8a5b-1542515c8ade', '7daa96a8-909d-4005-b54a-c4740ec0fdb9', '6ec6f239-36bb-4df5-a5b3-d5a707da4665', '4cb2a767-4bdf-4bcf-b44b-405916bf6ad6'] {{(pid=88899) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 08:44:39 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-068f0fc6-da65-4098-9499-96fb94942d84 tempest-CreateVolumesFromImageTest-1275891140 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:44:39 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-068f0fc6-da65-4098-9499-96fb94942d84 tempest-CreateVolumesFromImageTest-1275891140 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:44:39 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-068f0fc6-da65-4098-9499-96fb94942d84 tempest-CreateVolumesFromImageTest-1275891140 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:44:39 devstack sudo[105742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-eb44d2da-9cf8-4046-9a5d-836cfd22b778 Aug 03 08:44:39 devstack sudo[105742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:44:39 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-068f0fc6-da65-4098-9499-96fb94942d84 tempest-CreateVolumesFromImageTest-1275891140 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:44:39 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-068f0fc6-da65-4098-9499-96fb94942d84 tempest-CreateVolumesFromImageTest-1275891140 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:44:39 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-068f0fc6-da65-4098-9499-96fb94942d84 tempest-CreateVolumesFromImageTest-1275891140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:44:39 devstack sudo[105745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a Aug 03 08:44:39 devstack sudo[105745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:44:40 devstack sudo[105745]: pam_unix(sudo:session): session closed for user root Aug 03 08:44:40 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-068f0fc6-da65-4098-9499-96fb94942d84 tempest-CreateVolumesFromImageTest-1275891140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a" returned: 0 in 0.539s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:44:40 devstack cinder-volume[88899]: DEBUG cinder.manager [None req-068f0fc6-da65-4098-9499-96fb94942d84 tempest-CreateVolumesFromImageTest-1275891140 None] Notifying Schedulers of capabilities ... {{(pid=88899) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 08:44:40 devstack sudo[105742]: pam_unix(sudo:session): session closed for user root Aug 03 08:44:40 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-068f0fc6-da65-4098-9499-96fb94942d84 tempest-CreateVolumesFromImageTest-1275891140 None] Deleted volume successfully. Aug 03 08:44:40 devstack cinder-volume[88899]: DEBUG dbcounter [-] [88899] Writing DB stats cinder:SELECT=103,cinder:UPDATE=123,cinder:INSERT=26,cinder:DELETE=11 {{(pid=88899) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 03 08:44:40 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-b81cc714-b8d9-4478-9fd2-7c86c6161481 tempest-VolumesGetTest-1176098524 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-eb44d2da-9cf8-4046-9a5d-836cfd22b778" returned: 0 in 0.789s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:44:40 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-b81cc714-b8d9-4478-9fd2-7c86c6161481 tempest-VolumesGetTest-1176098524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-eb44d2da-9cf8-4046-9a5d-836cfd22b778 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:44:40 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-068f0fc6-da65-4098-9499-96fb94942d84 tempest-CreateVolumesFromImageTest-1275891140 None] Lock "cinder-2786cc73-cf36-4f63-9480-9c6c2a5db506-delete_volume" released by "delete_volume" :: held 1.981s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:44:40 devstack sudo[105751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-eb44d2da-9cf8-4046-9a5d-836cfd22b778 Aug 03 08:44:40 devstack sudo[105751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:44:40 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-5b8087e5-5d71-440a-b24e-968cbb85d267 tempest-CreateVolumesFromImageTest-1275891140 None] Acquiring lock "cinder-1e996a37-f86d-49d8-8f93-2cd097f1b134-delete_volume" by "delete_volume" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:44:40 devstack sudo[105751]: pam_unix(sudo:session): session closed for user root Aug 03 08:44:40 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-b81cc714-b8d9-4478-9fd2-7c86c6161481 tempest-VolumesGetTest-1176098524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-eb44d2da-9cf8-4046-9a5d-836cfd22b778" returned: 0 in 0.508s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:44:40 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-5b8087e5-5d71-440a-b24e-968cbb85d267 tempest-CreateVolumesFromImageTest-1275891140 None] Lock "cinder-1e996a37-f86d-49d8-8f93-2cd097f1b134-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:44:40 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-b81cc714-b8d9-4478-9fd2-7c86c6161481 tempest-VolumesGetTest-1176098524 None] Lock "cinder-quobyte-eb44d2da-9cf8-4046-9a5d-836cfd22b778" released by "delete_volume" :: held 1.431s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:44:40 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-5b8087e5-5d71-440a-b24e-968cbb85d267 tempest-CreateVolumesFromImageTest-1275891140 None] Acquiring lock "cinder-quobyte-1e996a37-f86d-49d8-8f93-2cd097f1b134" by "delete_volume" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:44:40 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-5b8087e5-5d71-440a-b24e-968cbb85d267 tempest-CreateVolumesFromImageTest-1275891140 None] Lock "cinder-quobyte-1e996a37-f86d-49d8-8f93-2cd097f1b134" acquired by "delete_volume" :: waited 0.034s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:44:40 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[2198651d-8888-4681-bb3a-2c5161cf8202]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:44:40 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-5b8087e5-5d71-440a-b24e-968cbb85d267 tempest-CreateVolumesFromImageTest-1275891140 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-1e996a37-f86d-49d8-8f93-2cd097f1b134 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:44:41 devstack cinder-volume[88899]: DEBUG cinder.quota [None req-b81cc714-b8d9-4478-9fd2-7c86c6161481 tempest-VolumesGetTest-1176098524 None] Created reservations ['e8e94792-7497-466d-8e27-1f137290d0f1', '32c662ae-5ba5-4124-a38d-102e73301c89', 'd8e5a5be-a1e0-43cb-9929-4b66c4f5cbe3', 'b5387062-4655-4b9d-9ec3-ff028fb2aa09'] {{(pid=88899) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 08:44:41 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-b81cc714-b8d9-4478-9fd2-7c86c6161481 tempest-VolumesGetTest-1176098524 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:44:41 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-b81cc714-b8d9-4478-9fd2-7c86c6161481 tempest-VolumesGetTest-1176098524 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:44:41 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-b81cc714-b8d9-4478-9fd2-7c86c6161481 tempest-VolumesGetTest-1176098524 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:44:41 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-b81cc714-b8d9-4478-9fd2-7c86c6161481 tempest-VolumesGetTest-1176098524 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:44:41 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-b81cc714-b8d9-4478-9fd2-7c86c6161481 tempest-VolumesGetTest-1176098524 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:44:41 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-b81cc714-b8d9-4478-9fd2-7c86c6161481 tempest-VolumesGetTest-1176098524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:44:41 devstack sudo[105754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-1e996a37-f86d-49d8-8f93-2cd097f1b134 Aug 03 08:44:41 devstack sudo[105754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:44:41 devstack sudo[105755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a Aug 03 08:44:41 devstack sudo[105755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:44:41 devstack sudo[105754]: pam_unix(sudo:session): session closed for user root Aug 03 08:44:41 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-5b8087e5-5d71-440a-b24e-968cbb85d267 tempest-CreateVolumesFromImageTest-1275891140 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-1e996a37-f86d-49d8-8f93-2cd097f1b134" returned: 0 in 0.972s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:44:41 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-5b8087e5-5d71-440a-b24e-968cbb85d267 tempest-CreateVolumesFromImageTest-1275891140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-1e996a37-f86d-49d8-8f93-2cd097f1b134 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:44:41 devstack sudo[105755]: pam_unix(sudo:session): session closed for user root Aug 03 08:44:42 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-b81cc714-b8d9-4478-9fd2-7c86c6161481 tempest-VolumesGetTest-1176098524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a" returned: 0 in 0.793s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:44:42 devstack cinder-volume[88899]: DEBUG cinder.manager [None req-b81cc714-b8d9-4478-9fd2-7c86c6161481 tempest-VolumesGetTest-1176098524 None] Notifying Schedulers of capabilities ... {{(pid=88899) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 08:44:42 devstack sudo[105762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-1e996a37-f86d-49d8-8f93-2cd097f1b134 Aug 03 08:44:42 devstack sudo[105762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:44:42 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-b81cc714-b8d9-4478-9fd2-7c86c6161481 tempest-VolumesGetTest-1176098524 None] Deleted volume successfully. Aug 03 08:44:42 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-b618e9e6-7481-484c-bea2-a913a97fa347 tempest-VolumesGetTest-1176098524 None] Acquiring lock "cinder-05bbb02d-4373-4cf9-9175-e03927f03823-delete_volume" by "delete_volume" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:44:42 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-b618e9e6-7481-484c-bea2-a913a97fa347 tempest-VolumesGetTest-1176098524 None] Lock "cinder-05bbb02d-4373-4cf9-9175-e03927f03823-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:44:42 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-b81cc714-b8d9-4478-9fd2-7c86c6161481 tempest-VolumesGetTest-1176098524 None] Lock "cinder-eb44d2da-9cf8-4046-9a5d-836cfd22b778-delete_volume" released by "delete_volume" :: held 2.890s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:44:42 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-b618e9e6-7481-484c-bea2-a913a97fa347 tempest-VolumesGetTest-1176098524 None] Acquiring lock "cinder-quobyte-05bbb02d-4373-4cf9-9175-e03927f03823" by "delete_volume" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:44:42 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-b618e9e6-7481-484c-bea2-a913a97fa347 tempest-VolumesGetTest-1176098524 None] Lock "cinder-quobyte-05bbb02d-4373-4cf9-9175-e03927f03823" acquired by "delete_volume" :: waited 0.025s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:44:42 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[b43d8d2e-4c39-4eff-ae31-962a4efe0fc8]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:44:42 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-b618e9e6-7481-484c-bea2-a913a97fa347 tempest-VolumesGetTest-1176098524 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-05bbb02d-4373-4cf9-9175-e03927f03823 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:44:42 devstack sudo[105762]: pam_unix(sudo:session): session closed for user root Aug 03 08:44:42 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-5b8087e5-5d71-440a-b24e-968cbb85d267 tempest-CreateVolumesFromImageTest-1275891140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-1e996a37-f86d-49d8-8f93-2cd097f1b134" returned: 0 in 0.439s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:44:42 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-5b8087e5-5d71-440a-b24e-968cbb85d267 tempest-CreateVolumesFromImageTest-1275891140 None] Lock "cinder-quobyte-1e996a37-f86d-49d8-8f93-2cd097f1b134" released by "delete_volume" :: held 1.511s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:44:42 devstack cinder-volume[88899]: DEBUG cinder.quota [None req-5b8087e5-5d71-440a-b24e-968cbb85d267 tempest-CreateVolumesFromImageTest-1275891140 None] Created reservations ['26e1e0d8-df12-44b9-a9ef-e27c31ec2379', '55700ab8-2871-4b44-b1d0-177fde5abeac', '7e496110-5940-4429-967c-b9f2ab897027', 'cccfb4a6-c5a5-437c-af20-831551f2d547'] {{(pid=88899) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 08:44:42 devstack sudo[105765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-05bbb02d-4373-4cf9-9175-e03927f03823 Aug 03 08:44:42 devstack sudo[105765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:44:42 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-5b8087e5-5d71-440a-b24e-968cbb85d267 tempest-CreateVolumesFromImageTest-1275891140 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:44:42 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-5b8087e5-5d71-440a-b24e-968cbb85d267 tempest-CreateVolumesFromImageTest-1275891140 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:44:42 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-5b8087e5-5d71-440a-b24e-968cbb85d267 tempest-CreateVolumesFromImageTest-1275891140 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:44:42 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-5b8087e5-5d71-440a-b24e-968cbb85d267 tempest-CreateVolumesFromImageTest-1275891140 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:44:42 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-5b8087e5-5d71-440a-b24e-968cbb85d267 tempest-CreateVolumesFromImageTest-1275891140 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.033s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:44:42 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-5b8087e5-5d71-440a-b24e-968cbb85d267 tempest-CreateVolumesFromImageTest-1275891140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:44:42 devstack sudo[105768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a Aug 03 08:44:42 devstack sudo[105768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:44:43 devstack sudo[105765]: pam_unix(sudo:session): session closed for user root Aug 03 08:44:43 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-b618e9e6-7481-484c-bea2-a913a97fa347 tempest-VolumesGetTest-1176098524 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-05bbb02d-4373-4cf9-9175-e03927f03823" returned: 0 in 0.830s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:44:43 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-b618e9e6-7481-484c-bea2-a913a97fa347 tempest-VolumesGetTest-1176098524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-05bbb02d-4373-4cf9-9175-e03927f03823 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:44:43 devstack sudo[105774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-05bbb02d-4373-4cf9-9175-e03927f03823 Aug 03 08:44:43 devstack sudo[105774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:44:43 devstack sudo[105768]: pam_unix(sudo:session): session closed for user root Aug 03 08:44:43 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-5b8087e5-5d71-440a-b24e-968cbb85d267 tempest-CreateVolumesFromImageTest-1275891140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a" returned: 0 in 0.406s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:44:43 devstack cinder-volume[88899]: DEBUG cinder.manager [None req-5b8087e5-5d71-440a-b24e-968cbb85d267 tempest-CreateVolumesFromImageTest-1275891140 None] Notifying Schedulers of capabilities ... {{(pid=88899) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 08:44:43 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-5b8087e5-5d71-440a-b24e-968cbb85d267 tempest-CreateVolumesFromImageTest-1275891140 None] Deleted volume successfully. Aug 03 08:44:43 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-5b8087e5-5d71-440a-b24e-968cbb85d267 tempest-CreateVolumesFromImageTest-1275891140 None] Lock "cinder-1e996a37-f86d-49d8-8f93-2cd097f1b134-delete_volume" released by "delete_volume" :: held 2.621s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:44:43 devstack sudo[105774]: pam_unix(sudo:session): session closed for user root Aug 03 08:44:43 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-b618e9e6-7481-484c-bea2-a913a97fa347 tempest-VolumesGetTest-1176098524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-05bbb02d-4373-4cf9-9175-e03927f03823" returned: 0 in 0.718s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:44:43 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-b618e9e6-7481-484c-bea2-a913a97fa347 tempest-VolumesGetTest-1176098524 None] Lock "cinder-quobyte-05bbb02d-4373-4cf9-9175-e03927f03823" released by "delete_volume" :: held 1.737s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:44:44 devstack sudo[105715]: pam_unix(sudo:session): session closed for user root Aug 03 08:44:44 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-616b8258-5a48-45c3-a527-e6504d88608f tempest-VolumeDependencyTests-1073688899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-66ec0c6b-ba7c-4f8a-8c2a-6dbfd6262fc1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-e46018f8-fcf9-4900-a1d8-c08fccbd5379" returned: 0 in 5.626s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:44:44 devstack cinder-volume[88899]: DEBUG cinder.image.image_utils [None req-616b8258-5a48-45c3-a527-e6504d88608f tempest-VolumeDependencyTests-1073688899 None] Image conversion details: src /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-66ec0c6b-ba7c-4f8a-8c2a-6dbfd6262fc1, size 1024.00 MB, duration 5.63 sec, destination /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-e46018f8-fcf9-4900-a1d8-c08fccbd5379 {{(pid=88899) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 03 08:44:44 devstack cinder-volume[88899]: INFO cinder.image.image_utils [None req-616b8258-5a48-45c3-a527-e6504d88608f tempest-VolumeDependencyTests-1073688899 None] Converted 1024.00 MB image at 181.99 MB/s Aug 03 08:44:44 devstack cinder-volume[88899]: WARNING cinder.volume.drivers.remotefs [None req-616b8258-5a48-45c3-a527-e6504d88608f tempest-VolumeDependencyTests-1073688899 None] /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-e46018f8-fcf9-4900-a1d8-c08fccbd5379 is being set with open permissions: ugo+rw Aug 03 08:44:44 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-616b8258-5a48-45c3-a527-e6504d88608f tempest-VolumeDependencyTests-1073688899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-e46018f8-fcf9-4900-a1d8-c08fccbd5379 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:44:44 devstack cinder-volume[88899]: DEBUG cinder.quota [None req-b618e9e6-7481-484c-bea2-a913a97fa347 tempest-VolumesGetTest-1176098524 None] Created reservations ['b28803f3-b7d2-4f5a-9d78-c86ee6239543', 'a642b7de-049e-4318-a343-0a9afb714525', 'f89c79ec-3d32-4bde-87bf-a11916f6eb35', '5a5be192-983b-4778-ba25-6a932cba4a98'] {{(pid=88899) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 08:44:44 devstack sudo[105777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-e46018f8-fcf9-4900-a1d8-c08fccbd5379 Aug 03 08:44:44 devstack sudo[105777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:44:44 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-b618e9e6-7481-484c-bea2-a913a97fa347 tempest-VolumesGetTest-1176098524 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:44:44 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-b618e9e6-7481-484c-bea2-a913a97fa347 tempest-VolumesGetTest-1176098524 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:44:44 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-b618e9e6-7481-484c-bea2-a913a97fa347 tempest-VolumesGetTest-1176098524 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:44:44 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-b618e9e6-7481-484c-bea2-a913a97fa347 tempest-VolumesGetTest-1176098524 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:44:44 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-b618e9e6-7481-484c-bea2-a913a97fa347 tempest-VolumesGetTest-1176098524 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:44:44 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-b618e9e6-7481-484c-bea2-a913a97fa347 tempest-VolumesGetTest-1176098524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:44:44 devstack sudo[105779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a Aug 03 08:44:44 devstack sudo[105779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:44:44 devstack sudo[105777]: pam_unix(sudo:session): session closed for user root Aug 03 08:44:44 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-616b8258-5a48-45c3-a527-e6504d88608f tempest-VolumeDependencyTests-1073688899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-e46018f8-fcf9-4900-a1d8-c08fccbd5379" returned: 0 in 0.308s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:44:44 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-616b8258-5a48-45c3-a527-e6504d88608f tempest-VolumeDependencyTests-1073688899 None] Lock "cinder-quobyte-e46018f8-fcf9-4900-a1d8-c08fccbd5379" released by "_copy_volume_from_snapshot" :: held 6.933s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:44:44 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-616b8258-5a48-45c3-a527-e6504d88608f tempest-VolumeDependencyTests-1073688899 None] Lock "cinder-quobyte-db77f550-d390-434b-8115-37b701c9c8bd-e46018f8-fcf9-4900-a1d8-c08fccbd5379" released by "_create_volume_from_snapshot" :: held 7.022s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:44:44 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-616b8258-5a48-45c3-a527-e6504d88608f tempest-VolumeDependencyTests-1073688899 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.037s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:44:44 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-616b8258-5a48-45c3-a527-e6504d88608f tempest-VolumeDependencyTests-1073688899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d4d2bc00-207e-46fb-a377-01d1df0ab69c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e46018f8-fcf9-4900-a1d8-c08fccbd5379', 'volume_size': 1, 'snapshot_id': 'db77f550-d390-434b-8115-37b701c9c8bd'}' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:44:44 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-616b8258-5a48-45c3-a527-e6504d88608f tempest-VolumeDependencyTests-1073688899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee131320-3c62-44d7-a543-4a8114efa8bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:44:44 devstack cinder-volume[88899]: INFO cinder.volume.flows.manager.create_volume [None req-616b8258-5a48-45c3-a527-e6504d88608f tempest-VolumeDependencyTests-1073688899 None] Volume volume-e46018f8-fcf9-4900-a1d8-c08fccbd5379 (e46018f8-fcf9-4900-a1d8-c08fccbd5379): created successfully Aug 03 08:44:44 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-616b8258-5a48-45c3-a527-e6504d88608f tempest-VolumeDependencyTests-1073688899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee131320-3c62-44d7-a543-4a8114efa8bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:44:44 devstack sudo[105779]: pam_unix(sudo:session): session closed for user root Aug 03 08:44:44 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-616b8258-5a48-45c3-a527-e6504d88608f tempest-VolumeDependencyTests-1073688899 None] Flow 'volume_create_manager' (44ff50ea-a4f8-41c2-a187-c547a10adef4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:44:44 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-b618e9e6-7481-484c-bea2-a913a97fa347 tempest-VolumesGetTest-1176098524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a" returned: 0 in 0.368s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:44:44 devstack cinder-volume[88899]: DEBUG cinder.manager [None req-b618e9e6-7481-484c-bea2-a913a97fa347 tempest-VolumesGetTest-1176098524 None] Notifying Schedulers of capabilities ... {{(pid=88899) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 08:44:44 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-b618e9e6-7481-484c-bea2-a913a97fa347 tempest-VolumesGetTest-1176098524 None] Deleted volume successfully. Aug 03 08:44:44 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-616b8258-5a48-45c3-a527-e6504d88608f tempest-VolumeDependencyTests-1073688899 None] Created volume successfully. Aug 03 08:44:44 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-b618e9e6-7481-484c-bea2-a913a97fa347 tempest-VolumesGetTest-1176098524 None] Lock "cinder-05bbb02d-4373-4cf9-9175-e03927f03823-delete_volume" released by "delete_volume" :: held 2.426s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:44:45 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-e8875a38-2a14-4ce8-a3c5-57e95be6000c tempest-VolumeDependencyTests-1073688899 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:44:45 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-e8875a38-2a14-4ce8-a3c5-57e95be6000c tempest-VolumeDependencyTests-1073688899 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:44:45 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-e8875a38-2a14-4ce8-a3c5-57e95be6000c tempest-VolumeDependencyTests-1073688899 None] Creating offline snapshot db51ea83-ee57-4e9e-b0f3-65e6e31570dc of volume e46018f8-fcf9-4900-a1d8-c08fccbd5379 {{(pid=88899) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 03 08:44:45 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[98a2e6fe-cdff-4ddc-8d02-21c0940c493d]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:44:45 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-e8875a38-2a14-4ce8-a3c5-57e95be6000c tempest-VolumeDependencyTests-1073688899 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-e46018f8-fcf9-4900-a1d8-c08fccbd5379 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:44:45 devstack sudo[105783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-e46018f8-fcf9-4900-a1d8-c08fccbd5379 Aug 03 08:44:45 devstack sudo[105783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:44:45 devstack cinder-volume[88899]: DEBUG cinder.volume.flows.manager.create_volume [None req-d6cbce6c-f739-4dae-a3d4-b103ed995d1d tempest-VolumesGetTest-1176098524 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88899) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 08:44:45 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-d6cbce6c-f739-4dae-a3d4-b103ed995d1d tempest-VolumesGetTest-1176098524 None] Flow 'volume_create_manager' (df308a18-e0f0-4807-94eb-8e8111154dcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:44:45 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-d6cbce6c-f739-4dae-a3d4-b103ed995d1d tempest-VolumesGetTest-1176098524 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e61f760-1112-4943-a80c-989f613d5010) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:44:45 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-d6cbce6c-f739-4dae-a3d4-b103ed995d1d tempest-VolumesGetTest-1176098524 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e61f760-1112-4943-a80c-989f613d5010) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:44:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-997578555',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b891511d-e5f7-4909-842f-e479e44868c1,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='070ec6e114534bca93d5d121647b843c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:44:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:44:46Z,use_quota=True,user_id='e38f947f25c6490eb48ca43abf9ef753',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8bde7129-1dc4-42ab-b852-ab32c61b4921),volume_type_id=8bde7129-1dc4-42ab-b852-ab32c61b4921)' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:44:45 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-d6cbce6c-f739-4dae-a3d4-b103ed995d1d tempest-VolumesGetTest-1176098524 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b98e68e2-3a82-4501-9a10-42a918b12cd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:44:45 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-d6cbce6c-f739-4dae-a3d4-b103ed995d1d tempest-VolumesGetTest-1176098524 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b98e68e2-3a82-4501-9a10-42a918b12cd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:44:45 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-d6cbce6c-f739-4dae-a3d4-b103ed995d1d tempest-VolumesGetTest-1176098524 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (31c1e5c2-bcc8-4627-9582-6b0426629572) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:44:45 devstack cinder-volume[88899]: DEBUG cinder.image.glance [None req-d6cbce6c-f739-4dae-a3d4-b103ed995d1d tempest-VolumesGetTest-1176098524 None] Creating Keystone auth plugin from conf {{(pid=88899) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Aug 03 08:44:45 devstack sudo[105783]: pam_unix(sudo:session): session closed for user root Aug 03 08:44:45 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-e8875a38-2a14-4ce8-a3c5-57e95be6000c tempest-VolumeDependencyTests-1073688899 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-e46018f8-fcf9-4900-a1d8-c08fccbd5379" returned: 0 in 0.483s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:44:45 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-e8875a38-2a14-4ce8-a3c5-57e95be6000c tempest-VolumeDependencyTests-1073688899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-e46018f8-fcf9-4900-a1d8-c08fccbd5379,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-e46018f8-fcf9-4900-a1d8-c08fccbd5379.db51ea83-ee57-4e9e-b0f3-65e6e31570dc 1G {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:44:45 devstack sudo[105788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-e46018f8-fcf9-4900-a1d8-c08fccbd5379,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-e46018f8-fcf9-4900-a1d8-c08fccbd5379.db51ea83-ee57-4e9e-b0f3-65e6e31570dc 1G Aug 03 08:44:45 devstack sudo[105788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:44:46 devstack sudo[105788]: pam_unix(sudo:session): session closed for user root Aug 03 08:44:46 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-e8875a38-2a14-4ce8-a3c5-57e95be6000c tempest-VolumeDependencyTests-1073688899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-e46018f8-fcf9-4900-a1d8-c08fccbd5379,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-e46018f8-fcf9-4900-a1d8-c08fccbd5379.db51ea83-ee57-4e9e-b0f3-65e6e31570dc 1G" returned: 0 in 0.517s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:44:46 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-e8875a38-2a14-4ce8-a3c5-57e95be6000c tempest-VolumeDependencyTests-1073688899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e46018f8-fcf9-4900-a1d8-c08fccbd5379 -F qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-e46018f8-fcf9-4900-a1d8-c08fccbd5379.db51ea83-ee57-4e9e-b0f3-65e6e31570dc {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:44:46 devstack sudo[105794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e46018f8-fcf9-4900-a1d8-c08fccbd5379 -F qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-e46018f8-fcf9-4900-a1d8-c08fccbd5379.db51ea83-ee57-4e9e-b0f3-65e6e31570dc Aug 03 08:44:46 devstack sudo[105794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:44:46 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-d6cbce6c-f739-4dae-a3d4-b103ed995d1d tempest-VolumesGetTest-1176098524 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (31c1e5c2-bcc8-4627-9582-6b0426629572) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'b891511d-e5f7-4909-842f-e479e44868c1', 'volume_name': 'volume-b891511d-e5f7-4909-842f-e479e44868c1', 'volume_size': 1, 'image_id': '37045a76-b9b1-4156-b15f-85c62a8616c3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/37045a76-b9b1-4156-b15f-85c62a8616c3', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'adee82974e9f41769efcb3f4a0eef199', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '37045a76-b9b1-4156-b15f-85c62a8616c3', 'created_at': datetime.datetime(2026, 8, 3, 6, 23, 4, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 3, 6, 23, 6, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/37045a76-b9b1-4156-b15f-85c62a8616c3/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:44:46 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-d6cbce6c-f739-4dae-a3d4-b103ed995d1d tempest-VolumesGetTest-1176098524 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80e8b5df-2b44-4554-ab8d-0cdc9a4d231a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:44:46 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-d6cbce6c-f739-4dae-a3d4-b103ed995d1d tempest-VolumesGetTest-1176098524 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80e8b5df-2b44-4554-ab8d-0cdc9a4d231a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:44:46 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-d6cbce6c-f739-4dae-a3d4-b103ed995d1d tempest-VolumesGetTest-1176098524 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d730168a-5e10-40a5-9960-640c01b7dff5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:44:46 devstack cinder-volume[88899]: INFO cinder.volume.flows.manager.create_volume [None req-d6cbce6c-f739-4dae-a3d4-b103ed995d1d tempest-VolumesGetTest-1176098524 None] Volume b891511d-e5f7-4909-842f-e479e44868c1: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-b891511d-e5f7-4909-842f-e479e44868c1', 'volume_size': 1, 'image_id': '37045a76-b9b1-4156-b15f-85c62a8616c3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/37045a76-b9b1-4156-b15f-85c62a8616c3', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'adee82974e9f41769efcb3f4a0eef199', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '37045a76-b9b1-4156-b15f-85c62a8616c3', 'created_at': datetime.datetime(2026, 8, 3, 6, 23, 4, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 3, 6, 23, 6, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/37045a76-b9b1-4156-b15f-85c62a8616c3/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Aug 03 08:44:46 devstack cinder-volume[88899]: DEBUG cinder.volume.flows.manager.create_volume [None req-d6cbce6c-f739-4dae-a3d4-b103ed995d1d tempest-VolumesGetTest-1176098524 None] Trying to clone b891511d-e5f7-4909-842f-e479e44868c1 from image 37045a76-b9b1-4156-b15f-85c62a8616c3 at location (None, [{'url': 'file:///opt/stack/data/glance/images/37045a76-b9b1-4156-b15f-85c62a8616c3', 'metadata': {}}]). {{(pid=88899) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Aug 03 08:44:46 devstack sudo[105794]: pam_unix(sudo:session): session closed for user root Aug 03 08:44:46 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-e8875a38-2a14-4ce8-a3c5-57e95be6000c tempest-VolumeDependencyTests-1073688899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e46018f8-fcf9-4900-a1d8-c08fccbd5379 -F qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-e46018f8-fcf9-4900-a1d8-c08fccbd5379.db51ea83-ee57-4e9e-b0f3-65e6e31570dc" returned: 0 in 0.383s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:44:46 devstack cinder-volume[88899]: WARNING cinder.volume.drivers.remotefs [None req-e8875a38-2a14-4ce8-a3c5-57e95be6000c tempest-VolumeDependencyTests-1073688899 None] /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-e46018f8-fcf9-4900-a1d8-c08fccbd5379.db51ea83-ee57-4e9e-b0f3-65e6e31570dc is being set with open permissions: ugo+rw Aug 03 08:44:46 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-e8875a38-2a14-4ce8-a3c5-57e95be6000c tempest-VolumeDependencyTests-1073688899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-e46018f8-fcf9-4900-a1d8-c08fccbd5379.db51ea83-ee57-4e9e-b0f3-65e6e31570dc {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:44:46 devstack sudo[105799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-e46018f8-fcf9-4900-a1d8-c08fccbd5379.db51ea83-ee57-4e9e-b0f3-65e6e31570dc Aug 03 08:44:46 devstack sudo[105799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:44:46 devstack cinder-volume[88899]: DEBUG cinder.image.image_utils [None req-d6cbce6c-f739-4dae-a3d4-b103ed995d1d tempest-VolumesGetTest-1176098524 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_37045a76-b9b1-4156-b15f-85c62a8616c3_x885o289devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=88899) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Aug 03 08:44:46 devstack cinder-volume[88899]: INFO cinder.image.image_utils [None req-d6cbce6c-f739-4dae-a3d4-b103ed995d1d tempest-VolumesGetTest-1176098524 None] Image download 20.69 MB at 20.69 MB/s Aug 03 08:44:47 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb0d8d64-5eca-4e3d-b15f-db06e195ecd2]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:44:47 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-d6cbce6c-f739-4dae-a3d4-b103ed995d1d tempest-VolumesGetTest-1176098524 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_37045a76-b9b1-4156-b15f-85c62a8616c3_x885o289devstack@QuobyteHD {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:44:47 devstack sudo[105802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_37045a76-b9b1-4156-b15f-85c62a8616c3_x885o289devstack@QuobyteHD Aug 03 08:44:47 devstack sudo[105802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:44:47 devstack sudo[105799]: pam_unix(sudo:session): session closed for user root Aug 03 08:44:47 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-e8875a38-2a14-4ce8-a3c5-57e95be6000c tempest-VolumeDependencyTests-1073688899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-e46018f8-fcf9-4900-a1d8-c08fccbd5379.db51ea83-ee57-4e9e-b0f3-65e6e31570dc" returned: 0 in 0.359s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:44:47 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-e8875a38-2a14-4ce8-a3c5-57e95be6000c tempest-VolumeDependencyTests-1073688899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-e46018f8-fcf9-4900-a1d8-c08fccbd5379.info {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:44:47 devstack sudo[105805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-e46018f8-fcf9-4900-a1d8-c08fccbd5379.info Aug 03 08:44:47 devstack sudo[105805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:44:47 devstack cinder-volume[88899]: DEBUG cinder.volume.flows.manager.create_volume [None req-6a63ac61-969f-46eb-ab91-fe8c95d69a30 tempest-CreateVolumesFromSnapshotTest-499945752 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88899) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 08:44:47 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-6a63ac61-969f-46eb-ab91-fe8c95d69a30 tempest-CreateVolumesFromSnapshotTest-499945752 None] Flow 'volume_create_manager' (26518a39-1878-43d7-9da4-ce33637e03c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:44:47 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-6a63ac61-969f-46eb-ab91-fe8c95d69a30 tempest-CreateVolumesFromSnapshotTest-499945752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e47e4650-47da-4e1e-9a43-62be86821e43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:44:47 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-6a63ac61-969f-46eb-ab91-fe8c95d69a30 tempest-CreateVolumesFromSnapshotTest-499945752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e47e4650-47da-4e1e-9a43-62be86821e43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:44:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-893204658',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=921f6804-dbe4-483c-8f82-244aad495afb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9487a33641d4d31bb388ed345e2cba1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:44:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:44:47Z,use_quota=True,user_id='dbed2458e8bb45e183e7c8ee6f212513',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8bde7129-1dc4-42ab-b852-ab32c61b4921),volume_type_id=8bde7129-1dc4-42ab-b852-ab32c61b4921)' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:44:47 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-6a63ac61-969f-46eb-ab91-fe8c95d69a30 tempest-CreateVolumesFromSnapshotTest-499945752 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61415e65-6c08-4fb5-ba54-c6bc5c895d58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:44:47 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-6a63ac61-969f-46eb-ab91-fe8c95d69a30 tempest-CreateVolumesFromSnapshotTest-499945752 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61415e65-6c08-4fb5-ba54-c6bc5c895d58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:44:47 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-6a63ac61-969f-46eb-ab91-fe8c95d69a30 tempest-CreateVolumesFromSnapshotTest-499945752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3bc46434-b1de-4d80-9534-bb099ef8fbef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:44:47 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-6a63ac61-969f-46eb-ab91-fe8c95d69a30 tempest-CreateVolumesFromSnapshotTest-499945752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3bc46434-b1de-4d80-9534-bb099ef8fbef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '921f6804-dbe4-483c-8f82-244aad495afb', 'volume_name': 'volume-921f6804-dbe4-483c-8f82-244aad495afb', 'volume_size': 1}' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:44:47 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-6a63ac61-969f-46eb-ab91-fe8c95d69a30 tempest-CreateVolumesFromSnapshotTest-499945752 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4fb7b6d9-8b24-49c3-bc46-83e0a44af13f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:44:47 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-6a63ac61-969f-46eb-ab91-fe8c95d69a30 tempest-CreateVolumesFromSnapshotTest-499945752 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4fb7b6d9-8b24-49c3-bc46-83e0a44af13f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:44:47 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-6a63ac61-969f-46eb-ab91-fe8c95d69a30 tempest-CreateVolumesFromSnapshotTest-499945752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd7a8d68-63b2-4c05-9915-f6555502473d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:44:47 devstack cinder-volume[88899]: INFO cinder.volume.flows.manager.create_volume [None req-6a63ac61-969f-46eb-ab91-fe8c95d69a30 tempest-CreateVolumesFromSnapshotTest-499945752 None] Volume 921f6804-dbe4-483c-8f82-244aad495afb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-921f6804-dbe4-483c-8f82-244aad495afb', 'volume_size': 1} Aug 03 08:44:47 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-6a63ac61-969f-46eb-ab91-fe8c95d69a30 tempest-CreateVolumesFromSnapshotTest-499945752 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:44:47 devstack sudo[105802]: pam_unix(sudo:session): session closed for user root Aug 03 08:44:47 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-d6cbce6c-f739-4dae-a3d4-b103ed995d1d tempest-VolumesGetTest-1176098524 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_37045a76-b9b1-4156-b15f-85c62a8616c3_x885o289devstack@QuobyteHD" returned: 0 in 0.414s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:44:47 devstack cinder-volume[88899]: DEBUG cinder.image.image_utils [None req-d6cbce6c-f739-4dae-a3d4-b103ed995d1d tempest-VolumesGetTest-1176098524 None] Temporary image 37045a76-b9b1-4156-b15f-85c62a8616c3 is fetched for user e38f947f25c6490eb48ca43abf9ef753. {{(pid=88899) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Aug 03 08:44:47 devstack sudo[105805]: pam_unix(sudo:session): session closed for user root Aug 03 08:44:47 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-e8875a38-2a14-4ce8-a3c5-57e95be6000c tempest-VolumeDependencyTests-1073688899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-e46018f8-fcf9-4900-a1d8-c08fccbd5379.info" returned: 0 in 0.269s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:44:47 devstack cinder-volume[88899]: WARNING cinder.volume.drivers.remotefs [None req-e8875a38-2a14-4ce8-a3c5-57e95be6000c tempest-VolumeDependencyTests-1073688899 None] /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-e46018f8-fcf9-4900-a1d8-c08fccbd5379.info is being set with open permissions: ugo+rw Aug 03 08:44:47 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-e8875a38-2a14-4ce8-a3c5-57e95be6000c tempest-VolumeDependencyTests-1073688899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-e46018f8-fcf9-4900-a1d8-c08fccbd5379.info {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:44:47 devstack sudo[105811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-e46018f8-fcf9-4900-a1d8-c08fccbd5379.info Aug 03 08:44:47 devstack sudo[105811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:44:47 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[1291fb6f-7455-4aa0-bb61-f3dc527bd958]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:44:47 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-d6cbce6c-f739-4dae-a3d4-b103ed995d1d tempest-VolumesGetTest-1176098524 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_37045a76-b9b1-4156-b15f-85c62a8616c3_x885o289devstack@QuobyteHD {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:44:47 devstack sudo[105813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_37045a76-b9b1-4156-b15f-85c62a8616c3_x885o289devstack@QuobyteHD Aug 03 08:44:47 devstack sudo[105813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:44:47 devstack sudo[105811]: pam_unix(sudo:session): session closed for user root Aug 03 08:44:47 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-e8875a38-2a14-4ce8-a3c5-57e95be6000c tempest-VolumeDependencyTests-1073688899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-e46018f8-fcf9-4900-a1d8-c08fccbd5379.info" returned: 0 in 0.273s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:44:47 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-e8875a38-2a14-4ce8-a3c5-57e95be6000c tempest-VolumeDependencyTests-1073688899 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.403s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:44:47 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-6a63ac61-969f-46eb-ab91-fe8c95d69a30 tempest-CreateVolumesFromSnapshotTest-499945752 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.398s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:44:47 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-6a63ac61-969f-46eb-ab91-fe8c95d69a30 tempest-CreateVolumesFromSnapshotTest-499945752 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:44:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-893204658',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=921f6804-dbe4-483c-8f82-244aad495afb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9487a33641d4d31bb388ed345e2cba1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:44:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:44:47Z,use_quota=True,user_id='dbed2458e8bb45e183e7c8ee6f212513',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8bde7129-1dc4-42ab-b852-ab32c61b4921),volume_type_id=8bde7129-1dc4-42ab-b852-ab32c61b4921)}" {{(pid=88899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 08:44:47 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-6a63ac61-969f-46eb-ab91-fe8c95d69a30 tempest-CreateVolumesFromSnapshotTest-499945752 None] Creating volume 921f6804-dbe4-483c-8f82-244aad495afb {{(pid=88899) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 08:44:47 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-6a63ac61-969f-46eb-ab91-fe8c95d69a30 tempest-CreateVolumesFromSnapshotTest-499945752 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:44:47 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-6a63ac61-969f-46eb-ab91-fe8c95d69a30 tempest-CreateVolumesFromSnapshotTest-499945752 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:44:47 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-6a63ac61-969f-46eb-ab91-fe8c95d69a30 tempest-CreateVolumesFromSnapshotTest-499945752 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:44:47 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-6a63ac61-969f-46eb-ab91-fe8c95d69a30 tempest-CreateVolumesFromSnapshotTest-499945752 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:44:47 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-6a63ac61-969f-46eb-ab91-fe8c95d69a30 tempest-CreateVolumesFromSnapshotTest-499945752 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:44:47 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-6a63ac61-969f-46eb-ab91-fe8c95d69a30 tempest-CreateVolumesFromSnapshotTest-499945752 None] Selected osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385 as target Quobyte volume. {{(pid=88899) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 08:44:47 devstack cinder-volume[88899]: INFO cinder.volume.drivers.remotefs [None req-6a63ac61-969f-46eb-ab91-fe8c95d69a30 tempest-CreateVolumesFromSnapshotTest-499945752 None] casted to osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385 Aug 03 08:44:47 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-6a63ac61-969f-46eb-ab91-fe8c95d69a30 tempest-CreateVolumesFromSnapshotTest-499945752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-921f6804-dbe4-483c-8f82-244aad495afb 1073741824 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:44:47 devstack sudo[105816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-921f6804-dbe4-483c-8f82-244aad495afb 1073741824 Aug 03 08:44:47 devstack sudo[105816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:44:47 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-e8875a38-2a14-4ce8-a3c5-57e95be6000c tempest-VolumeDependencyTests-1073688899 None] Create snapshot completed successfully Aug 03 08:44:47 devstack sudo[105813]: pam_unix(sudo:session): session closed for user root Aug 03 08:44:47 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-d6cbce6c-f739-4dae-a3d4-b103ed995d1d tempest-VolumesGetTest-1176098524 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_37045a76-b9b1-4156-b15f-85c62a8616c3_x885o289devstack@QuobyteHD" returned: 0 in 0.348s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:44:47 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-d6cbce6c-f739-4dae-a3d4-b103ed995d1d tempest-VolumesGetTest-1176098524 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:44:48 devstack sudo[105816]: pam_unix(sudo:session): session closed for user root Aug 03 08:44:48 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-6a63ac61-969f-46eb-ab91-fe8c95d69a30 tempest-CreateVolumesFromSnapshotTest-499945752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-921f6804-dbe4-483c-8f82-244aad495afb 1073741824" returned: 0 in 0.463s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:44:48 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-6a63ac61-969f-46eb-ab91-fe8c95d69a30 tempest-CreateVolumesFromSnapshotTest-499945752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-921f6804-dbe4-483c-8f82-244aad495afb {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:44:48 devstack sudo[105827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-921f6804-dbe4-483c-8f82-244aad495afb Aug 03 08:44:48 devstack sudo[105827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:44:48 devstack sudo[105827]: pam_unix(sudo:session): session closed for user root Aug 03 08:44:48 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-6a63ac61-969f-46eb-ab91-fe8c95d69a30 tempest-CreateVolumesFromSnapshotTest-499945752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-921f6804-dbe4-483c-8f82-244aad495afb" returned: 0 in 0.243s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:44:48 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-6a63ac61-969f-46eb-ab91-fe8c95d69a30 tempest-CreateVolumesFromSnapshotTest-499945752 None] <== create_volume: return (773ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'} {{(pid=88899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 08:44:48 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-6a63ac61-969f-46eb-ab91-fe8c95d69a30 tempest-CreateVolumesFromSnapshotTest-499945752 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.776s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:44:48 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-d6cbce6c-f739-4dae-a3d4-b103ed995d1d tempest-VolumesGetTest-1176098524 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.693s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:44:48 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-d6cbce6c-f739-4dae-a3d4-b103ed995d1d tempest-VolumesGetTest-1176098524 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:44:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-997578555',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b891511d-e5f7-4909-842f-e479e44868c1,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='070ec6e114534bca93d5d121647b843c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:44:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:44:46Z,use_quota=True,user_id='e38f947f25c6490eb48ca43abf9ef753',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8bde7129-1dc4-42ab-b852-ab32c61b4921),volume_type_id=8bde7129-1dc4-42ab-b852-ab32c61b4921)}" {{(pid=88899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 08:44:48 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-d6cbce6c-f739-4dae-a3d4-b103ed995d1d tempest-VolumesGetTest-1176098524 None] Creating volume b891511d-e5f7-4909-842f-e479e44868c1 {{(pid=88899) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 08:44:48 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-d6cbce6c-f739-4dae-a3d4-b103ed995d1d tempest-VolumesGetTest-1176098524 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:44:48 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-d6cbce6c-f739-4dae-a3d4-b103ed995d1d tempest-VolumesGetTest-1176098524 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:44:48 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-d6cbce6c-f739-4dae-a3d4-b103ed995d1d tempest-VolumesGetTest-1176098524 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:44:48 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-d6cbce6c-f739-4dae-a3d4-b103ed995d1d tempest-VolumesGetTest-1176098524 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:44:48 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-d6cbce6c-f739-4dae-a3d4-b103ed995d1d tempest-VolumesGetTest-1176098524 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:44:48 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-d6cbce6c-f739-4dae-a3d4-b103ed995d1d tempest-VolumesGetTest-1176098524 None] Selected osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385 as target Quobyte volume. {{(pid=88899) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 08:44:48 devstack cinder-volume[88899]: INFO cinder.volume.drivers.remotefs [None req-d6cbce6c-f739-4dae-a3d4-b103ed995d1d tempest-VolumesGetTest-1176098524 None] casted to osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385 Aug 03 08:44:48 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-d6cbce6c-f739-4dae-a3d4-b103ed995d1d tempest-VolumesGetTest-1176098524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-b891511d-e5f7-4909-842f-e479e44868c1 1073741824 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:44:48 devstack sudo[105830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-b891511d-e5f7-4909-842f-e479e44868c1 1073741824 Aug 03 08:44:48 devstack sudo[105830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:44:48 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-6a63ac61-969f-46eb-ab91-fe8c95d69a30 tempest-CreateVolumesFromSnapshotTest-499945752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd7a8d68-63b2-4c05-9915-f6555502473d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-921f6804-dbe4-483c-8f82-244aad495afb', 'volume_size': 1}' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:44:48 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-6a63ac61-969f-46eb-ab91-fe8c95d69a30 tempest-CreateVolumesFromSnapshotTest-499945752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6de4063d-78d3-4df1-842a-e6f3a8574c18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:44:48 devstack cinder-volume[88899]: INFO cinder.volume.flows.manager.create_volume [None req-6a63ac61-969f-46eb-ab91-fe8c95d69a30 tempest-CreateVolumesFromSnapshotTest-499945752 None] Volume volume-921f6804-dbe4-483c-8f82-244aad495afb (921f6804-dbe4-483c-8f82-244aad495afb): created successfully Aug 03 08:44:48 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-6a63ac61-969f-46eb-ab91-fe8c95d69a30 tempest-CreateVolumesFromSnapshotTest-499945752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6de4063d-78d3-4df1-842a-e6f3a8574c18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:44:48 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-6a63ac61-969f-46eb-ab91-fe8c95d69a30 tempest-CreateVolumesFromSnapshotTest-499945752 None] Flow 'volume_create_manager' (26518a39-1878-43d7-9da4-ce33637e03c7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:44:48 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-6a63ac61-969f-46eb-ab91-fe8c95d69a30 tempest-CreateVolumesFromSnapshotTest-499945752 None] Created volume successfully. Aug 03 08:44:49 devstack sudo[105830]: pam_unix(sudo:session): session closed for user root Aug 03 08:44:49 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-d6cbce6c-f739-4dae-a3d4-b103ed995d1d tempest-VolumesGetTest-1176098524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-b891511d-e5f7-4909-842f-e479e44868c1 1073741824" returned: 0 in 0.456s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:44:49 devstack cinder-volume[88899]: DEBUG cinder.volume.flows.manager.create_volume [None req-7de948fe-0978-42f7-9a61-d98555670986 tempest-VolumeDependencyTests-1073688899 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88899) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 08:44:49 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-d6cbce6c-f739-4dae-a3d4-b103ed995d1d tempest-VolumesGetTest-1176098524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-b891511d-e5f7-4909-842f-e479e44868c1 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:44:49 devstack sudo[105836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-b891511d-e5f7-4909-842f-e479e44868c1 Aug 03 08:44:49 devstack sudo[105836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:44:49 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-7de948fe-0978-42f7-9a61-d98555670986 tempest-VolumeDependencyTests-1073688899 None] Flow 'volume_create_manager' (befef532-c25c-45bd-9155-5b2e53ad310e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:44:49 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-7de948fe-0978-42f7-9a61-d98555670986 tempest-VolumeDependencyTests-1073688899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99934b67-2c8e-404f-b6f9-d7009790a20f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:44:49 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-7de948fe-0978-42f7-9a61-d98555670986 tempest-VolumeDependencyTests-1073688899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99934b67-2c8e-404f-b6f9-d7009790a20f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:44:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-724929531',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=33af9960-696c-415a-b163-e48848a09396,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c2f62930ea114d94aae304e8ed339f9c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:44:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=db51ea83-ee57-4e9e-b0f3-65e6e31570dc,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:44:49Z,use_quota=True,user_id='de61709cf33340bf9e956c0545be3966',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8bde7129-1dc4-42ab-b852-ab32c61b4921),volume_type_id=8bde7129-1dc4-42ab-b852-ab32c61b4921)' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:44:49 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-7de948fe-0978-42f7-9a61-d98555670986 tempest-VolumeDependencyTests-1073688899 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b4a4c56-297d-4566-8f52-8027654e3275) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:44:49 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-7de948fe-0978-42f7-9a61-d98555670986 tempest-VolumeDependencyTests-1073688899 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b4a4c56-297d-4566-8f52-8027654e3275) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:44:49 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-7de948fe-0978-42f7-9a61-d98555670986 tempest-VolumeDependencyTests-1073688899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (65419043-9675-4f00-b2e4-78fb8c05df53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:44:49 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-7de948fe-0978-42f7-9a61-d98555670986 tempest-VolumeDependencyTests-1073688899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (65419043-9675-4f00-b2e4-78fb8c05df53) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '33af9960-696c-415a-b163-e48848a09396', 'volume_name': 'volume-33af9960-696c-415a-b163-e48848a09396', 'volume_size': 1, 'snapshot_id': 'db51ea83-ee57-4e9e-b0f3-65e6e31570dc'}' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:44:49 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-7de948fe-0978-42f7-9a61-d98555670986 tempest-VolumeDependencyTests-1073688899 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6d67b7d-135d-497c-a44b-6d09ea44d8e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:44:49 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-7de948fe-0978-42f7-9a61-d98555670986 tempest-VolumeDependencyTests-1073688899 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6d67b7d-135d-497c-a44b-6d09ea44d8e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:44:49 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-7de948fe-0978-42f7-9a61-d98555670986 tempest-VolumeDependencyTests-1073688899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5cb580f8-3d26-4478-bf4a-6dff163d081b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:44:49 devstack cinder-volume[88899]: INFO cinder.volume.flows.manager.create_volume [None req-7de948fe-0978-42f7-9a61-d98555670986 tempest-VolumeDependencyTests-1073688899 None] Volume 33af9960-696c-415a-b163-e48848a09396: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-33af9960-696c-415a-b163-e48848a09396', 'volume_size': 1, 'snapshot_id': 'db51ea83-ee57-4e9e-b0f3-65e6e31570dc'} Aug 03 08:44:49 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-7de948fe-0978-42f7-9a61-d98555670986 tempest-VolumeDependencyTests-1073688899 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:44:49 devstack sudo[105836]: pam_unix(sudo:session): session closed for user root Aug 03 08:44:49 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-d6cbce6c-f739-4dae-a3d4-b103ed995d1d tempest-VolumesGetTest-1176098524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-b891511d-e5f7-4909-842f-e479e44868c1" returned: 0 in 0.268s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:44:49 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-d6cbce6c-f739-4dae-a3d4-b103ed995d1d tempest-VolumesGetTest-1176098524 None] <== create_volume: return (779ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'} {{(pid=88899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 08:44:49 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-d6cbce6c-f739-4dae-a3d4-b103ed995d1d tempest-VolumesGetTest-1176098524 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.781s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:44:49 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-7de948fe-0978-42f7-9a61-d98555670986 tempest-VolumeDependencyTests-1073688899 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.162s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:44:49 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-7de948fe-0978-42f7-9a61-d98555670986 tempest-VolumeDependencyTests-1073688899 None] Acquiring lock "cinder-quobyte-db51ea83-ee57-4e9e-b0f3-65e6e31570dc-33af9960-696c-415a-b163-e48848a09396" by "_create_volume_from_snapshot" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:44:49 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-7de948fe-0978-42f7-9a61-d98555670986 tempest-VolumeDependencyTests-1073688899 None] Lock "cinder-quobyte-db51ea83-ee57-4e9e-b0f3-65e6e31570dc-33af9960-696c-415a-b163-e48848a09396" acquired by "_create_volume_from_snapshot" :: waited 0.016s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:44:49 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-7de948fe-0978-42f7-9a61-d98555670986 tempest-VolumeDependencyTests-1073688899 None] Creating volume 33af9960-696c-415a-b163-e48848a09396 from snapshot db51ea83-ee57-4e9e-b0f3-65e6e31570dc {{(pid=88899) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Aug 03 08:44:49 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-7de948fe-0978-42f7-9a61-d98555670986 tempest-VolumeDependencyTests-1073688899 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:44:49 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-7de948fe-0978-42f7-9a61-d98555670986 tempest-VolumeDependencyTests-1073688899 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:44:49 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-7de948fe-0978-42f7-9a61-d98555670986 tempest-VolumeDependencyTests-1073688899 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:44:49 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-7de948fe-0978-42f7-9a61-d98555670986 tempest-VolumeDependencyTests-1073688899 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:44:49 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-7de948fe-0978-42f7-9a61-d98555670986 tempest-VolumeDependencyTests-1073688899 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:44:49 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-7de948fe-0978-42f7-9a61-d98555670986 tempest-VolumeDependencyTests-1073688899 None] Selected osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385 as target Quobyte volume. {{(pid=88899) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 08:44:49 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-7de948fe-0978-42f7-9a61-d98555670986 tempest-VolumeDependencyTests-1073688899 None] Acquiring lock "cinder-quobyte-33af9960-696c-415a-b163-e48848a09396" by "_copy_volume_from_snapshot" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:44:49 devstack cinder-volume[88899]: DEBUG cinder.volume.volume_utils [None req-d6cbce6c-f739-4dae-a3d4-b103ed995d1d tempest-VolumesGetTest-1176098524 None] Attempting download of 37045a76-b9b1-4156-b15f-85c62a8616c3 ((None, [{'url': 'file:///opt/stack/data/glance/images/37045a76-b9b1-4156-b15f-85c62a8616c3', 'metadata': {}}])) to volume b891511d-e5f7-4909-842f-e479e44868c1. {{(pid=88899) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Aug 03 08:44:49 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-7de948fe-0978-42f7-9a61-d98555670986 tempest-VolumeDependencyTests-1073688899 None] Lock "cinder-quobyte-33af9960-696c-415a-b163-e48848a09396" acquired by "_copy_volume_from_snapshot" :: waited 0.028s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:44:49 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-7de948fe-0978-42f7-9a61-d98555670986 tempest-VolumeDependencyTests-1073688899 None] snapshot: db51ea83-ee57-4e9e-b0f3-65e6e31570dc, volume: 33af9960-696c-415a-b163-e48848a09396, {{(pid=88899) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Aug 03 08:44:49 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-7de948fe-0978-42f7-9a61-d98555670986 tempest-VolumeDependencyTests-1073688899 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:44:49 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-7de948fe-0978-42f7-9a61-d98555670986 tempest-VolumeDependencyTests-1073688899 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:44:49 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-7de948fe-0978-42f7-9a61-d98555670986 tempest-VolumeDependencyTests-1073688899 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:44:49 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-7de948fe-0978-42f7-9a61-d98555670986 tempest-VolumeDependencyTests-1073688899 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:44:49 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-7de948fe-0978-42f7-9a61-d98555670986 tempest-VolumeDependencyTests-1073688899 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:44:49 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[02968cac-c6d5-436b-8139-a3b5bf08354e]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:44:49 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-7de948fe-0978-42f7-9a61-d98555670986 tempest-VolumeDependencyTests-1073688899 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-e46018f8-fcf9-4900-a1d8-c08fccbd5379.db51ea83-ee57-4e9e-b0f3-65e6e31570dc {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:44:49 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[6331860c-c893-41c7-b26c-ce5e7fe70059]: (4, 'raw') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:44:49 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-d6cbce6c-f739-4dae-a3d4-b103ed995d1d tempest-VolumesGetTest-1176098524 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_37045a76-b9b1-4156-b15f-85c62a8616c3_ha3o74qh {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:44:49 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-00ee8b4d-6327-4175-bd9c-751979f69a7b tempest-CreateVolumesFromSnapshotTest-499945752 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:44:49 devstack sudo[105840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_37045a76-b9b1-4156-b15f-85c62a8616c3_ha3o74qh Aug 03 08:44:49 devstack sudo[105839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-e46018f8-fcf9-4900-a1d8-c08fccbd5379.db51ea83-ee57-4e9e-b0f3-65e6e31570dc Aug 03 08:44:49 devstack sudo[105840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:44:49 devstack sudo[105839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:44:49 devstack sudo[105840]: pam_unix(sudo:session): session closed for user root Aug 03 08:44:49 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-d6cbce6c-f739-4dae-a3d4-b103ed995d1d tempest-VolumesGetTest-1176098524 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_37045a76-b9b1-4156-b15f-85c62a8616c3_ha3o74qh" returned: 0 in 0.354s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:44:49 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-d6cbce6c-f739-4dae-a3d4-b103ed995d1d tempest-VolumesGetTest-1176098524 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_37045a76-b9b1-4156-b15f-85c62a8616c3_ha3o74qh {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:44:49 devstack sudo[105839]: pam_unix(sudo:session): session closed for user root Aug 03 08:44:49 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-7de948fe-0978-42f7-9a61-d98555670986 tempest-VolumeDependencyTests-1073688899 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-e46018f8-fcf9-4900-a1d8-c08fccbd5379.db51ea83-ee57-4e9e-b0f3-65e6e31570dc" returned: 0 in 0.397s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:44:49 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-7de948fe-0978-42f7-9a61-d98555670986 tempest-VolumeDependencyTests-1073688899 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e46018f8-fcf9-4900-a1d8-c08fccbd5379(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88899) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 03 08:44:49 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cb8acc5-7ef5-42bb-bcdb-4a298ff6dcdb]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:44:49 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-7de948fe-0978-42f7-9a61-d98555670986 tempest-VolumeDependencyTests-1073688899 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-e46018f8-fcf9-4900-a1d8-c08fccbd5379 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:44:49 devstack sudo[105848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_37045a76-b9b1-4156-b15f-85c62a8616c3_ha3o74qh Aug 03 08:44:49 devstack sudo[105848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:44:50 devstack sudo[105849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-e46018f8-fcf9-4900-a1d8-c08fccbd5379 Aug 03 08:44:50 devstack sudo[105849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:44:50 devstack sudo[105848]: pam_unix(sudo:session): session closed for user root Aug 03 08:44:50 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-d6cbce6c-f739-4dae-a3d4-b103ed995d1d tempest-VolumesGetTest-1176098524 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_37045a76-b9b1-4156-b15f-85c62a8616c3_ha3o74qh" returned: 1 in 0.344s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:44:50 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-d6cbce6c-f739-4dae-a3d4-b103ed995d1d tempest-VolumesGetTest-1176098524 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_37045a76-b9b1-4156-b15f-85c62a8616c3_ha3o74qh' failed. Not Retrying. {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 03 08:44:50 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b7c6f1a-756d-4319-980b-92e5f1ecc2db]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:44:50 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-d6cbce6c-f739-4dae-a3d4-b103ed995d1d tempest-VolumesGetTest-1176098524 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_37045a76-b9b1-4156-b15f-85c62a8616c3_x885o289devstack@QuobyteHD {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:44:50 devstack sudo[105849]: pam_unix(sudo:session): session closed for user root Aug 03 08:44:50 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-7de948fe-0978-42f7-9a61-d98555670986 tempest-VolumeDependencyTests-1073688899 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-e46018f8-fcf9-4900-a1d8-c08fccbd5379" returned: 0 in 0.380s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:44:50 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-7de948fe-0978-42f7-9a61-d98555670986 tempest-VolumeDependencyTests-1073688899 None] will copy from snapshot at /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-e46018f8-fcf9-4900-a1d8-c08fccbd5379 {{(pid=88899) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Aug 03 08:44:50 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-7de948fe-0978-42f7-9a61-d98555670986 tempest-VolumeDependencyTests-1073688899 None] Creating direct copy from snapshot {{(pid=88899) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Aug 03 08:44:50 devstack cinder-volume[88899]: DEBUG cinder.utils [None req-7de948fe-0978-42f7-9a61-d98555670986 tempest-VolumeDependencyTests-1073688899 None] Path /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-33af9960-696c-415a-b163-e48848a09396 not found in is_blk_device check {{(pid=88899) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Aug 03 08:44:50 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-7de948fe-0978-42f7-9a61-d98555670986 tempest-VolumeDependencyTests-1073688899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-e46018f8-fcf9-4900-a1d8-c08fccbd5379 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-33af9960-696c-415a-b163-e48848a09396 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:44:50 devstack sudo[105855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_37045a76-b9b1-4156-b15f-85c62a8616c3_x885o289devstack@QuobyteHD Aug 03 08:44:50 devstack sudo[105858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-e46018f8-fcf9-4900-a1d8-c08fccbd5379 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-33af9960-696c-415a-b163-e48848a09396 Aug 03 08:44:50 devstack sudo[105855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:44:50 devstack sudo[105858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:44:50 devstack sudo[105855]: pam_unix(sudo:session): session closed for user root Aug 03 08:44:50 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-d6cbce6c-f739-4dae-a3d4-b103ed995d1d tempest-VolumesGetTest-1176098524 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_37045a76-b9b1-4156-b15f-85c62a8616c3_x885o289devstack@QuobyteHD" returned: 0 in 0.322s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:44:50 devstack cinder-volume[88899]: DEBUG cinder.image.image_utils [None req-d6cbce6c-f739-4dae-a3d4-b103ed995d1d tempest-VolumesGetTest-1176098524 None] 37045a76-b9b1-4156-b15f-85c62a8616c3 was qcow2, converting to qcow2 {{(pid=88899) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Aug 03 08:44:50 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-d6cbce6c-f739-4dae-a3d4-b103ed995d1d tempest-VolumesGetTest-1176098524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_37045a76-b9b1-4156-b15f-85c62a8616c3_x885o289devstack@QuobyteHD /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-b891511d-e5f7-4909-842f-e479e44868c1 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:44:50 devstack sudo[105867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_37045a76-b9b1-4156-b15f-85c62a8616c3_x885o289devstack@QuobyteHD /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-b891511d-e5f7-4909-842f-e479e44868c1 Aug 03 08:44:50 devstack sudo[105867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:44:50 devstack sudo[105858]: pam_unix(sudo:session): session closed for user root Aug 03 08:44:50 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-7de948fe-0978-42f7-9a61-d98555670986 tempest-VolumeDependencyTests-1073688899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-e46018f8-fcf9-4900-a1d8-c08fccbd5379 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-33af9960-696c-415a-b163-e48848a09396" returned: 0 in 0.448s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:44:50 devstack cinder-volume[88899]: DEBUG cinder.image.image_utils [None req-7de948fe-0978-42f7-9a61-d98555670986 tempest-VolumeDependencyTests-1073688899 None] Image conversion details: src /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-e46018f8-fcf9-4900-a1d8-c08fccbd5379, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-33af9960-696c-415a-b163-e48848a09396 {{(pid=88899) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 03 08:44:50 devstack cinder-volume[88899]: INFO cinder.image.image_utils [None req-7de948fe-0978-42f7-9a61-d98555670986 tempest-VolumeDependencyTests-1073688899 None] Converted 1024.00 MB image at 1024.00 MB/s Aug 03 08:44:50 devstack cinder-volume[88899]: WARNING cinder.volume.drivers.remotefs [None req-7de948fe-0978-42f7-9a61-d98555670986 tempest-VolumeDependencyTests-1073688899 None] /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-33af9960-696c-415a-b163-e48848a09396 is being set with open permissions: ugo+rw Aug 03 08:44:50 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-7de948fe-0978-42f7-9a61-d98555670986 tempest-VolumeDependencyTests-1073688899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-33af9960-696c-415a-b163-e48848a09396 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:44:50 devstack sudo[105872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-33af9960-696c-415a-b163-e48848a09396 Aug 03 08:44:50 devstack sudo[105872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:44:50 devstack sudo[105872]: pam_unix(sudo:session): session closed for user root Aug 03 08:44:50 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-7de948fe-0978-42f7-9a61-d98555670986 tempest-VolumeDependencyTests-1073688899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-33af9960-696c-415a-b163-e48848a09396" returned: 0 in 0.263s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:44:51 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-7de948fe-0978-42f7-9a61-d98555670986 tempest-VolumeDependencyTests-1073688899 None] Lock "cinder-quobyte-33af9960-696c-415a-b163-e48848a09396" released by "_copy_volume_from_snapshot" :: held 1.597s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:44:51 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-7de948fe-0978-42f7-9a61-d98555670986 tempest-VolumeDependencyTests-1073688899 None] Lock "cinder-quobyte-db51ea83-ee57-4e9e-b0f3-65e6e31570dc-33af9960-696c-415a-b163-e48848a09396" released by "_create_volume_from_snapshot" :: held 1.676s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:44:51 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-7de948fe-0978-42f7-9a61-d98555670986 tempest-VolumeDependencyTests-1073688899 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 1.693s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:44:51 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-00ee8b4d-6327-4175-bd9c-751979f69a7b tempest-CreateVolumesFromSnapshotTest-499945752 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.452s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:44:51 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-00ee8b4d-6327-4175-bd9c-751979f69a7b tempest-CreateVolumesFromSnapshotTest-499945752 None] Creating offline snapshot 60842ba4-5608-4470-b7f0-ffacb342bdf4 of volume 921f6804-dbe4-483c-8f82-244aad495afb {{(pid=88899) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 03 08:44:51 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-7de948fe-0978-42f7-9a61-d98555670986 tempest-VolumeDependencyTests-1073688899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5cb580f8-3d26-4478-bf4a-6dff163d081b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-33af9960-696c-415a-b163-e48848a09396', 'volume_size': 1, 'snapshot_id': 'db51ea83-ee57-4e9e-b0f3-65e6e31570dc'}' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:44:51 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-7de948fe-0978-42f7-9a61-d98555670986 tempest-VolumeDependencyTests-1073688899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fec58df3-f77c-435b-9840-0f99d82a1b7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:44:51 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[556ae254-e9ae-4e14-83cb-44c4476627b4]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:44:51 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-00ee8b4d-6327-4175-bd9c-751979f69a7b tempest-CreateVolumesFromSnapshotTest-499945752 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-921f6804-dbe4-483c-8f82-244aad495afb {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:44:51 devstack cinder-volume[88899]: INFO cinder.volume.flows.manager.create_volume [None req-7de948fe-0978-42f7-9a61-d98555670986 tempest-VolumeDependencyTests-1073688899 None] Volume volume-33af9960-696c-415a-b163-e48848a09396 (33af9960-696c-415a-b163-e48848a09396): created successfully Aug 03 08:44:51 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-7de948fe-0978-42f7-9a61-d98555670986 tempest-VolumeDependencyTests-1073688899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fec58df3-f77c-435b-9840-0f99d82a1b7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:44:51 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-7de948fe-0978-42f7-9a61-d98555670986 tempest-VolumeDependencyTests-1073688899 None] Flow 'volume_create_manager' (befef532-c25c-45bd-9155-5b2e53ad310e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:44:51 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-7de948fe-0978-42f7-9a61-d98555670986 tempest-VolumeDependencyTests-1073688899 None] Created volume successfully. Aug 03 08:44:51 devstack sudo[105877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-921f6804-dbe4-483c-8f82-244aad495afb Aug 03 08:44:51 devstack sudo[105877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:44:51 devstack sudo[105877]: pam_unix(sudo:session): session closed for user root Aug 03 08:44:51 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-00ee8b4d-6327-4175-bd9c-751979f69a7b tempest-CreateVolumesFromSnapshotTest-499945752 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-921f6804-dbe4-483c-8f82-244aad495afb" returned: 0 in 0.388s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:44:51 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-00ee8b4d-6327-4175-bd9c-751979f69a7b tempest-CreateVolumesFromSnapshotTest-499945752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-921f6804-dbe4-483c-8f82-244aad495afb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-921f6804-dbe4-483c-8f82-244aad495afb.60842ba4-5608-4470-b7f0-ffacb342bdf4 1G {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:44:51 devstack sudo[105882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-921f6804-dbe4-483c-8f82-244aad495afb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-921f6804-dbe4-483c-8f82-244aad495afb.60842ba4-5608-4470-b7f0-ffacb342bdf4 1G Aug 03 08:44:51 devstack sudo[105882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:44:51 devstack sudo[105882]: pam_unix(sudo:session): session closed for user root Aug 03 08:44:51 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-00ee8b4d-6327-4175-bd9c-751979f69a7b tempest-CreateVolumesFromSnapshotTest-499945752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-921f6804-dbe4-483c-8f82-244aad495afb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-921f6804-dbe4-483c-8f82-244aad495afb.60842ba4-5608-4470-b7f0-ffacb342bdf4 1G" returned: 0 in 0.417s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:44:51 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-00ee8b4d-6327-4175-bd9c-751979f69a7b tempest-CreateVolumesFromSnapshotTest-499945752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-921f6804-dbe4-483c-8f82-244aad495afb -F qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-921f6804-dbe4-483c-8f82-244aad495afb.60842ba4-5608-4470-b7f0-ffacb342bdf4 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:44:51 devstack cinder-volume[88899]: DEBUG oslo_service.periodic_task [None req-f948fb4a-c4d7-499f-b1bd-8d6be3de0b53 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88899) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 03 08:44:51 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-f948fb4a-c4d7-499f-b1bd-8d6be3de0b53 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:44:51 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-f948fb4a-c4d7-499f-b1bd-8d6be3de0b53 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:44:51 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-f948fb4a-c4d7-499f-b1bd-8d6be3de0b53 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:44:51 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-f948fb4a-c4d7-499f-b1bd-8d6be3de0b53 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:44:51 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-f948fb4a-c4d7-499f-b1bd-8d6be3de0b53 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:44:51 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-f948fb4a-c4d7-499f-b1bd-8d6be3de0b53 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:44:51 devstack sudo[105889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-921f6804-dbe4-483c-8f82-244aad495afb -F qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-921f6804-dbe4-483c-8f82-244aad495afb.60842ba4-5608-4470-b7f0-ffacb342bdf4 Aug 03 08:44:51 devstack sudo[105889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:44:51 devstack sudo[105891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a Aug 03 08:44:51 devstack sudo[105891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:44:52 devstack sudo[105889]: pam_unix(sudo:session): session closed for user root Aug 03 08:44:52 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-00ee8b4d-6327-4175-bd9c-751979f69a7b tempest-CreateVolumesFromSnapshotTest-499945752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-921f6804-dbe4-483c-8f82-244aad495afb -F qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-921f6804-dbe4-483c-8f82-244aad495afb.60842ba4-5608-4470-b7f0-ffacb342bdf4" returned: 0 in 0.343s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:44:52 devstack cinder-volume[88899]: WARNING cinder.volume.drivers.remotefs [None req-00ee8b4d-6327-4175-bd9c-751979f69a7b tempest-CreateVolumesFromSnapshotTest-499945752 None] /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-921f6804-dbe4-483c-8f82-244aad495afb.60842ba4-5608-4470-b7f0-ffacb342bdf4 is being set with open permissions: ugo+rw Aug 03 08:44:52 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-00ee8b4d-6327-4175-bd9c-751979f69a7b tempest-CreateVolumesFromSnapshotTest-499945752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-921f6804-dbe4-483c-8f82-244aad495afb.60842ba4-5608-4470-b7f0-ffacb342bdf4 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:44:52 devstack sudo[105891]: pam_unix(sudo:session): session closed for user root Aug 03 08:44:52 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-f948fb4a-c4d7-499f-b1bd-8d6be3de0b53 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a" returned: 0 in 0.336s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:44:52 devstack cinder-volume[88899]: DEBUG cinder.manager [None req-f948fb4a-c4d7-499f-b1bd-8d6be3de0b53 None None] Notifying Schedulers of capabilities ... {{(pid=88899) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 08:44:52 devstack sudo[105867]: pam_unix(sudo:session): session closed for user root Aug 03 08:44:52 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-d6cbce6c-f739-4dae-a3d4-b103ed995d1d tempest-VolumesGetTest-1176098524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_37045a76-b9b1-4156-b15f-85c62a8616c3_x885o289devstack@QuobyteHD /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-b891511d-e5f7-4909-842f-e479e44868c1" returned: 0 in 1.752s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:44:52 devstack cinder-volume[88899]: DEBUG oslo_service.periodic_task [None req-f948fb4a-c4d7-499f-b1bd-8d6be3de0b53 None None] Running periodic task VolumeManager._thread_info {{(pid=88899) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 03 08:44:52 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-f948fb4a-c4d7-499f-b1bd-8d6be3de0b53 None None] thread count: 28 {{(pid=88899) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 03 08:44:52 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-f948fb4a-c4d7-499f-b1bd-8d6be3de0b53 None None] thread info: [<_MainThread(MainThread, started 132234320248960)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88899) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 03 08:44:52 devstack cinder-volume[88899]: DEBUG cinder.image.image_utils [None req-d6cbce6c-f739-4dae-a3d4-b103ed995d1d tempest-VolumesGetTest-1176098524 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_37045a76-b9b1-4156-b15f-85c62a8616c3_x885o289devstack@QuobyteHD, size 112.00 MB, duration 1.76 sec, destination /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-b891511d-e5f7-4909-842f-e479e44868c1 {{(pid=88899) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 03 08:44:52 devstack cinder-volume[88899]: INFO cinder.image.image_utils [None req-d6cbce6c-f739-4dae-a3d4-b103ed995d1d tempest-VolumesGetTest-1176098524 None] Converted 112.00 MB image at 63.81 MB/s Aug 03 08:44:52 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-d6cbce6c-f739-4dae-a3d4-b103ed995d1d tempest-VolumesGetTest-1176098524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-b891511d-e5f7-4909-842f-e479e44868c1 1G {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:44:52 devstack sudo[105897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-921f6804-dbe4-483c-8f82-244aad495afb.60842ba4-5608-4470-b7f0-ffacb342bdf4 Aug 03 08:44:52 devstack sudo[105897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:44:52 devstack sudo[105899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-b891511d-e5f7-4909-842f-e479e44868c1 1G Aug 03 08:44:52 devstack sudo[105899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:44:52 devstack sudo[105897]: pam_unix(sudo:session): session closed for user root Aug 03 08:44:52 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-00ee8b4d-6327-4175-bd9c-751979f69a7b tempest-CreateVolumesFromSnapshotTest-499945752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-921f6804-dbe4-483c-8f82-244aad495afb.60842ba4-5608-4470-b7f0-ffacb342bdf4" returned: 0 in 0.261s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:44:52 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-00ee8b4d-6327-4175-bd9c-751979f69a7b tempest-CreateVolumesFromSnapshotTest-499945752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-921f6804-dbe4-483c-8f82-244aad495afb.info {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:44:52 devstack sudo[105905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-921f6804-dbe4-483c-8f82-244aad495afb.info Aug 03 08:44:52 devstack sudo[105905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:44:52 devstack sudo[105899]: pam_unix(sudo:session): session closed for user root Aug 03 08:44:52 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-d6cbce6c-f739-4dae-a3d4-b103ed995d1d tempest-VolumesGetTest-1176098524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-b891511d-e5f7-4909-842f-e479e44868c1 1G" returned: 0 in 0.360s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:44:52 devstack cinder-volume[88899]: DEBUG cinder.volume.volume_utils [None req-d6cbce6c-f739-4dae-a3d4-b103ed995d1d tempest-VolumesGetTest-1176098524 None] Downloaded image 37045a76-b9b1-4156-b15f-85c62a8616c3 ((None, [{'url': 'file:///opt/stack/data/glance/images/37045a76-b9b1-4156-b15f-85c62a8616c3', 'metadata': {}}])) to volume b891511d-e5f7-4909-842f-e479e44868c1 successfully. {{(pid=88899) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Aug 03 08:44:52 devstack cinder-volume[88899]: DEBUG cinder.image.image_utils [None req-d6cbce6c-f739-4dae-a3d4-b103ed995d1d tempest-VolumesGetTest-1176098524 None] Temporary image 37045a76-b9b1-4156-b15f-85c62a8616c3 for user e38f947f25c6490eb48ca43abf9ef753 is deleted. {{(pid=88899) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Aug 03 08:44:52 devstack cinder-volume[88899]: DEBUG cinder.volume.volume_utils [None req-d6cbce6c-f739-4dae-a3d4-b103ed995d1d tempest-VolumesGetTest-1176098524 None] Marking volume b891511d-e5f7-4909-842f-e479e44868c1 as bootable. {{(pid=88899) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Aug 03 08:44:52 devstack cinder-volume[88899]: DEBUG cinder.volume.flows.manager.create_volume [None req-d6cbce6c-f739-4dae-a3d4-b103ed995d1d tempest-VolumesGetTest-1176098524 None] Copying metadata from image 37045a76-b9b1-4156-b15f-85c62a8616c3 to b891511d-e5f7-4909-842f-e479e44868c1. {{(pid=88899) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Aug 03 08:44:52 devstack cinder-volume[88899]: DEBUG cinder.volume.flows.manager.create_volume [None req-d6cbce6c-f739-4dae-a3d4-b103ed995d1d tempest-VolumesGetTest-1176098524 None] Creating volume glance metadata for volume b891511d-e5f7-4909-842f-e479e44868c1 backed by image 37045a76-b9b1-4156-b15f-85c62a8616c3 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '37045a76-b9b1-4156-b15f-85c62a8616c3', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=88899) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Aug 03 08:44:52 devstack cinder-volume[88899]: DEBUG cinder.volume.flows.manager.create_volume [None req-0c6bd868-b2a9-4628-bf0c-2078c3a323e9 tempest-VolumeDependencyTests-1073688899 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88899) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 08:44:52 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-0c6bd868-b2a9-4628-bf0c-2078c3a323e9 tempest-VolumeDependencyTests-1073688899 None] Flow 'volume_create_manager' (7e40ce63-9981-4e0d-9de9-ff47438ba541) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:44:52 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-0c6bd868-b2a9-4628-bf0c-2078c3a323e9 tempest-VolumeDependencyTests-1073688899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a6ca73b-aac8-4ee2-b70a-3904a0fbb2c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:44:52 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-d6cbce6c-f739-4dae-a3d4-b103ed995d1d tempest-VolumesGetTest-1176098524 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d730168a-5e10-40a5-9960-640c01b7dff5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b891511d-e5f7-4909-842f-e479e44868c1', 'volume_size': 1, 'image_id': '37045a76-b9b1-4156-b15f-85c62a8616c3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/37045a76-b9b1-4156-b15f-85c62a8616c3', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'adee82974e9f41769efcb3f4a0eef199', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '37045a76-b9b1-4156-b15f-85c62a8616c3', 'created_at': datetime.datetime(2026, 8, 3, 6, 23, 4, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 3, 6, 23, 6, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/37045a76-b9b1-4156-b15f-85c62a8616c3/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:44:52 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-d6cbce6c-f739-4dae-a3d4-b103ed995d1d tempest-VolumesGetTest-1176098524 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1290d427-a766-4c78-8c27-635c3ce59562) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:44:52 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-0c6bd868-b2a9-4628-bf0c-2078c3a323e9 tempest-VolumeDependencyTests-1073688899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a6ca73b-aac8-4ee2-b70a-3904a0fbb2c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:44:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1326065650',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=475b65d3-a899-45ac-913b-c64ae81ffc3c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c2f62930ea114d94aae304e8ed339f9c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:44:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=33af9960-696c-415a-b163-e48848a09396,status='creating',terminated_at=None,updated_at=2026-08-03T06:44:53Z,use_quota=True,user_id='de61709cf33340bf9e956c0545be3966',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8bde7129-1dc4-42ab-b852-ab32c61b4921),volume_type_id=8bde7129-1dc4-42ab-b852-ab32c61b4921)' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:44:52 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-0c6bd868-b2a9-4628-bf0c-2078c3a323e9 tempest-VolumeDependencyTests-1073688899 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56b6eeff-54d4-44ca-9c06-a51671751603) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:44:52 devstack sudo[105905]: pam_unix(sudo:session): session closed for user root Aug 03 08:44:52 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-0c6bd868-b2a9-4628-bf0c-2078c3a323e9 tempest-VolumeDependencyTests-1073688899 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56b6eeff-54d4-44ca-9c06-a51671751603) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:44:52 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-0c6bd868-b2a9-4628-bf0c-2078c3a323e9 tempest-VolumeDependencyTests-1073688899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be9c5511-0280-440c-b0fa-1e13ed999f06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:44:52 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-00ee8b4d-6327-4175-bd9c-751979f69a7b tempest-CreateVolumesFromSnapshotTest-499945752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-921f6804-dbe4-483c-8f82-244aad495afb.info" returned: 0 in 0.302s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:44:52 devstack cinder-volume[88899]: WARNING cinder.volume.drivers.remotefs [None req-00ee8b4d-6327-4175-bd9c-751979f69a7b tempest-CreateVolumesFromSnapshotTest-499945752 None] /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-921f6804-dbe4-483c-8f82-244aad495afb.info is being set with open permissions: ugo+rw Aug 03 08:44:52 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-00ee8b4d-6327-4175-bd9c-751979f69a7b tempest-CreateVolumesFromSnapshotTest-499945752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-921f6804-dbe4-483c-8f82-244aad495afb.info {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:44:52 devstack cinder-volume[88899]: INFO cinder.volume.flows.manager.create_volume [None req-d6cbce6c-f739-4dae-a3d4-b103ed995d1d tempest-VolumesGetTest-1176098524 None] Volume volume-b891511d-e5f7-4909-842f-e479e44868c1 (b891511d-e5f7-4909-842f-e479e44868c1): created successfully Aug 03 08:44:52 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-d6cbce6c-f739-4dae-a3d4-b103ed995d1d tempest-VolumesGetTest-1176098524 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1290d427-a766-4c78-8c27-635c3ce59562) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:44:52 devstack sudo[105909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-921f6804-dbe4-483c-8f82-244aad495afb.info Aug 03 08:44:52 devstack sudo[105909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:44:52 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-d6cbce6c-f739-4dae-a3d4-b103ed995d1d tempest-VolumesGetTest-1176098524 None] Flow 'volume_create_manager' (df308a18-e0f0-4807-94eb-8e8111154dcf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:44:52 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-0c6bd868-b2a9-4628-bf0c-2078c3a323e9 tempest-VolumeDependencyTests-1073688899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be9c5511-0280-440c-b0fa-1e13ed999f06) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '475b65d3-a899-45ac-913b-c64ae81ffc3c', 'volume_name': 'volume-475b65d3-a899-45ac-913b-c64ae81ffc3c', 'volume_size': 1, 'source_volid': '33af9960-696c-415a-b163-e48848a09396', 'source_volstatus': 'available'}' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:44:52 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-0c6bd868-b2a9-4628-bf0c-2078c3a323e9 tempest-VolumeDependencyTests-1073688899 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (22ca38c6-fb7e-4264-b00c-c867b929a736) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:44:52 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-0c6bd868-b2a9-4628-bf0c-2078c3a323e9 tempest-VolumeDependencyTests-1073688899 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (22ca38c6-fb7e-4264-b00c-c867b929a736) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:44:52 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-0c6bd868-b2a9-4628-bf0c-2078c3a323e9 tempest-VolumeDependencyTests-1073688899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7c5b27d-d964-4832-b0c0-9e667cb65d34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:44:52 devstack cinder-volume[88899]: INFO cinder.volume.flows.manager.create_volume [None req-0c6bd868-b2a9-4628-bf0c-2078c3a323e9 tempest-VolumeDependencyTests-1073688899 None] Volume 475b65d3-a899-45ac-913b-c64ae81ffc3c: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-475b65d3-a899-45ac-913b-c64ae81ffc3c', 'volume_size': 1, 'source_volid': '33af9960-696c-415a-b163-e48848a09396', 'source_volstatus': 'available'} Aug 03 08:44:52 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-d6cbce6c-f739-4dae-a3d4-b103ed995d1d tempest-VolumesGetTest-1176098524 None] Created volume successfully. Aug 03 08:44:52 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-0c6bd868-b2a9-4628-bf0c-2078c3a323e9 tempest-VolumeDependencyTests-1073688899 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:44:53 devstack sudo[105909]: pam_unix(sudo:session): session closed for user root Aug 03 08:44:53 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-00ee8b4d-6327-4175-bd9c-751979f69a7b tempest-CreateVolumesFromSnapshotTest-499945752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-921f6804-dbe4-483c-8f82-244aad495afb.info" returned: 0 in 0.283s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:44:53 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-00ee8b4d-6327-4175-bd9c-751979f69a7b tempest-CreateVolumesFromSnapshotTest-499945752 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.100s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:44:53 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-0c6bd868-b2a9-4628-bf0c-2078c3a323e9 tempest-VolumeDependencyTests-1073688899 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.234s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:44:53 devstack cinder-volume[88899]: INFO cinder.volume.drivers.remotefs [None req-0c6bd868-b2a9-4628-bf0c-2078c3a323e9 tempest-VolumeDependencyTests-1073688899 None] Cloning volume 33af9960-696c-415a-b163-e48848a09396 to volume 475b65d3-a899-45ac-913b-c64ae81ffc3c Aug 03 08:44:53 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-0c6bd868-b2a9-4628-bf0c-2078c3a323e9 tempest-VolumeDependencyTests-1073688899 None] Creating offline snapshot 0a20052c-1e8c-4b06-91e9-5befa0cbf7ed of volume 33af9960-696c-415a-b163-e48848a09396 {{(pid=88899) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 03 08:44:53 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-00ee8b4d-6327-4175-bd9c-751979f69a7b tempest-CreateVolumesFromSnapshotTest-499945752 None] Create snapshot completed successfully Aug 03 08:44:53 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[29bc3992-9395-4964-9645-3628df3577f5]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:44:53 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-0c6bd868-b2a9-4628-bf0c-2078c3a323e9 tempest-VolumeDependencyTests-1073688899 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-33af9960-696c-415a-b163-e48848a09396 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:44:53 devstack sudo[105912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-33af9960-696c-415a-b163-e48848a09396 Aug 03 08:44:53 devstack sudo[105912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:44:53 devstack sudo[105912]: pam_unix(sudo:session): session closed for user root Aug 03 08:44:53 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-0c6bd868-b2a9-4628-bf0c-2078c3a323e9 tempest-VolumeDependencyTests-1073688899 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-33af9960-696c-415a-b163-e48848a09396" returned: 0 in 0.420s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:44:53 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-0c6bd868-b2a9-4628-bf0c-2078c3a323e9 tempest-VolumeDependencyTests-1073688899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-33af9960-696c-415a-b163-e48848a09396,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-33af9960-696c-415a-b163-e48848a09396.0a20052c-1e8c-4b06-91e9-5befa0cbf7ed 1G {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:44:53 devstack sudo[105919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-33af9960-696c-415a-b163-e48848a09396,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-33af9960-696c-415a-b163-e48848a09396.0a20052c-1e8c-4b06-91e9-5befa0cbf7ed 1G Aug 03 08:44:53 devstack sudo[105919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:44:54 devstack cinder-volume[88899]: DEBUG cinder.volume.flows.manager.create_volume [None req-a451cb93-f9a2-43f7-bc99-50a4b5a75710 tempest-VolumesGetTest-1176098524 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88899) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 08:44:54 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-a451cb93-f9a2-43f7-bc99-50a4b5a75710 tempest-VolumesGetTest-1176098524 None] Flow 'volume_create_manager' (95b8b047-eb19-46ea-afc4-e102db6af215) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:44:54 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-a451cb93-f9a2-43f7-bc99-50a4b5a75710 tempest-VolumesGetTest-1176098524 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3d47d15-7541-4994-937d-15c0bf65b8a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:44:54 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-a451cb93-f9a2-43f7-bc99-50a4b5a75710 tempest-VolumesGetTest-1176098524 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3d47d15-7541-4994-937d-15c0bf65b8a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:44:54Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-131734404',display_name='tempest-VolumesGetTest-Volume-1680266547',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f574eaec-95ae-42c2-8e1a-347542a0ab56,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='070ec6e114534bca93d5d121647b843c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:44:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:44:54Z,use_quota=True,user_id='e38f947f25c6490eb48ca43abf9ef753',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8bde7129-1dc4-42ab-b852-ab32c61b4921),volume_type_id=8bde7129-1dc4-42ab-b852-ab32c61b4921)' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:44:54 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-a451cb93-f9a2-43f7-bc99-50a4b5a75710 tempest-VolumesGetTest-1176098524 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c747475a-8e39-4c0c-ac8f-1bd29606e0a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:44:54 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-a451cb93-f9a2-43f7-bc99-50a4b5a75710 tempest-VolumesGetTest-1176098524 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c747475a-8e39-4c0c-ac8f-1bd29606e0a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:44:54 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-a451cb93-f9a2-43f7-bc99-50a4b5a75710 tempest-VolumesGetTest-1176098524 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69ab9830-a69b-46b1-9c0a-32490338ed5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:44:54 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-a451cb93-f9a2-43f7-bc99-50a4b5a75710 tempest-VolumesGetTest-1176098524 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69ab9830-a69b-46b1-9c0a-32490338ed5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f574eaec-95ae-42c2-8e1a-347542a0ab56', 'volume_name': 'volume-f574eaec-95ae-42c2-8e1a-347542a0ab56', 'volume_size': 1}' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:44:54 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-a451cb93-f9a2-43f7-bc99-50a4b5a75710 tempest-VolumesGetTest-1176098524 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (227cdeb6-4d73-4777-9abb-1c55683fdf5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:44:54 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-a451cb93-f9a2-43f7-bc99-50a4b5a75710 tempest-VolumesGetTest-1176098524 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (227cdeb6-4d73-4777-9abb-1c55683fdf5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:44:54 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-a451cb93-f9a2-43f7-bc99-50a4b5a75710 tempest-VolumesGetTest-1176098524 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (34258290-8eb2-46e0-b6c1-90f05407a5ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:44:54 devstack cinder-volume[88899]: INFO cinder.volume.flows.manager.create_volume [None req-a451cb93-f9a2-43f7-bc99-50a4b5a75710 tempest-VolumesGetTest-1176098524 None] Volume f574eaec-95ae-42c2-8e1a-347542a0ab56: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f574eaec-95ae-42c2-8e1a-347542a0ab56', 'volume_size': 1} Aug 03 08:44:54 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-a451cb93-f9a2-43f7-bc99-50a4b5a75710 tempest-VolumesGetTest-1176098524 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:44:54 devstack sudo[105919]: pam_unix(sudo:session): session closed for user root Aug 03 08:44:54 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-0c6bd868-b2a9-4628-bf0c-2078c3a323e9 tempest-VolumeDependencyTests-1073688899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-33af9960-696c-415a-b163-e48848a09396,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-33af9960-696c-415a-b163-e48848a09396.0a20052c-1e8c-4b06-91e9-5befa0cbf7ed 1G" returned: 0 in 0.494s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:44:54 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-0c6bd868-b2a9-4628-bf0c-2078c3a323e9 tempest-VolumeDependencyTests-1073688899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-33af9960-696c-415a-b163-e48848a09396 -F qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-33af9960-696c-415a-b163-e48848a09396.0a20052c-1e8c-4b06-91e9-5befa0cbf7ed {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:44:54 devstack sudo[105926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-33af9960-696c-415a-b163-e48848a09396 -F qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-33af9960-696c-415a-b163-e48848a09396.0a20052c-1e8c-4b06-91e9-5befa0cbf7ed Aug 03 08:44:54 devstack sudo[105926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:44:54 devstack cinder-volume[88899]: DEBUG cinder.volume.flows.manager.create_volume [None req-35f0cbda-9fb2-4931-89c5-110ccf2ea1d5 tempest-CreateVolumesFromSnapshotTest-499945752 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88899) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 08:44:54 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-35f0cbda-9fb2-4931-89c5-110ccf2ea1d5 tempest-CreateVolumesFromSnapshotTest-499945752 None] Flow 'volume_create_manager' (8c505ab0-0ec3-4e68-8491-07d9da172a19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:44:54 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-35f0cbda-9fb2-4931-89c5-110ccf2ea1d5 tempest-CreateVolumesFromSnapshotTest-499945752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab2d586d-9223-487f-98df-8d69545f5086) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:44:54 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-35f0cbda-9fb2-4931-89c5-110ccf2ea1d5 tempest-CreateVolumesFromSnapshotTest-499945752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab2d586d-9223-487f-98df-8d69545f5086) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:44:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1442476352',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=536fdef5-781d-4687-9b4a-8929595c7845,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9487a33641d4d31bb388ed345e2cba1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:44:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:44:54Z,use_quota=True,user_id='dbed2458e8bb45e183e7c8ee6f212513',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8bde7129-1dc4-42ab-b852-ab32c61b4921),volume_type_id=8bde7129-1dc4-42ab-b852-ab32c61b4921)' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:44:54 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-35f0cbda-9fb2-4931-89c5-110ccf2ea1d5 tempest-CreateVolumesFromSnapshotTest-499945752 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab075c8a-7640-42f3-ad8e-82afd491df59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:44:54 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-35f0cbda-9fb2-4931-89c5-110ccf2ea1d5 tempest-CreateVolumesFromSnapshotTest-499945752 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab075c8a-7640-42f3-ad8e-82afd491df59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:44:54 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-35f0cbda-9fb2-4931-89c5-110ccf2ea1d5 tempest-CreateVolumesFromSnapshotTest-499945752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77feae85-ed87-4779-a6d0-913a4a5bf830) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:44:54 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-35f0cbda-9fb2-4931-89c5-110ccf2ea1d5 tempest-CreateVolumesFromSnapshotTest-499945752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77feae85-ed87-4779-a6d0-913a4a5bf830) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '536fdef5-781d-4687-9b4a-8929595c7845', 'volume_name': 'volume-536fdef5-781d-4687-9b4a-8929595c7845', 'volume_size': 1}' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:44:54 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-35f0cbda-9fb2-4931-89c5-110ccf2ea1d5 tempest-CreateVolumesFromSnapshotTest-499945752 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b51bce6-f7b0-45c8-af41-d2ab04674454) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:44:54 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-35f0cbda-9fb2-4931-89c5-110ccf2ea1d5 tempest-CreateVolumesFromSnapshotTest-499945752 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b51bce6-f7b0-45c8-af41-d2ab04674454) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:44:54 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-35f0cbda-9fb2-4931-89c5-110ccf2ea1d5 tempest-CreateVolumesFromSnapshotTest-499945752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (502fe13a-96c4-4298-b1b3-c6d9c3f6f559) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:44:54 devstack cinder-volume[88899]: INFO cinder.volume.flows.manager.create_volume [None req-35f0cbda-9fb2-4931-89c5-110ccf2ea1d5 tempest-CreateVolumesFromSnapshotTest-499945752 None] Volume 536fdef5-781d-4687-9b4a-8929595c7845: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-536fdef5-781d-4687-9b4a-8929595c7845', 'volume_size': 1} Aug 03 08:44:54 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-35f0cbda-9fb2-4931-89c5-110ccf2ea1d5 tempest-CreateVolumesFromSnapshotTest-499945752 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:44:54 devstack sudo[105926]: pam_unix(sudo:session): session closed for user root Aug 03 08:44:54 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-0c6bd868-b2a9-4628-bf0c-2078c3a323e9 tempest-VolumeDependencyTests-1073688899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-33af9960-696c-415a-b163-e48848a09396 -F qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-33af9960-696c-415a-b163-e48848a09396.0a20052c-1e8c-4b06-91e9-5befa0cbf7ed" returned: 0 in 0.333s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:44:54 devstack cinder-volume[88899]: WARNING cinder.volume.drivers.remotefs [None req-0c6bd868-b2a9-4628-bf0c-2078c3a323e9 tempest-VolumeDependencyTests-1073688899 None] /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-33af9960-696c-415a-b163-e48848a09396.0a20052c-1e8c-4b06-91e9-5befa0cbf7ed is being set with open permissions: ugo+rw Aug 03 08:44:54 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-0c6bd868-b2a9-4628-bf0c-2078c3a323e9 tempest-VolumeDependencyTests-1073688899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-33af9960-696c-415a-b163-e48848a09396.0a20052c-1e8c-4b06-91e9-5befa0cbf7ed {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:44:54 devstack sudo[105932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-33af9960-696c-415a-b163-e48848a09396.0a20052c-1e8c-4b06-91e9-5befa0cbf7ed Aug 03 08:44:54 devstack sudo[105932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:44:54 devstack cinder-volume[88899]: DEBUG cinder.volume.flows.manager.create_volume [None req-e9dc7f74-8464-44d4-859c-c8be0b6166c2 tempest-CreateVolumesFromSnapshotTest-499945752 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88899) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 08:44:54 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-e9dc7f74-8464-44d4-859c-c8be0b6166c2 tempest-CreateVolumesFromSnapshotTest-499945752 None] Flow 'volume_create_manager' (f1973236-2bcb-497e-8a18-aa24ba598136) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:44:54 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-e9dc7f74-8464-44d4-859c-c8be0b6166c2 tempest-CreateVolumesFromSnapshotTest-499945752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (38cb738f-1caa-4dda-a50b-c95da6fc60ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:44:54 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-e9dc7f74-8464-44d4-859c-c8be0b6166c2 tempest-CreateVolumesFromSnapshotTest-499945752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (38cb738f-1caa-4dda-a50b-c95da6fc60ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:44:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1665391160',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e12693a7-7a76-4009-a37e-ee176a7499bc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9487a33641d4d31bb388ed345e2cba1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:44:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:44:55Z,use_quota=True,user_id='dbed2458e8bb45e183e7c8ee6f212513',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8bde7129-1dc4-42ab-b852-ab32c61b4921),volume_type_id=8bde7129-1dc4-42ab-b852-ab32c61b4921)' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:44:54 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-e9dc7f74-8464-44d4-859c-c8be0b6166c2 tempest-CreateVolumesFromSnapshotTest-499945752 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c4804d8d-a031-48d9-b0b5-af0a10a2c194) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:44:54 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-e9dc7f74-8464-44d4-859c-c8be0b6166c2 tempest-CreateVolumesFromSnapshotTest-499945752 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c4804d8d-a031-48d9-b0b5-af0a10a2c194) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:44:54 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-e9dc7f74-8464-44d4-859c-c8be0b6166c2 tempest-CreateVolumesFromSnapshotTest-499945752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14b23907-b9ca-45e4-9ab7-164bec45c58b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:44:54 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-e9dc7f74-8464-44d4-859c-c8be0b6166c2 tempest-CreateVolumesFromSnapshotTest-499945752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14b23907-b9ca-45e4-9ab7-164bec45c58b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e12693a7-7a76-4009-a37e-ee176a7499bc', 'volume_name': 'volume-e12693a7-7a76-4009-a37e-ee176a7499bc', 'volume_size': 1}' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:44:54 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-e9dc7f74-8464-44d4-859c-c8be0b6166c2 tempest-CreateVolumesFromSnapshotTest-499945752 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e8c88c27-ead8-4632-b41b-1d03929f4968) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:44:54 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-e9dc7f74-8464-44d4-859c-c8be0b6166c2 tempest-CreateVolumesFromSnapshotTest-499945752 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e8c88c27-ead8-4632-b41b-1d03929f4968) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:44:54 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-e9dc7f74-8464-44d4-859c-c8be0b6166c2 tempest-CreateVolumesFromSnapshotTest-499945752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68fdfab5-f568-44a2-8d85-452c5a3b9e93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:44:54 devstack cinder-volume[88899]: INFO cinder.volume.flows.manager.create_volume [None req-e9dc7f74-8464-44d4-859c-c8be0b6166c2 tempest-CreateVolumesFromSnapshotTest-499945752 None] Volume e12693a7-7a76-4009-a37e-ee176a7499bc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e12693a7-7a76-4009-a37e-ee176a7499bc', 'volume_size': 1} Aug 03 08:44:54 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-e9dc7f74-8464-44d4-859c-c8be0b6166c2 tempest-CreateVolumesFromSnapshotTest-499945752 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:44:54 devstack sudo[105932]: pam_unix(sudo:session): session closed for user root Aug 03 08:44:54 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-0c6bd868-b2a9-4628-bf0c-2078c3a323e9 tempest-VolumeDependencyTests-1073688899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-33af9960-696c-415a-b163-e48848a09396.0a20052c-1e8c-4b06-91e9-5befa0cbf7ed" returned: 0 in 0.293s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:44:54 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-0c6bd868-b2a9-4628-bf0c-2078c3a323e9 tempest-VolumeDependencyTests-1073688899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-33af9960-696c-415a-b163-e48848a09396.info {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:44:54 devstack sudo[105935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-33af9960-696c-415a-b163-e48848a09396.info Aug 03 08:44:54 devstack sudo[105935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:44:55 devstack cinder-volume[88899]: DEBUG cinder.volume.flows.manager.create_volume [None req-52d5056f-aea1-4fb6-a30b-dd9f27ef4a91 tempest-CreateVolumesFromSnapshotTest-499945752 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88899) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 08:44:55 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-52d5056f-aea1-4fb6-a30b-dd9f27ef4a91 tempest-CreateVolumesFromSnapshotTest-499945752 None] Flow 'volume_create_manager' (40fed876-4564-4fa8-b1a8-ec1472441d18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:44:55 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-52d5056f-aea1-4fb6-a30b-dd9f27ef4a91 tempest-CreateVolumesFromSnapshotTest-499945752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e5877e5-8e8e-4683-9274-1c2e71495440) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:44:55 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-52d5056f-aea1-4fb6-a30b-dd9f27ef4a91 tempest-CreateVolumesFromSnapshotTest-499945752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e5877e5-8e8e-4683-9274-1c2e71495440) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:44:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1743353426',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed402e41-3ba8-4546-ba67-4c213b01988b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9487a33641d4d31bb388ed345e2cba1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:44:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:44:55Z,use_quota=True,user_id='dbed2458e8bb45e183e7c8ee6f212513',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8bde7129-1dc4-42ab-b852-ab32c61b4921),volume_type_id=8bde7129-1dc4-42ab-b852-ab32c61b4921)' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:44:55 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-52d5056f-aea1-4fb6-a30b-dd9f27ef4a91 tempest-CreateVolumesFromSnapshotTest-499945752 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (242c6977-b1d8-4234-8afb-0aaad514eb35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:44:55 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-52d5056f-aea1-4fb6-a30b-dd9f27ef4a91 tempest-CreateVolumesFromSnapshotTest-499945752 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (242c6977-b1d8-4234-8afb-0aaad514eb35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:44:55 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-52d5056f-aea1-4fb6-a30b-dd9f27ef4a91 tempest-CreateVolumesFromSnapshotTest-499945752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1328edbb-affd-491d-9b00-982a1c8b5d73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:44:55 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-52d5056f-aea1-4fb6-a30b-dd9f27ef4a91 tempest-CreateVolumesFromSnapshotTest-499945752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1328edbb-affd-491d-9b00-982a1c8b5d73) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ed402e41-3ba8-4546-ba67-4c213b01988b', 'volume_name': 'volume-ed402e41-3ba8-4546-ba67-4c213b01988b', 'volume_size': 1}' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:44:55 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-52d5056f-aea1-4fb6-a30b-dd9f27ef4a91 tempest-CreateVolumesFromSnapshotTest-499945752 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d4b3c5b-a9fa-41a4-aa13-2988e2322392) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:44:55 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-52d5056f-aea1-4fb6-a30b-dd9f27ef4a91 tempest-CreateVolumesFromSnapshotTest-499945752 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d4b3c5b-a9fa-41a4-aa13-2988e2322392) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:44:55 devstack sudo[105935]: pam_unix(sudo:session): session closed for user root Aug 03 08:44:55 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-52d5056f-aea1-4fb6-a30b-dd9f27ef4a91 tempest-CreateVolumesFromSnapshotTest-499945752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (90083184-3780-4723-8ffc-778c8b963741) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:44:55 devstack cinder-volume[88899]: INFO cinder.volume.flows.manager.create_volume [None req-52d5056f-aea1-4fb6-a30b-dd9f27ef4a91 tempest-CreateVolumesFromSnapshotTest-499945752 None] Volume ed402e41-3ba8-4546-ba67-4c213b01988b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ed402e41-3ba8-4546-ba67-4c213b01988b', 'volume_size': 1} Aug 03 08:44:55 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-52d5056f-aea1-4fb6-a30b-dd9f27ef4a91 tempest-CreateVolumesFromSnapshotTest-499945752 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:44:55 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-0c6bd868-b2a9-4628-bf0c-2078c3a323e9 tempest-VolumeDependencyTests-1073688899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-33af9960-696c-415a-b163-e48848a09396.info" returned: 0 in 0.300s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:44:55 devstack cinder-volume[88899]: WARNING cinder.volume.drivers.remotefs [None req-0c6bd868-b2a9-4628-bf0c-2078c3a323e9 tempest-VolumeDependencyTests-1073688899 None] /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-33af9960-696c-415a-b163-e48848a09396.info is being set with open permissions: ugo+rw Aug 03 08:44:55 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-0c6bd868-b2a9-4628-bf0c-2078c3a323e9 tempest-VolumeDependencyTests-1073688899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-33af9960-696c-415a-b163-e48848a09396.info {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:44:55 devstack sudo[105938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-33af9960-696c-415a-b163-e48848a09396.info Aug 03 08:44:55 devstack sudo[105938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:44:55 devstack sudo[105938]: pam_unix(sudo:session): session closed for user root Aug 03 08:44:55 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-0c6bd868-b2a9-4628-bf0c-2078c3a323e9 tempest-VolumeDependencyTests-1073688899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-33af9960-696c-415a-b163-e48848a09396.info" returned: 0 in 0.271s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:44:55 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-0c6bd868-b2a9-4628-bf0c-2078c3a323e9 tempest-VolumeDependencyTests-1073688899 None] Acquiring lock "cinder-quobyte-475b65d3-a899-45ac-913b-c64ae81ffc3c" by "_copy_volume_from_snapshot" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:44:55 devstack cinder-volume[88899]: DEBUG cinder.volume.flows.manager.create_volume [None req-4c0fdff8-66d4-44f7-9d35-0a57e2c55336 tempest-CreateVolumesFromSnapshotTest-499945752 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88899) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 08:44:55 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-4c0fdff8-66d4-44f7-9d35-0a57e2c55336 tempest-CreateVolumesFromSnapshotTest-499945752 None] Flow 'volume_create_manager' (ff614373-7e92-4e94-9070-4aae9359b861) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:44:55 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-4c0fdff8-66d4-44f7-9d35-0a57e2c55336 tempest-CreateVolumesFromSnapshotTest-499945752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0079589e-5254-48f6-9305-03f2a406a40b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:44:55 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-0c6bd868-b2a9-4628-bf0c-2078c3a323e9 tempest-VolumeDependencyTests-1073688899 None] Lock "cinder-quobyte-475b65d3-a899-45ac-913b-c64ae81ffc3c" acquired by "_copy_volume_from_snapshot" :: waited 0.056s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:44:55 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-0c6bd868-b2a9-4628-bf0c-2078c3a323e9 tempest-VolumeDependencyTests-1073688899 None] snapshot: 0a20052c-1e8c-4b06-91e9-5befa0cbf7ed, volume: 475b65d3-a899-45ac-913b-c64ae81ffc3c, {{(pid=88899) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Aug 03 08:44:55 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-0c6bd868-b2a9-4628-bf0c-2078c3a323e9 tempest-VolumeDependencyTests-1073688899 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:44:55 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-0c6bd868-b2a9-4628-bf0c-2078c3a323e9 tempest-VolumeDependencyTests-1073688899 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:44:55 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-0c6bd868-b2a9-4628-bf0c-2078c3a323e9 tempest-VolumeDependencyTests-1073688899 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:44:55 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-0c6bd868-b2a9-4628-bf0c-2078c3a323e9 tempest-VolumeDependencyTests-1073688899 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:44:55 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-0c6bd868-b2a9-4628-bf0c-2078c3a323e9 tempest-VolumeDependencyTests-1073688899 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:44:55 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee244727-abb1-459a-b06c-5f0ff72b86f3]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:44:55 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-0c6bd868-b2a9-4628-bf0c-2078c3a323e9 tempest-VolumeDependencyTests-1073688899 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-33af9960-696c-415a-b163-e48848a09396.0a20052c-1e8c-4b06-91e9-5befa0cbf7ed {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:44:55 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-4c0fdff8-66d4-44f7-9d35-0a57e2c55336 tempest-CreateVolumesFromSnapshotTest-499945752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0079589e-5254-48f6-9305-03f2a406a40b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:44:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1746577603',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f04dfd17-ebd5-46dc-a05d-ed7b6eeb311c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9487a33641d4d31bb388ed345e2cba1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:44:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:44:55Z,use_quota=True,user_id='dbed2458e8bb45e183e7c8ee6f212513',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8bde7129-1dc4-42ab-b852-ab32c61b4921),volume_type_id=8bde7129-1dc4-42ab-b852-ab32c61b4921)' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:44:55 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-4c0fdff8-66d4-44f7-9d35-0a57e2c55336 tempest-CreateVolumesFromSnapshotTest-499945752 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f72af6e4-4ff6-461a-8360-b6d2fd5b643f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:44:55 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-4c0fdff8-66d4-44f7-9d35-0a57e2c55336 tempest-CreateVolumesFromSnapshotTest-499945752 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f72af6e4-4ff6-461a-8360-b6d2fd5b643f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:44:55 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-4c0fdff8-66d4-44f7-9d35-0a57e2c55336 tempest-CreateVolumesFromSnapshotTest-499945752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f88ea169-7550-42b0-a731-cbd76e251bbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:44:55 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-4c0fdff8-66d4-44f7-9d35-0a57e2c55336 tempest-CreateVolumesFromSnapshotTest-499945752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f88ea169-7550-42b0-a731-cbd76e251bbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f04dfd17-ebd5-46dc-a05d-ed7b6eeb311c', 'volume_name': 'volume-f04dfd17-ebd5-46dc-a05d-ed7b6eeb311c', 'volume_size': 1}' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:44:55 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-4c0fdff8-66d4-44f7-9d35-0a57e2c55336 tempest-CreateVolumesFromSnapshotTest-499945752 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (489e0ea8-447f-4c31-9922-d8922e4b9141) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:44:55 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-4c0fdff8-66d4-44f7-9d35-0a57e2c55336 tempest-CreateVolumesFromSnapshotTest-499945752 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (489e0ea8-447f-4c31-9922-d8922e4b9141) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:44:55 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-4c0fdff8-66d4-44f7-9d35-0a57e2c55336 tempest-CreateVolumesFromSnapshotTest-499945752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c76cb74e-605a-49e7-a085-9fae09b2fe18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:44:55 devstack cinder-volume[88899]: INFO cinder.volume.flows.manager.create_volume [None req-4c0fdff8-66d4-44f7-9d35-0a57e2c55336 tempest-CreateVolumesFromSnapshotTest-499945752 None] Volume f04dfd17-ebd5-46dc-a05d-ed7b6eeb311c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f04dfd17-ebd5-46dc-a05d-ed7b6eeb311c', 'volume_size': 1} Aug 03 08:44:55 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-4c0fdff8-66d4-44f7-9d35-0a57e2c55336 tempest-CreateVolumesFromSnapshotTest-499945752 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:44:55 devstack sudo[105941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-33af9960-696c-415a-b163-e48848a09396.0a20052c-1e8c-4b06-91e9-5befa0cbf7ed Aug 03 08:44:55 devstack sudo[105941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:44:55 devstack cinder-volume[88899]: DEBUG cinder.volume.flows.manager.create_volume [None req-7fd33681-8508-47da-867e-bb74fa3fee67 tempest-CreateVolumesFromSnapshotTest-499945752 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88899) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 08:44:55 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-7fd33681-8508-47da-867e-bb74fa3fee67 tempest-CreateVolumesFromSnapshotTest-499945752 None] Flow 'volume_create_manager' (cb38a76e-b56f-49f3-8c57-a3f1ab83d64b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:44:55 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-7fd33681-8508-47da-867e-bb74fa3fee67 tempest-CreateVolumesFromSnapshotTest-499945752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d0b03e5-4314-4e13-b6b8-ed041cfeaf24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:44:55 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-7fd33681-8508-47da-867e-bb74fa3fee67 tempest-CreateVolumesFromSnapshotTest-499945752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d0b03e5-4314-4e13-b6b8-ed041cfeaf24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:44:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1191649371',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f02c5e58-ce3d-40c4-80e1-de7a35fef297,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9487a33641d4d31bb388ed345e2cba1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:44:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:44:56Z,use_quota=True,user_id='dbed2458e8bb45e183e7c8ee6f212513',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8bde7129-1dc4-42ab-b852-ab32c61b4921),volume_type_id=8bde7129-1dc4-42ab-b852-ab32c61b4921)' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:44:55 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-7fd33681-8508-47da-867e-bb74fa3fee67 tempest-CreateVolumesFromSnapshotTest-499945752 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06e3f9cf-4ed6-4cbd-85e5-07744538cbf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:44:55 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-7fd33681-8508-47da-867e-bb74fa3fee67 tempest-CreateVolumesFromSnapshotTest-499945752 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06e3f9cf-4ed6-4cbd-85e5-07744538cbf5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:44:55 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-7fd33681-8508-47da-867e-bb74fa3fee67 tempest-CreateVolumesFromSnapshotTest-499945752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ffe63e86-c242-4cc3-8a96-a6b5bf6f8c2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:44:55 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-7fd33681-8508-47da-867e-bb74fa3fee67 tempest-CreateVolumesFromSnapshotTest-499945752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ffe63e86-c242-4cc3-8a96-a6b5bf6f8c2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f02c5e58-ce3d-40c4-80e1-de7a35fef297', 'volume_name': 'volume-f02c5e58-ce3d-40c4-80e1-de7a35fef297', 'volume_size': 1}' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:44:55 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-7fd33681-8508-47da-867e-bb74fa3fee67 tempest-CreateVolumesFromSnapshotTest-499945752 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3116d3a-fbc7-4b76-aa5a-76bc5205cb06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:44:55 devstack sudo[105941]: pam_unix(sudo:session): session closed for user root Aug 03 08:44:55 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-7fd33681-8508-47da-867e-bb74fa3fee67 tempest-CreateVolumesFromSnapshotTest-499945752 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3116d3a-fbc7-4b76-aa5a-76bc5205cb06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:44:55 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-7fd33681-8508-47da-867e-bb74fa3fee67 tempest-CreateVolumesFromSnapshotTest-499945752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f6978d5-0ab9-4695-9d7c-66ab5217df71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:44:55 devstack cinder-volume[88899]: INFO cinder.volume.flows.manager.create_volume [None req-7fd33681-8508-47da-867e-bb74fa3fee67 tempest-CreateVolumesFromSnapshotTest-499945752 None] Volume f02c5e58-ce3d-40c4-80e1-de7a35fef297: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f02c5e58-ce3d-40c4-80e1-de7a35fef297', 'volume_size': 1} Aug 03 08:44:55 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-7fd33681-8508-47da-867e-bb74fa3fee67 tempest-CreateVolumesFromSnapshotTest-499945752 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:44:55 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-0c6bd868-b2a9-4628-bf0c-2078c3a323e9 tempest-VolumeDependencyTests-1073688899 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-33af9960-696c-415a-b163-e48848a09396.0a20052c-1e8c-4b06-91e9-5befa0cbf7ed" returned: 0 in 0.382s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:44:55 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-0c6bd868-b2a9-4628-bf0c-2078c3a323e9 tempest-VolumeDependencyTests-1073688899 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-33af9960-696c-415a-b163-e48848a09396(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88899) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 03 08:44:55 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[e95eb39b-f9c9-4d93-9469-bf0aae90d2cd]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:44:55 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-0c6bd868-b2a9-4628-bf0c-2078c3a323e9 tempest-VolumeDependencyTests-1073688899 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-33af9960-696c-415a-b163-e48848a09396 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:44:55 devstack sudo[105947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-33af9960-696c-415a-b163-e48848a09396 Aug 03 08:44:55 devstack sudo[105947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:44:56 devstack sudo[105947]: pam_unix(sudo:session): session closed for user root Aug 03 08:44:56 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-0c6bd868-b2a9-4628-bf0c-2078c3a323e9 tempest-VolumeDependencyTests-1073688899 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-33af9960-696c-415a-b163-e48848a09396" returned: 0 in 0.353s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:44:56 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-0c6bd868-b2a9-4628-bf0c-2078c3a323e9 tempest-VolumeDependencyTests-1073688899 None] will copy from snapshot at /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-33af9960-696c-415a-b163-e48848a09396 {{(pid=88899) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Aug 03 08:44:56 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-0c6bd868-b2a9-4628-bf0c-2078c3a323e9 tempest-VolumeDependencyTests-1073688899 None] Creating direct copy from snapshot {{(pid=88899) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Aug 03 08:44:56 devstack cinder-volume[88899]: DEBUG cinder.utils [None req-0c6bd868-b2a9-4628-bf0c-2078c3a323e9 tempest-VolumeDependencyTests-1073688899 None] Path /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-475b65d3-a899-45ac-913b-c64ae81ffc3c not found in is_blk_device check {{(pid=88899) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Aug 03 08:44:56 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-0c6bd868-b2a9-4628-bf0c-2078c3a323e9 tempest-VolumeDependencyTests-1073688899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-33af9960-696c-415a-b163-e48848a09396 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-475b65d3-a899-45ac-913b-c64ae81ffc3c {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:44:56 devstack sudo[105952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-33af9960-696c-415a-b163-e48848a09396 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-475b65d3-a899-45ac-913b-c64ae81ffc3c Aug 03 08:44:56 devstack sudo[105952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:44:56 devstack sudo[105952]: pam_unix(sudo:session): session closed for user root Aug 03 08:44:56 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-0c6bd868-b2a9-4628-bf0c-2078c3a323e9 tempest-VolumeDependencyTests-1073688899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-33af9960-696c-415a-b163-e48848a09396 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-475b65d3-a899-45ac-913b-c64ae81ffc3c" returned: 0 in 0.418s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:44:56 devstack cinder-volume[88899]: DEBUG cinder.image.image_utils [None req-0c6bd868-b2a9-4628-bf0c-2078c3a323e9 tempest-VolumeDependencyTests-1073688899 None] Image conversion details: src /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-33af9960-696c-415a-b163-e48848a09396, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-475b65d3-a899-45ac-913b-c64ae81ffc3c {{(pid=88899) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 03 08:44:56 devstack cinder-volume[88899]: INFO cinder.image.image_utils [None req-0c6bd868-b2a9-4628-bf0c-2078c3a323e9 tempest-VolumeDependencyTests-1073688899 None] Converted 1024.00 MB image at 1024.00 MB/s Aug 03 08:44:56 devstack cinder-volume[88899]: WARNING cinder.volume.drivers.remotefs [None req-0c6bd868-b2a9-4628-bf0c-2078c3a323e9 tempest-VolumeDependencyTests-1073688899 None] /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-475b65d3-a899-45ac-913b-c64ae81ffc3c is being set with open permissions: ugo+rw Aug 03 08:44:56 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-0c6bd868-b2a9-4628-bf0c-2078c3a323e9 tempest-VolumeDependencyTests-1073688899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-475b65d3-a899-45ac-913b-c64ae81ffc3c {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:44:56 devstack sudo[105958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-475b65d3-a899-45ac-913b-c64ae81ffc3c Aug 03 08:44:56 devstack sudo[105958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:44:56 devstack sudo[105958]: pam_unix(sudo:session): session closed for user root Aug 03 08:44:56 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-0c6bd868-b2a9-4628-bf0c-2078c3a323e9 tempest-VolumeDependencyTests-1073688899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-475b65d3-a899-45ac-913b-c64ae81ffc3c" returned: 0 in 0.248s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:44:56 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-0c6bd868-b2a9-4628-bf0c-2078c3a323e9 tempest-VolumeDependencyTests-1073688899 None] Lock "cinder-quobyte-475b65d3-a899-45ac-913b-c64ae81ffc3c" released by "_copy_volume_from_snapshot" :: held 1.471s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:44:56 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-0c6bd868-b2a9-4628-bf0c-2078c3a323e9 tempest-VolumeDependencyTests-1073688899 None] Acquiring lock "cinder-quobyte-0a20052c-1e8c-4b06-91e9-5befa0cbf7ed" by "_delete_snapshot" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:44:56 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-0c6bd868-b2a9-4628-bf0c-2078c3a323e9 tempest-VolumeDependencyTests-1073688899 None] Lock "cinder-quobyte-0a20052c-1e8c-4b06-91e9-5befa0cbf7ed" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:44:56 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-0c6bd868-b2a9-4628-bf0c-2078c3a323e9 tempest-VolumeDependencyTests-1073688899 None] Deleting offline snapshot 0a20052c-1e8c-4b06-91e9-5befa0cbf7ed of volume 33af9960-696c-415a-b163-e48848a09396 {{(pid=88899) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 03 08:44:56 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-0c6bd868-b2a9-4628-bf0c-2078c3a323e9 tempest-VolumeDependencyTests-1073688899 None] snapshot_file for this snap is: volume-33af9960-696c-415a-b163-e48848a09396.0a20052c-1e8c-4b06-91e9-5befa0cbf7ed {{(pid=88899) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 03 08:44:56 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c287bb5-822b-48b5-8811-2c18d4a2a0fd]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:44:56 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-0c6bd868-b2a9-4628-bf0c-2078c3a323e9 tempest-VolumeDependencyTests-1073688899 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-33af9960-696c-415a-b163-e48848a09396.0a20052c-1e8c-4b06-91e9-5befa0cbf7ed {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:44:57 devstack sudo[105961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-33af9960-696c-415a-b163-e48848a09396.0a20052c-1e8c-4b06-91e9-5befa0cbf7ed Aug 03 08:44:57 devstack sudo[105961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:44:57 devstack sudo[105961]: pam_unix(sudo:session): session closed for user root Aug 03 08:44:57 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-0c6bd868-b2a9-4628-bf0c-2078c3a323e9 tempest-VolumeDependencyTests-1073688899 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-33af9960-696c-415a-b163-e48848a09396.0a20052c-1e8c-4b06-91e9-5befa0cbf7ed" returned: 0 in 0.352s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:44:57 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-0c6bd868-b2a9-4628-bf0c-2078c3a323e9 tempest-VolumeDependencyTests-1073688899 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-33af9960-696c-415a-b163-e48848a09396(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88899) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 03 08:44:57 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0413387-f246-4c6b-8188-4f0a8edc2e5e]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:44:57 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-0c6bd868-b2a9-4628-bf0c-2078c3a323e9 tempest-VolumeDependencyTests-1073688899 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-33af9960-696c-415a-b163-e48848a09396 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:44:57 devstack sudo[105966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-33af9960-696c-415a-b163-e48848a09396 Aug 03 08:44:57 devstack sudo[105966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:44:57 devstack sudo[105966]: pam_unix(sudo:session): session closed for user root Aug 03 08:44:57 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-0c6bd868-b2a9-4628-bf0c-2078c3a323e9 tempest-VolumeDependencyTests-1073688899 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-33af9960-696c-415a-b163-e48848a09396" returned: 0 in 0.349s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:44:57 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-0c6bd868-b2a9-4628-bf0c-2078c3a323e9 tempest-VolumeDependencyTests-1073688899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-33af9960-696c-415a-b163-e48848a09396.0a20052c-1e8c-4b06-91e9-5befa0cbf7ed {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:44:57 devstack sudo[105971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-33af9960-696c-415a-b163-e48848a09396.0a20052c-1e8c-4b06-91e9-5befa0cbf7ed Aug 03 08:44:57 devstack sudo[105971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:44:58 devstack sudo[105971]: pam_unix(sudo:session): session closed for user root Aug 03 08:44:58 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-0c6bd868-b2a9-4628-bf0c-2078c3a323e9 tempest-VolumeDependencyTests-1073688899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-33af9960-696c-415a-b163-e48848a09396.0a20052c-1e8c-4b06-91e9-5befa0cbf7ed" returned: 0 in 0.354s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:44:58 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-0c6bd868-b2a9-4628-bf0c-2078c3a323e9 tempest-VolumeDependencyTests-1073688899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-33af9960-696c-415a-b163-e48848a09396.0a20052c-1e8c-4b06-91e9-5befa0cbf7ed {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:44:58 devstack sudo[105976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-33af9960-696c-415a-b163-e48848a09396.0a20052c-1e8c-4b06-91e9-5befa0cbf7ed Aug 03 08:44:58 devstack sudo[105976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:44:58 devstack sudo[105976]: pam_unix(sudo:session): session closed for user root Aug 03 08:44:58 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-0c6bd868-b2a9-4628-bf0c-2078c3a323e9 tempest-VolumeDependencyTests-1073688899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-33af9960-696c-415a-b163-e48848a09396.0a20052c-1e8c-4b06-91e9-5befa0cbf7ed" returned: 0 in 0.251s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:44:58 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-0c6bd868-b2a9-4628-bf0c-2078c3a323e9 tempest-VolumeDependencyTests-1073688899 None] Lock "cinder-quobyte-0a20052c-1e8c-4b06-91e9-5befa0cbf7ed" released by "_delete_snapshot" :: held 1.391s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:44:58 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-0c6bd868-b2a9-4628-bf0c-2078c3a323e9 tempest-VolumeDependencyTests-1073688899 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 5.207s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:44:58 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-a451cb93-f9a2-43f7-bc99-50a4b5a75710 tempest-VolumesGetTest-1176098524 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.235s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:44:58 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-a451cb93-f9a2-43f7-bc99-50a4b5a75710 tempest-VolumesGetTest-1176098524 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:44:54Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-131734404',display_name='tempest-VolumesGetTest-Volume-1680266547',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f574eaec-95ae-42c2-8e1a-347542a0ab56,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='070ec6e114534bca93d5d121647b843c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:44:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:44:54Z,use_quota=True,user_id='e38f947f25c6490eb48ca43abf9ef753',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8bde7129-1dc4-42ab-b852-ab32c61b4921),volume_type_id=8bde7129-1dc4-42ab-b852-ab32c61b4921)}" {{(pid=88899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 08:44:58 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-a451cb93-f9a2-43f7-bc99-50a4b5a75710 tempest-VolumesGetTest-1176098524 None] Creating volume f574eaec-95ae-42c2-8e1a-347542a0ab56 {{(pid=88899) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 08:44:58 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-a451cb93-f9a2-43f7-bc99-50a4b5a75710 tempest-VolumesGetTest-1176098524 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:44:58 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-a451cb93-f9a2-43f7-bc99-50a4b5a75710 tempest-VolumesGetTest-1176098524 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:44:58 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-a451cb93-f9a2-43f7-bc99-50a4b5a75710 tempest-VolumesGetTest-1176098524 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:44:58 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-a451cb93-f9a2-43f7-bc99-50a4b5a75710 tempest-VolumesGetTest-1176098524 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:44:58 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-a451cb93-f9a2-43f7-bc99-50a4b5a75710 tempest-VolumesGetTest-1176098524 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:44:58 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-a451cb93-f9a2-43f7-bc99-50a4b5a75710 tempest-VolumesGetTest-1176098524 None] Selected osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385 as target Quobyte volume. {{(pid=88899) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 08:44:58 devstack cinder-volume[88899]: INFO cinder.volume.drivers.remotefs [None req-a451cb93-f9a2-43f7-bc99-50a4b5a75710 tempest-VolumesGetTest-1176098524 None] casted to osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385 Aug 03 08:44:58 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-a451cb93-f9a2-43f7-bc99-50a4b5a75710 tempest-VolumesGetTest-1176098524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-f574eaec-95ae-42c2-8e1a-347542a0ab56 1073741824 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:44:58 devstack sudo[105980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-f574eaec-95ae-42c2-8e1a-347542a0ab56 1073741824 Aug 03 08:44:58 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-0c6bd868-b2a9-4628-bf0c-2078c3a323e9 tempest-VolumeDependencyTests-1073688899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7c5b27d-d964-4832-b0c0-9e667cb65d34) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-475b65d3-a899-45ac-913b-c64ae81ffc3c', 'volume_size': 1, 'source_volid': '33af9960-696c-415a-b163-e48848a09396', 'source_volstatus': 'available'}' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:44:58 devstack sudo[105980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:44:58 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-0c6bd868-b2a9-4628-bf0c-2078c3a323e9 tempest-VolumeDependencyTests-1073688899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (78e760b4-567b-47ce-98d6-90f043a1b8f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:44:58 devstack cinder-volume[88899]: INFO cinder.volume.flows.manager.create_volume [None req-0c6bd868-b2a9-4628-bf0c-2078c3a323e9 tempest-VolumeDependencyTests-1073688899 None] Volume volume-475b65d3-a899-45ac-913b-c64ae81ffc3c (475b65d3-a899-45ac-913b-c64ae81ffc3c): created successfully Aug 03 08:44:58 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-0c6bd868-b2a9-4628-bf0c-2078c3a323e9 tempest-VolumeDependencyTests-1073688899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (78e760b4-567b-47ce-98d6-90f043a1b8f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:44:58 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-0c6bd868-b2a9-4628-bf0c-2078c3a323e9 tempest-VolumeDependencyTests-1073688899 None] Flow 'volume_create_manager' (7e40ce63-9981-4e0d-9de9-ff47438ba541) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:44:58 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-0c6bd868-b2a9-4628-bf0c-2078c3a323e9 tempest-VolumeDependencyTests-1073688899 None] Created volume successfully. Aug 03 08:44:58 devstack sudo[105980]: pam_unix(sudo:session): session closed for user root Aug 03 08:44:58 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-a451cb93-f9a2-43f7-bc99-50a4b5a75710 tempest-VolumesGetTest-1176098524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-f574eaec-95ae-42c2-8e1a-347542a0ab56 1073741824" returned: 0 in 0.431s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:44:58 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-a451cb93-f9a2-43f7-bc99-50a4b5a75710 tempest-VolumesGetTest-1176098524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-f574eaec-95ae-42c2-8e1a-347542a0ab56 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:44:58 devstack sudo[105985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-f574eaec-95ae-42c2-8e1a-347542a0ab56 Aug 03 08:44:58 devstack sudo[105985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:44:59 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-0d10cba3-6e05-45a0-ab76-8069badd9439 tempest-VolumeDependencyTests-1073688899 None] Acquiring lock "cinder-db77f550-d390-434b-8115-37b701c9c8bd-delete_snapshot" by "delete_snapshot" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:44:59 devstack sudo[105985]: pam_unix(sudo:session): session closed for user root Aug 03 08:44:59 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-a451cb93-f9a2-43f7-bc99-50a4b5a75710 tempest-VolumesGetTest-1176098524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-f574eaec-95ae-42c2-8e1a-347542a0ab56" returned: 0 in 0.268s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:44:59 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-a451cb93-f9a2-43f7-bc99-50a4b5a75710 tempest-VolumesGetTest-1176098524 None] <== create_volume: return (739ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'} {{(pid=88899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 08:44:59 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-a451cb93-f9a2-43f7-bc99-50a4b5a75710 tempest-VolumesGetTest-1176098524 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.742s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:44:59 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-35f0cbda-9fb2-4931-89c5-110ccf2ea1d5 tempest-CreateVolumesFromSnapshotTest-499945752 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.687s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:44:59 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-35f0cbda-9fb2-4931-89c5-110ccf2ea1d5 tempest-CreateVolumesFromSnapshotTest-499945752 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:44:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1442476352',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=536fdef5-781d-4687-9b4a-8929595c7845,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9487a33641d4d31bb388ed345e2cba1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:44:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:44:54Z,use_quota=True,user_id='dbed2458e8bb45e183e7c8ee6f212513',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8bde7129-1dc4-42ab-b852-ab32c61b4921),volume_type_id=8bde7129-1dc4-42ab-b852-ab32c61b4921)}" {{(pid=88899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 08:44:59 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-35f0cbda-9fb2-4931-89c5-110ccf2ea1d5 tempest-CreateVolumesFromSnapshotTest-499945752 None] Creating volume 536fdef5-781d-4687-9b4a-8929595c7845 {{(pid=88899) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 08:44:59 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-35f0cbda-9fb2-4931-89c5-110ccf2ea1d5 tempest-CreateVolumesFromSnapshotTest-499945752 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:44:59 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-35f0cbda-9fb2-4931-89c5-110ccf2ea1d5 tempest-CreateVolumesFromSnapshotTest-499945752 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:44:59 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-35f0cbda-9fb2-4931-89c5-110ccf2ea1d5 tempest-CreateVolumesFromSnapshotTest-499945752 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:44:59 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-35f0cbda-9fb2-4931-89c5-110ccf2ea1d5 tempest-CreateVolumesFromSnapshotTest-499945752 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:44:59 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-35f0cbda-9fb2-4931-89c5-110ccf2ea1d5 tempest-CreateVolumesFromSnapshotTest-499945752 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:44:59 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-35f0cbda-9fb2-4931-89c5-110ccf2ea1d5 tempest-CreateVolumesFromSnapshotTest-499945752 None] Selected osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385 as target Quobyte volume. {{(pid=88899) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 08:44:59 devstack cinder-volume[88899]: INFO cinder.volume.drivers.remotefs [None req-35f0cbda-9fb2-4931-89c5-110ccf2ea1d5 tempest-CreateVolumesFromSnapshotTest-499945752 None] casted to osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385 Aug 03 08:44:59 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-35f0cbda-9fb2-4931-89c5-110ccf2ea1d5 tempest-CreateVolumesFromSnapshotTest-499945752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-536fdef5-781d-4687-9b4a-8929595c7845 1073741824 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:44:59 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-0d10cba3-6e05-45a0-ab76-8069badd9439 tempest-VolumeDependencyTests-1073688899 None] Lock "cinder-db77f550-d390-434b-8115-37b701c9c8bd-delete_snapshot" acquired by "delete_snapshot" :: waited 0.050s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:44:59 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-0d10cba3-6e05-45a0-ab76-8069badd9439 tempest-VolumeDependencyTests-1073688899 None] Acquiring lock "cinder-quobyte-66ec0c6b-ba7c-4f8a-8c2a-6dbfd6262fc1" by "delete_snapshot" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:44:59 devstack sudo[105988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-536fdef5-781d-4687-9b4a-8929595c7845 1073741824 Aug 03 08:44:59 devstack sudo[105988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:44:59 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-a451cb93-f9a2-43f7-bc99-50a4b5a75710 tempest-VolumesGetTest-1176098524 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (34258290-8eb2-46e0-b6c1-90f05407a5ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f574eaec-95ae-42c2-8e1a-347542a0ab56', 'volume_size': 1}' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:44:59 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-a451cb93-f9a2-43f7-bc99-50a4b5a75710 tempest-VolumesGetTest-1176098524 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (11b367d9-6c18-4059-99d9-18cc0056db16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:44:59 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-0d10cba3-6e05-45a0-ab76-8069badd9439 tempest-VolumeDependencyTests-1073688899 None] Lock "cinder-quobyte-66ec0c6b-ba7c-4f8a-8c2a-6dbfd6262fc1" acquired by "delete_snapshot" :: waited 0.041s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:44:59 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-0d10cba3-6e05-45a0-ab76-8069badd9439 tempest-VolumeDependencyTests-1073688899 None] Acquiring lock "cinder-quobyte-db77f550-d390-434b-8115-37b701c9c8bd" by "_delete_snapshot" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:44:59 devstack cinder-volume[88899]: INFO cinder.volume.flows.manager.create_volume [None req-a451cb93-f9a2-43f7-bc99-50a4b5a75710 tempest-VolumesGetTest-1176098524 None] Volume volume-f574eaec-95ae-42c2-8e1a-347542a0ab56 (f574eaec-95ae-42c2-8e1a-347542a0ab56): created successfully Aug 03 08:44:59 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-a451cb93-f9a2-43f7-bc99-50a4b5a75710 tempest-VolumesGetTest-1176098524 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (11b367d9-6c18-4059-99d9-18cc0056db16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:44:59 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-a451cb93-f9a2-43f7-bc99-50a4b5a75710 tempest-VolumesGetTest-1176098524 None] Flow 'volume_create_manager' (95b8b047-eb19-46ea-afc4-e102db6af215) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:44:59 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-0d10cba3-6e05-45a0-ab76-8069badd9439 tempest-VolumeDependencyTests-1073688899 None] Lock "cinder-quobyte-db77f550-d390-434b-8115-37b701c9c8bd" acquired by "_delete_snapshot" :: waited 0.033s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:44:59 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-0d10cba3-6e05-45a0-ab76-8069badd9439 tempest-VolumeDependencyTests-1073688899 None] Deleting offline snapshot db77f550-d390-434b-8115-37b701c9c8bd of volume 66ec0c6b-ba7c-4f8a-8c2a-6dbfd6262fc1 {{(pid=88899) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 03 08:44:59 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-0d10cba3-6e05-45a0-ab76-8069badd9439 tempest-VolumeDependencyTests-1073688899 None] snapshot_file for this snap is: volume-66ec0c6b-ba7c-4f8a-8c2a-6dbfd6262fc1.db77f550-d390-434b-8115-37b701c9c8bd {{(pid=88899) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 03 08:44:59 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-a451cb93-f9a2-43f7-bc99-50a4b5a75710 tempest-VolumesGetTest-1176098524 None] Created volume successfully. Aug 03 08:44:59 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a617952-f9b9-472f-aa65-f4028010a110]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:44:59 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-0d10cba3-6e05-45a0-ab76-8069badd9439 tempest-VolumeDependencyTests-1073688899 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-66ec0c6b-ba7c-4f8a-8c2a-6dbfd6262fc1.db77f550-d390-434b-8115-37b701c9c8bd {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:44:59 devstack sudo[105990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-66ec0c6b-ba7c-4f8a-8c2a-6dbfd6262fc1.db77f550-d390-434b-8115-37b701c9c8bd Aug 03 08:44:59 devstack sudo[105990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:44:59 devstack sudo[105988]: pam_unix(sudo:session): session closed for user root Aug 03 08:44:59 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-35f0cbda-9fb2-4931-89c5-110ccf2ea1d5 tempest-CreateVolumesFromSnapshotTest-499945752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-536fdef5-781d-4687-9b4a-8929595c7845 1073741824" returned: 0 in 0.467s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:44:59 devstack sudo[105990]: pam_unix(sudo:session): session closed for user root Aug 03 08:44:59 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-0d10cba3-6e05-45a0-ab76-8069badd9439 tempest-VolumeDependencyTests-1073688899 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-66ec0c6b-ba7c-4f8a-8c2a-6dbfd6262fc1.db77f550-d390-434b-8115-37b701c9c8bd" returned: 0 in 0.373s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:44:59 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-0d10cba3-6e05-45a0-ab76-8069badd9439 tempest-VolumeDependencyTests-1073688899 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-66ec0c6b-ba7c-4f8a-8c2a-6dbfd6262fc1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88899) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 03 08:44:59 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-35f0cbda-9fb2-4931-89c5-110ccf2ea1d5 tempest-CreateVolumesFromSnapshotTest-499945752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-536fdef5-781d-4687-9b4a-8929595c7845 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:44:59 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4c6053c-a2da-4c2f-abcb-94d679954bb6]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:44:59 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-0d10cba3-6e05-45a0-ab76-8069badd9439 tempest-VolumeDependencyTests-1073688899 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-66ec0c6b-ba7c-4f8a-8c2a-6dbfd6262fc1 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:44:59 devstack sudo[105998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-536fdef5-781d-4687-9b4a-8929595c7845 Aug 03 08:44:59 devstack sudo[105998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:44:59 devstack sudo[105999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-66ec0c6b-ba7c-4f8a-8c2a-6dbfd6262fc1 Aug 03 08:44:59 devstack sudo[105999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:44:59 devstack sudo[105998]: pam_unix(sudo:session): session closed for user root Aug 03 08:44:59 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-35f0cbda-9fb2-4931-89c5-110ccf2ea1d5 tempest-CreateVolumesFromSnapshotTest-499945752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-536fdef5-781d-4687-9b4a-8929595c7845" returned: 0 in 0.267s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:44:59 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-35f0cbda-9fb2-4931-89c5-110ccf2ea1d5 tempest-CreateVolumesFromSnapshotTest-499945752 None] <== create_volume: return (799ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'} {{(pid=88899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 08:44:59 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-35f0cbda-9fb2-4931-89c5-110ccf2ea1d5 tempest-CreateVolumesFromSnapshotTest-499945752 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.801s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:44:59 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-e9dc7f74-8464-44d4-859c-c8be0b6166c2 tempest-CreateVolumesFromSnapshotTest-499945752 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.173s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:44:59 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-e9dc7f74-8464-44d4-859c-c8be0b6166c2 tempest-CreateVolumesFromSnapshotTest-499945752 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:44:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1665391160',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e12693a7-7a76-4009-a37e-ee176a7499bc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9487a33641d4d31bb388ed345e2cba1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:44:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:44:55Z,use_quota=True,user_id='dbed2458e8bb45e183e7c8ee6f212513',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8bde7129-1dc4-42ab-b852-ab32c61b4921),volume_type_id=8bde7129-1dc4-42ab-b852-ab32c61b4921)}" {{(pid=88899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 08:44:59 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-e9dc7f74-8464-44d4-859c-c8be0b6166c2 tempest-CreateVolumesFromSnapshotTest-499945752 None] Creating volume e12693a7-7a76-4009-a37e-ee176a7499bc {{(pid=88899) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 08:44:59 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-e9dc7f74-8464-44d4-859c-c8be0b6166c2 tempest-CreateVolumesFromSnapshotTest-499945752 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:44:59 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-e9dc7f74-8464-44d4-859c-c8be0b6166c2 tempest-CreateVolumesFromSnapshotTest-499945752 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:44:59 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-e9dc7f74-8464-44d4-859c-c8be0b6166c2 tempest-CreateVolumesFromSnapshotTest-499945752 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:44:59 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-e9dc7f74-8464-44d4-859c-c8be0b6166c2 tempest-CreateVolumesFromSnapshotTest-499945752 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:44:59 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-e9dc7f74-8464-44d4-859c-c8be0b6166c2 tempest-CreateVolumesFromSnapshotTest-499945752 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:44:59 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-e9dc7f74-8464-44d4-859c-c8be0b6166c2 tempest-CreateVolumesFromSnapshotTest-499945752 None] Selected osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385 as target Quobyte volume. {{(pid=88899) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 08:44:59 devstack cinder-volume[88899]: INFO cinder.volume.drivers.remotefs [None req-e9dc7f74-8464-44d4-859c-c8be0b6166c2 tempest-CreateVolumesFromSnapshotTest-499945752 None] casted to osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385 Aug 03 08:44:59 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-e9dc7f74-8464-44d4-859c-c8be0b6166c2 tempest-CreateVolumesFromSnapshotTest-499945752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-e12693a7-7a76-4009-a37e-ee176a7499bc 1073741824 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:44:59 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-35f0cbda-9fb2-4931-89c5-110ccf2ea1d5 tempest-CreateVolumesFromSnapshotTest-499945752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (502fe13a-96c4-4298-b1b3-c6d9c3f6f559) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-536fdef5-781d-4687-9b4a-8929595c7845', 'volume_size': 1}' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:44:59 devstack sudo[106003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-e12693a7-7a76-4009-a37e-ee176a7499bc 1073741824 Aug 03 08:44:59 devstack sudo[106003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:44:59 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-35f0cbda-9fb2-4931-89c5-110ccf2ea1d5 tempest-CreateVolumesFromSnapshotTest-499945752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8d5717f-686b-462a-9d43-3b1d6da2d459) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:44:59 devstack cinder-volume[88899]: INFO cinder.volume.flows.manager.create_volume [None req-35f0cbda-9fb2-4931-89c5-110ccf2ea1d5 tempest-CreateVolumesFromSnapshotTest-499945752 None] Volume volume-536fdef5-781d-4687-9b4a-8929595c7845 (536fdef5-781d-4687-9b4a-8929595c7845): created successfully Aug 03 08:44:59 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-35f0cbda-9fb2-4931-89c5-110ccf2ea1d5 tempest-CreateVolumesFromSnapshotTest-499945752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8d5717f-686b-462a-9d43-3b1d6da2d459) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:44:59 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-35f0cbda-9fb2-4931-89c5-110ccf2ea1d5 tempest-CreateVolumesFromSnapshotTest-499945752 None] Flow 'volume_create_manager' (8c505ab0-0ec3-4e68-8491-07d9da172a19) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:45:00 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-35f0cbda-9fb2-4931-89c5-110ccf2ea1d5 tempest-CreateVolumesFromSnapshotTest-499945752 None] Created volume successfully. Aug 03 08:45:00 devstack sudo[105999]: pam_unix(sudo:session): session closed for user root Aug 03 08:45:00 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-0d10cba3-6e05-45a0-ab76-8069badd9439 tempest-VolumeDependencyTests-1073688899 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-66ec0c6b-ba7c-4f8a-8c2a-6dbfd6262fc1" returned: 0 in 0.597s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:45:00 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-0d10cba3-6e05-45a0-ab76-8069badd9439 tempest-VolumeDependencyTests-1073688899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-66ec0c6b-ba7c-4f8a-8c2a-6dbfd6262fc1.db77f550-d390-434b-8115-37b701c9c8bd {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:45:00 devstack sudo[106011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-66ec0c6b-ba7c-4f8a-8c2a-6dbfd6262fc1.db77f550-d390-434b-8115-37b701c9c8bd Aug 03 08:45:00 devstack sudo[106011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:45:00 devstack sudo[106003]: pam_unix(sudo:session): session closed for user root Aug 03 08:45:00 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-6562835b-3b7d-4d5d-86da-97e0e82b0b3b tempest-VolumesGetTest-1176098524 None] Acquiring lock "cinder-f574eaec-95ae-42c2-8e1a-347542a0ab56-delete_volume" by "delete_volume" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:45:00 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-e9dc7f74-8464-44d4-859c-c8be0b6166c2 tempest-CreateVolumesFromSnapshotTest-499945752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-e12693a7-7a76-4009-a37e-ee176a7499bc 1073741824" returned: 0 in 0.542s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:45:00 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-6562835b-3b7d-4d5d-86da-97e0e82b0b3b tempest-VolumesGetTest-1176098524 None] Lock "cinder-f574eaec-95ae-42c2-8e1a-347542a0ab56-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:45:00 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-e9dc7f74-8464-44d4-859c-c8be0b6166c2 tempest-CreateVolumesFromSnapshotTest-499945752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-e12693a7-7a76-4009-a37e-ee176a7499bc {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:45:00 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-6562835b-3b7d-4d5d-86da-97e0e82b0b3b tempest-VolumesGetTest-1176098524 None] Acquiring lock "cinder-quobyte-f574eaec-95ae-42c2-8e1a-347542a0ab56" by "delete_volume" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:45:00 devstack sudo[106016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-e12693a7-7a76-4009-a37e-ee176a7499bc Aug 03 08:45:00 devstack sudo[106016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:45:00 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-6562835b-3b7d-4d5d-86da-97e0e82b0b3b tempest-VolumesGetTest-1176098524 None] Lock "cinder-quobyte-f574eaec-95ae-42c2-8e1a-347542a0ab56" acquired by "delete_volume" :: waited 0.022s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:45:00 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[5887d36e-b6c7-4be0-b629-2fe7c79e6aa7]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:45:00 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-6562835b-3b7d-4d5d-86da-97e0e82b0b3b tempest-VolumesGetTest-1176098524 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-f574eaec-95ae-42c2-8e1a-347542a0ab56 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:45:00 devstack sudo[106011]: pam_unix(sudo:session): session closed for user root Aug 03 08:45:00 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-0d10cba3-6e05-45a0-ab76-8069badd9439 tempest-VolumeDependencyTests-1073688899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-66ec0c6b-ba7c-4f8a-8c2a-6dbfd6262fc1.db77f550-d390-434b-8115-37b701c9c8bd" returned: 0 in 0.431s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:45:00 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-0d10cba3-6e05-45a0-ab76-8069badd9439 tempest-VolumeDependencyTests-1073688899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-66ec0c6b-ba7c-4f8a-8c2a-6dbfd6262fc1.db77f550-d390-434b-8115-37b701c9c8bd {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:45:00 devstack sudo[106021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-66ec0c6b-ba7c-4f8a-8c2a-6dbfd6262fc1.db77f550-d390-434b-8115-37b701c9c8bd Aug 03 08:45:00 devstack sudo[106021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:45:00 devstack sudo[106020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-f574eaec-95ae-42c2-8e1a-347542a0ab56 Aug 03 08:45:00 devstack sudo[106020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:45:00 devstack sudo[106016]: pam_unix(sudo:session): session closed for user root Aug 03 08:45:00 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-e9dc7f74-8464-44d4-859c-c8be0b6166c2 tempest-CreateVolumesFromSnapshotTest-499945752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-e12693a7-7a76-4009-a37e-ee176a7499bc" returned: 0 in 0.260s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:45:00 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-e9dc7f74-8464-44d4-859c-c8be0b6166c2 tempest-CreateVolumesFromSnapshotTest-499945752 None] <== create_volume: return (878ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'} {{(pid=88899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 08:45:00 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-e9dc7f74-8464-44d4-859c-c8be0b6166c2 tempest-CreateVolumesFromSnapshotTest-499945752 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.881s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:45:00 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-52d5056f-aea1-4fb6-a30b-dd9f27ef4a91 tempest-CreateVolumesFromSnapshotTest-499945752 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.713s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:45:00 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-52d5056f-aea1-4fb6-a30b-dd9f27ef4a91 tempest-CreateVolumesFromSnapshotTest-499945752 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:44:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1743353426',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed402e41-3ba8-4546-ba67-4c213b01988b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9487a33641d4d31bb388ed345e2cba1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:44:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:44:55Z,use_quota=True,user_id='dbed2458e8bb45e183e7c8ee6f212513',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8bde7129-1dc4-42ab-b852-ab32c61b4921),volume_type_id=8bde7129-1dc4-42ab-b852-ab32c61b4921)}" {{(pid=88899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 08:45:00 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-52d5056f-aea1-4fb6-a30b-dd9f27ef4a91 tempest-CreateVolumesFromSnapshotTest-499945752 None] Creating volume ed402e41-3ba8-4546-ba67-4c213b01988b {{(pid=88899) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 08:45:00 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-52d5056f-aea1-4fb6-a30b-dd9f27ef4a91 tempest-CreateVolumesFromSnapshotTest-499945752 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:45:00 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-52d5056f-aea1-4fb6-a30b-dd9f27ef4a91 tempest-CreateVolumesFromSnapshotTest-499945752 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:45:00 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-52d5056f-aea1-4fb6-a30b-dd9f27ef4a91 tempest-CreateVolumesFromSnapshotTest-499945752 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:45:00 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-52d5056f-aea1-4fb6-a30b-dd9f27ef4a91 tempest-CreateVolumesFromSnapshotTest-499945752 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:45:00 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-52d5056f-aea1-4fb6-a30b-dd9f27ef4a91 tempest-CreateVolumesFromSnapshotTest-499945752 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:45:00 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-52d5056f-aea1-4fb6-a30b-dd9f27ef4a91 tempest-CreateVolumesFromSnapshotTest-499945752 None] Selected osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385 as target Quobyte volume. {{(pid=88899) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 08:45:00 devstack cinder-volume[88899]: INFO cinder.volume.drivers.remotefs [None req-52d5056f-aea1-4fb6-a30b-dd9f27ef4a91 tempest-CreateVolumesFromSnapshotTest-499945752 None] casted to osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385 Aug 03 08:45:00 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-52d5056f-aea1-4fb6-a30b-dd9f27ef4a91 tempest-CreateVolumesFromSnapshotTest-499945752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-ed402e41-3ba8-4546-ba67-4c213b01988b 1073741824 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:45:00 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-e9dc7f74-8464-44d4-859c-c8be0b6166c2 tempest-CreateVolumesFromSnapshotTest-499945752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68fdfab5-f568-44a2-8d85-452c5a3b9e93) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e12693a7-7a76-4009-a37e-ee176a7499bc', 'volume_size': 1}' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:45:00 devstack sudo[106025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-ed402e41-3ba8-4546-ba67-4c213b01988b 1073741824 Aug 03 08:45:00 devstack sudo[106025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:45:00 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-e9dc7f74-8464-44d4-859c-c8be0b6166c2 tempest-CreateVolumesFromSnapshotTest-499945752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (deec5f79-903c-4bdb-b570-3985a0a49e0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:45:00 devstack cinder-volume[88899]: INFO cinder.volume.flows.manager.create_volume [None req-e9dc7f74-8464-44d4-859c-c8be0b6166c2 tempest-CreateVolumesFromSnapshotTest-499945752 None] Volume volume-e12693a7-7a76-4009-a37e-ee176a7499bc (e12693a7-7a76-4009-a37e-ee176a7499bc): created successfully Aug 03 08:45:00 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-e9dc7f74-8464-44d4-859c-c8be0b6166c2 tempest-CreateVolumesFromSnapshotTest-499945752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (deec5f79-903c-4bdb-b570-3985a0a49e0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:45:00 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-e9dc7f74-8464-44d4-859c-c8be0b6166c2 tempest-CreateVolumesFromSnapshotTest-499945752 None] Flow 'volume_create_manager' (f1973236-2bcb-497e-8a18-aa24ba598136) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:45:00 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-e9dc7f74-8464-44d4-859c-c8be0b6166c2 tempest-CreateVolumesFromSnapshotTest-499945752 None] Created volume successfully. Aug 03 08:45:00 devstack sudo[106021]: pam_unix(sudo:session): session closed for user root Aug 03 08:45:00 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-0d10cba3-6e05-45a0-ab76-8069badd9439 tempest-VolumeDependencyTests-1073688899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-66ec0c6b-ba7c-4f8a-8c2a-6dbfd6262fc1.db77f550-d390-434b-8115-37b701c9c8bd" returned: 0 in 0.312s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:45:01 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-0d10cba3-6e05-45a0-ab76-8069badd9439 tempest-VolumeDependencyTests-1073688899 None] Lock "cinder-quobyte-db77f550-d390-434b-8115-37b701c9c8bd" released by "_delete_snapshot" :: held 1.842s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:45:01 devstack sudo[106020]: pam_unix(sudo:session): session closed for user root Aug 03 08:45:01 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-0d10cba3-6e05-45a0-ab76-8069badd9439 tempest-VolumeDependencyTests-1073688899 None] Lock "cinder-quobyte-66ec0c6b-ba7c-4f8a-8c2a-6dbfd6262fc1" released by "delete_snapshot" :: held 1.886s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:45:01 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-6562835b-3b7d-4d5d-86da-97e0e82b0b3b tempest-VolumesGetTest-1176098524 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-f574eaec-95ae-42c2-8e1a-347542a0ab56" returned: 0 in 0.472s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:45:01 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-6562835b-3b7d-4d5d-86da-97e0e82b0b3b tempest-VolumesGetTest-1176098524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-f574eaec-95ae-42c2-8e1a-347542a0ab56 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:45:01 devstack sudo[106033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-f574eaec-95ae-42c2-8e1a-347542a0ab56 Aug 03 08:45:01 devstack sudo[106033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:45:01 devstack cinder-volume[88899]: DEBUG cinder.quota [None req-0d10cba3-6e05-45a0-ab76-8069badd9439 tempest-VolumeDependencyTests-1073688899 None] Created reservations ['c07758c9-2669-4efa-a74a-180b1a7c1eb0', '15e4ed2e-24e2-414b-8239-749c06801f72', 'c1695d95-34d7-4919-a2c4-9d5eb4e57198', 'f888d7cb-2296-46e0-8b07-b85f1f8c942c'] {{(pid=88899) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 08:45:01 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-0d10cba3-6e05-45a0-ab76-8069badd9439 tempest-VolumeDependencyTests-1073688899 None] Delete snapshot completed successfully. Aug 03 08:45:01 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-0d10cba3-6e05-45a0-ab76-8069badd9439 tempest-VolumeDependencyTests-1073688899 None] Lock "cinder-db77f550-d390-434b-8115-37b701c9c8bd-delete_snapshot" released by "delete_snapshot" :: held 2.114s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:45:01 devstack sudo[106025]: pam_unix(sudo:session): session closed for user root Aug 03 08:45:01 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-52d5056f-aea1-4fb6-a30b-dd9f27ef4a91 tempest-CreateVolumesFromSnapshotTest-499945752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-ed402e41-3ba8-4546-ba67-4c213b01988b 1073741824" returned: 0 in 0.542s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:45:01 devstack sudo[106033]: pam_unix(sudo:session): session closed for user root Aug 03 08:45:01 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-6562835b-3b7d-4d5d-86da-97e0e82b0b3b tempest-VolumesGetTest-1176098524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-f574eaec-95ae-42c2-8e1a-347542a0ab56" returned: 0 in 0.282s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:45:01 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-6562835b-3b7d-4d5d-86da-97e0e82b0b3b tempest-VolumesGetTest-1176098524 None] Lock "cinder-quobyte-f574eaec-95ae-42c2-8e1a-347542a0ab56" released by "delete_volume" :: held 0.802s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:45:01 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-52d5056f-aea1-4fb6-a30b-dd9f27ef4a91 tempest-CreateVolumesFromSnapshotTest-499945752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-ed402e41-3ba8-4546-ba67-4c213b01988b {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:45:01 devstack sudo[106038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-ed402e41-3ba8-4546-ba67-4c213b01988b Aug 03 08:45:01 devstack sudo[106038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:45:01 devstack cinder-volume[88899]: DEBUG cinder.quota [None req-6562835b-3b7d-4d5d-86da-97e0e82b0b3b tempest-VolumesGetTest-1176098524 None] Created reservations ['82615a0d-7ce1-4a80-bddb-7fd7e552ac1b', '02ec1791-6145-4465-876a-ef44734104f3', 'd71b4c88-07a8-4019-8ddc-3fdb82becd96', 'a4daa0cd-e8ea-4eb7-822e-6b0e6275d467'] {{(pid=88899) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 08:45:01 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-6562835b-3b7d-4d5d-86da-97e0e82b0b3b tempest-VolumesGetTest-1176098524 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:45:01 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-6562835b-3b7d-4d5d-86da-97e0e82b0b3b tempest-VolumesGetTest-1176098524 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:45:01 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-6562835b-3b7d-4d5d-86da-97e0e82b0b3b tempest-VolumesGetTest-1176098524 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:45:01 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-6562835b-3b7d-4d5d-86da-97e0e82b0b3b tempest-VolumesGetTest-1176098524 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:45:01 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-6562835b-3b7d-4d5d-86da-97e0e82b0b3b tempest-VolumesGetTest-1176098524 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:45:01 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-6562835b-3b7d-4d5d-86da-97e0e82b0b3b tempest-VolumesGetTest-1176098524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:45:01 devstack sudo[106043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a Aug 03 08:45:01 devstack sudo[106043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:45:01 devstack sudo[106038]: pam_unix(sudo:session): session closed for user root Aug 03 08:45:01 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-52d5056f-aea1-4fb6-a30b-dd9f27ef4a91 tempest-CreateVolumesFromSnapshotTest-499945752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-ed402e41-3ba8-4546-ba67-4c213b01988b" returned: 0 in 0.271s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:45:01 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-52d5056f-aea1-4fb6-a30b-dd9f27ef4a91 tempest-CreateVolumesFromSnapshotTest-499945752 None] <== create_volume: return (874ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'} {{(pid=88899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 08:45:01 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-52d5056f-aea1-4fb6-a30b-dd9f27ef4a91 tempest-CreateVolumesFromSnapshotTest-499945752 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.877s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:45:01 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-4c0fdff8-66d4-44f7-9d35-0a57e2c55336 tempest-CreateVolumesFromSnapshotTest-499945752 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.158s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:45:01 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-4c0fdff8-66d4-44f7-9d35-0a57e2c55336 tempest-CreateVolumesFromSnapshotTest-499945752 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:44:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1746577603',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f04dfd17-ebd5-46dc-a05d-ed7b6eeb311c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9487a33641d4d31bb388ed345e2cba1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:44:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:44:55Z,use_quota=True,user_id='dbed2458e8bb45e183e7c8ee6f212513',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8bde7129-1dc4-42ab-b852-ab32c61b4921),volume_type_id=8bde7129-1dc4-42ab-b852-ab32c61b4921)}" {{(pid=88899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 08:45:01 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-4c0fdff8-66d4-44f7-9d35-0a57e2c55336 tempest-CreateVolumesFromSnapshotTest-499945752 None] Creating volume f04dfd17-ebd5-46dc-a05d-ed7b6eeb311c {{(pid=88899) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 08:45:01 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-4c0fdff8-66d4-44f7-9d35-0a57e2c55336 tempest-CreateVolumesFromSnapshotTest-499945752 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:45:01 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-4c0fdff8-66d4-44f7-9d35-0a57e2c55336 tempest-CreateVolumesFromSnapshotTest-499945752 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:45:01 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-4c0fdff8-66d4-44f7-9d35-0a57e2c55336 tempest-CreateVolumesFromSnapshotTest-499945752 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:45:01 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-4c0fdff8-66d4-44f7-9d35-0a57e2c55336 tempest-CreateVolumesFromSnapshotTest-499945752 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:45:01 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-4c0fdff8-66d4-44f7-9d35-0a57e2c55336 tempest-CreateVolumesFromSnapshotTest-499945752 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:45:01 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-4c0fdff8-66d4-44f7-9d35-0a57e2c55336 tempest-CreateVolumesFromSnapshotTest-499945752 None] Selected osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385 as target Quobyte volume. {{(pid=88899) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 08:45:01 devstack cinder-volume[88899]: INFO cinder.volume.drivers.remotefs [None req-4c0fdff8-66d4-44f7-9d35-0a57e2c55336 tempest-CreateVolumesFromSnapshotTest-499945752 None] casted to osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385 Aug 03 08:45:01 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-4c0fdff8-66d4-44f7-9d35-0a57e2c55336 tempest-CreateVolumesFromSnapshotTest-499945752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-f04dfd17-ebd5-46dc-a05d-ed7b6eeb311c 1073741824 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:45:01 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-3c966e6e-285d-4d3e-98f8-520b4b16eabe tempest-VolumesGetTest-1176098524 None] Acquiring lock "cinder-b891511d-e5f7-4909-842f-e479e44868c1-delete_volume" by "delete_volume" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:45:01 devstack sudo[106046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-f04dfd17-ebd5-46dc-a05d-ed7b6eeb311c 1073741824 Aug 03 08:45:01 devstack sudo[106046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:45:01 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-52d5056f-aea1-4fb6-a30b-dd9f27ef4a91 tempest-CreateVolumesFromSnapshotTest-499945752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (90083184-3780-4723-8ffc-778c8b963741) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ed402e41-3ba8-4546-ba67-4c213b01988b', 'volume_size': 1}' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:45:01 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-52d5056f-aea1-4fb6-a30b-dd9f27ef4a91 tempest-CreateVolumesFromSnapshotTest-499945752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d918ccb-865d-4d0f-96cb-86d24e0b04f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:45:01 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-3c966e6e-285d-4d3e-98f8-520b4b16eabe tempest-VolumesGetTest-1176098524 None] Lock "cinder-b891511d-e5f7-4909-842f-e479e44868c1-delete_volume" acquired by "delete_volume" :: waited 0.058s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:45:01 devstack cinder-volume[88899]: INFO cinder.volume.flows.manager.create_volume [None req-52d5056f-aea1-4fb6-a30b-dd9f27ef4a91 tempest-CreateVolumesFromSnapshotTest-499945752 None] Volume volume-ed402e41-3ba8-4546-ba67-4c213b01988b (ed402e41-3ba8-4546-ba67-4c213b01988b): created successfully Aug 03 08:45:01 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-52d5056f-aea1-4fb6-a30b-dd9f27ef4a91 tempest-CreateVolumesFromSnapshotTest-499945752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d918ccb-865d-4d0f-96cb-86d24e0b04f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:45:01 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-52d5056f-aea1-4fb6-a30b-dd9f27ef4a91 tempest-CreateVolumesFromSnapshotTest-499945752 None] Flow 'volume_create_manager' (40fed876-4564-4fa8-b1a8-ec1472441d18) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:45:01 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-52d5056f-aea1-4fb6-a30b-dd9f27ef4a91 tempest-CreateVolumesFromSnapshotTest-499945752 None] Created volume successfully. Aug 03 08:45:01 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-3c966e6e-285d-4d3e-98f8-520b4b16eabe tempest-VolumesGetTest-1176098524 None] Acquiring lock "cinder-quobyte-b891511d-e5f7-4909-842f-e479e44868c1" by "delete_volume" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:45:01 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-3c966e6e-285d-4d3e-98f8-520b4b16eabe tempest-VolumesGetTest-1176098524 None] Lock "cinder-quobyte-b891511d-e5f7-4909-842f-e479e44868c1" acquired by "delete_volume" :: waited 0.020s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:45:01 devstack sudo[106043]: pam_unix(sudo:session): session closed for user root Aug 03 08:45:01 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-6562835b-3b7d-4d5d-86da-97e0e82b0b3b tempest-VolumesGetTest-1176098524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a" returned: 0 in 0.342s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:45:01 devstack cinder-volume[88899]: DEBUG cinder.manager [None req-6562835b-3b7d-4d5d-86da-97e0e82b0b3b tempest-VolumesGetTest-1176098524 None] Notifying Schedulers of capabilities ... {{(pid=88899) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 08:45:01 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-6562835b-3b7d-4d5d-86da-97e0e82b0b3b tempest-VolumesGetTest-1176098524 None] Deleted volume successfully. Aug 03 08:45:01 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef37158c-dac2-428d-afdb-822377897723]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:45:01 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-3c966e6e-285d-4d3e-98f8-520b4b16eabe tempest-VolumesGetTest-1176098524 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-b891511d-e5f7-4909-842f-e479e44868c1 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:45:01 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-6562835b-3b7d-4d5d-86da-97e0e82b0b3b tempest-VolumesGetTest-1176098524 None] Lock "cinder-f574eaec-95ae-42c2-8e1a-347542a0ab56-delete_volume" released by "delete_volume" :: held 1.423s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:45:02 devstack sudo[106049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-b891511d-e5f7-4909-842f-e479e44868c1 Aug 03 08:45:02 devstack sudo[106049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:45:02 devstack sudo[106046]: pam_unix(sudo:session): session closed for user root Aug 03 08:45:02 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-4c0fdff8-66d4-44f7-9d35-0a57e2c55336 tempest-CreateVolumesFromSnapshotTest-499945752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-f04dfd17-ebd5-46dc-a05d-ed7b6eeb311c 1073741824" returned: 0 in 0.542s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:45:02 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-9d9a22af-0b34-4a3b-8a0d-a33de5bdb251 tempest-VolumeDependencyTests-1073688899 None] Acquiring lock "cinder-db51ea83-ee57-4e9e-b0f3-65e6e31570dc-delete_snapshot" by "delete_snapshot" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:45:02 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-4c0fdff8-66d4-44f7-9d35-0a57e2c55336 tempest-CreateVolumesFromSnapshotTest-499945752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-f04dfd17-ebd5-46dc-a05d-ed7b6eeb311c {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:45:02 devstack sudo[106091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-f04dfd17-ebd5-46dc-a05d-ed7b6eeb311c Aug 03 08:45:02 devstack sudo[106091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:45:02 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-9d9a22af-0b34-4a3b-8a0d-a33de5bdb251 tempest-VolumeDependencyTests-1073688899 None] Lock "cinder-db51ea83-ee57-4e9e-b0f3-65e6e31570dc-delete_snapshot" acquired by "delete_snapshot" :: waited 0.044s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:45:02 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-9d9a22af-0b34-4a3b-8a0d-a33de5bdb251 tempest-VolumeDependencyTests-1073688899 None] Acquiring lock "cinder-quobyte-e46018f8-fcf9-4900-a1d8-c08fccbd5379" by "delete_snapshot" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:45:02 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-9d9a22af-0b34-4a3b-8a0d-a33de5bdb251 tempest-VolumeDependencyTests-1073688899 None] Lock "cinder-quobyte-e46018f8-fcf9-4900-a1d8-c08fccbd5379" acquired by "delete_snapshot" :: waited 0.016s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:45:02 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-9d9a22af-0b34-4a3b-8a0d-a33de5bdb251 tempest-VolumeDependencyTests-1073688899 None] Acquiring lock "cinder-quobyte-db51ea83-ee57-4e9e-b0f3-65e6e31570dc" by "_delete_snapshot" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:45:02 devstack sudo[106049]: pam_unix(sudo:session): session closed for user root Aug 03 08:45:02 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-9d9a22af-0b34-4a3b-8a0d-a33de5bdb251 tempest-VolumeDependencyTests-1073688899 None] Lock "cinder-quobyte-db51ea83-ee57-4e9e-b0f3-65e6e31570dc" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:45:02 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-9d9a22af-0b34-4a3b-8a0d-a33de5bdb251 tempest-VolumeDependencyTests-1073688899 None] Deleting offline snapshot db51ea83-ee57-4e9e-b0f3-65e6e31570dc of volume e46018f8-fcf9-4900-a1d8-c08fccbd5379 {{(pid=88899) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 03 08:45:02 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-9d9a22af-0b34-4a3b-8a0d-a33de5bdb251 tempest-VolumeDependencyTests-1073688899 None] snapshot_file for this snap is: volume-e46018f8-fcf9-4900-a1d8-c08fccbd5379.db51ea83-ee57-4e9e-b0f3-65e6e31570dc {{(pid=88899) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 03 08:45:02 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-3c966e6e-285d-4d3e-98f8-520b4b16eabe tempest-VolumesGetTest-1176098524 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-b891511d-e5f7-4909-842f-e479e44868c1" returned: 0 in 0.510s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:45:02 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-3c966e6e-285d-4d3e-98f8-520b4b16eabe tempest-VolumesGetTest-1176098524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-b891511d-e5f7-4909-842f-e479e44868c1 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:45:02 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[8740a3b3-069f-4724-91d6-45e6cef64f49]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:45:02 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-9d9a22af-0b34-4a3b-8a0d-a33de5bdb251 tempest-VolumeDependencyTests-1073688899 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-e46018f8-fcf9-4900-a1d8-c08fccbd5379.db51ea83-ee57-4e9e-b0f3-65e6e31570dc {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:45:02 devstack sudo[106093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-b891511d-e5f7-4909-842f-e479e44868c1 Aug 03 08:45:02 devstack sudo[106093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:45:02 devstack sudo[106094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-e46018f8-fcf9-4900-a1d8-c08fccbd5379.db51ea83-ee57-4e9e-b0f3-65e6e31570dc Aug 03 08:45:02 devstack sudo[106094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:45:02 devstack sudo[106091]: pam_unix(sudo:session): session closed for user root Aug 03 08:45:02 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-4c0fdff8-66d4-44f7-9d35-0a57e2c55336 tempest-CreateVolumesFromSnapshotTest-499945752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-f04dfd17-ebd5-46dc-a05d-ed7b6eeb311c" returned: 0 in 0.309s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:45:02 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-4c0fdff8-66d4-44f7-9d35-0a57e2c55336 tempest-CreateVolumesFromSnapshotTest-499945752 None] <== create_volume: return (929ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'} {{(pid=88899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 08:45:02 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-4c0fdff8-66d4-44f7-9d35-0a57e2c55336 tempest-CreateVolumesFromSnapshotTest-499945752 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.932s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:45:02 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-7fd33681-8508-47da-867e-bb74fa3fee67 tempest-CreateVolumesFromSnapshotTest-499945752 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.771s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:45:02 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-7fd33681-8508-47da-867e-bb74fa3fee67 tempest-CreateVolumesFromSnapshotTest-499945752 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:44:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1191649371',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f02c5e58-ce3d-40c4-80e1-de7a35fef297,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9487a33641d4d31bb388ed345e2cba1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:44:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:44:56Z,use_quota=True,user_id='dbed2458e8bb45e183e7c8ee6f212513',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8bde7129-1dc4-42ab-b852-ab32c61b4921),volume_type_id=8bde7129-1dc4-42ab-b852-ab32c61b4921)}" {{(pid=88899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 08:45:02 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-7fd33681-8508-47da-867e-bb74fa3fee67 tempest-CreateVolumesFromSnapshotTest-499945752 None] Creating volume f02c5e58-ce3d-40c4-80e1-de7a35fef297 {{(pid=88899) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 08:45:02 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-7fd33681-8508-47da-867e-bb74fa3fee67 tempest-CreateVolumesFromSnapshotTest-499945752 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:45:02 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-7fd33681-8508-47da-867e-bb74fa3fee67 tempest-CreateVolumesFromSnapshotTest-499945752 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:45:02 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-7fd33681-8508-47da-867e-bb74fa3fee67 tempest-CreateVolumesFromSnapshotTest-499945752 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:45:02 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-7fd33681-8508-47da-867e-bb74fa3fee67 tempest-CreateVolumesFromSnapshotTest-499945752 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:45:02 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-7fd33681-8508-47da-867e-bb74fa3fee67 tempest-CreateVolumesFromSnapshotTest-499945752 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:45:02 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-7fd33681-8508-47da-867e-bb74fa3fee67 tempest-CreateVolumesFromSnapshotTest-499945752 None] Selected osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385 as target Quobyte volume. {{(pid=88899) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 08:45:02 devstack cinder-volume[88899]: INFO cinder.volume.drivers.remotefs [None req-7fd33681-8508-47da-867e-bb74fa3fee67 tempest-CreateVolumesFromSnapshotTest-499945752 None] casted to osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385 Aug 03 08:45:02 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-7fd33681-8508-47da-867e-bb74fa3fee67 tempest-CreateVolumesFromSnapshotTest-499945752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-f02c5e58-ce3d-40c4-80e1-de7a35fef297 1073741824 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:45:02 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-4c0fdff8-66d4-44f7-9d35-0a57e2c55336 tempest-CreateVolumesFromSnapshotTest-499945752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c76cb74e-605a-49e7-a085-9fae09b2fe18) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f04dfd17-ebd5-46dc-a05d-ed7b6eeb311c', 'volume_size': 1}' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:45:02 devstack sudo[106100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-f02c5e58-ce3d-40c4-80e1-de7a35fef297 1073741824 Aug 03 08:45:02 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-4c0fdff8-66d4-44f7-9d35-0a57e2c55336 tempest-CreateVolumesFromSnapshotTest-499945752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (88cab60f-88ce-4895-ae79-271a9e914849) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:45:02 devstack sudo[106100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:45:02 devstack cinder-volume[88899]: INFO cinder.volume.flows.manager.create_volume [None req-4c0fdff8-66d4-44f7-9d35-0a57e2c55336 tempest-CreateVolumesFromSnapshotTest-499945752 None] Volume volume-f04dfd17-ebd5-46dc-a05d-ed7b6eeb311c (f04dfd17-ebd5-46dc-a05d-ed7b6eeb311c): created successfully Aug 03 08:45:02 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-4c0fdff8-66d4-44f7-9d35-0a57e2c55336 tempest-CreateVolumesFromSnapshotTest-499945752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (88cab60f-88ce-4895-ae79-271a9e914849) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:45:02 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-4c0fdff8-66d4-44f7-9d35-0a57e2c55336 tempest-CreateVolumesFromSnapshotTest-499945752 None] Flow 'volume_create_manager' (ff614373-7e92-4e94-9070-4aae9359b861) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:45:02 devstack sudo[106093]: pam_unix(sudo:session): session closed for user root Aug 03 08:45:02 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-3c966e6e-285d-4d3e-98f8-520b4b16eabe tempest-VolumesGetTest-1176098524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-b891511d-e5f7-4909-842f-e479e44868c1" returned: 0 in 0.306s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:45:02 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-3c966e6e-285d-4d3e-98f8-520b4b16eabe tempest-VolumesGetTest-1176098524 None] Lock "cinder-quobyte-b891511d-e5f7-4909-842f-e479e44868c1" released by "delete_volume" :: held 0.872s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:45:02 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-4c0fdff8-66d4-44f7-9d35-0a57e2c55336 tempest-CreateVolumesFromSnapshotTest-499945752 None] Created volume successfully. Aug 03 08:45:02 devstack cinder-volume[88899]: DEBUG cinder.quota [None req-3c966e6e-285d-4d3e-98f8-520b4b16eabe tempest-VolumesGetTest-1176098524 None] Created reservations ['853c2094-6fd6-4db6-8174-12e0a15002fa', '76cd979f-8967-42a1-86b9-7d0cfc25f569', 'aaf6bdad-9096-4de6-b317-77b6ff312b68', '0a913c00-b6aa-42ab-b564-3de6fb7ac5b7'] {{(pid=88899) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 08:45:02 devstack sudo[106094]: pam_unix(sudo:session): session closed for user root Aug 03 08:45:02 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-9d9a22af-0b34-4a3b-8a0d-a33de5bdb251 tempest-VolumeDependencyTests-1073688899 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-e46018f8-fcf9-4900-a1d8-c08fccbd5379.db51ea83-ee57-4e9e-b0f3-65e6e31570dc" returned: 0 in 0.442s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:45:02 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-9d9a22af-0b34-4a3b-8a0d-a33de5bdb251 tempest-VolumeDependencyTests-1073688899 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e46018f8-fcf9-4900-a1d8-c08fccbd5379(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88899) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 03 08:45:02 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[a70d5bb1-de35-4185-b1c1-d1b22d5d394b]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:45:02 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-9d9a22af-0b34-4a3b-8a0d-a33de5bdb251 tempest-VolumeDependencyTests-1073688899 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-e46018f8-fcf9-4900-a1d8-c08fccbd5379 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:45:02 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-3c966e6e-285d-4d3e-98f8-520b4b16eabe tempest-VolumesGetTest-1176098524 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:45:02 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-3c966e6e-285d-4d3e-98f8-520b4b16eabe tempest-VolumesGetTest-1176098524 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:45:02 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-3c966e6e-285d-4d3e-98f8-520b4b16eabe tempest-VolumesGetTest-1176098524 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:45:02 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-3c966e6e-285d-4d3e-98f8-520b4b16eabe tempest-VolumesGetTest-1176098524 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:45:02 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-3c966e6e-285d-4d3e-98f8-520b4b16eabe tempest-VolumesGetTest-1176098524 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:45:02 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-3c966e6e-285d-4d3e-98f8-520b4b16eabe tempest-VolumesGetTest-1176098524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:45:02 devstack sudo[106110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a Aug 03 08:45:02 devstack sudo[106110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:45:03 devstack sudo[106107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-e46018f8-fcf9-4900-a1d8-c08fccbd5379 Aug 03 08:45:03 devstack sudo[106107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:45:03 devstack sudo[106100]: pam_unix(sudo:session): session closed for user root Aug 03 08:45:03 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-7fd33681-8508-47da-867e-bb74fa3fee67 tempest-CreateVolumesFromSnapshotTest-499945752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-f02c5e58-ce3d-40c4-80e1-de7a35fef297 1073741824" returned: 0 in 0.518s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:45:03 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-7fd33681-8508-47da-867e-bb74fa3fee67 tempest-CreateVolumesFromSnapshotTest-499945752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-f02c5e58-ce3d-40c4-80e1-de7a35fef297 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:45:03 devstack sudo[106110]: pam_unix(sudo:session): session closed for user root Aug 03 08:45:03 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-3c966e6e-285d-4d3e-98f8-520b4b16eabe tempest-VolumesGetTest-1176098524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a" returned: 0 in 0.278s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:45:03 devstack cinder-volume[88899]: DEBUG cinder.manager [None req-3c966e6e-285d-4d3e-98f8-520b4b16eabe tempest-VolumesGetTest-1176098524 None] Notifying Schedulers of capabilities ... {{(pid=88899) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 08:45:03 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-3c966e6e-285d-4d3e-98f8-520b4b16eabe tempest-VolumesGetTest-1176098524 None] Deleted volume successfully. Aug 03 08:45:03 devstack sudo[106115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-f02c5e58-ce3d-40c4-80e1-de7a35fef297 Aug 03 08:45:03 devstack sudo[106115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:45:03 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-3c966e6e-285d-4d3e-98f8-520b4b16eabe tempest-VolumesGetTest-1176098524 None] Lock "cinder-b891511d-e5f7-4909-842f-e479e44868c1-delete_volume" released by "delete_volume" :: held 1.459s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:45:03 devstack sudo[106107]: pam_unix(sudo:session): session closed for user root Aug 03 08:45:03 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-9d9a22af-0b34-4a3b-8a0d-a33de5bdb251 tempest-VolumeDependencyTests-1073688899 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-e46018f8-fcf9-4900-a1d8-c08fccbd5379" returned: 0 in 0.417s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:45:03 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-9d9a22af-0b34-4a3b-8a0d-a33de5bdb251 tempest-VolumeDependencyTests-1073688899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-e46018f8-fcf9-4900-a1d8-c08fccbd5379.db51ea83-ee57-4e9e-b0f3-65e6e31570dc {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:45:03 devstack sudo[106120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-e46018f8-fcf9-4900-a1d8-c08fccbd5379.db51ea83-ee57-4e9e-b0f3-65e6e31570dc Aug 03 08:45:03 devstack sudo[106120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:45:03 devstack sudo[106115]: pam_unix(sudo:session): session closed for user root Aug 03 08:45:03 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-7fd33681-8508-47da-867e-bb74fa3fee67 tempest-CreateVolumesFromSnapshotTest-499945752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-f02c5e58-ce3d-40c4-80e1-de7a35fef297" returned: 0 in 0.261s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:45:03 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-7fd33681-8508-47da-867e-bb74fa3fee67 tempest-CreateVolumesFromSnapshotTest-499945752 None] <== create_volume: return (829ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'} {{(pid=88899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 08:45:03 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-7fd33681-8508-47da-867e-bb74fa3fee67 tempest-CreateVolumesFromSnapshotTest-499945752 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.832s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:45:03 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-7fd33681-8508-47da-867e-bb74fa3fee67 tempest-CreateVolumesFromSnapshotTest-499945752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f6978d5-0ab9-4695-9d7c-66ab5217df71) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f02c5e58-ce3d-40c4-80e1-de7a35fef297', 'volume_size': 1}' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:45:03 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-7fd33681-8508-47da-867e-bb74fa3fee67 tempest-CreateVolumesFromSnapshotTest-499945752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a31b49cb-1f67-4663-b102-238ffe238bee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:45:03 devstack cinder-volume[88899]: INFO cinder.volume.flows.manager.create_volume [None req-7fd33681-8508-47da-867e-bb74fa3fee67 tempest-CreateVolumesFromSnapshotTest-499945752 None] Volume volume-f02c5e58-ce3d-40c4-80e1-de7a35fef297 (f02c5e58-ce3d-40c4-80e1-de7a35fef297): created successfully Aug 03 08:45:03 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-7fd33681-8508-47da-867e-bb74fa3fee67 tempest-CreateVolumesFromSnapshotTest-499945752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a31b49cb-1f67-4663-b102-238ffe238bee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:45:03 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-7fd33681-8508-47da-867e-bb74fa3fee67 tempest-CreateVolumesFromSnapshotTest-499945752 None] Flow 'volume_create_manager' (cb38a76e-b56f-49f3-8c57-a3f1ab83d64b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:45:03 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-7fd33681-8508-47da-867e-bb74fa3fee67 tempest-CreateVolumesFromSnapshotTest-499945752 None] Created volume successfully. Aug 03 08:45:03 devstack sudo[106120]: pam_unix(sudo:session): session closed for user root Aug 03 08:45:03 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-9d9a22af-0b34-4a3b-8a0d-a33de5bdb251 tempest-VolumeDependencyTests-1073688899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-e46018f8-fcf9-4900-a1d8-c08fccbd5379.db51ea83-ee57-4e9e-b0f3-65e6e31570dc" returned: 0 in 0.363s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:45:03 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-9d9a22af-0b34-4a3b-8a0d-a33de5bdb251 tempest-VolumeDependencyTests-1073688899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-e46018f8-fcf9-4900-a1d8-c08fccbd5379.db51ea83-ee57-4e9e-b0f3-65e6e31570dc {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:45:03 devstack sudo[106126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-e46018f8-fcf9-4900-a1d8-c08fccbd5379.db51ea83-ee57-4e9e-b0f3-65e6e31570dc Aug 03 08:45:03 devstack sudo[106126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:45:03 devstack sudo[106126]: pam_unix(sudo:session): session closed for user root Aug 03 08:45:03 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-9d9a22af-0b34-4a3b-8a0d-a33de5bdb251 tempest-VolumeDependencyTests-1073688899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-e46018f8-fcf9-4900-a1d8-c08fccbd5379.db51ea83-ee57-4e9e-b0f3-65e6e31570dc" returned: 0 in 0.249s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:45:03 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-9d9a22af-0b34-4a3b-8a0d-a33de5bdb251 tempest-VolumeDependencyTests-1073688899 None] Lock "cinder-quobyte-db51ea83-ee57-4e9e-b0f3-65e6e31570dc" released by "_delete_snapshot" :: held 1.584s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:45:03 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-9d9a22af-0b34-4a3b-8a0d-a33de5bdb251 tempest-VolumeDependencyTests-1073688899 None] Lock "cinder-quobyte-e46018f8-fcf9-4900-a1d8-c08fccbd5379" released by "delete_snapshot" :: held 1.609s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:45:04 devstack cinder-volume[88899]: DEBUG cinder.quota [None req-9d9a22af-0b34-4a3b-8a0d-a33de5bdb251 tempest-VolumeDependencyTests-1073688899 None] Created reservations ['4a355ffb-a040-4c5f-9b56-9a9485ea410d', '4fb36cf2-7d03-4887-9cc3-41db4a99612b', 'e046279a-0357-40bc-9787-e36b11b0e704', 'e655eb13-dbf8-477c-ba45-ee259a8c2398'] {{(pid=88899) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 08:45:04 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-9d9a22af-0b34-4a3b-8a0d-a33de5bdb251 tempest-VolumeDependencyTests-1073688899 None] Delete snapshot completed successfully. Aug 03 08:45:04 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-9d9a22af-0b34-4a3b-8a0d-a33de5bdb251 tempest-VolumeDependencyTests-1073688899 None] Lock "cinder-db51ea83-ee57-4e9e-b0f3-65e6e31570dc-delete_snapshot" released by "delete_snapshot" :: held 1.757s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:45:04 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-99c3c549-f293-4ad3-a403-8a5fcddbb131 tempest-VolumeDependencyTests-1073688899 None] Acquiring lock "cinder-33af9960-696c-415a-b163-e48848a09396-delete_volume" by "delete_volume" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:45:04 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-99c3c549-f293-4ad3-a403-8a5fcddbb131 tempest-VolumeDependencyTests-1073688899 None] Lock "cinder-33af9960-696c-415a-b163-e48848a09396-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:45:04 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-99c3c549-f293-4ad3-a403-8a5fcddbb131 tempest-VolumeDependencyTests-1073688899 None] Acquiring lock "cinder-quobyte-33af9960-696c-415a-b163-e48848a09396" by "delete_volume" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:45:04 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-3a03ec76-8809-438d-9ea0-f7b0d71390e4 tempest-CreateVolumesFromSnapshotTest-499945752 None] Acquiring lock "cinder-f02c5e58-ce3d-40c4-80e1-de7a35fef297-delete_volume" by "delete_volume" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:45:04 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-3a03ec76-8809-438d-9ea0-f7b0d71390e4 tempest-CreateVolumesFromSnapshotTest-499945752 None] Lock "cinder-f02c5e58-ce3d-40c4-80e1-de7a35fef297-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:45:04 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-99c3c549-f293-4ad3-a403-8a5fcddbb131 tempest-VolumeDependencyTests-1073688899 None] Lock "cinder-quobyte-33af9960-696c-415a-b163-e48848a09396" acquired by "delete_volume" :: waited 0.037s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:45:04 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[434b3dd7-3adc-46d4-8618-01e388e982c4]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:45:04 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-99c3c549-f293-4ad3-a403-8a5fcddbb131 tempest-VolumeDependencyTests-1073688899 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-33af9960-696c-415a-b163-e48848a09396 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:45:04 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-3a03ec76-8809-438d-9ea0-f7b0d71390e4 tempest-CreateVolumesFromSnapshotTest-499945752 None] Acquiring lock "cinder-quobyte-f02c5e58-ce3d-40c4-80e1-de7a35fef297" by "delete_volume" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:45:04 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-3a03ec76-8809-438d-9ea0-f7b0d71390e4 tempest-CreateVolumesFromSnapshotTest-499945752 None] Lock "cinder-quobyte-f02c5e58-ce3d-40c4-80e1-de7a35fef297" acquired by "delete_volume" :: waited 0.021s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:45:04 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0c38653-acc2-4f57-8486-79593736da49]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:45:04 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-3a03ec76-8809-438d-9ea0-f7b0d71390e4 tempest-CreateVolumesFromSnapshotTest-499945752 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-f02c5e58-ce3d-40c4-80e1-de7a35fef297 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:45:04 devstack sudo[106129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-33af9960-696c-415a-b163-e48848a09396 Aug 03 08:45:04 devstack sudo[106129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:45:04 devstack sudo[106131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-f02c5e58-ce3d-40c4-80e1-de7a35fef297 Aug 03 08:45:04 devstack sudo[106131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:45:05 devstack sudo[106129]: pam_unix(sudo:session): session closed for user root Aug 03 08:45:05 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-99c3c549-f293-4ad3-a403-8a5fcddbb131 tempest-VolumeDependencyTests-1073688899 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-33af9960-696c-415a-b163-e48848a09396" returned: 0 in 0.484s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:45:05 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-99c3c549-f293-4ad3-a403-8a5fcddbb131 tempest-VolumeDependencyTests-1073688899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-33af9960-696c-415a-b163-e48848a09396 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:45:05 devstack sudo[106141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-33af9960-696c-415a-b163-e48848a09396 Aug 03 08:45:05 devstack sudo[106141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:45:05 devstack sudo[106131]: pam_unix(sudo:session): session closed for user root Aug 03 08:45:05 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-3a03ec76-8809-438d-9ea0-f7b0d71390e4 tempest-CreateVolumesFromSnapshotTest-499945752 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-f02c5e58-ce3d-40c4-80e1-de7a35fef297" returned: 0 in 0.489s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:45:05 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-3a03ec76-8809-438d-9ea0-f7b0d71390e4 tempest-CreateVolumesFromSnapshotTest-499945752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-f02c5e58-ce3d-40c4-80e1-de7a35fef297 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:45:05 devstack sudo[106143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-f02c5e58-ce3d-40c4-80e1-de7a35fef297 Aug 03 08:45:05 devstack sudo[106143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:45:05 devstack sudo[106141]: pam_unix(sudo:session): session closed for user root Aug 03 08:45:05 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-99c3c549-f293-4ad3-a403-8a5fcddbb131 tempest-VolumeDependencyTests-1073688899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-33af9960-696c-415a-b163-e48848a09396" returned: 0 in 0.365s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:45:05 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-99c3c549-f293-4ad3-a403-8a5fcddbb131 tempest-VolumeDependencyTests-1073688899 None] Lock "cinder-quobyte-33af9960-696c-415a-b163-e48848a09396" released by "delete_volume" :: held 0.943s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:45:05 devstack sudo[106143]: pam_unix(sudo:session): session closed for user root Aug 03 08:45:05 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-3a03ec76-8809-438d-9ea0-f7b0d71390e4 tempest-CreateVolumesFromSnapshotTest-499945752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-f02c5e58-ce3d-40c4-80e1-de7a35fef297" returned: 0 in 0.318s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:45:05 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-3a03ec76-8809-438d-9ea0-f7b0d71390e4 tempest-CreateVolumesFromSnapshotTest-499945752 None] Lock "cinder-quobyte-f02c5e58-ce3d-40c4-80e1-de7a35fef297" released by "delete_volume" :: held 0.860s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:45:05 devstack cinder-volume[88899]: DEBUG cinder.quota [None req-99c3c549-f293-4ad3-a403-8a5fcddbb131 tempest-VolumeDependencyTests-1073688899 None] Created reservations ['f0221fde-d261-4b1b-a241-c64fc9e612c2', '51830002-9221-46d7-94ed-cb8da0d4fda3', '00311bd4-57f1-4d2d-ac51-cc0f705ee02b', '24a6fef3-2bc2-4fc8-bfa9-0df00646b05c'] {{(pid=88899) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 08:45:05 devstack cinder-volume[88899]: DEBUG cinder.quota [None req-3a03ec76-8809-438d-9ea0-f7b0d71390e4 tempest-CreateVolumesFromSnapshotTest-499945752 None] Created reservations ['8d8d1204-5e3b-4f6a-abed-4690bd40cf87', 'f471d795-4783-4499-8ac7-a5aabd6aa631', 'f5fd93c5-7922-4579-a712-a564e9030fb6', 'b83d798b-c104-4894-9608-92b1cb6070db'] {{(pid=88899) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 08:45:05 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-99c3c549-f293-4ad3-a403-8a5fcddbb131 tempest-VolumeDependencyTests-1073688899 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:45:05 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-99c3c549-f293-4ad3-a403-8a5fcddbb131 tempest-VolumeDependencyTests-1073688899 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:45:05 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-99c3c549-f293-4ad3-a403-8a5fcddbb131 tempest-VolumeDependencyTests-1073688899 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:45:05 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-99c3c549-f293-4ad3-a403-8a5fcddbb131 tempest-VolumeDependencyTests-1073688899 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:45:05 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-99c3c549-f293-4ad3-a403-8a5fcddbb131 tempest-VolumeDependencyTests-1073688899 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:45:05 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-99c3c549-f293-4ad3-a403-8a5fcddbb131 tempest-VolumeDependencyTests-1073688899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:45:05 devstack sudo[106147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a Aug 03 08:45:05 devstack sudo[106147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:45:05 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-3a03ec76-8809-438d-9ea0-f7b0d71390e4 tempest-CreateVolumesFromSnapshotTest-499945752 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:45:05 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-3a03ec76-8809-438d-9ea0-f7b0d71390e4 tempest-CreateVolumesFromSnapshotTest-499945752 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:45:05 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-3a03ec76-8809-438d-9ea0-f7b0d71390e4 tempest-CreateVolumesFromSnapshotTest-499945752 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:45:05 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-3a03ec76-8809-438d-9ea0-f7b0d71390e4 tempest-CreateVolumesFromSnapshotTest-499945752 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:45:05 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-3a03ec76-8809-438d-9ea0-f7b0d71390e4 tempest-CreateVolumesFromSnapshotTest-499945752 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:45:05 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-3a03ec76-8809-438d-9ea0-f7b0d71390e4 tempest-CreateVolumesFromSnapshotTest-499945752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:45:05 devstack sudo[106149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a Aug 03 08:45:05 devstack sudo[106149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:45:06 devstack sudo[106149]: pam_unix(sudo:session): session closed for user root Aug 03 08:45:06 devstack sudo[106147]: pam_unix(sudo:session): session closed for user root Aug 03 08:45:06 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-3a03ec76-8809-438d-9ea0-f7b0d71390e4 tempest-CreateVolumesFromSnapshotTest-499945752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a" returned: 0 in 0.273s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:45:06 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-99c3c549-f293-4ad3-a403-8a5fcddbb131 tempest-VolumeDependencyTests-1073688899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a" returned: 0 in 0.320s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:45:06 devstack cinder-volume[88899]: DEBUG cinder.manager [None req-3a03ec76-8809-438d-9ea0-f7b0d71390e4 tempest-CreateVolumesFromSnapshotTest-499945752 None] Notifying Schedulers of capabilities ... {{(pid=88899) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 08:45:06 devstack cinder-volume[88899]: DEBUG cinder.manager [None req-99c3c549-f293-4ad3-a403-8a5fcddbb131 tempest-VolumeDependencyTests-1073688899 None] Notifying Schedulers of capabilities ... {{(pid=88899) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 08:45:06 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-3a03ec76-8809-438d-9ea0-f7b0d71390e4 tempest-CreateVolumesFromSnapshotTest-499945752 None] Deleted volume successfully. Aug 03 08:45:06 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-3a03ec76-8809-438d-9ea0-f7b0d71390e4 tempest-CreateVolumesFromSnapshotTest-499945752 None] Lock "cinder-f02c5e58-ce3d-40c4-80e1-de7a35fef297-delete_volume" released by "delete_volume" :: held 1.527s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:45:06 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-99c3c549-f293-4ad3-a403-8a5fcddbb131 tempest-VolumeDependencyTests-1073688899 None] Deleted volume successfully. Aug 03 08:45:06 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-99c3c549-f293-4ad3-a403-8a5fcddbb131 tempest-VolumeDependencyTests-1073688899 None] Lock "cinder-33af9960-696c-415a-b163-e48848a09396-delete_volume" released by "delete_volume" :: held 1.642s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:45:06 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-d6d90008-1cf5-4bb2-98c3-e3ca330fb346 tempest-VolumeDependencyTests-1073688899 None] Acquiring lock "cinder-66ec0c6b-ba7c-4f8a-8c2a-6dbfd6262fc1-delete_volume" by "delete_volume" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:45:06 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-d6d90008-1cf5-4bb2-98c3-e3ca330fb346 tempest-VolumeDependencyTests-1073688899 None] Lock "cinder-66ec0c6b-ba7c-4f8a-8c2a-6dbfd6262fc1-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:45:06 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-d6d90008-1cf5-4bb2-98c3-e3ca330fb346 tempest-VolumeDependencyTests-1073688899 None] Acquiring lock "cinder-quobyte-66ec0c6b-ba7c-4f8a-8c2a-6dbfd6262fc1" by "delete_volume" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:45:06 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-d6d90008-1cf5-4bb2-98c3-e3ca330fb346 tempest-VolumeDependencyTests-1073688899 None] Lock "cinder-quobyte-66ec0c6b-ba7c-4f8a-8c2a-6dbfd6262fc1" acquired by "delete_volume" :: waited 0.015s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:45:06 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d0617dc-6a16-4f30-8f40-c84fa2c45e52]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:45:06 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-d6d90008-1cf5-4bb2-98c3-e3ca330fb346 tempest-VolumeDependencyTests-1073688899 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-66ec0c6b-ba7c-4f8a-8c2a-6dbfd6262fc1 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:45:06 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-deb32551-e96e-4ef1-9159-9fba09103c97 tempest-CreateVolumesFromSnapshotTest-499945752 None] Acquiring lock "cinder-f04dfd17-ebd5-46dc-a05d-ed7b6eeb311c-delete_volume" by "delete_volume" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:45:06 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-deb32551-e96e-4ef1-9159-9fba09103c97 tempest-CreateVolumesFromSnapshotTest-499945752 None] Lock "cinder-f04dfd17-ebd5-46dc-a05d-ed7b6eeb311c-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:45:07 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-deb32551-e96e-4ef1-9159-9fba09103c97 tempest-CreateVolumesFromSnapshotTest-499945752 None] Acquiring lock "cinder-quobyte-f04dfd17-ebd5-46dc-a05d-ed7b6eeb311c" by "delete_volume" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:45:07 devstack sudo[106153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-66ec0c6b-ba7c-4f8a-8c2a-6dbfd6262fc1 Aug 03 08:45:07 devstack sudo[106153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:45:07 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-deb32551-e96e-4ef1-9159-9fba09103c97 tempest-CreateVolumesFromSnapshotTest-499945752 None] Lock "cinder-quobyte-f04dfd17-ebd5-46dc-a05d-ed7b6eeb311c" acquired by "delete_volume" :: waited 0.025s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:45:07 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d2bd8d4-c54b-41d4-933f-ed249531da44]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:45:07 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-deb32551-e96e-4ef1-9159-9fba09103c97 tempest-CreateVolumesFromSnapshotTest-499945752 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-f04dfd17-ebd5-46dc-a05d-ed7b6eeb311c {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:45:07 devstack sudo[106155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-f04dfd17-ebd5-46dc-a05d-ed7b6eeb311c Aug 03 08:45:07 devstack sudo[106155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:45:07 devstack sudo[106153]: pam_unix(sudo:session): session closed for user root Aug 03 08:45:07 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-d6d90008-1cf5-4bb2-98c3-e3ca330fb346 tempest-VolumeDependencyTests-1073688899 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-66ec0c6b-ba7c-4f8a-8c2a-6dbfd6262fc1" returned: 0 in 0.480s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:45:07 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-d6d90008-1cf5-4bb2-98c3-e3ca330fb346 tempest-VolumeDependencyTests-1073688899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-66ec0c6b-ba7c-4f8a-8c2a-6dbfd6262fc1 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:45:07 devstack sudo[106160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-66ec0c6b-ba7c-4f8a-8c2a-6dbfd6262fc1 Aug 03 08:45:07 devstack sudo[106160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:45:07 devstack cinder-volume[88899]: DEBUG cinder.volume.flows.manager.create_volume [None req-3bd30a1a-798c-4b43-ba2d-059238bca507 tempest-VolumesSnapshotNegativeTestJSON-476543663 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88899) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 08:45:07 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-3bd30a1a-798c-4b43-ba2d-059238bca507 tempest-VolumesSnapshotNegativeTestJSON-476543663 None] Flow 'volume_create_manager' (00a71778-c1a1-4274-9371-91298129d587) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:45:07 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-3bd30a1a-798c-4b43-ba2d-059238bca507 tempest-VolumesSnapshotNegativeTestJSON-476543663 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac02e029-02bd-49e8-a284-edd2910d6e45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:45:07 devstack sudo[106155]: pam_unix(sudo:session): session closed for user root Aug 03 08:45:07 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-3bd30a1a-798c-4b43-ba2d-059238bca507 tempest-VolumesSnapshotNegativeTestJSON-476543663 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac02e029-02bd-49e8-a284-edd2910d6e45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:45:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-641034971',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7cca1ce8-9fba-4288-ad46-1a96dea33177,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d778e491f6604fb89e49a3f2869bd16b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:45:07Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:45:07Z,use_quota=True,user_id='16f88b1c67474077934c366ac4b59ee6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8bde7129-1dc4-42ab-b852-ab32c61b4921),volume_type_id=8bde7129-1dc4-42ab-b852-ab32c61b4921)' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:45:07 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-3bd30a1a-798c-4b43-ba2d-059238bca507 tempest-VolumesSnapshotNegativeTestJSON-476543663 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3917245-be91-431e-8ad5-821750afaea3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:45:07 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-3bd30a1a-798c-4b43-ba2d-059238bca507 tempest-VolumesSnapshotNegativeTestJSON-476543663 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3917245-be91-431e-8ad5-821750afaea3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:45:07 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-3bd30a1a-798c-4b43-ba2d-059238bca507 tempest-VolumesSnapshotNegativeTestJSON-476543663 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ce08f17-ea0f-4eeb-9af8-ec6b6a0fc394) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:45:07 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-3bd30a1a-798c-4b43-ba2d-059238bca507 tempest-VolumesSnapshotNegativeTestJSON-476543663 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ce08f17-ea0f-4eeb-9af8-ec6b6a0fc394) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7cca1ce8-9fba-4288-ad46-1a96dea33177', 'volume_name': 'volume-7cca1ce8-9fba-4288-ad46-1a96dea33177', 'volume_size': 2}' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:45:07 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-3bd30a1a-798c-4b43-ba2d-059238bca507 tempest-VolumesSnapshotNegativeTestJSON-476543663 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5524ea26-98df-4a59-afc6-3590ddc6ee1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:45:07 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-3bd30a1a-798c-4b43-ba2d-059238bca507 tempest-VolumesSnapshotNegativeTestJSON-476543663 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5524ea26-98df-4a59-afc6-3590ddc6ee1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:45:07 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-3bd30a1a-798c-4b43-ba2d-059238bca507 tempest-VolumesSnapshotNegativeTestJSON-476543663 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1abdf08f-d33b-4efa-935d-61b2cca4627d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:45:07 devstack cinder-volume[88899]: INFO cinder.volume.flows.manager.create_volume [None req-3bd30a1a-798c-4b43-ba2d-059238bca507 tempest-VolumesSnapshotNegativeTestJSON-476543663 None] Volume 7cca1ce8-9fba-4288-ad46-1a96dea33177: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7cca1ce8-9fba-4288-ad46-1a96dea33177', 'volume_size': 2} Aug 03 08:45:07 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-3bd30a1a-798c-4b43-ba2d-059238bca507 tempest-VolumesSnapshotNegativeTestJSON-476543663 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:45:07 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-3bd30a1a-798c-4b43-ba2d-059238bca507 tempest-VolumesSnapshotNegativeTestJSON-476543663 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:45:07 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-3bd30a1a-798c-4b43-ba2d-059238bca507 tempest-VolumesSnapshotNegativeTestJSON-476543663 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:45:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-641034971',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7cca1ce8-9fba-4288-ad46-1a96dea33177,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d778e491f6604fb89e49a3f2869bd16b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:45:07Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:45:07Z,use_quota=True,user_id='16f88b1c67474077934c366ac4b59ee6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8bde7129-1dc4-42ab-b852-ab32c61b4921),volume_type_id=8bde7129-1dc4-42ab-b852-ab32c61b4921)}" {{(pid=88899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 08:45:07 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-3bd30a1a-798c-4b43-ba2d-059238bca507 tempest-VolumesSnapshotNegativeTestJSON-476543663 None] Creating volume 7cca1ce8-9fba-4288-ad46-1a96dea33177 {{(pid=88899) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 08:45:07 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-3bd30a1a-798c-4b43-ba2d-059238bca507 tempest-VolumesSnapshotNegativeTestJSON-476543663 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:45:07 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-3bd30a1a-798c-4b43-ba2d-059238bca507 tempest-VolumesSnapshotNegativeTestJSON-476543663 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:45:07 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-3bd30a1a-798c-4b43-ba2d-059238bca507 tempest-VolumesSnapshotNegativeTestJSON-476543663 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:45:07 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-3bd30a1a-798c-4b43-ba2d-059238bca507 tempest-VolumesSnapshotNegativeTestJSON-476543663 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:45:07 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-3bd30a1a-798c-4b43-ba2d-059238bca507 tempest-VolumesSnapshotNegativeTestJSON-476543663 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:45:07 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-3bd30a1a-798c-4b43-ba2d-059238bca507 tempest-VolumesSnapshotNegativeTestJSON-476543663 None] Selected osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385 as target Quobyte volume. {{(pid=88899) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 08:45:07 devstack cinder-volume[88899]: INFO cinder.volume.drivers.remotefs [None req-3bd30a1a-798c-4b43-ba2d-059238bca507 tempest-VolumesSnapshotNegativeTestJSON-476543663 None] casted to osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385 Aug 03 08:45:07 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-3bd30a1a-798c-4b43-ba2d-059238bca507 tempest-VolumesSnapshotNegativeTestJSON-476543663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-7cca1ce8-9fba-4288-ad46-1a96dea33177 2147483648 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:45:07 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-deb32551-e96e-4ef1-9159-9fba09103c97 tempest-CreateVolumesFromSnapshotTest-499945752 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-f04dfd17-ebd5-46dc-a05d-ed7b6eeb311c" returned: 0 in 0.483s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:45:07 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-deb32551-e96e-4ef1-9159-9fba09103c97 tempest-CreateVolumesFromSnapshotTest-499945752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-f04dfd17-ebd5-46dc-a05d-ed7b6eeb311c {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:45:07 devstack sudo[106165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-7cca1ce8-9fba-4288-ad46-1a96dea33177 2147483648 Aug 03 08:45:07 devstack sudo[106165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:45:07 devstack sudo[106166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-f04dfd17-ebd5-46dc-a05d-ed7b6eeb311c Aug 03 08:45:07 devstack sudo[106166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:45:07 devstack sudo[106160]: pam_unix(sudo:session): session closed for user root Aug 03 08:45:07 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-d6d90008-1cf5-4bb2-98c3-e3ca330fb346 tempest-VolumeDependencyTests-1073688899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-66ec0c6b-ba7c-4f8a-8c2a-6dbfd6262fc1" returned: 0 in 0.286s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:45:07 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-d6d90008-1cf5-4bb2-98c3-e3ca330fb346 tempest-VolumeDependencyTests-1073688899 None] Lock "cinder-quobyte-66ec0c6b-ba7c-4f8a-8c2a-6dbfd6262fc1" released by "delete_volume" :: held 0.832s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:45:07 devstack cinder-volume[88899]: DEBUG cinder.quota [None req-d6d90008-1cf5-4bb2-98c3-e3ca330fb346 tempest-VolumeDependencyTests-1073688899 None] Created reservations ['b782ebda-2607-4d63-824a-f99df9c4a744', '248ae758-4a7c-4d16-8146-c7587e974160', 'e8364b4e-a3f5-4c4e-a220-d25121009e07', '18b5a10e-786e-4e7d-a7d8-93a59c539094'] {{(pid=88899) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 08:45:07 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-d6d90008-1cf5-4bb2-98c3-e3ca330fb346 tempest-VolumeDependencyTests-1073688899 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:45:07 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-d6d90008-1cf5-4bb2-98c3-e3ca330fb346 tempest-VolumeDependencyTests-1073688899 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:45:07 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-d6d90008-1cf5-4bb2-98c3-e3ca330fb346 tempest-VolumeDependencyTests-1073688899 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:45:07 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-d6d90008-1cf5-4bb2-98c3-e3ca330fb346 tempest-VolumeDependencyTests-1073688899 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:45:07 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-d6d90008-1cf5-4bb2-98c3-e3ca330fb346 tempest-VolumeDependencyTests-1073688899 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:45:07 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-d6d90008-1cf5-4bb2-98c3-e3ca330fb346 tempest-VolumeDependencyTests-1073688899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:45:07 devstack sudo[106173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a Aug 03 08:45:07 devstack sudo[106173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:45:07 devstack sudo[106166]: pam_unix(sudo:session): session closed for user root Aug 03 08:45:07 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-deb32551-e96e-4ef1-9159-9fba09103c97 tempest-CreateVolumesFromSnapshotTest-499945752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-f04dfd17-ebd5-46dc-a05d-ed7b6eeb311c" returned: 0 in 0.271s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:45:07 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-deb32551-e96e-4ef1-9159-9fba09103c97 tempest-CreateVolumesFromSnapshotTest-499945752 None] Lock "cinder-quobyte-f04dfd17-ebd5-46dc-a05d-ed7b6eeb311c" released by "delete_volume" :: held 0.812s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:45:07 devstack cinder-volume[88899]: DEBUG cinder.quota [None req-deb32551-e96e-4ef1-9159-9fba09103c97 tempest-CreateVolumesFromSnapshotTest-499945752 None] Created reservations ['0a4558cc-18ea-4b73-9b3f-51330802e790', '971e4f7f-d8aa-4ab5-b4ef-3721d56a4ff3', '31110ece-b64a-40f7-a1a4-7ee7310aa41d', 'c8ec03a0-0d22-45e1-a237-6f68360253c3'] {{(pid=88899) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 08:45:08 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-6c1f29be-ad7d-4d37-8a2e-c34199bca813 tempest-VolumeDependencyTests-1073688899 None] Acquiring lock "cinder-e46018f8-fcf9-4900-a1d8-c08fccbd5379-delete_volume" by "delete_volume" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:45:08 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-deb32551-e96e-4ef1-9159-9fba09103c97 tempest-CreateVolumesFromSnapshotTest-499945752 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:45:08 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-deb32551-e96e-4ef1-9159-9fba09103c97 tempest-CreateVolumesFromSnapshotTest-499945752 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:45:08 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-deb32551-e96e-4ef1-9159-9fba09103c97 tempest-CreateVolumesFromSnapshotTest-499945752 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:45:08 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-deb32551-e96e-4ef1-9159-9fba09103c97 tempest-CreateVolumesFromSnapshotTest-499945752 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:45:08 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-deb32551-e96e-4ef1-9159-9fba09103c97 tempest-CreateVolumesFromSnapshotTest-499945752 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:45:08 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-deb32551-e96e-4ef1-9159-9fba09103c97 tempest-CreateVolumesFromSnapshotTest-499945752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:45:08 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-6c1f29be-ad7d-4d37-8a2e-c34199bca813 tempest-VolumeDependencyTests-1073688899 None] Lock "cinder-e46018f8-fcf9-4900-a1d8-c08fccbd5379-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:45:08 devstack sudo[106177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a Aug 03 08:45:08 devstack sudo[106177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:45:08 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-6c1f29be-ad7d-4d37-8a2e-c34199bca813 tempest-VolumeDependencyTests-1073688899 None] Acquiring lock "cinder-quobyte-e46018f8-fcf9-4900-a1d8-c08fccbd5379" by "delete_volume" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:45:08 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-6c1f29be-ad7d-4d37-8a2e-c34199bca813 tempest-VolumeDependencyTests-1073688899 None] Lock "cinder-quobyte-e46018f8-fcf9-4900-a1d8-c08fccbd5379" acquired by "delete_volume" :: waited 0.023s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:45:08 devstack sudo[106173]: pam_unix(sudo:session): session closed for user root Aug 03 08:45:08 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-b8dcd4a2-2875-476c-9c6b-667ba0001008 tempest-CreateVolumesFromSnapshotTest-499945752 None] Acquiring lock "cinder-ed402e41-3ba8-4546-ba67-4c213b01988b-delete_volume" by "delete_volume" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:45:08 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-d6d90008-1cf5-4bb2-98c3-e3ca330fb346 tempest-VolumeDependencyTests-1073688899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a" returned: 0 in 0.385s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:45:08 devstack cinder-volume[88899]: DEBUG cinder.manager [None req-d6d90008-1cf5-4bb2-98c3-e3ca330fb346 tempest-VolumeDependencyTests-1073688899 None] Notifying Schedulers of capabilities ... {{(pid=88899) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 08:45:08 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-d6d90008-1cf5-4bb2-98c3-e3ca330fb346 tempest-VolumeDependencyTests-1073688899 None] Deleted volume successfully. Aug 03 08:45:08 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[4606034d-5626-46e7-8823-f46f0483294b]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:45:08 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-6c1f29be-ad7d-4d37-8a2e-c34199bca813 tempest-VolumeDependencyTests-1073688899 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-e46018f8-fcf9-4900-a1d8-c08fccbd5379 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:45:08 devstack sudo[106165]: pam_unix(sudo:session): session closed for user root Aug 03 08:45:08 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-b8dcd4a2-2875-476c-9c6b-667ba0001008 tempest-CreateVolumesFromSnapshotTest-499945752 None] Lock "cinder-ed402e41-3ba8-4546-ba67-4c213b01988b-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:45:08 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-3bd30a1a-798c-4b43-ba2d-059238bca507 tempest-VolumesSnapshotNegativeTestJSON-476543663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-7cca1ce8-9fba-4288-ad46-1a96dea33177 2147483648" returned: 0 in 0.684s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:45:08 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-d6d90008-1cf5-4bb2-98c3-e3ca330fb346 tempest-VolumeDependencyTests-1073688899 None] Lock "cinder-66ec0c6b-ba7c-4f8a-8c2a-6dbfd6262fc1-delete_volume" released by "delete_volume" :: held 1.471s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:45:08 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-3bd30a1a-798c-4b43-ba2d-059238bca507 tempest-VolumesSnapshotNegativeTestJSON-476543663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-7cca1ce8-9fba-4288-ad46-1a96dea33177 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:45:08 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-b8dcd4a2-2875-476c-9c6b-667ba0001008 tempest-CreateVolumesFromSnapshotTest-499945752 None] Acquiring lock "cinder-quobyte-ed402e41-3ba8-4546-ba67-4c213b01988b" by "delete_volume" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:45:08 devstack sudo[106181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-7cca1ce8-9fba-4288-ad46-1a96dea33177 Aug 03 08:45:08 devstack sudo[106181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:45:08 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-b8dcd4a2-2875-476c-9c6b-667ba0001008 tempest-CreateVolumesFromSnapshotTest-499945752 None] Lock "cinder-quobyte-ed402e41-3ba8-4546-ba67-4c213b01988b" acquired by "delete_volume" :: waited 0.027s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:45:08 devstack sudo[106180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-e46018f8-fcf9-4900-a1d8-c08fccbd5379 Aug 03 08:45:08 devstack sudo[106180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:45:08 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[6def6fb1-2e56-49da-b39c-874f73b20bca]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:45:08 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-b8dcd4a2-2875-476c-9c6b-667ba0001008 tempest-CreateVolumesFromSnapshotTest-499945752 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-ed402e41-3ba8-4546-ba67-4c213b01988b {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:45:08 devstack sudo[106177]: pam_unix(sudo:session): session closed for user root Aug 03 08:45:08 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-deb32551-e96e-4ef1-9159-9fba09103c97 tempest-CreateVolumesFromSnapshotTest-499945752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a" returned: 0 in 0.407s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:45:08 devstack cinder-volume[88899]: DEBUG cinder.manager [None req-deb32551-e96e-4ef1-9159-9fba09103c97 tempest-CreateVolumesFromSnapshotTest-499945752 None] Notifying Schedulers of capabilities ... {{(pid=88899) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 08:45:08 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-deb32551-e96e-4ef1-9159-9fba09103c97 tempest-CreateVolumesFromSnapshotTest-499945752 None] Deleted volume successfully. Aug 03 08:45:08 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-deb32551-e96e-4ef1-9159-9fba09103c97 tempest-CreateVolumesFromSnapshotTest-499945752 None] Lock "cinder-f04dfd17-ebd5-46dc-a05d-ed7b6eeb311c-delete_volume" released by "delete_volume" :: held 1.508s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:45:08 devstack sudo[106186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-ed402e41-3ba8-4546-ba67-4c213b01988b Aug 03 08:45:08 devstack sudo[106186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:45:08 devstack sudo[106181]: pam_unix(sudo:session): session closed for user root Aug 03 08:45:08 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-3bd30a1a-798c-4b43-ba2d-059238bca507 tempest-VolumesSnapshotNegativeTestJSON-476543663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-7cca1ce8-9fba-4288-ad46-1a96dea33177" returned: 0 in 0.284s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:45:08 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-3bd30a1a-798c-4b43-ba2d-059238bca507 tempest-VolumesSnapshotNegativeTestJSON-476543663 None] <== create_volume: return (1029ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'} {{(pid=88899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 08:45:08 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-3bd30a1a-798c-4b43-ba2d-059238bca507 tempest-VolumesSnapshotNegativeTestJSON-476543663 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.031s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:45:08 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-3bd30a1a-798c-4b43-ba2d-059238bca507 tempest-VolumesSnapshotNegativeTestJSON-476543663 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1abdf08f-d33b-4efa-935d-61b2cca4627d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7cca1ce8-9fba-4288-ad46-1a96dea33177', 'volume_size': 2}' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:45:08 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-3bd30a1a-798c-4b43-ba2d-059238bca507 tempest-VolumesSnapshotNegativeTestJSON-476543663 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (037611e4-5e59-49b5-b759-f22ff3ddb66d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:45:08 devstack cinder-volume[88899]: INFO cinder.volume.flows.manager.create_volume [None req-3bd30a1a-798c-4b43-ba2d-059238bca507 tempest-VolumesSnapshotNegativeTestJSON-476543663 None] Volume volume-7cca1ce8-9fba-4288-ad46-1a96dea33177 (7cca1ce8-9fba-4288-ad46-1a96dea33177): created successfully Aug 03 08:45:08 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-3bd30a1a-798c-4b43-ba2d-059238bca507 tempest-VolumesSnapshotNegativeTestJSON-476543663 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (037611e4-5e59-49b5-b759-f22ff3ddb66d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:45:08 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-3bd30a1a-798c-4b43-ba2d-059238bca507 tempest-VolumesSnapshotNegativeTestJSON-476543663 None] Flow 'volume_create_manager' (00a71778-c1a1-4274-9371-91298129d587) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:45:08 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-3bd30a1a-798c-4b43-ba2d-059238bca507 tempest-VolumesSnapshotNegativeTestJSON-476543663 None] Created volume successfully. Aug 03 08:45:08 devstack sudo[106180]: pam_unix(sudo:session): session closed for user root Aug 03 08:45:08 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-6c1f29be-ad7d-4d37-8a2e-c34199bca813 tempest-VolumeDependencyTests-1073688899 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-e46018f8-fcf9-4900-a1d8-c08fccbd5379" returned: 0 in 0.452s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:45:08 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-6c1f29be-ad7d-4d37-8a2e-c34199bca813 tempest-VolumeDependencyTests-1073688899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-e46018f8-fcf9-4900-a1d8-c08fccbd5379 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:45:08 devstack sudo[106192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-e46018f8-fcf9-4900-a1d8-c08fccbd5379 Aug 03 08:45:08 devstack sudo[106192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:45:08 devstack sudo[106186]: pam_unix(sudo:session): session closed for user root Aug 03 08:45:08 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-b8dcd4a2-2875-476c-9c6b-667ba0001008 tempest-CreateVolumesFromSnapshotTest-499945752 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-ed402e41-3ba8-4546-ba67-4c213b01988b" returned: 0 in 0.397s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:45:08 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-b8dcd4a2-2875-476c-9c6b-667ba0001008 tempest-CreateVolumesFromSnapshotTest-499945752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-ed402e41-3ba8-4546-ba67-4c213b01988b {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:45:08 devstack sudo[106197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-ed402e41-3ba8-4546-ba67-4c213b01988b Aug 03 08:45:08 devstack sudo[106197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:45:08 devstack sudo[106192]: pam_unix(sudo:session): session closed for user root Aug 03 08:45:08 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-6c1f29be-ad7d-4d37-8a2e-c34199bca813 tempest-VolumeDependencyTests-1073688899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-e46018f8-fcf9-4900-a1d8-c08fccbd5379" returned: 0 in 0.251s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:45:08 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-6c1f29be-ad7d-4d37-8a2e-c34199bca813 tempest-VolumeDependencyTests-1073688899 None] Lock "cinder-quobyte-e46018f8-fcf9-4900-a1d8-c08fccbd5379" released by "delete_volume" :: held 0.803s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:45:08 devstack cinder-volume[88899]: DEBUG cinder.quota [None req-6c1f29be-ad7d-4d37-8a2e-c34199bca813 tempest-VolumeDependencyTests-1073688899 None] Created reservations ['1af74645-77c0-4c33-a1df-6a1217d5f3e9', 'f6783b60-0c85-4dc0-a530-0af80ff5e370', 'd23f024f-0dcb-4017-8cc7-2cd1a30a48b0', 'c8fe9663-b302-409a-955c-5d040f51b1f5'] {{(pid=88899) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 08:45:09 devstack sudo[106197]: pam_unix(sudo:session): session closed for user root Aug 03 08:45:09 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-b8dcd4a2-2875-476c-9c6b-667ba0001008 tempest-CreateVolumesFromSnapshotTest-499945752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-ed402e41-3ba8-4546-ba67-4c213b01988b" returned: 0 in 0.269s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:45:09 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-b8dcd4a2-2875-476c-9c6b-667ba0001008 tempest-CreateVolumesFromSnapshotTest-499945752 None] Lock "cinder-quobyte-ed402e41-3ba8-4546-ba67-4c213b01988b" released by "delete_volume" :: held 0.734s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:45:09 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-6c1f29be-ad7d-4d37-8a2e-c34199bca813 tempest-VolumeDependencyTests-1073688899 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:45:09 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-6c1f29be-ad7d-4d37-8a2e-c34199bca813 tempest-VolumeDependencyTests-1073688899 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:45:09 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-6c1f29be-ad7d-4d37-8a2e-c34199bca813 tempest-VolumeDependencyTests-1073688899 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:45:09 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-6c1f29be-ad7d-4d37-8a2e-c34199bca813 tempest-VolumeDependencyTests-1073688899 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:45:09 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-6c1f29be-ad7d-4d37-8a2e-c34199bca813 tempest-VolumeDependencyTests-1073688899 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:45:09 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-6c1f29be-ad7d-4d37-8a2e-c34199bca813 tempest-VolumeDependencyTests-1073688899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:45:09 devstack sudo[106201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a Aug 03 08:45:09 devstack sudo[106201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:45:09 devstack cinder-volume[88899]: DEBUG cinder.quota [None req-b8dcd4a2-2875-476c-9c6b-667ba0001008 tempest-CreateVolumesFromSnapshotTest-499945752 None] Created reservations ['8a5734b6-90db-42f6-a87d-6c52a3dbe8fb', '5453c82c-cba2-4ce6-baf9-8c38f2f73090', '6cd27911-1fed-4a17-8e1a-65937f8a2eb6', '15c0aae4-26b8-477b-8f27-9429382ec07a'] {{(pid=88899) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 08:45:09 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-03e32d06-dcd5-4d84-8390-5a2ff20dc372 tempest-VolumeDependencyTests-1073688899 None] Acquiring lock "cinder-475b65d3-a899-45ac-913b-c64ae81ffc3c-delete_volume" by "delete_volume" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:45:09 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-03e32d06-dcd5-4d84-8390-5a2ff20dc372 tempest-VolumeDependencyTests-1073688899 None] Lock "cinder-475b65d3-a899-45ac-913b-c64ae81ffc3c-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:45:09 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-b8dcd4a2-2875-476c-9c6b-667ba0001008 tempest-CreateVolumesFromSnapshotTest-499945752 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:45:09 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-b8dcd4a2-2875-476c-9c6b-667ba0001008 tempest-CreateVolumesFromSnapshotTest-499945752 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:45:09 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-b8dcd4a2-2875-476c-9c6b-667ba0001008 tempest-CreateVolumesFromSnapshotTest-499945752 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:45:09 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-b8dcd4a2-2875-476c-9c6b-667ba0001008 tempest-CreateVolumesFromSnapshotTest-499945752 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:45:09 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-b8dcd4a2-2875-476c-9c6b-667ba0001008 tempest-CreateVolumesFromSnapshotTest-499945752 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:45:09 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-b8dcd4a2-2875-476c-9c6b-667ba0001008 tempest-CreateVolumesFromSnapshotTest-499945752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:45:09 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-03e32d06-dcd5-4d84-8390-5a2ff20dc372 tempest-VolumeDependencyTests-1073688899 None] Acquiring lock "cinder-quobyte-475b65d3-a899-45ac-913b-c64ae81ffc3c" by "delete_volume" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:45:09 devstack sudo[106203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a Aug 03 08:45:09 devstack sudo[106203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:45:09 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-03e32d06-dcd5-4d84-8390-5a2ff20dc372 tempest-VolumeDependencyTests-1073688899 None] Lock "cinder-quobyte-475b65d3-a899-45ac-913b-c64ae81ffc3c" acquired by "delete_volume" :: waited 0.018s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:45:09 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[972e32e2-596a-4180-9ed0-dbc865ac27e4]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:45:09 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-03e32d06-dcd5-4d84-8390-5a2ff20dc372 tempest-VolumeDependencyTests-1073688899 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-475b65d3-a899-45ac-913b-c64ae81ffc3c {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:45:09 devstack sudo[106201]: pam_unix(sudo:session): session closed for user root Aug 03 08:45:09 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-6c1f29be-ad7d-4d37-8a2e-c34199bca813 tempest-VolumeDependencyTests-1073688899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a" returned: 0 in 0.296s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:45:09 devstack cinder-volume[88899]: DEBUG cinder.manager [None req-6c1f29be-ad7d-4d37-8a2e-c34199bca813 tempest-VolumeDependencyTests-1073688899 None] Notifying Schedulers of capabilities ... {{(pid=88899) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 08:45:09 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-6c1f29be-ad7d-4d37-8a2e-c34199bca813 tempest-VolumeDependencyTests-1073688899 None] Deleted volume successfully. Aug 03 08:45:09 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-2e339cb2-7c02-4595-b94f-3da748c5d9ae tempest-CreateVolumesFromSnapshotTest-499945752 None] Acquiring lock "cinder-e12693a7-7a76-4009-a37e-ee176a7499bc-delete_volume" by "delete_volume" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:45:09 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-6c1f29be-ad7d-4d37-8a2e-c34199bca813 tempest-VolumeDependencyTests-1073688899 None] Lock "cinder-e46018f8-fcf9-4900-a1d8-c08fccbd5379-delete_volume" released by "delete_volume" :: held 1.356s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:45:09 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-2e339cb2-7c02-4595-b94f-3da748c5d9ae tempest-CreateVolumesFromSnapshotTest-499945752 None] Lock "cinder-e12693a7-7a76-4009-a37e-ee176a7499bc-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:45:09 devstack sudo[106206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-475b65d3-a899-45ac-913b-c64ae81ffc3c Aug 03 08:45:09 devstack sudo[106206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:45:09 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-2e339cb2-7c02-4595-b94f-3da748c5d9ae tempest-CreateVolumesFromSnapshotTest-499945752 None] Acquiring lock "cinder-quobyte-e12693a7-7a76-4009-a37e-ee176a7499bc" by "delete_volume" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:45:09 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-2e339cb2-7c02-4595-b94f-3da748c5d9ae tempest-CreateVolumesFromSnapshotTest-499945752 None] Lock "cinder-quobyte-e12693a7-7a76-4009-a37e-ee176a7499bc" acquired by "delete_volume" :: waited 0.018s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:45:09 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[77d5c4b3-4eb7-46bf-b857-583b10810a9c]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:45:09 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-2e339cb2-7c02-4595-b94f-3da748c5d9ae tempest-CreateVolumesFromSnapshotTest-499945752 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-e12693a7-7a76-4009-a37e-ee176a7499bc {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:45:09 devstack sudo[106203]: pam_unix(sudo:session): session closed for user root Aug 03 08:45:09 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-b8dcd4a2-2875-476c-9c6b-667ba0001008 tempest-CreateVolumesFromSnapshotTest-499945752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a" returned: 0 in 0.382s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:45:09 devstack cinder-volume[88899]: DEBUG cinder.manager [None req-b8dcd4a2-2875-476c-9c6b-667ba0001008 tempest-CreateVolumesFromSnapshotTest-499945752 None] Notifying Schedulers of capabilities ... {{(pid=88899) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 08:45:09 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-b8dcd4a2-2875-476c-9c6b-667ba0001008 tempest-CreateVolumesFromSnapshotTest-499945752 None] Deleted volume successfully. Aug 03 08:45:09 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-b8dcd4a2-2875-476c-9c6b-667ba0001008 tempest-CreateVolumesFromSnapshotTest-499945752 None] Lock "cinder-ed402e41-3ba8-4546-ba67-4c213b01988b-delete_volume" released by "delete_volume" :: held 1.447s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:45:09 devstack sudo[106208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-e12693a7-7a76-4009-a37e-ee176a7499bc Aug 03 08:45:09 devstack sudo[106208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:45:09 devstack sudo[106206]: pam_unix(sudo:session): session closed for user root Aug 03 08:45:09 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-03e32d06-dcd5-4d84-8390-5a2ff20dc372 tempest-VolumeDependencyTests-1073688899 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-475b65d3-a899-45ac-913b-c64ae81ffc3c" returned: 0 in 0.482s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:45:09 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-03e32d06-dcd5-4d84-8390-5a2ff20dc372 tempest-VolumeDependencyTests-1073688899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-475b65d3-a899-45ac-913b-c64ae81ffc3c {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:45:09 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-3d5d4817-b426-4176-b76a-343729e3ea88 tempest-VolumesSnapshotNegativeTestJSON-476543663 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:45:09 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-3d5d4817-b426-4176-b76a-343729e3ea88 tempest-VolumesSnapshotNegativeTestJSON-476543663 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:45:09 devstack sudo[106214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-475b65d3-a899-45ac-913b-c64ae81ffc3c Aug 03 08:45:09 devstack sudo[106214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:45:09 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-3d5d4817-b426-4176-b76a-343729e3ea88 tempest-VolumesSnapshotNegativeTestJSON-476543663 None] Creating offline snapshot 5494e1f4-774a-4c17-8be5-35db42b47efc of volume 7cca1ce8-9fba-4288-ad46-1a96dea33177 {{(pid=88899) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 03 08:45:09 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bbbac25-a70f-4c56-a7f8-0dd6b96b5b32]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:45:09 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-3d5d4817-b426-4176-b76a-343729e3ea88 tempest-VolumesSnapshotNegativeTestJSON-476543663 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-7cca1ce8-9fba-4288-ad46-1a96dea33177 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:45:09 devstack sudo[106216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-7cca1ce8-9fba-4288-ad46-1a96dea33177 Aug 03 08:45:09 devstack sudo[106216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:45:09 devstack sudo[106208]: pam_unix(sudo:session): session closed for user root Aug 03 08:45:09 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-2e339cb2-7c02-4595-b94f-3da748c5d9ae tempest-CreateVolumesFromSnapshotTest-499945752 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-e12693a7-7a76-4009-a37e-ee176a7499bc" returned: 0 in 0.441s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:45:09 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-2e339cb2-7c02-4595-b94f-3da748c5d9ae tempest-CreateVolumesFromSnapshotTest-499945752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-e12693a7-7a76-4009-a37e-ee176a7499bc {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:45:10 devstack sudo[106221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-e12693a7-7a76-4009-a37e-ee176a7499bc Aug 03 08:45:10 devstack sudo[106221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:45:10 devstack sudo[106214]: pam_unix(sudo:session): session closed for user root Aug 03 08:45:10 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-03e32d06-dcd5-4d84-8390-5a2ff20dc372 tempest-VolumeDependencyTests-1073688899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-475b65d3-a899-45ac-913b-c64ae81ffc3c" returned: 0 in 0.259s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:45:10 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-03e32d06-dcd5-4d84-8390-5a2ff20dc372 tempest-VolumeDependencyTests-1073688899 None] Lock "cinder-quobyte-475b65d3-a899-45ac-913b-c64ae81ffc3c" released by "delete_volume" :: held 0.794s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:45:10 devstack cinder-volume[88899]: DEBUG cinder.quota [None req-03e32d06-dcd5-4d84-8390-5a2ff20dc372 tempest-VolumeDependencyTests-1073688899 None] Created reservations ['bc63d28e-b4cb-4e55-9d6d-513c3098ee8e', '6ad68e29-d6df-4ae7-bd35-22da4f2bf1cc', '3c3bf8c6-203a-4e00-a8da-001ce84223f8', 'f4b6a750-b733-497f-b0db-c23df5ee3901'] {{(pid=88899) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 08:45:10 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-03e32d06-dcd5-4d84-8390-5a2ff20dc372 tempest-VolumeDependencyTests-1073688899 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:45:10 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-03e32d06-dcd5-4d84-8390-5a2ff20dc372 tempest-VolumeDependencyTests-1073688899 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:45:10 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-03e32d06-dcd5-4d84-8390-5a2ff20dc372 tempest-VolumeDependencyTests-1073688899 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:45:10 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-03e32d06-dcd5-4d84-8390-5a2ff20dc372 tempest-VolumeDependencyTests-1073688899 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:45:10 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-03e32d06-dcd5-4d84-8390-5a2ff20dc372 tempest-VolumeDependencyTests-1073688899 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:45:10 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-03e32d06-dcd5-4d84-8390-5a2ff20dc372 tempest-VolumeDependencyTests-1073688899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:45:10 devstack sudo[106229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a Aug 03 08:45:10 devstack sudo[106229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:45:10 devstack sudo[106221]: pam_unix(sudo:session): session closed for user root Aug 03 08:45:10 devstack sudo[106216]: pam_unix(sudo:session): session closed for user root Aug 03 08:45:10 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-2e339cb2-7c02-4595-b94f-3da748c5d9ae tempest-CreateVolumesFromSnapshotTest-499945752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-e12693a7-7a76-4009-a37e-ee176a7499bc" returned: 0 in 0.270s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:45:10 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-3d5d4817-b426-4176-b76a-343729e3ea88 tempest-VolumesSnapshotNegativeTestJSON-476543663 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-7cca1ce8-9fba-4288-ad46-1a96dea33177" returned: 0 in 0.412s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:45:10 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-3d5d4817-b426-4176-b76a-343729e3ea88 tempest-VolumesSnapshotNegativeTestJSON-476543663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-7cca1ce8-9fba-4288-ad46-1a96dea33177,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-7cca1ce8-9fba-4288-ad46-1a96dea33177.5494e1f4-774a-4c17-8be5-35db42b47efc 2G {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:45:10 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-2e339cb2-7c02-4595-b94f-3da748c5d9ae tempest-CreateVolumesFromSnapshotTest-499945752 None] Lock "cinder-quobyte-e12693a7-7a76-4009-a37e-ee176a7499bc" released by "delete_volume" :: held 0.766s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:45:10 devstack sudo[106231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-7cca1ce8-9fba-4288-ad46-1a96dea33177,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-7cca1ce8-9fba-4288-ad46-1a96dea33177.5494e1f4-774a-4c17-8be5-35db42b47efc 2G Aug 03 08:45:10 devstack sudo[106231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:45:10 devstack cinder-volume[88899]: DEBUG cinder.quota [None req-2e339cb2-7c02-4595-b94f-3da748c5d9ae tempest-CreateVolumesFromSnapshotTest-499945752 None] Created reservations ['c73c6055-6ca6-4d93-9dae-867a49608ab5', '7a2595d2-92b8-4faf-b39d-668322cc8aa1', 'f08c6d20-0df1-4f98-a81c-79760ec109f6', '986d2be4-551a-4655-b2e4-0262e6f82866'] {{(pid=88899) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 08:45:10 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-2e339cb2-7c02-4595-b94f-3da748c5d9ae tempest-CreateVolumesFromSnapshotTest-499945752 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:45:10 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-2e339cb2-7c02-4595-b94f-3da748c5d9ae tempest-CreateVolumesFromSnapshotTest-499945752 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:45:10 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-2e339cb2-7c02-4595-b94f-3da748c5d9ae tempest-CreateVolumesFromSnapshotTest-499945752 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:45:10 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-2e339cb2-7c02-4595-b94f-3da748c5d9ae tempest-CreateVolumesFromSnapshotTest-499945752 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:45:10 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-2e339cb2-7c02-4595-b94f-3da748c5d9ae tempest-CreateVolumesFromSnapshotTest-499945752 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:45:10 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-2e339cb2-7c02-4595-b94f-3da748c5d9ae tempest-CreateVolumesFromSnapshotTest-499945752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:45:10 devstack sudo[106233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a Aug 03 08:45:10 devstack sudo[106233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:45:10 devstack sudo[106229]: pam_unix(sudo:session): session closed for user root Aug 03 08:45:10 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-03e32d06-dcd5-4d84-8390-5a2ff20dc372 tempest-VolumeDependencyTests-1073688899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a" returned: 0 in 0.329s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:45:10 devstack cinder-volume[88899]: DEBUG cinder.manager [None req-03e32d06-dcd5-4d84-8390-5a2ff20dc372 tempest-VolumeDependencyTests-1073688899 None] Notifying Schedulers of capabilities ... {{(pid=88899) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 08:45:10 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-03e32d06-dcd5-4d84-8390-5a2ff20dc372 tempest-VolumeDependencyTests-1073688899 None] Deleted volume successfully. Aug 03 08:45:10 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-03e32d06-dcd5-4d84-8390-5a2ff20dc372 tempest-VolumeDependencyTests-1073688899 None] Lock "cinder-475b65d3-a899-45ac-913b-c64ae81ffc3c-delete_volume" released by "delete_volume" :: held 1.375s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:45:10 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-38d351a7-7ad9-4f90-92ef-83c802ddf7a3 tempest-CreateVolumesFromSnapshotTest-499945752 None] Acquiring lock "cinder-536fdef5-781d-4687-9b4a-8929595c7845-delete_volume" by "delete_volume" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:45:10 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-38d351a7-7ad9-4f90-92ef-83c802ddf7a3 tempest-CreateVolumesFromSnapshotTest-499945752 None] Lock "cinder-536fdef5-781d-4687-9b4a-8929595c7845-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:45:10 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-38d351a7-7ad9-4f90-92ef-83c802ddf7a3 tempest-CreateVolumesFromSnapshotTest-499945752 None] Acquiring lock "cinder-quobyte-536fdef5-781d-4687-9b4a-8929595c7845" by "delete_volume" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:45:10 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-38d351a7-7ad9-4f90-92ef-83c802ddf7a3 tempest-CreateVolumesFromSnapshotTest-499945752 None] Lock "cinder-quobyte-536fdef5-781d-4687-9b4a-8929595c7845" acquired by "delete_volume" :: waited 0.023s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:45:10 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[91185f5e-068f-4a92-abaf-51420c3947c6]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:45:10 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-38d351a7-7ad9-4f90-92ef-83c802ddf7a3 tempest-CreateVolumesFromSnapshotTest-499945752 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-536fdef5-781d-4687-9b4a-8929595c7845 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:45:10 devstack sudo[106233]: pam_unix(sudo:session): session closed for user root Aug 03 08:45:10 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-2e339cb2-7c02-4595-b94f-3da748c5d9ae tempest-CreateVolumesFromSnapshotTest-499945752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a" returned: 0 in 0.383s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:45:10 devstack cinder-volume[88899]: DEBUG cinder.manager [None req-2e339cb2-7c02-4595-b94f-3da748c5d9ae tempest-CreateVolumesFromSnapshotTest-499945752 None] Notifying Schedulers of capabilities ... {{(pid=88899) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 08:45:10 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-2e339cb2-7c02-4595-b94f-3da748c5d9ae tempest-CreateVolumesFromSnapshotTest-499945752 None] Deleted volume successfully. Aug 03 08:45:10 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-2e339cb2-7c02-4595-b94f-3da748c5d9ae tempest-CreateVolumesFromSnapshotTest-499945752 None] Lock "cinder-e12693a7-7a76-4009-a37e-ee176a7499bc-delete_volume" released by "delete_volume" :: held 1.442s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:45:10 devstack sudo[106231]: pam_unix(sudo:session): session closed for user root Aug 03 08:45:10 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-3d5d4817-b426-4176-b76a-343729e3ea88 tempest-VolumesSnapshotNegativeTestJSON-476543663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-7cca1ce8-9fba-4288-ad46-1a96dea33177,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-7cca1ce8-9fba-4288-ad46-1a96dea33177.5494e1f4-774a-4c17-8be5-35db42b47efc 2G" returned: 0 in 0.629s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:45:10 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-3d5d4817-b426-4176-b76a-343729e3ea88 tempest-VolumesSnapshotNegativeTestJSON-476543663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7cca1ce8-9fba-4288-ad46-1a96dea33177 -F qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-7cca1ce8-9fba-4288-ad46-1a96dea33177.5494e1f4-774a-4c17-8be5-35db42b47efc {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:45:10 devstack sudo[106241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7cca1ce8-9fba-4288-ad46-1a96dea33177 -F qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-7cca1ce8-9fba-4288-ad46-1a96dea33177.5494e1f4-774a-4c17-8be5-35db42b47efc Aug 03 08:45:10 devstack sudo[106241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:45:10 devstack sudo[106240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-536fdef5-781d-4687-9b4a-8929595c7845 Aug 03 08:45:10 devstack sudo[106240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:45:11 devstack cinder-volume[88899]: DEBUG cinder.volume.flows.manager.create_volume [None req-35ab1b42-58ef-41da-a155-2df74ece1b5f tempest-VolumeDependencyTests-1073688899 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88899) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 08:45:11 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-35ab1b42-58ef-41da-a155-2df74ece1b5f tempest-VolumeDependencyTests-1073688899 None] Flow 'volume_create_manager' (5c3323de-0d5e-4b8d-9ed3-9709d9305112) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:45:11 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-35ab1b42-58ef-41da-a155-2df74ece1b5f tempest-VolumeDependencyTests-1073688899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9acd7bcc-050a-40e6-8a7f-9609eab072b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:45:11 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-35ab1b42-58ef-41da-a155-2df74ece1b5f tempest-VolumeDependencyTests-1073688899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9acd7bcc-050a-40e6-8a7f-9609eab072b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:45:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-2058391200',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=527e2540-732a-4b7c-afbc-ae2ccda5d24b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c2f62930ea114d94aae304e8ed339f9c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:45:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:45:11Z,use_quota=True,user_id='de61709cf33340bf9e956c0545be3966',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8bde7129-1dc4-42ab-b852-ab32c61b4921),volume_type_id=8bde7129-1dc4-42ab-b852-ab32c61b4921)' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:45:11 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-35ab1b42-58ef-41da-a155-2df74ece1b5f tempest-VolumeDependencyTests-1073688899 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (450771d0-be88-4c13-ab9f-1f397214737b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:45:11 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-35ab1b42-58ef-41da-a155-2df74ece1b5f tempest-VolumeDependencyTests-1073688899 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (450771d0-be88-4c13-ab9f-1f397214737b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:45:11 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-35ab1b42-58ef-41da-a155-2df74ece1b5f tempest-VolumeDependencyTests-1073688899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5f3e309-edf8-4f7e-8355-c0c29535a6b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:45:11 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-35ab1b42-58ef-41da-a155-2df74ece1b5f tempest-VolumeDependencyTests-1073688899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5f3e309-edf8-4f7e-8355-c0c29535a6b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '527e2540-732a-4b7c-afbc-ae2ccda5d24b', 'volume_name': 'volume-527e2540-732a-4b7c-afbc-ae2ccda5d24b', 'volume_size': 1}' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:45:11 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-35ab1b42-58ef-41da-a155-2df74ece1b5f tempest-VolumeDependencyTests-1073688899 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3bc274cf-8ae5-41bf-bdf6-0dedaa9298f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:45:11 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-35ab1b42-58ef-41da-a155-2df74ece1b5f tempest-VolumeDependencyTests-1073688899 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3bc274cf-8ae5-41bf-bdf6-0dedaa9298f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:45:11 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-35ab1b42-58ef-41da-a155-2df74ece1b5f tempest-VolumeDependencyTests-1073688899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a9c2155-42c7-404e-a36a-dd893a8f0204) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:45:11 devstack cinder-volume[88899]: INFO cinder.volume.flows.manager.create_volume [None req-35ab1b42-58ef-41da-a155-2df74ece1b5f tempest-VolumeDependencyTests-1073688899 None] Volume 527e2540-732a-4b7c-afbc-ae2ccda5d24b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-527e2540-732a-4b7c-afbc-ae2ccda5d24b', 'volume_size': 1} Aug 03 08:45:11 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-35ab1b42-58ef-41da-a155-2df74ece1b5f tempest-VolumeDependencyTests-1073688899 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:45:11 devstack sudo[106241]: pam_unix(sudo:session): session closed for user root Aug 03 08:45:11 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-3d5d4817-b426-4176-b76a-343729e3ea88 tempest-VolumesSnapshotNegativeTestJSON-476543663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7cca1ce8-9fba-4288-ad46-1a96dea33177 -F qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-7cca1ce8-9fba-4288-ad46-1a96dea33177.5494e1f4-774a-4c17-8be5-35db42b47efc" returned: 0 in 0.315s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:45:11 devstack cinder-volume[88899]: WARNING cinder.volume.drivers.remotefs [None req-3d5d4817-b426-4176-b76a-343729e3ea88 tempest-VolumesSnapshotNegativeTestJSON-476543663 None] /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-7cca1ce8-9fba-4288-ad46-1a96dea33177.5494e1f4-774a-4c17-8be5-35db42b47efc is being set with open permissions: ugo+rw Aug 03 08:45:11 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-3d5d4817-b426-4176-b76a-343729e3ea88 tempest-VolumesSnapshotNegativeTestJSON-476543663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-7cca1ce8-9fba-4288-ad46-1a96dea33177.5494e1f4-774a-4c17-8be5-35db42b47efc {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:45:11 devstack sudo[106240]: pam_unix(sudo:session): session closed for user root Aug 03 08:45:11 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-38d351a7-7ad9-4f90-92ef-83c802ddf7a3 tempest-CreateVolumesFromSnapshotTest-499945752 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-536fdef5-781d-4687-9b4a-8929595c7845" returned: 0 in 0.422s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:45:11 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-38d351a7-7ad9-4f90-92ef-83c802ddf7a3 tempest-CreateVolumesFromSnapshotTest-499945752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-536fdef5-781d-4687-9b4a-8929595c7845 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:45:11 devstack sudo[106250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-7cca1ce8-9fba-4288-ad46-1a96dea33177.5494e1f4-774a-4c17-8be5-35db42b47efc Aug 03 08:45:11 devstack sudo[106250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:45:11 devstack sudo[106251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-536fdef5-781d-4687-9b4a-8929595c7845 Aug 03 08:45:11 devstack sudo[106251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:45:11 devstack sudo[106250]: pam_unix(sudo:session): session closed for user root Aug 03 08:45:11 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-3d5d4817-b426-4176-b76a-343729e3ea88 tempest-VolumesSnapshotNegativeTestJSON-476543663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-7cca1ce8-9fba-4288-ad46-1a96dea33177.5494e1f4-774a-4c17-8be5-35db42b47efc" returned: 0 in 0.243s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:45:11 devstack sudo[106251]: pam_unix(sudo:session): session closed for user root Aug 03 08:45:11 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-38d351a7-7ad9-4f90-92ef-83c802ddf7a3 tempest-CreateVolumesFromSnapshotTest-499945752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-536fdef5-781d-4687-9b4a-8929595c7845" returned: 0 in 0.245s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:45:11 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-38d351a7-7ad9-4f90-92ef-83c802ddf7a3 tempest-CreateVolumesFromSnapshotTest-499945752 None] Lock "cinder-quobyte-536fdef5-781d-4687-9b4a-8929595c7845" released by "delete_volume" :: held 0.727s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:45:11 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-3d5d4817-b426-4176-b76a-343729e3ea88 tempest-VolumesSnapshotNegativeTestJSON-476543663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-7cca1ce8-9fba-4288-ad46-1a96dea33177.info {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:45:11 devstack sudo[106262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-7cca1ce8-9fba-4288-ad46-1a96dea33177.info Aug 03 08:45:11 devstack sudo[106262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:45:11 devstack cinder-volume[88899]: DEBUG cinder.quota [None req-38d351a7-7ad9-4f90-92ef-83c802ddf7a3 tempest-CreateVolumesFromSnapshotTest-499945752 None] Created reservations ['f14720a0-cc44-45a3-8c2e-fe87aecae505', '43795e7e-1da6-4276-9aec-83349616748c', '1d7e861a-e31c-4f8b-b0f9-88ccbddb141f', '1a884b44-bd71-42c6-b140-7cfea94a7033'] {{(pid=88899) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 08:45:11 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-38d351a7-7ad9-4f90-92ef-83c802ddf7a3 tempest-CreateVolumesFromSnapshotTest-499945752 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:45:11 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-38d351a7-7ad9-4f90-92ef-83c802ddf7a3 tempest-CreateVolumesFromSnapshotTest-499945752 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:45:11 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-38d351a7-7ad9-4f90-92ef-83c802ddf7a3 tempest-CreateVolumesFromSnapshotTest-499945752 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:45:11 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-38d351a7-7ad9-4f90-92ef-83c802ddf7a3 tempest-CreateVolumesFromSnapshotTest-499945752 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:45:11 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-38d351a7-7ad9-4f90-92ef-83c802ddf7a3 tempest-CreateVolumesFromSnapshotTest-499945752 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:45:11 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-38d351a7-7ad9-4f90-92ef-83c802ddf7a3 tempest-CreateVolumesFromSnapshotTest-499945752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:45:11 devstack sudo[106264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a Aug 03 08:45:11 devstack sudo[106264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:45:11 devstack sudo[106262]: pam_unix(sudo:session): session closed for user root Aug 03 08:45:11 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-3d5d4817-b426-4176-b76a-343729e3ea88 tempest-VolumesSnapshotNegativeTestJSON-476543663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-7cca1ce8-9fba-4288-ad46-1a96dea33177.info" returned: 0 in 0.248s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:45:11 devstack cinder-volume[88899]: WARNING cinder.volume.drivers.remotefs [None req-3d5d4817-b426-4176-b76a-343729e3ea88 tempest-VolumesSnapshotNegativeTestJSON-476543663 None] /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-7cca1ce8-9fba-4288-ad46-1a96dea33177.info is being set with open permissions: ugo+rw Aug 03 08:45:11 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-3d5d4817-b426-4176-b76a-343729e3ea88 tempest-VolumesSnapshotNegativeTestJSON-476543663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-7cca1ce8-9fba-4288-ad46-1a96dea33177.info {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:45:11 devstack sudo[106267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-7cca1ce8-9fba-4288-ad46-1a96dea33177.info Aug 03 08:45:11 devstack sudo[106267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:45:11 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-da589575-34b8-4bea-bfad-41dea1dda602 tempest-CreateVolumesFromSnapshotTest-499945752 None] Acquiring lock "cinder-60842ba4-5608-4470-b7f0-ffacb342bdf4-delete_snapshot" by "delete_snapshot" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:45:11 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-da589575-34b8-4bea-bfad-41dea1dda602 tempest-CreateVolumesFromSnapshotTest-499945752 None] Lock "cinder-60842ba4-5608-4470-b7f0-ffacb342bdf4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:45:11 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-da589575-34b8-4bea-bfad-41dea1dda602 tempest-CreateVolumesFromSnapshotTest-499945752 None] Acquiring lock "cinder-quobyte-921f6804-dbe4-483c-8f82-244aad495afb" by "delete_snapshot" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:45:11 devstack sudo[106264]: pam_unix(sudo:session): session closed for user root Aug 03 08:45:11 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-38d351a7-7ad9-4f90-92ef-83c802ddf7a3 tempest-CreateVolumesFromSnapshotTest-499945752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a" returned: 0 in 0.269s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:45:11 devstack cinder-volume[88899]: DEBUG cinder.manager [None req-38d351a7-7ad9-4f90-92ef-83c802ddf7a3 tempest-CreateVolumesFromSnapshotTest-499945752 None] Notifying Schedulers of capabilities ... {{(pid=88899) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 08:45:11 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-da589575-34b8-4bea-bfad-41dea1dda602 tempest-CreateVolumesFromSnapshotTest-499945752 None] Lock "cinder-quobyte-921f6804-dbe4-483c-8f82-244aad495afb" acquired by "delete_snapshot" :: waited 0.020s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:45:11 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-da589575-34b8-4bea-bfad-41dea1dda602 tempest-CreateVolumesFromSnapshotTest-499945752 None] Acquiring lock "cinder-quobyte-60842ba4-5608-4470-b7f0-ffacb342bdf4" by "_delete_snapshot" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:45:11 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-38d351a7-7ad9-4f90-92ef-83c802ddf7a3 tempest-CreateVolumesFromSnapshotTest-499945752 None] Deleted volume successfully. Aug 03 08:45:11 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-da589575-34b8-4bea-bfad-41dea1dda602 tempest-CreateVolumesFromSnapshotTest-499945752 None] Lock "cinder-quobyte-60842ba4-5608-4470-b7f0-ffacb342bdf4" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:45:11 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-da589575-34b8-4bea-bfad-41dea1dda602 tempest-CreateVolumesFromSnapshotTest-499945752 None] Deleting offline snapshot 60842ba4-5608-4470-b7f0-ffacb342bdf4 of volume 921f6804-dbe4-483c-8f82-244aad495afb {{(pid=88899) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 03 08:45:11 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-da589575-34b8-4bea-bfad-41dea1dda602 tempest-CreateVolumesFromSnapshotTest-499945752 None] snapshot_file for this snap is: volume-921f6804-dbe4-483c-8f82-244aad495afb.60842ba4-5608-4470-b7f0-ffacb342bdf4 {{(pid=88899) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 03 08:45:11 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-38d351a7-7ad9-4f90-92ef-83c802ddf7a3 tempest-CreateVolumesFromSnapshotTest-499945752 None] Lock "cinder-536fdef5-781d-4687-9b4a-8929595c7845-delete_volume" released by "delete_volume" :: held 1.269s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:45:11 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[22afedf6-86e5-4a14-bcf0-1ec0c0f4ca22]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:45:11 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-da589575-34b8-4bea-bfad-41dea1dda602 tempest-CreateVolumesFromSnapshotTest-499945752 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-921f6804-dbe4-483c-8f82-244aad495afb.60842ba4-5608-4470-b7f0-ffacb342bdf4 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:45:12 devstack sudo[106267]: pam_unix(sudo:session): session closed for user root Aug 03 08:45:12 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-3d5d4817-b426-4176-b76a-343729e3ea88 tempest-VolumesSnapshotNegativeTestJSON-476543663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-7cca1ce8-9fba-4288-ad46-1a96dea33177.info" returned: 0 in 0.309s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:45:12 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-3d5d4817-b426-4176-b76a-343729e3ea88 tempest-VolumesSnapshotNegativeTestJSON-476543663 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.256s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:45:12 devstack sudo[106270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-921f6804-dbe4-483c-8f82-244aad495afb.60842ba4-5608-4470-b7f0-ffacb342bdf4 Aug 03 08:45:12 devstack sudo[106270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:45:12 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-35ab1b42-58ef-41da-a155-2df74ece1b5f tempest-VolumeDependencyTests-1073688899 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.957s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:45:12 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-35ab1b42-58ef-41da-a155-2df74ece1b5f tempest-VolumeDependencyTests-1073688899 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:45:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-2058391200',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=527e2540-732a-4b7c-afbc-ae2ccda5d24b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c2f62930ea114d94aae304e8ed339f9c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:45:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:45:11Z,use_quota=True,user_id='de61709cf33340bf9e956c0545be3966',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8bde7129-1dc4-42ab-b852-ab32c61b4921),volume_type_id=8bde7129-1dc4-42ab-b852-ab32c61b4921)}" {{(pid=88899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 08:45:12 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-35ab1b42-58ef-41da-a155-2df74ece1b5f tempest-VolumeDependencyTests-1073688899 None] Creating volume 527e2540-732a-4b7c-afbc-ae2ccda5d24b {{(pid=88899) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 08:45:12 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-35ab1b42-58ef-41da-a155-2df74ece1b5f tempest-VolumeDependencyTests-1073688899 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:45:12 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-35ab1b42-58ef-41da-a155-2df74ece1b5f tempest-VolumeDependencyTests-1073688899 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:45:12 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-35ab1b42-58ef-41da-a155-2df74ece1b5f tempest-VolumeDependencyTests-1073688899 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:45:12 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-35ab1b42-58ef-41da-a155-2df74ece1b5f tempest-VolumeDependencyTests-1073688899 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:45:12 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-35ab1b42-58ef-41da-a155-2df74ece1b5f tempest-VolumeDependencyTests-1073688899 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:45:12 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-35ab1b42-58ef-41da-a155-2df74ece1b5f tempest-VolumeDependencyTests-1073688899 None] Selected osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385 as target Quobyte volume. {{(pid=88899) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 08:45:12 devstack cinder-volume[88899]: INFO cinder.volume.drivers.remotefs [None req-35ab1b42-58ef-41da-a155-2df74ece1b5f tempest-VolumeDependencyTests-1073688899 None] casted to osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385 Aug 03 08:45:12 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-35ab1b42-58ef-41da-a155-2df74ece1b5f tempest-VolumeDependencyTests-1073688899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-527e2540-732a-4b7c-afbc-ae2ccda5d24b 1073741824 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:45:12 devstack sudo[106273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-527e2540-732a-4b7c-afbc-ae2ccda5d24b 1073741824 Aug 03 08:45:12 devstack sudo[106273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:45:12 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-3d5d4817-b426-4176-b76a-343729e3ea88 tempest-VolumesSnapshotNegativeTestJSON-476543663 None] Create snapshot completed successfully Aug 03 08:45:12 devstack sudo[106270]: pam_unix(sudo:session): session closed for user root Aug 03 08:45:12 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-da589575-34b8-4bea-bfad-41dea1dda602 tempest-CreateVolumesFromSnapshotTest-499945752 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-921f6804-dbe4-483c-8f82-244aad495afb.60842ba4-5608-4470-b7f0-ffacb342bdf4" returned: 0 in 0.377s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:45:12 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-da589575-34b8-4bea-bfad-41dea1dda602 tempest-CreateVolumesFromSnapshotTest-499945752 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-921f6804-dbe4-483c-8f82-244aad495afb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88899) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 03 08:45:12 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c2e45e5-ce8c-49c0-adf4-ca18a5b7a827]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:45:12 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-da589575-34b8-4bea-bfad-41dea1dda602 tempest-CreateVolumesFromSnapshotTest-499945752 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-921f6804-dbe4-483c-8f82-244aad495afb {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:45:12 devstack sudo[106281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-921f6804-dbe4-483c-8f82-244aad495afb Aug 03 08:45:12 devstack sudo[106281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:45:12 devstack sudo[106273]: pam_unix(sudo:session): session closed for user root Aug 03 08:45:12 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-35ab1b42-58ef-41da-a155-2df74ece1b5f tempest-VolumeDependencyTests-1073688899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-527e2540-732a-4b7c-afbc-ae2ccda5d24b 1073741824" returned: 0 in 0.434s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:45:12 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-35ab1b42-58ef-41da-a155-2df74ece1b5f tempest-VolumeDependencyTests-1073688899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-527e2540-732a-4b7c-afbc-ae2ccda5d24b {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:45:12 devstack sudo[106284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-527e2540-732a-4b7c-afbc-ae2ccda5d24b Aug 03 08:45:12 devstack sudo[106284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:45:12 devstack sudo[106281]: pam_unix(sudo:session): session closed for user root Aug 03 08:45:12 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-da589575-34b8-4bea-bfad-41dea1dda602 tempest-CreateVolumesFromSnapshotTest-499945752 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-921f6804-dbe4-483c-8f82-244aad495afb" returned: 0 in 0.371s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:45:12 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-da589575-34b8-4bea-bfad-41dea1dda602 tempest-CreateVolumesFromSnapshotTest-499945752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-921f6804-dbe4-483c-8f82-244aad495afb.60842ba4-5608-4470-b7f0-ffacb342bdf4 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:45:12 devstack sudo[106289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-921f6804-dbe4-483c-8f82-244aad495afb.60842ba4-5608-4470-b7f0-ffacb342bdf4 Aug 03 08:45:12 devstack sudo[106289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:45:12 devstack sudo[106284]: pam_unix(sudo:session): session closed for user root Aug 03 08:45:12 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-35ab1b42-58ef-41da-a155-2df74ece1b5f tempest-VolumeDependencyTests-1073688899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-527e2540-732a-4b7c-afbc-ae2ccda5d24b" returned: 0 in 0.249s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:45:12 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-35ab1b42-58ef-41da-a155-2df74ece1b5f tempest-VolumeDependencyTests-1073688899 None] <== create_volume: return (726ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'} {{(pid=88899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 08:45:12 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-35ab1b42-58ef-41da-a155-2df74ece1b5f tempest-VolumeDependencyTests-1073688899 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.730s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:45:12 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-35ab1b42-58ef-41da-a155-2df74ece1b5f tempest-VolumeDependencyTests-1073688899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a9c2155-42c7-404e-a36a-dd893a8f0204) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-527e2540-732a-4b7c-afbc-ae2ccda5d24b', 'volume_size': 1}' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:45:12 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-35ab1b42-58ef-41da-a155-2df74ece1b5f tempest-VolumeDependencyTests-1073688899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2dae12ec-75f5-462a-9a54-60727312398b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:45:12 devstack cinder-volume[88899]: INFO cinder.volume.flows.manager.create_volume [None req-35ab1b42-58ef-41da-a155-2df74ece1b5f tempest-VolumeDependencyTests-1073688899 None] Volume volume-527e2540-732a-4b7c-afbc-ae2ccda5d24b (527e2540-732a-4b7c-afbc-ae2ccda5d24b): created successfully Aug 03 08:45:12 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-35ab1b42-58ef-41da-a155-2df74ece1b5f tempest-VolumeDependencyTests-1073688899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2dae12ec-75f5-462a-9a54-60727312398b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:45:12 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-35ab1b42-58ef-41da-a155-2df74ece1b5f tempest-VolumeDependencyTests-1073688899 None] Flow 'volume_create_manager' (5c3323de-0d5e-4b8d-9ed3-9709d9305112) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:45:12 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-35ab1b42-58ef-41da-a155-2df74ece1b5f tempest-VolumeDependencyTests-1073688899 None] Created volume successfully. Aug 03 08:45:13 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-172db143-9d52-4c69-903f-d346019f2c1f tempest-VolumesSnapshotNegativeTestJSON-476543663 None] Acquiring lock "cinder-5494e1f4-774a-4c17-8be5-35db42b47efc-delete_snapshot" by "delete_snapshot" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:45:13 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-172db143-9d52-4c69-903f-d346019f2c1f tempest-VolumesSnapshotNegativeTestJSON-476543663 None] Lock "cinder-5494e1f4-774a-4c17-8be5-35db42b47efc-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:45:13 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-172db143-9d52-4c69-903f-d346019f2c1f tempest-VolumesSnapshotNegativeTestJSON-476543663 None] Acquiring lock "cinder-quobyte-7cca1ce8-9fba-4288-ad46-1a96dea33177" by "delete_snapshot" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:45:13 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-172db143-9d52-4c69-903f-d346019f2c1f tempest-VolumesSnapshotNegativeTestJSON-476543663 None] Lock "cinder-quobyte-7cca1ce8-9fba-4288-ad46-1a96dea33177" acquired by "delete_snapshot" :: waited 0.017s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:45:13 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-172db143-9d52-4c69-903f-d346019f2c1f tempest-VolumesSnapshotNegativeTestJSON-476543663 None] Acquiring lock "cinder-quobyte-5494e1f4-774a-4c17-8be5-35db42b47efc" by "_delete_snapshot" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:45:13 devstack sudo[106289]: pam_unix(sudo:session): session closed for user root Aug 03 08:45:13 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-da589575-34b8-4bea-bfad-41dea1dda602 tempest-CreateVolumesFromSnapshotTest-499945752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-921f6804-dbe4-483c-8f82-244aad495afb.60842ba4-5608-4470-b7f0-ffacb342bdf4" returned: 0 in 0.400s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:45:13 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-da589575-34b8-4bea-bfad-41dea1dda602 tempest-CreateVolumesFromSnapshotTest-499945752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-921f6804-dbe4-483c-8f82-244aad495afb.60842ba4-5608-4470-b7f0-ffacb342bdf4 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:45:13 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-172db143-9d52-4c69-903f-d346019f2c1f tempest-VolumesSnapshotNegativeTestJSON-476543663 None] Lock "cinder-quobyte-5494e1f4-774a-4c17-8be5-35db42b47efc" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:45:13 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-172db143-9d52-4c69-903f-d346019f2c1f tempest-VolumesSnapshotNegativeTestJSON-476543663 None] Deleting offline snapshot 5494e1f4-774a-4c17-8be5-35db42b47efc of volume 7cca1ce8-9fba-4288-ad46-1a96dea33177 {{(pid=88899) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 03 08:45:13 devstack sudo[106296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-921f6804-dbe4-483c-8f82-244aad495afb.60842ba4-5608-4470-b7f0-ffacb342bdf4 Aug 03 08:45:13 devstack sudo[106296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:45:13 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-172db143-9d52-4c69-903f-d346019f2c1f tempest-VolumesSnapshotNegativeTestJSON-476543663 None] snapshot_file for this snap is: volume-7cca1ce8-9fba-4288-ad46-1a96dea33177.5494e1f4-774a-4c17-8be5-35db42b47efc {{(pid=88899) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 03 08:45:13 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7dfde31-1a58-484b-b54e-63af37827ab4]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:45:13 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-172db143-9d52-4c69-903f-d346019f2c1f tempest-VolumesSnapshotNegativeTestJSON-476543663 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-7cca1ce8-9fba-4288-ad46-1a96dea33177.5494e1f4-774a-4c17-8be5-35db42b47efc {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:45:13 devstack sudo[106298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-7cca1ce8-9fba-4288-ad46-1a96dea33177.5494e1f4-774a-4c17-8be5-35db42b47efc Aug 03 08:45:13 devstack sudo[106298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:45:13 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-2ba1742d-2601-4b00-801a-f39eb6de04a0 tempest-VolumeDependencyTests-1073688899 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:45:13 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-2ba1742d-2601-4b00-801a-f39eb6de04a0 tempest-VolumeDependencyTests-1073688899 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:45:13 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-2ba1742d-2601-4b00-801a-f39eb6de04a0 tempest-VolumeDependencyTests-1073688899 None] Creating offline snapshot 6798eb38-d3dc-4f82-a260-cb1f3fcff136 of volume 527e2540-732a-4b7c-afbc-ae2ccda5d24b {{(pid=88899) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 03 08:45:13 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f8fdf15-c91b-4d19-8869-687eb5be1bb7]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:45:13 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-2ba1742d-2601-4b00-801a-f39eb6de04a0 tempest-VolumeDependencyTests-1073688899 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-527e2540-732a-4b7c-afbc-ae2ccda5d24b {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:45:13 devstack sudo[106296]: pam_unix(sudo:session): session closed for user root Aug 03 08:45:13 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-da589575-34b8-4bea-bfad-41dea1dda602 tempest-CreateVolumesFromSnapshotTest-499945752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-921f6804-dbe4-483c-8f82-244aad495afb.60842ba4-5608-4470-b7f0-ffacb342bdf4" returned: 0 in 0.292s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:45:13 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-da589575-34b8-4bea-bfad-41dea1dda602 tempest-CreateVolumesFromSnapshotTest-499945752 None] Lock "cinder-quobyte-60842ba4-5608-4470-b7f0-ffacb342bdf4" released by "_delete_snapshot" :: held 1.555s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:45:13 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-da589575-34b8-4bea-bfad-41dea1dda602 tempest-CreateVolumesFromSnapshotTest-499945752 None] Lock "cinder-quobyte-921f6804-dbe4-483c-8f82-244aad495afb" released by "delete_snapshot" :: held 1.582s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:45:13 devstack sudo[106300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-527e2540-732a-4b7c-afbc-ae2ccda5d24b Aug 03 08:45:13 devstack sudo[106300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:45:13 devstack cinder-volume[88899]: DEBUG cinder.quota [None req-da589575-34b8-4bea-bfad-41dea1dda602 tempest-CreateVolumesFromSnapshotTest-499945752 None] Created reservations ['7f7e4f18-7229-4ee3-bd79-4425a5f09f1e', 'acda44c7-6a59-46f8-b40e-bc93935e1d1c', 'f158fd0f-e789-43d8-b944-ce0a40e8e94c', '0c574e69-0efe-42e1-9dc2-1e0769fb0ceb'] {{(pid=88899) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 08:45:13 devstack sudo[106298]: pam_unix(sudo:session): session closed for user root Aug 03 08:45:13 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-172db143-9d52-4c69-903f-d346019f2c1f tempest-VolumesSnapshotNegativeTestJSON-476543663 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-7cca1ce8-9fba-4288-ad46-1a96dea33177.5494e1f4-774a-4c17-8be5-35db42b47efc" returned: 0 in 0.390s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:45:13 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-172db143-9d52-4c69-903f-d346019f2c1f tempest-VolumesSnapshotNegativeTestJSON-476543663 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7cca1ce8-9fba-4288-ad46-1a96dea33177(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88899) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 03 08:45:13 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef3a3aaa-dbdc-4c4b-93c7-cbf6a72fb6e4]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:45:13 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-172db143-9d52-4c69-903f-d346019f2c1f tempest-VolumesSnapshotNegativeTestJSON-476543663 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-7cca1ce8-9fba-4288-ad46-1a96dea33177 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:45:13 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-da589575-34b8-4bea-bfad-41dea1dda602 tempest-CreateVolumesFromSnapshotTest-499945752 None] Delete snapshot completed successfully. Aug 03 08:45:13 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-da589575-34b8-4bea-bfad-41dea1dda602 tempest-CreateVolumesFromSnapshotTest-499945752 None] Lock "cinder-60842ba4-5608-4470-b7f0-ffacb342bdf4-delete_snapshot" released by "delete_snapshot" :: held 1.758s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:45:13 devstack sudo[106306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-7cca1ce8-9fba-4288-ad46-1a96dea33177 Aug 03 08:45:13 devstack sudo[106306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:45:13 devstack sudo[106300]: pam_unix(sudo:session): session closed for user root Aug 03 08:45:13 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-2ba1742d-2601-4b00-801a-f39eb6de04a0 tempest-VolumeDependencyTests-1073688899 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-527e2540-732a-4b7c-afbc-ae2ccda5d24b" returned: 0 in 0.381s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:45:13 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-2ba1742d-2601-4b00-801a-f39eb6de04a0 tempest-VolumeDependencyTests-1073688899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-527e2540-732a-4b7c-afbc-ae2ccda5d24b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-527e2540-732a-4b7c-afbc-ae2ccda5d24b.6798eb38-d3dc-4f82-a260-cb1f3fcff136 1G {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:45:13 devstack sudo[106311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-527e2540-732a-4b7c-afbc-ae2ccda5d24b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-527e2540-732a-4b7c-afbc-ae2ccda5d24b.6798eb38-d3dc-4f82-a260-cb1f3fcff136 1G Aug 03 08:45:13 devstack sudo[106311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:45:14 devstack sudo[106306]: pam_unix(sudo:session): session closed for user root Aug 03 08:45:14 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-91557071-e2e0-4d5c-8e7a-5a9439781e9e tempest-CreateVolumesFromSnapshotTest-499945752 None] Acquiring lock "cinder-921f6804-dbe4-483c-8f82-244aad495afb-delete_volume" by "delete_volume" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:45:14 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-172db143-9d52-4c69-903f-d346019f2c1f tempest-VolumesSnapshotNegativeTestJSON-476543663 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-7cca1ce8-9fba-4288-ad46-1a96dea33177" returned: 0 in 0.420s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:45:14 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-172db143-9d52-4c69-903f-d346019f2c1f tempest-VolumesSnapshotNegativeTestJSON-476543663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-7cca1ce8-9fba-4288-ad46-1a96dea33177.5494e1f4-774a-4c17-8be5-35db42b47efc {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:45:14 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-91557071-e2e0-4d5c-8e7a-5a9439781e9e tempest-CreateVolumesFromSnapshotTest-499945752 None] Lock "cinder-921f6804-dbe4-483c-8f82-244aad495afb-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:45:14 devstack sudo[106320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-7cca1ce8-9fba-4288-ad46-1a96dea33177.5494e1f4-774a-4c17-8be5-35db42b47efc Aug 03 08:45:14 devstack sudo[106320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:45:14 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-91557071-e2e0-4d5c-8e7a-5a9439781e9e tempest-CreateVolumesFromSnapshotTest-499945752 None] Acquiring lock "cinder-quobyte-921f6804-dbe4-483c-8f82-244aad495afb" by "delete_volume" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:45:14 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-91557071-e2e0-4d5c-8e7a-5a9439781e9e tempest-CreateVolumesFromSnapshotTest-499945752 None] Lock "cinder-quobyte-921f6804-dbe4-483c-8f82-244aad495afb" acquired by "delete_volume" :: waited 0.015s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:45:14 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[663cd335-fb93-4078-811a-1f75d5e269f5]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:45:14 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-91557071-e2e0-4d5c-8e7a-5a9439781e9e tempest-CreateVolumesFromSnapshotTest-499945752 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-921f6804-dbe4-483c-8f82-244aad495afb {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:45:14 devstack sudo[106311]: pam_unix(sudo:session): session closed for user root Aug 03 08:45:14 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-2ba1742d-2601-4b00-801a-f39eb6de04a0 tempest-VolumeDependencyTests-1073688899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-527e2540-732a-4b7c-afbc-ae2ccda5d24b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-527e2540-732a-4b7c-afbc-ae2ccda5d24b.6798eb38-d3dc-4f82-a260-cb1f3fcff136 1G" returned: 0 in 0.476s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:45:14 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-2ba1742d-2601-4b00-801a-f39eb6de04a0 tempest-VolumeDependencyTests-1073688899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-527e2540-732a-4b7c-afbc-ae2ccda5d24b -F qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-527e2540-732a-4b7c-afbc-ae2ccda5d24b.6798eb38-d3dc-4f82-a260-cb1f3fcff136 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:45:14 devstack sudo[106323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-527e2540-732a-4b7c-afbc-ae2ccda5d24b -F qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-527e2540-732a-4b7c-afbc-ae2ccda5d24b.6798eb38-d3dc-4f82-a260-cb1f3fcff136 Aug 03 08:45:14 devstack sudo[106323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:45:14 devstack sudo[106322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-921f6804-dbe4-483c-8f82-244aad495afb Aug 03 08:45:14 devstack sudo[106322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:45:14 devstack sudo[106320]: pam_unix(sudo:session): session closed for user root Aug 03 08:45:14 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-172db143-9d52-4c69-903f-d346019f2c1f tempest-VolumesSnapshotNegativeTestJSON-476543663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-7cca1ce8-9fba-4288-ad46-1a96dea33177.5494e1f4-774a-4c17-8be5-35db42b47efc" returned: 0 in 0.379s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:45:14 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-172db143-9d52-4c69-903f-d346019f2c1f tempest-VolumesSnapshotNegativeTestJSON-476543663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-7cca1ce8-9fba-4288-ad46-1a96dea33177.5494e1f4-774a-4c17-8be5-35db42b47efc {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:45:14 devstack sudo[106329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-7cca1ce8-9fba-4288-ad46-1a96dea33177.5494e1f4-774a-4c17-8be5-35db42b47efc Aug 03 08:45:14 devstack sudo[106329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:45:14 devstack sudo[106322]: pam_unix(sudo:session): session closed for user root Aug 03 08:45:14 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-91557071-e2e0-4d5c-8e7a-5a9439781e9e tempest-CreateVolumesFromSnapshotTest-499945752 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-921f6804-dbe4-483c-8f82-244aad495afb" returned: 0 in 0.375s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:45:14 devstack sudo[106323]: pam_unix(sudo:session): session closed for user root Aug 03 08:45:14 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-91557071-e2e0-4d5c-8e7a-5a9439781e9e tempest-CreateVolumesFromSnapshotTest-499945752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-921f6804-dbe4-483c-8f82-244aad495afb {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:45:14 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-2ba1742d-2601-4b00-801a-f39eb6de04a0 tempest-VolumeDependencyTests-1073688899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-527e2540-732a-4b7c-afbc-ae2ccda5d24b -F qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-527e2540-732a-4b7c-afbc-ae2ccda5d24b.6798eb38-d3dc-4f82-a260-cb1f3fcff136" returned: 0 in 0.328s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:45:14 devstack cinder-volume[88899]: WARNING cinder.volume.drivers.remotefs [None req-2ba1742d-2601-4b00-801a-f39eb6de04a0 tempest-VolumeDependencyTests-1073688899 None] /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-527e2540-732a-4b7c-afbc-ae2ccda5d24b.6798eb38-d3dc-4f82-a260-cb1f3fcff136 is being set with open permissions: ugo+rw Aug 03 08:45:14 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-2ba1742d-2601-4b00-801a-f39eb6de04a0 tempest-VolumeDependencyTests-1073688899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-527e2540-732a-4b7c-afbc-ae2ccda5d24b.6798eb38-d3dc-4f82-a260-cb1f3fcff136 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:45:14 devstack sudo[106337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-921f6804-dbe4-483c-8f82-244aad495afb Aug 03 08:45:14 devstack sudo[106337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:45:14 devstack sudo[106338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-527e2540-732a-4b7c-afbc-ae2ccda5d24b.6798eb38-d3dc-4f82-a260-cb1f3fcff136 Aug 03 08:45:14 devstack sudo[106338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:45:14 devstack sudo[106329]: pam_unix(sudo:session): session closed for user root Aug 03 08:45:14 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-172db143-9d52-4c69-903f-d346019f2c1f tempest-VolumesSnapshotNegativeTestJSON-476543663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-7cca1ce8-9fba-4288-ad46-1a96dea33177.5494e1f4-774a-4c17-8be5-35db42b47efc" returned: 0 in 0.256s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:45:14 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-172db143-9d52-4c69-903f-d346019f2c1f tempest-VolumesSnapshotNegativeTestJSON-476543663 None] Lock "cinder-quobyte-5494e1f4-774a-4c17-8be5-35db42b47efc" released by "_delete_snapshot" :: held 1.554s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:45:14 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-172db143-9d52-4c69-903f-d346019f2c1f tempest-VolumesSnapshotNegativeTestJSON-476543663 None] Lock "cinder-quobyte-7cca1ce8-9fba-4288-ad46-1a96dea33177" released by "delete_snapshot" :: held 1.591s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:45:14 devstack cinder-volume[88899]: DEBUG cinder.quota [None req-172db143-9d52-4c69-903f-d346019f2c1f tempest-VolumesSnapshotNegativeTestJSON-476543663 None] Created reservations ['452d75d6-2d6c-4888-a1dc-2ecb2527d975', '2d703a34-186d-4c2d-8756-029b61d1aa44', 'a8475752-b3e0-4fce-bac2-4dc186105360', 'bc5455f8-3a3a-47f8-a35b-d6a86f2e39df'] {{(pid=88899) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 08:45:14 devstack sudo[106337]: pam_unix(sudo:session): session closed for user root Aug 03 08:45:14 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-91557071-e2e0-4d5c-8e7a-5a9439781e9e tempest-CreateVolumesFromSnapshotTest-499945752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-921f6804-dbe4-483c-8f82-244aad495afb" returned: 0 in 0.265s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:45:14 devstack sudo[106338]: pam_unix(sudo:session): session closed for user root Aug 03 08:45:14 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-2ba1742d-2601-4b00-801a-f39eb6de04a0 tempest-VolumeDependencyTests-1073688899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-527e2540-732a-4b7c-afbc-ae2ccda5d24b.6798eb38-d3dc-4f82-a260-cb1f3fcff136" returned: 0 in 0.265s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:45:14 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-91557071-e2e0-4d5c-8e7a-5a9439781e9e tempest-CreateVolumesFromSnapshotTest-499945752 None] Lock "cinder-quobyte-921f6804-dbe4-483c-8f82-244aad495afb" released by "delete_volume" :: held 0.719s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:45:14 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-172db143-9d52-4c69-903f-d346019f2c1f tempest-VolumesSnapshotNegativeTestJSON-476543663 None] Delete snapshot completed successfully. Aug 03 08:45:14 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-172db143-9d52-4c69-903f-d346019f2c1f tempest-VolumesSnapshotNegativeTestJSON-476543663 None] Lock "cinder-5494e1f4-774a-4c17-8be5-35db42b47efc-delete_snapshot" released by "delete_snapshot" :: held 1.775s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:45:14 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-2ba1742d-2601-4b00-801a-f39eb6de04a0 tempest-VolumeDependencyTests-1073688899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-527e2540-732a-4b7c-afbc-ae2ccda5d24b.info {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:45:14 devstack sudo[106344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-527e2540-732a-4b7c-afbc-ae2ccda5d24b.info Aug 03 08:45:14 devstack sudo[106344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:45:14 devstack cinder-volume[88899]: DEBUG cinder.quota [None req-91557071-e2e0-4d5c-8e7a-5a9439781e9e tempest-CreateVolumesFromSnapshotTest-499945752 None] Created reservations ['7a8d26f6-ba06-4495-9ad0-e0c6177e8258', '7cdf34e2-82cf-4217-98c3-59c46654a5ec', 'e96fa8e1-ab98-4b06-9e01-b13b3f98d77b', '1efa6357-254c-4984-b383-eaba449f1ca5'] {{(pid=88899) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 08:45:14 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-91557071-e2e0-4d5c-8e7a-5a9439781e9e tempest-CreateVolumesFromSnapshotTest-499945752 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:45:14 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-91557071-e2e0-4d5c-8e7a-5a9439781e9e tempest-CreateVolumesFromSnapshotTest-499945752 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:45:14 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-91557071-e2e0-4d5c-8e7a-5a9439781e9e tempest-CreateVolumesFromSnapshotTest-499945752 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:45:14 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-91557071-e2e0-4d5c-8e7a-5a9439781e9e tempest-CreateVolumesFromSnapshotTest-499945752 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:45:14 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-91557071-e2e0-4d5c-8e7a-5a9439781e9e tempest-CreateVolumesFromSnapshotTest-499945752 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:45:14 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-91557071-e2e0-4d5c-8e7a-5a9439781e9e tempest-CreateVolumesFromSnapshotTest-499945752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:45:15 devstack sudo[106346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a Aug 03 08:45:15 devstack sudo[106346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:45:15 devstack sudo[106344]: pam_unix(sudo:session): session closed for user root Aug 03 08:45:15 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-2ba1742d-2601-4b00-801a-f39eb6de04a0 tempest-VolumeDependencyTests-1073688899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-527e2540-732a-4b7c-afbc-ae2ccda5d24b.info" returned: 0 in 0.259s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:45:15 devstack cinder-volume[88899]: WARNING cinder.volume.drivers.remotefs [None req-2ba1742d-2601-4b00-801a-f39eb6de04a0 tempest-VolumeDependencyTests-1073688899 None] /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-527e2540-732a-4b7c-afbc-ae2ccda5d24b.info is being set with open permissions: ugo+rw Aug 03 08:45:15 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-2ba1742d-2601-4b00-801a-f39eb6de04a0 tempest-VolumeDependencyTests-1073688899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-527e2540-732a-4b7c-afbc-ae2ccda5d24b.info {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:45:15 devstack sudo[106349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-527e2540-732a-4b7c-afbc-ae2ccda5d24b.info Aug 03 08:45:15 devstack sudo[106349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:45:15 devstack sudo[106346]: pam_unix(sudo:session): session closed for user root Aug 03 08:45:15 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-91557071-e2e0-4d5c-8e7a-5a9439781e9e tempest-CreateVolumesFromSnapshotTest-499945752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a" returned: 0 in 0.271s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:45:15 devstack cinder-volume[88899]: DEBUG cinder.manager [None req-91557071-e2e0-4d5c-8e7a-5a9439781e9e tempest-CreateVolumesFromSnapshotTest-499945752 None] Notifying Schedulers of capabilities ... {{(pid=88899) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 08:45:15 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-91557071-e2e0-4d5c-8e7a-5a9439781e9e tempest-CreateVolumesFromSnapshotTest-499945752 None] Deleted volume successfully. Aug 03 08:45:15 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-91557071-e2e0-4d5c-8e7a-5a9439781e9e tempest-CreateVolumesFromSnapshotTest-499945752 None] Lock "cinder-921f6804-dbe4-483c-8f82-244aad495afb-delete_volume" released by "delete_volume" :: held 1.254s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:45:15 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-c1c01c86-b850-4bdf-9b54-29d283bd29ab tempest-VolumesSnapshotNegativeTestJSON-476543663 None] Acquiring lock "cinder-7cca1ce8-9fba-4288-ad46-1a96dea33177-delete_volume" by "delete_volume" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:45:15 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-c1c01c86-b850-4bdf-9b54-29d283bd29ab tempest-VolumesSnapshotNegativeTestJSON-476543663 None] Lock "cinder-7cca1ce8-9fba-4288-ad46-1a96dea33177-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:45:15 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-c1c01c86-b850-4bdf-9b54-29d283bd29ab tempest-VolumesSnapshotNegativeTestJSON-476543663 None] Acquiring lock "cinder-quobyte-7cca1ce8-9fba-4288-ad46-1a96dea33177" by "delete_volume" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:45:15 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-c1c01c86-b850-4bdf-9b54-29d283bd29ab tempest-VolumesSnapshotNegativeTestJSON-476543663 None] Lock "cinder-quobyte-7cca1ce8-9fba-4288-ad46-1a96dea33177" acquired by "delete_volume" :: waited 0.022s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:45:15 devstack sudo[106349]: pam_unix(sudo:session): session closed for user root Aug 03 08:45:15 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-2ba1742d-2601-4b00-801a-f39eb6de04a0 tempest-VolumeDependencyTests-1073688899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-527e2540-732a-4b7c-afbc-ae2ccda5d24b.info" returned: 0 in 0.335s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:45:15 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-2ba1742d-2601-4b00-801a-f39eb6de04a0 tempest-VolumeDependencyTests-1073688899 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.168s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:45:15 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[0936cbee-e492-465f-b855-87bc9c5ff6a6]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:45:15 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-c1c01c86-b850-4bdf-9b54-29d283bd29ab tempest-VolumesSnapshotNegativeTestJSON-476543663 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-7cca1ce8-9fba-4288-ad46-1a96dea33177 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:45:15 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-2ba1742d-2601-4b00-801a-f39eb6de04a0 tempest-VolumeDependencyTests-1073688899 None] Create snapshot completed successfully Aug 03 08:45:15 devstack sudo[106353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-7cca1ce8-9fba-4288-ad46-1a96dea33177 Aug 03 08:45:15 devstack sudo[106353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:45:15 devstack sudo[106353]: pam_unix(sudo:session): session closed for user root Aug 03 08:45:15 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-c1c01c86-b850-4bdf-9b54-29d283bd29ab tempest-VolumesSnapshotNegativeTestJSON-476543663 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-7cca1ce8-9fba-4288-ad46-1a96dea33177" returned: 0 in 0.378s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:45:15 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-c1c01c86-b850-4bdf-9b54-29d283bd29ab tempest-VolumesSnapshotNegativeTestJSON-476543663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-7cca1ce8-9fba-4288-ad46-1a96dea33177 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:45:15 devstack sudo[106358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-7cca1ce8-9fba-4288-ad46-1a96dea33177 Aug 03 08:45:15 devstack sudo[106358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:45:16 devstack sudo[106358]: pam_unix(sudo:session): session closed for user root Aug 03 08:45:16 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-c1c01c86-b850-4bdf-9b54-29d283bd29ab tempest-VolumesSnapshotNegativeTestJSON-476543663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-7cca1ce8-9fba-4288-ad46-1a96dea33177" returned: 0 in 0.271s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:45:16 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-c1c01c86-b850-4bdf-9b54-29d283bd29ab tempest-VolumesSnapshotNegativeTestJSON-476543663 None] Lock "cinder-quobyte-7cca1ce8-9fba-4288-ad46-1a96dea33177" released by "delete_volume" :: held 0.730s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:45:16 devstack cinder-volume[88899]: DEBUG cinder.quota [None req-c1c01c86-b850-4bdf-9b54-29d283bd29ab tempest-VolumesSnapshotNegativeTestJSON-476543663 None] Created reservations ['904202bd-f83a-44fc-926c-7aa492ed83b6', 'e991fe17-181b-4584-9502-58e095b3d62c', '93f73349-a848-4c7d-ba37-2e080e82199b', '9eff124d-9b17-43c8-9be0-ceabcb342858'] {{(pid=88899) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 08:45:16 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-c1c01c86-b850-4bdf-9b54-29d283bd29ab tempest-VolumesSnapshotNegativeTestJSON-476543663 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:45:16 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-c1c01c86-b850-4bdf-9b54-29d283bd29ab tempest-VolumesSnapshotNegativeTestJSON-476543663 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:45:16 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-c1c01c86-b850-4bdf-9b54-29d283bd29ab tempest-VolumesSnapshotNegativeTestJSON-476543663 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:45:16 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-c1c01c86-b850-4bdf-9b54-29d283bd29ab tempest-VolumesSnapshotNegativeTestJSON-476543663 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:45:16 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-c1c01c86-b850-4bdf-9b54-29d283bd29ab tempest-VolumesSnapshotNegativeTestJSON-476543663 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:45:16 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-c1c01c86-b850-4bdf-9b54-29d283bd29ab tempest-VolumesSnapshotNegativeTestJSON-476543663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:45:16 devstack sudo[106361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a Aug 03 08:45:16 devstack sudo[106361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:45:16 devstack sudo[106361]: pam_unix(sudo:session): session closed for user root Aug 03 08:45:16 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-c1c01c86-b850-4bdf-9b54-29d283bd29ab tempest-VolumesSnapshotNegativeTestJSON-476543663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a" returned: 0 in 0.304s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:45:16 devstack cinder-volume[88899]: DEBUG cinder.manager [None req-c1c01c86-b850-4bdf-9b54-29d283bd29ab tempest-VolumesSnapshotNegativeTestJSON-476543663 None] Notifying Schedulers of capabilities ... {{(pid=88899) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 08:45:16 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-c1c01c86-b850-4bdf-9b54-29d283bd29ab tempest-VolumesSnapshotNegativeTestJSON-476543663 None] Deleted volume successfully. Aug 03 08:45:16 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-c1c01c86-b850-4bdf-9b54-29d283bd29ab tempest-VolumesSnapshotNegativeTestJSON-476543663 None] Lock "cinder-7cca1ce8-9fba-4288-ad46-1a96dea33177-delete_volume" released by "delete_volume" :: held 1.281s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:45:17 devstack cinder-volume[88899]: DEBUG cinder.volume.flows.manager.create_volume [None req-8123db30-48cd-4f00-b617-68601c4474c2 tempest-VolumeDependencyTests-1073688899 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88899) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 08:45:17 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-8123db30-48cd-4f00-b617-68601c4474c2 tempest-VolumeDependencyTests-1073688899 None] Flow 'volume_create_manager' (6fd283a5-d6f6-4faa-a068-fb2b276c5ee9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:45:17 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-8123db30-48cd-4f00-b617-68601c4474c2 tempest-VolumeDependencyTests-1073688899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c208a175-5885-4526-9221-97de87b7f923) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:45:17 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-8123db30-48cd-4f00-b617-68601c4474c2 tempest-VolumeDependencyTests-1073688899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c208a175-5885-4526-9221-97de87b7f923) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:45:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1784884156',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d835afb-99cc-442b-ab26-0d36c54fdbe2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c2f62930ea114d94aae304e8ed339f9c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:45:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=6798eb38-d3dc-4f82-a260-cb1f3fcff136,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:45:17Z,use_quota=True,user_id='de61709cf33340bf9e956c0545be3966',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8bde7129-1dc4-42ab-b852-ab32c61b4921),volume_type_id=8bde7129-1dc4-42ab-b852-ab32c61b4921)' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:45:17 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-8123db30-48cd-4f00-b617-68601c4474c2 tempest-VolumeDependencyTests-1073688899 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ba919ef-c2a1-426f-918a-8c3308c0d948) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:45:17 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-8123db30-48cd-4f00-b617-68601c4474c2 tempest-VolumeDependencyTests-1073688899 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ba919ef-c2a1-426f-918a-8c3308c0d948) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:45:17 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-8123db30-48cd-4f00-b617-68601c4474c2 tempest-VolumeDependencyTests-1073688899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a2916c2a-b8ad-4e16-b809-aeceda2549a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:45:17 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-8123db30-48cd-4f00-b617-68601c4474c2 tempest-VolumeDependencyTests-1073688899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a2916c2a-b8ad-4e16-b809-aeceda2549a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '3d835afb-99cc-442b-ab26-0d36c54fdbe2', 'volume_name': 'volume-3d835afb-99cc-442b-ab26-0d36c54fdbe2', 'volume_size': 1, 'snapshot_id': '6798eb38-d3dc-4f82-a260-cb1f3fcff136'}' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:45:17 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-8123db30-48cd-4f00-b617-68601c4474c2 tempest-VolumeDependencyTests-1073688899 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2788cc03-7c32-4e20-aad2-4682706e038f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:45:17 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-8123db30-48cd-4f00-b617-68601c4474c2 tempest-VolumeDependencyTests-1073688899 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2788cc03-7c32-4e20-aad2-4682706e038f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:45:17 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-8123db30-48cd-4f00-b617-68601c4474c2 tempest-VolumeDependencyTests-1073688899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (426f112b-b40b-4c56-bb4d-c2db68461984) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:45:17 devstack cinder-volume[88899]: INFO cinder.volume.flows.manager.create_volume [None req-8123db30-48cd-4f00-b617-68601c4474c2 tempest-VolumeDependencyTests-1073688899 None] Volume 3d835afb-99cc-442b-ab26-0d36c54fdbe2: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-3d835afb-99cc-442b-ab26-0d36c54fdbe2', 'volume_size': 1, 'snapshot_id': '6798eb38-d3dc-4f82-a260-cb1f3fcff136'} Aug 03 08:45:17 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-8123db30-48cd-4f00-b617-68601c4474c2 tempest-VolumeDependencyTests-1073688899 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:45:17 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-8123db30-48cd-4f00-b617-68601c4474c2 tempest-VolumeDependencyTests-1073688899 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:45:17 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-8123db30-48cd-4f00-b617-68601c4474c2 tempest-VolumeDependencyTests-1073688899 None] Acquiring lock "cinder-quobyte-6798eb38-d3dc-4f82-a260-cb1f3fcff136-3d835afb-99cc-442b-ab26-0d36c54fdbe2" by "_create_volume_from_snapshot" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:45:17 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-8123db30-48cd-4f00-b617-68601c4474c2 tempest-VolumeDependencyTests-1073688899 None] Lock "cinder-quobyte-6798eb38-d3dc-4f82-a260-cb1f3fcff136-3d835afb-99cc-442b-ab26-0d36c54fdbe2" acquired by "_create_volume_from_snapshot" :: waited 0.023s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:45:17 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-8123db30-48cd-4f00-b617-68601c4474c2 tempest-VolumeDependencyTests-1073688899 None] Creating volume 3d835afb-99cc-442b-ab26-0d36c54fdbe2 from snapshot 6798eb38-d3dc-4f82-a260-cb1f3fcff136 {{(pid=88899) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Aug 03 08:45:17 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-8123db30-48cd-4f00-b617-68601c4474c2 tempest-VolumeDependencyTests-1073688899 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:45:17 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-8123db30-48cd-4f00-b617-68601c4474c2 tempest-VolumeDependencyTests-1073688899 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:45:17 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-8123db30-48cd-4f00-b617-68601c4474c2 tempest-VolumeDependencyTests-1073688899 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:45:17 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-8123db30-48cd-4f00-b617-68601c4474c2 tempest-VolumeDependencyTests-1073688899 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:45:17 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-8123db30-48cd-4f00-b617-68601c4474c2 tempest-VolumeDependencyTests-1073688899 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:45:17 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-8123db30-48cd-4f00-b617-68601c4474c2 tempest-VolumeDependencyTests-1073688899 None] Selected osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385 as target Quobyte volume. {{(pid=88899) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 08:45:17 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-8123db30-48cd-4f00-b617-68601c4474c2 tempest-VolumeDependencyTests-1073688899 None] Acquiring lock "cinder-quobyte-3d835afb-99cc-442b-ab26-0d36c54fdbe2" by "_copy_volume_from_snapshot" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:45:17 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-8123db30-48cd-4f00-b617-68601c4474c2 tempest-VolumeDependencyTests-1073688899 None] Lock "cinder-quobyte-3d835afb-99cc-442b-ab26-0d36c54fdbe2" acquired by "_copy_volume_from_snapshot" :: waited 0.024s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:45:17 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-8123db30-48cd-4f00-b617-68601c4474c2 tempest-VolumeDependencyTests-1073688899 None] snapshot: 6798eb38-d3dc-4f82-a260-cb1f3fcff136, volume: 3d835afb-99cc-442b-ab26-0d36c54fdbe2, {{(pid=88899) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Aug 03 08:45:17 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-8123db30-48cd-4f00-b617-68601c4474c2 tempest-VolumeDependencyTests-1073688899 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:45:17 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-8123db30-48cd-4f00-b617-68601c4474c2 tempest-VolumeDependencyTests-1073688899 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:45:17 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-8123db30-48cd-4f00-b617-68601c4474c2 tempest-VolumeDependencyTests-1073688899 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:45:17 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-8123db30-48cd-4f00-b617-68601c4474c2 tempest-VolumeDependencyTests-1073688899 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:45:17 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-8123db30-48cd-4f00-b617-68601c4474c2 tempest-VolumeDependencyTests-1073688899 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:45:17 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[54012e30-0b84-4ff8-90c7-fc5eaabd9fc1]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:45:17 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-8123db30-48cd-4f00-b617-68601c4474c2 tempest-VolumeDependencyTests-1073688899 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-527e2540-732a-4b7c-afbc-ae2ccda5d24b.6798eb38-d3dc-4f82-a260-cb1f3fcff136 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:45:17 devstack sudo[106364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-527e2540-732a-4b7c-afbc-ae2ccda5d24b.6798eb38-d3dc-4f82-a260-cb1f3fcff136 Aug 03 08:45:17 devstack sudo[106364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:45:17 devstack sudo[106364]: pam_unix(sudo:session): session closed for user root Aug 03 08:45:17 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-8123db30-48cd-4f00-b617-68601c4474c2 tempest-VolumeDependencyTests-1073688899 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-527e2540-732a-4b7c-afbc-ae2ccda5d24b.6798eb38-d3dc-4f82-a260-cb1f3fcff136" returned: 0 in 0.413s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:45:17 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-8123db30-48cd-4f00-b617-68601c4474c2 tempest-VolumeDependencyTests-1073688899 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-527e2540-732a-4b7c-afbc-ae2ccda5d24b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88899) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 03 08:45:17 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7faadbb-3a62-4061-9b3d-448dc488f146]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:45:17 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-8123db30-48cd-4f00-b617-68601c4474c2 tempest-VolumeDependencyTests-1073688899 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-527e2540-732a-4b7c-afbc-ae2ccda5d24b {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:45:17 devstack sudo[106369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-527e2540-732a-4b7c-afbc-ae2ccda5d24b Aug 03 08:45:17 devstack sudo[106369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:45:18 devstack sudo[106369]: pam_unix(sudo:session): session closed for user root Aug 03 08:45:18 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-8123db30-48cd-4f00-b617-68601c4474c2 tempest-VolumeDependencyTests-1073688899 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-527e2540-732a-4b7c-afbc-ae2ccda5d24b" returned: 0 in 0.427s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:45:18 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-8123db30-48cd-4f00-b617-68601c4474c2 tempest-VolumeDependencyTests-1073688899 None] will copy from snapshot at /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-527e2540-732a-4b7c-afbc-ae2ccda5d24b {{(pid=88899) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Aug 03 08:45:18 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-8123db30-48cd-4f00-b617-68601c4474c2 tempest-VolumeDependencyTests-1073688899 None] Creating direct copy from snapshot {{(pid=88899) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Aug 03 08:45:18 devstack cinder-volume[88899]: DEBUG cinder.utils [None req-8123db30-48cd-4f00-b617-68601c4474c2 tempest-VolumeDependencyTests-1073688899 None] Path /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-3d835afb-99cc-442b-ab26-0d36c54fdbe2 not found in is_blk_device check {{(pid=88899) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Aug 03 08:45:18 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-8123db30-48cd-4f00-b617-68601c4474c2 tempest-VolumeDependencyTests-1073688899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-527e2540-732a-4b7c-afbc-ae2ccda5d24b /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-3d835afb-99cc-442b-ab26-0d36c54fdbe2 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:45:18 devstack sudo[106374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-527e2540-732a-4b7c-afbc-ae2ccda5d24b /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-3d835afb-99cc-442b-ab26-0d36c54fdbe2 Aug 03 08:45:18 devstack sudo[106374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:45:18 devstack cinder-volume[88899]: DEBUG cinder.volume.flows.manager.create_volume [None req-e2d09697-b3c8-4ca1-9646-5feb23bda6f5 tempest-CinderUnicodeTest-1013959674 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88899) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 08:45:18 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-e2d09697-b3c8-4ca1-9646-5feb23bda6f5 tempest-CinderUnicodeTest-1013959674 None] Flow 'volume_create_manager' (4e8ee16f-43c5-4cf5-abae-9f35e4c0a0af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:45:18 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-e2d09697-b3c8-4ca1-9646-5feb23bda6f5 tempest-CinderUnicodeTest-1013959674 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8c732b2-ffc2-43b4-b24d-77ce67aa3f99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:45:18 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-e2d09697-b3c8-4ca1-9646-5feb23bda6f5 tempest-CinderUnicodeTest-1013959674 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8c732b2-ffc2-43b4-b24d-77ce67aa3f99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:45:18Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e509c020-ad02-4ecb-a716-d238cef89493,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='944cf6466cfa45be80e25a9c2113f163',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:45:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:45:19Z,use_quota=True,user_id='a0d1a048bf264748a78b3012d835984e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8bde7129-1dc4-42ab-b852-ab32c61b4921),volume_type_id=8bde7129-1dc4-42ab-b852-ab32c61b4921)' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:45:18 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-e2d09697-b3c8-4ca1-9646-5feb23bda6f5 tempest-CinderUnicodeTest-1013959674 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2e2d469-e9aa-4473-a349-c5940d815224) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:45:18 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-e2d09697-b3c8-4ca1-9646-5feb23bda6f5 tempest-CinderUnicodeTest-1013959674 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2e2d469-e9aa-4473-a349-c5940d815224) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:45:18 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-e2d09697-b3c8-4ca1-9646-5feb23bda6f5 tempest-CinderUnicodeTest-1013959674 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e82ce22-ed45-467f-9284-deb2529d7b0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:45:18 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-e2d09697-b3c8-4ca1-9646-5feb23bda6f5 tempest-CinderUnicodeTest-1013959674 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e82ce22-ed45-467f-9284-deb2529d7b0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e509c020-ad02-4ecb-a716-d238cef89493', 'volume_name': 'volume-e509c020-ad02-4ecb-a716-d238cef89493', 'volume_size': 1}' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:45:18 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-e2d09697-b3c8-4ca1-9646-5feb23bda6f5 tempest-CinderUnicodeTest-1013959674 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (65b89ee1-775b-43e8-9490-c5bd2f53385e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:45:18 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-e2d09697-b3c8-4ca1-9646-5feb23bda6f5 tempest-CinderUnicodeTest-1013959674 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (65b89ee1-775b-43e8-9490-c5bd2f53385e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:45:18 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-e2d09697-b3c8-4ca1-9646-5feb23bda6f5 tempest-CinderUnicodeTest-1013959674 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d6d2cc9-96bc-48c9-9aa7-0ddd42dda9c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:45:18 devstack cinder-volume[88899]: INFO cinder.volume.flows.manager.create_volume [None req-e2d09697-b3c8-4ca1-9646-5feb23bda6f5 tempest-CinderUnicodeTest-1013959674 None] Volume e509c020-ad02-4ecb-a716-d238cef89493: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e509c020-ad02-4ecb-a716-d238cef89493', 'volume_size': 1} Aug 03 08:45:18 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-e2d09697-b3c8-4ca1-9646-5feb23bda6f5 tempest-CinderUnicodeTest-1013959674 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:45:22 devstack sudo[106374]: pam_unix(sudo:session): session closed for user root Aug 03 08:45:22 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-8123db30-48cd-4f00-b617-68601c4474c2 tempest-VolumeDependencyTests-1073688899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-527e2540-732a-4b7c-afbc-ae2ccda5d24b /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-3d835afb-99cc-442b-ab26-0d36c54fdbe2" returned: 0 in 4.565s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:45:22 devstack cinder-volume[88899]: DEBUG cinder.image.image_utils [None req-8123db30-48cd-4f00-b617-68601c4474c2 tempest-VolumeDependencyTests-1073688899 None] Image conversion details: src /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-527e2540-732a-4b7c-afbc-ae2ccda5d24b, size 1024.00 MB, duration 4.57 sec, destination /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-3d835afb-99cc-442b-ab26-0d36c54fdbe2 {{(pid=88899) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 03 08:45:22 devstack cinder-volume[88899]: INFO cinder.image.image_utils [None req-8123db30-48cd-4f00-b617-68601c4474c2 tempest-VolumeDependencyTests-1073688899 None] Converted 1024.00 MB image at 224.26 MB/s Aug 03 08:45:22 devstack cinder-volume[88899]: WARNING cinder.volume.drivers.remotefs [None req-8123db30-48cd-4f00-b617-68601c4474c2 tempest-VolumeDependencyTests-1073688899 None] /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-3d835afb-99cc-442b-ab26-0d36c54fdbe2 is being set with open permissions: ugo+rw Aug 03 08:45:22 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-8123db30-48cd-4f00-b617-68601c4474c2 tempest-VolumeDependencyTests-1073688899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-3d835afb-99cc-442b-ab26-0d36c54fdbe2 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:45:22 devstack sudo[106388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-3d835afb-99cc-442b-ab26-0d36c54fdbe2 Aug 03 08:45:22 devstack sudo[106388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:45:23 devstack sudo[106388]: pam_unix(sudo:session): session closed for user root Aug 03 08:45:23 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-8123db30-48cd-4f00-b617-68601c4474c2 tempest-VolumeDependencyTests-1073688899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-3d835afb-99cc-442b-ab26-0d36c54fdbe2" returned: 0 in 0.271s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:45:23 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-8123db30-48cd-4f00-b617-68601c4474c2 tempest-VolumeDependencyTests-1073688899 None] Lock "cinder-quobyte-3d835afb-99cc-442b-ab26-0d36c54fdbe2" released by "_copy_volume_from_snapshot" :: held 5.801s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:45:23 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-8123db30-48cd-4f00-b617-68601c4474c2 tempest-VolumeDependencyTests-1073688899 None] Lock "cinder-quobyte-6798eb38-d3dc-4f82-a260-cb1f3fcff136-3d835afb-99cc-442b-ab26-0d36c54fdbe2" released by "_create_volume_from_snapshot" :: held 5.877s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:45:23 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-8123db30-48cd-4f00-b617-68601c4474c2 tempest-VolumeDependencyTests-1073688899 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.902s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:45:23 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-e2d09697-b3c8-4ca1-9646-5feb23bda6f5 tempest-CinderUnicodeTest-1013959674 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.469s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:45:23 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-e2d09697-b3c8-4ca1-9646-5feb23bda6f5 tempest-CinderUnicodeTest-1013959674 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:45:18Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e509c020-ad02-4ecb-a716-d238cef89493,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='944cf6466cfa45be80e25a9c2113f163',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:45:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:45:19Z,use_quota=True,user_id='a0d1a048bf264748a78b3012d835984e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8bde7129-1dc4-42ab-b852-ab32c61b4921),volume_type_id=8bde7129-1dc4-42ab-b852-ab32c61b4921)}" {{(pid=88899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 08:45:23 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-e2d09697-b3c8-4ca1-9646-5feb23bda6f5 tempest-CinderUnicodeTest-1013959674 None] Creating volume e509c020-ad02-4ecb-a716-d238cef89493 {{(pid=88899) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 08:45:23 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-e2d09697-b3c8-4ca1-9646-5feb23bda6f5 tempest-CinderUnicodeTest-1013959674 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:45:23 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-e2d09697-b3c8-4ca1-9646-5feb23bda6f5 tempest-CinderUnicodeTest-1013959674 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:45:23 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-e2d09697-b3c8-4ca1-9646-5feb23bda6f5 tempest-CinderUnicodeTest-1013959674 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:45:23 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-e2d09697-b3c8-4ca1-9646-5feb23bda6f5 tempest-CinderUnicodeTest-1013959674 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:45:23 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-e2d09697-b3c8-4ca1-9646-5feb23bda6f5 tempest-CinderUnicodeTest-1013959674 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:45:23 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-e2d09697-b3c8-4ca1-9646-5feb23bda6f5 tempest-CinderUnicodeTest-1013959674 None] Selected osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385 as target Quobyte volume. {{(pid=88899) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 08:45:23 devstack cinder-volume[88899]: INFO cinder.volume.drivers.remotefs [None req-e2d09697-b3c8-4ca1-9646-5feb23bda6f5 tempest-CinderUnicodeTest-1013959674 None] casted to osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385 Aug 03 08:45:23 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-e2d09697-b3c8-4ca1-9646-5feb23bda6f5 tempest-CinderUnicodeTest-1013959674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-e509c020-ad02-4ecb-a716-d238cef89493 1073741824 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:45:23 devstack sudo[106391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-e509c020-ad02-4ecb-a716-d238cef89493 1073741824 Aug 03 08:45:23 devstack sudo[106391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:45:23 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-8123db30-48cd-4f00-b617-68601c4474c2 tempest-VolumeDependencyTests-1073688899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (426f112b-b40b-4c56-bb4d-c2db68461984) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3d835afb-99cc-442b-ab26-0d36c54fdbe2', 'volume_size': 1, 'snapshot_id': '6798eb38-d3dc-4f82-a260-cb1f3fcff136'}' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:45:23 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-8123db30-48cd-4f00-b617-68601c4474c2 tempest-VolumeDependencyTests-1073688899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (875424c2-e319-4be0-96c2-472602ffccb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:45:23 devstack cinder-volume[88899]: INFO cinder.volume.flows.manager.create_volume [None req-8123db30-48cd-4f00-b617-68601c4474c2 tempest-VolumeDependencyTests-1073688899 None] Volume volume-3d835afb-99cc-442b-ab26-0d36c54fdbe2 (3d835afb-99cc-442b-ab26-0d36c54fdbe2): created successfully Aug 03 08:45:23 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-8123db30-48cd-4f00-b617-68601c4474c2 tempest-VolumeDependencyTests-1073688899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (875424c2-e319-4be0-96c2-472602ffccb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:45:23 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-8123db30-48cd-4f00-b617-68601c4474c2 tempest-VolumeDependencyTests-1073688899 None] Flow 'volume_create_manager' (6fd283a5-d6f6-4faa-a068-fb2b276c5ee9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:45:23 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-8123db30-48cd-4f00-b617-68601c4474c2 tempest-VolumeDependencyTests-1073688899 None] Created volume successfully. Aug 03 08:45:23 devstack sudo[106391]: pam_unix(sudo:session): session closed for user root Aug 03 08:45:23 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-e2d09697-b3c8-4ca1-9646-5feb23bda6f5 tempest-CinderUnicodeTest-1013959674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-e509c020-ad02-4ecb-a716-d238cef89493 1073741824" returned: 0 in 0.444s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:45:23 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-e2d09697-b3c8-4ca1-9646-5feb23bda6f5 tempest-CinderUnicodeTest-1013959674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-e509c020-ad02-4ecb-a716-d238cef89493 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:45:23 devstack sudo[106397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-e509c020-ad02-4ecb-a716-d238cef89493 Aug 03 08:45:23 devstack sudo[106397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:45:23 devstack sudo[106397]: pam_unix(sudo:session): session closed for user root Aug 03 08:45:23 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-e2d09697-b3c8-4ca1-9646-5feb23bda6f5 tempest-CinderUnicodeTest-1013959674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-e509c020-ad02-4ecb-a716-d238cef89493" returned: 0 in 0.281s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:45:23 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-e2d09697-b3c8-4ca1-9646-5feb23bda6f5 tempest-CinderUnicodeTest-1013959674 None] <== create_volume: return (765ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'} {{(pid=88899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 08:45:23 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-e2d09697-b3c8-4ca1-9646-5feb23bda6f5 tempest-CinderUnicodeTest-1013959674 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.769s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:45:23 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-e2d09697-b3c8-4ca1-9646-5feb23bda6f5 tempest-CinderUnicodeTest-1013959674 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d6d2cc9-96bc-48c9-9aa7-0ddd42dda9c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e509c020-ad02-4ecb-a716-d238cef89493', 'volume_size': 1}' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:45:23 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-e2d09697-b3c8-4ca1-9646-5feb23bda6f5 tempest-CinderUnicodeTest-1013959674 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd293707-0830-476b-ba8e-9e6caf7b4c44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:45:23 devstack cinder-volume[88899]: INFO cinder.volume.flows.manager.create_volume [None req-e2d09697-b3c8-4ca1-9646-5feb23bda6f5 tempest-CinderUnicodeTest-1013959674 None] Volume volume-e509c020-ad02-4ecb-a716-d238cef89493 (e509c020-ad02-4ecb-a716-d238cef89493): created successfully Aug 03 08:45:23 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-e2d09697-b3c8-4ca1-9646-5feb23bda6f5 tempest-CinderUnicodeTest-1013959674 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd293707-0830-476b-ba8e-9e6caf7b4c44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:45:23 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-e2d09697-b3c8-4ca1-9646-5feb23bda6f5 tempest-CinderUnicodeTest-1013959674 None] Flow 'volume_create_manager' (4e8ee16f-43c5-4cf5-abae-9f35e4c0a0af) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:45:24 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-e2d09697-b3c8-4ca1-9646-5feb23bda6f5 tempest-CinderUnicodeTest-1013959674 None] Created volume successfully. Aug 03 08:45:24 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-284a9e25-bf9b-43da-9da0-8a485fc1e42f tempest-VolumeDependencyTests-1073688899 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:45:24 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-284a9e25-bf9b-43da-9da0-8a485fc1e42f tempest-VolumeDependencyTests-1073688899 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:45:24 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-284a9e25-bf9b-43da-9da0-8a485fc1e42f tempest-VolumeDependencyTests-1073688899 None] Creating offline snapshot ee471be0-d742-4eb6-9255-ebab73e67b67 of volume 3d835afb-99cc-442b-ab26-0d36c54fdbe2 {{(pid=88899) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 03 08:45:24 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee86a0fe-d242-46d3-8ae6-d89641cec04d]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:45:24 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-284a9e25-bf9b-43da-9da0-8a485fc1e42f tempest-VolumeDependencyTests-1073688899 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-3d835afb-99cc-442b-ab26-0d36c54fdbe2 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:45:24 devstack sudo[106400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-3d835afb-99cc-442b-ab26-0d36c54fdbe2 Aug 03 08:45:24 devstack sudo[106400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:45:24 devstack sudo[106400]: pam_unix(sudo:session): session closed for user root Aug 03 08:45:24 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-284a9e25-bf9b-43da-9da0-8a485fc1e42f tempest-VolumeDependencyTests-1073688899 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-3d835afb-99cc-442b-ab26-0d36c54fdbe2" returned: 0 in 0.383s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:45:24 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-284a9e25-bf9b-43da-9da0-8a485fc1e42f tempest-VolumeDependencyTests-1073688899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-3d835afb-99cc-442b-ab26-0d36c54fdbe2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-3d835afb-99cc-442b-ab26-0d36c54fdbe2.ee471be0-d742-4eb6-9255-ebab73e67b67 1G {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:45:24 devstack sudo[106405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-3d835afb-99cc-442b-ab26-0d36c54fdbe2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-3d835afb-99cc-442b-ab26-0d36c54fdbe2.ee471be0-d742-4eb6-9255-ebab73e67b67 1G Aug 03 08:45:24 devstack sudo[106405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:45:25 devstack sudo[106405]: pam_unix(sudo:session): session closed for user root Aug 03 08:45:25 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-284a9e25-bf9b-43da-9da0-8a485fc1e42f tempest-VolumeDependencyTests-1073688899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-3d835afb-99cc-442b-ab26-0d36c54fdbe2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-3d835afb-99cc-442b-ab26-0d36c54fdbe2.ee471be0-d742-4eb6-9255-ebab73e67b67 1G" returned: 0 in 0.437s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:45:25 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-284a9e25-bf9b-43da-9da0-8a485fc1e42f tempest-VolumeDependencyTests-1073688899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3d835afb-99cc-442b-ab26-0d36c54fdbe2 -F qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-3d835afb-99cc-442b-ab26-0d36c54fdbe2.ee471be0-d742-4eb6-9255-ebab73e67b67 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:45:25 devstack sudo[106410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3d835afb-99cc-442b-ab26-0d36c54fdbe2 -F qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-3d835afb-99cc-442b-ab26-0d36c54fdbe2.ee471be0-d742-4eb6-9255-ebab73e67b67 Aug 03 08:45:25 devstack sudo[106410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:45:25 devstack sudo[106410]: pam_unix(sudo:session): session closed for user root Aug 03 08:45:25 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-284a9e25-bf9b-43da-9da0-8a485fc1e42f tempest-VolumeDependencyTests-1073688899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3d835afb-99cc-442b-ab26-0d36c54fdbe2 -F qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-3d835afb-99cc-442b-ab26-0d36c54fdbe2.ee471be0-d742-4eb6-9255-ebab73e67b67" returned: 0 in 0.394s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:45:25 devstack cinder-volume[88899]: WARNING cinder.volume.drivers.remotefs [None req-284a9e25-bf9b-43da-9da0-8a485fc1e42f tempest-VolumeDependencyTests-1073688899 None] /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-3d835afb-99cc-442b-ab26-0d36c54fdbe2.ee471be0-d742-4eb6-9255-ebab73e67b67 is being set with open permissions: ugo+rw Aug 03 08:45:25 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-284a9e25-bf9b-43da-9da0-8a485fc1e42f tempest-VolumeDependencyTests-1073688899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-3d835afb-99cc-442b-ab26-0d36c54fdbe2.ee471be0-d742-4eb6-9255-ebab73e67b67 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:45:25 devstack sudo[106416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-3d835afb-99cc-442b-ab26-0d36c54fdbe2.ee471be0-d742-4eb6-9255-ebab73e67b67 Aug 03 08:45:25 devstack sudo[106416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:45:25 devstack sudo[106416]: pam_unix(sudo:session): session closed for user root Aug 03 08:45:25 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-284a9e25-bf9b-43da-9da0-8a485fc1e42f tempest-VolumeDependencyTests-1073688899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-3d835afb-99cc-442b-ab26-0d36c54fdbe2.ee471be0-d742-4eb6-9255-ebab73e67b67" returned: 0 in 0.271s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:45:25 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-284a9e25-bf9b-43da-9da0-8a485fc1e42f tempest-VolumeDependencyTests-1073688899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-3d835afb-99cc-442b-ab26-0d36c54fdbe2.info {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:45:25 devstack sudo[106419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-3d835afb-99cc-442b-ab26-0d36c54fdbe2.info Aug 03 08:45:25 devstack sudo[106419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:45:25 devstack cinder-volume[88899]: DEBUG cinder.volume.flows.manager.create_volume [None req-4a144979-e67d-473d-846b-39070ffb52f4 tempest-CinderUnicodeTest-1013959674 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88899) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 08:45:25 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-4a144979-e67d-473d-846b-39070ffb52f4 tempest-CinderUnicodeTest-1013959674 None] Flow 'volume_create_manager' (47ca2a4e-140a-4a13-a072-526fdbb2c608) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:45:25 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-4a144979-e67d-473d-846b-39070ffb52f4 tempest-CinderUnicodeTest-1013959674 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc6b55b1-4b9a-429c-9316-e66297ce4857) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:45:25 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-4a144979-e67d-473d-846b-39070ffb52f4 tempest-CinderUnicodeTest-1013959674 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc6b55b1-4b9a-429c-9316-e66297ce4857) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:45:25Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1919757080',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6a2bee57-d313-4e44-b49f-815797780efc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='944cf6466cfa45be80e25a9c2113f163',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:45:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:45:26Z,use_quota=True,user_id='a0d1a048bf264748a78b3012d835984e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8bde7129-1dc4-42ab-b852-ab32c61b4921),volume_type_id=8bde7129-1dc4-42ab-b852-ab32c61b4921)' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:45:25 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-4a144979-e67d-473d-846b-39070ffb52f4 tempest-CinderUnicodeTest-1013959674 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (734a4944-52b3-4030-b02e-47fe2d4f15fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:45:25 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-4a144979-e67d-473d-846b-39070ffb52f4 tempest-CinderUnicodeTest-1013959674 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (734a4944-52b3-4030-b02e-47fe2d4f15fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:45:25 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-4a144979-e67d-473d-846b-39070ffb52f4 tempest-CinderUnicodeTest-1013959674 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb80309b-72cb-4b32-80a1-a7b4f42ca021) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:45:25 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-4a144979-e67d-473d-846b-39070ffb52f4 tempest-CinderUnicodeTest-1013959674 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb80309b-72cb-4b32-80a1-a7b4f42ca021) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6a2bee57-d313-4e44-b49f-815797780efc', 'volume_name': 'volume-6a2bee57-d313-4e44-b49f-815797780efc', 'volume_size': 1}' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:45:25 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-4a144979-e67d-473d-846b-39070ffb52f4 tempest-CinderUnicodeTest-1013959674 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f70e7374-980d-4fa6-b9c0-9fb1b988b7a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:45:25 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-4a144979-e67d-473d-846b-39070ffb52f4 tempest-CinderUnicodeTest-1013959674 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f70e7374-980d-4fa6-b9c0-9fb1b988b7a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:45:25 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-4a144979-e67d-473d-846b-39070ffb52f4 tempest-CinderUnicodeTest-1013959674 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (563b13f1-a42e-495c-8389-5d227c640bce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:45:25 devstack cinder-volume[88899]: INFO cinder.volume.flows.manager.create_volume [None req-4a144979-e67d-473d-846b-39070ffb52f4 tempest-CinderUnicodeTest-1013959674 None] Volume 6a2bee57-d313-4e44-b49f-815797780efc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6a2bee57-d313-4e44-b49f-815797780efc', 'volume_size': 1} Aug 03 08:45:25 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-4a144979-e67d-473d-846b-39070ffb52f4 tempest-CinderUnicodeTest-1013959674 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:45:26 devstack sudo[106419]: pam_unix(sudo:session): session closed for user root Aug 03 08:45:26 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-284a9e25-bf9b-43da-9da0-8a485fc1e42f tempest-VolumeDependencyTests-1073688899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-3d835afb-99cc-442b-ab26-0d36c54fdbe2.info" returned: 0 in 0.277s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:45:26 devstack cinder-volume[88899]: WARNING cinder.volume.drivers.remotefs [None req-284a9e25-bf9b-43da-9da0-8a485fc1e42f tempest-VolumeDependencyTests-1073688899 None] /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-3d835afb-99cc-442b-ab26-0d36c54fdbe2.info is being set with open permissions: ugo+rw Aug 03 08:45:26 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-284a9e25-bf9b-43da-9da0-8a485fc1e42f tempest-VolumeDependencyTests-1073688899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-3d835afb-99cc-442b-ab26-0d36c54fdbe2.info {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:45:26 devstack sudo[106422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-3d835afb-99cc-442b-ab26-0d36c54fdbe2.info Aug 03 08:45:26 devstack sudo[106422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:45:26 devstack sudo[106422]: pam_unix(sudo:session): session closed for user root Aug 03 08:45:26 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-284a9e25-bf9b-43da-9da0-8a485fc1e42f tempest-VolumeDependencyTests-1073688899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-3d835afb-99cc-442b-ab26-0d36c54fdbe2.info" returned: 0 in 0.292s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:45:26 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-284a9e25-bf9b-43da-9da0-8a485fc1e42f tempest-VolumeDependencyTests-1073688899 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.149s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:45:26 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-4a144979-e67d-473d-846b-39070ffb52f4 tempest-CinderUnicodeTest-1013959674 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.448s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:45:26 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-4a144979-e67d-473d-846b-39070ffb52f4 tempest-CinderUnicodeTest-1013959674 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:45:25Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1919757080',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6a2bee57-d313-4e44-b49f-815797780efc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='944cf6466cfa45be80e25a9c2113f163',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:45:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:45:26Z,use_quota=True,user_id='a0d1a048bf264748a78b3012d835984e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8bde7129-1dc4-42ab-b852-ab32c61b4921),volume_type_id=8bde7129-1dc4-42ab-b852-ab32c61b4921)}" {{(pid=88899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 08:45:26 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-4a144979-e67d-473d-846b-39070ffb52f4 tempest-CinderUnicodeTest-1013959674 None] Creating volume 6a2bee57-d313-4e44-b49f-815797780efc {{(pid=88899) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 08:45:26 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-4a144979-e67d-473d-846b-39070ffb52f4 tempest-CinderUnicodeTest-1013959674 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:45:26 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-4a144979-e67d-473d-846b-39070ffb52f4 tempest-CinderUnicodeTest-1013959674 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:45:26 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-4a144979-e67d-473d-846b-39070ffb52f4 tempest-CinderUnicodeTest-1013959674 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:45:26 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-4a144979-e67d-473d-846b-39070ffb52f4 tempest-CinderUnicodeTest-1013959674 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:45:26 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-4a144979-e67d-473d-846b-39070ffb52f4 tempest-CinderUnicodeTest-1013959674 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:45:26 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-4a144979-e67d-473d-846b-39070ffb52f4 tempest-CinderUnicodeTest-1013959674 None] Selected osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385 as target Quobyte volume. {{(pid=88899) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 08:45:26 devstack cinder-volume[88899]: INFO cinder.volume.drivers.remotefs [None req-4a144979-e67d-473d-846b-39070ffb52f4 tempest-CinderUnicodeTest-1013959674 None] casted to osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385 Aug 03 08:45:26 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-4a144979-e67d-473d-846b-39070ffb52f4 tempest-CinderUnicodeTest-1013959674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-6a2bee57-d313-4e44-b49f-815797780efc 1073741824 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:45:26 devstack sudo[106425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-6a2bee57-d313-4e44-b49f-815797780efc 1073741824 Aug 03 08:45:26 devstack sudo[106425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:45:26 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-284a9e25-bf9b-43da-9da0-8a485fc1e42f tempest-VolumeDependencyTests-1073688899 None] Create snapshot completed successfully Aug 03 08:45:26 devstack sudo[106425]: pam_unix(sudo:session): session closed for user root Aug 03 08:45:26 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-4a144979-e67d-473d-846b-39070ffb52f4 tempest-CinderUnicodeTest-1013959674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-6a2bee57-d313-4e44-b49f-815797780efc 1073741824" returned: 0 in 0.572s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:45:26 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-4a144979-e67d-473d-846b-39070ffb52f4 tempest-CinderUnicodeTest-1013959674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-6a2bee57-d313-4e44-b49f-815797780efc {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:45:26 devstack sudo[106431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-6a2bee57-d313-4e44-b49f-815797780efc Aug 03 08:45:26 devstack sudo[106431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:45:27 devstack sudo[106431]: pam_unix(sudo:session): session closed for user root Aug 03 08:45:27 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-4a144979-e67d-473d-846b-39070ffb52f4 tempest-CinderUnicodeTest-1013959674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-6a2bee57-d313-4e44-b49f-815797780efc" returned: 0 in 0.271s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:45:27 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-4a144979-e67d-473d-846b-39070ffb52f4 tempest-CinderUnicodeTest-1013959674 None] <== create_volume: return (888ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'} {{(pid=88899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 08:45:27 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-4a144979-e67d-473d-846b-39070ffb52f4 tempest-CinderUnicodeTest-1013959674 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.892s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:45:27 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-4a144979-e67d-473d-846b-39070ffb52f4 tempest-CinderUnicodeTest-1013959674 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (563b13f1-a42e-495c-8389-5d227c640bce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6a2bee57-d313-4e44-b49f-815797780efc', 'volume_size': 1}' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:45:27 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-4a144979-e67d-473d-846b-39070ffb52f4 tempest-CinderUnicodeTest-1013959674 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c797b5eb-1778-4968-b46f-369e9143d458) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:45:27 devstack cinder-volume[88899]: INFO cinder.volume.flows.manager.create_volume [None req-4a144979-e67d-473d-846b-39070ffb52f4 tempest-CinderUnicodeTest-1013959674 None] Volume volume-6a2bee57-d313-4e44-b49f-815797780efc (6a2bee57-d313-4e44-b49f-815797780efc): created successfully Aug 03 08:45:27 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-4a144979-e67d-473d-846b-39070ffb52f4 tempest-CinderUnicodeTest-1013959674 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c797b5eb-1778-4968-b46f-369e9143d458) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:45:27 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-4a144979-e67d-473d-846b-39070ffb52f4 tempest-CinderUnicodeTest-1013959674 None] Flow 'volume_create_manager' (47ca2a4e-140a-4a13-a072-526fdbb2c608) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:45:27 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-4a144979-e67d-473d-846b-39070ffb52f4 tempest-CinderUnicodeTest-1013959674 None] Created volume successfully. Aug 03 08:45:28 devstack cinder-volume[88899]: DEBUG cinder.volume.flows.manager.create_volume [None req-6960a25a-6597-4e79-9d84-35df683ea079 tempest-VolumeDependencyTests-1073688899 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88899) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 08:45:28 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-6960a25a-6597-4e79-9d84-35df683ea079 tempest-VolumeDependencyTests-1073688899 None] Flow 'volume_create_manager' (5ffcbc48-a157-4174-94b3-e7fc6010a778) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:45:28 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-6960a25a-6597-4e79-9d84-35df683ea079 tempest-VolumeDependencyTests-1073688899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (682c0679-ca55-442c-ae31-3cbe5cbba98b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:45:28 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-6960a25a-6597-4e79-9d84-35df683ea079 tempest-VolumeDependencyTests-1073688899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (682c0679-ca55-442c-ae31-3cbe5cbba98b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:45:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1346390010',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5fbff1a7-fff1-4ab5-ae3b-8a08c8645cb8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c2f62930ea114d94aae304e8ed339f9c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:45:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=ee471be0-d742-4eb6-9255-ebab73e67b67,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:45:28Z,use_quota=True,user_id='de61709cf33340bf9e956c0545be3966',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8bde7129-1dc4-42ab-b852-ab32c61b4921),volume_type_id=8bde7129-1dc4-42ab-b852-ab32c61b4921)' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:45:28 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-6960a25a-6597-4e79-9d84-35df683ea079 tempest-VolumeDependencyTests-1073688899 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e34fb44-44ec-453e-9635-8d705c91f7a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:45:28 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-6960a25a-6597-4e79-9d84-35df683ea079 tempest-VolumeDependencyTests-1073688899 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e34fb44-44ec-453e-9635-8d705c91f7a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:45:28 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-6960a25a-6597-4e79-9d84-35df683ea079 tempest-VolumeDependencyTests-1073688899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e77aa7a-afcf-4a08-bc26-0e93ae6d2ecd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:45:28 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-6960a25a-6597-4e79-9d84-35df683ea079 tempest-VolumeDependencyTests-1073688899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e77aa7a-afcf-4a08-bc26-0e93ae6d2ecd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '5fbff1a7-fff1-4ab5-ae3b-8a08c8645cb8', 'volume_name': 'volume-5fbff1a7-fff1-4ab5-ae3b-8a08c8645cb8', 'volume_size': 1, 'snapshot_id': 'ee471be0-d742-4eb6-9255-ebab73e67b67'}' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:45:28 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-6960a25a-6597-4e79-9d84-35df683ea079 tempest-VolumeDependencyTests-1073688899 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f60cd18-b1ec-4be0-91be-a8aa9ac8ce3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:45:28 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-6960a25a-6597-4e79-9d84-35df683ea079 tempest-VolumeDependencyTests-1073688899 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f60cd18-b1ec-4be0-91be-a8aa9ac8ce3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:45:28 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-6960a25a-6597-4e79-9d84-35df683ea079 tempest-VolumeDependencyTests-1073688899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (baad0bed-3ec5-402b-872e-e2d0d6d148b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:45:28 devstack cinder-volume[88899]: INFO cinder.volume.flows.manager.create_volume [None req-6960a25a-6597-4e79-9d84-35df683ea079 tempest-VolumeDependencyTests-1073688899 None] Volume 5fbff1a7-fff1-4ab5-ae3b-8a08c8645cb8: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-5fbff1a7-fff1-4ab5-ae3b-8a08c8645cb8', 'volume_size': 1, 'snapshot_id': 'ee471be0-d742-4eb6-9255-ebab73e67b67'} Aug 03 08:45:28 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-6960a25a-6597-4e79-9d84-35df683ea079 tempest-VolumeDependencyTests-1073688899 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:45:28 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-6960a25a-6597-4e79-9d84-35df683ea079 tempest-VolumeDependencyTests-1073688899 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:45:28 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-6960a25a-6597-4e79-9d84-35df683ea079 tempest-VolumeDependencyTests-1073688899 None] Acquiring lock "cinder-quobyte-ee471be0-d742-4eb6-9255-ebab73e67b67-5fbff1a7-fff1-4ab5-ae3b-8a08c8645cb8" by "_create_volume_from_snapshot" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:45:28 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-6960a25a-6597-4e79-9d84-35df683ea079 tempest-VolumeDependencyTests-1073688899 None] Lock "cinder-quobyte-ee471be0-d742-4eb6-9255-ebab73e67b67-5fbff1a7-fff1-4ab5-ae3b-8a08c8645cb8" acquired by "_create_volume_from_snapshot" :: waited 0.024s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:45:28 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-6960a25a-6597-4e79-9d84-35df683ea079 tempest-VolumeDependencyTests-1073688899 None] Creating volume 5fbff1a7-fff1-4ab5-ae3b-8a08c8645cb8 from snapshot ee471be0-d742-4eb6-9255-ebab73e67b67 {{(pid=88899) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Aug 03 08:45:28 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-6960a25a-6597-4e79-9d84-35df683ea079 tempest-VolumeDependencyTests-1073688899 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:45:28 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-6960a25a-6597-4e79-9d84-35df683ea079 tempest-VolumeDependencyTests-1073688899 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:45:28 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-6960a25a-6597-4e79-9d84-35df683ea079 tempest-VolumeDependencyTests-1073688899 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:45:28 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-6960a25a-6597-4e79-9d84-35df683ea079 tempest-VolumeDependencyTests-1073688899 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:45:28 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-6960a25a-6597-4e79-9d84-35df683ea079 tempest-VolumeDependencyTests-1073688899 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:45:28 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-6960a25a-6597-4e79-9d84-35df683ea079 tempest-VolumeDependencyTests-1073688899 None] Selected osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385 as target Quobyte volume. {{(pid=88899) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 08:45:28 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-6960a25a-6597-4e79-9d84-35df683ea079 tempest-VolumeDependencyTests-1073688899 None] Acquiring lock "cinder-quobyte-5fbff1a7-fff1-4ab5-ae3b-8a08c8645cb8" by "_copy_volume_from_snapshot" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:45:28 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-6960a25a-6597-4e79-9d84-35df683ea079 tempest-VolumeDependencyTests-1073688899 None] Lock "cinder-quobyte-5fbff1a7-fff1-4ab5-ae3b-8a08c8645cb8" acquired by "_copy_volume_from_snapshot" :: waited 0.021s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:45:28 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-6960a25a-6597-4e79-9d84-35df683ea079 tempest-VolumeDependencyTests-1073688899 None] snapshot: ee471be0-d742-4eb6-9255-ebab73e67b67, volume: 5fbff1a7-fff1-4ab5-ae3b-8a08c8645cb8, {{(pid=88899) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Aug 03 08:45:28 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-6960a25a-6597-4e79-9d84-35df683ea079 tempest-VolumeDependencyTests-1073688899 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:45:28 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-6960a25a-6597-4e79-9d84-35df683ea079 tempest-VolumeDependencyTests-1073688899 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:45:28 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-6960a25a-6597-4e79-9d84-35df683ea079 tempest-VolumeDependencyTests-1073688899 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:45:28 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-6960a25a-6597-4e79-9d84-35df683ea079 tempest-VolumeDependencyTests-1073688899 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:45:28 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-6960a25a-6597-4e79-9d84-35df683ea079 tempest-VolumeDependencyTests-1073688899 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:45:28 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[af868a2a-1c71-423f-a7e3-c9928bfd7378]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:45:28 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-6960a25a-6597-4e79-9d84-35df683ea079 tempest-VolumeDependencyTests-1073688899 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-3d835afb-99cc-442b-ab26-0d36c54fdbe2.ee471be0-d742-4eb6-9255-ebab73e67b67 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:45:28 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-e567a733-4114-4d6f-a65e-f02a4e713b94 tempest-CinderUnicodeTest-1013959674 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:45:28 devstack sudo[106435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-3d835afb-99cc-442b-ab26-0d36c54fdbe2.ee471be0-d742-4eb6-9255-ebab73e67b67 Aug 03 08:45:28 devstack sudo[106435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:45:28 devstack sudo[106435]: pam_unix(sudo:session): session closed for user root Aug 03 08:45:28 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-6960a25a-6597-4e79-9d84-35df683ea079 tempest-VolumeDependencyTests-1073688899 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-3d835afb-99cc-442b-ab26-0d36c54fdbe2.ee471be0-d742-4eb6-9255-ebab73e67b67" returned: 0 in 0.435s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:45:28 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-6960a25a-6597-4e79-9d84-35df683ea079 tempest-VolumeDependencyTests-1073688899 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3d835afb-99cc-442b-ab26-0d36c54fdbe2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88899) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 03 08:45:28 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[9282e13f-2019-4229-81ef-2b5d0e9002f5]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:45:28 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-6960a25a-6597-4e79-9d84-35df683ea079 tempest-VolumeDependencyTests-1073688899 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-3d835afb-99cc-442b-ab26-0d36c54fdbe2 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:45:28 devstack sudo[106442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-3d835afb-99cc-442b-ab26-0d36c54fdbe2 Aug 03 08:45:28 devstack sudo[106442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:45:29 devstack sudo[106442]: pam_unix(sudo:session): session closed for user root Aug 03 08:45:29 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-6960a25a-6597-4e79-9d84-35df683ea079 tempest-VolumeDependencyTests-1073688899 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-3d835afb-99cc-442b-ab26-0d36c54fdbe2" returned: 0 in 0.393s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:45:29 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-6960a25a-6597-4e79-9d84-35df683ea079 tempest-VolumeDependencyTests-1073688899 None] will copy from snapshot at /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-3d835afb-99cc-442b-ab26-0d36c54fdbe2 {{(pid=88899) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Aug 03 08:45:29 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-6960a25a-6597-4e79-9d84-35df683ea079 tempest-VolumeDependencyTests-1073688899 None] Creating direct copy from snapshot {{(pid=88899) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Aug 03 08:45:29 devstack cinder-volume[88899]: DEBUG cinder.utils [None req-6960a25a-6597-4e79-9d84-35df683ea079 tempest-VolumeDependencyTests-1073688899 None] Path /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-5fbff1a7-fff1-4ab5-ae3b-8a08c8645cb8 not found in is_blk_device check {{(pid=88899) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Aug 03 08:45:29 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-6960a25a-6597-4e79-9d84-35df683ea079 tempest-VolumeDependencyTests-1073688899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-3d835afb-99cc-442b-ab26-0d36c54fdbe2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-5fbff1a7-fff1-4ab5-ae3b-8a08c8645cb8 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:45:29 devstack sudo[106447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-3d835afb-99cc-442b-ab26-0d36c54fdbe2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-5fbff1a7-fff1-4ab5-ae3b-8a08c8645cb8 Aug 03 08:45:29 devstack sudo[106447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:45:29 devstack sudo[106447]: pam_unix(sudo:session): session closed for user root Aug 03 08:45:29 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-6960a25a-6597-4e79-9d84-35df683ea079 tempest-VolumeDependencyTests-1073688899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-3d835afb-99cc-442b-ab26-0d36c54fdbe2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-5fbff1a7-fff1-4ab5-ae3b-8a08c8645cb8" returned: 0 in 0.467s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:45:29 devstack cinder-volume[88899]: DEBUG cinder.image.image_utils [None req-6960a25a-6597-4e79-9d84-35df683ea079 tempest-VolumeDependencyTests-1073688899 None] Image conversion details: src /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-3d835afb-99cc-442b-ab26-0d36c54fdbe2, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-5fbff1a7-fff1-4ab5-ae3b-8a08c8645cb8 {{(pid=88899) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 03 08:45:29 devstack cinder-volume[88899]: INFO cinder.image.image_utils [None req-6960a25a-6597-4e79-9d84-35df683ea079 tempest-VolumeDependencyTests-1073688899 None] Converted 1024.00 MB image at 1024.00 MB/s Aug 03 08:45:29 devstack cinder-volume[88899]: WARNING cinder.volume.drivers.remotefs [None req-6960a25a-6597-4e79-9d84-35df683ea079 tempest-VolumeDependencyTests-1073688899 None] /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-5fbff1a7-fff1-4ab5-ae3b-8a08c8645cb8 is being set with open permissions: ugo+rw Aug 03 08:45:29 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-6960a25a-6597-4e79-9d84-35df683ea079 tempest-VolumeDependencyTests-1073688899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-5fbff1a7-fff1-4ab5-ae3b-8a08c8645cb8 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:45:29 devstack sudo[106453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-5fbff1a7-fff1-4ab5-ae3b-8a08c8645cb8 Aug 03 08:45:29 devstack sudo[106453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:45:29 devstack sudo[106453]: pam_unix(sudo:session): session closed for user root Aug 03 08:45:29 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-6960a25a-6597-4e79-9d84-35df683ea079 tempest-VolumeDependencyTests-1073688899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-5fbff1a7-fff1-4ab5-ae3b-8a08c8645cb8" returned: 0 in 0.284s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:45:29 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-6960a25a-6597-4e79-9d84-35df683ea079 tempest-VolumeDependencyTests-1073688899 None] Lock "cinder-quobyte-5fbff1a7-fff1-4ab5-ae3b-8a08c8645cb8" released by "_copy_volume_from_snapshot" :: held 1.712s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:45:30 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-6960a25a-6597-4e79-9d84-35df683ea079 tempest-VolumeDependencyTests-1073688899 None] Lock "cinder-quobyte-ee471be0-d742-4eb6-9255-ebab73e67b67-5fbff1a7-fff1-4ab5-ae3b-8a08c8645cb8" released by "_create_volume_from_snapshot" :: held 1.797s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:45:30 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-6960a25a-6597-4e79-9d84-35df683ea079 tempest-VolumeDependencyTests-1073688899 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 1.823s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:45:30 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-e567a733-4114-4d6f-a65e-f02a4e713b94 tempest-CinderUnicodeTest-1013959674 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.649s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:45:30 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-e567a733-4114-4d6f-a65e-f02a4e713b94 tempest-CinderUnicodeTest-1013959674 None] Creating offline snapshot 1f4f02ba-d925-421e-9159-8efdebe30b48 of volume 6a2bee57-d313-4e44-b49f-815797780efc {{(pid=88899) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 03 08:45:30 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-6960a25a-6597-4e79-9d84-35df683ea079 tempest-VolumeDependencyTests-1073688899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (baad0bed-3ec5-402b-872e-e2d0d6d148b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5fbff1a7-fff1-4ab5-ae3b-8a08c8645cb8', 'volume_size': 1, 'snapshot_id': 'ee471be0-d742-4eb6-9255-ebab73e67b67'}' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:45:30 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-6960a25a-6597-4e79-9d84-35df683ea079 tempest-VolumeDependencyTests-1073688899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a3fd9eb-8d6b-4dec-bfbf-95efef27d0b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:45:30 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[941f9f2b-03e6-4822-9e53-0bae31e61e7c]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:45:30 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-e567a733-4114-4d6f-a65e-f02a4e713b94 tempest-CinderUnicodeTest-1013959674 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-6a2bee57-d313-4e44-b49f-815797780efc {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:45:30 devstack cinder-volume[88899]: INFO cinder.volume.flows.manager.create_volume [None req-6960a25a-6597-4e79-9d84-35df683ea079 tempest-VolumeDependencyTests-1073688899 None] Volume volume-5fbff1a7-fff1-4ab5-ae3b-8a08c8645cb8 (5fbff1a7-fff1-4ab5-ae3b-8a08c8645cb8): created successfully Aug 03 08:45:30 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-6960a25a-6597-4e79-9d84-35df683ea079 tempest-VolumeDependencyTests-1073688899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a3fd9eb-8d6b-4dec-bfbf-95efef27d0b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:45:30 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-6960a25a-6597-4e79-9d84-35df683ea079 tempest-VolumeDependencyTests-1073688899 None] Flow 'volume_create_manager' (5ffcbc48-a157-4174-94b3-e7fc6010a778) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:45:30 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-6960a25a-6597-4e79-9d84-35df683ea079 tempest-VolumeDependencyTests-1073688899 None] Created volume successfully. Aug 03 08:45:30 devstack sudo[106456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-6a2bee57-d313-4e44-b49f-815797780efc Aug 03 08:45:30 devstack sudo[106456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:45:30 devstack sudo[106456]: pam_unix(sudo:session): session closed for user root Aug 03 08:45:30 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-e567a733-4114-4d6f-a65e-f02a4e713b94 tempest-CinderUnicodeTest-1013959674 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-6a2bee57-d313-4e44-b49f-815797780efc" returned: 0 in 0.383s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:45:30 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-e567a733-4114-4d6f-a65e-f02a4e713b94 tempest-CinderUnicodeTest-1013959674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-6a2bee57-d313-4e44-b49f-815797780efc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-6a2bee57-d313-4e44-b49f-815797780efc.1f4f02ba-d925-421e-9159-8efdebe30b48 1G {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:45:30 devstack sudo[106462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-6a2bee57-d313-4e44-b49f-815797780efc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-6a2bee57-d313-4e44-b49f-815797780efc.1f4f02ba-d925-421e-9159-8efdebe30b48 1G Aug 03 08:45:30 devstack sudo[106462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:45:30 devstack sudo[106462]: pam_unix(sudo:session): session closed for user root Aug 03 08:45:30 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-e567a733-4114-4d6f-a65e-f02a4e713b94 tempest-CinderUnicodeTest-1013959674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-6a2bee57-d313-4e44-b49f-815797780efc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-6a2bee57-d313-4e44-b49f-815797780efc.1f4f02ba-d925-421e-9159-8efdebe30b48 1G" returned: 0 in 0.431s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:45:30 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-e567a733-4114-4d6f-a65e-f02a4e713b94 tempest-CinderUnicodeTest-1013959674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6a2bee57-d313-4e44-b49f-815797780efc -F qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-6a2bee57-d313-4e44-b49f-815797780efc.1f4f02ba-d925-421e-9159-8efdebe30b48 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:45:30 devstack sudo[106467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6a2bee57-d313-4e44-b49f-815797780efc -F qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-6a2bee57-d313-4e44-b49f-815797780efc.1f4f02ba-d925-421e-9159-8efdebe30b48 Aug 03 08:45:30 devstack sudo[106467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:45:31 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-ed422467-9693-406e-9bb6-682b12be4607 tempest-VolumeDependencyTests-1073688899 None] Acquiring lock "cinder-6798eb38-d3dc-4f82-a260-cb1f3fcff136-delete_snapshot" by "delete_snapshot" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:45:31 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-ed422467-9693-406e-9bb6-682b12be4607 tempest-VolumeDependencyTests-1073688899 None] Lock "cinder-6798eb38-d3dc-4f82-a260-cb1f3fcff136-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:45:31 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-ed422467-9693-406e-9bb6-682b12be4607 tempest-VolumeDependencyTests-1073688899 None] Acquiring lock "cinder-quobyte-527e2540-732a-4b7c-afbc-ae2ccda5d24b" by "delete_snapshot" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:45:31 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-ed422467-9693-406e-9bb6-682b12be4607 tempest-VolumeDependencyTests-1073688899 None] Lock "cinder-quobyte-527e2540-732a-4b7c-afbc-ae2ccda5d24b" acquired by "delete_snapshot" :: waited 0.028s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:45:31 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-ed422467-9693-406e-9bb6-682b12be4607 tempest-VolumeDependencyTests-1073688899 None] Acquiring lock "cinder-quobyte-6798eb38-d3dc-4f82-a260-cb1f3fcff136" by "_delete_snapshot" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:45:31 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-ed422467-9693-406e-9bb6-682b12be4607 tempest-VolumeDependencyTests-1073688899 None] Lock "cinder-quobyte-6798eb38-d3dc-4f82-a260-cb1f3fcff136" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:45:31 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-ed422467-9693-406e-9bb6-682b12be4607 tempest-VolumeDependencyTests-1073688899 None] Deleting offline snapshot 6798eb38-d3dc-4f82-a260-cb1f3fcff136 of volume 527e2540-732a-4b7c-afbc-ae2ccda5d24b {{(pid=88899) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 03 08:45:31 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-ed422467-9693-406e-9bb6-682b12be4607 tempest-VolumeDependencyTests-1073688899 None] snapshot_file for this snap is: volume-527e2540-732a-4b7c-afbc-ae2ccda5d24b.6798eb38-d3dc-4f82-a260-cb1f3fcff136 {{(pid=88899) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 03 08:45:31 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4ee54b6-81a0-417f-b619-9482d97fd80e]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:45:31 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-ed422467-9693-406e-9bb6-682b12be4607 tempest-VolumeDependencyTests-1073688899 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-527e2540-732a-4b7c-afbc-ae2ccda5d24b.6798eb38-d3dc-4f82-a260-cb1f3fcff136 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:45:31 devstack sudo[106467]: pam_unix(sudo:session): session closed for user root Aug 03 08:45:31 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-e567a733-4114-4d6f-a65e-f02a4e713b94 tempest-CinderUnicodeTest-1013959674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6a2bee57-d313-4e44-b49f-815797780efc -F qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-6a2bee57-d313-4e44-b49f-815797780efc.1f4f02ba-d925-421e-9159-8efdebe30b48" returned: 0 in 0.402s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:45:31 devstack cinder-volume[88899]: WARNING cinder.volume.drivers.remotefs [None req-e567a733-4114-4d6f-a65e-f02a4e713b94 tempest-CinderUnicodeTest-1013959674 None] /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-6a2bee57-d313-4e44-b49f-815797780efc.1f4f02ba-d925-421e-9159-8efdebe30b48 is being set with open permissions: ugo+rw Aug 03 08:45:31 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-e567a733-4114-4d6f-a65e-f02a4e713b94 tempest-CinderUnicodeTest-1013959674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-6a2bee57-d313-4e44-b49f-815797780efc.1f4f02ba-d925-421e-9159-8efdebe30b48 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:45:31 devstack sudo[106473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-6a2bee57-d313-4e44-b49f-815797780efc.1f4f02ba-d925-421e-9159-8efdebe30b48 Aug 03 08:45:31 devstack sudo[106473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:45:31 devstack sudo[106472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-527e2540-732a-4b7c-afbc-ae2ccda5d24b.6798eb38-d3dc-4f82-a260-cb1f3fcff136 Aug 03 08:45:31 devstack sudo[106472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:45:31 devstack sudo[106473]: pam_unix(sudo:session): session closed for user root Aug 03 08:45:31 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-e567a733-4114-4d6f-a65e-f02a4e713b94 tempest-CinderUnicodeTest-1013959674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-6a2bee57-d313-4e44-b49f-815797780efc.1f4f02ba-d925-421e-9159-8efdebe30b48" returned: 0 in 0.285s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:45:31 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-e567a733-4114-4d6f-a65e-f02a4e713b94 tempest-CinderUnicodeTest-1013959674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-6a2bee57-d313-4e44-b49f-815797780efc.info {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:45:31 devstack sudo[106479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-6a2bee57-d313-4e44-b49f-815797780efc.info Aug 03 08:45:31 devstack sudo[106479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:45:31 devstack sudo[106472]: pam_unix(sudo:session): session closed for user root Aug 03 08:45:31 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-ed422467-9693-406e-9bb6-682b12be4607 tempest-VolumeDependencyTests-1073688899 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-527e2540-732a-4b7c-afbc-ae2ccda5d24b.6798eb38-d3dc-4f82-a260-cb1f3fcff136" returned: 0 in 0.440s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:45:31 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-ed422467-9693-406e-9bb6-682b12be4607 tempest-VolumeDependencyTests-1073688899 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-527e2540-732a-4b7c-afbc-ae2ccda5d24b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88899) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 03 08:45:31 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[d77c29f4-dd1b-4914-bd78-2bbbd8203cde]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:45:31 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-ed422467-9693-406e-9bb6-682b12be4607 tempest-VolumeDependencyTests-1073688899 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-527e2540-732a-4b7c-afbc-ae2ccda5d24b {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:45:31 devstack sudo[106482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-527e2540-732a-4b7c-afbc-ae2ccda5d24b Aug 03 08:45:31 devstack sudo[106482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:45:31 devstack sudo[106479]: pam_unix(sudo:session): session closed for user root Aug 03 08:45:31 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-e567a733-4114-4d6f-a65e-f02a4e713b94 tempest-CinderUnicodeTest-1013959674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-6a2bee57-d313-4e44-b49f-815797780efc.info" returned: 0 in 0.335s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:45:31 devstack cinder-volume[88899]: WARNING cinder.volume.drivers.remotefs [None req-e567a733-4114-4d6f-a65e-f02a4e713b94 tempest-CinderUnicodeTest-1013959674 None] /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-6a2bee57-d313-4e44-b49f-815797780efc.info is being set with open permissions: ugo+rw Aug 03 08:45:31 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-e567a733-4114-4d6f-a65e-f02a4e713b94 tempest-CinderUnicodeTest-1013959674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-6a2bee57-d313-4e44-b49f-815797780efc.info {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:45:32 devstack sudo[106485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-6a2bee57-d313-4e44-b49f-815797780efc.info Aug 03 08:45:32 devstack sudo[106485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:45:32 devstack sudo[106485]: pam_unix(sudo:session): session closed for user root Aug 03 08:45:32 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-e567a733-4114-4d6f-a65e-f02a4e713b94 tempest-CinderUnicodeTest-1013959674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-6a2bee57-d313-4e44-b49f-815797780efc.info" returned: 0 in 0.284s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:45:32 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-e567a733-4114-4d6f-a65e-f02a4e713b94 tempest-CinderUnicodeTest-1013959674 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.236s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:45:32 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-e567a733-4114-4d6f-a65e-f02a4e713b94 tempest-CinderUnicodeTest-1013959674 None] Create snapshot completed successfully Aug 03 08:45:32 devstack sudo[106482]: pam_unix(sudo:session): session closed for user root Aug 03 08:45:32 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-ed422467-9693-406e-9bb6-682b12be4607 tempest-VolumeDependencyTests-1073688899 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-527e2540-732a-4b7c-afbc-ae2ccda5d24b" returned: 0 in 0.598s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:45:32 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-ed422467-9693-406e-9bb6-682b12be4607 tempest-VolumeDependencyTests-1073688899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-527e2540-732a-4b7c-afbc-ae2ccda5d24b.6798eb38-d3dc-4f82-a260-cb1f3fcff136 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:45:32 devstack sudo[106491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-527e2540-732a-4b7c-afbc-ae2ccda5d24b.6798eb38-d3dc-4f82-a260-cb1f3fcff136 Aug 03 08:45:32 devstack sudo[106491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:45:32 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-8a76ebe6-b950-47ca-8690-4ca022340653 tempest-CinderUnicodeTest-1013959674 None] Acquiring lock "cinder-1f4f02ba-d925-421e-9159-8efdebe30b48-delete_snapshot" by "delete_snapshot" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:45:32 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-8a76ebe6-b950-47ca-8690-4ca022340653 tempest-CinderUnicodeTest-1013959674 None] Lock "cinder-1f4f02ba-d925-421e-9159-8efdebe30b48-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:45:32 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-8a76ebe6-b950-47ca-8690-4ca022340653 tempest-CinderUnicodeTest-1013959674 None] Acquiring lock "cinder-quobyte-6a2bee57-d313-4e44-b49f-815797780efc" by "delete_snapshot" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:45:32 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-8a76ebe6-b950-47ca-8690-4ca022340653 tempest-CinderUnicodeTest-1013959674 None] Lock "cinder-quobyte-6a2bee57-d313-4e44-b49f-815797780efc" acquired by "delete_snapshot" :: waited 0.019s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:45:32 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-8a76ebe6-b950-47ca-8690-4ca022340653 tempest-CinderUnicodeTest-1013959674 None] Acquiring lock "cinder-quobyte-1f4f02ba-d925-421e-9159-8efdebe30b48" by "_delete_snapshot" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:45:32 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-8a76ebe6-b950-47ca-8690-4ca022340653 tempest-CinderUnicodeTest-1013959674 None] Lock "cinder-quobyte-1f4f02ba-d925-421e-9159-8efdebe30b48" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:45:32 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-8a76ebe6-b950-47ca-8690-4ca022340653 tempest-CinderUnicodeTest-1013959674 None] Deleting offline snapshot 1f4f02ba-d925-421e-9159-8efdebe30b48 of volume 6a2bee57-d313-4e44-b49f-815797780efc {{(pid=88899) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 03 08:45:32 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-8a76ebe6-b950-47ca-8690-4ca022340653 tempest-CinderUnicodeTest-1013959674 None] snapshot_file for this snap is: volume-6a2bee57-d313-4e44-b49f-815797780efc.1f4f02ba-d925-421e-9159-8efdebe30b48 {{(pid=88899) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 03 08:45:32 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[a228a33b-9c50-46ed-a52a-0be81d3a0a8a]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:45:32 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-8a76ebe6-b950-47ca-8690-4ca022340653 tempest-CinderUnicodeTest-1013959674 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-6a2bee57-d313-4e44-b49f-815797780efc.1f4f02ba-d925-421e-9159-8efdebe30b48 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:45:32 devstack sudo[106491]: pam_unix(sudo:session): session closed for user root Aug 03 08:45:32 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-ed422467-9693-406e-9bb6-682b12be4607 tempest-VolumeDependencyTests-1073688899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-527e2540-732a-4b7c-afbc-ae2ccda5d24b.6798eb38-d3dc-4f82-a260-cb1f3fcff136" returned: 0 in 0.416s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:45:32 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-ed422467-9693-406e-9bb6-682b12be4607 tempest-VolumeDependencyTests-1073688899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-527e2540-732a-4b7c-afbc-ae2ccda5d24b.6798eb38-d3dc-4f82-a260-cb1f3fcff136 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:45:32 devstack sudo[106498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-6a2bee57-d313-4e44-b49f-815797780efc.1f4f02ba-d925-421e-9159-8efdebe30b48 Aug 03 08:45:32 devstack sudo[106498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:45:32 devstack sudo[106501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-527e2540-732a-4b7c-afbc-ae2ccda5d24b.6798eb38-d3dc-4f82-a260-cb1f3fcff136 Aug 03 08:45:32 devstack sudo[106501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:45:33 devstack sudo[106501]: pam_unix(sudo:session): session closed for user root Aug 03 08:45:33 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-ed422467-9693-406e-9bb6-682b12be4607 tempest-VolumeDependencyTests-1073688899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-527e2540-732a-4b7c-afbc-ae2ccda5d24b.6798eb38-d3dc-4f82-a260-cb1f3fcff136" returned: 0 in 0.287s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:45:33 devstack sudo[106498]: pam_unix(sudo:session): session closed for user root Aug 03 08:45:33 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-8a76ebe6-b950-47ca-8690-4ca022340653 tempest-CinderUnicodeTest-1013959674 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-6a2bee57-d313-4e44-b49f-815797780efc.1f4f02ba-d925-421e-9159-8efdebe30b48" returned: 0 in 0.437s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:45:33 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-8a76ebe6-b950-47ca-8690-4ca022340653 tempest-CinderUnicodeTest-1013959674 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6a2bee57-d313-4e44-b49f-815797780efc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88899) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 03 08:45:33 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-ed422467-9693-406e-9bb6-682b12be4607 tempest-VolumeDependencyTests-1073688899 None] Lock "cinder-quobyte-6798eb38-d3dc-4f82-a260-cb1f3fcff136" released by "_delete_snapshot" :: held 1.917s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:45:33 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-ed422467-9693-406e-9bb6-682b12be4607 tempest-VolumeDependencyTests-1073688899 None] Lock "cinder-quobyte-527e2540-732a-4b7c-afbc-ae2ccda5d24b" released by "delete_snapshot" :: held 1.949s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:45:33 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c7f3030-bdb2-4013-aa47-d360fc9b834f]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:45:33 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-8a76ebe6-b950-47ca-8690-4ca022340653 tempest-CinderUnicodeTest-1013959674 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-6a2bee57-d313-4e44-b49f-815797780efc {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:45:33 devstack cinder-volume[88899]: DEBUG cinder.quota [None req-ed422467-9693-406e-9bb6-682b12be4607 tempest-VolumeDependencyTests-1073688899 None] Created reservations ['b3761c42-fca2-4290-8bc7-d9b6753fce04', '845d979d-1bea-422e-8f1b-6daf75232210', '9dc9e5c1-94e3-4bb1-ac8a-4e9f52d0203a', '1211c44b-76c0-4da8-ae85-3f61611774d1'] {{(pid=88899) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 08:45:33 devstack sudo[106508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-6a2bee57-d313-4e44-b49f-815797780efc Aug 03 08:45:33 devstack sudo[106508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:45:33 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-ed422467-9693-406e-9bb6-682b12be4607 tempest-VolumeDependencyTests-1073688899 None] Delete snapshot completed successfully. Aug 03 08:45:33 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-ed422467-9693-406e-9bb6-682b12be4607 tempest-VolumeDependencyTests-1073688899 None] Lock "cinder-6798eb38-d3dc-4f82-a260-cb1f3fcff136-delete_snapshot" released by "delete_snapshot" :: held 2.149s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:45:33 devstack sudo[106508]: pam_unix(sudo:session): session closed for user root Aug 03 08:45:33 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-8a76ebe6-b950-47ca-8690-4ca022340653 tempest-CinderUnicodeTest-1013959674 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-6a2bee57-d313-4e44-b49f-815797780efc" returned: 0 in 0.405s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:45:33 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-8a76ebe6-b950-47ca-8690-4ca022340653 tempest-CinderUnicodeTest-1013959674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-6a2bee57-d313-4e44-b49f-815797780efc.1f4f02ba-d925-421e-9159-8efdebe30b48 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:45:33 devstack sudo[106513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-6a2bee57-d313-4e44-b49f-815797780efc.1f4f02ba-d925-421e-9159-8efdebe30b48 Aug 03 08:45:33 devstack sudo[106513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:45:33 devstack sudo[106513]: pam_unix(sudo:session): session closed for user root Aug 03 08:45:33 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-8a76ebe6-b950-47ca-8690-4ca022340653 tempest-CinderUnicodeTest-1013959674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-6a2bee57-d313-4e44-b49f-815797780efc.1f4f02ba-d925-421e-9159-8efdebe30b48" returned: 0 in 0.347s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:45:33 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-8a76ebe6-b950-47ca-8690-4ca022340653 tempest-CinderUnicodeTest-1013959674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-6a2bee57-d313-4e44-b49f-815797780efc.1f4f02ba-d925-421e-9159-8efdebe30b48 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:45:33 devstack sudo[106518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-6a2bee57-d313-4e44-b49f-815797780efc.1f4f02ba-d925-421e-9159-8efdebe30b48 Aug 03 08:45:33 devstack sudo[106518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:45:34 devstack sudo[106518]: pam_unix(sudo:session): session closed for user root Aug 03 08:45:34 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-8a76ebe6-b950-47ca-8690-4ca022340653 tempest-CinderUnicodeTest-1013959674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-6a2bee57-d313-4e44-b49f-815797780efc.1f4f02ba-d925-421e-9159-8efdebe30b48" returned: 0 in 0.242s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:45:34 devstack cinder-volume[88899]: DEBUG dbcounter [-] [88899] Writing DB stats cinder:SELECT=211,cinder:UPDATE=257,cinder:DELETE=25,cinder:INSERT=71 {{(pid=88899) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 03 08:45:34 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-8a76ebe6-b950-47ca-8690-4ca022340653 tempest-CinderUnicodeTest-1013959674 None] Lock "cinder-quobyte-1f4f02ba-d925-421e-9159-8efdebe30b48" released by "_delete_snapshot" :: held 1.543s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:45:34 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-8a76ebe6-b950-47ca-8690-4ca022340653 tempest-CinderUnicodeTest-1013959674 None] Lock "cinder-quobyte-6a2bee57-d313-4e44-b49f-815797780efc" released by "delete_snapshot" :: held 1.569s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:45:34 devstack cinder-volume[88899]: DEBUG cinder.quota [None req-8a76ebe6-b950-47ca-8690-4ca022340653 tempest-CinderUnicodeTest-1013959674 None] Created reservations ['aa480318-dd9a-44c8-bd97-0c0472101cef', 'a678f7ec-e4ea-4a70-b11d-cdf6c7f4eed0', '1f1f44f3-f7d8-48ba-ab9e-348292c27021', '65915c3d-dc31-4069-9a57-6bb6566aa3fd'] {{(pid=88899) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 08:45:34 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-8a76ebe6-b950-47ca-8690-4ca022340653 tempest-CinderUnicodeTest-1013959674 None] Delete snapshot completed successfully. Aug 03 08:45:34 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-8a76ebe6-b950-47ca-8690-4ca022340653 tempest-CinderUnicodeTest-1013959674 None] Lock "cinder-1f4f02ba-d925-421e-9159-8efdebe30b48-delete_snapshot" released by "delete_snapshot" :: held 1.721s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:45:34 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-0df3c5a5-86ed-46ec-826b-966c0fab141c tempest-VolumeDependencyTests-1073688899 None] Acquiring lock "cinder-ee471be0-d742-4eb6-9255-ebab73e67b67-delete_snapshot" by "delete_snapshot" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:45:34 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-0df3c5a5-86ed-46ec-826b-966c0fab141c tempest-VolumeDependencyTests-1073688899 None] Lock "cinder-ee471be0-d742-4eb6-9255-ebab73e67b67-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:45:34 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-0df3c5a5-86ed-46ec-826b-966c0fab141c tempest-VolumeDependencyTests-1073688899 None] Acquiring lock "cinder-quobyte-3d835afb-99cc-442b-ab26-0d36c54fdbe2" by "delete_snapshot" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:45:34 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-0df3c5a5-86ed-46ec-826b-966c0fab141c tempest-VolumeDependencyTests-1073688899 None] Lock "cinder-quobyte-3d835afb-99cc-442b-ab26-0d36c54fdbe2" acquired by "delete_snapshot" :: waited 0.013s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:45:34 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-0df3c5a5-86ed-46ec-826b-966c0fab141c tempest-VolumeDependencyTests-1073688899 None] Acquiring lock "cinder-quobyte-ee471be0-d742-4eb6-9255-ebab73e67b67" by "_delete_snapshot" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:45:34 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-0df3c5a5-86ed-46ec-826b-966c0fab141c tempest-VolumeDependencyTests-1073688899 None] Lock "cinder-quobyte-ee471be0-d742-4eb6-9255-ebab73e67b67" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:45:34 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-0df3c5a5-86ed-46ec-826b-966c0fab141c tempest-VolumeDependencyTests-1073688899 None] Deleting offline snapshot ee471be0-d742-4eb6-9255-ebab73e67b67 of volume 3d835afb-99cc-442b-ab26-0d36c54fdbe2 {{(pid=88899) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 03 08:45:34 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-0df3c5a5-86ed-46ec-826b-966c0fab141c tempest-VolumeDependencyTests-1073688899 None] snapshot_file for this snap is: volume-3d835afb-99cc-442b-ab26-0d36c54fdbe2.ee471be0-d742-4eb6-9255-ebab73e67b67 {{(pid=88899) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 03 08:45:34 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[c98ea9dc-24df-4fb0-93d2-274c56451ce2]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:45:34 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-0df3c5a5-86ed-46ec-826b-966c0fab141c tempest-VolumeDependencyTests-1073688899 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-3d835afb-99cc-442b-ab26-0d36c54fdbe2.ee471be0-d742-4eb6-9255-ebab73e67b67 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:45:34 devstack sudo[106521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-3d835afb-99cc-442b-ab26-0d36c54fdbe2.ee471be0-d742-4eb6-9255-ebab73e67b67 Aug 03 08:45:34 devstack sudo[106521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:45:34 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-aae511c8-83af-4ef4-a17f-9cb480fdff86 tempest-CinderUnicodeTest-1013959674 None] Acquiring lock "cinder-6a2bee57-d313-4e44-b49f-815797780efc-delete_volume" by "delete_volume" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:45:34 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-aae511c8-83af-4ef4-a17f-9cb480fdff86 tempest-CinderUnicodeTest-1013959674 None] Lock "cinder-6a2bee57-d313-4e44-b49f-815797780efc-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:45:34 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-aae511c8-83af-4ef4-a17f-9cb480fdff86 tempest-CinderUnicodeTest-1013959674 None] Acquiring lock "cinder-quobyte-6a2bee57-d313-4e44-b49f-815797780efc" by "delete_volume" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:45:34 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-aae511c8-83af-4ef4-a17f-9cb480fdff86 tempest-CinderUnicodeTest-1013959674 None] Lock "cinder-quobyte-6a2bee57-d313-4e44-b49f-815797780efc" acquired by "delete_volume" :: waited 0.024s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:45:34 devstack sudo[106521]: pam_unix(sudo:session): session closed for user root Aug 03 08:45:34 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-0df3c5a5-86ed-46ec-826b-966c0fab141c tempest-VolumeDependencyTests-1073688899 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-3d835afb-99cc-442b-ab26-0d36c54fdbe2.ee471be0-d742-4eb6-9255-ebab73e67b67" returned: 0 in 0.459s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:45:34 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-0df3c5a5-86ed-46ec-826b-966c0fab141c tempest-VolumeDependencyTests-1073688899 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3d835afb-99cc-442b-ab26-0d36c54fdbe2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88899) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 03 08:45:34 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7e5b02c-a4d1-4726-930a-482eff546709]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:45:34 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-aae511c8-83af-4ef4-a17f-9cb480fdff86 tempest-CinderUnicodeTest-1013959674 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-6a2bee57-d313-4e44-b49f-815797780efc {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:45:34 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[af6531a7-bd42-4d11-b9f5-7d4a8aeac53c]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:45:34 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-0df3c5a5-86ed-46ec-826b-966c0fab141c tempest-VolumeDependencyTests-1073688899 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-3d835afb-99cc-442b-ab26-0d36c54fdbe2 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:45:35 devstack sudo[106528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-6a2bee57-d313-4e44-b49f-815797780efc Aug 03 08:45:35 devstack sudo[106528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:45:35 devstack sudo[106529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-3d835afb-99cc-442b-ab26-0d36c54fdbe2 Aug 03 08:45:35 devstack sudo[106529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:45:35 devstack sudo[106528]: pam_unix(sudo:session): session closed for user root Aug 03 08:45:35 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-aae511c8-83af-4ef4-a17f-9cb480fdff86 tempest-CinderUnicodeTest-1013959674 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-6a2bee57-d313-4e44-b49f-815797780efc" returned: 0 in 0.383s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:45:35 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-aae511c8-83af-4ef4-a17f-9cb480fdff86 tempest-CinderUnicodeTest-1013959674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-6a2bee57-d313-4e44-b49f-815797780efc {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:45:35 devstack sudo[106529]: pam_unix(sudo:session): session closed for user root Aug 03 08:45:35 devstack sudo[106539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-6a2bee57-d313-4e44-b49f-815797780efc Aug 03 08:45:35 devstack sudo[106539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:45:35 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-0df3c5a5-86ed-46ec-826b-966c0fab141c tempest-VolumeDependencyTests-1073688899 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-3d835afb-99cc-442b-ab26-0d36c54fdbe2" returned: 0 in 0.394s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:45:35 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-0df3c5a5-86ed-46ec-826b-966c0fab141c tempest-VolumeDependencyTests-1073688899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-3d835afb-99cc-442b-ab26-0d36c54fdbe2.ee471be0-d742-4eb6-9255-ebab73e67b67 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:45:35 devstack sudo[106541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-3d835afb-99cc-442b-ab26-0d36c54fdbe2.ee471be0-d742-4eb6-9255-ebab73e67b67 Aug 03 08:45:35 devstack sudo[106541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:45:35 devstack sudo[106539]: pam_unix(sudo:session): session closed for user root Aug 03 08:45:35 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-aae511c8-83af-4ef4-a17f-9cb480fdff86 tempest-CinderUnicodeTest-1013959674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-6a2bee57-d313-4e44-b49f-815797780efc" returned: 0 in 0.252s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:45:35 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-aae511c8-83af-4ef4-a17f-9cb480fdff86 tempest-CinderUnicodeTest-1013959674 None] Lock "cinder-quobyte-6a2bee57-d313-4e44-b49f-815797780efc" released by "delete_volume" :: held 0.727s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:45:35 devstack cinder-volume[88899]: DEBUG cinder.quota [None req-aae511c8-83af-4ef4-a17f-9cb480fdff86 tempest-CinderUnicodeTest-1013959674 None] Created reservations ['0b3c27be-cce2-44dc-9a39-bac5a3b71698', '73c33b04-4ea3-4392-9876-0f73969b8481', 'eb144ce3-506d-4195-9a93-99fb1119326b', 'a9d18b12-5ca6-4fdc-8ec1-14e260929086'] {{(pid=88899) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 08:45:35 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-aae511c8-83af-4ef4-a17f-9cb480fdff86 tempest-CinderUnicodeTest-1013959674 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:45:35 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-aae511c8-83af-4ef4-a17f-9cb480fdff86 tempest-CinderUnicodeTest-1013959674 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:45:35 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-aae511c8-83af-4ef4-a17f-9cb480fdff86 tempest-CinderUnicodeTest-1013959674 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:45:35 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-aae511c8-83af-4ef4-a17f-9cb480fdff86 tempest-CinderUnicodeTest-1013959674 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:45:35 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-aae511c8-83af-4ef4-a17f-9cb480fdff86 tempest-CinderUnicodeTest-1013959674 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:45:35 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-aae511c8-83af-4ef4-a17f-9cb480fdff86 tempest-CinderUnicodeTest-1013959674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:45:35 devstack sudo[106541]: pam_unix(sudo:session): session closed for user root Aug 03 08:45:35 devstack sudo[106548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a Aug 03 08:45:35 devstack sudo[106548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:45:35 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-0df3c5a5-86ed-46ec-826b-966c0fab141c tempest-VolumeDependencyTests-1073688899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-3d835afb-99cc-442b-ab26-0d36c54fdbe2.ee471be0-d742-4eb6-9255-ebab73e67b67" returned: 0 in 0.445s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:45:35 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-0df3c5a5-86ed-46ec-826b-966c0fab141c tempest-VolumeDependencyTests-1073688899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-3d835afb-99cc-442b-ab26-0d36c54fdbe2.ee471be0-d742-4eb6-9255-ebab73e67b67 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:45:35 devstack sudo[106550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-3d835afb-99cc-442b-ab26-0d36c54fdbe2.ee471be0-d742-4eb6-9255-ebab73e67b67 Aug 03 08:45:35 devstack sudo[106550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:45:36 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-191ba0f2-a9f4-4878-93ce-57662471065a tempest-CinderUnicodeTest-1013959674 None] Acquiring lock "cinder-e509c020-ad02-4ecb-a716-d238cef89493-delete_volume" by "delete_volume" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:45:36 devstack sudo[106548]: pam_unix(sudo:session): session closed for user root Aug 03 08:45:36 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-aae511c8-83af-4ef4-a17f-9cb480fdff86 tempest-CinderUnicodeTest-1013959674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a" returned: 0 in 0.292s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:45:36 devstack cinder-volume[88899]: DEBUG cinder.manager [None req-aae511c8-83af-4ef4-a17f-9cb480fdff86 tempest-CinderUnicodeTest-1013959674 None] Notifying Schedulers of capabilities ... {{(pid=88899) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 08:45:36 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-191ba0f2-a9f4-4878-93ce-57662471065a tempest-CinderUnicodeTest-1013959674 None] Lock "cinder-e509c020-ad02-4ecb-a716-d238cef89493-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:45:36 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-aae511c8-83af-4ef4-a17f-9cb480fdff86 tempest-CinderUnicodeTest-1013959674 None] Deleted volume successfully. Aug 03 08:45:36 devstack sudo[106550]: pam_unix(sudo:session): session closed for user root Aug 03 08:45:36 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-0df3c5a5-86ed-46ec-826b-966c0fab141c tempest-VolumeDependencyTests-1073688899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-3d835afb-99cc-442b-ab26-0d36c54fdbe2.ee471be0-d742-4eb6-9255-ebab73e67b67" returned: 0 in 0.302s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:45:36 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-aae511c8-83af-4ef4-a17f-9cb480fdff86 tempest-CinderUnicodeTest-1013959674 None] Lock "cinder-6a2bee57-d313-4e44-b49f-815797780efc-delete_volume" released by "delete_volume" :: held 1.298s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:45:36 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-0df3c5a5-86ed-46ec-826b-966c0fab141c tempest-VolumeDependencyTests-1073688899 None] Lock "cinder-quobyte-ee471be0-d742-4eb6-9255-ebab73e67b67" released by "_delete_snapshot" :: held 1.727s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:45:36 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-191ba0f2-a9f4-4878-93ce-57662471065a tempest-CinderUnicodeTest-1013959674 None] Acquiring lock "cinder-quobyte-e509c020-ad02-4ecb-a716-d238cef89493" by "delete_volume" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:45:36 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-0df3c5a5-86ed-46ec-826b-966c0fab141c tempest-VolumeDependencyTests-1073688899 None] Lock "cinder-quobyte-3d835afb-99cc-442b-ab26-0d36c54fdbe2" released by "delete_snapshot" :: held 1.755s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:45:36 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-191ba0f2-a9f4-4878-93ce-57662471065a tempest-CinderUnicodeTest-1013959674 None] Lock "cinder-quobyte-e509c020-ad02-4ecb-a716-d238cef89493" acquired by "delete_volume" :: waited 0.024s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:45:36 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[3933ec05-dc3a-4e38-835b-6e309444425b]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:45:36 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-191ba0f2-a9f4-4878-93ce-57662471065a tempest-CinderUnicodeTest-1013959674 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-e509c020-ad02-4ecb-a716-d238cef89493 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:45:36 devstack cinder-volume[88899]: DEBUG cinder.quota [None req-0df3c5a5-86ed-46ec-826b-966c0fab141c tempest-VolumeDependencyTests-1073688899 None] Created reservations ['19c8a66b-1317-44bb-8e52-83db7b72bafa', '8299aaed-6abc-4162-ab57-fa10451fcfd8', '84fd1fea-a457-4b57-8433-4899cc543af1', '7499d903-093f-4919-b55a-0411602dbb5a'] {{(pid=88899) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 08:45:36 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-0df3c5a5-86ed-46ec-826b-966c0fab141c tempest-VolumeDependencyTests-1073688899 None] Delete snapshot completed successfully. Aug 03 08:45:36 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-0df3c5a5-86ed-46ec-826b-966c0fab141c tempest-VolumeDependencyTests-1073688899 None] Lock "cinder-ee471be0-d742-4eb6-9255-ebab73e67b67-delete_snapshot" released by "delete_snapshot" :: held 1.928s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:45:36 devstack sudo[106554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-e509c020-ad02-4ecb-a716-d238cef89493 Aug 03 08:45:36 devstack sudo[106554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:45:36 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-3b7ba2e3-626c-47d3-916d-8734dfb64cae tempest-VolumeDependencyTests-1073688899 None] Acquiring lock "cinder-527e2540-732a-4b7c-afbc-ae2ccda5d24b-delete_volume" by "delete_volume" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:45:36 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-3b7ba2e3-626c-47d3-916d-8734dfb64cae tempest-VolumeDependencyTests-1073688899 None] Lock "cinder-527e2540-732a-4b7c-afbc-ae2ccda5d24b-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:45:36 devstack sudo[106554]: pam_unix(sudo:session): session closed for user root Aug 03 08:45:36 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-191ba0f2-a9f4-4878-93ce-57662471065a tempest-CinderUnicodeTest-1013959674 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-e509c020-ad02-4ecb-a716-d238cef89493" returned: 0 in 0.387s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:45:36 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-191ba0f2-a9f4-4878-93ce-57662471065a tempest-CinderUnicodeTest-1013959674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-e509c020-ad02-4ecb-a716-d238cef89493 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:45:36 devstack sudo[106560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-e509c020-ad02-4ecb-a716-d238cef89493 Aug 03 08:45:36 devstack sudo[106560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:45:36 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-3b7ba2e3-626c-47d3-916d-8734dfb64cae tempest-VolumeDependencyTests-1073688899 None] Acquiring lock "cinder-quobyte-527e2540-732a-4b7c-afbc-ae2ccda5d24b" by "delete_volume" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:45:36 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-3b7ba2e3-626c-47d3-916d-8734dfb64cae tempest-VolumeDependencyTests-1073688899 None] Lock "cinder-quobyte-527e2540-732a-4b7c-afbc-ae2ccda5d24b" acquired by "delete_volume" :: waited 0.017s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:45:36 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[00948cf5-3d52-4b1c-a407-ca72d6c1d720]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:45:36 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-3b7ba2e3-626c-47d3-916d-8734dfb64cae tempest-VolumeDependencyTests-1073688899 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-527e2540-732a-4b7c-afbc-ae2ccda5d24b {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:45:36 devstack sudo[106562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-527e2540-732a-4b7c-afbc-ae2ccda5d24b Aug 03 08:45:36 devstack sudo[106562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:45:37 devstack sudo[106560]: pam_unix(sudo:session): session closed for user root Aug 03 08:45:37 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-191ba0f2-a9f4-4878-93ce-57662471065a tempest-CinderUnicodeTest-1013959674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-e509c020-ad02-4ecb-a716-d238cef89493" returned: 0 in 0.405s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:45:37 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-191ba0f2-a9f4-4878-93ce-57662471065a tempest-CinderUnicodeTest-1013959674 None] Lock "cinder-quobyte-e509c020-ad02-4ecb-a716-d238cef89493" released by "delete_volume" :: held 0.844s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:45:37 devstack cinder-volume[88899]: DEBUG cinder.quota [None req-191ba0f2-a9f4-4878-93ce-57662471065a tempest-CinderUnicodeTest-1013959674 None] Created reservations ['7173e01a-2685-4d9a-b7f2-379c8e37eeca', '2ddb2b76-99ad-47fc-a61e-d4cac6a6a87b', '2c3fd331-f4b3-4f3b-a02a-5a2dc7a2eeb9', '939b0473-2c2b-4825-b627-bcf9f410a8b1'] {{(pid=88899) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 08:45:37 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-191ba0f2-a9f4-4878-93ce-57662471065a tempest-CinderUnicodeTest-1013959674 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:45:37 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-191ba0f2-a9f4-4878-93ce-57662471065a tempest-CinderUnicodeTest-1013959674 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:45:37 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-191ba0f2-a9f4-4878-93ce-57662471065a tempest-CinderUnicodeTest-1013959674 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:45:37 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-191ba0f2-a9f4-4878-93ce-57662471065a tempest-CinderUnicodeTest-1013959674 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:45:37 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-191ba0f2-a9f4-4878-93ce-57662471065a tempest-CinderUnicodeTest-1013959674 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:45:37 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-191ba0f2-a9f4-4878-93ce-57662471065a tempest-CinderUnicodeTest-1013959674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:45:37 devstack sudo[106562]: pam_unix(sudo:session): session closed for user root Aug 03 08:45:37 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-3b7ba2e3-626c-47d3-916d-8734dfb64cae tempest-VolumeDependencyTests-1073688899 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-527e2540-732a-4b7c-afbc-ae2ccda5d24b" returned: 0 in 0.516s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:45:37 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-3b7ba2e3-626c-47d3-916d-8734dfb64cae tempest-VolumeDependencyTests-1073688899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-527e2540-732a-4b7c-afbc-ae2ccda5d24b {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:45:37 devstack sudo[106568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a Aug 03 08:45:37 devstack sudo[106568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:45:37 devstack sudo[106569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-527e2540-732a-4b7c-afbc-ae2ccda5d24b Aug 03 08:45:37 devstack sudo[106569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:45:37 devstack sudo[106568]: pam_unix(sudo:session): session closed for user root Aug 03 08:45:37 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-191ba0f2-a9f4-4878-93ce-57662471065a tempest-CinderUnicodeTest-1013959674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a" returned: 0 in 0.293s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:45:37 devstack cinder-volume[88899]: DEBUG cinder.manager [None req-191ba0f2-a9f4-4878-93ce-57662471065a tempest-CinderUnicodeTest-1013959674 None] Notifying Schedulers of capabilities ... {{(pid=88899) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 08:45:37 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-191ba0f2-a9f4-4878-93ce-57662471065a tempest-CinderUnicodeTest-1013959674 None] Deleted volume successfully. Aug 03 08:45:37 devstack sudo[106569]: pam_unix(sudo:session): session closed for user root Aug 03 08:45:37 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-3b7ba2e3-626c-47d3-916d-8734dfb64cae tempest-VolumeDependencyTests-1073688899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-527e2540-732a-4b7c-afbc-ae2ccda5d24b" returned: 0 in 0.311s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:45:37 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-191ba0f2-a9f4-4878-93ce-57662471065a tempest-CinderUnicodeTest-1013959674 None] Lock "cinder-e509c020-ad02-4ecb-a716-d238cef89493-delete_volume" released by "delete_volume" :: held 1.476s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:45:37 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-3b7ba2e3-626c-47d3-916d-8734dfb64cae tempest-VolumeDependencyTests-1073688899 None] Lock "cinder-quobyte-527e2540-732a-4b7c-afbc-ae2ccda5d24b" released by "delete_volume" :: held 0.911s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:45:37 devstack cinder-volume[88899]: DEBUG cinder.quota [None req-3b7ba2e3-626c-47d3-916d-8734dfb64cae tempest-VolumeDependencyTests-1073688899 None] Created reservations ['326a0b31-2300-4c5e-8e3b-9474c809191c', '6e1f702c-6517-45df-b3b5-2a1e0fd2c33c', '4636466f-835a-43a1-850a-553c8937a766', '148af0b1-ae91-477f-9c57-f11884a84cfa'] {{(pid=88899) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 08:45:37 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-3b7ba2e3-626c-47d3-916d-8734dfb64cae tempest-VolumeDependencyTests-1073688899 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:45:37 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-3b7ba2e3-626c-47d3-916d-8734dfb64cae tempest-VolumeDependencyTests-1073688899 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:45:37 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-3b7ba2e3-626c-47d3-916d-8734dfb64cae tempest-VolumeDependencyTests-1073688899 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:45:37 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-3b7ba2e3-626c-47d3-916d-8734dfb64cae tempest-VolumeDependencyTests-1073688899 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:45:37 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-3b7ba2e3-626c-47d3-916d-8734dfb64cae tempest-VolumeDependencyTests-1073688899 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:45:37 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-3b7ba2e3-626c-47d3-916d-8734dfb64cae tempest-VolumeDependencyTests-1073688899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:45:37 devstack sudo[106574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a Aug 03 08:45:37 devstack sudo[106574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:45:38 devstack sudo[106574]: pam_unix(sudo:session): session closed for user root Aug 03 08:45:38 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-3b7ba2e3-626c-47d3-916d-8734dfb64cae tempest-VolumeDependencyTests-1073688899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a" returned: 0 in 0.328s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:45:38 devstack cinder-volume[88899]: DEBUG cinder.manager [None req-3b7ba2e3-626c-47d3-916d-8734dfb64cae tempest-VolumeDependencyTests-1073688899 None] Notifying Schedulers of capabilities ... {{(pid=88899) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 08:45:38 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-3b7ba2e3-626c-47d3-916d-8734dfb64cae tempest-VolumeDependencyTests-1073688899 None] Deleted volume successfully. Aug 03 08:45:38 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-3b7ba2e3-626c-47d3-916d-8734dfb64cae tempest-VolumeDependencyTests-1073688899 None] Lock "cinder-527e2540-732a-4b7c-afbc-ae2ccda5d24b-delete_volume" released by "delete_volume" :: held 1.579s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:45:38 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-50f98dda-677c-40a2-a6f6-efcda27741f5 tempest-VolumeDependencyTests-1073688899 None] Acquiring lock "cinder-3d835afb-99cc-442b-ab26-0d36c54fdbe2-delete_volume" by "delete_volume" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:45:38 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-50f98dda-677c-40a2-a6f6-efcda27741f5 tempest-VolumeDependencyTests-1073688899 None] Lock "cinder-3d835afb-99cc-442b-ab26-0d36c54fdbe2-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:45:38 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-50f98dda-677c-40a2-a6f6-efcda27741f5 tempest-VolumeDependencyTests-1073688899 None] Acquiring lock "cinder-quobyte-3d835afb-99cc-442b-ab26-0d36c54fdbe2" by "delete_volume" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:45:38 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-50f98dda-677c-40a2-a6f6-efcda27741f5 tempest-VolumeDependencyTests-1073688899 None] Lock "cinder-quobyte-3d835afb-99cc-442b-ab26-0d36c54fdbe2" acquired by "delete_volume" :: waited 0.021s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:45:39 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[d25d2ebe-cb18-4c59-9a4c-4d3328bbf9b7]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:45:39 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-50f98dda-677c-40a2-a6f6-efcda27741f5 tempest-VolumeDependencyTests-1073688899 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-3d835afb-99cc-442b-ab26-0d36c54fdbe2 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:45:39 devstack sudo[106578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-3d835afb-99cc-442b-ab26-0d36c54fdbe2 Aug 03 08:45:39 devstack sudo[106578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:45:39 devstack sudo[106578]: pam_unix(sudo:session): session closed for user root Aug 03 08:45:39 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-50f98dda-677c-40a2-a6f6-efcda27741f5 tempest-VolumeDependencyTests-1073688899 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-3d835afb-99cc-442b-ab26-0d36c54fdbe2" returned: 0 in 0.388s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:45:39 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-50f98dda-677c-40a2-a6f6-efcda27741f5 tempest-VolumeDependencyTests-1073688899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-3d835afb-99cc-442b-ab26-0d36c54fdbe2 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:45:39 devstack sudo[106584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-3d835afb-99cc-442b-ab26-0d36c54fdbe2 Aug 03 08:45:39 devstack sudo[106584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:45:39 devstack sudo[106584]: pam_unix(sudo:session): session closed for user root Aug 03 08:45:39 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-50f98dda-677c-40a2-a6f6-efcda27741f5 tempest-VolumeDependencyTests-1073688899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-3d835afb-99cc-442b-ab26-0d36c54fdbe2" returned: 0 in 0.327s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:45:39 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-50f98dda-677c-40a2-a6f6-efcda27741f5 tempest-VolumeDependencyTests-1073688899 None] Lock "cinder-quobyte-3d835afb-99cc-442b-ab26-0d36c54fdbe2" released by "delete_volume" :: held 0.791s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:45:39 devstack cinder-volume[88899]: DEBUG cinder.quota [None req-50f98dda-677c-40a2-a6f6-efcda27741f5 tempest-VolumeDependencyTests-1073688899 None] Created reservations ['cdefea15-547f-443d-9d13-3af81790a099', '5e436fac-0cae-46cc-815f-fb7587e93e19', '9a945d2c-4ea9-435b-b330-0885172d47f1', 'd3fb1895-3d65-4739-98bf-54bad347e1fe'] {{(pid=88899) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 08:45:39 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-50f98dda-677c-40a2-a6f6-efcda27741f5 tempest-VolumeDependencyTests-1073688899 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:45:39 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-50f98dda-677c-40a2-a6f6-efcda27741f5 tempest-VolumeDependencyTests-1073688899 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:45:39 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-50f98dda-677c-40a2-a6f6-efcda27741f5 tempest-VolumeDependencyTests-1073688899 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:45:39 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-50f98dda-677c-40a2-a6f6-efcda27741f5 tempest-VolumeDependencyTests-1073688899 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:45:39 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-50f98dda-677c-40a2-a6f6-efcda27741f5 tempest-VolumeDependencyTests-1073688899 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:45:39 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-50f98dda-677c-40a2-a6f6-efcda27741f5 tempest-VolumeDependencyTests-1073688899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:45:39 devstack sudo[106587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a Aug 03 08:45:39 devstack sudo[106587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:45:40 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-3f9f0070-8b96-467d-8b2c-9d451a8aa87a tempest-VolumeDependencyTests-1073688899 None] Acquiring lock "cinder-5fbff1a7-fff1-4ab5-ae3b-8a08c8645cb8-delete_volume" by "delete_volume" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:45:40 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-3f9f0070-8b96-467d-8b2c-9d451a8aa87a tempest-VolumeDependencyTests-1073688899 None] Lock "cinder-5fbff1a7-fff1-4ab5-ae3b-8a08c8645cb8-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:45:40 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-3f9f0070-8b96-467d-8b2c-9d451a8aa87a tempest-VolumeDependencyTests-1073688899 None] Acquiring lock "cinder-quobyte-5fbff1a7-fff1-4ab5-ae3b-8a08c8645cb8" by "delete_volume" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:45:40 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-3f9f0070-8b96-467d-8b2c-9d451a8aa87a tempest-VolumeDependencyTests-1073688899 None] Lock "cinder-quobyte-5fbff1a7-fff1-4ab5-ae3b-8a08c8645cb8" acquired by "delete_volume" :: waited 0.038s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:45:40 devstack sudo[106587]: pam_unix(sudo:session): session closed for user root Aug 03 08:45:40 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-50f98dda-677c-40a2-a6f6-efcda27741f5 tempest-VolumeDependencyTests-1073688899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a" returned: 0 in 0.449s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:45:40 devstack cinder-volume[88899]: DEBUG cinder.manager [None req-50f98dda-677c-40a2-a6f6-efcda27741f5 tempest-VolumeDependencyTests-1073688899 None] Notifying Schedulers of capabilities ... {{(pid=88899) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 08:45:40 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-50f98dda-677c-40a2-a6f6-efcda27741f5 tempest-VolumeDependencyTests-1073688899 None] Deleted volume successfully. Aug 03 08:45:40 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[c916481a-d53c-4ec2-a8f7-1a37c96bf28c]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:45:40 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-3f9f0070-8b96-467d-8b2c-9d451a8aa87a tempest-VolumeDependencyTests-1073688899 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-5fbff1a7-fff1-4ab5-ae3b-8a08c8645cb8 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:45:40 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-50f98dda-677c-40a2-a6f6-efcda27741f5 tempest-VolumeDependencyTests-1073688899 None] Lock "cinder-3d835afb-99cc-442b-ab26-0d36c54fdbe2-delete_volume" released by "delete_volume" :: held 1.502s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:45:40 devstack sudo[106590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-5fbff1a7-fff1-4ab5-ae3b-8a08c8645cb8 Aug 03 08:45:40 devstack sudo[106590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:45:40 devstack sudo[106590]: pam_unix(sudo:session): session closed for user root Aug 03 08:45:40 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-3f9f0070-8b96-467d-8b2c-9d451a8aa87a tempest-VolumeDependencyTests-1073688899 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-5fbff1a7-fff1-4ab5-ae3b-8a08c8645cb8" returned: 0 in 0.471s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:45:40 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-3f9f0070-8b96-467d-8b2c-9d451a8aa87a tempest-VolumeDependencyTests-1073688899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-5fbff1a7-fff1-4ab5-ae3b-8a08c8645cb8 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:45:40 devstack sudo[106596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-5fbff1a7-fff1-4ab5-ae3b-8a08c8645cb8 Aug 03 08:45:40 devstack sudo[106596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:45:41 devstack sudo[106596]: pam_unix(sudo:session): session closed for user root Aug 03 08:45:41 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-3f9f0070-8b96-467d-8b2c-9d451a8aa87a tempest-VolumeDependencyTests-1073688899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-5fbff1a7-fff1-4ab5-ae3b-8a08c8645cb8" returned: 0 in 0.451s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:45:41 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-3f9f0070-8b96-467d-8b2c-9d451a8aa87a tempest-VolumeDependencyTests-1073688899 None] Lock "cinder-quobyte-5fbff1a7-fff1-4ab5-ae3b-8a08c8645cb8" released by "delete_volume" :: held 0.987s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:45:41 devstack cinder-volume[88899]: DEBUG dbcounter [-] [88899] Writing DB stats cinder:SELECT=202,cinder:INSERT=72,cinder:UPDATE=267,cinder:DELETE=20 {{(pid=88899) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 03 08:45:41 devstack cinder-volume[88899]: DEBUG cinder.quota [None req-3f9f0070-8b96-467d-8b2c-9d451a8aa87a tempest-VolumeDependencyTests-1073688899 None] Created reservations ['7eb0d05f-38be-48dd-82f5-2a99bb0c7f26', '18a0c71f-0983-4b52-9b60-38900cc94597', '01fef754-4720-4cc3-8e7a-b1b3a1396529', '44b67ec9-403b-4058-80ef-4e0f5129e225'] {{(pid=88899) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 08:45:41 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-3f9f0070-8b96-467d-8b2c-9d451a8aa87a tempest-VolumeDependencyTests-1073688899 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:45:41 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-3f9f0070-8b96-467d-8b2c-9d451a8aa87a tempest-VolumeDependencyTests-1073688899 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:45:41 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-3f9f0070-8b96-467d-8b2c-9d451a8aa87a tempest-VolumeDependencyTests-1073688899 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:45:41 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-3f9f0070-8b96-467d-8b2c-9d451a8aa87a tempest-VolumeDependencyTests-1073688899 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:45:41 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-3f9f0070-8b96-467d-8b2c-9d451a8aa87a tempest-VolumeDependencyTests-1073688899 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:45:41 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-3f9f0070-8b96-467d-8b2c-9d451a8aa87a tempest-VolumeDependencyTests-1073688899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:45:41 devstack sudo[106599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a Aug 03 08:45:41 devstack sudo[106599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:45:41 devstack sudo[106599]: pam_unix(sudo:session): session closed for user root Aug 03 08:45:41 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-3f9f0070-8b96-467d-8b2c-9d451a8aa87a tempest-VolumeDependencyTests-1073688899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a" returned: 0 in 0.365s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:45:41 devstack cinder-volume[88899]: DEBUG cinder.manager [None req-3f9f0070-8b96-467d-8b2c-9d451a8aa87a tempest-VolumeDependencyTests-1073688899 None] Notifying Schedulers of capabilities ... {{(pid=88899) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 08:45:41 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-3f9f0070-8b96-467d-8b2c-9d451a8aa87a tempest-VolumeDependencyTests-1073688899 None] Deleted volume successfully. Aug 03 08:45:41 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-3f9f0070-8b96-467d-8b2c-9d451a8aa87a tempest-VolumeDependencyTests-1073688899 None] Lock "cinder-5fbff1a7-fff1-4ab5-ae3b-8a08c8645cb8-delete_volume" released by "delete_volume" :: held 1.709s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:45:43 devstack cinder-volume[88899]: DEBUG cinder.volume.flows.manager.create_volume [None req-25c9dd46-5bf6-49f7-914e-f1978448e15f tempest-VolumeDependencyTests-1073688899 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88899) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 08:45:43 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-25c9dd46-5bf6-49f7-914e-f1978448e15f tempest-VolumeDependencyTests-1073688899 None] Flow 'volume_create_manager' (2c80ef34-26b1-43a9-854b-89cdeef6e6d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:45:43 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-25c9dd46-5bf6-49f7-914e-f1978448e15f tempest-VolumeDependencyTests-1073688899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (78823351-1c00-4ca0-a7ac-d0592d9b5b86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:45:43 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-25c9dd46-5bf6-49f7-914e-f1978448e15f tempest-VolumeDependencyTests-1073688899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (78823351-1c00-4ca0-a7ac-d0592d9b5b86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:45:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-643125687',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f6fae8bb-ee2d-4ffd-aa4b-04a7aa4631e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c2f62930ea114d94aae304e8ed339f9c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:45:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:45:43Z,use_quota=True,user_id='de61709cf33340bf9e956c0545be3966',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8bde7129-1dc4-42ab-b852-ab32c61b4921),volume_type_id=8bde7129-1dc4-42ab-b852-ab32c61b4921)' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:45:43 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-25c9dd46-5bf6-49f7-914e-f1978448e15f tempest-VolumeDependencyTests-1073688899 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8adcd013-d67e-42ff-9a52-ab88ff638f27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:45:43 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-25c9dd46-5bf6-49f7-914e-f1978448e15f tempest-VolumeDependencyTests-1073688899 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8adcd013-d67e-42ff-9a52-ab88ff638f27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:45:43 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-25c9dd46-5bf6-49f7-914e-f1978448e15f tempest-VolumeDependencyTests-1073688899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (958d1762-973d-4457-a3b8-04794a57bdf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:45:43 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-25c9dd46-5bf6-49f7-914e-f1978448e15f tempest-VolumeDependencyTests-1073688899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (958d1762-973d-4457-a3b8-04794a57bdf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f6fae8bb-ee2d-4ffd-aa4b-04a7aa4631e1', 'volume_name': 'volume-f6fae8bb-ee2d-4ffd-aa4b-04a7aa4631e1', 'volume_size': 1}' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:45:43 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-25c9dd46-5bf6-49f7-914e-f1978448e15f tempest-VolumeDependencyTests-1073688899 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (828bc6bc-7bdd-4362-86f5-559c6cc9cf67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:45:43 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-25c9dd46-5bf6-49f7-914e-f1978448e15f tempest-VolumeDependencyTests-1073688899 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (828bc6bc-7bdd-4362-86f5-559c6cc9cf67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:45:43 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-25c9dd46-5bf6-49f7-914e-f1978448e15f tempest-VolumeDependencyTests-1073688899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (134d8a74-539e-4c67-a49a-89468dce00c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:45:43 devstack cinder-volume[88899]: INFO cinder.volume.flows.manager.create_volume [None req-25c9dd46-5bf6-49f7-914e-f1978448e15f tempest-VolumeDependencyTests-1073688899 None] Volume f6fae8bb-ee2d-4ffd-aa4b-04a7aa4631e1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f6fae8bb-ee2d-4ffd-aa4b-04a7aa4631e1', 'volume_size': 1} Aug 03 08:45:43 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-25c9dd46-5bf6-49f7-914e-f1978448e15f tempest-VolumeDependencyTests-1073688899 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:45:43 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-25c9dd46-5bf6-49f7-914e-f1978448e15f tempest-VolumeDependencyTests-1073688899 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:45:43 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-25c9dd46-5bf6-49f7-914e-f1978448e15f tempest-VolumeDependencyTests-1073688899 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:45:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-643125687',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f6fae8bb-ee2d-4ffd-aa4b-04a7aa4631e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c2f62930ea114d94aae304e8ed339f9c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:45:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:45:43Z,use_quota=True,user_id='de61709cf33340bf9e956c0545be3966',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8bde7129-1dc4-42ab-b852-ab32c61b4921),volume_type_id=8bde7129-1dc4-42ab-b852-ab32c61b4921)}" {{(pid=88899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 08:45:43 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-25c9dd46-5bf6-49f7-914e-f1978448e15f tempest-VolumeDependencyTests-1073688899 None] Creating volume f6fae8bb-ee2d-4ffd-aa4b-04a7aa4631e1 {{(pid=88899) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 08:45:43 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-25c9dd46-5bf6-49f7-914e-f1978448e15f tempest-VolumeDependencyTests-1073688899 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:45:43 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-25c9dd46-5bf6-49f7-914e-f1978448e15f tempest-VolumeDependencyTests-1073688899 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:45:43 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-25c9dd46-5bf6-49f7-914e-f1978448e15f tempest-VolumeDependencyTests-1073688899 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:45:43 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-25c9dd46-5bf6-49f7-914e-f1978448e15f tempest-VolumeDependencyTests-1073688899 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:45:43 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-25c9dd46-5bf6-49f7-914e-f1978448e15f tempest-VolumeDependencyTests-1073688899 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:45:43 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-25c9dd46-5bf6-49f7-914e-f1978448e15f tempest-VolumeDependencyTests-1073688899 None] Selected osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385 as target Quobyte volume. {{(pid=88899) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 08:45:43 devstack cinder-volume[88899]: INFO cinder.volume.drivers.remotefs [None req-25c9dd46-5bf6-49f7-914e-f1978448e15f tempest-VolumeDependencyTests-1073688899 None] casted to osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385 Aug 03 08:45:43 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-25c9dd46-5bf6-49f7-914e-f1978448e15f tempest-VolumeDependencyTests-1073688899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-f6fae8bb-ee2d-4ffd-aa4b-04a7aa4631e1 1073741824 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:45:43 devstack sudo[106602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-f6fae8bb-ee2d-4ffd-aa4b-04a7aa4631e1 1073741824 Aug 03 08:45:43 devstack sudo[106602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:45:43 devstack sudo[106602]: pam_unix(sudo:session): session closed for user root Aug 03 08:45:43 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-25c9dd46-5bf6-49f7-914e-f1978448e15f tempest-VolumeDependencyTests-1073688899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-f6fae8bb-ee2d-4ffd-aa4b-04a7aa4631e1 1073741824" returned: 0 in 0.516s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:45:43 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-25c9dd46-5bf6-49f7-914e-f1978448e15f tempest-VolumeDependencyTests-1073688899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-f6fae8bb-ee2d-4ffd-aa4b-04a7aa4631e1 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:45:43 devstack sudo[106608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-f6fae8bb-ee2d-4ffd-aa4b-04a7aa4631e1 Aug 03 08:45:43 devstack sudo[106608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:45:44 devstack sudo[106608]: pam_unix(sudo:session): session closed for user root Aug 03 08:45:44 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-25c9dd46-5bf6-49f7-914e-f1978448e15f tempest-VolumeDependencyTests-1073688899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-f6fae8bb-ee2d-4ffd-aa4b-04a7aa4631e1" returned: 0 in 0.279s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:45:44 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-25c9dd46-5bf6-49f7-914e-f1978448e15f tempest-VolumeDependencyTests-1073688899 None] <== create_volume: return (845ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'} {{(pid=88899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 08:45:44 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-25c9dd46-5bf6-49f7-914e-f1978448e15f tempest-VolumeDependencyTests-1073688899 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.848s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:45:44 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-25c9dd46-5bf6-49f7-914e-f1978448e15f tempest-VolumeDependencyTests-1073688899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (134d8a74-539e-4c67-a49a-89468dce00c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f6fae8bb-ee2d-4ffd-aa4b-04a7aa4631e1', 'volume_size': 1}' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:45:44 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-25c9dd46-5bf6-49f7-914e-f1978448e15f tempest-VolumeDependencyTests-1073688899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (105b9122-145b-4b63-b33b-1089df484060) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:45:44 devstack cinder-volume[88899]: INFO cinder.volume.flows.manager.create_volume [None req-25c9dd46-5bf6-49f7-914e-f1978448e15f tempest-VolumeDependencyTests-1073688899 None] Volume volume-f6fae8bb-ee2d-4ffd-aa4b-04a7aa4631e1 (f6fae8bb-ee2d-4ffd-aa4b-04a7aa4631e1): created successfully Aug 03 08:45:44 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-25c9dd46-5bf6-49f7-914e-f1978448e15f tempest-VolumeDependencyTests-1073688899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (105b9122-145b-4b63-b33b-1089df484060) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:45:44 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-25c9dd46-5bf6-49f7-914e-f1978448e15f tempest-VolumeDependencyTests-1073688899 None] Flow 'volume_create_manager' (2c80ef34-26b1-43a9-854b-89cdeef6e6d5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:45:44 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-25c9dd46-5bf6-49f7-914e-f1978448e15f tempest-VolumeDependencyTests-1073688899 None] Created volume successfully. Aug 03 08:45:45 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-efb980b9-5946-4511-8dd7-76e06fa00e13 tempest-VolumeDependencyTests-1073688899 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:45:45 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-efb980b9-5946-4511-8dd7-76e06fa00e13 tempest-VolumeDependencyTests-1073688899 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:45:45 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-efb980b9-5946-4511-8dd7-76e06fa00e13 tempest-VolumeDependencyTests-1073688899 None] Creating offline snapshot c17f8863-d791-494f-9c20-db2fb701440d of volume f6fae8bb-ee2d-4ffd-aa4b-04a7aa4631e1 {{(pid=88899) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 03 08:45:45 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[55a64ef5-e9b2-419e-996d-c36e19dc6ab4]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:45:45 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-efb980b9-5946-4511-8dd7-76e06fa00e13 tempest-VolumeDependencyTests-1073688899 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-f6fae8bb-ee2d-4ffd-aa4b-04a7aa4631e1 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:45:45 devstack sudo[106611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-f6fae8bb-ee2d-4ffd-aa4b-04a7aa4631e1 Aug 03 08:45:45 devstack sudo[106611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:45:45 devstack cinder-volume[88899]: DEBUG cinder.volume.flows.manager.create_volume [None req-b86ab9d9-58dd-4bd4-9a61-7c083f2b498b tempest-TestShelveInstance-1134734811 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88899) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 08:45:45 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-b86ab9d9-58dd-4bd4-9a61-7c083f2b498b tempest-TestShelveInstance-1134734811 None] Flow 'volume_create_manager' (dc033b90-9635-41ee-9962-bafd517046c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:45:45 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-b86ab9d9-58dd-4bd4-9a61-7c083f2b498b tempest-TestShelveInstance-1134734811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e062b3e2-d6f7-4d59-ad7e-c82e1499d186) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:45:45 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-b86ab9d9-58dd-4bd4-9a61-7c083f2b498b tempest-TestShelveInstance-1134734811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e062b3e2-d6f7-4d59-ad7e-c82e1499d186) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:45:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-597969996',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5dd62159-5525-4bf9-8830-803d9e606d29,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2276e962cba74952abf4d8d0d5778635',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:45:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:45:46Z,use_quota=True,user_id='e489bd31863844ec8452b95ea407f594',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8bde7129-1dc4-42ab-b852-ab32c61b4921),volume_type_id=8bde7129-1dc4-42ab-b852-ab32c61b4921)' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:45:45 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-b86ab9d9-58dd-4bd4-9a61-7c083f2b498b tempest-TestShelveInstance-1134734811 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4bd82357-2399-44e5-9112-8fdd4857a910) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:45:45 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-b86ab9d9-58dd-4bd4-9a61-7c083f2b498b tempest-TestShelveInstance-1134734811 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4bd82357-2399-44e5-9112-8fdd4857a910) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:45:45 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-b86ab9d9-58dd-4bd4-9a61-7c083f2b498b tempest-TestShelveInstance-1134734811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f000f9df-714a-45b0-8a1b-efa79d3c0610) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:45:45 devstack cinder-volume[88899]: DEBUG cinder.image.glance [None req-b86ab9d9-58dd-4bd4-9a61-7c083f2b498b tempest-TestShelveInstance-1134734811 None] Creating Keystone auth plugin from conf {{(pid=88899) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Aug 03 08:45:45 devstack sudo[106611]: pam_unix(sudo:session): session closed for user root Aug 03 08:45:45 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-efb980b9-5946-4511-8dd7-76e06fa00e13 tempest-VolumeDependencyTests-1073688899 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-f6fae8bb-ee2d-4ffd-aa4b-04a7aa4631e1" returned: 0 in 0.413s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:45:45 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-efb980b9-5946-4511-8dd7-76e06fa00e13 tempest-VolumeDependencyTests-1073688899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-f6fae8bb-ee2d-4ffd-aa4b-04a7aa4631e1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-f6fae8bb-ee2d-4ffd-aa4b-04a7aa4631e1.c17f8863-d791-494f-9c20-db2fb701440d 1G {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:45:45 devstack sudo[106616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-f6fae8bb-ee2d-4ffd-aa4b-04a7aa4631e1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-f6fae8bb-ee2d-4ffd-aa4b-04a7aa4631e1.c17f8863-d791-494f-9c20-db2fb701440d 1G Aug 03 08:45:45 devstack sudo[106616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:45:46 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-b86ab9d9-58dd-4bd4-9a61-7c083f2b498b tempest-TestShelveInstance-1134734811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f000f9df-714a-45b0-8a1b-efa79d3c0610) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '5dd62159-5525-4bf9-8830-803d9e606d29', 'volume_name': 'volume-5dd62159-5525-4bf9-8830-803d9e606d29', 'volume_size': 1, 'image_id': '37045a76-b9b1-4156-b15f-85c62a8616c3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/37045a76-b9b1-4156-b15f-85c62a8616c3', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'adee82974e9f41769efcb3f4a0eef199', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '37045a76-b9b1-4156-b15f-85c62a8616c3', 'created_at': datetime.datetime(2026, 8, 3, 6, 23, 4, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 3, 6, 23, 6, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/37045a76-b9b1-4156-b15f-85c62a8616c3/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:45:46 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-b86ab9d9-58dd-4bd4-9a61-7c083f2b498b tempest-TestShelveInstance-1134734811 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (05d2248e-7ed7-49d1-9ad3-01175821731b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:45:46 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-b86ab9d9-58dd-4bd4-9a61-7c083f2b498b tempest-TestShelveInstance-1134734811 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (05d2248e-7ed7-49d1-9ad3-01175821731b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:45:46 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-b86ab9d9-58dd-4bd4-9a61-7c083f2b498b tempest-TestShelveInstance-1134734811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33cc355c-94fc-464c-a1b5-b3a9cc6342ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:45:46 devstack cinder-volume[88899]: INFO cinder.volume.flows.manager.create_volume [None req-b86ab9d9-58dd-4bd4-9a61-7c083f2b498b tempest-TestShelveInstance-1134734811 None] Volume 5dd62159-5525-4bf9-8830-803d9e606d29: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-5dd62159-5525-4bf9-8830-803d9e606d29', 'volume_size': 1, 'image_id': '37045a76-b9b1-4156-b15f-85c62a8616c3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/37045a76-b9b1-4156-b15f-85c62a8616c3', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'adee82974e9f41769efcb3f4a0eef199', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '37045a76-b9b1-4156-b15f-85c62a8616c3', 'created_at': datetime.datetime(2026, 8, 3, 6, 23, 4, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 3, 6, 23, 6, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/37045a76-b9b1-4156-b15f-85c62a8616c3/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Aug 03 08:45:46 devstack cinder-volume[88899]: DEBUG cinder.volume.flows.manager.create_volume [None req-b86ab9d9-58dd-4bd4-9a61-7c083f2b498b tempest-TestShelveInstance-1134734811 None] Trying to clone 5dd62159-5525-4bf9-8830-803d9e606d29 from image 37045a76-b9b1-4156-b15f-85c62a8616c3 at location (None, [{'url': 'file:///opt/stack/data/glance/images/37045a76-b9b1-4156-b15f-85c62a8616c3', 'metadata': {}}]). {{(pid=88899) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Aug 03 08:45:46 devstack sudo[106616]: pam_unix(sudo:session): session closed for user root Aug 03 08:45:46 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-efb980b9-5946-4511-8dd7-76e06fa00e13 tempest-VolumeDependencyTests-1073688899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-f6fae8bb-ee2d-4ffd-aa4b-04a7aa4631e1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-f6fae8bb-ee2d-4ffd-aa4b-04a7aa4631e1.c17f8863-d791-494f-9c20-db2fb701440d 1G" returned: 0 in 0.549s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:45:46 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-efb980b9-5946-4511-8dd7-76e06fa00e13 tempest-VolumeDependencyTests-1073688899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f6fae8bb-ee2d-4ffd-aa4b-04a7aa4631e1 -F qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-f6fae8bb-ee2d-4ffd-aa4b-04a7aa4631e1.c17f8863-d791-494f-9c20-db2fb701440d {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:45:46 devstack sudo[106623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f6fae8bb-ee2d-4ffd-aa4b-04a7aa4631e1 -F qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-f6fae8bb-ee2d-4ffd-aa4b-04a7aa4631e1.c17f8863-d791-494f-9c20-db2fb701440d Aug 03 08:45:46 devstack sudo[106623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:45:46 devstack cinder-volume[88899]: DEBUG cinder.image.image_utils [None req-b86ab9d9-58dd-4bd4-9a61-7c083f2b498b tempest-TestShelveInstance-1134734811 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_37045a76-b9b1-4156-b15f-85c62a8616c3_whm66j_edevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=88899) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Aug 03 08:45:46 devstack cinder-volume[88899]: INFO cinder.image.image_utils [None req-b86ab9d9-58dd-4bd4-9a61-7c083f2b498b tempest-TestShelveInstance-1134734811 None] Image download 20.69 MB at 20.69 MB/s Aug 03 08:45:46 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[829b7e9d-ec8b-405d-bdba-dbeee635d231]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:45:46 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-b86ab9d9-58dd-4bd4-9a61-7c083f2b498b tempest-TestShelveInstance-1134734811 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_37045a76-b9b1-4156-b15f-85c62a8616c3_whm66j_edevstack@QuobyteHD {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:45:46 devstack sudo[106625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_37045a76-b9b1-4156-b15f-85c62a8616c3_whm66j_edevstack@QuobyteHD Aug 03 08:45:46 devstack sudo[106625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:45:46 devstack sudo[106623]: pam_unix(sudo:session): session closed for user root Aug 03 08:45:46 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-efb980b9-5946-4511-8dd7-76e06fa00e13 tempest-VolumeDependencyTests-1073688899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f6fae8bb-ee2d-4ffd-aa4b-04a7aa4631e1 -F qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-f6fae8bb-ee2d-4ffd-aa4b-04a7aa4631e1.c17f8863-d791-494f-9c20-db2fb701440d" returned: 0 in 0.312s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:45:46 devstack cinder-volume[88899]: WARNING cinder.volume.drivers.remotefs [None req-efb980b9-5946-4511-8dd7-76e06fa00e13 tempest-VolumeDependencyTests-1073688899 None] /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-f6fae8bb-ee2d-4ffd-aa4b-04a7aa4631e1.c17f8863-d791-494f-9c20-db2fb701440d is being set with open permissions: ugo+rw Aug 03 08:45:46 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-efb980b9-5946-4511-8dd7-76e06fa00e13 tempest-VolumeDependencyTests-1073688899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-f6fae8bb-ee2d-4ffd-aa4b-04a7aa4631e1.c17f8863-d791-494f-9c20-db2fb701440d {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:45:46 devstack sudo[106631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-f6fae8bb-ee2d-4ffd-aa4b-04a7aa4631e1.c17f8863-d791-494f-9c20-db2fb701440d Aug 03 08:45:46 devstack sudo[106631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:45:46 devstack sudo[106625]: pam_unix(sudo:session): session closed for user root Aug 03 08:45:46 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-b86ab9d9-58dd-4bd4-9a61-7c083f2b498b tempest-TestShelveInstance-1134734811 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_37045a76-b9b1-4156-b15f-85c62a8616c3_whm66j_edevstack@QuobyteHD" returned: 0 in 0.349s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:45:46 devstack cinder-volume[88899]: DEBUG cinder.image.image_utils [None req-b86ab9d9-58dd-4bd4-9a61-7c083f2b498b tempest-TestShelveInstance-1134734811 None] Temporary image 37045a76-b9b1-4156-b15f-85c62a8616c3 is fetched for user e489bd31863844ec8452b95ea407f594. {{(pid=88899) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Aug 03 08:45:46 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[adba62d8-4913-4a73-9245-d53ad086eda1]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:45:46 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-b86ab9d9-58dd-4bd4-9a61-7c083f2b498b tempest-TestShelveInstance-1134734811 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_37045a76-b9b1-4156-b15f-85c62a8616c3_whm66j_edevstack@QuobyteHD {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:45:46 devstack sudo[106631]: pam_unix(sudo:session): session closed for user root Aug 03 08:45:46 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-efb980b9-5946-4511-8dd7-76e06fa00e13 tempest-VolumeDependencyTests-1073688899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-f6fae8bb-ee2d-4ffd-aa4b-04a7aa4631e1.c17f8863-d791-494f-9c20-db2fb701440d" returned: 0 in 0.251s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:45:47 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-efb980b9-5946-4511-8dd7-76e06fa00e13 tempest-VolumeDependencyTests-1073688899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-f6fae8bb-ee2d-4ffd-aa4b-04a7aa4631e1.info {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:45:47 devstack sudo[106638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-f6fae8bb-ee2d-4ffd-aa4b-04a7aa4631e1.info Aug 03 08:45:47 devstack sudo[106638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:45:47 devstack sudo[106636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_37045a76-b9b1-4156-b15f-85c62a8616c3_whm66j_edevstack@QuobyteHD Aug 03 08:45:47 devstack sudo[106636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:45:47 devstack sudo[106638]: pam_unix(sudo:session): session closed for user root Aug 03 08:45:47 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-efb980b9-5946-4511-8dd7-76e06fa00e13 tempest-VolumeDependencyTests-1073688899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-f6fae8bb-ee2d-4ffd-aa4b-04a7aa4631e1.info" returned: 0 in 0.258s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:45:47 devstack cinder-volume[88899]: WARNING cinder.volume.drivers.remotefs [None req-efb980b9-5946-4511-8dd7-76e06fa00e13 tempest-VolumeDependencyTests-1073688899 None] /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-f6fae8bb-ee2d-4ffd-aa4b-04a7aa4631e1.info is being set with open permissions: ugo+rw Aug 03 08:45:47 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-efb980b9-5946-4511-8dd7-76e06fa00e13 tempest-VolumeDependencyTests-1073688899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-f6fae8bb-ee2d-4ffd-aa4b-04a7aa4631e1.info {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:45:47 devstack sudo[106636]: pam_unix(sudo:session): session closed for user root Aug 03 08:45:47 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-b86ab9d9-58dd-4bd4-9a61-7c083f2b498b tempest-TestShelveInstance-1134734811 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_37045a76-b9b1-4156-b15f-85c62a8616c3_whm66j_edevstack@QuobyteHD" returned: 0 in 0.358s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:45:47 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-b86ab9d9-58dd-4bd4-9a61-7c083f2b498b tempest-TestShelveInstance-1134734811 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:45:47 devstack sudo[106645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-f6fae8bb-ee2d-4ffd-aa4b-04a7aa4631e1.info Aug 03 08:45:47 devstack sudo[106645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:45:47 devstack sudo[106645]: pam_unix(sudo:session): session closed for user root Aug 03 08:45:47 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-efb980b9-5946-4511-8dd7-76e06fa00e13 tempest-VolumeDependencyTests-1073688899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-f6fae8bb-ee2d-4ffd-aa4b-04a7aa4631e1.info" returned: 0 in 0.254s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:45:47 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-efb980b9-5946-4511-8dd7-76e06fa00e13 tempest-VolumeDependencyTests-1073688899 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.156s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:45:47 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-b86ab9d9-58dd-4bd4-9a61-7c083f2b498b tempest-TestShelveInstance-1134734811 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.264s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:45:47 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-b86ab9d9-58dd-4bd4-9a61-7c083f2b498b tempest-TestShelveInstance-1134734811 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:45:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-597969996',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5dd62159-5525-4bf9-8830-803d9e606d29,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2276e962cba74952abf4d8d0d5778635',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:45:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:45:46Z,use_quota=True,user_id='e489bd31863844ec8452b95ea407f594',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8bde7129-1dc4-42ab-b852-ab32c61b4921),volume_type_id=8bde7129-1dc4-42ab-b852-ab32c61b4921)}" {{(pid=88899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 08:45:47 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-b86ab9d9-58dd-4bd4-9a61-7c083f2b498b tempest-TestShelveInstance-1134734811 None] Creating volume 5dd62159-5525-4bf9-8830-803d9e606d29 {{(pid=88899) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 08:45:47 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-b86ab9d9-58dd-4bd4-9a61-7c083f2b498b tempest-TestShelveInstance-1134734811 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:45:47 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-b86ab9d9-58dd-4bd4-9a61-7c083f2b498b tempest-TestShelveInstance-1134734811 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:45:47 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-b86ab9d9-58dd-4bd4-9a61-7c083f2b498b tempest-TestShelveInstance-1134734811 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:45:47 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-b86ab9d9-58dd-4bd4-9a61-7c083f2b498b tempest-TestShelveInstance-1134734811 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:45:47 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-b86ab9d9-58dd-4bd4-9a61-7c083f2b498b tempest-TestShelveInstance-1134734811 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:45:47 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-b86ab9d9-58dd-4bd4-9a61-7c083f2b498b tempest-TestShelveInstance-1134734811 None] Selected osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385 as target Quobyte volume. {{(pid=88899) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 08:45:47 devstack cinder-volume[88899]: INFO cinder.volume.drivers.remotefs [None req-b86ab9d9-58dd-4bd4-9a61-7c083f2b498b tempest-TestShelveInstance-1134734811 None] casted to osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385 Aug 03 08:45:47 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-b86ab9d9-58dd-4bd4-9a61-7c083f2b498b tempest-TestShelveInstance-1134734811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-5dd62159-5525-4bf9-8830-803d9e606d29 1073741824 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:45:47 devstack sudo[106648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-5dd62159-5525-4bf9-8830-803d9e606d29 1073741824 Aug 03 08:45:47 devstack sudo[106648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:45:47 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-efb980b9-5946-4511-8dd7-76e06fa00e13 tempest-VolumeDependencyTests-1073688899 None] Create snapshot completed successfully Aug 03 08:45:47 devstack cinder-volume[88899]: DEBUG cinder.volume.flows.manager.create_volume [None req-aa6c0529-fb5f-42ad-a2ed-4667d46dd5bb tempest-ProjectReaderTests-2034209105 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88899) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 08:45:48 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-aa6c0529-fb5f-42ad-a2ed-4667d46dd5bb tempest-ProjectReaderTests-2034209105 None] Flow 'volume_create_manager' (325d0fb7-be20-469e-839b-8eb51f8b7fbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:45:48 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-aa6c0529-fb5f-42ad-a2ed-4667d46dd5bb tempest-ProjectReaderTests-2034209105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b0d84adc-02ce-4715-aad3-022c5bb1e747) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:45:48 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-aa6c0529-fb5f-42ad-a2ed-4667d46dd5bb tempest-ProjectReaderTests-2034209105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b0d84adc-02ce-4715-aad3-022c5bb1e747) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:45:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1250658179',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5b1985ad-1d9d-4c61-b78a-84e081f254d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='60b0e0bae6734bc7b4895d6c2ea550de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:45:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:45:48Z,use_quota=True,user_id='5291713768084f098e5d7f65813dad8e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8bde7129-1dc4-42ab-b852-ab32c61b4921),volume_type_id=8bde7129-1dc4-42ab-b852-ab32c61b4921)' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:45:48 devstack sudo[106648]: pam_unix(sudo:session): session closed for user root Aug 03 08:45:48 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-aa6c0529-fb5f-42ad-a2ed-4667d46dd5bb tempest-ProjectReaderTests-2034209105 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91c15909-17f9-4b75-bc2a-428d55df95ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:45:48 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-aa6c0529-fb5f-42ad-a2ed-4667d46dd5bb tempest-ProjectReaderTests-2034209105 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91c15909-17f9-4b75-bc2a-428d55df95ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:45:48 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-aa6c0529-fb5f-42ad-a2ed-4667d46dd5bb tempest-ProjectReaderTests-2034209105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (594a41de-c7af-4cee-877d-c4f570e36b46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:45:48 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-aa6c0529-fb5f-42ad-a2ed-4667d46dd5bb tempest-ProjectReaderTests-2034209105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (594a41de-c7af-4cee-877d-c4f570e36b46) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5b1985ad-1d9d-4c61-b78a-84e081f254d7', 'volume_name': 'volume-5b1985ad-1d9d-4c61-b78a-84e081f254d7', 'volume_size': 1}' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:45:48 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-aa6c0529-fb5f-42ad-a2ed-4667d46dd5bb tempest-ProjectReaderTests-2034209105 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8cef2ba-3449-41b4-8bd6-38cedfc2c860) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:45:48 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-aa6c0529-fb5f-42ad-a2ed-4667d46dd5bb tempest-ProjectReaderTests-2034209105 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8cef2ba-3449-41b4-8bd6-38cedfc2c860) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:45:48 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-aa6c0529-fb5f-42ad-a2ed-4667d46dd5bb tempest-ProjectReaderTests-2034209105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87b795ed-4641-45e1-9084-4fc025476fe5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:45:48 devstack cinder-volume[88899]: INFO cinder.volume.flows.manager.create_volume [None req-aa6c0529-fb5f-42ad-a2ed-4667d46dd5bb tempest-ProjectReaderTests-2034209105 None] Volume 5b1985ad-1d9d-4c61-b78a-84e081f254d7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5b1985ad-1d9d-4c61-b78a-84e081f254d7', 'volume_size': 1} Aug 03 08:45:48 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-aa6c0529-fb5f-42ad-a2ed-4667d46dd5bb tempest-ProjectReaderTests-2034209105 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:45:48 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-b86ab9d9-58dd-4bd4-9a61-7c083f2b498b tempest-TestShelveInstance-1134734811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-5dd62159-5525-4bf9-8830-803d9e606d29 1073741824" returned: 0 in 0.512s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:45:48 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-b86ab9d9-58dd-4bd4-9a61-7c083f2b498b tempest-TestShelveInstance-1134734811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-5dd62159-5525-4bf9-8830-803d9e606d29 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:45:48 devstack sudo[106655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-5dd62159-5525-4bf9-8830-803d9e606d29 Aug 03 08:45:48 devstack sudo[106655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:45:48 devstack sudo[106655]: pam_unix(sudo:session): session closed for user root Aug 03 08:45:48 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-b86ab9d9-58dd-4bd4-9a61-7c083f2b498b tempest-TestShelveInstance-1134734811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-5dd62159-5525-4bf9-8830-803d9e606d29" returned: 0 in 0.234s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:45:48 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-b86ab9d9-58dd-4bd4-9a61-7c083f2b498b tempest-TestShelveInstance-1134734811 None] <== create_volume: return (798ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'} {{(pid=88899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 08:45:48 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-b86ab9d9-58dd-4bd4-9a61-7c083f2b498b tempest-TestShelveInstance-1134734811 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.803s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:45:48 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-aa6c0529-fb5f-42ad-a2ed-4667d46dd5bb tempest-ProjectReaderTests-2034209105 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.282s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:45:48 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-aa6c0529-fb5f-42ad-a2ed-4667d46dd5bb tempest-ProjectReaderTests-2034209105 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:45:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1250658179',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5b1985ad-1d9d-4c61-b78a-84e081f254d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='60b0e0bae6734bc7b4895d6c2ea550de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:45:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:45:48Z,use_quota=True,user_id='5291713768084f098e5d7f65813dad8e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8bde7129-1dc4-42ab-b852-ab32c61b4921),volume_type_id=8bde7129-1dc4-42ab-b852-ab32c61b4921)}" {{(pid=88899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 08:45:48 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-aa6c0529-fb5f-42ad-a2ed-4667d46dd5bb tempest-ProjectReaderTests-2034209105 None] Creating volume 5b1985ad-1d9d-4c61-b78a-84e081f254d7 {{(pid=88899) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 08:45:48 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-aa6c0529-fb5f-42ad-a2ed-4667d46dd5bb tempest-ProjectReaderTests-2034209105 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:45:48 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-aa6c0529-fb5f-42ad-a2ed-4667d46dd5bb tempest-ProjectReaderTests-2034209105 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:45:48 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-aa6c0529-fb5f-42ad-a2ed-4667d46dd5bb tempest-ProjectReaderTests-2034209105 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:45:48 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-aa6c0529-fb5f-42ad-a2ed-4667d46dd5bb tempest-ProjectReaderTests-2034209105 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:45:48 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-aa6c0529-fb5f-42ad-a2ed-4667d46dd5bb tempest-ProjectReaderTests-2034209105 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:45:48 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-aa6c0529-fb5f-42ad-a2ed-4667d46dd5bb tempest-ProjectReaderTests-2034209105 None] Selected osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385 as target Quobyte volume. {{(pid=88899) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 08:45:48 devstack cinder-volume[88899]: INFO cinder.volume.drivers.remotefs [None req-aa6c0529-fb5f-42ad-a2ed-4667d46dd5bb tempest-ProjectReaderTests-2034209105 None] casted to osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385 Aug 03 08:45:48 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-aa6c0529-fb5f-42ad-a2ed-4667d46dd5bb tempest-ProjectReaderTests-2034209105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-5b1985ad-1d9d-4c61-b78a-84e081f254d7 1073741824 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:45:48 devstack sudo[106659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-5b1985ad-1d9d-4c61-b78a-84e081f254d7 1073741824 Aug 03 08:45:48 devstack sudo[106659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:45:48 devstack cinder-volume[88899]: DEBUG cinder.volume.volume_utils [None req-b86ab9d9-58dd-4bd4-9a61-7c083f2b498b tempest-TestShelveInstance-1134734811 None] Attempting download of 37045a76-b9b1-4156-b15f-85c62a8616c3 ((None, [{'url': 'file:///opt/stack/data/glance/images/37045a76-b9b1-4156-b15f-85c62a8616c3', 'metadata': {}}])) to volume 5dd62159-5525-4bf9-8830-803d9e606d29. {{(pid=88899) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Aug 03 08:45:48 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b3a54c9-be3d-40f3-a1b4-d773f8c560fe]: (4, 'raw') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:45:48 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-b86ab9d9-58dd-4bd4-9a61-7c083f2b498b tempest-TestShelveInstance-1134734811 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_37045a76-b9b1-4156-b15f-85c62a8616c3_0p2m_7da {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:45:48 devstack sudo[106661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_37045a76-b9b1-4156-b15f-85c62a8616c3_0p2m_7da Aug 03 08:45:48 devstack sudo[106661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:45:48 devstack sudo[106661]: pam_unix(sudo:session): session closed for user root Aug 03 08:45:48 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-b86ab9d9-58dd-4bd4-9a61-7c083f2b498b tempest-TestShelveInstance-1134734811 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_37045a76-b9b1-4156-b15f-85c62a8616c3_0p2m_7da" returned: 0 in 0.352s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:45:48 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-b86ab9d9-58dd-4bd4-9a61-7c083f2b498b tempest-TestShelveInstance-1134734811 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_37045a76-b9b1-4156-b15f-85c62a8616c3_0p2m_7da {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:45:48 devstack sudo[106659]: pam_unix(sudo:session): session closed for user root Aug 03 08:45:48 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-aa6c0529-fb5f-42ad-a2ed-4667d46dd5bb tempest-ProjectReaderTests-2034209105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-5b1985ad-1d9d-4c61-b78a-84e081f254d7 1073741824" returned: 0 in 0.496s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:45:48 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-aa6c0529-fb5f-42ad-a2ed-4667d46dd5bb tempest-ProjectReaderTests-2034209105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-5b1985ad-1d9d-4c61-b78a-84e081f254d7 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:45:48 devstack sudo[106669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_37045a76-b9b1-4156-b15f-85c62a8616c3_0p2m_7da Aug 03 08:45:48 devstack sudo[106669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:45:48 devstack sudo[106671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-5b1985ad-1d9d-4c61-b78a-84e081f254d7 Aug 03 08:45:48 devstack sudo[106671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:45:49 devstack cinder-volume[88899]: DEBUG cinder.volume.flows.manager.create_volume [None req-1aa166de-0d58-48a4-b3e7-7c8a2bd3be5c tempest-VolumeDependencyTests-1073688899 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88899) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 08:45:49 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-1aa166de-0d58-48a4-b3e7-7c8a2bd3be5c tempest-VolumeDependencyTests-1073688899 None] Flow 'volume_create_manager' (e0db25e1-e7c5-4682-bf8e-46dcb52a52ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:45:49 devstack sudo[106669]: pam_unix(sudo:session): session closed for user root Aug 03 08:45:49 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-1aa166de-0d58-48a4-b3e7-7c8a2bd3be5c tempest-VolumeDependencyTests-1073688899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b15536e9-7ba5-436f-b324-b3e2825ef847) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:45:49 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-b86ab9d9-58dd-4bd4-9a61-7c083f2b498b tempest-TestShelveInstance-1134734811 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_37045a76-b9b1-4156-b15f-85c62a8616c3_0p2m_7da" returned: 1 in 0.383s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:45:49 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-b86ab9d9-58dd-4bd4-9a61-7c083f2b498b tempest-TestShelveInstance-1134734811 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_37045a76-b9b1-4156-b15f-85c62a8616c3_0p2m_7da' failed. Not Retrying. {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 03 08:45:49 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[c367b205-b7dd-4d40-9c29-790a67f2567b]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:45:49 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-b86ab9d9-58dd-4bd4-9a61-7c083f2b498b tempest-TestShelveInstance-1134734811 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_37045a76-b9b1-4156-b15f-85c62a8616c3_whm66j_edevstack@QuobyteHD {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:45:49 devstack sudo[106671]: pam_unix(sudo:session): session closed for user root Aug 03 08:45:49 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-1aa166de-0d58-48a4-b3e7-7c8a2bd3be5c tempest-VolumeDependencyTests-1073688899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b15536e9-7ba5-436f-b324-b3e2825ef847) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:45:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-302857053',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b993036e-7726-48b6-b4e9-2ab7325b2d63,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c2f62930ea114d94aae304e8ed339f9c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:45:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=c17f8863-d791-494f-9c20-db2fb701440d,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:45:49Z,use_quota=True,user_id='de61709cf33340bf9e956c0545be3966',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8bde7129-1dc4-42ab-b852-ab32c61b4921),volume_type_id=8bde7129-1dc4-42ab-b852-ab32c61b4921)' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:45:49 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-1aa166de-0d58-48a4-b3e7-7c8a2bd3be5c tempest-VolumeDependencyTests-1073688899 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b52d628-c585-41a3-9527-54244c6c725b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:45:49 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-1aa166de-0d58-48a4-b3e7-7c8a2bd3be5c tempest-VolumeDependencyTests-1073688899 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b52d628-c585-41a3-9527-54244c6c725b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:45:49 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-1aa166de-0d58-48a4-b3e7-7c8a2bd3be5c tempest-VolumeDependencyTests-1073688899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7cbfd4a6-a68d-4c3e-b563-431d347ded87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:45:49 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-1aa166de-0d58-48a4-b3e7-7c8a2bd3be5c tempest-VolumeDependencyTests-1073688899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7cbfd4a6-a68d-4c3e-b563-431d347ded87) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'b993036e-7726-48b6-b4e9-2ab7325b2d63', 'volume_name': 'volume-b993036e-7726-48b6-b4e9-2ab7325b2d63', 'volume_size': 1, 'snapshot_id': 'c17f8863-d791-494f-9c20-db2fb701440d'}' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:45:49 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-1aa166de-0d58-48a4-b3e7-7c8a2bd3be5c tempest-VolumeDependencyTests-1073688899 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b1899a9-eba3-4bf2-ae6c-cf7671a40d65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:45:49 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-1aa166de-0d58-48a4-b3e7-7c8a2bd3be5c tempest-VolumeDependencyTests-1073688899 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b1899a9-eba3-4bf2-ae6c-cf7671a40d65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:45:49 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-1aa166de-0d58-48a4-b3e7-7c8a2bd3be5c tempest-VolumeDependencyTests-1073688899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd5f6858-ab27-49a4-b9a2-5cb647001a4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:45:49 devstack cinder-volume[88899]: INFO cinder.volume.flows.manager.create_volume [None req-1aa166de-0d58-48a4-b3e7-7c8a2bd3be5c tempest-VolumeDependencyTests-1073688899 None] Volume b993036e-7726-48b6-b4e9-2ab7325b2d63: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-b993036e-7726-48b6-b4e9-2ab7325b2d63', 'volume_size': 1, 'snapshot_id': 'c17f8863-d791-494f-9c20-db2fb701440d'} Aug 03 08:45:49 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-aa6c0529-fb5f-42ad-a2ed-4667d46dd5bb tempest-ProjectReaderTests-2034209105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-5b1985ad-1d9d-4c61-b78a-84e081f254d7" returned: 0 in 0.343s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:45:49 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-aa6c0529-fb5f-42ad-a2ed-4667d46dd5bb tempest-ProjectReaderTests-2034209105 None] <== create_volume: return (893ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'} {{(pid=88899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 08:45:49 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-aa6c0529-fb5f-42ad-a2ed-4667d46dd5bb tempest-ProjectReaderTests-2034209105 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.895s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:45:49 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-1aa166de-0d58-48a4-b3e7-7c8a2bd3be5c tempest-VolumeDependencyTests-1073688899 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:45:49 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-1aa166de-0d58-48a4-b3e7-7c8a2bd3be5c tempest-VolumeDependencyTests-1073688899 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:45:49 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-1aa166de-0d58-48a4-b3e7-7c8a2bd3be5c tempest-VolumeDependencyTests-1073688899 None] Acquiring lock "cinder-quobyte-c17f8863-d791-494f-9c20-db2fb701440d-b993036e-7726-48b6-b4e9-2ab7325b2d63" by "_create_volume_from_snapshot" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:45:49 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-aa6c0529-fb5f-42ad-a2ed-4667d46dd5bb tempest-ProjectReaderTests-2034209105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87b795ed-4641-45e1-9084-4fc025476fe5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5b1985ad-1d9d-4c61-b78a-84e081f254d7', 'volume_size': 1}' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:45:49 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-aa6c0529-fb5f-42ad-a2ed-4667d46dd5bb tempest-ProjectReaderTests-2034209105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d3b2704-e5d3-4977-b569-88371b3bd5da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:45:49 devstack cinder-volume[88899]: INFO cinder.volume.flows.manager.create_volume [None req-aa6c0529-fb5f-42ad-a2ed-4667d46dd5bb tempest-ProjectReaderTests-2034209105 None] Volume volume-5b1985ad-1d9d-4c61-b78a-84e081f254d7 (5b1985ad-1d9d-4c61-b78a-84e081f254d7): created successfully Aug 03 08:45:49 devstack sudo[106676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_37045a76-b9b1-4156-b15f-85c62a8616c3_whm66j_edevstack@QuobyteHD Aug 03 08:45:49 devstack sudo[106676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:45:49 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-aa6c0529-fb5f-42ad-a2ed-4667d46dd5bb tempest-ProjectReaderTests-2034209105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d3b2704-e5d3-4977-b569-88371b3bd5da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:45:49 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-aa6c0529-fb5f-42ad-a2ed-4667d46dd5bb tempest-ProjectReaderTests-2034209105 None] Flow 'volume_create_manager' (325d0fb7-be20-469e-839b-8eb51f8b7fbd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:45:49 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-1aa166de-0d58-48a4-b3e7-7c8a2bd3be5c tempest-VolumeDependencyTests-1073688899 None] Lock "cinder-quobyte-c17f8863-d791-494f-9c20-db2fb701440d-b993036e-7726-48b6-b4e9-2ab7325b2d63" acquired by "_create_volume_from_snapshot" :: waited 0.045s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:45:49 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-1aa166de-0d58-48a4-b3e7-7c8a2bd3be5c tempest-VolumeDependencyTests-1073688899 None] Creating volume b993036e-7726-48b6-b4e9-2ab7325b2d63 from snapshot c17f8863-d791-494f-9c20-db2fb701440d {{(pid=88899) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Aug 03 08:45:49 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-1aa166de-0d58-48a4-b3e7-7c8a2bd3be5c tempest-VolumeDependencyTests-1073688899 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:45:49 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-1aa166de-0d58-48a4-b3e7-7c8a2bd3be5c tempest-VolumeDependencyTests-1073688899 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:45:49 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-1aa166de-0d58-48a4-b3e7-7c8a2bd3be5c tempest-VolumeDependencyTests-1073688899 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:45:49 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-1aa166de-0d58-48a4-b3e7-7c8a2bd3be5c tempest-VolumeDependencyTests-1073688899 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:45:49 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-1aa166de-0d58-48a4-b3e7-7c8a2bd3be5c tempest-VolumeDependencyTests-1073688899 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:45:49 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-1aa166de-0d58-48a4-b3e7-7c8a2bd3be5c tempest-VolumeDependencyTests-1073688899 None] Selected osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385 as target Quobyte volume. {{(pid=88899) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 08:45:49 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-1aa166de-0d58-48a4-b3e7-7c8a2bd3be5c tempest-VolumeDependencyTests-1073688899 None] Acquiring lock "cinder-quobyte-b993036e-7726-48b6-b4e9-2ab7325b2d63" by "_copy_volume_from_snapshot" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:45:49 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-aa6c0529-fb5f-42ad-a2ed-4667d46dd5bb tempest-ProjectReaderTests-2034209105 None] Created volume successfully. Aug 03 08:45:49 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-1aa166de-0d58-48a4-b3e7-7c8a2bd3be5c tempest-VolumeDependencyTests-1073688899 None] Lock "cinder-quobyte-b993036e-7726-48b6-b4e9-2ab7325b2d63" acquired by "_copy_volume_from_snapshot" :: waited 0.017s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:45:49 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-1aa166de-0d58-48a4-b3e7-7c8a2bd3be5c tempest-VolumeDependencyTests-1073688899 None] snapshot: c17f8863-d791-494f-9c20-db2fb701440d, volume: b993036e-7726-48b6-b4e9-2ab7325b2d63, {{(pid=88899) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Aug 03 08:45:49 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-1aa166de-0d58-48a4-b3e7-7c8a2bd3be5c tempest-VolumeDependencyTests-1073688899 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:45:49 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-1aa166de-0d58-48a4-b3e7-7c8a2bd3be5c tempest-VolumeDependencyTests-1073688899 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:45:49 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-1aa166de-0d58-48a4-b3e7-7c8a2bd3be5c tempest-VolumeDependencyTests-1073688899 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:45:49 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-1aa166de-0d58-48a4-b3e7-7c8a2bd3be5c tempest-VolumeDependencyTests-1073688899 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:45:49 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-1aa166de-0d58-48a4-b3e7-7c8a2bd3be5c tempest-VolumeDependencyTests-1073688899 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:45:49 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[bba58702-d3c9-4181-8212-f5db3f404aca]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:45:49 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-1aa166de-0d58-48a4-b3e7-7c8a2bd3be5c tempest-VolumeDependencyTests-1073688899 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-f6fae8bb-ee2d-4ffd-aa4b-04a7aa4631e1.c17f8863-d791-494f-9c20-db2fb701440d {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:45:49 devstack sudo[106678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-f6fae8bb-ee2d-4ffd-aa4b-04a7aa4631e1.c17f8863-d791-494f-9c20-db2fb701440d Aug 03 08:45:49 devstack sudo[106678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:45:49 devstack sudo[106676]: pam_unix(sudo:session): session closed for user root Aug 03 08:45:49 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-b86ab9d9-58dd-4bd4-9a61-7c083f2b498b tempest-TestShelveInstance-1134734811 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_37045a76-b9b1-4156-b15f-85c62a8616c3_whm66j_edevstack@QuobyteHD" returned: 0 in 0.330s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:45:49 devstack cinder-volume[88899]: DEBUG cinder.image.image_utils [None req-b86ab9d9-58dd-4bd4-9a61-7c083f2b498b tempest-TestShelveInstance-1134734811 None] 37045a76-b9b1-4156-b15f-85c62a8616c3 was qcow2, converting to qcow2 {{(pid=88899) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Aug 03 08:45:49 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-b86ab9d9-58dd-4bd4-9a61-7c083f2b498b tempest-TestShelveInstance-1134734811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_37045a76-b9b1-4156-b15f-85c62a8616c3_whm66j_edevstack@QuobyteHD /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-5dd62159-5525-4bf9-8830-803d9e606d29 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:45:49 devstack sudo[106683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_37045a76-b9b1-4156-b15f-85c62a8616c3_whm66j_edevstack@QuobyteHD /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-5dd62159-5525-4bf9-8830-803d9e606d29 Aug 03 08:45:49 devstack sudo[106683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:45:49 devstack sudo[106678]: pam_unix(sudo:session): session closed for user root Aug 03 08:45:49 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-1aa166de-0d58-48a4-b3e7-7c8a2bd3be5c tempest-VolumeDependencyTests-1073688899 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-f6fae8bb-ee2d-4ffd-aa4b-04a7aa4631e1.c17f8863-d791-494f-9c20-db2fb701440d" returned: 0 in 0.353s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:45:49 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-1aa166de-0d58-48a4-b3e7-7c8a2bd3be5c tempest-VolumeDependencyTests-1073688899 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f6fae8bb-ee2d-4ffd-aa4b-04a7aa4631e1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88899) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 03 08:45:49 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fe258a9-1c06-43b1-b9d0-f2a1924da5f5]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:45:49 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-1aa166de-0d58-48a4-b3e7-7c8a2bd3be5c tempest-VolumeDependencyTests-1073688899 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-f6fae8bb-ee2d-4ffd-aa4b-04a7aa4631e1 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:45:49 devstack sudo[106691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-f6fae8bb-ee2d-4ffd-aa4b-04a7aa4631e1 Aug 03 08:45:49 devstack sudo[106691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:45:50 devstack sudo[106691]: pam_unix(sudo:session): session closed for user root Aug 03 08:45:50 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-1aa166de-0d58-48a4-b3e7-7c8a2bd3be5c tempest-VolumeDependencyTests-1073688899 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-f6fae8bb-ee2d-4ffd-aa4b-04a7aa4631e1" returned: 0 in 0.378s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:45:50 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-1aa166de-0d58-48a4-b3e7-7c8a2bd3be5c tempest-VolumeDependencyTests-1073688899 None] will copy from snapshot at /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-f6fae8bb-ee2d-4ffd-aa4b-04a7aa4631e1 {{(pid=88899) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Aug 03 08:45:50 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-1aa166de-0d58-48a4-b3e7-7c8a2bd3be5c tempest-VolumeDependencyTests-1073688899 None] Creating direct copy from snapshot {{(pid=88899) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Aug 03 08:45:50 devstack cinder-volume[88899]: DEBUG cinder.utils [None req-1aa166de-0d58-48a4-b3e7-7c8a2bd3be5c tempest-VolumeDependencyTests-1073688899 None] Path /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-b993036e-7726-48b6-b4e9-2ab7325b2d63 not found in is_blk_device check {{(pid=88899) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Aug 03 08:45:50 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-1aa166de-0d58-48a4-b3e7-7c8a2bd3be5c tempest-VolumeDependencyTests-1073688899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-f6fae8bb-ee2d-4ffd-aa4b-04a7aa4631e1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-b993036e-7726-48b6-b4e9-2ab7325b2d63 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:45:50 devstack sudo[106700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-f6fae8bb-ee2d-4ffd-aa4b-04a7aa4631e1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-b993036e-7726-48b6-b4e9-2ab7325b2d63 Aug 03 08:45:50 devstack sudo[106700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:45:50 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-96c7273b-e394-458d-b5f2-6fd47c857594 tempest-ProjectReaderTests-2034209105 None] Acquiring lock "cinder-5b1985ad-1d9d-4c61-b78a-84e081f254d7-delete_volume" by "delete_volume" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:45:50 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-96c7273b-e394-458d-b5f2-6fd47c857594 tempest-ProjectReaderTests-2034209105 None] Lock "cinder-5b1985ad-1d9d-4c61-b78a-84e081f254d7-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:45:50 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-96c7273b-e394-458d-b5f2-6fd47c857594 tempest-ProjectReaderTests-2034209105 None] Acquiring lock "cinder-quobyte-5b1985ad-1d9d-4c61-b78a-84e081f254d7" by "delete_volume" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:45:50 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-96c7273b-e394-458d-b5f2-6fd47c857594 tempest-ProjectReaderTests-2034209105 None] Lock "cinder-quobyte-5b1985ad-1d9d-4c61-b78a-84e081f254d7" acquired by "delete_volume" :: waited 0.025s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:45:50 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee78023f-5de5-4524-8d9f-ddfada1df5c1]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:45:50 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-96c7273b-e394-458d-b5f2-6fd47c857594 tempest-ProjectReaderTests-2034209105 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-5b1985ad-1d9d-4c61-b78a-84e081f254d7 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:45:50 devstack sudo[106704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-5b1985ad-1d9d-4c61-b78a-84e081f254d7 Aug 03 08:45:50 devstack sudo[106704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:45:50 devstack sudo[106704]: pam_unix(sudo:session): session closed for user root Aug 03 08:45:50 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-96c7273b-e394-458d-b5f2-6fd47c857594 tempest-ProjectReaderTests-2034209105 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-5b1985ad-1d9d-4c61-b78a-84e081f254d7" returned: 0 in 0.502s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:45:50 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-96c7273b-e394-458d-b5f2-6fd47c857594 tempest-ProjectReaderTests-2034209105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-5b1985ad-1d9d-4c61-b78a-84e081f254d7 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:45:50 devstack sudo[106717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-5b1985ad-1d9d-4c61-b78a-84e081f254d7 Aug 03 08:45:50 devstack sudo[106717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:45:51 devstack sudo[106717]: pam_unix(sudo:session): session closed for user root Aug 03 08:45:51 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-96c7273b-e394-458d-b5f2-6fd47c857594 tempest-ProjectReaderTests-2034209105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-5b1985ad-1d9d-4c61-b78a-84e081f254d7" returned: 0 in 0.554s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:45:51 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-96c7273b-e394-458d-b5f2-6fd47c857594 tempest-ProjectReaderTests-2034209105 None] Lock "cinder-quobyte-5b1985ad-1d9d-4c61-b78a-84e081f254d7" released by "delete_volume" :: held 1.137s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:45:51 devstack cinder-volume[88899]: DEBUG cinder.quota [None req-96c7273b-e394-458d-b5f2-6fd47c857594 tempest-ProjectReaderTests-2034209105 None] Created reservations ['d05b8a4b-13f2-4c52-9a31-0263c207048c', '79085ffd-73f0-4aa0-a11a-dcde8c9440bd', '1af282eb-200c-4296-98f1-0fd635227d1a', 'cbce936f-003d-4470-8fed-06c6af6a456f'] {{(pid=88899) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 08:45:51 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-96c7273b-e394-458d-b5f2-6fd47c857594 tempest-ProjectReaderTests-2034209105 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:45:51 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-96c7273b-e394-458d-b5f2-6fd47c857594 tempest-ProjectReaderTests-2034209105 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:45:51 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-96c7273b-e394-458d-b5f2-6fd47c857594 tempest-ProjectReaderTests-2034209105 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:45:51 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-96c7273b-e394-458d-b5f2-6fd47c857594 tempest-ProjectReaderTests-2034209105 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:45:51 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-96c7273b-e394-458d-b5f2-6fd47c857594 tempest-ProjectReaderTests-2034209105 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:45:51 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-96c7273b-e394-458d-b5f2-6fd47c857594 tempest-ProjectReaderTests-2034209105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:45:51 devstack cinder-volume[88899]: DEBUG oslo_service.periodic_task [None req-f948fb4a-c4d7-499f-b1bd-8d6be3de0b53 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88899) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 03 08:45:51 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-f948fb4a-c4d7-499f-b1bd-8d6be3de0b53 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:45:51 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-f948fb4a-c4d7-499f-b1bd-8d6be3de0b53 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:45:51 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-f948fb4a-c4d7-499f-b1bd-8d6be3de0b53 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:45:51 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-f948fb4a-c4d7-499f-b1bd-8d6be3de0b53 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:45:51 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-f948fb4a-c4d7-499f-b1bd-8d6be3de0b53 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:45:51 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-f948fb4a-c4d7-499f-b1bd-8d6be3de0b53 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:45:51 devstack sudo[106721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a Aug 03 08:45:51 devstack sudo[106721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:45:52 devstack sudo[106723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a Aug 03 08:45:52 devstack sudo[106723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:45:52 devstack sudo[106683]: pam_unix(sudo:session): session closed for user root Aug 03 08:45:52 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-b86ab9d9-58dd-4bd4-9a61-7c083f2b498b tempest-TestShelveInstance-1134734811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_37045a76-b9b1-4156-b15f-85c62a8616c3_whm66j_edevstack@QuobyteHD /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-5dd62159-5525-4bf9-8830-803d9e606d29" returned: 0 in 2.587s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:45:52 devstack cinder-volume[88899]: DEBUG cinder.image.image_utils [None req-b86ab9d9-58dd-4bd4-9a61-7c083f2b498b tempest-TestShelveInstance-1134734811 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_37045a76-b9b1-4156-b15f-85c62a8616c3_whm66j_edevstack@QuobyteHD, size 112.00 MB, duration 2.59 sec, destination /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-5dd62159-5525-4bf9-8830-803d9e606d29 {{(pid=88899) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 03 08:45:52 devstack cinder-volume[88899]: INFO cinder.image.image_utils [None req-b86ab9d9-58dd-4bd4-9a61-7c083f2b498b tempest-TestShelveInstance-1134734811 None] Converted 112.00 MB image at 43.25 MB/s Aug 03 08:45:52 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-b86ab9d9-58dd-4bd4-9a61-7c083f2b498b tempest-TestShelveInstance-1134734811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-5dd62159-5525-4bf9-8830-803d9e606d29 1G {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:45:52 devstack sudo[106725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-5dd62159-5525-4bf9-8830-803d9e606d29 1G Aug 03 08:45:52 devstack sudo[106725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:45:52 devstack sudo[106721]: pam_unix(sudo:session): session closed for user root Aug 03 08:45:52 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-96c7273b-e394-458d-b5f2-6fd47c857594 tempest-ProjectReaderTests-2034209105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a" returned: 0 in 0.404s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:45:52 devstack cinder-volume[88899]: DEBUG cinder.manager [None req-96c7273b-e394-458d-b5f2-6fd47c857594 tempest-ProjectReaderTests-2034209105 None] Notifying Schedulers of capabilities ... {{(pid=88899) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 08:45:52 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-96c7273b-e394-458d-b5f2-6fd47c857594 tempest-ProjectReaderTests-2034209105 None] Deleted volume successfully. Aug 03 08:45:52 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-96c7273b-e394-458d-b5f2-6fd47c857594 tempest-ProjectReaderTests-2034209105 None] Lock "cinder-5b1985ad-1d9d-4c61-b78a-84e081f254d7-delete_volume" released by "delete_volume" :: held 2.199s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:45:52 devstack sudo[106723]: pam_unix(sudo:session): session closed for user root Aug 03 08:45:52 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-f948fb4a-c4d7-499f-b1bd-8d6be3de0b53 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a" returned: 0 in 0.666s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:45:52 devstack cinder-volume[88899]: DEBUG cinder.manager [None req-f948fb4a-c4d7-499f-b1bd-8d6be3de0b53 None None] Notifying Schedulers of capabilities ... {{(pid=88899) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 08:45:52 devstack cinder-volume[88899]: DEBUG oslo_service.periodic_task [None req-f948fb4a-c4d7-499f-b1bd-8d6be3de0b53 None None] Running periodic task VolumeManager._thread_info {{(pid=88899) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 03 08:45:52 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-f948fb4a-c4d7-499f-b1bd-8d6be3de0b53 None None] thread count: 29 {{(pid=88899) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 03 08:45:52 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-f948fb4a-c4d7-499f-b1bd-8d6be3de0b53 None None] thread info: [<_MainThread(MainThread, started 132234320248960)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88899) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 03 08:45:52 devstack sudo[106725]: pam_unix(sudo:session): session closed for user root Aug 03 08:45:52 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-b86ab9d9-58dd-4bd4-9a61-7c083f2b498b tempest-TestShelveInstance-1134734811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-5dd62159-5525-4bf9-8830-803d9e606d29 1G" returned: 0 in 0.874s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:45:52 devstack cinder-volume[88899]: DEBUG cinder.volume.volume_utils [None req-b86ab9d9-58dd-4bd4-9a61-7c083f2b498b tempest-TestShelveInstance-1134734811 None] Downloaded image 37045a76-b9b1-4156-b15f-85c62a8616c3 ((None, [{'url': 'file:///opt/stack/data/glance/images/37045a76-b9b1-4156-b15f-85c62a8616c3', 'metadata': {}}])) to volume 5dd62159-5525-4bf9-8830-803d9e606d29 successfully. {{(pid=88899) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Aug 03 08:45:53 devstack cinder-volume[88899]: DEBUG cinder.image.image_utils [None req-b86ab9d9-58dd-4bd4-9a61-7c083f2b498b tempest-TestShelveInstance-1134734811 None] Temporary image 37045a76-b9b1-4156-b15f-85c62a8616c3 for user e489bd31863844ec8452b95ea407f594 is deleted. {{(pid=88899) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Aug 03 08:45:53 devstack cinder-volume[88899]: DEBUG cinder.volume.volume_utils [None req-b86ab9d9-58dd-4bd4-9a61-7c083f2b498b tempest-TestShelveInstance-1134734811 None] Marking volume 5dd62159-5525-4bf9-8830-803d9e606d29 as bootable. {{(pid=88899) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Aug 03 08:45:53 devstack cinder-volume[88899]: DEBUG cinder.volume.flows.manager.create_volume [None req-b86ab9d9-58dd-4bd4-9a61-7c083f2b498b tempest-TestShelveInstance-1134734811 None] Copying metadata from image 37045a76-b9b1-4156-b15f-85c62a8616c3 to 5dd62159-5525-4bf9-8830-803d9e606d29. {{(pid=88899) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Aug 03 08:45:53 devstack cinder-volume[88899]: DEBUG cinder.volume.flows.manager.create_volume [None req-b86ab9d9-58dd-4bd4-9a61-7c083f2b498b tempest-TestShelveInstance-1134734811 None] Creating volume glance metadata for volume 5dd62159-5525-4bf9-8830-803d9e606d29 backed by image 37045a76-b9b1-4156-b15f-85c62a8616c3 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '37045a76-b9b1-4156-b15f-85c62a8616c3', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=88899) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Aug 03 08:45:53 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-b86ab9d9-58dd-4bd4-9a61-7c083f2b498b tempest-TestShelveInstance-1134734811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33cc355c-94fc-464c-a1b5-b3a9cc6342ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5dd62159-5525-4bf9-8830-803d9e606d29', 'volume_size': 1, 'image_id': '37045a76-b9b1-4156-b15f-85c62a8616c3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/37045a76-b9b1-4156-b15f-85c62a8616c3', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'adee82974e9f41769efcb3f4a0eef199', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '37045a76-b9b1-4156-b15f-85c62a8616c3', 'created_at': datetime.datetime(2026, 8, 3, 6, 23, 4, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 3, 6, 23, 6, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/37045a76-b9b1-4156-b15f-85c62a8616c3/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:45:53 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-b86ab9d9-58dd-4bd4-9a61-7c083f2b498b tempest-TestShelveInstance-1134734811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc503aae-6ac8-4484-b4e8-5781bd226784) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:45:53 devstack cinder-volume[88899]: INFO cinder.volume.flows.manager.create_volume [None req-b86ab9d9-58dd-4bd4-9a61-7c083f2b498b tempest-TestShelveInstance-1134734811 None] Volume volume-5dd62159-5525-4bf9-8830-803d9e606d29 (5dd62159-5525-4bf9-8830-803d9e606d29): created successfully Aug 03 08:45:53 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-b86ab9d9-58dd-4bd4-9a61-7c083f2b498b tempest-TestShelveInstance-1134734811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc503aae-6ac8-4484-b4e8-5781bd226784) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:45:53 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-b86ab9d9-58dd-4bd4-9a61-7c083f2b498b tempest-TestShelveInstance-1134734811 None] Flow 'volume_create_manager' (dc033b90-9635-41ee-9962-bafd517046c8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:45:53 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-b86ab9d9-58dd-4bd4-9a61-7c083f2b498b tempest-TestShelveInstance-1134734811 None] Created volume successfully. Aug 03 08:45:54 devstack cinder-volume[88899]: DEBUG cinder.volume.flows.manager.create_volume [None req-ed857f40-e47d-4814-857e-12ec10480e20 tempest-ProjectReaderTests-2034209105 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88899) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 08:45:54 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-ed857f40-e47d-4814-857e-12ec10480e20 tempest-ProjectReaderTests-2034209105 None] Flow 'volume_create_manager' (de7d87fa-86fd-4dee-9525-bc610a436f4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:45:54 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-ed857f40-e47d-4814-857e-12ec10480e20 tempest-ProjectReaderTests-2034209105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49a17751-24ba-4e2b-82d0-d91ec04d89b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:45:54 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-ed857f40-e47d-4814-857e-12ec10480e20 tempest-ProjectReaderTests-2034209105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49a17751-24ba-4e2b-82d0-d91ec04d89b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:45:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-457074099',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ecb3c349-126e-41bb-a388-4cf2c644173b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='60b0e0bae6734bc7b4895d6c2ea550de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:45:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:45:54Z,use_quota=True,user_id='5291713768084f098e5d7f65813dad8e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8bde7129-1dc4-42ab-b852-ab32c61b4921),volume_type_id=8bde7129-1dc4-42ab-b852-ab32c61b4921)' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:45:54 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-ed857f40-e47d-4814-857e-12ec10480e20 tempest-ProjectReaderTests-2034209105 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b571a57f-e6d4-4770-b4b7-f2fb7d93284c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:45:54 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-ed857f40-e47d-4814-857e-12ec10480e20 tempest-ProjectReaderTests-2034209105 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b571a57f-e6d4-4770-b4b7-f2fb7d93284c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:45:54 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-ed857f40-e47d-4814-857e-12ec10480e20 tempest-ProjectReaderTests-2034209105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9862c1f9-5af5-4a3c-843f-4cbb1b238183) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:45:54 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-ed857f40-e47d-4814-857e-12ec10480e20 tempest-ProjectReaderTests-2034209105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9862c1f9-5af5-4a3c-843f-4cbb1b238183) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ecb3c349-126e-41bb-a388-4cf2c644173b', 'volume_name': 'volume-ecb3c349-126e-41bb-a388-4cf2c644173b', 'volume_size': 1}' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:45:54 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-ed857f40-e47d-4814-857e-12ec10480e20 tempest-ProjectReaderTests-2034209105 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fbe15239-7785-4f15-ad62-b9a2d2ae12e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:45:54 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-ed857f40-e47d-4814-857e-12ec10480e20 tempest-ProjectReaderTests-2034209105 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fbe15239-7785-4f15-ad62-b9a2d2ae12e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:45:54 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-ed857f40-e47d-4814-857e-12ec10480e20 tempest-ProjectReaderTests-2034209105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6118e597-f3f0-40f0-9402-2027248de4d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:45:54 devstack cinder-volume[88899]: INFO cinder.volume.flows.manager.create_volume [None req-ed857f40-e47d-4814-857e-12ec10480e20 tempest-ProjectReaderTests-2034209105 None] Volume ecb3c349-126e-41bb-a388-4cf2c644173b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ecb3c349-126e-41bb-a388-4cf2c644173b', 'volume_size': 1} Aug 03 08:45:54 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-ed857f40-e47d-4814-857e-12ec10480e20 tempest-ProjectReaderTests-2034209105 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:45:55 devstack sudo[106700]: pam_unix(sudo:session): session closed for user root Aug 03 08:45:55 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-1aa166de-0d58-48a4-b3e7-7c8a2bd3be5c tempest-VolumeDependencyTests-1073688899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-f6fae8bb-ee2d-4ffd-aa4b-04a7aa4631e1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-b993036e-7726-48b6-b4e9-2ab7325b2d63" returned: 0 in 5.138s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:45:55 devstack cinder-volume[88899]: DEBUG cinder.image.image_utils [None req-1aa166de-0d58-48a4-b3e7-7c8a2bd3be5c tempest-VolumeDependencyTests-1073688899 None] Image conversion details: src /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-f6fae8bb-ee2d-4ffd-aa4b-04a7aa4631e1, size 1024.00 MB, duration 5.14 sec, destination /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-b993036e-7726-48b6-b4e9-2ab7325b2d63 {{(pid=88899) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 03 08:45:55 devstack cinder-volume[88899]: INFO cinder.image.image_utils [None req-1aa166de-0d58-48a4-b3e7-7c8a2bd3be5c tempest-VolumeDependencyTests-1073688899 None] Converted 1024.00 MB image at 199.26 MB/s Aug 03 08:45:55 devstack cinder-volume[88899]: WARNING cinder.volume.drivers.remotefs [None req-1aa166de-0d58-48a4-b3e7-7c8a2bd3be5c tempest-VolumeDependencyTests-1073688899 None] /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-b993036e-7726-48b6-b4e9-2ab7325b2d63 is being set with open permissions: ugo+rw Aug 03 08:45:55 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-1aa166de-0d58-48a4-b3e7-7c8a2bd3be5c tempest-VolumeDependencyTests-1073688899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-b993036e-7726-48b6-b4e9-2ab7325b2d63 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:45:55 devstack sudo[106734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-b993036e-7726-48b6-b4e9-2ab7325b2d63 Aug 03 08:45:55 devstack sudo[106734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:45:55 devstack sudo[106734]: pam_unix(sudo:session): session closed for user root Aug 03 08:45:55 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-1aa166de-0d58-48a4-b3e7-7c8a2bd3be5c tempest-VolumeDependencyTests-1073688899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-b993036e-7726-48b6-b4e9-2ab7325b2d63" returned: 0 in 0.252s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:45:55 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-1aa166de-0d58-48a4-b3e7-7c8a2bd3be5c tempest-VolumeDependencyTests-1073688899 None] Lock "cinder-quobyte-b993036e-7726-48b6-b4e9-2ab7325b2d63" released by "_copy_volume_from_snapshot" :: held 6.198s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:45:55 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-1aa166de-0d58-48a4-b3e7-7c8a2bd3be5c tempest-VolumeDependencyTests-1073688899 None] Lock "cinder-quobyte-c17f8863-d791-494f-9c20-db2fb701440d-b993036e-7726-48b6-b4e9-2ab7325b2d63" released by "_create_volume_from_snapshot" :: held 6.271s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:45:55 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-1aa166de-0d58-48a4-b3e7-7c8a2bd3be5c tempest-VolumeDependencyTests-1073688899 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.318s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:45:55 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-ed857f40-e47d-4814-857e-12ec10480e20 tempest-ProjectReaderTests-2034209105 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.140s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:45:55 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-ed857f40-e47d-4814-857e-12ec10480e20 tempest-ProjectReaderTests-2034209105 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:45:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-457074099',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ecb3c349-126e-41bb-a388-4cf2c644173b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='60b0e0bae6734bc7b4895d6c2ea550de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:45:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:45:54Z,use_quota=True,user_id='5291713768084f098e5d7f65813dad8e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8bde7129-1dc4-42ab-b852-ab32c61b4921),volume_type_id=8bde7129-1dc4-42ab-b852-ab32c61b4921)}" {{(pid=88899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 08:45:55 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-ed857f40-e47d-4814-857e-12ec10480e20 tempest-ProjectReaderTests-2034209105 None] Creating volume ecb3c349-126e-41bb-a388-4cf2c644173b {{(pid=88899) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 08:45:55 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-ed857f40-e47d-4814-857e-12ec10480e20 tempest-ProjectReaderTests-2034209105 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:45:55 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-ed857f40-e47d-4814-857e-12ec10480e20 tempest-ProjectReaderTests-2034209105 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:45:55 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-ed857f40-e47d-4814-857e-12ec10480e20 tempest-ProjectReaderTests-2034209105 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:45:55 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-ed857f40-e47d-4814-857e-12ec10480e20 tempest-ProjectReaderTests-2034209105 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:45:55 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-ed857f40-e47d-4814-857e-12ec10480e20 tempest-ProjectReaderTests-2034209105 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:45:55 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-ed857f40-e47d-4814-857e-12ec10480e20 tempest-ProjectReaderTests-2034209105 None] Selected osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385 as target Quobyte volume. {{(pid=88899) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 08:45:55 devstack cinder-volume[88899]: INFO cinder.volume.drivers.remotefs [None req-ed857f40-e47d-4814-857e-12ec10480e20 tempest-ProjectReaderTests-2034209105 None] casted to osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385 Aug 03 08:45:55 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-ed857f40-e47d-4814-857e-12ec10480e20 tempest-ProjectReaderTests-2034209105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-ecb3c349-126e-41bb-a388-4cf2c644173b 1073741824 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:45:55 devstack sudo[106740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-ecb3c349-126e-41bb-a388-4cf2c644173b 1073741824 Aug 03 08:45:55 devstack sudo[106740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:45:55 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-1aa166de-0d58-48a4-b3e7-7c8a2bd3be5c tempest-VolumeDependencyTests-1073688899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd5f6858-ab27-49a4-b9a2-5cb647001a4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b993036e-7726-48b6-b4e9-2ab7325b2d63', 'volume_size': 1, 'snapshot_id': 'c17f8863-d791-494f-9c20-db2fb701440d'}' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:45:55 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-1aa166de-0d58-48a4-b3e7-7c8a2bd3be5c tempest-VolumeDependencyTests-1073688899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1907753a-a8be-4dc7-811a-bdbdaba2e0a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:45:55 devstack cinder-volume[88899]: INFO cinder.volume.flows.manager.create_volume [None req-1aa166de-0d58-48a4-b3e7-7c8a2bd3be5c tempest-VolumeDependencyTests-1073688899 None] Volume volume-b993036e-7726-48b6-b4e9-2ab7325b2d63 (b993036e-7726-48b6-b4e9-2ab7325b2d63): created successfully Aug 03 08:45:55 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-1aa166de-0d58-48a4-b3e7-7c8a2bd3be5c tempest-VolumeDependencyTests-1073688899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1907753a-a8be-4dc7-811a-bdbdaba2e0a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:45:55 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-1aa166de-0d58-48a4-b3e7-7c8a2bd3be5c tempest-VolumeDependencyTests-1073688899 None] Flow 'volume_create_manager' (e0db25e1-e7c5-4682-bf8e-46dcb52a52ba) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:45:55 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-1aa166de-0d58-48a4-b3e7-7c8a2bd3be5c tempest-VolumeDependencyTests-1073688899 None] Created volume successfully. Aug 03 08:45:55 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-d53f5923-7093-4201-9618-20508baaa4e2 tempest-VolumeDependencyTests-1073688899 None] Acquiring lock "cinder-c17f8863-d791-494f-9c20-db2fb701440d-delete_snapshot" by "delete_snapshot" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:45:55 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-d53f5923-7093-4201-9618-20508baaa4e2 tempest-VolumeDependencyTests-1073688899 None] Lock "cinder-c17f8863-d791-494f-9c20-db2fb701440d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:45:55 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-d53f5923-7093-4201-9618-20508baaa4e2 tempest-VolumeDependencyTests-1073688899 None] Acquiring lock "cinder-quobyte-f6fae8bb-ee2d-4ffd-aa4b-04a7aa4631e1" by "delete_snapshot" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:45:55 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-d53f5923-7093-4201-9618-20508baaa4e2 tempest-VolumeDependencyTests-1073688899 None] Lock "cinder-quobyte-f6fae8bb-ee2d-4ffd-aa4b-04a7aa4631e1" acquired by "delete_snapshot" :: waited 0.020s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:45:55 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-d53f5923-7093-4201-9618-20508baaa4e2 tempest-VolumeDependencyTests-1073688899 None] Acquiring lock "cinder-quobyte-c17f8863-d791-494f-9c20-db2fb701440d" by "_delete_snapshot" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:45:55 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-d53f5923-7093-4201-9618-20508baaa4e2 tempest-VolumeDependencyTests-1073688899 None] Lock "cinder-quobyte-c17f8863-d791-494f-9c20-db2fb701440d" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:45:55 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-d53f5923-7093-4201-9618-20508baaa4e2 tempest-VolumeDependencyTests-1073688899 None] Deleting offline snapshot c17f8863-d791-494f-9c20-db2fb701440d of volume f6fae8bb-ee2d-4ffd-aa4b-04a7aa4631e1 {{(pid=88899) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 03 08:45:55 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-d53f5923-7093-4201-9618-20508baaa4e2 tempest-VolumeDependencyTests-1073688899 None] snapshot_file for this snap is: volume-f6fae8bb-ee2d-4ffd-aa4b-04a7aa4631e1.c17f8863-d791-494f-9c20-db2fb701440d {{(pid=88899) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 03 08:45:56 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[c03366b3-381a-4a2b-922a-28699af7ab3a]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:45:56 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-d53f5923-7093-4201-9618-20508baaa4e2 tempest-VolumeDependencyTests-1073688899 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-f6fae8bb-ee2d-4ffd-aa4b-04a7aa4631e1.c17f8863-d791-494f-9c20-db2fb701440d {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:45:56 devstack sudo[106740]: pam_unix(sudo:session): session closed for user root Aug 03 08:45:56 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-ed857f40-e47d-4814-857e-12ec10480e20 tempest-ProjectReaderTests-2034209105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-ecb3c349-126e-41bb-a388-4cf2c644173b 1073741824" returned: 0 in 0.520s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:45:56 devstack sudo[106745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-f6fae8bb-ee2d-4ffd-aa4b-04a7aa4631e1.c17f8863-d791-494f-9c20-db2fb701440d Aug 03 08:45:56 devstack sudo[106745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:45:56 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-ed857f40-e47d-4814-857e-12ec10480e20 tempest-ProjectReaderTests-2034209105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-ecb3c349-126e-41bb-a388-4cf2c644173b {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:45:56 devstack sudo[106747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-ecb3c349-126e-41bb-a388-4cf2c644173b Aug 03 08:45:56 devstack sudo[106747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:45:56 devstack sudo[106745]: pam_unix(sudo:session): session closed for user root Aug 03 08:45:56 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-d53f5923-7093-4201-9618-20508baaa4e2 tempest-VolumeDependencyTests-1073688899 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-f6fae8bb-ee2d-4ffd-aa4b-04a7aa4631e1.c17f8863-d791-494f-9c20-db2fb701440d" returned: 0 in 0.425s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:45:56 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-d53f5923-7093-4201-9618-20508baaa4e2 tempest-VolumeDependencyTests-1073688899 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f6fae8bb-ee2d-4ffd-aa4b-04a7aa4631e1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88899) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 03 08:45:56 devstack sudo[106747]: pam_unix(sudo:session): session closed for user root Aug 03 08:45:56 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-ed857f40-e47d-4814-857e-12ec10480e20 tempest-ProjectReaderTests-2034209105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-ecb3c349-126e-41bb-a388-4cf2c644173b" returned: 0 in 0.292s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:45:56 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-ed857f40-e47d-4814-857e-12ec10480e20 tempest-ProjectReaderTests-2034209105 None] <== create_volume: return (870ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'} {{(pid=88899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 08:45:56 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-ed857f40-e47d-4814-857e-12ec10480e20 tempest-ProjectReaderTests-2034209105 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.873s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:45:56 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ed46e0c-101e-46a2-8102-4b63a4b4ba2a]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:45:56 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-d53f5923-7093-4201-9618-20508baaa4e2 tempest-VolumeDependencyTests-1073688899 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-f6fae8bb-ee2d-4ffd-aa4b-04a7aa4631e1 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:45:56 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-ed857f40-e47d-4814-857e-12ec10480e20 tempest-ProjectReaderTests-2034209105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6118e597-f3f0-40f0-9402-2027248de4d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ecb3c349-126e-41bb-a388-4cf2c644173b', 'volume_size': 1}' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:45:56 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-ed857f40-e47d-4814-857e-12ec10480e20 tempest-ProjectReaderTests-2034209105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fca7addf-b8e1-4025-9665-1f1683bd1423) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:45:56 devstack cinder-volume[88899]: INFO cinder.volume.flows.manager.create_volume [None req-ed857f40-e47d-4814-857e-12ec10480e20 tempest-ProjectReaderTests-2034209105 None] Volume volume-ecb3c349-126e-41bb-a388-4cf2c644173b (ecb3c349-126e-41bb-a388-4cf2c644173b): created successfully Aug 03 08:45:56 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-ed857f40-e47d-4814-857e-12ec10480e20 tempest-ProjectReaderTests-2034209105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fca7addf-b8e1-4025-9665-1f1683bd1423) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:45:56 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-ed857f40-e47d-4814-857e-12ec10480e20 tempest-ProjectReaderTests-2034209105 None] Flow 'volume_create_manager' (de7d87fa-86fd-4dee-9525-bc610a436f4b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:45:56 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-ed857f40-e47d-4814-857e-12ec10480e20 tempest-ProjectReaderTests-2034209105 None] Created volume successfully. Aug 03 08:45:56 devstack sudo[106753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-f6fae8bb-ee2d-4ffd-aa4b-04a7aa4631e1 Aug 03 08:45:56 devstack sudo[106753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:45:57 devstack sudo[106753]: pam_unix(sudo:session): session closed for user root Aug 03 08:45:57 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-d53f5923-7093-4201-9618-20508baaa4e2 tempest-VolumeDependencyTests-1073688899 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-f6fae8bb-ee2d-4ffd-aa4b-04a7aa4631e1" returned: 0 in 0.599s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:45:57 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-d53f5923-7093-4201-9618-20508baaa4e2 tempest-VolumeDependencyTests-1073688899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-f6fae8bb-ee2d-4ffd-aa4b-04a7aa4631e1.c17f8863-d791-494f-9c20-db2fb701440d {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:45:57 devstack sudo[106758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-f6fae8bb-ee2d-4ffd-aa4b-04a7aa4631e1.c17f8863-d791-494f-9c20-db2fb701440d Aug 03 08:45:57 devstack sudo[106758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:45:57 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-81a4950f-125d-4ae1-a115-9c334c6720ed tempest-ProjectReaderTests-2034209105 None] Acquiring lock "cinder-ecb3c349-126e-41bb-a388-4cf2c644173b-delete_volume" by "delete_volume" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:45:57 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-81a4950f-125d-4ae1-a115-9c334c6720ed tempest-ProjectReaderTests-2034209105 None] Lock "cinder-ecb3c349-126e-41bb-a388-4cf2c644173b-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:45:57 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-81a4950f-125d-4ae1-a115-9c334c6720ed tempest-ProjectReaderTests-2034209105 None] Acquiring lock "cinder-quobyte-ecb3c349-126e-41bb-a388-4cf2c644173b" by "delete_volume" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:45:57 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-81a4950f-125d-4ae1-a115-9c334c6720ed tempest-ProjectReaderTests-2034209105 None] Lock "cinder-quobyte-ecb3c349-126e-41bb-a388-4cf2c644173b" acquired by "delete_volume" :: waited 0.018s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:45:57 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2dffaae-e8bc-4f16-97a8-3ec001fd0a68]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:45:57 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-81a4950f-125d-4ae1-a115-9c334c6720ed tempest-ProjectReaderTests-2034209105 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-ecb3c349-126e-41bb-a388-4cf2c644173b {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:45:57 devstack sudo[106758]: pam_unix(sudo:session): session closed for user root Aug 03 08:45:57 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-d53f5923-7093-4201-9618-20508baaa4e2 tempest-VolumeDependencyTests-1073688899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-f6fae8bb-ee2d-4ffd-aa4b-04a7aa4631e1.c17f8863-d791-494f-9c20-db2fb701440d" returned: 0 in 0.495s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:45:57 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-d53f5923-7093-4201-9618-20508baaa4e2 tempest-VolumeDependencyTests-1073688899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-f6fae8bb-ee2d-4ffd-aa4b-04a7aa4631e1.c17f8863-d791-494f-9c20-db2fb701440d {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:45:57 devstack sudo[106772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-f6fae8bb-ee2d-4ffd-aa4b-04a7aa4631e1.c17f8863-d791-494f-9c20-db2fb701440d Aug 03 08:45:57 devstack sudo[106772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:45:57 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [req-b240a7d4-8185-4130-8e86-effe200718e3 req-9e55f169-d0d8-4196-bd30-20dfccf5efae tempest-TestShelveInstance-1134734811 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:45:57 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [req-b240a7d4-8185-4130-8e86-effe200718e3 req-9e55f169-d0d8-4196-bd30-20dfccf5efae tempest-TestShelveInstance-1134734811 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:45:57 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [req-b240a7d4-8185-4130-8e86-effe200718e3 req-9e55f169-d0d8-4196-bd30-20dfccf5efae tempest-TestShelveInstance-1134734811 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.017s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:45:57 devstack sudo[106771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-ecb3c349-126e-41bb-a388-4cf2c644173b Aug 03 08:45:57 devstack sudo[106771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:45:57 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [req-b240a7d4-8185-4130-8e86-effe200718e3 req-9e55f169-d0d8-4196-bd30-20dfccf5efae tempest-TestShelveInstance-1134734811 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385', 'name': 'volume-5dd62159-5525-4bf9-8830-803d9e606d29', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '84c6cc1e-6d33-4b86-ab0e-e6f278865536', 'enforce_multipath': True} {{(pid=88899) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 03 08:45:57 devstack cinder-volume[88899]: INFO cinder.volume.manager [req-b240a7d4-8185-4130-8e86-effe200718e3 req-9e55f169-d0d8-4196-bd30-20dfccf5efae tempest-TestShelveInstance-1134734811 None] attachment_update completed successfully. Aug 03 08:45:57 devstack sudo[106771]: pam_unix(sudo:session): session closed for user root Aug 03 08:45:57 devstack sudo[106772]: pam_unix(sudo:session): session closed for user root Aug 03 08:45:57 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-81a4950f-125d-4ae1-a115-9c334c6720ed tempest-ProjectReaderTests-2034209105 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-ecb3c349-126e-41bb-a388-4cf2c644173b" returned: 0 in 0.440s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:45:57 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-81a4950f-125d-4ae1-a115-9c334c6720ed tempest-ProjectReaderTests-2034209105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-ecb3c349-126e-41bb-a388-4cf2c644173b {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:45:57 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-d53f5923-7093-4201-9618-20508baaa4e2 tempest-VolumeDependencyTests-1073688899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-f6fae8bb-ee2d-4ffd-aa4b-04a7aa4631e1.c17f8863-d791-494f-9c20-db2fb701440d" returned: 0 in 0.377s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:45:57 devstack sudo[106780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-ecb3c349-126e-41bb-a388-4cf2c644173b Aug 03 08:45:57 devstack sudo[106780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:45:58 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-d53f5923-7093-4201-9618-20508baaa4e2 tempest-VolumeDependencyTests-1073688899 None] Lock "cinder-quobyte-c17f8863-d791-494f-9c20-db2fb701440d" released by "_delete_snapshot" :: held 2.071s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:45:58 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-d53f5923-7093-4201-9618-20508baaa4e2 tempest-VolumeDependencyTests-1073688899 None] Lock "cinder-quobyte-f6fae8bb-ee2d-4ffd-aa4b-04a7aa4631e1" released by "delete_snapshot" :: held 2.104s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:45:58 devstack cinder-volume[88899]: DEBUG cinder.quota [None req-d53f5923-7093-4201-9618-20508baaa4e2 tempest-VolumeDependencyTests-1073688899 None] Created reservations ['b01bf066-8c71-4106-ad74-cf38970399a9', 'b5413360-1e90-4542-986f-4ea29f35f5a1', '800be0b4-a06a-4e2a-864d-db401db6b45e', '98cc8293-d61e-4809-8f12-38ac2c87b914'] {{(pid=88899) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 08:45:58 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-d53f5923-7093-4201-9618-20508baaa4e2 tempest-VolumeDependencyTests-1073688899 None] Delete snapshot completed successfully. Aug 03 08:45:58 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-d53f5923-7093-4201-9618-20508baaa4e2 tempest-VolumeDependencyTests-1073688899 None] Lock "cinder-c17f8863-d791-494f-9c20-db2fb701440d-delete_snapshot" released by "delete_snapshot" :: held 2.355s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:45:58 devstack sudo[106780]: pam_unix(sudo:session): session closed for user root Aug 03 08:45:58 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-81a4950f-125d-4ae1-a115-9c334c6720ed tempest-ProjectReaderTests-2034209105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-ecb3c349-126e-41bb-a388-4cf2c644173b" returned: 0 in 0.436s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:45:58 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-81a4950f-125d-4ae1-a115-9c334c6720ed tempest-ProjectReaderTests-2034209105 None] Lock "cinder-quobyte-ecb3c349-126e-41bb-a388-4cf2c644173b" released by "delete_volume" :: held 0.918s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:45:58 devstack cinder-volume[88899]: DEBUG cinder.quota [None req-81a4950f-125d-4ae1-a115-9c334c6720ed tempest-ProjectReaderTests-2034209105 None] Created reservations ['7b6cf364-94ab-4c6f-801e-2deae16e0be5', 'cd62ca24-2784-4d9c-8f02-277fb03005e5', '06b94fbf-1c04-49eb-add0-e318f32e2b2a', '373586fc-49f0-4e77-be54-0559d1df788b'] {{(pid=88899) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 08:45:58 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-81a4950f-125d-4ae1-a115-9c334c6720ed tempest-ProjectReaderTests-2034209105 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:45:58 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-81a4950f-125d-4ae1-a115-9c334c6720ed tempest-ProjectReaderTests-2034209105 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:45:58 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-81a4950f-125d-4ae1-a115-9c334c6720ed tempest-ProjectReaderTests-2034209105 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:45:58 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-81a4950f-125d-4ae1-a115-9c334c6720ed tempest-ProjectReaderTests-2034209105 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:45:58 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-81a4950f-125d-4ae1-a115-9c334c6720ed tempest-ProjectReaderTests-2034209105 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:45:58 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-81a4950f-125d-4ae1-a115-9c334c6720ed tempest-ProjectReaderTests-2034209105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:45:58 devstack sudo[106784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a Aug 03 08:45:58 devstack sudo[106784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:45:58 devstack sudo[106784]: pam_unix(sudo:session): session closed for user root Aug 03 08:45:58 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-81a4950f-125d-4ae1-a115-9c334c6720ed tempest-ProjectReaderTests-2034209105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a" returned: 0 in 0.262s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:45:58 devstack cinder-volume[88899]: DEBUG cinder.manager [None req-81a4950f-125d-4ae1-a115-9c334c6720ed tempest-ProjectReaderTests-2034209105 None] Notifying Schedulers of capabilities ... {{(pid=88899) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 08:45:58 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-81a4950f-125d-4ae1-a115-9c334c6720ed tempest-ProjectReaderTests-2034209105 None] Deleted volume successfully. Aug 03 08:45:58 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-81a4950f-125d-4ae1-a115-9c334c6720ed tempest-ProjectReaderTests-2034209105 None] Lock "cinder-ecb3c349-126e-41bb-a388-4cf2c644173b-delete_volume" released by "delete_volume" :: held 1.468s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:45:59 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-34f4d9c2-0d5d-4e90-bcad-c30b33cb04e5 tempest-VolumeDependencyTests-1073688899 None] Acquiring lock "cinder-f6fae8bb-ee2d-4ffd-aa4b-04a7aa4631e1-delete_volume" by "delete_volume" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:45:59 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-34f4d9c2-0d5d-4e90-bcad-c30b33cb04e5 tempest-VolumeDependencyTests-1073688899 None] Lock "cinder-f6fae8bb-ee2d-4ffd-aa4b-04a7aa4631e1-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:45:59 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-34f4d9c2-0d5d-4e90-bcad-c30b33cb04e5 tempest-VolumeDependencyTests-1073688899 None] Acquiring lock "cinder-quobyte-f6fae8bb-ee2d-4ffd-aa4b-04a7aa4631e1" by "delete_volume" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:45:59 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-34f4d9c2-0d5d-4e90-bcad-c30b33cb04e5 tempest-VolumeDependencyTests-1073688899 None] Lock "cinder-quobyte-f6fae8bb-ee2d-4ffd-aa4b-04a7aa4631e1" acquired by "delete_volume" :: waited 0.023s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:45:59 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c5b8710-8ee6-4f75-8a81-abc0d7eb13a4]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:45:59 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-34f4d9c2-0d5d-4e90-bcad-c30b33cb04e5 tempest-VolumeDependencyTests-1073688899 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-f6fae8bb-ee2d-4ffd-aa4b-04a7aa4631e1 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:45:59 devstack sudo[106788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-f6fae8bb-ee2d-4ffd-aa4b-04a7aa4631e1 Aug 03 08:45:59 devstack sudo[106788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:45:59 devstack sudo[106788]: pam_unix(sudo:session): session closed for user root Aug 03 08:45:59 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-34f4d9c2-0d5d-4e90-bcad-c30b33cb04e5 tempest-VolumeDependencyTests-1073688899 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-f6fae8bb-ee2d-4ffd-aa4b-04a7aa4631e1" returned: 0 in 0.422s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:45:59 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-34f4d9c2-0d5d-4e90-bcad-c30b33cb04e5 tempest-VolumeDependencyTests-1073688899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-f6fae8bb-ee2d-4ffd-aa4b-04a7aa4631e1 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:45:59 devstack sudo[106793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-f6fae8bb-ee2d-4ffd-aa4b-04a7aa4631e1 Aug 03 08:45:59 devstack sudo[106793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:46:00 devstack cinder-volume[88899]: DEBUG cinder.volume.flows.manager.create_volume [None req-9cbe9570-5531-48c9-b2d6-d9a702b6e44d tempest-ProjectReaderTests-2034209105 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88899) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 08:46:00 devstack sudo[106793]: pam_unix(sudo:session): session closed for user root Aug 03 08:46:00 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-9cbe9570-5531-48c9-b2d6-d9a702b6e44d tempest-ProjectReaderTests-2034209105 None] Flow 'volume_create_manager' (64fc189a-9b35-4020-8d05-b229dcd57453) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:46:00 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-9cbe9570-5531-48c9-b2d6-d9a702b6e44d tempest-ProjectReaderTests-2034209105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b80a55f1-38bf-4489-886a-12079d3f5d56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:46:00 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-34f4d9c2-0d5d-4e90-bcad-c30b33cb04e5 tempest-VolumeDependencyTests-1073688899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-f6fae8bb-ee2d-4ffd-aa4b-04a7aa4631e1" returned: 0 in 0.445s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:46:00 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-34f4d9c2-0d5d-4e90-bcad-c30b33cb04e5 tempest-VolumeDependencyTests-1073688899 None] Lock "cinder-quobyte-f6fae8bb-ee2d-4ffd-aa4b-04a7aa4631e1" released by "delete_volume" :: held 0.961s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:46:00 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-9cbe9570-5531-48c9-b2d6-d9a702b6e44d tempest-ProjectReaderTests-2034209105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b80a55f1-38bf-4489-886a-12079d3f5d56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:46:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1640863138',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e9903327-6f2d-4671-b88b-ada10347f6bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='60b0e0bae6734bc7b4895d6c2ea550de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:46:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:46:00Z,use_quota=True,user_id='5291713768084f098e5d7f65813dad8e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8bde7129-1dc4-42ab-b852-ab32c61b4921),volume_type_id=8bde7129-1dc4-42ab-b852-ab32c61b4921)' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:46:00 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-9cbe9570-5531-48c9-b2d6-d9a702b6e44d tempest-ProjectReaderTests-2034209105 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47196111-462b-429c-bc2b-e2a9e9a5b064) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:46:00 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-9cbe9570-5531-48c9-b2d6-d9a702b6e44d tempest-ProjectReaderTests-2034209105 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47196111-462b-429c-bc2b-e2a9e9a5b064) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:46:00 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-9cbe9570-5531-48c9-b2d6-d9a702b6e44d tempest-ProjectReaderTests-2034209105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15effb53-ae3a-4be1-b6c3-97d2ec403a47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:46:00 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-9cbe9570-5531-48c9-b2d6-d9a702b6e44d tempest-ProjectReaderTests-2034209105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15effb53-ae3a-4be1-b6c3-97d2ec403a47) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e9903327-6f2d-4671-b88b-ada10347f6bb', 'volume_name': 'volume-e9903327-6f2d-4671-b88b-ada10347f6bb', 'volume_size': 1}' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:46:00 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-9cbe9570-5531-48c9-b2d6-d9a702b6e44d tempest-ProjectReaderTests-2034209105 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52e37352-acc8-4b86-8fa8-07073cd0da3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:46:00 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-9cbe9570-5531-48c9-b2d6-d9a702b6e44d tempest-ProjectReaderTests-2034209105 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52e37352-acc8-4b86-8fa8-07073cd0da3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:46:00 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-9cbe9570-5531-48c9-b2d6-d9a702b6e44d tempest-ProjectReaderTests-2034209105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5a41d4d-1855-4b50-bcec-033bb234dd65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:46:00 devstack cinder-volume[88899]: INFO cinder.volume.flows.manager.create_volume [None req-9cbe9570-5531-48c9-b2d6-d9a702b6e44d tempest-ProjectReaderTests-2034209105 None] Volume e9903327-6f2d-4671-b88b-ada10347f6bb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e9903327-6f2d-4671-b88b-ada10347f6bb', 'volume_size': 1} Aug 03 08:46:00 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-9cbe9570-5531-48c9-b2d6-d9a702b6e44d tempest-ProjectReaderTests-2034209105 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:46:00 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-9cbe9570-5531-48c9-b2d6-d9a702b6e44d tempest-ProjectReaderTests-2034209105 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:46:00 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-9cbe9570-5531-48c9-b2d6-d9a702b6e44d tempest-ProjectReaderTests-2034209105 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:46:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1640863138',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e9903327-6f2d-4671-b88b-ada10347f6bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='60b0e0bae6734bc7b4895d6c2ea550de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:46:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:46:00Z,use_quota=True,user_id='5291713768084f098e5d7f65813dad8e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8bde7129-1dc4-42ab-b852-ab32c61b4921),volume_type_id=8bde7129-1dc4-42ab-b852-ab32c61b4921)}" {{(pid=88899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 08:46:00 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-9cbe9570-5531-48c9-b2d6-d9a702b6e44d tempest-ProjectReaderTests-2034209105 None] Creating volume e9903327-6f2d-4671-b88b-ada10347f6bb {{(pid=88899) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 08:46:00 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-9cbe9570-5531-48c9-b2d6-d9a702b6e44d tempest-ProjectReaderTests-2034209105 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:46:00 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-9cbe9570-5531-48c9-b2d6-d9a702b6e44d tempest-ProjectReaderTests-2034209105 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:46:00 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-9cbe9570-5531-48c9-b2d6-d9a702b6e44d tempest-ProjectReaderTests-2034209105 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:46:00 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-9cbe9570-5531-48c9-b2d6-d9a702b6e44d tempest-ProjectReaderTests-2034209105 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:46:00 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-9cbe9570-5531-48c9-b2d6-d9a702b6e44d tempest-ProjectReaderTests-2034209105 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:46:00 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-9cbe9570-5531-48c9-b2d6-d9a702b6e44d tempest-ProjectReaderTests-2034209105 None] Selected osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385 as target Quobyte volume. {{(pid=88899) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 08:46:00 devstack cinder-volume[88899]: INFO cinder.volume.drivers.remotefs [None req-9cbe9570-5531-48c9-b2d6-d9a702b6e44d tempest-ProjectReaderTests-2034209105 None] casted to osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385 Aug 03 08:46:00 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-9cbe9570-5531-48c9-b2d6-d9a702b6e44d tempest-ProjectReaderTests-2034209105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-e9903327-6f2d-4671-b88b-ada10347f6bb 1073741824 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:46:00 devstack sudo[106876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-e9903327-6f2d-4671-b88b-ada10347f6bb 1073741824 Aug 03 08:46:00 devstack sudo[106876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:46:00 devstack cinder-volume[88899]: DEBUG cinder.quota [None req-34f4d9c2-0d5d-4e90-bcad-c30b33cb04e5 tempest-VolumeDependencyTests-1073688899 None] Created reservations ['acf660e4-7df6-4707-a7ad-6fe31c1d48df', 'df16917e-456b-414c-ada0-7e8bb1d8b86d', 'ade184a8-6ffb-4f84-b9d9-6737d9c5c275', 'ebf2313d-ce18-45a8-ad21-3c7f84687f8b'] {{(pid=88899) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 08:46:00 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-34f4d9c2-0d5d-4e90-bcad-c30b33cb04e5 tempest-VolumeDependencyTests-1073688899 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:46:00 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-34f4d9c2-0d5d-4e90-bcad-c30b33cb04e5 tempest-VolumeDependencyTests-1073688899 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:46:00 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-34f4d9c2-0d5d-4e90-bcad-c30b33cb04e5 tempest-VolumeDependencyTests-1073688899 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:46:00 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-34f4d9c2-0d5d-4e90-bcad-c30b33cb04e5 tempest-VolumeDependencyTests-1073688899 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:46:00 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-34f4d9c2-0d5d-4e90-bcad-c30b33cb04e5 tempest-VolumeDependencyTests-1073688899 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:46:00 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-34f4d9c2-0d5d-4e90-bcad-c30b33cb04e5 tempest-VolumeDependencyTests-1073688899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:46:00 devstack sudo[107209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a Aug 03 08:46:00 devstack sudo[107209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:46:00 devstack sudo[107209]: pam_unix(sudo:session): session closed for user root Aug 03 08:46:00 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-34f4d9c2-0d5d-4e90-bcad-c30b33cb04e5 tempest-VolumeDependencyTests-1073688899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a" returned: 0 in 0.338s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:46:00 devstack cinder-volume[88899]: DEBUG cinder.manager [None req-34f4d9c2-0d5d-4e90-bcad-c30b33cb04e5 tempest-VolumeDependencyTests-1073688899 None] Notifying Schedulers of capabilities ... {{(pid=88899) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 08:46:00 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-34f4d9c2-0d5d-4e90-bcad-c30b33cb04e5 tempest-VolumeDependencyTests-1073688899 None] Deleted volume successfully. Aug 03 08:46:00 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-34f4d9c2-0d5d-4e90-bcad-c30b33cb04e5 tempest-VolumeDependencyTests-1073688899 None] Lock "cinder-f6fae8bb-ee2d-4ffd-aa4b-04a7aa4631e1-delete_volume" released by "delete_volume" :: held 1.772s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:46:01 devstack sudo[106876]: pam_unix(sudo:session): session closed for user root Aug 03 08:46:01 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-9cbe9570-5531-48c9-b2d6-d9a702b6e44d tempest-ProjectReaderTests-2034209105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-e9903327-6f2d-4671-b88b-ada10347f6bb 1073741824" returned: 0 in 0.823s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:46:01 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-9cbe9570-5531-48c9-b2d6-d9a702b6e44d tempest-ProjectReaderTests-2034209105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-e9903327-6f2d-4671-b88b-ada10347f6bb {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:46:01 devstack sudo[107236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-e9903327-6f2d-4671-b88b-ada10347f6bb Aug 03 08:46:01 devstack sudo[107236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:46:01 devstack sudo[107236]: pam_unix(sudo:session): session closed for user root Aug 03 08:46:01 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-9cbe9570-5531-48c9-b2d6-d9a702b6e44d tempest-ProjectReaderTests-2034209105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-e9903327-6f2d-4671-b88b-ada10347f6bb" returned: 0 in 0.281s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:46:01 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-9cbe9570-5531-48c9-b2d6-d9a702b6e44d tempest-ProjectReaderTests-2034209105 None] <== create_volume: return (1171ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'} {{(pid=88899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 08:46:01 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-9cbe9570-5531-48c9-b2d6-d9a702b6e44d tempest-ProjectReaderTests-2034209105 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.174s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:46:01 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-9cbe9570-5531-48c9-b2d6-d9a702b6e44d tempest-ProjectReaderTests-2034209105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5a41d4d-1855-4b50-bcec-033bb234dd65) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e9903327-6f2d-4671-b88b-ada10347f6bb', 'volume_size': 1}' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:46:01 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-9cbe9570-5531-48c9-b2d6-d9a702b6e44d tempest-ProjectReaderTests-2034209105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (542cfad4-e81f-49dc-8068-5cd58b3f50ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:46:01 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-06f709f2-c96f-4177-9730-b4b70fbd154d tempest-VolumeDependencyTests-1073688899 None] Acquiring lock "cinder-b993036e-7726-48b6-b4e9-2ab7325b2d63-delete_volume" by "delete_volume" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:46:01 devstack cinder-volume[88899]: INFO cinder.volume.flows.manager.create_volume [None req-9cbe9570-5531-48c9-b2d6-d9a702b6e44d tempest-ProjectReaderTests-2034209105 None] Volume volume-e9903327-6f2d-4671-b88b-ada10347f6bb (e9903327-6f2d-4671-b88b-ada10347f6bb): created successfully Aug 03 08:46:01 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-9cbe9570-5531-48c9-b2d6-d9a702b6e44d tempest-ProjectReaderTests-2034209105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (542cfad4-e81f-49dc-8068-5cd58b3f50ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:46:01 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-9cbe9570-5531-48c9-b2d6-d9a702b6e44d tempest-ProjectReaderTests-2034209105 None] Flow 'volume_create_manager' (64fc189a-9b35-4020-8d05-b229dcd57453) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:46:01 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-06f709f2-c96f-4177-9730-b4b70fbd154d tempest-VolumeDependencyTests-1073688899 None] Lock "cinder-b993036e-7726-48b6-b4e9-2ab7325b2d63-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:46:01 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-9cbe9570-5531-48c9-b2d6-d9a702b6e44d tempest-ProjectReaderTests-2034209105 None] Created volume successfully. Aug 03 08:46:01 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-06f709f2-c96f-4177-9730-b4b70fbd154d tempest-VolumeDependencyTests-1073688899 None] Acquiring lock "cinder-quobyte-b993036e-7726-48b6-b4e9-2ab7325b2d63" by "delete_volume" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:46:01 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-06f709f2-c96f-4177-9730-b4b70fbd154d tempest-VolumeDependencyTests-1073688899 None] Lock "cinder-quobyte-b993036e-7726-48b6-b4e9-2ab7325b2d63" acquired by "delete_volume" :: waited 0.014s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:46:01 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[14282c72-d9e8-44ff-b9ab-87e1d38e8965]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:46:01 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-06f709f2-c96f-4177-9730-b4b70fbd154d tempest-VolumeDependencyTests-1073688899 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-b993036e-7726-48b6-b4e9-2ab7325b2d63 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:46:01 devstack sudo[107251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-b993036e-7726-48b6-b4e9-2ab7325b2d63 Aug 03 08:46:01 devstack sudo[107251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:46:01 devstack sudo[107251]: pam_unix(sudo:session): session closed for user root Aug 03 08:46:01 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-06f709f2-c96f-4177-9730-b4b70fbd154d tempest-VolumeDependencyTests-1073688899 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-b993036e-7726-48b6-b4e9-2ab7325b2d63" returned: 0 in 0.377s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:46:01 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-06f709f2-c96f-4177-9730-b4b70fbd154d tempest-VolumeDependencyTests-1073688899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-b993036e-7726-48b6-b4e9-2ab7325b2d63 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:46:02 devstack sudo[107270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-b993036e-7726-48b6-b4e9-2ab7325b2d63 Aug 03 08:46:02 devstack sudo[107270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:46:02 devstack sudo[107270]: pam_unix(sudo:session): session closed for user root Aug 03 08:46:02 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-06f709f2-c96f-4177-9730-b4b70fbd154d tempest-VolumeDependencyTests-1073688899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-b993036e-7726-48b6-b4e9-2ab7325b2d63" returned: 0 in 0.286s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:46:02 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-2fc704b2-c719-444b-994e-14bdb129e9a4 tempest-ProjectReaderTests-2034209105 None] Acquiring lock "cinder-e9903327-6f2d-4671-b88b-ada10347f6bb-delete_volume" by "delete_volume" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:46:02 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-06f709f2-c96f-4177-9730-b4b70fbd154d tempest-VolumeDependencyTests-1073688899 None] Lock "cinder-quobyte-b993036e-7726-48b6-b4e9-2ab7325b2d63" released by "delete_volume" :: held 0.716s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:46:02 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-2fc704b2-c719-444b-994e-14bdb129e9a4 tempest-ProjectReaderTests-2034209105 None] Lock "cinder-e9903327-6f2d-4671-b88b-ada10347f6bb-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:46:02 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-2fc704b2-c719-444b-994e-14bdb129e9a4 tempest-ProjectReaderTests-2034209105 None] Acquiring lock "cinder-quobyte-e9903327-6f2d-4671-b88b-ada10347f6bb" by "delete_volume" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:46:02 devstack cinder-volume[88899]: DEBUG cinder.quota [None req-06f709f2-c96f-4177-9730-b4b70fbd154d tempest-VolumeDependencyTests-1073688899 None] Created reservations ['da2081f3-15b9-4694-a833-4e380a283c50', '2c14b020-fb6e-404b-b002-b8b80b00a92a', '0440c944-11f4-43bd-bf16-b62bb906814f', 'e3d65274-6b05-4a79-baeb-ed4ddf933827'] {{(pid=88899) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 08:46:02 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-2fc704b2-c719-444b-994e-14bdb129e9a4 tempest-ProjectReaderTests-2034209105 None] Lock "cinder-quobyte-e9903327-6f2d-4671-b88b-ada10347f6bb" acquired by "delete_volume" :: waited 0.020s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:46:02 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2825ba5-e321-4c2f-a106-de3bbd365aad]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:46:02 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-2fc704b2-c719-444b-994e-14bdb129e9a4 tempest-ProjectReaderTests-2034209105 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-e9903327-6f2d-4671-b88b-ada10347f6bb {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:46:02 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-06f709f2-c96f-4177-9730-b4b70fbd154d tempest-VolumeDependencyTests-1073688899 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:46:02 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-06f709f2-c96f-4177-9730-b4b70fbd154d tempest-VolumeDependencyTests-1073688899 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:46:02 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-06f709f2-c96f-4177-9730-b4b70fbd154d tempest-VolumeDependencyTests-1073688899 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:46:02 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-06f709f2-c96f-4177-9730-b4b70fbd154d tempest-VolumeDependencyTests-1073688899 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:46:02 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-06f709f2-c96f-4177-9730-b4b70fbd154d tempest-VolumeDependencyTests-1073688899 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:46:02 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-06f709f2-c96f-4177-9730-b4b70fbd154d tempest-VolumeDependencyTests-1073688899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:46:02 devstack sudo[107274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a Aug 03 08:46:02 devstack sudo[107274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:46:02 devstack sudo[107273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-e9903327-6f2d-4671-b88b-ada10347f6bb Aug 03 08:46:02 devstack sudo[107273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:46:02 devstack sudo[107274]: pam_unix(sudo:session): session closed for user root Aug 03 08:46:02 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-06f709f2-c96f-4177-9730-b4b70fbd154d tempest-VolumeDependencyTests-1073688899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a" returned: 0 in 0.306s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:46:02 devstack cinder-volume[88899]: DEBUG cinder.manager [None req-06f709f2-c96f-4177-9730-b4b70fbd154d tempest-VolumeDependencyTests-1073688899 None] Notifying Schedulers of capabilities ... {{(pid=88899) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 08:46:02 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-06f709f2-c96f-4177-9730-b4b70fbd154d tempest-VolumeDependencyTests-1073688899 None] Deleted volume successfully. Aug 03 08:46:02 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-06f709f2-c96f-4177-9730-b4b70fbd154d tempest-VolumeDependencyTests-1073688899 None] Lock "cinder-b993036e-7726-48b6-b4e9-2ab7325b2d63-delete_volume" released by "delete_volume" :: held 1.353s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:46:02 devstack sudo[107273]: pam_unix(sudo:session): session closed for user root Aug 03 08:46:03 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-2fc704b2-c719-444b-994e-14bdb129e9a4 tempest-ProjectReaderTests-2034209105 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-e9903327-6f2d-4671-b88b-ada10347f6bb" returned: 0 in 0.551s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:46:03 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-2fc704b2-c719-444b-994e-14bdb129e9a4 tempest-ProjectReaderTests-2034209105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-e9903327-6f2d-4671-b88b-ada10347f6bb {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:46:03 devstack sudo[107317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-e9903327-6f2d-4671-b88b-ada10347f6bb Aug 03 08:46:03 devstack sudo[107317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:46:03 devstack sudo[107317]: pam_unix(sudo:session): session closed for user root Aug 03 08:46:03 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-2fc704b2-c719-444b-994e-14bdb129e9a4 tempest-ProjectReaderTests-2034209105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-e9903327-6f2d-4671-b88b-ada10347f6bb" returned: 0 in 0.566s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:46:03 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-2fc704b2-c719-444b-994e-14bdb129e9a4 tempest-ProjectReaderTests-2034209105 None] Lock "cinder-quobyte-e9903327-6f2d-4671-b88b-ada10347f6bb" released by "delete_volume" :: held 1.182s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:46:03 devstack cinder-volume[88899]: DEBUG cinder.quota [None req-2fc704b2-c719-444b-994e-14bdb129e9a4 tempest-ProjectReaderTests-2034209105 None] Created reservations ['a47fa111-4dcb-4021-ab25-d91eb30873a0', 'd3b687f8-9aa6-4352-ae4b-45504dad3cd9', '77af8e65-b930-42bd-89a7-11543f88e2d6', '4fe4e24d-627e-419c-9d1f-cc1e92a9c973'] {{(pid=88899) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 08:46:03 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-2fc704b2-c719-444b-994e-14bdb129e9a4 tempest-ProjectReaderTests-2034209105 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:46:03 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-2fc704b2-c719-444b-994e-14bdb129e9a4 tempest-ProjectReaderTests-2034209105 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:46:03 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-2fc704b2-c719-444b-994e-14bdb129e9a4 tempest-ProjectReaderTests-2034209105 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:46:03 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-2fc704b2-c719-444b-994e-14bdb129e9a4 tempest-ProjectReaderTests-2034209105 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:46:03 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-2fc704b2-c719-444b-994e-14bdb129e9a4 tempest-ProjectReaderTests-2034209105 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:46:03 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-2fc704b2-c719-444b-994e-14bdb129e9a4 tempest-ProjectReaderTests-2034209105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:46:03 devstack sudo[107320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a Aug 03 08:46:03 devstack sudo[107320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:46:04 devstack sudo[107320]: pam_unix(sudo:session): session closed for user root Aug 03 08:46:04 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-2fc704b2-c719-444b-994e-14bdb129e9a4 tempest-ProjectReaderTests-2034209105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a" returned: 0 in 0.318s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:46:04 devstack cinder-volume[88899]: DEBUG cinder.manager [None req-2fc704b2-c719-444b-994e-14bdb129e9a4 tempest-ProjectReaderTests-2034209105 None] Notifying Schedulers of capabilities ... {{(pid=88899) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 08:46:04 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-2fc704b2-c719-444b-994e-14bdb129e9a4 tempest-ProjectReaderTests-2034209105 None] Deleted volume successfully. Aug 03 08:46:04 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-2fc704b2-c719-444b-994e-14bdb129e9a4 tempest-ProjectReaderTests-2034209105 None] Lock "cinder-e9903327-6f2d-4671-b88b-ada10347f6bb-delete_volume" released by "delete_volume" :: held 1.792s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:46:05 devstack cinder-volume[88899]: DEBUG cinder.volume.flows.manager.create_volume [None req-c863055d-e9ac-4b6c-89f9-29b9dfc5b06a tempest-ProjectReaderTests-2034209105 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88899) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 08:46:05 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-c863055d-e9ac-4b6c-89f9-29b9dfc5b06a tempest-ProjectReaderTests-2034209105 None] Flow 'volume_create_manager' (b91b8ba7-60d1-429a-852d-865c366312fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:46:05 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-c863055d-e9ac-4b6c-89f9-29b9dfc5b06a tempest-ProjectReaderTests-2034209105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (33eec3a7-d813-4017-b6db-63b124a62442) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:46:05 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-c863055d-e9ac-4b6c-89f9-29b9dfc5b06a tempest-ProjectReaderTests-2034209105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (33eec3a7-d813-4017-b6db-63b124a62442) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:46:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-38414945',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=75c2bd32-3280-4ce6-a5cc-b293e0366a84,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='60b0e0bae6734bc7b4895d6c2ea550de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:46:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:46:05Z,use_quota=True,user_id='5291713768084f098e5d7f65813dad8e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8bde7129-1dc4-42ab-b852-ab32c61b4921),volume_type_id=8bde7129-1dc4-42ab-b852-ab32c61b4921)' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:46:05 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-c863055d-e9ac-4b6c-89f9-29b9dfc5b06a tempest-ProjectReaderTests-2034209105 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (99459fd4-1799-42df-b6ed-8c749ac5e4f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:46:05 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-c863055d-e9ac-4b6c-89f9-29b9dfc5b06a tempest-ProjectReaderTests-2034209105 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (99459fd4-1799-42df-b6ed-8c749ac5e4f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:46:05 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-c863055d-e9ac-4b6c-89f9-29b9dfc5b06a tempest-ProjectReaderTests-2034209105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9bf4105b-692a-4d39-9129-88a62b964c8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:46:05 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-c863055d-e9ac-4b6c-89f9-29b9dfc5b06a tempest-ProjectReaderTests-2034209105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9bf4105b-692a-4d39-9129-88a62b964c8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '75c2bd32-3280-4ce6-a5cc-b293e0366a84', 'volume_name': 'volume-75c2bd32-3280-4ce6-a5cc-b293e0366a84', 'volume_size': 1}' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:46:05 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-c863055d-e9ac-4b6c-89f9-29b9dfc5b06a tempest-ProjectReaderTests-2034209105 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f76ccc33-41a4-44d7-b956-fd4ff03f0546) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:46:05 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-c863055d-e9ac-4b6c-89f9-29b9dfc5b06a tempest-ProjectReaderTests-2034209105 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f76ccc33-41a4-44d7-b956-fd4ff03f0546) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:46:05 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-c863055d-e9ac-4b6c-89f9-29b9dfc5b06a tempest-ProjectReaderTests-2034209105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31e8a106-0c2f-436d-abeb-dc23cc4e6072) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:46:05 devstack cinder-volume[88899]: INFO cinder.volume.flows.manager.create_volume [None req-c863055d-e9ac-4b6c-89f9-29b9dfc5b06a tempest-ProjectReaderTests-2034209105 None] Volume 75c2bd32-3280-4ce6-a5cc-b293e0366a84: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-75c2bd32-3280-4ce6-a5cc-b293e0366a84', 'volume_size': 1} Aug 03 08:46:05 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-c863055d-e9ac-4b6c-89f9-29b9dfc5b06a tempest-ProjectReaderTests-2034209105 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:46:05 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-c863055d-e9ac-4b6c-89f9-29b9dfc5b06a tempest-ProjectReaderTests-2034209105 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:46:05 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-c863055d-e9ac-4b6c-89f9-29b9dfc5b06a tempest-ProjectReaderTests-2034209105 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:46:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-38414945',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=75c2bd32-3280-4ce6-a5cc-b293e0366a84,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='60b0e0bae6734bc7b4895d6c2ea550de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:46:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:46:05Z,use_quota=True,user_id='5291713768084f098e5d7f65813dad8e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8bde7129-1dc4-42ab-b852-ab32c61b4921),volume_type_id=8bde7129-1dc4-42ab-b852-ab32c61b4921)}" {{(pid=88899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 08:46:05 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-c863055d-e9ac-4b6c-89f9-29b9dfc5b06a tempest-ProjectReaderTests-2034209105 None] Creating volume 75c2bd32-3280-4ce6-a5cc-b293e0366a84 {{(pid=88899) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 08:46:05 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-c863055d-e9ac-4b6c-89f9-29b9dfc5b06a tempest-ProjectReaderTests-2034209105 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:46:05 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-c863055d-e9ac-4b6c-89f9-29b9dfc5b06a tempest-ProjectReaderTests-2034209105 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:46:05 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-c863055d-e9ac-4b6c-89f9-29b9dfc5b06a tempest-ProjectReaderTests-2034209105 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:46:05 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-c863055d-e9ac-4b6c-89f9-29b9dfc5b06a tempest-ProjectReaderTests-2034209105 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:46:05 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-c863055d-e9ac-4b6c-89f9-29b9dfc5b06a tempest-ProjectReaderTests-2034209105 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:46:05 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-c863055d-e9ac-4b6c-89f9-29b9dfc5b06a tempest-ProjectReaderTests-2034209105 None] Selected osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385 as target Quobyte volume. {{(pid=88899) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 08:46:05 devstack cinder-volume[88899]: INFO cinder.volume.drivers.remotefs [None req-c863055d-e9ac-4b6c-89f9-29b9dfc5b06a tempest-ProjectReaderTests-2034209105 None] casted to osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385 Aug 03 08:46:05 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-c863055d-e9ac-4b6c-89f9-29b9dfc5b06a tempest-ProjectReaderTests-2034209105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-75c2bd32-3280-4ce6-a5cc-b293e0366a84 1073741824 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:46:05 devstack sudo[107326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-75c2bd32-3280-4ce6-a5cc-b293e0366a84 1073741824 Aug 03 08:46:05 devstack sudo[107326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:46:06 devstack sudo[107326]: pam_unix(sudo:session): session closed for user root Aug 03 08:46:06 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-c863055d-e9ac-4b6c-89f9-29b9dfc5b06a tempest-ProjectReaderTests-2034209105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-75c2bd32-3280-4ce6-a5cc-b293e0366a84 1073741824" returned: 0 in 0.793s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:46:06 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-c863055d-e9ac-4b6c-89f9-29b9dfc5b06a tempest-ProjectReaderTests-2034209105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-75c2bd32-3280-4ce6-a5cc-b293e0366a84 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:46:06 devstack sudo[107332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-75c2bd32-3280-4ce6-a5cc-b293e0366a84 Aug 03 08:46:06 devstack sudo[107332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:46:06 devstack sudo[107332]: pam_unix(sudo:session): session closed for user root Aug 03 08:46:06 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-c863055d-e9ac-4b6c-89f9-29b9dfc5b06a tempest-ProjectReaderTests-2034209105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-75c2bd32-3280-4ce6-a5cc-b293e0366a84" returned: 0 in 0.422s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:46:06 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-c863055d-e9ac-4b6c-89f9-29b9dfc5b06a tempest-ProjectReaderTests-2034209105 None] <== create_volume: return (1296ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'} {{(pid=88899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 08:46:06 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-c863055d-e9ac-4b6c-89f9-29b9dfc5b06a tempest-ProjectReaderTests-2034209105 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.300s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:46:06 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-c863055d-e9ac-4b6c-89f9-29b9dfc5b06a tempest-ProjectReaderTests-2034209105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31e8a106-0c2f-436d-abeb-dc23cc4e6072) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-75c2bd32-3280-4ce6-a5cc-b293e0366a84', 'volume_size': 1}' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:46:06 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-c863055d-e9ac-4b6c-89f9-29b9dfc5b06a tempest-ProjectReaderTests-2034209105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8dc0d6de-5719-4e5c-a363-2b3037b3cd4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:46:06 devstack cinder-volume[88899]: INFO cinder.volume.flows.manager.create_volume [None req-c863055d-e9ac-4b6c-89f9-29b9dfc5b06a tempest-ProjectReaderTests-2034209105 None] Volume volume-75c2bd32-3280-4ce6-a5cc-b293e0366a84 (75c2bd32-3280-4ce6-a5cc-b293e0366a84): created successfully Aug 03 08:46:06 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-c863055d-e9ac-4b6c-89f9-29b9dfc5b06a tempest-ProjectReaderTests-2034209105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8dc0d6de-5719-4e5c-a363-2b3037b3cd4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:46:06 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-c863055d-e9ac-4b6c-89f9-29b9dfc5b06a tempest-ProjectReaderTests-2034209105 None] Flow 'volume_create_manager' (b91b8ba7-60d1-429a-852d-865c366312fc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:46:06 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-c863055d-e9ac-4b6c-89f9-29b9dfc5b06a tempest-ProjectReaderTests-2034209105 None] Created volume successfully. Aug 03 08:46:07 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-f4716982-3573-4017-b39e-69b15a820a15 tempest-ProjectReaderTests-2034209105 None] Acquiring lock "cinder-75c2bd32-3280-4ce6-a5cc-b293e0366a84-delete_volume" by "delete_volume" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:46:07 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-f4716982-3573-4017-b39e-69b15a820a15 tempest-ProjectReaderTests-2034209105 None] Lock "cinder-75c2bd32-3280-4ce6-a5cc-b293e0366a84-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:46:07 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-f4716982-3573-4017-b39e-69b15a820a15 tempest-ProjectReaderTests-2034209105 None] Acquiring lock "cinder-quobyte-75c2bd32-3280-4ce6-a5cc-b293e0366a84" by "delete_volume" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:46:07 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-f4716982-3573-4017-b39e-69b15a820a15 tempest-ProjectReaderTests-2034209105 None] Lock "cinder-quobyte-75c2bd32-3280-4ce6-a5cc-b293e0366a84" acquired by "delete_volume" :: waited 0.031s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:46:07 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[237b1145-15c6-4b60-b79c-263d5d1a4312]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:46:07 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-f4716982-3573-4017-b39e-69b15a820a15 tempest-ProjectReaderTests-2034209105 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-75c2bd32-3280-4ce6-a5cc-b293e0366a84 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:46:07 devstack sudo[107335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-75c2bd32-3280-4ce6-a5cc-b293e0366a84 Aug 03 08:46:07 devstack sudo[107335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:46:08 devstack sudo[107335]: pam_unix(sudo:session): session closed for user root Aug 03 08:46:08 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-f4716982-3573-4017-b39e-69b15a820a15 tempest-ProjectReaderTests-2034209105 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-75c2bd32-3280-4ce6-a5cc-b293e0366a84" returned: 0 in 0.568s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:46:08 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-f4716982-3573-4017-b39e-69b15a820a15 tempest-ProjectReaderTests-2034209105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-75c2bd32-3280-4ce6-a5cc-b293e0366a84 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:46:08 devstack sudo[107340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-75c2bd32-3280-4ce6-a5cc-b293e0366a84 Aug 03 08:46:08 devstack sudo[107340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:46:08 devstack sudo[107340]: pam_unix(sudo:session): session closed for user root Aug 03 08:46:08 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-f4716982-3573-4017-b39e-69b15a820a15 tempest-ProjectReaderTests-2034209105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-75c2bd32-3280-4ce6-a5cc-b293e0366a84" returned: 0 in 0.353s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:46:08 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-f4716982-3573-4017-b39e-69b15a820a15 tempest-ProjectReaderTests-2034209105 None] Lock "cinder-quobyte-75c2bd32-3280-4ce6-a5cc-b293e0366a84" released by "delete_volume" :: held 0.991s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:46:08 devstack cinder-volume[88899]: DEBUG cinder.quota [None req-f4716982-3573-4017-b39e-69b15a820a15 tempest-ProjectReaderTests-2034209105 None] Created reservations ['cb85e30b-ac11-4332-a9e5-431e779b3992', '25c312f8-ee62-489c-b394-4800b49098e2', '88544f2a-71ad-4b99-9ef8-b3a670f6ba5b', '9933d767-4df3-4db2-8b01-a3f2ae567b72'] {{(pid=88899) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 08:46:08 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-f4716982-3573-4017-b39e-69b15a820a15 tempest-ProjectReaderTests-2034209105 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:46:08 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-f4716982-3573-4017-b39e-69b15a820a15 tempest-ProjectReaderTests-2034209105 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:46:08 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-f4716982-3573-4017-b39e-69b15a820a15 tempest-ProjectReaderTests-2034209105 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:46:08 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-f4716982-3573-4017-b39e-69b15a820a15 tempest-ProjectReaderTests-2034209105 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:46:08 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-f4716982-3573-4017-b39e-69b15a820a15 tempest-ProjectReaderTests-2034209105 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:46:08 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-f4716982-3573-4017-b39e-69b15a820a15 tempest-ProjectReaderTests-2034209105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:46:08 devstack sudo[107345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a Aug 03 08:46:08 devstack sudo[107345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:46:09 devstack sudo[107345]: pam_unix(sudo:session): session closed for user root Aug 03 08:46:09 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-f4716982-3573-4017-b39e-69b15a820a15 tempest-ProjectReaderTests-2034209105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a" returned: 0 in 0.334s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:46:09 devstack cinder-volume[88899]: DEBUG cinder.manager [None req-f4716982-3573-4017-b39e-69b15a820a15 tempest-ProjectReaderTests-2034209105 None] Notifying Schedulers of capabilities ... {{(pid=88899) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 08:46:09 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-f4716982-3573-4017-b39e-69b15a820a15 tempest-ProjectReaderTests-2034209105 None] Deleted volume successfully. Aug 03 08:46:09 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-f4716982-3573-4017-b39e-69b15a820a15 tempest-ProjectReaderTests-2034209105 None] Lock "cinder-75c2bd32-3280-4ce6-a5cc-b293e0366a84-delete_volume" released by "delete_volume" :: held 1.711s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:46:11 devstack cinder-volume[88899]: DEBUG cinder.volume.flows.manager.create_volume [None req-2c1d7737-81f7-449d-a122-0ded83666a9a tempest-VolumeImageDependencyTests-1692488225 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88899) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 08:46:11 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-2c1d7737-81f7-449d-a122-0ded83666a9a tempest-VolumeImageDependencyTests-1692488225 None] Flow 'volume_create_manager' (3f187b6f-f25b-4076-ab82-600f6c7addfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:46:11 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-2c1d7737-81f7-449d-a122-0ded83666a9a tempest-VolumeImageDependencyTests-1692488225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cdee65b2-9c1a-4fdd-adb4-e02373f778ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:46:11 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-2c1d7737-81f7-449d-a122-0ded83666a9a tempest-VolumeImageDependencyTests-1692488225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cdee65b2-9c1a-4fdd-adb4-e02373f778ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:46:11Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8856f847-3786-439f-b8c1-bc864a46b06b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5f2073d44fb6478c84cdc92ba34faea6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:46:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:46:12Z,use_quota=True,user_id='5178bef6bbbc4a64812776d11b4731f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8bde7129-1dc4-42ab-b852-ab32c61b4921),volume_type_id=8bde7129-1dc4-42ab-b852-ab32c61b4921)' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:46:11 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-2c1d7737-81f7-449d-a122-0ded83666a9a tempest-VolumeImageDependencyTests-1692488225 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a49e23d0-17e7-4be9-8477-fddd14c95818) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:46:11 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-2c1d7737-81f7-449d-a122-0ded83666a9a tempest-VolumeImageDependencyTests-1692488225 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a49e23d0-17e7-4be9-8477-fddd14c95818) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:46:11 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-2c1d7737-81f7-449d-a122-0ded83666a9a tempest-VolumeImageDependencyTests-1692488225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94c917b9-b42d-4950-922e-9a02194dd1b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:46:11 devstack cinder-volume[88899]: DEBUG cinder.image.glance [None req-2c1d7737-81f7-449d-a122-0ded83666a9a tempest-VolumeImageDependencyTests-1692488225 None] Creating Keystone auth plugin from conf {{(pid=88899) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Aug 03 08:46:12 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-2c1d7737-81f7-449d-a122-0ded83666a9a tempest-VolumeImageDependencyTests-1692488225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94c917b9-b42d-4950-922e-9a02194dd1b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '8856f847-3786-439f-b8c1-bc864a46b06b', 'volume_name': 'volume-8856f847-3786-439f-b8c1-bc864a46b06b', 'volume_size': 1, 'image_id': '4a122e29-d304-4ed4-a154-ee31bea11485', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4a122e29-d304-4ed4-a154-ee31bea11485', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'cc9583f73581afd4a3a0cb2256bd5272', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '5f2073d44fb6478c84cdc92ba34faea6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '7386819b79d04099aa9014f88ca45541121494401877082307675c94902964b7ffb4c0266bf1268d7b38db8a4970a5edc37183519a031ff2ef3997d1f4f24abb', 'id': '4a122e29-d304-4ed4-a154-ee31bea11485', 'created_at': datetime.datetime(2026, 8, 3, 6, 46, 9, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 3, 6, 46, 10, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4a122e29-d304-4ed4-a154-ee31bea11485/file', 'properties': {}}, 'image_service': }' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:46:12 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-2c1d7737-81f7-449d-a122-0ded83666a9a tempest-VolumeImageDependencyTests-1692488225 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2ddaf25-cfef-4e7c-a37e-493caabdf241) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:46:12 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-2c1d7737-81f7-449d-a122-0ded83666a9a tempest-VolumeImageDependencyTests-1692488225 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2ddaf25-cfef-4e7c-a37e-493caabdf241) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:46:12 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-2c1d7737-81f7-449d-a122-0ded83666a9a tempest-VolumeImageDependencyTests-1692488225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87be95a3-ba40-4127-baa2-271cac327653) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:46:12 devstack cinder-volume[88899]: INFO cinder.volume.flows.manager.create_volume [None req-2c1d7737-81f7-449d-a122-0ded83666a9a tempest-VolumeImageDependencyTests-1692488225 None] Volume 8856f847-3786-439f-b8c1-bc864a46b06b: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-8856f847-3786-439f-b8c1-bc864a46b06b', 'volume_size': 1, 'image_id': '4a122e29-d304-4ed4-a154-ee31bea11485', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4a122e29-d304-4ed4-a154-ee31bea11485', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'cc9583f73581afd4a3a0cb2256bd5272', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '5f2073d44fb6478c84cdc92ba34faea6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '7386819b79d04099aa9014f88ca45541121494401877082307675c94902964b7ffb4c0266bf1268d7b38db8a4970a5edc37183519a031ff2ef3997d1f4f24abb', 'id': '4a122e29-d304-4ed4-a154-ee31bea11485', 'created_at': datetime.datetime(2026, 8, 3, 6, 46, 9, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 3, 6, 46, 10, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4a122e29-d304-4ed4-a154-ee31bea11485/file', 'properties': {}}, 'image_service': } Aug 03 08:46:12 devstack cinder-volume[88899]: DEBUG cinder.volume.flows.manager.create_volume [None req-2c1d7737-81f7-449d-a122-0ded83666a9a tempest-VolumeImageDependencyTests-1692488225 None] Trying to clone 8856f847-3786-439f-b8c1-bc864a46b06b from image 4a122e29-d304-4ed4-a154-ee31bea11485 at location (None, [{'url': 'file:///opt/stack/data/glance/images/4a122e29-d304-4ed4-a154-ee31bea11485', 'metadata': {}}]). {{(pid=88899) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Aug 03 08:46:12 devstack cinder-volume[88899]: DEBUG cinder.image.image_utils [None req-2c1d7737-81f7-449d-a122-0ded83666a9a tempest-VolumeImageDependencyTests-1692488225 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_4a122e29-d304-4ed4-a154-ee31bea11485_kiewf5_jdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=88899) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Aug 03 08:46:12 devstack cinder-volume[88899]: INFO cinder.image.image_utils [None req-2c1d7737-81f7-449d-a122-0ded83666a9a tempest-VolumeImageDependencyTests-1692488225 None] Image download 0.00 MB at 0.00 MB/s Aug 03 08:46:12 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba485565-3d6f-4e88-b33f-66245beffc5b]: (4, 'raw') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:46:12 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-2c1d7737-81f7-449d-a122-0ded83666a9a tempest-VolumeImageDependencyTests-1692488225 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4a122e29-d304-4ed4-a154-ee31bea11485_kiewf5_jdevstack@QuobyteHD {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:46:12 devstack sudo[107355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4a122e29-d304-4ed4-a154-ee31bea11485_kiewf5_jdevstack@QuobyteHD Aug 03 08:46:12 devstack sudo[107355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:46:12 devstack sudo[107355]: pam_unix(sudo:session): session closed for user root Aug 03 08:46:12 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-2c1d7737-81f7-449d-a122-0ded83666a9a tempest-VolumeImageDependencyTests-1692488225 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4a122e29-d304-4ed4-a154-ee31bea11485_kiewf5_jdevstack@QuobyteHD" returned: 0 in 0.328s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:46:12 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-2c1d7737-81f7-449d-a122-0ded83666a9a tempest-VolumeImageDependencyTests-1692488225 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4a122e29-d304-4ed4-a154-ee31bea11485_kiewf5_jdevstack@QuobyteHD {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:46:12 devstack sudo[107359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4a122e29-d304-4ed4-a154-ee31bea11485_kiewf5_jdevstack@QuobyteHD Aug 03 08:46:12 devstack sudo[107359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:46:12 devstack sudo[107359]: pam_unix(sudo:session): session closed for user root Aug 03 08:46:12 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-2c1d7737-81f7-449d-a122-0ded83666a9a tempest-VolumeImageDependencyTests-1692488225 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4a122e29-d304-4ed4-a154-ee31bea11485_kiewf5_jdevstack@QuobyteHD" returned: 1 in 0.338s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:46:12 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-2c1d7737-81f7-449d-a122-0ded83666a9a tempest-VolumeImageDependencyTests-1692488225 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4a122e29-d304-4ed4-a154-ee31bea11485_kiewf5_jdevstack@QuobyteHD' failed. Not Retrying. {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 03 08:46:12 devstack cinder-volume[88899]: DEBUG cinder.image.image_utils [None req-2c1d7737-81f7-449d-a122-0ded83666a9a tempest-VolumeImageDependencyTests-1692488225 None] Temporary image 4a122e29-d304-4ed4-a154-ee31bea11485 is fetched for user 5178bef6bbbc4a64812776d11b4731f2. {{(pid=88899) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Aug 03 08:46:13 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[4780885e-6bed-4854-92f9-1819c66f7a65]: (4, 'raw') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:46:13 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-2c1d7737-81f7-449d-a122-0ded83666a9a tempest-VolumeImageDependencyTests-1692488225 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4a122e29-d304-4ed4-a154-ee31bea11485_kiewf5_jdevstack@QuobyteHD {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:46:13 devstack sudo[107364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4a122e29-d304-4ed4-a154-ee31bea11485_kiewf5_jdevstack@QuobyteHD Aug 03 08:46:13 devstack sudo[107364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:46:13 devstack sudo[107364]: pam_unix(sudo:session): session closed for user root Aug 03 08:46:13 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-2c1d7737-81f7-449d-a122-0ded83666a9a tempest-VolumeImageDependencyTests-1692488225 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4a122e29-d304-4ed4-a154-ee31bea11485_kiewf5_jdevstack@QuobyteHD" returned: 0 in 0.371s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:46:13 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-2c1d7737-81f7-449d-a122-0ded83666a9a tempest-VolumeImageDependencyTests-1692488225 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4a122e29-d304-4ed4-a154-ee31bea11485_kiewf5_jdevstack@QuobyteHD {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:46:13 devstack sudo[107368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4a122e29-d304-4ed4-a154-ee31bea11485_kiewf5_jdevstack@QuobyteHD Aug 03 08:46:13 devstack sudo[107368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:46:13 devstack sudo[107368]: pam_unix(sudo:session): session closed for user root Aug 03 08:46:13 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-2c1d7737-81f7-449d-a122-0ded83666a9a tempest-VolumeImageDependencyTests-1692488225 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4a122e29-d304-4ed4-a154-ee31bea11485_kiewf5_jdevstack@QuobyteHD" returned: 1 in 0.372s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:46:13 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-2c1d7737-81f7-449d-a122-0ded83666a9a tempest-VolumeImageDependencyTests-1692488225 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4a122e29-d304-4ed4-a154-ee31bea11485_kiewf5_jdevstack@QuobyteHD' failed. Not Retrying. {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 03 08:46:13 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-2c1d7737-81f7-449d-a122-0ded83666a9a tempest-VolumeImageDependencyTests-1692488225 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:46:13 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-2c1d7737-81f7-449d-a122-0ded83666a9a tempest-VolumeImageDependencyTests-1692488225 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:46:13 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-2c1d7737-81f7-449d-a122-0ded83666a9a tempest-VolumeImageDependencyTests-1692488225 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:46:11Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8856f847-3786-439f-b8c1-bc864a46b06b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5f2073d44fb6478c84cdc92ba34faea6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:46:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:46:12Z,use_quota=True,user_id='5178bef6bbbc4a64812776d11b4731f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8bde7129-1dc4-42ab-b852-ab32c61b4921),volume_type_id=8bde7129-1dc4-42ab-b852-ab32c61b4921)}" {{(pid=88899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 08:46:13 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-2c1d7737-81f7-449d-a122-0ded83666a9a tempest-VolumeImageDependencyTests-1692488225 None] Creating volume 8856f847-3786-439f-b8c1-bc864a46b06b {{(pid=88899) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 08:46:13 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-2c1d7737-81f7-449d-a122-0ded83666a9a tempest-VolumeImageDependencyTests-1692488225 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:46:13 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-2c1d7737-81f7-449d-a122-0ded83666a9a tempest-VolumeImageDependencyTests-1692488225 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:46:13 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-2c1d7737-81f7-449d-a122-0ded83666a9a tempest-VolumeImageDependencyTests-1692488225 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:46:13 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-2c1d7737-81f7-449d-a122-0ded83666a9a tempest-VolumeImageDependencyTests-1692488225 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:46:13 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-2c1d7737-81f7-449d-a122-0ded83666a9a tempest-VolumeImageDependencyTests-1692488225 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:46:13 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-2c1d7737-81f7-449d-a122-0ded83666a9a tempest-VolumeImageDependencyTests-1692488225 None] Selected osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385 as target Quobyte volume. {{(pid=88899) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 08:46:13 devstack cinder-volume[88899]: INFO cinder.volume.drivers.remotefs [None req-2c1d7737-81f7-449d-a122-0ded83666a9a tempest-VolumeImageDependencyTests-1692488225 None] casted to osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385 Aug 03 08:46:13 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-2c1d7737-81f7-449d-a122-0ded83666a9a tempest-VolumeImageDependencyTests-1692488225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-8856f847-3786-439f-b8c1-bc864a46b06b 1073741824 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:46:13 devstack sudo[107373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-8856f847-3786-439f-b8c1-bc864a46b06b 1073741824 Aug 03 08:46:13 devstack sudo[107373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:46:14 devstack sudo[107373]: pam_unix(sudo:session): session closed for user root Aug 03 08:46:14 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-2c1d7737-81f7-449d-a122-0ded83666a9a tempest-VolumeImageDependencyTests-1692488225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-8856f847-3786-439f-b8c1-bc864a46b06b 1073741824" returned: 0 in 0.478s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:46:14 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-2c1d7737-81f7-449d-a122-0ded83666a9a tempest-VolumeImageDependencyTests-1692488225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-8856f847-3786-439f-b8c1-bc864a46b06b {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:46:14 devstack sudo[107378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-8856f847-3786-439f-b8c1-bc864a46b06b Aug 03 08:46:14 devstack sudo[107378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:46:14 devstack sudo[107378]: pam_unix(sudo:session): session closed for user root Aug 03 08:46:14 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-2c1d7737-81f7-449d-a122-0ded83666a9a tempest-VolumeImageDependencyTests-1692488225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-8856f847-3786-439f-b8c1-bc864a46b06b" returned: 0 in 0.239s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:46:14 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-2c1d7737-81f7-449d-a122-0ded83666a9a tempest-VolumeImageDependencyTests-1692488225 None] <== create_volume: return (761ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'} {{(pid=88899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 08:46:14 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-2c1d7737-81f7-449d-a122-0ded83666a9a tempest-VolumeImageDependencyTests-1692488225 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.764s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:46:14 devstack cinder-volume[88899]: DEBUG cinder.volume.volume_utils [None req-2c1d7737-81f7-449d-a122-0ded83666a9a tempest-VolumeImageDependencyTests-1692488225 None] Attempting download of 4a122e29-d304-4ed4-a154-ee31bea11485 ((None, [{'url': 'file:///opt/stack/data/glance/images/4a122e29-d304-4ed4-a154-ee31bea11485', 'metadata': {}}])) to volume 8856f847-3786-439f-b8c1-bc864a46b06b. {{(pid=88899) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Aug 03 08:46:14 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5e30dac-564e-4d84-a2ff-535b3ab98ef1]: (4, 'raw') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:46:14 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-2c1d7737-81f7-449d-a122-0ded83666a9a tempest-VolumeImageDependencyTests-1692488225 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4a122e29-d304-4ed4-a154-ee31bea11485_qd0pw_92 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:46:14 devstack sudo[107381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4a122e29-d304-4ed4-a154-ee31bea11485_qd0pw_92 Aug 03 08:46:14 devstack sudo[107381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:46:14 devstack sudo[107381]: pam_unix(sudo:session): session closed for user root Aug 03 08:46:14 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-2c1d7737-81f7-449d-a122-0ded83666a9a tempest-VolumeImageDependencyTests-1692488225 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4a122e29-d304-4ed4-a154-ee31bea11485_qd0pw_92" returned: 0 in 0.324s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:46:14 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-2c1d7737-81f7-449d-a122-0ded83666a9a tempest-VolumeImageDependencyTests-1692488225 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4a122e29-d304-4ed4-a154-ee31bea11485_qd0pw_92 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:46:15 devstack sudo[107385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4a122e29-d304-4ed4-a154-ee31bea11485_qd0pw_92 Aug 03 08:46:15 devstack sudo[107385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:46:15 devstack sudo[107385]: pam_unix(sudo:session): session closed for user root Aug 03 08:46:15 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-2c1d7737-81f7-449d-a122-0ded83666a9a tempest-VolumeImageDependencyTests-1692488225 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4a122e29-d304-4ed4-a154-ee31bea11485_qd0pw_92" returned: 1 in 0.329s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:46:15 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-2c1d7737-81f7-449d-a122-0ded83666a9a tempest-VolumeImageDependencyTests-1692488225 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4a122e29-d304-4ed4-a154-ee31bea11485_qd0pw_92' failed. Not Retrying. {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 03 08:46:15 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[4286b805-15ce-41eb-a1f8-67d86bb9d027]: (4, 'raw') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:46:15 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-2c1d7737-81f7-449d-a122-0ded83666a9a tempest-VolumeImageDependencyTests-1692488225 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4a122e29-d304-4ed4-a154-ee31bea11485_kiewf5_jdevstack@QuobyteHD {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:46:15 devstack sudo[107389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4a122e29-d304-4ed4-a154-ee31bea11485_kiewf5_jdevstack@QuobyteHD Aug 03 08:46:15 devstack sudo[107389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:46:15 devstack sudo[107389]: pam_unix(sudo:session): session closed for user root Aug 03 08:46:15 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-2c1d7737-81f7-449d-a122-0ded83666a9a tempest-VolumeImageDependencyTests-1692488225 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4a122e29-d304-4ed4-a154-ee31bea11485_kiewf5_jdevstack@QuobyteHD" returned: 0 in 0.340s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:46:15 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-2c1d7737-81f7-449d-a122-0ded83666a9a tempest-VolumeImageDependencyTests-1692488225 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4a122e29-d304-4ed4-a154-ee31bea11485_kiewf5_jdevstack@QuobyteHD {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:46:15 devstack sudo[107393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4a122e29-d304-4ed4-a154-ee31bea11485_kiewf5_jdevstack@QuobyteHD Aug 03 08:46:15 devstack sudo[107393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:46:15 devstack sudo[107393]: pam_unix(sudo:session): session closed for user root Aug 03 08:46:15 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-2c1d7737-81f7-449d-a122-0ded83666a9a tempest-VolumeImageDependencyTests-1692488225 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4a122e29-d304-4ed4-a154-ee31bea11485_kiewf5_jdevstack@QuobyteHD" returned: 1 in 0.336s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:46:15 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-2c1d7737-81f7-449d-a122-0ded83666a9a tempest-VolumeImageDependencyTests-1692488225 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4a122e29-d304-4ed4-a154-ee31bea11485_kiewf5_jdevstack@QuobyteHD' failed. Not Retrying. {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 03 08:46:15 devstack cinder-volume[88899]: DEBUG cinder.image.image_utils [None req-2c1d7737-81f7-449d-a122-0ded83666a9a tempest-VolumeImageDependencyTests-1692488225 None] 4a122e29-d304-4ed4-a154-ee31bea11485 was raw, converting to qcow2 {{(pid=88899) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Aug 03 08:46:15 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-2c1d7737-81f7-449d-a122-0ded83666a9a tempest-VolumeImageDependencyTests-1692488225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_4a122e29-d304-4ed4-a154-ee31bea11485_kiewf5_jdevstack@QuobyteHD /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-8856f847-3786-439f-b8c1-bc864a46b06b {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:46:16 devstack sudo[107398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_4a122e29-d304-4ed4-a154-ee31bea11485_kiewf5_jdevstack@QuobyteHD /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-8856f847-3786-439f-b8c1-bc864a46b06b Aug 03 08:46:16 devstack sudo[107398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:46:16 devstack sudo[107398]: pam_unix(sudo:session): session closed for user root Aug 03 08:46:16 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-2c1d7737-81f7-449d-a122-0ded83666a9a tempest-VolumeImageDependencyTests-1692488225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_4a122e29-d304-4ed4-a154-ee31bea11485_kiewf5_jdevstack@QuobyteHD /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-8856f847-3786-439f-b8c1-bc864a46b06b" returned: 0 in 0.495s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:46:16 devstack cinder-volume[88899]: DEBUG cinder.image.image_utils [None req-2c1d7737-81f7-449d-a122-0ded83666a9a tempest-VolumeImageDependencyTests-1692488225 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_4a122e29-d304-4ed4-a154-ee31bea11485_kiewf5_jdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-8856f847-3786-439f-b8c1-bc864a46b06b {{(pid=88899) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 03 08:46:16 devstack cinder-volume[88899]: INFO cinder.image.image_utils [None req-2c1d7737-81f7-449d-a122-0ded83666a9a tempest-VolumeImageDependencyTests-1692488225 None] Converted 0.00 MB image at 0.00 MB/s Aug 03 08:46:16 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-2c1d7737-81f7-449d-a122-0ded83666a9a tempest-VolumeImageDependencyTests-1692488225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-8856f847-3786-439f-b8c1-bc864a46b06b 1G {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:46:16 devstack sudo[107404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-8856f847-3786-439f-b8c1-bc864a46b06b 1G Aug 03 08:46:16 devstack sudo[107404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:46:16 devstack sudo[107404]: pam_unix(sudo:session): session closed for user root Aug 03 08:46:16 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-2c1d7737-81f7-449d-a122-0ded83666a9a tempest-VolumeImageDependencyTests-1692488225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-8856f847-3786-439f-b8c1-bc864a46b06b 1G" returned: 0 in 0.365s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:46:16 devstack cinder-volume[88899]: DEBUG cinder.volume.volume_utils [None req-2c1d7737-81f7-449d-a122-0ded83666a9a tempest-VolumeImageDependencyTests-1692488225 None] Downloaded image 4a122e29-d304-4ed4-a154-ee31bea11485 ((None, [{'url': 'file:///opt/stack/data/glance/images/4a122e29-d304-4ed4-a154-ee31bea11485', 'metadata': {}}])) to volume 8856f847-3786-439f-b8c1-bc864a46b06b successfully. {{(pid=88899) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Aug 03 08:46:16 devstack cinder-volume[88899]: DEBUG cinder.image.image_utils [None req-2c1d7737-81f7-449d-a122-0ded83666a9a tempest-VolumeImageDependencyTests-1692488225 None] Temporary image 4a122e29-d304-4ed4-a154-ee31bea11485 for user 5178bef6bbbc4a64812776d11b4731f2 is deleted. {{(pid=88899) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Aug 03 08:46:16 devstack cinder-volume[88899]: DEBUG cinder.volume.volume_utils [None req-2c1d7737-81f7-449d-a122-0ded83666a9a tempest-VolumeImageDependencyTests-1692488225 None] Marking volume 8856f847-3786-439f-b8c1-bc864a46b06b as bootable. {{(pid=88899) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Aug 03 08:46:16 devstack cinder-volume[88899]: DEBUG cinder.volume.flows.manager.create_volume [None req-2c1d7737-81f7-449d-a122-0ded83666a9a tempest-VolumeImageDependencyTests-1692488225 None] Copying metadata from image 4a122e29-d304-4ed4-a154-ee31bea11485 to 8856f847-3786-439f-b8c1-bc864a46b06b. {{(pid=88899) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Aug 03 08:46:16 devstack cinder-volume[88899]: DEBUG cinder.volume.flows.manager.create_volume [None req-2c1d7737-81f7-449d-a122-0ded83666a9a tempest-VolumeImageDependencyTests-1692488225 None] Creating volume glance metadata for volume 8856f847-3786-439f-b8c1-bc864a46b06b backed by image 4a122e29-d304-4ed4-a154-ee31bea11485 with: {'image_id': '4a122e29-d304-4ed4-a154-ee31bea11485', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': 'cc9583f73581afd4a3a0cb2256bd5272', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=88899) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Aug 03 08:46:16 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-2c1d7737-81f7-449d-a122-0ded83666a9a tempest-VolumeImageDependencyTests-1692488225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87be95a3-ba40-4127-baa2-271cac327653) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8856f847-3786-439f-b8c1-bc864a46b06b', 'volume_size': 1, 'image_id': '4a122e29-d304-4ed4-a154-ee31bea11485', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4a122e29-d304-4ed4-a154-ee31bea11485', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'cc9583f73581afd4a3a0cb2256bd5272', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '5f2073d44fb6478c84cdc92ba34faea6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '7386819b79d04099aa9014f88ca45541121494401877082307675c94902964b7ffb4c0266bf1268d7b38db8a4970a5edc37183519a031ff2ef3997d1f4f24abb', 'id': '4a122e29-d304-4ed4-a154-ee31bea11485', 'created_at': datetime.datetime(2026, 8, 3, 6, 46, 9, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 3, 6, 46, 10, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4a122e29-d304-4ed4-a154-ee31bea11485/file', 'properties': {}}, 'image_service': }' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:46:16 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-2c1d7737-81f7-449d-a122-0ded83666a9a tempest-VolumeImageDependencyTests-1692488225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6837fc31-cd81-469b-9951-b4cf53411a6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:46:16 devstack cinder-volume[88899]: INFO cinder.volume.flows.manager.create_volume [None req-2c1d7737-81f7-449d-a122-0ded83666a9a tempest-VolumeImageDependencyTests-1692488225 None] Volume volume-8856f847-3786-439f-b8c1-bc864a46b06b (8856f847-3786-439f-b8c1-bc864a46b06b): created successfully Aug 03 08:46:16 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-2c1d7737-81f7-449d-a122-0ded83666a9a tempest-VolumeImageDependencyTests-1692488225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6837fc31-cd81-469b-9951-b4cf53411a6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:46:16 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-2c1d7737-81f7-449d-a122-0ded83666a9a tempest-VolumeImageDependencyTests-1692488225 None] Flow 'volume_create_manager' (3f187b6f-f25b-4076-ab82-600f6c7addfb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:46:17 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-2c1d7737-81f7-449d-a122-0ded83666a9a tempest-VolumeImageDependencyTests-1692488225 None] Created volume successfully. Aug 03 08:46:17 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-9a9ccc94-b390-477d-9977-06a493d324a2 tempest-VolumeImageDependencyTests-1692488225 None] Acquiring lock "cinder-8856f847-3786-439f-b8c1-bc864a46b06b-delete_volume" by "delete_volume" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:46:17 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-9a9ccc94-b390-477d-9977-06a493d324a2 tempest-VolumeImageDependencyTests-1692488225 None] Lock "cinder-8856f847-3786-439f-b8c1-bc864a46b06b-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:46:18 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-9a9ccc94-b390-477d-9977-06a493d324a2 tempest-VolumeImageDependencyTests-1692488225 None] Acquiring lock "cinder-quobyte-8856f847-3786-439f-b8c1-bc864a46b06b" by "delete_volume" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:46:18 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-9a9ccc94-b390-477d-9977-06a493d324a2 tempest-VolumeImageDependencyTests-1692488225 None] Lock "cinder-quobyte-8856f847-3786-439f-b8c1-bc864a46b06b" acquired by "delete_volume" :: waited 0.023s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:46:18 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[888e7557-684c-4356-8d92-ea3ba1f52447]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:46:18 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-9a9ccc94-b390-477d-9977-06a493d324a2 tempest-VolumeImageDependencyTests-1692488225 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-8856f847-3786-439f-b8c1-bc864a46b06b {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:46:18 devstack sudo[107409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-8856f847-3786-439f-b8c1-bc864a46b06b Aug 03 08:46:18 devstack sudo[107409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:46:18 devstack sudo[107409]: pam_unix(sudo:session): session closed for user root Aug 03 08:46:18 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-9a9ccc94-b390-477d-9977-06a493d324a2 tempest-VolumeImageDependencyTests-1692488225 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-8856f847-3786-439f-b8c1-bc864a46b06b" returned: 0 in 0.388s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:46:18 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-9a9ccc94-b390-477d-9977-06a493d324a2 tempest-VolumeImageDependencyTests-1692488225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-8856f847-3786-439f-b8c1-bc864a46b06b {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:46:18 devstack sudo[107417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-8856f847-3786-439f-b8c1-bc864a46b06b Aug 03 08:46:18 devstack sudo[107417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:46:18 devstack sudo[107417]: pam_unix(sudo:session): session closed for user root Aug 03 08:46:18 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-9a9ccc94-b390-477d-9977-06a493d324a2 tempest-VolumeImageDependencyTests-1692488225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-8856f847-3786-439f-b8c1-bc864a46b06b" returned: 0 in 0.253s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:46:18 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-9a9ccc94-b390-477d-9977-06a493d324a2 tempest-VolumeImageDependencyTests-1692488225 None] Lock "cinder-quobyte-8856f847-3786-439f-b8c1-bc864a46b06b" released by "delete_volume" :: held 0.683s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:46:18 devstack cinder-volume[88899]: DEBUG cinder.quota [None req-9a9ccc94-b390-477d-9977-06a493d324a2 tempest-VolumeImageDependencyTests-1692488225 None] Created reservations ['da07c32b-8e1a-4ee7-b939-b835a82a2876', 'fab22c05-0ec5-42b4-af0f-fc9624342601', '57ae46f3-fd85-4937-95ff-16b0745df2b6', '588d439e-e87e-4220-8785-c9055d572db9'] {{(pid=88899) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 08:46:18 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-9a9ccc94-b390-477d-9977-06a493d324a2 tempest-VolumeImageDependencyTests-1692488225 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:46:18 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-9a9ccc94-b390-477d-9977-06a493d324a2 tempest-VolumeImageDependencyTests-1692488225 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:46:18 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-9a9ccc94-b390-477d-9977-06a493d324a2 tempest-VolumeImageDependencyTests-1692488225 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:46:18 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-9a9ccc94-b390-477d-9977-06a493d324a2 tempest-VolumeImageDependencyTests-1692488225 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:46:18 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-9a9ccc94-b390-477d-9977-06a493d324a2 tempest-VolumeImageDependencyTests-1692488225 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:46:18 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-9a9ccc94-b390-477d-9977-06a493d324a2 tempest-VolumeImageDependencyTests-1692488225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:46:18 devstack sudo[107422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a Aug 03 08:46:18 devstack sudo[107422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:46:19 devstack sudo[107422]: pam_unix(sudo:session): session closed for user root Aug 03 08:46:19 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-9a9ccc94-b390-477d-9977-06a493d324a2 tempest-VolumeImageDependencyTests-1692488225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a" returned: 0 in 0.334s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:46:19 devstack cinder-volume[88899]: DEBUG cinder.manager [None req-9a9ccc94-b390-477d-9977-06a493d324a2 tempest-VolumeImageDependencyTests-1692488225 None] Notifying Schedulers of capabilities ... {{(pid=88899) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 08:46:19 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-9a9ccc94-b390-477d-9977-06a493d324a2 tempest-VolumeImageDependencyTests-1692488225 None] Deleted volume successfully. Aug 03 08:46:19 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-9a9ccc94-b390-477d-9977-06a493d324a2 tempest-VolumeImageDependencyTests-1692488225 None] Lock "cinder-8856f847-3786-439f-b8c1-bc864a46b06b-delete_volume" released by "delete_volume" :: held 1.274s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:46:21 devstack cinder-volume[88899]: DEBUG cinder.volume.flows.manager.create_volume [None req-16e3d31d-64e5-403c-b6fd-4f930c5996dc tempest-VolumeImageDependencyTests-1692488225 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88899) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 08:46:21 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-16e3d31d-64e5-403c-b6fd-4f930c5996dc tempest-VolumeImageDependencyTests-1692488225 None] Flow 'volume_create_manager' (4fa2f890-9c25-4a8b-b93a-c7773c43f5c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:46:21 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-16e3d31d-64e5-403c-b6fd-4f930c5996dc tempest-VolumeImageDependencyTests-1692488225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (549d69bd-f278-4c49-9a0d-951e84140390) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:46:22 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-16e3d31d-64e5-403c-b6fd-4f930c5996dc tempest-VolumeImageDependencyTests-1692488225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (549d69bd-f278-4c49-9a0d-951e84140390) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:46:22Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test0e20bd6e-440f-41d8-9b5d-fc047ac00423',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=456bdf0f-de2e-46bc-9220-57f0d7a122bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5f2073d44fb6478c84cdc92ba34faea6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:46:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:46:22Z,use_quota=True,user_id='5178bef6bbbc4a64812776d11b4731f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8bde7129-1dc4-42ab-b852-ab32c61b4921),volume_type_id=8bde7129-1dc4-42ab-b852-ab32c61b4921)' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:46:22 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-16e3d31d-64e5-403c-b6fd-4f930c5996dc tempest-VolumeImageDependencyTests-1692488225 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32a3d6d2-39ea-4f78-af34-c2a97dcdae88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:46:22 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-16e3d31d-64e5-403c-b6fd-4f930c5996dc tempest-VolumeImageDependencyTests-1692488225 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32a3d6d2-39ea-4f78-af34-c2a97dcdae88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:46:22 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-16e3d31d-64e5-403c-b6fd-4f930c5996dc tempest-VolumeImageDependencyTests-1692488225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (150bb4c1-b46d-4799-98ee-8be1c00df94a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:46:22 devstack cinder-volume[88899]: DEBUG cinder.image.glance [None req-16e3d31d-64e5-403c-b6fd-4f930c5996dc tempest-VolumeImageDependencyTests-1692488225 None] Creating Keystone auth plugin from conf {{(pid=88899) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Aug 03 08:46:22 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-16e3d31d-64e5-403c-b6fd-4f930c5996dc tempest-VolumeImageDependencyTests-1692488225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (150bb4c1-b46d-4799-98ee-8be1c00df94a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '456bdf0f-de2e-46bc-9220-57f0d7a122bb', 'volume_name': 'volume-456bdf0f-de2e-46bc-9220-57f0d7a122bb', 'volume_size': 1, 'image_id': '11823ba0-f289-45d1-8f43-809b9a648101', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/11823ba0-f289-45d1-8f43-809b9a648101', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-0e20bd6e-440f-41d8-9b5d-fc047ac00423', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '490018a8d01074db3ae9f01228db080b', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '5f2073d44fb6478c84cdc92ba34faea6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '178fb92d88a2cb384cf9db53c0a1e3b4b17a6c1b82948b2303d98c489f85d2562cc8ab9d14436cc4f0b777154cd5ed5acc9e04fac7275e86f9675398110cc26f', 'id': '11823ba0-f289-45d1-8f43-809b9a648101', 'created_at': datetime.datetime(2026, 8, 3, 6, 46, 20, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 3, 6, 46, 21, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/11823ba0-f289-45d1-8f43-809b9a648101/file', 'properties': {}}, 'image_service': }' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:46:22 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-16e3d31d-64e5-403c-b6fd-4f930c5996dc tempest-VolumeImageDependencyTests-1692488225 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (613a60b0-e181-42c3-a6ae-e950304b3192) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:46:22 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-16e3d31d-64e5-403c-b6fd-4f930c5996dc tempest-VolumeImageDependencyTests-1692488225 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (613a60b0-e181-42c3-a6ae-e950304b3192) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:46:22 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-16e3d31d-64e5-403c-b6fd-4f930c5996dc tempest-VolumeImageDependencyTests-1692488225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c40b8b2-2ce5-4584-a5b4-60b20bcc2343) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:46:22 devstack cinder-volume[88899]: INFO cinder.volume.flows.manager.create_volume [None req-16e3d31d-64e5-403c-b6fd-4f930c5996dc tempest-VolumeImageDependencyTests-1692488225 None] Volume 456bdf0f-de2e-46bc-9220-57f0d7a122bb: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-456bdf0f-de2e-46bc-9220-57f0d7a122bb', 'volume_size': 1, 'image_id': '11823ba0-f289-45d1-8f43-809b9a648101', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/11823ba0-f289-45d1-8f43-809b9a648101', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-0e20bd6e-440f-41d8-9b5d-fc047ac00423', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '490018a8d01074db3ae9f01228db080b', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '5f2073d44fb6478c84cdc92ba34faea6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '178fb92d88a2cb384cf9db53c0a1e3b4b17a6c1b82948b2303d98c489f85d2562cc8ab9d14436cc4f0b777154cd5ed5acc9e04fac7275e86f9675398110cc26f', 'id': '11823ba0-f289-45d1-8f43-809b9a648101', 'created_at': datetime.datetime(2026, 8, 3, 6, 46, 20, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 3, 6, 46, 21, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/11823ba0-f289-45d1-8f43-809b9a648101/file', 'properties': {}}, 'image_service': } Aug 03 08:46:22 devstack cinder-volume[88899]: DEBUG cinder.volume.flows.manager.create_volume [None req-16e3d31d-64e5-403c-b6fd-4f930c5996dc tempest-VolumeImageDependencyTests-1692488225 None] Trying to clone 456bdf0f-de2e-46bc-9220-57f0d7a122bb from image 11823ba0-f289-45d1-8f43-809b9a648101 at location (None, [{'url': 'file:///opt/stack/data/glance/images/11823ba0-f289-45d1-8f43-809b9a648101', 'metadata': {}}]). {{(pid=88899) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Aug 03 08:46:22 devstack cinder-volume[88899]: DEBUG cinder.image.image_utils [None req-16e3d31d-64e5-403c-b6fd-4f930c5996dc tempest-VolumeImageDependencyTests-1692488225 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_11823ba0-f289-45d1-8f43-809b9a648101_zm01o7bhdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=88899) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Aug 03 08:46:22 devstack cinder-volume[88899]: INFO cinder.image.image_utils [None req-16e3d31d-64e5-403c-b6fd-4f930c5996dc tempest-VolumeImageDependencyTests-1692488225 None] Image download 0.00 MB at 0.00 MB/s Aug 03 08:46:22 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[60eb4568-6a1f-4b84-9c96-ccccbf32bb65]: (4, 'raw') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:46:22 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-16e3d31d-64e5-403c-b6fd-4f930c5996dc tempest-VolumeImageDependencyTests-1692488225 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_11823ba0-f289-45d1-8f43-809b9a648101_zm01o7bhdevstack@QuobyteHD {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:46:22 devstack sudo[107455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_11823ba0-f289-45d1-8f43-809b9a648101_zm01o7bhdevstack@QuobyteHD Aug 03 08:46:22 devstack sudo[107455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:46:22 devstack sudo[107455]: pam_unix(sudo:session): session closed for user root Aug 03 08:46:22 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-16e3d31d-64e5-403c-b6fd-4f930c5996dc tempest-VolumeImageDependencyTests-1692488225 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_11823ba0-f289-45d1-8f43-809b9a648101_zm01o7bhdevstack@QuobyteHD" returned: 0 in 0.320s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:46:22 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-16e3d31d-64e5-403c-b6fd-4f930c5996dc tempest-VolumeImageDependencyTests-1692488225 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_11823ba0-f289-45d1-8f43-809b9a648101_zm01o7bhdevstack@QuobyteHD {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:46:22 devstack sudo[107459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_11823ba0-f289-45d1-8f43-809b9a648101_zm01o7bhdevstack@QuobyteHD Aug 03 08:46:22 devstack sudo[107459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:46:23 devstack sudo[107459]: pam_unix(sudo:session): session closed for user root Aug 03 08:46:23 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-16e3d31d-64e5-403c-b6fd-4f930c5996dc tempest-VolumeImageDependencyTests-1692488225 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_11823ba0-f289-45d1-8f43-809b9a648101_zm01o7bhdevstack@QuobyteHD" returned: 1 in 0.309s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:46:23 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-16e3d31d-64e5-403c-b6fd-4f930c5996dc tempest-VolumeImageDependencyTests-1692488225 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_11823ba0-f289-45d1-8f43-809b9a648101_zm01o7bhdevstack@QuobyteHD' failed. Not Retrying. {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 03 08:46:23 devstack cinder-volume[88899]: DEBUG cinder.image.image_utils [None req-16e3d31d-64e5-403c-b6fd-4f930c5996dc tempest-VolumeImageDependencyTests-1692488225 None] Temporary image 11823ba0-f289-45d1-8f43-809b9a648101 is fetched for user 5178bef6bbbc4a64812776d11b4731f2. {{(pid=88899) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Aug 03 08:46:23 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e76e928-b11f-4b43-b38f-c82f648dc22a]: (4, 'raw') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:46:23 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-16e3d31d-64e5-403c-b6fd-4f930c5996dc tempest-VolumeImageDependencyTests-1692488225 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_11823ba0-f289-45d1-8f43-809b9a648101_zm01o7bhdevstack@QuobyteHD {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:46:23 devstack sudo[107464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_11823ba0-f289-45d1-8f43-809b9a648101_zm01o7bhdevstack@QuobyteHD Aug 03 08:46:23 devstack sudo[107464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:46:23 devstack sudo[107464]: pam_unix(sudo:session): session closed for user root Aug 03 08:46:23 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-16e3d31d-64e5-403c-b6fd-4f930c5996dc tempest-VolumeImageDependencyTests-1692488225 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_11823ba0-f289-45d1-8f43-809b9a648101_zm01o7bhdevstack@QuobyteHD" returned: 0 in 0.324s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:46:23 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-16e3d31d-64e5-403c-b6fd-4f930c5996dc tempest-VolumeImageDependencyTests-1692488225 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_11823ba0-f289-45d1-8f43-809b9a648101_zm01o7bhdevstack@QuobyteHD {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:46:23 devstack sudo[107468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_11823ba0-f289-45d1-8f43-809b9a648101_zm01o7bhdevstack@QuobyteHD Aug 03 08:46:23 devstack sudo[107468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:46:23 devstack sudo[107468]: pam_unix(sudo:session): session closed for user root Aug 03 08:46:23 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-16e3d31d-64e5-403c-b6fd-4f930c5996dc tempest-VolumeImageDependencyTests-1692488225 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_11823ba0-f289-45d1-8f43-809b9a648101_zm01o7bhdevstack@QuobyteHD" returned: 1 in 0.314s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:46:23 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-16e3d31d-64e5-403c-b6fd-4f930c5996dc tempest-VolumeImageDependencyTests-1692488225 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_11823ba0-f289-45d1-8f43-809b9a648101_zm01o7bhdevstack@QuobyteHD' failed. Not Retrying. {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 03 08:46:23 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-16e3d31d-64e5-403c-b6fd-4f930c5996dc tempest-VolumeImageDependencyTests-1692488225 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:46:23 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-16e3d31d-64e5-403c-b6fd-4f930c5996dc tempest-VolumeImageDependencyTests-1692488225 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:46:23 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-16e3d31d-64e5-403c-b6fd-4f930c5996dc tempest-VolumeImageDependencyTests-1692488225 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:46:22Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test0e20bd6e-440f-41d8-9b5d-fc047ac00423',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=456bdf0f-de2e-46bc-9220-57f0d7a122bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5f2073d44fb6478c84cdc92ba34faea6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:46:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:46:22Z,use_quota=True,user_id='5178bef6bbbc4a64812776d11b4731f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8bde7129-1dc4-42ab-b852-ab32c61b4921),volume_type_id=8bde7129-1dc4-42ab-b852-ab32c61b4921)}" {{(pid=88899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 08:46:23 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-16e3d31d-64e5-403c-b6fd-4f930c5996dc tempest-VolumeImageDependencyTests-1692488225 None] Creating volume 456bdf0f-de2e-46bc-9220-57f0d7a122bb {{(pid=88899) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 08:46:23 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-16e3d31d-64e5-403c-b6fd-4f930c5996dc tempest-VolumeImageDependencyTests-1692488225 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:46:23 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-16e3d31d-64e5-403c-b6fd-4f930c5996dc tempest-VolumeImageDependencyTests-1692488225 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:46:23 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-16e3d31d-64e5-403c-b6fd-4f930c5996dc tempest-VolumeImageDependencyTests-1692488225 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:46:23 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-16e3d31d-64e5-403c-b6fd-4f930c5996dc tempest-VolumeImageDependencyTests-1692488225 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:46:23 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-16e3d31d-64e5-403c-b6fd-4f930c5996dc tempest-VolumeImageDependencyTests-1692488225 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:46:23 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-16e3d31d-64e5-403c-b6fd-4f930c5996dc tempest-VolumeImageDependencyTests-1692488225 None] Selected osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385 as target Quobyte volume. {{(pid=88899) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 08:46:23 devstack cinder-volume[88899]: INFO cinder.volume.drivers.remotefs [None req-16e3d31d-64e5-403c-b6fd-4f930c5996dc tempest-VolumeImageDependencyTests-1692488225 None] casted to osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385 Aug 03 08:46:23 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-16e3d31d-64e5-403c-b6fd-4f930c5996dc tempest-VolumeImageDependencyTests-1692488225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-456bdf0f-de2e-46bc-9220-57f0d7a122bb 1073741824 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:46:23 devstack sudo[107473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-456bdf0f-de2e-46bc-9220-57f0d7a122bb 1073741824 Aug 03 08:46:23 devstack sudo[107473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:46:24 devstack sudo[107473]: pam_unix(sudo:session): session closed for user root Aug 03 08:46:24 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-16e3d31d-64e5-403c-b6fd-4f930c5996dc tempest-VolumeImageDependencyTests-1692488225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-456bdf0f-de2e-46bc-9220-57f0d7a122bb 1073741824" returned: 0 in 0.440s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:46:24 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-16e3d31d-64e5-403c-b6fd-4f930c5996dc tempest-VolumeImageDependencyTests-1692488225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-456bdf0f-de2e-46bc-9220-57f0d7a122bb {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:46:24 devstack sudo[107478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-456bdf0f-de2e-46bc-9220-57f0d7a122bb Aug 03 08:46:24 devstack sudo[107478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:46:24 devstack sudo[107478]: pam_unix(sudo:session): session closed for user root Aug 03 08:46:24 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-16e3d31d-64e5-403c-b6fd-4f930c5996dc tempest-VolumeImageDependencyTests-1692488225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-456bdf0f-de2e-46bc-9220-57f0d7a122bb" returned: 0 in 0.246s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:46:24 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-16e3d31d-64e5-403c-b6fd-4f930c5996dc tempest-VolumeImageDependencyTests-1692488225 None] <== create_volume: return (726ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'} {{(pid=88899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 08:46:24 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-16e3d31d-64e5-403c-b6fd-4f930c5996dc tempest-VolumeImageDependencyTests-1692488225 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.730s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:46:24 devstack cinder-volume[88899]: DEBUG cinder.volume.volume_utils [None req-16e3d31d-64e5-403c-b6fd-4f930c5996dc tempest-VolumeImageDependencyTests-1692488225 None] Attempting download of 11823ba0-f289-45d1-8f43-809b9a648101 ((None, [{'url': 'file:///opt/stack/data/glance/images/11823ba0-f289-45d1-8f43-809b9a648101', 'metadata': {}}])) to volume 456bdf0f-de2e-46bc-9220-57f0d7a122bb. {{(pid=88899) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Aug 03 08:46:24 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc3c34e0-0958-41d1-bb24-d756fa8f62e6]: (4, 'raw') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:46:24 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-16e3d31d-64e5-403c-b6fd-4f930c5996dc tempest-VolumeImageDependencyTests-1692488225 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_11823ba0-f289-45d1-8f43-809b9a648101_tmqd8s5g {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:46:24 devstack sudo[107481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_11823ba0-f289-45d1-8f43-809b9a648101_tmqd8s5g Aug 03 08:46:24 devstack sudo[107481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:46:24 devstack sudo[107481]: pam_unix(sudo:session): session closed for user root Aug 03 08:46:24 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-16e3d31d-64e5-403c-b6fd-4f930c5996dc tempest-VolumeImageDependencyTests-1692488225 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_11823ba0-f289-45d1-8f43-809b9a648101_tmqd8s5g" returned: 0 in 0.332s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:46:24 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-16e3d31d-64e5-403c-b6fd-4f930c5996dc tempest-VolumeImageDependencyTests-1692488225 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_11823ba0-f289-45d1-8f43-809b9a648101_tmqd8s5g {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:46:24 devstack sudo[107485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_11823ba0-f289-45d1-8f43-809b9a648101_tmqd8s5g Aug 03 08:46:24 devstack sudo[107485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:46:25 devstack sudo[107485]: pam_unix(sudo:session): session closed for user root Aug 03 08:46:25 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-16e3d31d-64e5-403c-b6fd-4f930c5996dc tempest-VolumeImageDependencyTests-1692488225 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_11823ba0-f289-45d1-8f43-809b9a648101_tmqd8s5g" returned: 1 in 0.356s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:46:25 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-16e3d31d-64e5-403c-b6fd-4f930c5996dc tempest-VolumeImageDependencyTests-1692488225 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_11823ba0-f289-45d1-8f43-809b9a648101_tmqd8s5g' failed. Not Retrying. {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 03 08:46:25 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[c18c39b6-bccd-41a2-b19c-7cedab25e941]: (4, 'raw') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:46:25 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-16e3d31d-64e5-403c-b6fd-4f930c5996dc tempest-VolumeImageDependencyTests-1692488225 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_11823ba0-f289-45d1-8f43-809b9a648101_zm01o7bhdevstack@QuobyteHD {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:46:25 devstack sudo[107489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_11823ba0-f289-45d1-8f43-809b9a648101_zm01o7bhdevstack@QuobyteHD Aug 03 08:46:25 devstack sudo[107489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:46:25 devstack sudo[107489]: pam_unix(sudo:session): session closed for user root Aug 03 08:46:25 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-16e3d31d-64e5-403c-b6fd-4f930c5996dc tempest-VolumeImageDependencyTests-1692488225 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_11823ba0-f289-45d1-8f43-809b9a648101_zm01o7bhdevstack@QuobyteHD" returned: 0 in 0.333s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:46:25 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-16e3d31d-64e5-403c-b6fd-4f930c5996dc tempest-VolumeImageDependencyTests-1692488225 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_11823ba0-f289-45d1-8f43-809b9a648101_zm01o7bhdevstack@QuobyteHD {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:46:25 devstack sudo[107493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_11823ba0-f289-45d1-8f43-809b9a648101_zm01o7bhdevstack@QuobyteHD Aug 03 08:46:25 devstack sudo[107493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:46:25 devstack sudo[107493]: pam_unix(sudo:session): session closed for user root Aug 03 08:46:25 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-16e3d31d-64e5-403c-b6fd-4f930c5996dc tempest-VolumeImageDependencyTests-1692488225 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_11823ba0-f289-45d1-8f43-809b9a648101_zm01o7bhdevstack@QuobyteHD" returned: 1 in 0.327s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:46:25 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-16e3d31d-64e5-403c-b6fd-4f930c5996dc tempest-VolumeImageDependencyTests-1692488225 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_11823ba0-f289-45d1-8f43-809b9a648101_zm01o7bhdevstack@QuobyteHD' failed. Not Retrying. {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 03 08:46:25 devstack cinder-volume[88899]: DEBUG cinder.image.image_utils [None req-16e3d31d-64e5-403c-b6fd-4f930c5996dc tempest-VolumeImageDependencyTests-1692488225 None] 11823ba0-f289-45d1-8f43-809b9a648101 was raw, converting to qcow2 {{(pid=88899) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Aug 03 08:46:25 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-16e3d31d-64e5-403c-b6fd-4f930c5996dc tempest-VolumeImageDependencyTests-1692488225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_11823ba0-f289-45d1-8f43-809b9a648101_zm01o7bhdevstack@QuobyteHD /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-456bdf0f-de2e-46bc-9220-57f0d7a122bb {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:46:25 devstack sudo[107498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_11823ba0-f289-45d1-8f43-809b9a648101_zm01o7bhdevstack@QuobyteHD /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-456bdf0f-de2e-46bc-9220-57f0d7a122bb Aug 03 08:46:25 devstack sudo[107498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:46:26 devstack sudo[107498]: pam_unix(sudo:session): session closed for user root Aug 03 08:46:26 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-16e3d31d-64e5-403c-b6fd-4f930c5996dc tempest-VolumeImageDependencyTests-1692488225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_11823ba0-f289-45d1-8f43-809b9a648101_zm01o7bhdevstack@QuobyteHD /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-456bdf0f-de2e-46bc-9220-57f0d7a122bb" returned: 0 in 0.450s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:46:26 devstack cinder-volume[88899]: DEBUG cinder.image.image_utils [None req-16e3d31d-64e5-403c-b6fd-4f930c5996dc tempest-VolumeImageDependencyTests-1692488225 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_11823ba0-f289-45d1-8f43-809b9a648101_zm01o7bhdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-456bdf0f-de2e-46bc-9220-57f0d7a122bb {{(pid=88899) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 03 08:46:26 devstack cinder-volume[88899]: INFO cinder.image.image_utils [None req-16e3d31d-64e5-403c-b6fd-4f930c5996dc tempest-VolumeImageDependencyTests-1692488225 None] Converted 0.00 MB image at 0.00 MB/s Aug 03 08:46:26 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-16e3d31d-64e5-403c-b6fd-4f930c5996dc tempest-VolumeImageDependencyTests-1692488225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-456bdf0f-de2e-46bc-9220-57f0d7a122bb 1G {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:46:26 devstack sudo[107504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-456bdf0f-de2e-46bc-9220-57f0d7a122bb 1G Aug 03 08:46:26 devstack sudo[107504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:46:26 devstack sudo[107504]: pam_unix(sudo:session): session closed for user root Aug 03 08:46:26 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-16e3d31d-64e5-403c-b6fd-4f930c5996dc tempest-VolumeImageDependencyTests-1692488225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-456bdf0f-de2e-46bc-9220-57f0d7a122bb 1G" returned: 0 in 0.300s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:46:26 devstack cinder-volume[88899]: DEBUG cinder.volume.volume_utils [None req-16e3d31d-64e5-403c-b6fd-4f930c5996dc tempest-VolumeImageDependencyTests-1692488225 None] Downloaded image 11823ba0-f289-45d1-8f43-809b9a648101 ((None, [{'url': 'file:///opt/stack/data/glance/images/11823ba0-f289-45d1-8f43-809b9a648101', 'metadata': {}}])) to volume 456bdf0f-de2e-46bc-9220-57f0d7a122bb successfully. {{(pid=88899) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Aug 03 08:46:26 devstack cinder-volume[88899]: DEBUG cinder.image.image_utils [None req-16e3d31d-64e5-403c-b6fd-4f930c5996dc tempest-VolumeImageDependencyTests-1692488225 None] Temporary image 11823ba0-f289-45d1-8f43-809b9a648101 for user 5178bef6bbbc4a64812776d11b4731f2 is deleted. {{(pid=88899) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Aug 03 08:46:26 devstack cinder-volume[88899]: DEBUG cinder.volume.volume_utils [None req-16e3d31d-64e5-403c-b6fd-4f930c5996dc tempest-VolumeImageDependencyTests-1692488225 None] Marking volume 456bdf0f-de2e-46bc-9220-57f0d7a122bb as bootable. {{(pid=88899) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Aug 03 08:46:26 devstack cinder-volume[88899]: DEBUG cinder.volume.flows.manager.create_volume [None req-16e3d31d-64e5-403c-b6fd-4f930c5996dc tempest-VolumeImageDependencyTests-1692488225 None] Copying metadata from image 11823ba0-f289-45d1-8f43-809b9a648101 to 456bdf0f-de2e-46bc-9220-57f0d7a122bb. {{(pid=88899) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Aug 03 08:46:26 devstack cinder-volume[88899]: DEBUG cinder.volume.flows.manager.create_volume [None req-16e3d31d-64e5-403c-b6fd-4f930c5996dc tempest-VolumeImageDependencyTests-1692488225 None] Creating volume glance metadata for volume 456bdf0f-de2e-46bc-9220-57f0d7a122bb backed by image 11823ba0-f289-45d1-8f43-809b9a648101 with: {'image_id': '11823ba0-f289-45d1-8f43-809b9a648101', 'image_name': 'image-for-test-0e20bd6e-440f-41d8-9b5d-fc047ac00423', 'checksum': '490018a8d01074db3ae9f01228db080b', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=88899) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Aug 03 08:46:26 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-16e3d31d-64e5-403c-b6fd-4f930c5996dc tempest-VolumeImageDependencyTests-1692488225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c40b8b2-2ce5-4584-a5b4-60b20bcc2343) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-456bdf0f-de2e-46bc-9220-57f0d7a122bb', 'volume_size': 1, 'image_id': '11823ba0-f289-45d1-8f43-809b9a648101', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/11823ba0-f289-45d1-8f43-809b9a648101', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-0e20bd6e-440f-41d8-9b5d-fc047ac00423', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '490018a8d01074db3ae9f01228db080b', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '5f2073d44fb6478c84cdc92ba34faea6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '178fb92d88a2cb384cf9db53c0a1e3b4b17a6c1b82948b2303d98c489f85d2562cc8ab9d14436cc4f0b777154cd5ed5acc9e04fac7275e86f9675398110cc26f', 'id': '11823ba0-f289-45d1-8f43-809b9a648101', 'created_at': datetime.datetime(2026, 8, 3, 6, 46, 20, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 3, 6, 46, 21, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/11823ba0-f289-45d1-8f43-809b9a648101/file', 'properties': {}}, 'image_service': }' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:46:26 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-16e3d31d-64e5-403c-b6fd-4f930c5996dc tempest-VolumeImageDependencyTests-1692488225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af019144-f34b-4770-93bf-1e456642c78a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:46:26 devstack cinder-volume[88899]: INFO cinder.volume.flows.manager.create_volume [None req-16e3d31d-64e5-403c-b6fd-4f930c5996dc tempest-VolumeImageDependencyTests-1692488225 None] Volume volume-456bdf0f-de2e-46bc-9220-57f0d7a122bb (456bdf0f-de2e-46bc-9220-57f0d7a122bb): created successfully Aug 03 08:46:26 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-16e3d31d-64e5-403c-b6fd-4f930c5996dc tempest-VolumeImageDependencyTests-1692488225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af019144-f34b-4770-93bf-1e456642c78a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:46:26 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-16e3d31d-64e5-403c-b6fd-4f930c5996dc tempest-VolumeImageDependencyTests-1692488225 None] Flow 'volume_create_manager' (4fa2f890-9c25-4a8b-b93a-c7773c43f5c3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:46:26 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-16e3d31d-64e5-403c-b6fd-4f930c5996dc tempest-VolumeImageDependencyTests-1692488225 None] Created volume successfully. Aug 03 08:46:27 devstack cinder-volume[88899]: DEBUG cinder.volume.flows.manager.create_volume [None req-c09e5d52-b9d5-4c27-92f7-14e5ea7eb4cc tempest-VolumeImageDependencyTests-1692488225 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88899) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 08:46:27 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-c09e5d52-b9d5-4c27-92f7-14e5ea7eb4cc tempest-VolumeImageDependencyTests-1692488225 None] Flow 'volume_create_manager' (fb0eec57-cd70-4b58-b227-7523ea6bfafc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:46:27 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-c09e5d52-b9d5-4c27-92f7-14e5ea7eb4cc tempest-VolumeImageDependencyTests-1692488225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84e85e72-5dcd-44ed-8c71-e4c17e532296) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:46:27 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-c09e5d52-b9d5-4c27-92f7-14e5ea7eb4cc tempest-VolumeImageDependencyTests-1692488225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84e85e72-5dcd-44ed-8c71-e4c17e532296) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=True,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:46:27Z,deleted=False,deleted_at=None,display_description=None,display_name='volume2-for-test-0e20bd6e-440f-41d8-9b5d-fc047ac00423',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=24be8730-eebe-4fae-a364-4cbd51c37f8f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5f2073d44fb6478c84cdc92ba34faea6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:46:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=456bdf0f-de2e-46bc-9220-57f0d7a122bb,status='creating',terminated_at=None,updated_at=2026-08-03T06:46:28Z,use_quota=True,user_id='5178bef6bbbc4a64812776d11b4731f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8bde7129-1dc4-42ab-b852-ab32c61b4921),volume_type_id=8bde7129-1dc4-42ab-b852-ab32c61b4921)' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:46:27 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-c09e5d52-b9d5-4c27-92f7-14e5ea7eb4cc tempest-VolumeImageDependencyTests-1692488225 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2eb5b31-1158-4f76-9f1c-99394e76f5a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:46:27 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-c09e5d52-b9d5-4c27-92f7-14e5ea7eb4cc tempest-VolumeImageDependencyTests-1692488225 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2eb5b31-1158-4f76-9f1c-99394e76f5a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:46:27 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-c09e5d52-b9d5-4c27-92f7-14e5ea7eb4cc tempest-VolumeImageDependencyTests-1692488225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9253503-9e0d-4c51-8507-8255920038d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:46:27 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-c09e5d52-b9d5-4c27-92f7-14e5ea7eb4cc tempest-VolumeImageDependencyTests-1692488225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9253503-9e0d-4c51-8507-8255920038d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '24be8730-eebe-4fae-a364-4cbd51c37f8f', 'volume_name': 'volume-24be8730-eebe-4fae-a364-4cbd51c37f8f', 'volume_size': 1, 'source_volid': '456bdf0f-de2e-46bc-9220-57f0d7a122bb', 'source_volstatus': 'available'}' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:46:27 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-c09e5d52-b9d5-4c27-92f7-14e5ea7eb4cc tempest-VolumeImageDependencyTests-1692488225 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa7fe019-46dd-4dd9-936d-947e906aa98c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:46:27 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-c09e5d52-b9d5-4c27-92f7-14e5ea7eb4cc tempest-VolumeImageDependencyTests-1692488225 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa7fe019-46dd-4dd9-936d-947e906aa98c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:46:27 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-c09e5d52-b9d5-4c27-92f7-14e5ea7eb4cc tempest-VolumeImageDependencyTests-1692488225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (592fb2dc-4f84-45ff-b270-945e1e24a1ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:46:27 devstack cinder-volume[88899]: INFO cinder.volume.flows.manager.create_volume [None req-c09e5d52-b9d5-4c27-92f7-14e5ea7eb4cc tempest-VolumeImageDependencyTests-1692488225 None] Volume 24be8730-eebe-4fae-a364-4cbd51c37f8f: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-24be8730-eebe-4fae-a364-4cbd51c37f8f', 'volume_size': 1, 'source_volid': '456bdf0f-de2e-46bc-9220-57f0d7a122bb', 'source_volstatus': 'available'} Aug 03 08:46:27 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-c09e5d52-b9d5-4c27-92f7-14e5ea7eb4cc tempest-VolumeImageDependencyTests-1692488225 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:46:27 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-c09e5d52-b9d5-4c27-92f7-14e5ea7eb4cc tempest-VolumeImageDependencyTests-1692488225 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:46:27 devstack cinder-volume[88899]: INFO cinder.volume.drivers.remotefs [None req-c09e5d52-b9d5-4c27-92f7-14e5ea7eb4cc tempest-VolumeImageDependencyTests-1692488225 None] Cloning volume 456bdf0f-de2e-46bc-9220-57f0d7a122bb to volume 24be8730-eebe-4fae-a364-4cbd51c37f8f Aug 03 08:46:27 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-c09e5d52-b9d5-4c27-92f7-14e5ea7eb4cc tempest-VolumeImageDependencyTests-1692488225 None] Creating offline snapshot 0dcb1114-4c44-4b60-8b45-78e5d7ad0824 of volume 456bdf0f-de2e-46bc-9220-57f0d7a122bb {{(pid=88899) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 03 08:46:27 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[957266dd-e2dc-4ec8-ab03-58a72ae9ff0b]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:46:27 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-c09e5d52-b9d5-4c27-92f7-14e5ea7eb4cc tempest-VolumeImageDependencyTests-1692488225 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-456bdf0f-de2e-46bc-9220-57f0d7a122bb {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:46:28 devstack sudo[107509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-456bdf0f-de2e-46bc-9220-57f0d7a122bb Aug 03 08:46:28 devstack sudo[107509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:46:28 devstack sudo[107509]: pam_unix(sudo:session): session closed for user root Aug 03 08:46:28 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-c09e5d52-b9d5-4c27-92f7-14e5ea7eb4cc tempest-VolumeImageDependencyTests-1692488225 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-456bdf0f-de2e-46bc-9220-57f0d7a122bb" returned: 0 in 0.360s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:46:28 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-c09e5d52-b9d5-4c27-92f7-14e5ea7eb4cc tempest-VolumeImageDependencyTests-1692488225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-456bdf0f-de2e-46bc-9220-57f0d7a122bb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-456bdf0f-de2e-46bc-9220-57f0d7a122bb.0dcb1114-4c44-4b60-8b45-78e5d7ad0824 1G {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:46:28 devstack sudo[107514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-456bdf0f-de2e-46bc-9220-57f0d7a122bb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-456bdf0f-de2e-46bc-9220-57f0d7a122bb.0dcb1114-4c44-4b60-8b45-78e5d7ad0824 1G Aug 03 08:46:28 devstack sudo[107514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:46:28 devstack sudo[107514]: pam_unix(sudo:session): session closed for user root Aug 03 08:46:28 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-c09e5d52-b9d5-4c27-92f7-14e5ea7eb4cc tempest-VolumeImageDependencyTests-1692488225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-456bdf0f-de2e-46bc-9220-57f0d7a122bb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-456bdf0f-de2e-46bc-9220-57f0d7a122bb.0dcb1114-4c44-4b60-8b45-78e5d7ad0824 1G" returned: 0 in 0.413s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:46:28 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-c09e5d52-b9d5-4c27-92f7-14e5ea7eb4cc tempest-VolumeImageDependencyTests-1692488225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-456bdf0f-de2e-46bc-9220-57f0d7a122bb -F qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-456bdf0f-de2e-46bc-9220-57f0d7a122bb.0dcb1114-4c44-4b60-8b45-78e5d7ad0824 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:46:28 devstack sudo[107521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-456bdf0f-de2e-46bc-9220-57f0d7a122bb -F qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-456bdf0f-de2e-46bc-9220-57f0d7a122bb.0dcb1114-4c44-4b60-8b45-78e5d7ad0824 Aug 03 08:46:28 devstack sudo[107521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:46:29 devstack sudo[107521]: pam_unix(sudo:session): session closed for user root Aug 03 08:46:29 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-c09e5d52-b9d5-4c27-92f7-14e5ea7eb4cc tempest-VolumeImageDependencyTests-1692488225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-456bdf0f-de2e-46bc-9220-57f0d7a122bb -F qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-456bdf0f-de2e-46bc-9220-57f0d7a122bb.0dcb1114-4c44-4b60-8b45-78e5d7ad0824" returned: 0 in 0.290s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:46:29 devstack cinder-volume[88899]: WARNING cinder.volume.drivers.remotefs [None req-c09e5d52-b9d5-4c27-92f7-14e5ea7eb4cc tempest-VolumeImageDependencyTests-1692488225 None] /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-456bdf0f-de2e-46bc-9220-57f0d7a122bb.0dcb1114-4c44-4b60-8b45-78e5d7ad0824 is being set with open permissions: ugo+rw Aug 03 08:46:29 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-c09e5d52-b9d5-4c27-92f7-14e5ea7eb4cc tempest-VolumeImageDependencyTests-1692488225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-456bdf0f-de2e-46bc-9220-57f0d7a122bb.0dcb1114-4c44-4b60-8b45-78e5d7ad0824 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:46:29 devstack sudo[107527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-456bdf0f-de2e-46bc-9220-57f0d7a122bb.0dcb1114-4c44-4b60-8b45-78e5d7ad0824 Aug 03 08:46:29 devstack sudo[107527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:46:29 devstack sudo[107527]: pam_unix(sudo:session): session closed for user root Aug 03 08:46:29 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-c09e5d52-b9d5-4c27-92f7-14e5ea7eb4cc tempest-VolumeImageDependencyTests-1692488225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-456bdf0f-de2e-46bc-9220-57f0d7a122bb.0dcb1114-4c44-4b60-8b45-78e5d7ad0824" returned: 0 in 0.247s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:46:29 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-c09e5d52-b9d5-4c27-92f7-14e5ea7eb4cc tempest-VolumeImageDependencyTests-1692488225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-456bdf0f-de2e-46bc-9220-57f0d7a122bb.info {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:46:29 devstack sudo[107540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-456bdf0f-de2e-46bc-9220-57f0d7a122bb.info Aug 03 08:46:29 devstack sudo[107540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:46:29 devstack sudo[107540]: pam_unix(sudo:session): session closed for user root Aug 03 08:46:29 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-c09e5d52-b9d5-4c27-92f7-14e5ea7eb4cc tempest-VolumeImageDependencyTests-1692488225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-456bdf0f-de2e-46bc-9220-57f0d7a122bb.info" returned: 0 in 0.285s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:46:29 devstack cinder-volume[88899]: WARNING cinder.volume.drivers.remotefs [None req-c09e5d52-b9d5-4c27-92f7-14e5ea7eb4cc tempest-VolumeImageDependencyTests-1692488225 None] /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-456bdf0f-de2e-46bc-9220-57f0d7a122bb.info is being set with open permissions: ugo+rw Aug 03 08:46:29 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-c09e5d52-b9d5-4c27-92f7-14e5ea7eb4cc tempest-VolumeImageDependencyTests-1692488225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-456bdf0f-de2e-46bc-9220-57f0d7a122bb.info {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:46:29 devstack sudo[107543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-456bdf0f-de2e-46bc-9220-57f0d7a122bb.info Aug 03 08:46:29 devstack sudo[107543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:46:29 devstack sudo[107543]: pam_unix(sudo:session): session closed for user root Aug 03 08:46:29 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-c09e5d52-b9d5-4c27-92f7-14e5ea7eb4cc tempest-VolumeImageDependencyTests-1692488225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-456bdf0f-de2e-46bc-9220-57f0d7a122bb.info" returned: 0 in 0.245s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:46:29 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-c09e5d52-b9d5-4c27-92f7-14e5ea7eb4cc tempest-VolumeImageDependencyTests-1692488225 None] Acquiring lock "cinder-quobyte-24be8730-eebe-4fae-a364-4cbd51c37f8f" by "_copy_volume_from_snapshot" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:46:29 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-c09e5d52-b9d5-4c27-92f7-14e5ea7eb4cc tempest-VolumeImageDependencyTests-1692488225 None] Lock "cinder-quobyte-24be8730-eebe-4fae-a364-4cbd51c37f8f" acquired by "_copy_volume_from_snapshot" :: waited 0.019s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:46:29 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-c09e5d52-b9d5-4c27-92f7-14e5ea7eb4cc tempest-VolumeImageDependencyTests-1692488225 None] snapshot: 0dcb1114-4c44-4b60-8b45-78e5d7ad0824, volume: 24be8730-eebe-4fae-a364-4cbd51c37f8f, {{(pid=88899) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Aug 03 08:46:29 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-c09e5d52-b9d5-4c27-92f7-14e5ea7eb4cc tempest-VolumeImageDependencyTests-1692488225 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:46:29 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-c09e5d52-b9d5-4c27-92f7-14e5ea7eb4cc tempest-VolumeImageDependencyTests-1692488225 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:46:29 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-c09e5d52-b9d5-4c27-92f7-14e5ea7eb4cc tempest-VolumeImageDependencyTests-1692488225 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:46:29 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-c09e5d52-b9d5-4c27-92f7-14e5ea7eb4cc tempest-VolumeImageDependencyTests-1692488225 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:46:29 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-c09e5d52-b9d5-4c27-92f7-14e5ea7eb4cc tempest-VolumeImageDependencyTests-1692488225 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:46:29 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2dcc197-b97d-4cf2-b5d2-a4b5a8943301]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:46:29 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-c09e5d52-b9d5-4c27-92f7-14e5ea7eb4cc tempest-VolumeImageDependencyTests-1692488225 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-456bdf0f-de2e-46bc-9220-57f0d7a122bb.0dcb1114-4c44-4b60-8b45-78e5d7ad0824 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:46:30 devstack sudo[107546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-456bdf0f-de2e-46bc-9220-57f0d7a122bb.0dcb1114-4c44-4b60-8b45-78e5d7ad0824 Aug 03 08:46:30 devstack sudo[107546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:46:30 devstack sudo[107546]: pam_unix(sudo:session): session closed for user root Aug 03 08:46:30 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-c09e5d52-b9d5-4c27-92f7-14e5ea7eb4cc tempest-VolumeImageDependencyTests-1692488225 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-456bdf0f-de2e-46bc-9220-57f0d7a122bb.0dcb1114-4c44-4b60-8b45-78e5d7ad0824" returned: 0 in 0.345s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:46:30 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-c09e5d52-b9d5-4c27-92f7-14e5ea7eb4cc tempest-VolumeImageDependencyTests-1692488225 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-456bdf0f-de2e-46bc-9220-57f0d7a122bb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88899) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 03 08:46:30 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[645d3d6d-7706-43eb-aa6b-9abbd1aea826]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:46:30 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-c09e5d52-b9d5-4c27-92f7-14e5ea7eb4cc tempest-VolumeImageDependencyTests-1692488225 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-456bdf0f-de2e-46bc-9220-57f0d7a122bb {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:46:30 devstack sudo[107553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-456bdf0f-de2e-46bc-9220-57f0d7a122bb Aug 03 08:46:30 devstack sudo[107553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:46:30 devstack sudo[107553]: pam_unix(sudo:session): session closed for user root Aug 03 08:46:30 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-c09e5d52-b9d5-4c27-92f7-14e5ea7eb4cc tempest-VolumeImageDependencyTests-1692488225 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-456bdf0f-de2e-46bc-9220-57f0d7a122bb" returned: 0 in 0.347s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:46:30 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-c09e5d52-b9d5-4c27-92f7-14e5ea7eb4cc tempest-VolumeImageDependencyTests-1692488225 None] will copy from snapshot at /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-456bdf0f-de2e-46bc-9220-57f0d7a122bb {{(pid=88899) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Aug 03 08:46:30 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-c09e5d52-b9d5-4c27-92f7-14e5ea7eb4cc tempest-VolumeImageDependencyTests-1692488225 None] Creating direct copy from snapshot {{(pid=88899) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Aug 03 08:46:30 devstack cinder-volume[88899]: DEBUG cinder.utils [None req-c09e5d52-b9d5-4c27-92f7-14e5ea7eb4cc tempest-VolumeImageDependencyTests-1692488225 None] Path /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-24be8730-eebe-4fae-a364-4cbd51c37f8f not found in is_blk_device check {{(pid=88899) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Aug 03 08:46:30 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-c09e5d52-b9d5-4c27-92f7-14e5ea7eb4cc tempest-VolumeImageDependencyTests-1692488225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-456bdf0f-de2e-46bc-9220-57f0d7a122bb /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-24be8730-eebe-4fae-a364-4cbd51c37f8f {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:46:30 devstack sudo[107558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-456bdf0f-de2e-46bc-9220-57f0d7a122bb /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-24be8730-eebe-4fae-a364-4cbd51c37f8f Aug 03 08:46:30 devstack sudo[107558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:46:31 devstack sudo[107558]: pam_unix(sudo:session): session closed for user root Aug 03 08:46:31 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-c09e5d52-b9d5-4c27-92f7-14e5ea7eb4cc tempest-VolumeImageDependencyTests-1692488225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-456bdf0f-de2e-46bc-9220-57f0d7a122bb /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-24be8730-eebe-4fae-a364-4cbd51c37f8f" returned: 0 in 0.460s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:46:31 devstack cinder-volume[88899]: DEBUG cinder.image.image_utils [None req-c09e5d52-b9d5-4c27-92f7-14e5ea7eb4cc tempest-VolumeImageDependencyTests-1692488225 None] Image conversion details: src /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-456bdf0f-de2e-46bc-9220-57f0d7a122bb, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-24be8730-eebe-4fae-a364-4cbd51c37f8f {{(pid=88899) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 03 08:46:31 devstack cinder-volume[88899]: INFO cinder.image.image_utils [None req-c09e5d52-b9d5-4c27-92f7-14e5ea7eb4cc tempest-VolumeImageDependencyTests-1692488225 None] Converted 1024.00 MB image at 1024.00 MB/s Aug 03 08:46:31 devstack cinder-volume[88899]: WARNING cinder.volume.drivers.remotefs [None req-c09e5d52-b9d5-4c27-92f7-14e5ea7eb4cc tempest-VolumeImageDependencyTests-1692488225 None] /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-24be8730-eebe-4fae-a364-4cbd51c37f8f is being set with open permissions: ugo+rw Aug 03 08:46:31 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-c09e5d52-b9d5-4c27-92f7-14e5ea7eb4cc tempest-VolumeImageDependencyTests-1692488225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-24be8730-eebe-4fae-a364-4cbd51c37f8f {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:46:31 devstack sudo[107566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-24be8730-eebe-4fae-a364-4cbd51c37f8f Aug 03 08:46:31 devstack sudo[107566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:46:31 devstack sudo[107566]: pam_unix(sudo:session): session closed for user root Aug 03 08:46:31 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-c09e5d52-b9d5-4c27-92f7-14e5ea7eb4cc tempest-VolumeImageDependencyTests-1692488225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-24be8730-eebe-4fae-a364-4cbd51c37f8f" returned: 0 in 0.249s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:46:31 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-c09e5d52-b9d5-4c27-92f7-14e5ea7eb4cc tempest-VolumeImageDependencyTests-1692488225 None] Lock "cinder-quobyte-24be8730-eebe-4fae-a364-4cbd51c37f8f" released by "_copy_volume_from_snapshot" :: held 1.467s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:46:31 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-c09e5d52-b9d5-4c27-92f7-14e5ea7eb4cc tempest-VolumeImageDependencyTests-1692488225 None] Acquiring lock "cinder-quobyte-0dcb1114-4c44-4b60-8b45-78e5d7ad0824" by "_delete_snapshot" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:46:31 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-c09e5d52-b9d5-4c27-92f7-14e5ea7eb4cc tempest-VolumeImageDependencyTests-1692488225 None] Lock "cinder-quobyte-0dcb1114-4c44-4b60-8b45-78e5d7ad0824" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:46:31 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-c09e5d52-b9d5-4c27-92f7-14e5ea7eb4cc tempest-VolumeImageDependencyTests-1692488225 None] Deleting offline snapshot 0dcb1114-4c44-4b60-8b45-78e5d7ad0824 of volume 456bdf0f-de2e-46bc-9220-57f0d7a122bb {{(pid=88899) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 03 08:46:31 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-c09e5d52-b9d5-4c27-92f7-14e5ea7eb4cc tempest-VolumeImageDependencyTests-1692488225 None] snapshot_file for this snap is: volume-456bdf0f-de2e-46bc-9220-57f0d7a122bb.0dcb1114-4c44-4b60-8b45-78e5d7ad0824 {{(pid=88899) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 03 08:46:31 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ca5389b-8819-4b24-bc66-07d48ec5e509]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:46:31 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-c09e5d52-b9d5-4c27-92f7-14e5ea7eb4cc tempest-VolumeImageDependencyTests-1692488225 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-456bdf0f-de2e-46bc-9220-57f0d7a122bb.0dcb1114-4c44-4b60-8b45-78e5d7ad0824 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:46:31 devstack sudo[107571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-456bdf0f-de2e-46bc-9220-57f0d7a122bb.0dcb1114-4c44-4b60-8b45-78e5d7ad0824 Aug 03 08:46:31 devstack sudo[107571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:46:31 devstack sudo[107571]: pam_unix(sudo:session): session closed for user root Aug 03 08:46:31 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-c09e5d52-b9d5-4c27-92f7-14e5ea7eb4cc tempest-VolumeImageDependencyTests-1692488225 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-456bdf0f-de2e-46bc-9220-57f0d7a122bb.0dcb1114-4c44-4b60-8b45-78e5d7ad0824" returned: 0 in 0.404s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:46:31 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-c09e5d52-b9d5-4c27-92f7-14e5ea7eb4cc tempest-VolumeImageDependencyTests-1692488225 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-456bdf0f-de2e-46bc-9220-57f0d7a122bb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88899) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 03 08:46:31 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[c26d848d-232a-4042-80bb-0a43d5be1efb]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:46:31 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-c09e5d52-b9d5-4c27-92f7-14e5ea7eb4cc tempest-VolumeImageDependencyTests-1692488225 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-456bdf0f-de2e-46bc-9220-57f0d7a122bb {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:46:32 devstack sudo[107579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-456bdf0f-de2e-46bc-9220-57f0d7a122bb Aug 03 08:46:32 devstack sudo[107579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:46:32 devstack sudo[107579]: pam_unix(sudo:session): session closed for user root Aug 03 08:46:32 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-c09e5d52-b9d5-4c27-92f7-14e5ea7eb4cc tempest-VolumeImageDependencyTests-1692488225 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-456bdf0f-de2e-46bc-9220-57f0d7a122bb" returned: 0 in 0.399s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:46:32 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-c09e5d52-b9d5-4c27-92f7-14e5ea7eb4cc tempest-VolumeImageDependencyTests-1692488225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-456bdf0f-de2e-46bc-9220-57f0d7a122bb.0dcb1114-4c44-4b60-8b45-78e5d7ad0824 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:46:32 devstack sudo[107592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-456bdf0f-de2e-46bc-9220-57f0d7a122bb.0dcb1114-4c44-4b60-8b45-78e5d7ad0824 Aug 03 08:46:32 devstack sudo[107592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:46:32 devstack sudo[107592]: pam_unix(sudo:session): session closed for user root Aug 03 08:46:32 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-c09e5d52-b9d5-4c27-92f7-14e5ea7eb4cc tempest-VolumeImageDependencyTests-1692488225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-456bdf0f-de2e-46bc-9220-57f0d7a122bb.0dcb1114-4c44-4b60-8b45-78e5d7ad0824" returned: 0 in 0.368s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:46:32 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-c09e5d52-b9d5-4c27-92f7-14e5ea7eb4cc tempest-VolumeImageDependencyTests-1692488225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-456bdf0f-de2e-46bc-9220-57f0d7a122bb.0dcb1114-4c44-4b60-8b45-78e5d7ad0824 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:46:32 devstack sudo[107599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-456bdf0f-de2e-46bc-9220-57f0d7a122bb.0dcb1114-4c44-4b60-8b45-78e5d7ad0824 Aug 03 08:46:32 devstack sudo[107599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:46:32 devstack sudo[107599]: pam_unix(sudo:session): session closed for user root Aug 03 08:46:32 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-c09e5d52-b9d5-4c27-92f7-14e5ea7eb4cc tempest-VolumeImageDependencyTests-1692488225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-456bdf0f-de2e-46bc-9220-57f0d7a122bb.0dcb1114-4c44-4b60-8b45-78e5d7ad0824" returned: 0 in 0.255s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:46:32 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-c09e5d52-b9d5-4c27-92f7-14e5ea7eb4cc tempest-VolumeImageDependencyTests-1692488225 None] Lock "cinder-quobyte-0dcb1114-4c44-4b60-8b45-78e5d7ad0824" released by "_delete_snapshot" :: held 1.533s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:46:32 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-c09e5d52-b9d5-4c27-92f7-14e5ea7eb4cc tempest-VolumeImageDependencyTests-1692488225 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 5.032s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:46:32 devstack cinder-volume[88899]: DEBUG cinder.volume.volume_utils [None req-c09e5d52-b9d5-4c27-92f7-14e5ea7eb4cc tempest-VolumeImageDependencyTests-1692488225 None] Marking volume 24be8730-eebe-4fae-a364-4cbd51c37f8f as bootable. {{(pid=88899) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Aug 03 08:46:32 devstack cinder-volume[88899]: DEBUG cinder.volume.flows.manager.create_volume [None req-c09e5d52-b9d5-4c27-92f7-14e5ea7eb4cc tempest-VolumeImageDependencyTests-1692488225 None] Copying metadata from source volume 456bdf0f-de2e-46bc-9220-57f0d7a122bb to 24be8730-eebe-4fae-a364-4cbd51c37f8f. {{(pid=88899) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:438}} Aug 03 08:46:33 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-c09e5d52-b9d5-4c27-92f7-14e5ea7eb4cc tempest-VolumeImageDependencyTests-1692488225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (592fb2dc-4f84-45ff-b270-945e1e24a1ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-24be8730-eebe-4fae-a364-4cbd51c37f8f', 'volume_size': 1, 'source_volid': '456bdf0f-de2e-46bc-9220-57f0d7a122bb', 'source_volstatus': 'available'}' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:46:33 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-c09e5d52-b9d5-4c27-92f7-14e5ea7eb4cc tempest-VolumeImageDependencyTests-1692488225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (90acece0-184f-4842-bb82-6481ca4a41a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:46:33 devstack cinder-volume[88899]: INFO cinder.volume.flows.manager.create_volume [None req-c09e5d52-b9d5-4c27-92f7-14e5ea7eb4cc tempest-VolumeImageDependencyTests-1692488225 None] Volume volume-24be8730-eebe-4fae-a364-4cbd51c37f8f (24be8730-eebe-4fae-a364-4cbd51c37f8f): created successfully Aug 03 08:46:33 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-c09e5d52-b9d5-4c27-92f7-14e5ea7eb4cc tempest-VolumeImageDependencyTests-1692488225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (90acece0-184f-4842-bb82-6481ca4a41a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:46:33 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-c09e5d52-b9d5-4c27-92f7-14e5ea7eb4cc tempest-VolumeImageDependencyTests-1692488225 None] Flow 'volume_create_manager' (fb0eec57-cd70-4b58-b227-7523ea6bfafc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:46:33 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-c09e5d52-b9d5-4c27-92f7-14e5ea7eb4cc tempest-VolumeImageDependencyTests-1692488225 None] Created volume successfully. Aug 03 08:46:34 devstack cinder-volume[88899]: INFO cinder.volume.manager [req-38e20252-d0ca-4b1c-bd47-9c9ba904d8e7 req-fd4e7a4b-72f6-4f50-9954-9715f08b1282 tempest-TestShelveInstance-1134734811 None] Terminate volume connection completed successfully. Aug 03 08:46:34 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [req-38e20252-d0ca-4b1c-bd47-9c9ba904d8e7 req-fd4e7a4b-72f6-4f50-9954-9715f08b1282 tempest-TestShelveInstance-1134734811 None] Deleting attachment 84c6cc1e-6d33-4b86-ab0e-e6f278865536. {{(pid=88899) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 03 08:46:34 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-cf6db448-2554-47bc-b205-31ab608eb8c2 tempest-VolumeImageDependencyTests-1692488225 None] Acquiring lock "cinder-456bdf0f-de2e-46bc-9220-57f0d7a122bb-delete_volume" by "delete_volume" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:46:34 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-cf6db448-2554-47bc-b205-31ab608eb8c2 tempest-VolumeImageDependencyTests-1692488225 None] Lock "cinder-456bdf0f-de2e-46bc-9220-57f0d7a122bb-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:46:34 devstack cinder-volume[88899]: DEBUG dbcounter [-] [88899] Writing DB stats cinder:SELECT=129,cinder:INSERT=58,cinder:UPDATE=152,cinder:DELETE=12 {{(pid=88899) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 03 08:46:34 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-cf6db448-2554-47bc-b205-31ab608eb8c2 tempest-VolumeImageDependencyTests-1692488225 None] Acquiring lock "cinder-quobyte-456bdf0f-de2e-46bc-9220-57f0d7a122bb" by "delete_volume" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:46:34 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-cf6db448-2554-47bc-b205-31ab608eb8c2 tempest-VolumeImageDependencyTests-1692488225 None] Lock "cinder-quobyte-456bdf0f-de2e-46bc-9220-57f0d7a122bb" acquired by "delete_volume" :: waited 0.045s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:46:34 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca78b53d-9c9e-4e7f-a555-34b908716f04]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:46:34 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-cf6db448-2554-47bc-b205-31ab608eb8c2 tempest-VolumeImageDependencyTests-1692488225 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-456bdf0f-de2e-46bc-9220-57f0d7a122bb {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:46:34 devstack sudo[107621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-456bdf0f-de2e-46bc-9220-57f0d7a122bb Aug 03 08:46:34 devstack sudo[107621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:46:34 devstack sudo[107621]: pam_unix(sudo:session): session closed for user root Aug 03 08:46:34 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-cf6db448-2554-47bc-b205-31ab608eb8c2 tempest-VolumeImageDependencyTests-1692488225 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-456bdf0f-de2e-46bc-9220-57f0d7a122bb" returned: 0 in 0.382s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:46:34 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-cf6db448-2554-47bc-b205-31ab608eb8c2 tempest-VolumeImageDependencyTests-1692488225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-456bdf0f-de2e-46bc-9220-57f0d7a122bb {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:46:34 devstack sudo[107626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-456bdf0f-de2e-46bc-9220-57f0d7a122bb Aug 03 08:46:34 devstack sudo[107626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:46:35 devstack sudo[107626]: pam_unix(sudo:session): session closed for user root Aug 03 08:46:35 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-cf6db448-2554-47bc-b205-31ab608eb8c2 tempest-VolumeImageDependencyTests-1692488225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-456bdf0f-de2e-46bc-9220-57f0d7a122bb" returned: 0 in 0.269s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:46:35 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-cf6db448-2554-47bc-b205-31ab608eb8c2 tempest-VolumeImageDependencyTests-1692488225 None] Lock "cinder-quobyte-456bdf0f-de2e-46bc-9220-57f0d7a122bb" released by "delete_volume" :: held 0.720s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:46:35 devstack cinder-volume[88899]: DEBUG cinder.quota [None req-cf6db448-2554-47bc-b205-31ab608eb8c2 tempest-VolumeImageDependencyTests-1692488225 None] Created reservations ['dad5b838-8e1b-4a4f-8872-cd4fa5b8e416', '20c0c4a0-9f6d-4526-bb76-ac50a58413fd', 'd18f8524-d1ed-4435-8b90-a67b39ad0c9a', '90ba0a1b-3e64-41aa-b371-42595dfc4655'] {{(pid=88899) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 08:46:35 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-cf6db448-2554-47bc-b205-31ab608eb8c2 tempest-VolumeImageDependencyTests-1692488225 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:46:35 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-cf6db448-2554-47bc-b205-31ab608eb8c2 tempest-VolumeImageDependencyTests-1692488225 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:46:35 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-cf6db448-2554-47bc-b205-31ab608eb8c2 tempest-VolumeImageDependencyTests-1692488225 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:46:35 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-cf6db448-2554-47bc-b205-31ab608eb8c2 tempest-VolumeImageDependencyTests-1692488225 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:46:35 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-cf6db448-2554-47bc-b205-31ab608eb8c2 tempest-VolumeImageDependencyTests-1692488225 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:46:35 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-cf6db448-2554-47bc-b205-31ab608eb8c2 tempest-VolumeImageDependencyTests-1692488225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:46:35 devstack sudo[107629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a Aug 03 08:46:35 devstack sudo[107629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:46:35 devstack sudo[107629]: pam_unix(sudo:session): session closed for user root Aug 03 08:46:35 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-cf6db448-2554-47bc-b205-31ab608eb8c2 tempest-VolumeImageDependencyTests-1692488225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a" returned: 0 in 0.259s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:46:35 devstack cinder-volume[88899]: DEBUG cinder.manager [None req-cf6db448-2554-47bc-b205-31ab608eb8c2 tempest-VolumeImageDependencyTests-1692488225 None] Notifying Schedulers of capabilities ... {{(pid=88899) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 08:46:35 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-cf6db448-2554-47bc-b205-31ab608eb8c2 tempest-VolumeImageDependencyTests-1692488225 None] Deleted volume successfully. Aug 03 08:46:35 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-cf6db448-2554-47bc-b205-31ab608eb8c2 tempest-VolumeImageDependencyTests-1692488225 None] Lock "cinder-456bdf0f-de2e-46bc-9220-57f0d7a122bb-delete_volume" released by "delete_volume" :: held 1.226s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:46:37 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [req-378d7af4-ce54-4123-b4ff-718aeb518e2e req-921b748a-8dee-4f7e-875c-213656417346 tempest-TestShelveInstance-1134734811 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:46:37 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [req-378d7af4-ce54-4123-b4ff-718aeb518e2e req-921b748a-8dee-4f7e-875c-213656417346 tempest-TestShelveInstance-1134734811 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:46:37 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [req-378d7af4-ce54-4123-b4ff-718aeb518e2e req-921b748a-8dee-4f7e-875c-213656417346 tempest-TestShelveInstance-1134734811 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.018s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:46:37 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [req-378d7af4-ce54-4123-b4ff-718aeb518e2e req-921b748a-8dee-4f7e-875c-213656417346 tempest-TestShelveInstance-1134734811 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385', 'name': 'volume-5dd62159-5525-4bf9-8830-803d9e606d29', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a08c3b76-538d-4361-8e4f-394900cfdb61', 'enforce_multipath': True} {{(pid=88899) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 03 08:46:37 devstack cinder-volume[88899]: INFO cinder.volume.manager [req-378d7af4-ce54-4123-b4ff-718aeb518e2e req-921b748a-8dee-4f7e-875c-213656417346 tempest-TestShelveInstance-1134734811 None] attachment_update completed successfully. Aug 03 08:46:38 devstack cinder-volume[88899]: DEBUG cinder.volume.flows.manager.create_volume [None req-2613afa1-1a12-4e29-a2d2-4492b2828024 tempest-VolumeImageDependencyTests-1692488225 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88899) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 08:46:38 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-2613afa1-1a12-4e29-a2d2-4492b2828024 tempest-VolumeImageDependencyTests-1692488225 None] Flow 'volume_create_manager' (44c4d8c3-41cb-4432-a54f-5a126fe1b8d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:46:38 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-2613afa1-1a12-4e29-a2d2-4492b2828024 tempest-VolumeImageDependencyTests-1692488225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5242b611-e0ad-4d92-8064-02cbf09a77ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:46:38 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-2613afa1-1a12-4e29-a2d2-4492b2828024 tempest-VolumeImageDependencyTests-1692488225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5242b611-e0ad-4d92-8064-02cbf09a77ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:46:38Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-teste6050452-06bd-4c7f-9912-45178c83e379',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=44b78dc0-8107-46b1-804f-b5e842f1203f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5f2073d44fb6478c84cdc92ba34faea6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:46:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:46:38Z,use_quota=True,user_id='5178bef6bbbc4a64812776d11b4731f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8bde7129-1dc4-42ab-b852-ab32c61b4921),volume_type_id=8bde7129-1dc4-42ab-b852-ab32c61b4921)' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:46:38 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-2613afa1-1a12-4e29-a2d2-4492b2828024 tempest-VolumeImageDependencyTests-1692488225 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ca2fe5b-d166-4408-ba8c-a7bf8e0c3260) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:46:38 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-2613afa1-1a12-4e29-a2d2-4492b2828024 tempest-VolumeImageDependencyTests-1692488225 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ca2fe5b-d166-4408-ba8c-a7bf8e0c3260) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:46:38 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-2613afa1-1a12-4e29-a2d2-4492b2828024 tempest-VolumeImageDependencyTests-1692488225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ef859fe-039e-43d6-96bc-5da46c656139) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:46:38 devstack cinder-volume[88899]: DEBUG cinder.image.glance [None req-2613afa1-1a12-4e29-a2d2-4492b2828024 tempest-VolumeImageDependencyTests-1692488225 None] Creating Keystone auth plugin from conf {{(pid=88899) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Aug 03 08:46:38 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-2613afa1-1a12-4e29-a2d2-4492b2828024 tempest-VolumeImageDependencyTests-1692488225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ef859fe-039e-43d6-96bc-5da46c656139) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '44b78dc0-8107-46b1-804f-b5e842f1203f', 'volume_name': 'volume-44b78dc0-8107-46b1-804f-b5e842f1203f', 'volume_size': 1, 'image_id': '467b4178-b820-4f14-b7f5-207be719969c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/467b4178-b820-4f14-b7f5-207be719969c', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-e6050452-06bd-4c7f-9912-45178c83e379', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '34e97aeb18407fa4d14e38b5d5e29219', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '5f2073d44fb6478c84cdc92ba34faea6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'aca44f9344c5d1da0958206dac34250a0a44b45d3b868c28a3f187feefae750f0f3e97a1bcdee268b296c3bf1be836f1fde93fd6b0ed606fa1f1338ae2dbb7dd', 'id': '467b4178-b820-4f14-b7f5-207be719969c', 'created_at': datetime.datetime(2026, 8, 3, 6, 46, 36, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 3, 6, 46, 38, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/467b4178-b820-4f14-b7f5-207be719969c/file', 'properties': {}}, 'image_service': }' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:46:38 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-2613afa1-1a12-4e29-a2d2-4492b2828024 tempest-VolumeImageDependencyTests-1692488225 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (797c3fbe-6705-4325-9bc0-c5c20340a5fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:46:38 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-2613afa1-1a12-4e29-a2d2-4492b2828024 tempest-VolumeImageDependencyTests-1692488225 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (797c3fbe-6705-4325-9bc0-c5c20340a5fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:46:38 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-2613afa1-1a12-4e29-a2d2-4492b2828024 tempest-VolumeImageDependencyTests-1692488225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d9db888f-4678-4398-b209-f9d16bbb4344) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:46:38 devstack cinder-volume[88899]: INFO cinder.volume.flows.manager.create_volume [None req-2613afa1-1a12-4e29-a2d2-4492b2828024 tempest-VolumeImageDependencyTests-1692488225 None] Volume 44b78dc0-8107-46b1-804f-b5e842f1203f: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-44b78dc0-8107-46b1-804f-b5e842f1203f', 'volume_size': 1, 'image_id': '467b4178-b820-4f14-b7f5-207be719969c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/467b4178-b820-4f14-b7f5-207be719969c', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-e6050452-06bd-4c7f-9912-45178c83e379', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '34e97aeb18407fa4d14e38b5d5e29219', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '5f2073d44fb6478c84cdc92ba34faea6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'aca44f9344c5d1da0958206dac34250a0a44b45d3b868c28a3f187feefae750f0f3e97a1bcdee268b296c3bf1be836f1fde93fd6b0ed606fa1f1338ae2dbb7dd', 'id': '467b4178-b820-4f14-b7f5-207be719969c', 'created_at': datetime.datetime(2026, 8, 3, 6, 46, 36, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 3, 6, 46, 38, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/467b4178-b820-4f14-b7f5-207be719969c/file', 'properties': {}}, 'image_service': } Aug 03 08:46:38 devstack cinder-volume[88899]: DEBUG cinder.volume.flows.manager.create_volume [None req-2613afa1-1a12-4e29-a2d2-4492b2828024 tempest-VolumeImageDependencyTests-1692488225 None] Trying to clone 44b78dc0-8107-46b1-804f-b5e842f1203f from image 467b4178-b820-4f14-b7f5-207be719969c at location (None, [{'url': 'file:///opt/stack/data/glance/images/467b4178-b820-4f14-b7f5-207be719969c', 'metadata': {}}]). {{(pid=88899) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Aug 03 08:46:38 devstack cinder-volume[88899]: DEBUG cinder.image.image_utils [None req-2613afa1-1a12-4e29-a2d2-4492b2828024 tempest-VolumeImageDependencyTests-1692488225 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_467b4178-b820-4f14-b7f5-207be719969c_6mbi_20ydevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=88899) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Aug 03 08:46:38 devstack cinder-volume[88899]: INFO cinder.image.image_utils [None req-2613afa1-1a12-4e29-a2d2-4492b2828024 tempest-VolumeImageDependencyTests-1692488225 None] Image download 0.00 MB at 0.00 MB/s Aug 03 08:46:39 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c27109f-8ec6-4b5b-8606-2fa699cf47cd]: (4, 'raw') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:46:39 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-2613afa1-1a12-4e29-a2d2-4492b2828024 tempest-VolumeImageDependencyTests-1692488225 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_467b4178-b820-4f14-b7f5-207be719969c_6mbi_20ydevstack@QuobyteHD {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:46:39 devstack sudo[107644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_467b4178-b820-4f14-b7f5-207be719969c_6mbi_20ydevstack@QuobyteHD Aug 03 08:46:39 devstack sudo[107644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:46:39 devstack sudo[107644]: pam_unix(sudo:session): session closed for user root Aug 03 08:46:39 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-2613afa1-1a12-4e29-a2d2-4492b2828024 tempest-VolumeImageDependencyTests-1692488225 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_467b4178-b820-4f14-b7f5-207be719969c_6mbi_20ydevstack@QuobyteHD" returned: 0 in 0.359s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:46:39 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-2613afa1-1a12-4e29-a2d2-4492b2828024 tempest-VolumeImageDependencyTests-1692488225 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_467b4178-b820-4f14-b7f5-207be719969c_6mbi_20ydevstack@QuobyteHD {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:46:39 devstack sudo[107649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_467b4178-b820-4f14-b7f5-207be719969c_6mbi_20ydevstack@QuobyteHD Aug 03 08:46:39 devstack sudo[107649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:46:39 devstack sudo[107649]: pam_unix(sudo:session): session closed for user root Aug 03 08:46:39 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-2613afa1-1a12-4e29-a2d2-4492b2828024 tempest-VolumeImageDependencyTests-1692488225 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_467b4178-b820-4f14-b7f5-207be719969c_6mbi_20ydevstack@QuobyteHD" returned: 1 in 0.344s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:46:39 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-2613afa1-1a12-4e29-a2d2-4492b2828024 tempest-VolumeImageDependencyTests-1692488225 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_467b4178-b820-4f14-b7f5-207be719969c_6mbi_20ydevstack@QuobyteHD' failed. Not Retrying. {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 03 08:46:39 devstack cinder-volume[88899]: DEBUG cinder.image.image_utils [None req-2613afa1-1a12-4e29-a2d2-4492b2828024 tempest-VolumeImageDependencyTests-1692488225 None] Temporary image 467b4178-b820-4f14-b7f5-207be719969c is fetched for user 5178bef6bbbc4a64812776d11b4731f2. {{(pid=88899) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Aug 03 08:46:39 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca25242a-3301-4a15-bd72-7ccaff1a50d2]: (4, 'raw') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:46:39 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-2613afa1-1a12-4e29-a2d2-4492b2828024 tempest-VolumeImageDependencyTests-1692488225 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_467b4178-b820-4f14-b7f5-207be719969c_6mbi_20ydevstack@QuobyteHD {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:46:39 devstack sudo[107654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_467b4178-b820-4f14-b7f5-207be719969c_6mbi_20ydevstack@QuobyteHD Aug 03 08:46:39 devstack sudo[107654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:46:40 devstack sudo[107654]: pam_unix(sudo:session): session closed for user root Aug 03 08:46:40 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-2613afa1-1a12-4e29-a2d2-4492b2828024 tempest-VolumeImageDependencyTests-1692488225 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_467b4178-b820-4f14-b7f5-207be719969c_6mbi_20ydevstack@QuobyteHD" returned: 0 in 0.429s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:46:40 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-2613afa1-1a12-4e29-a2d2-4492b2828024 tempest-VolumeImageDependencyTests-1692488225 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_467b4178-b820-4f14-b7f5-207be719969c_6mbi_20ydevstack@QuobyteHD {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:46:40 devstack sudo[107728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_467b4178-b820-4f14-b7f5-207be719969c_6mbi_20ydevstack@QuobyteHD Aug 03 08:46:40 devstack sudo[107728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:46:40 devstack sudo[107728]: pam_unix(sudo:session): session closed for user root Aug 03 08:46:40 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-2613afa1-1a12-4e29-a2d2-4492b2828024 tempest-VolumeImageDependencyTests-1692488225 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_467b4178-b820-4f14-b7f5-207be719969c_6mbi_20ydevstack@QuobyteHD" returned: 1 in 0.516s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:46:40 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-2613afa1-1a12-4e29-a2d2-4492b2828024 tempest-VolumeImageDependencyTests-1692488225 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_467b4178-b820-4f14-b7f5-207be719969c_6mbi_20ydevstack@QuobyteHD' failed. Not Retrying. {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 03 08:46:40 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-2613afa1-1a12-4e29-a2d2-4492b2828024 tempest-VolumeImageDependencyTests-1692488225 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:46:40 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-2613afa1-1a12-4e29-a2d2-4492b2828024 tempest-VolumeImageDependencyTests-1692488225 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:46:40 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-2613afa1-1a12-4e29-a2d2-4492b2828024 tempest-VolumeImageDependencyTests-1692488225 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:46:38Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-teste6050452-06bd-4c7f-9912-45178c83e379',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=44b78dc0-8107-46b1-804f-b5e842f1203f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5f2073d44fb6478c84cdc92ba34faea6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:46:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:46:38Z,use_quota=True,user_id='5178bef6bbbc4a64812776d11b4731f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8bde7129-1dc4-42ab-b852-ab32c61b4921),volume_type_id=8bde7129-1dc4-42ab-b852-ab32c61b4921)}" {{(pid=88899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 08:46:40 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-2613afa1-1a12-4e29-a2d2-4492b2828024 tempest-VolumeImageDependencyTests-1692488225 None] Creating volume 44b78dc0-8107-46b1-804f-b5e842f1203f {{(pid=88899) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 08:46:40 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-2613afa1-1a12-4e29-a2d2-4492b2828024 tempest-VolumeImageDependencyTests-1692488225 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:46:40 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-2613afa1-1a12-4e29-a2d2-4492b2828024 tempest-VolumeImageDependencyTests-1692488225 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:46:40 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-2613afa1-1a12-4e29-a2d2-4492b2828024 tempest-VolumeImageDependencyTests-1692488225 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:46:40 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-2613afa1-1a12-4e29-a2d2-4492b2828024 tempest-VolumeImageDependencyTests-1692488225 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:46:40 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-2613afa1-1a12-4e29-a2d2-4492b2828024 tempest-VolumeImageDependencyTests-1692488225 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:46:40 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-2613afa1-1a12-4e29-a2d2-4492b2828024 tempest-VolumeImageDependencyTests-1692488225 None] Selected osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385 as target Quobyte volume. {{(pid=88899) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 08:46:40 devstack cinder-volume[88899]: INFO cinder.volume.drivers.remotefs [None req-2613afa1-1a12-4e29-a2d2-4492b2828024 tempest-VolumeImageDependencyTests-1692488225 None] casted to osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385 Aug 03 08:46:40 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-2613afa1-1a12-4e29-a2d2-4492b2828024 tempest-VolumeImageDependencyTests-1692488225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-44b78dc0-8107-46b1-804f-b5e842f1203f 1073741824 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:46:40 devstack sudo[108081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-44b78dc0-8107-46b1-804f-b5e842f1203f 1073741824 Aug 03 08:46:40 devstack sudo[108081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:46:41 devstack sudo[108081]: pam_unix(sudo:session): session closed for user root Aug 03 08:46:41 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-2613afa1-1a12-4e29-a2d2-4492b2828024 tempest-VolumeImageDependencyTests-1692488225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-44b78dc0-8107-46b1-804f-b5e842f1203f 1073741824" returned: 0 in 0.568s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:46:41 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-2613afa1-1a12-4e29-a2d2-4492b2828024 tempest-VolumeImageDependencyTests-1692488225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-44b78dc0-8107-46b1-804f-b5e842f1203f {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:46:41 devstack sudo[108109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-44b78dc0-8107-46b1-804f-b5e842f1203f Aug 03 08:46:41 devstack sudo[108109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:46:41 devstack sudo[108109]: pam_unix(sudo:session): session closed for user root Aug 03 08:46:41 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-2613afa1-1a12-4e29-a2d2-4492b2828024 tempest-VolumeImageDependencyTests-1692488225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-44b78dc0-8107-46b1-804f-b5e842f1203f" returned: 0 in 0.252s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:46:41 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-2613afa1-1a12-4e29-a2d2-4492b2828024 tempest-VolumeImageDependencyTests-1692488225 None] <== create_volume: return (865ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'} {{(pid=88899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 08:46:41 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-2613afa1-1a12-4e29-a2d2-4492b2828024 tempest-VolumeImageDependencyTests-1692488225 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.869s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:46:41 devstack cinder-volume[88899]: DEBUG dbcounter [-] [88899] Writing DB stats cinder:SELECT=116,cinder:INSERT=47,cinder:UPDATE=120,cinder:DELETE=10 {{(pid=88899) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 03 08:46:41 devstack cinder-volume[88899]: DEBUG cinder.volume.volume_utils [None req-2613afa1-1a12-4e29-a2d2-4492b2828024 tempest-VolumeImageDependencyTests-1692488225 None] Attempting download of 467b4178-b820-4f14-b7f5-207be719969c ((None, [{'url': 'file:///opt/stack/data/glance/images/467b4178-b820-4f14-b7f5-207be719969c', 'metadata': {}}])) to volume 44b78dc0-8107-46b1-804f-b5e842f1203f. {{(pid=88899) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Aug 03 08:46:41 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[75889f63-8822-4b7d-855f-c306a75f283a]: (4, 'raw') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:46:41 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-2613afa1-1a12-4e29-a2d2-4492b2828024 tempest-VolumeImageDependencyTests-1692488225 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_467b4178-b820-4f14-b7f5-207be719969c_fi5o17sy {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:46:41 devstack sudo[108121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_467b4178-b820-4f14-b7f5-207be719969c_fi5o17sy Aug 03 08:46:41 devstack sudo[108121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:46:42 devstack sudo[108121]: pam_unix(sudo:session): session closed for user root Aug 03 08:46:42 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-2613afa1-1a12-4e29-a2d2-4492b2828024 tempest-VolumeImageDependencyTests-1692488225 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_467b4178-b820-4f14-b7f5-207be719969c_fi5o17sy" returned: 0 in 0.338s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:46:42 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-2613afa1-1a12-4e29-a2d2-4492b2828024 tempest-VolumeImageDependencyTests-1692488225 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_467b4178-b820-4f14-b7f5-207be719969c_fi5o17sy {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:46:42 devstack sudo[108135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_467b4178-b820-4f14-b7f5-207be719969c_fi5o17sy Aug 03 08:46:42 devstack sudo[108135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:46:42 devstack sudo[108135]: pam_unix(sudo:session): session closed for user root Aug 03 08:46:42 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-2613afa1-1a12-4e29-a2d2-4492b2828024 tempest-VolumeImageDependencyTests-1692488225 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_467b4178-b820-4f14-b7f5-207be719969c_fi5o17sy" returned: 1 in 0.354s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:46:42 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-2613afa1-1a12-4e29-a2d2-4492b2828024 tempest-VolumeImageDependencyTests-1692488225 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_467b4178-b820-4f14-b7f5-207be719969c_fi5o17sy' failed. Not Retrying. {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 03 08:46:42 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc442544-8b05-45c6-a114-c13c4bda1d40]: (4, 'raw') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:46:42 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-2613afa1-1a12-4e29-a2d2-4492b2828024 tempest-VolumeImageDependencyTests-1692488225 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_467b4178-b820-4f14-b7f5-207be719969c_6mbi_20ydevstack@QuobyteHD {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:46:42 devstack sudo[108139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_467b4178-b820-4f14-b7f5-207be719969c_6mbi_20ydevstack@QuobyteHD Aug 03 08:46:42 devstack sudo[108139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:46:42 devstack sudo[108139]: pam_unix(sudo:session): session closed for user root Aug 03 08:46:42 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-2613afa1-1a12-4e29-a2d2-4492b2828024 tempest-VolumeImageDependencyTests-1692488225 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_467b4178-b820-4f14-b7f5-207be719969c_6mbi_20ydevstack@QuobyteHD" returned: 0 in 0.348s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:46:42 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-2613afa1-1a12-4e29-a2d2-4492b2828024 tempest-VolumeImageDependencyTests-1692488225 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_467b4178-b820-4f14-b7f5-207be719969c_6mbi_20ydevstack@QuobyteHD {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:46:42 devstack sudo[108145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_467b4178-b820-4f14-b7f5-207be719969c_6mbi_20ydevstack@QuobyteHD Aug 03 08:46:42 devstack sudo[108145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:46:43 devstack sudo[108145]: pam_unix(sudo:session): session closed for user root Aug 03 08:46:43 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-2613afa1-1a12-4e29-a2d2-4492b2828024 tempest-VolumeImageDependencyTests-1692488225 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_467b4178-b820-4f14-b7f5-207be719969c_6mbi_20ydevstack@QuobyteHD" returned: 1 in 0.377s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:46:43 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-2613afa1-1a12-4e29-a2d2-4492b2828024 tempest-VolumeImageDependencyTests-1692488225 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_467b4178-b820-4f14-b7f5-207be719969c_6mbi_20ydevstack@QuobyteHD' failed. Not Retrying. {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 03 08:46:43 devstack cinder-volume[88899]: DEBUG cinder.image.image_utils [None req-2613afa1-1a12-4e29-a2d2-4492b2828024 tempest-VolumeImageDependencyTests-1692488225 None] 467b4178-b820-4f14-b7f5-207be719969c was raw, converting to qcow2 {{(pid=88899) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Aug 03 08:46:43 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-2613afa1-1a12-4e29-a2d2-4492b2828024 tempest-VolumeImageDependencyTests-1692488225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_467b4178-b820-4f14-b7f5-207be719969c_6mbi_20ydevstack@QuobyteHD /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-44b78dc0-8107-46b1-804f-b5e842f1203f {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:46:43 devstack sudo[108150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_467b4178-b820-4f14-b7f5-207be719969c_6mbi_20ydevstack@QuobyteHD /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-44b78dc0-8107-46b1-804f-b5e842f1203f Aug 03 08:46:43 devstack sudo[108150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:46:43 devstack sudo[108150]: pam_unix(sudo:session): session closed for user root Aug 03 08:46:43 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-2613afa1-1a12-4e29-a2d2-4492b2828024 tempest-VolumeImageDependencyTests-1692488225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_467b4178-b820-4f14-b7f5-207be719969c_6mbi_20ydevstack@QuobyteHD /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-44b78dc0-8107-46b1-804f-b5e842f1203f" returned: 0 in 0.453s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:46:43 devstack cinder-volume[88899]: DEBUG cinder.image.image_utils [None req-2613afa1-1a12-4e29-a2d2-4492b2828024 tempest-VolumeImageDependencyTests-1692488225 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_467b4178-b820-4f14-b7f5-207be719969c_6mbi_20ydevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-44b78dc0-8107-46b1-804f-b5e842f1203f {{(pid=88899) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 03 08:46:43 devstack cinder-volume[88899]: INFO cinder.image.image_utils [None req-2613afa1-1a12-4e29-a2d2-4492b2828024 tempest-VolumeImageDependencyTests-1692488225 None] Converted 0.00 MB image at 0.00 MB/s Aug 03 08:46:43 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-2613afa1-1a12-4e29-a2d2-4492b2828024 tempest-VolumeImageDependencyTests-1692488225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-44b78dc0-8107-46b1-804f-b5e842f1203f 1G {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:46:43 devstack sudo[108155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-44b78dc0-8107-46b1-804f-b5e842f1203f 1G Aug 03 08:46:43 devstack sudo[108155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:46:43 devstack sudo[108155]: pam_unix(sudo:session): session closed for user root Aug 03 08:46:43 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-2613afa1-1a12-4e29-a2d2-4492b2828024 tempest-VolumeImageDependencyTests-1692488225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-44b78dc0-8107-46b1-804f-b5e842f1203f 1G" returned: 0 in 0.356s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:46:43 devstack cinder-volume[88899]: DEBUG cinder.volume.volume_utils [None req-2613afa1-1a12-4e29-a2d2-4492b2828024 tempest-VolumeImageDependencyTests-1692488225 None] Downloaded image 467b4178-b820-4f14-b7f5-207be719969c ((None, [{'url': 'file:///opt/stack/data/glance/images/467b4178-b820-4f14-b7f5-207be719969c', 'metadata': {}}])) to volume 44b78dc0-8107-46b1-804f-b5e842f1203f successfully. {{(pid=88899) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Aug 03 08:46:43 devstack cinder-volume[88899]: DEBUG cinder.image.image_utils [None req-2613afa1-1a12-4e29-a2d2-4492b2828024 tempest-VolumeImageDependencyTests-1692488225 None] Temporary image 467b4178-b820-4f14-b7f5-207be719969c for user 5178bef6bbbc4a64812776d11b4731f2 is deleted. {{(pid=88899) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Aug 03 08:46:43 devstack cinder-volume[88899]: DEBUG cinder.volume.volume_utils [None req-2613afa1-1a12-4e29-a2d2-4492b2828024 tempest-VolumeImageDependencyTests-1692488225 None] Marking volume 44b78dc0-8107-46b1-804f-b5e842f1203f as bootable. {{(pid=88899) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Aug 03 08:46:44 devstack cinder-volume[88899]: DEBUG cinder.volume.flows.manager.create_volume [None req-2613afa1-1a12-4e29-a2d2-4492b2828024 tempest-VolumeImageDependencyTests-1692488225 None] Copying metadata from image 467b4178-b820-4f14-b7f5-207be719969c to 44b78dc0-8107-46b1-804f-b5e842f1203f. {{(pid=88899) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Aug 03 08:46:44 devstack cinder-volume[88899]: DEBUG cinder.volume.flows.manager.create_volume [None req-2613afa1-1a12-4e29-a2d2-4492b2828024 tempest-VolumeImageDependencyTests-1692488225 None] Creating volume glance metadata for volume 44b78dc0-8107-46b1-804f-b5e842f1203f backed by image 467b4178-b820-4f14-b7f5-207be719969c with: {'image_id': '467b4178-b820-4f14-b7f5-207be719969c', 'image_name': 'image-for-test-e6050452-06bd-4c7f-9912-45178c83e379', 'checksum': '34e97aeb18407fa4d14e38b5d5e29219', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=88899) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Aug 03 08:46:44 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-2613afa1-1a12-4e29-a2d2-4492b2828024 tempest-VolumeImageDependencyTests-1692488225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d9db888f-4678-4398-b209-f9d16bbb4344) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-44b78dc0-8107-46b1-804f-b5e842f1203f', 'volume_size': 1, 'image_id': '467b4178-b820-4f14-b7f5-207be719969c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/467b4178-b820-4f14-b7f5-207be719969c', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-e6050452-06bd-4c7f-9912-45178c83e379', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '34e97aeb18407fa4d14e38b5d5e29219', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '5f2073d44fb6478c84cdc92ba34faea6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'aca44f9344c5d1da0958206dac34250a0a44b45d3b868c28a3f187feefae750f0f3e97a1bcdee268b296c3bf1be836f1fde93fd6b0ed606fa1f1338ae2dbb7dd', 'id': '467b4178-b820-4f14-b7f5-207be719969c', 'created_at': datetime.datetime(2026, 8, 3, 6, 46, 36, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 3, 6, 46, 38, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/467b4178-b820-4f14-b7f5-207be719969c/file', 'properties': {}}, 'image_service': }' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:46:44 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-2613afa1-1a12-4e29-a2d2-4492b2828024 tempest-VolumeImageDependencyTests-1692488225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed68e7a2-e10b-42cc-afe0-e2196afca4e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:46:44 devstack cinder-volume[88899]: INFO cinder.volume.flows.manager.create_volume [None req-2613afa1-1a12-4e29-a2d2-4492b2828024 tempest-VolumeImageDependencyTests-1692488225 None] Volume volume-44b78dc0-8107-46b1-804f-b5e842f1203f (44b78dc0-8107-46b1-804f-b5e842f1203f): created successfully Aug 03 08:46:44 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-2613afa1-1a12-4e29-a2d2-4492b2828024 tempest-VolumeImageDependencyTests-1692488225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed68e7a2-e10b-42cc-afe0-e2196afca4e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:46:44 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-2613afa1-1a12-4e29-a2d2-4492b2828024 tempest-VolumeImageDependencyTests-1692488225 None] Flow 'volume_create_manager' (44c4d8c3-41cb-4432-a54f-5a126fe1b8d3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:46:44 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-2613afa1-1a12-4e29-a2d2-4492b2828024 tempest-VolumeImageDependencyTests-1692488225 None] Created volume successfully. Aug 03 08:46:45 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-42c63bfb-7dcc-433b-9624-c63920a417a4 tempest-VolumeImageDependencyTests-1692488225 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:46:45 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-42c63bfb-7dcc-433b-9624-c63920a417a4 tempest-VolumeImageDependencyTests-1692488225 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:46:45 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-42c63bfb-7dcc-433b-9624-c63920a417a4 tempest-VolumeImageDependencyTests-1692488225 None] Creating offline snapshot 50dea396-00b5-453e-b2cc-b46328406f59 of volume 44b78dc0-8107-46b1-804f-b5e842f1203f {{(pid=88899) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 03 08:46:45 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac7cc8c1-2368-4083-a5fd-74184c824c02]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:46:45 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-42c63bfb-7dcc-433b-9624-c63920a417a4 tempest-VolumeImageDependencyTests-1692488225 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-44b78dc0-8107-46b1-804f-b5e842f1203f {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:46:45 devstack sudo[108161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-44b78dc0-8107-46b1-804f-b5e842f1203f Aug 03 08:46:45 devstack sudo[108161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:46:45 devstack sudo[108161]: pam_unix(sudo:session): session closed for user root Aug 03 08:46:45 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-42c63bfb-7dcc-433b-9624-c63920a417a4 tempest-VolumeImageDependencyTests-1692488225 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-44b78dc0-8107-46b1-804f-b5e842f1203f" returned: 0 in 0.380s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:46:45 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-42c63bfb-7dcc-433b-9624-c63920a417a4 tempest-VolumeImageDependencyTests-1692488225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-44b78dc0-8107-46b1-804f-b5e842f1203f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-44b78dc0-8107-46b1-804f-b5e842f1203f.50dea396-00b5-453e-b2cc-b46328406f59 1G {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:46:45 devstack sudo[108166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-44b78dc0-8107-46b1-804f-b5e842f1203f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-44b78dc0-8107-46b1-804f-b5e842f1203f.50dea396-00b5-453e-b2cc-b46328406f59 1G Aug 03 08:46:45 devstack sudo[108166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:46:46 devstack sudo[108166]: pam_unix(sudo:session): session closed for user root Aug 03 08:46:46 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-42c63bfb-7dcc-433b-9624-c63920a417a4 tempest-VolumeImageDependencyTests-1692488225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-44b78dc0-8107-46b1-804f-b5e842f1203f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-44b78dc0-8107-46b1-804f-b5e842f1203f.50dea396-00b5-453e-b2cc-b46328406f59 1G" returned: 0 in 0.424s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:46:46 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-42c63bfb-7dcc-433b-9624-c63920a417a4 tempest-VolumeImageDependencyTests-1692488225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-44b78dc0-8107-46b1-804f-b5e842f1203f -F qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-44b78dc0-8107-46b1-804f-b5e842f1203f.50dea396-00b5-453e-b2cc-b46328406f59 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:46:46 devstack sudo[108172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-44b78dc0-8107-46b1-804f-b5e842f1203f -F qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-44b78dc0-8107-46b1-804f-b5e842f1203f.50dea396-00b5-453e-b2cc-b46328406f59 Aug 03 08:46:46 devstack sudo[108172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:46:46 devstack sudo[108172]: pam_unix(sudo:session): session closed for user root Aug 03 08:46:46 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-42c63bfb-7dcc-433b-9624-c63920a417a4 tempest-VolumeImageDependencyTests-1692488225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-44b78dc0-8107-46b1-804f-b5e842f1203f -F qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-44b78dc0-8107-46b1-804f-b5e842f1203f.50dea396-00b5-453e-b2cc-b46328406f59" returned: 0 in 0.311s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:46:46 devstack cinder-volume[88899]: WARNING cinder.volume.drivers.remotefs [None req-42c63bfb-7dcc-433b-9624-c63920a417a4 tempest-VolumeImageDependencyTests-1692488225 None] /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-44b78dc0-8107-46b1-804f-b5e842f1203f.50dea396-00b5-453e-b2cc-b46328406f59 is being set with open permissions: ugo+rw Aug 03 08:46:46 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-42c63bfb-7dcc-433b-9624-c63920a417a4 tempest-VolumeImageDependencyTests-1692488225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-44b78dc0-8107-46b1-804f-b5e842f1203f.50dea396-00b5-453e-b2cc-b46328406f59 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:46:46 devstack sudo[108177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-44b78dc0-8107-46b1-804f-b5e842f1203f.50dea396-00b5-453e-b2cc-b46328406f59 Aug 03 08:46:46 devstack sudo[108177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:46:46 devstack sudo[108177]: pam_unix(sudo:session): session closed for user root Aug 03 08:46:46 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-42c63bfb-7dcc-433b-9624-c63920a417a4 tempest-VolumeImageDependencyTests-1692488225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-44b78dc0-8107-46b1-804f-b5e842f1203f.50dea396-00b5-453e-b2cc-b46328406f59" returned: 0 in 0.250s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:46:46 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-42c63bfb-7dcc-433b-9624-c63920a417a4 tempest-VolumeImageDependencyTests-1692488225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-44b78dc0-8107-46b1-804f-b5e842f1203f.info {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:46:46 devstack sudo[108180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-44b78dc0-8107-46b1-804f-b5e842f1203f.info Aug 03 08:46:46 devstack sudo[108180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:46:46 devstack sudo[108180]: pam_unix(sudo:session): session closed for user root Aug 03 08:46:46 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-42c63bfb-7dcc-433b-9624-c63920a417a4 tempest-VolumeImageDependencyTests-1692488225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-44b78dc0-8107-46b1-804f-b5e842f1203f.info" returned: 0 in 0.256s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:46:46 devstack cinder-volume[88899]: WARNING cinder.volume.drivers.remotefs [None req-42c63bfb-7dcc-433b-9624-c63920a417a4 tempest-VolumeImageDependencyTests-1692488225 None] /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-44b78dc0-8107-46b1-804f-b5e842f1203f.info is being set with open permissions: ugo+rw Aug 03 08:46:46 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-42c63bfb-7dcc-433b-9624-c63920a417a4 tempest-VolumeImageDependencyTests-1692488225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-44b78dc0-8107-46b1-804f-b5e842f1203f.info {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:46:46 devstack sudo[108183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-44b78dc0-8107-46b1-804f-b5e842f1203f.info Aug 03 08:46:46 devstack sudo[108183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:46:47 devstack sudo[108183]: pam_unix(sudo:session): session closed for user root Aug 03 08:46:47 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-42c63bfb-7dcc-433b-9624-c63920a417a4 tempest-VolumeImageDependencyTests-1692488225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-44b78dc0-8107-46b1-804f-b5e842f1203f.info" returned: 0 in 0.264s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:46:47 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-42c63bfb-7dcc-433b-9624-c63920a417a4 tempest-VolumeImageDependencyTests-1692488225 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.986s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:46:47 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-42c63bfb-7dcc-433b-9624-c63920a417a4 tempest-VolumeImageDependencyTests-1692488225 None] Create snapshot completed successfully Aug 03 08:46:48 devstack cinder-volume[88899]: DEBUG cinder.volume.flows.manager.create_volume [None req-fa89daa2-f6ea-4815-ab7b-7a0f43bd8c0a tempest-VolumeImageDependencyTests-1692488225 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88899) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 08:46:48 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-fa89daa2-f6ea-4815-ab7b-7a0f43bd8c0a tempest-VolumeImageDependencyTests-1692488225 None] Flow 'volume_create_manager' (22ae8c86-107d-41c5-a527-fe3b33084771) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:46:48 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-fa89daa2-f6ea-4815-ab7b-7a0f43bd8c0a tempest-VolumeImageDependencyTests-1692488225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c23ea38f-9c81-4494-8814-db7e1fe6cdeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:46:48 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-fa89daa2-f6ea-4815-ab7b-7a0f43bd8c0a tempest-VolumeImageDependencyTests-1692488225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c23ea38f-9c81-4494-8814-db7e1fe6cdeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=True,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:46:49Z,deleted=False,deleted_at=None,display_description=None,display_name='volume2-for-test-e6050452-06bd-4c7f-9912-45178c83e379',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b7246d1-a8ce-4c7e-80b4-d67326caa3dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5f2073d44fb6478c84cdc92ba34faea6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:46:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=50dea396-00b5-453e-b2cc-b46328406f59,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:46:49Z,use_quota=True,user_id='5178bef6bbbc4a64812776d11b4731f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8bde7129-1dc4-42ab-b852-ab32c61b4921),volume_type_id=8bde7129-1dc4-42ab-b852-ab32c61b4921)' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:46:48 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-fa89daa2-f6ea-4815-ab7b-7a0f43bd8c0a tempest-VolumeImageDependencyTests-1692488225 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46838ab9-4474-41a6-b72a-9bae64998cba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:46:48 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-fa89daa2-f6ea-4815-ab7b-7a0f43bd8c0a tempest-VolumeImageDependencyTests-1692488225 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46838ab9-4474-41a6-b72a-9bae64998cba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:46:48 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-fa89daa2-f6ea-4815-ab7b-7a0f43bd8c0a tempest-VolumeImageDependencyTests-1692488225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b53022d9-e388-4383-8796-cc9eac384d7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:46:48 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-fa89daa2-f6ea-4815-ab7b-7a0f43bd8c0a tempest-VolumeImageDependencyTests-1692488225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b53022d9-e388-4383-8796-cc9eac384d7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '8b7246d1-a8ce-4c7e-80b4-d67326caa3dc', 'volume_name': 'volume-8b7246d1-a8ce-4c7e-80b4-d67326caa3dc', 'volume_size': 1, 'snapshot_id': '50dea396-00b5-453e-b2cc-b46328406f59'}' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:46:48 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-fa89daa2-f6ea-4815-ab7b-7a0f43bd8c0a tempest-VolumeImageDependencyTests-1692488225 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7da488e2-7b00-4a58-92f1-ef254bf4d02e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:46:48 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-fa89daa2-f6ea-4815-ab7b-7a0f43bd8c0a tempest-VolumeImageDependencyTests-1692488225 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7da488e2-7b00-4a58-92f1-ef254bf4d02e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:46:48 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-fa89daa2-f6ea-4815-ab7b-7a0f43bd8c0a tempest-VolumeImageDependencyTests-1692488225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a518dc31-4282-45fa-b823-9b00c21000a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:46:48 devstack cinder-volume[88899]: INFO cinder.volume.flows.manager.create_volume [None req-fa89daa2-f6ea-4815-ab7b-7a0f43bd8c0a tempest-VolumeImageDependencyTests-1692488225 None] Volume 8b7246d1-a8ce-4c7e-80b4-d67326caa3dc: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-8b7246d1-a8ce-4c7e-80b4-d67326caa3dc', 'volume_size': 1, 'snapshot_id': '50dea396-00b5-453e-b2cc-b46328406f59'} Aug 03 08:46:48 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-fa89daa2-f6ea-4815-ab7b-7a0f43bd8c0a tempest-VolumeImageDependencyTests-1692488225 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:46:48 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-fa89daa2-f6ea-4815-ab7b-7a0f43bd8c0a tempest-VolumeImageDependencyTests-1692488225 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:46:48 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-fa89daa2-f6ea-4815-ab7b-7a0f43bd8c0a tempest-VolumeImageDependencyTests-1692488225 None] Acquiring lock "cinder-quobyte-50dea396-00b5-453e-b2cc-b46328406f59-8b7246d1-a8ce-4c7e-80b4-d67326caa3dc" by "_create_volume_from_snapshot" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:46:48 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-fa89daa2-f6ea-4815-ab7b-7a0f43bd8c0a tempest-VolumeImageDependencyTests-1692488225 None] Lock "cinder-quobyte-50dea396-00b5-453e-b2cc-b46328406f59-8b7246d1-a8ce-4c7e-80b4-d67326caa3dc" acquired by "_create_volume_from_snapshot" :: waited 0.016s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:46:48 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-fa89daa2-f6ea-4815-ab7b-7a0f43bd8c0a tempest-VolumeImageDependencyTests-1692488225 None] Creating volume 8b7246d1-a8ce-4c7e-80b4-d67326caa3dc from snapshot 50dea396-00b5-453e-b2cc-b46328406f59 {{(pid=88899) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Aug 03 08:46:48 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-fa89daa2-f6ea-4815-ab7b-7a0f43bd8c0a tempest-VolumeImageDependencyTests-1692488225 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:46:48 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-fa89daa2-f6ea-4815-ab7b-7a0f43bd8c0a tempest-VolumeImageDependencyTests-1692488225 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:46:48 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-fa89daa2-f6ea-4815-ab7b-7a0f43bd8c0a tempest-VolumeImageDependencyTests-1692488225 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:46:49 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-fa89daa2-f6ea-4815-ab7b-7a0f43bd8c0a tempest-VolumeImageDependencyTests-1692488225 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:46:49 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-fa89daa2-f6ea-4815-ab7b-7a0f43bd8c0a tempest-VolumeImageDependencyTests-1692488225 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:46:49 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-fa89daa2-f6ea-4815-ab7b-7a0f43bd8c0a tempest-VolumeImageDependencyTests-1692488225 None] Selected osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385 as target Quobyte volume. {{(pid=88899) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 08:46:49 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-fa89daa2-f6ea-4815-ab7b-7a0f43bd8c0a tempest-VolumeImageDependencyTests-1692488225 None] Acquiring lock "cinder-quobyte-8b7246d1-a8ce-4c7e-80b4-d67326caa3dc" by "_copy_volume_from_snapshot" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:46:49 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-fa89daa2-f6ea-4815-ab7b-7a0f43bd8c0a tempest-VolumeImageDependencyTests-1692488225 None] Lock "cinder-quobyte-8b7246d1-a8ce-4c7e-80b4-d67326caa3dc" acquired by "_copy_volume_from_snapshot" :: waited 0.012s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:46:49 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-fa89daa2-f6ea-4815-ab7b-7a0f43bd8c0a tempest-VolumeImageDependencyTests-1692488225 None] snapshot: 50dea396-00b5-453e-b2cc-b46328406f59, volume: 8b7246d1-a8ce-4c7e-80b4-d67326caa3dc, {{(pid=88899) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Aug 03 08:46:49 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-fa89daa2-f6ea-4815-ab7b-7a0f43bd8c0a tempest-VolumeImageDependencyTests-1692488225 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:46:49 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-fa89daa2-f6ea-4815-ab7b-7a0f43bd8c0a tempest-VolumeImageDependencyTests-1692488225 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:46:49 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-fa89daa2-f6ea-4815-ab7b-7a0f43bd8c0a tempest-VolumeImageDependencyTests-1692488225 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:46:49 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-fa89daa2-f6ea-4815-ab7b-7a0f43bd8c0a tempest-VolumeImageDependencyTests-1692488225 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:46:49 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-fa89daa2-f6ea-4815-ab7b-7a0f43bd8c0a tempest-VolumeImageDependencyTests-1692488225 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:46:49 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f7eae00-9830-4afa-b544-a5ead4e66241]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:46:49 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-fa89daa2-f6ea-4815-ab7b-7a0f43bd8c0a tempest-VolumeImageDependencyTests-1692488225 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-44b78dc0-8107-46b1-804f-b5e842f1203f.50dea396-00b5-453e-b2cc-b46328406f59 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:46:49 devstack sudo[108187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-44b78dc0-8107-46b1-804f-b5e842f1203f.50dea396-00b5-453e-b2cc-b46328406f59 Aug 03 08:46:49 devstack sudo[108187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:46:49 devstack sudo[108187]: pam_unix(sudo:session): session closed for user root Aug 03 08:46:49 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-fa89daa2-f6ea-4815-ab7b-7a0f43bd8c0a tempest-VolumeImageDependencyTests-1692488225 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-44b78dc0-8107-46b1-804f-b5e842f1203f.50dea396-00b5-453e-b2cc-b46328406f59" returned: 0 in 0.358s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:46:49 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-fa89daa2-f6ea-4815-ab7b-7a0f43bd8c0a tempest-VolumeImageDependencyTests-1692488225 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-44b78dc0-8107-46b1-804f-b5e842f1203f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88899) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 03 08:46:49 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d182803-2dca-4e1f-b4fc-27e46f6a9142]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:46:49 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-fa89daa2-f6ea-4815-ab7b-7a0f43bd8c0a tempest-VolumeImageDependencyTests-1692488225 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-44b78dc0-8107-46b1-804f-b5e842f1203f {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:46:49 devstack sudo[108192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-44b78dc0-8107-46b1-804f-b5e842f1203f Aug 03 08:46:49 devstack sudo[108192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:46:49 devstack sudo[108192]: pam_unix(sudo:session): session closed for user root Aug 03 08:46:49 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-fa89daa2-f6ea-4815-ab7b-7a0f43bd8c0a tempest-VolumeImageDependencyTests-1692488225 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-44b78dc0-8107-46b1-804f-b5e842f1203f" returned: 0 in 0.357s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:46:49 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-fa89daa2-f6ea-4815-ab7b-7a0f43bd8c0a tempest-VolumeImageDependencyTests-1692488225 None] will copy from snapshot at /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-44b78dc0-8107-46b1-804f-b5e842f1203f {{(pid=88899) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Aug 03 08:46:49 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-fa89daa2-f6ea-4815-ab7b-7a0f43bd8c0a tempest-VolumeImageDependencyTests-1692488225 None] Creating direct copy from snapshot {{(pid=88899) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Aug 03 08:46:49 devstack cinder-volume[88899]: DEBUG cinder.utils [None req-fa89daa2-f6ea-4815-ab7b-7a0f43bd8c0a tempest-VolumeImageDependencyTests-1692488225 None] Path /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-8b7246d1-a8ce-4c7e-80b4-d67326caa3dc not found in is_blk_device check {{(pid=88899) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Aug 03 08:46:49 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-fa89daa2-f6ea-4815-ab7b-7a0f43bd8c0a tempest-VolumeImageDependencyTests-1692488225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-44b78dc0-8107-46b1-804f-b5e842f1203f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-8b7246d1-a8ce-4c7e-80b4-d67326caa3dc {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:46:49 devstack sudo[108197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-44b78dc0-8107-46b1-804f-b5e842f1203f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-8b7246d1-a8ce-4c7e-80b4-d67326caa3dc Aug 03 08:46:49 devstack sudo[108197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:46:50 devstack sudo[108197]: pam_unix(sudo:session): session closed for user root Aug 03 08:46:50 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-fa89daa2-f6ea-4815-ab7b-7a0f43bd8c0a tempest-VolumeImageDependencyTests-1692488225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-44b78dc0-8107-46b1-804f-b5e842f1203f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-8b7246d1-a8ce-4c7e-80b4-d67326caa3dc" returned: 0 in 0.469s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:46:50 devstack cinder-volume[88899]: DEBUG cinder.image.image_utils [None req-fa89daa2-f6ea-4815-ab7b-7a0f43bd8c0a tempest-VolumeImageDependencyTests-1692488225 None] Image conversion details: src /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-44b78dc0-8107-46b1-804f-b5e842f1203f, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-8b7246d1-a8ce-4c7e-80b4-d67326caa3dc {{(pid=88899) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 03 08:46:50 devstack cinder-volume[88899]: INFO cinder.image.image_utils [None req-fa89daa2-f6ea-4815-ab7b-7a0f43bd8c0a tempest-VolumeImageDependencyTests-1692488225 None] Converted 1024.00 MB image at 1024.00 MB/s Aug 03 08:46:50 devstack cinder-volume[88899]: WARNING cinder.volume.drivers.remotefs [None req-fa89daa2-f6ea-4815-ab7b-7a0f43bd8c0a tempest-VolumeImageDependencyTests-1692488225 None] /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-8b7246d1-a8ce-4c7e-80b4-d67326caa3dc is being set with open permissions: ugo+rw Aug 03 08:46:50 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-fa89daa2-f6ea-4815-ab7b-7a0f43bd8c0a tempest-VolumeImageDependencyTests-1692488225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-8b7246d1-a8ce-4c7e-80b4-d67326caa3dc {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:46:50 devstack sudo[108203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-8b7246d1-a8ce-4c7e-80b4-d67326caa3dc Aug 03 08:46:50 devstack sudo[108203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:46:50 devstack sudo[108203]: pam_unix(sudo:session): session closed for user root Aug 03 08:46:50 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-fa89daa2-f6ea-4815-ab7b-7a0f43bd8c0a tempest-VolumeImageDependencyTests-1692488225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-8b7246d1-a8ce-4c7e-80b4-d67326caa3dc" returned: 0 in 0.252s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:46:50 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-fa89daa2-f6ea-4815-ab7b-7a0f43bd8c0a tempest-VolumeImageDependencyTests-1692488225 None] Lock "cinder-quobyte-8b7246d1-a8ce-4c7e-80b4-d67326caa3dc" released by "_copy_volume_from_snapshot" :: held 1.518s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:46:50 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-fa89daa2-f6ea-4815-ab7b-7a0f43bd8c0a tempest-VolumeImageDependencyTests-1692488225 None] Lock "cinder-quobyte-50dea396-00b5-453e-b2cc-b46328406f59-8b7246d1-a8ce-4c7e-80b4-d67326caa3dc" released by "_create_volume_from_snapshot" :: held 1.582s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:46:50 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-fa89daa2-f6ea-4815-ab7b-7a0f43bd8c0a tempest-VolumeImageDependencyTests-1692488225 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 1.599s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:46:50 devstack cinder-volume[88899]: DEBUG cinder.volume.volume_utils [None req-fa89daa2-f6ea-4815-ab7b-7a0f43bd8c0a tempest-VolumeImageDependencyTests-1692488225 None] Marking volume 8b7246d1-a8ce-4c7e-80b4-d67326caa3dc as bootable. {{(pid=88899) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Aug 03 08:46:50 devstack cinder-volume[88899]: DEBUG cinder.volume.flows.manager.create_volume [None req-fa89daa2-f6ea-4815-ab7b-7a0f43bd8c0a tempest-VolumeImageDependencyTests-1692488225 None] Copying metadata from snapshot 50dea396-00b5-453e-b2cc-b46328406f59 to 8b7246d1-a8ce-4c7e-80b4-d67326caa3dc. {{(pid=88899) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:429}} Aug 03 08:46:50 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-fa89daa2-f6ea-4815-ab7b-7a0f43bd8c0a tempest-VolumeImageDependencyTests-1692488225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a518dc31-4282-45fa-b823-9b00c21000a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8b7246d1-a8ce-4c7e-80b4-d67326caa3dc', 'volume_size': 1, 'snapshot_id': '50dea396-00b5-453e-b2cc-b46328406f59'}' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:46:50 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-fa89daa2-f6ea-4815-ab7b-7a0f43bd8c0a tempest-VolumeImageDependencyTests-1692488225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b746ef64-8fec-42d8-9bae-0d3575a5b544) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:46:50 devstack cinder-volume[88899]: INFO cinder.volume.flows.manager.create_volume [None req-fa89daa2-f6ea-4815-ab7b-7a0f43bd8c0a tempest-VolumeImageDependencyTests-1692488225 None] Volume volume-8b7246d1-a8ce-4c7e-80b4-d67326caa3dc (8b7246d1-a8ce-4c7e-80b4-d67326caa3dc): created successfully Aug 03 08:46:50 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-fa89daa2-f6ea-4815-ab7b-7a0f43bd8c0a tempest-VolumeImageDependencyTests-1692488225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b746ef64-8fec-42d8-9bae-0d3575a5b544) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:46:50 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-fa89daa2-f6ea-4815-ab7b-7a0f43bd8c0a tempest-VolumeImageDependencyTests-1692488225 None] Flow 'volume_create_manager' (22ae8c86-107d-41c5-a527-fe3b33084771) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:46:50 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-fa89daa2-f6ea-4815-ab7b-7a0f43bd8c0a tempest-VolumeImageDependencyTests-1692488225 None] Created volume successfully. Aug 03 08:46:50 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-412160b2-eae1-45f4-af96-27eed7ef4032 tempest-VolumeImageDependencyTests-1692488225 None] Acquiring lock "cinder-50dea396-00b5-453e-b2cc-b46328406f59-delete_snapshot" by "delete_snapshot" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:46:50 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-412160b2-eae1-45f4-af96-27eed7ef4032 tempest-VolumeImageDependencyTests-1692488225 None] Lock "cinder-50dea396-00b5-453e-b2cc-b46328406f59-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:46:50 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-412160b2-eae1-45f4-af96-27eed7ef4032 tempest-VolumeImageDependencyTests-1692488225 None] Acquiring lock "cinder-quobyte-44b78dc0-8107-46b1-804f-b5e842f1203f" by "delete_snapshot" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:46:51 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-412160b2-eae1-45f4-af96-27eed7ef4032 tempest-VolumeImageDependencyTests-1692488225 None] Lock "cinder-quobyte-44b78dc0-8107-46b1-804f-b5e842f1203f" acquired by "delete_snapshot" :: waited 0.020s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:46:51 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-412160b2-eae1-45f4-af96-27eed7ef4032 tempest-VolumeImageDependencyTests-1692488225 None] Acquiring lock "cinder-quobyte-50dea396-00b5-453e-b2cc-b46328406f59" by "_delete_snapshot" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:46:51 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-412160b2-eae1-45f4-af96-27eed7ef4032 tempest-VolumeImageDependencyTests-1692488225 None] Lock "cinder-quobyte-50dea396-00b5-453e-b2cc-b46328406f59" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:46:51 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-412160b2-eae1-45f4-af96-27eed7ef4032 tempest-VolumeImageDependencyTests-1692488225 None] Deleting offline snapshot 50dea396-00b5-453e-b2cc-b46328406f59 of volume 44b78dc0-8107-46b1-804f-b5e842f1203f {{(pid=88899) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 03 08:46:51 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-412160b2-eae1-45f4-af96-27eed7ef4032 tempest-VolumeImageDependencyTests-1692488225 None] snapshot_file for this snap is: volume-44b78dc0-8107-46b1-804f-b5e842f1203f.50dea396-00b5-453e-b2cc-b46328406f59 {{(pid=88899) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 03 08:46:51 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[e44f0efd-924c-4cc8-8294-fe62e65b5191]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:46:51 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-412160b2-eae1-45f4-af96-27eed7ef4032 tempest-VolumeImageDependencyTests-1692488225 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-44b78dc0-8107-46b1-804f-b5e842f1203f.50dea396-00b5-453e-b2cc-b46328406f59 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:46:51 devstack sudo[108206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-44b78dc0-8107-46b1-804f-b5e842f1203f.50dea396-00b5-453e-b2cc-b46328406f59 Aug 03 08:46:51 devstack sudo[108206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:46:51 devstack sudo[108206]: pam_unix(sudo:session): session closed for user root Aug 03 08:46:51 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-412160b2-eae1-45f4-af96-27eed7ef4032 tempest-VolumeImageDependencyTests-1692488225 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-44b78dc0-8107-46b1-804f-b5e842f1203f.50dea396-00b5-453e-b2cc-b46328406f59" returned: 0 in 0.352s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:46:51 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-412160b2-eae1-45f4-af96-27eed7ef4032 tempest-VolumeImageDependencyTests-1692488225 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-44b78dc0-8107-46b1-804f-b5e842f1203f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88899) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 03 08:46:51 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[c326e3d6-8145-4867-8868-89f0354c6fb1]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:46:51 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-412160b2-eae1-45f4-af96-27eed7ef4032 tempest-VolumeImageDependencyTests-1692488225 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-44b78dc0-8107-46b1-804f-b5e842f1203f {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:46:51 devstack sudo[108211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-44b78dc0-8107-46b1-804f-b5e842f1203f Aug 03 08:46:51 devstack sudo[108211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:46:51 devstack sudo[108211]: pam_unix(sudo:session): session closed for user root Aug 03 08:46:51 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-412160b2-eae1-45f4-af96-27eed7ef4032 tempest-VolumeImageDependencyTests-1692488225 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-44b78dc0-8107-46b1-804f-b5e842f1203f" returned: 0 in 0.355s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:46:51 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-412160b2-eae1-45f4-af96-27eed7ef4032 tempest-VolumeImageDependencyTests-1692488225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-44b78dc0-8107-46b1-804f-b5e842f1203f.50dea396-00b5-453e-b2cc-b46328406f59 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:46:51 devstack sudo[108216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-44b78dc0-8107-46b1-804f-b5e842f1203f.50dea396-00b5-453e-b2cc-b46328406f59 Aug 03 08:46:51 devstack sudo[108216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:46:51 devstack cinder-volume[88899]: DEBUG oslo_service.periodic_task [None req-f948fb4a-c4d7-499f-b1bd-8d6be3de0b53 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88899) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 03 08:46:51 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-f948fb4a-c4d7-499f-b1bd-8d6be3de0b53 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:46:51 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-f948fb4a-c4d7-499f-b1bd-8d6be3de0b53 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:46:51 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-f948fb4a-c4d7-499f-b1bd-8d6be3de0b53 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:46:51 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-f948fb4a-c4d7-499f-b1bd-8d6be3de0b53 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:46:51 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-f948fb4a-c4d7-499f-b1bd-8d6be3de0b53 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:46:51 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-f948fb4a-c4d7-499f-b1bd-8d6be3de0b53 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:46:51 devstack sudo[108218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a Aug 03 08:46:51 devstack sudo[108218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:46:52 devstack sudo[108216]: pam_unix(sudo:session): session closed for user root Aug 03 08:46:52 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-412160b2-eae1-45f4-af96-27eed7ef4032 tempest-VolumeImageDependencyTests-1692488225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-44b78dc0-8107-46b1-804f-b5e842f1203f.50dea396-00b5-453e-b2cc-b46328406f59" returned: 0 in 0.377s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:46:52 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-412160b2-eae1-45f4-af96-27eed7ef4032 tempest-VolumeImageDependencyTests-1692488225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-44b78dc0-8107-46b1-804f-b5e842f1203f.50dea396-00b5-453e-b2cc-b46328406f59 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:46:52 devstack sudo[108224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-44b78dc0-8107-46b1-804f-b5e842f1203f.50dea396-00b5-453e-b2cc-b46328406f59 Aug 03 08:46:52 devstack sudo[108224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:46:52 devstack sudo[108218]: pam_unix(sudo:session): session closed for user root Aug 03 08:46:52 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-f948fb4a-c4d7-499f-b1bd-8d6be3de0b53 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a" returned: 0 in 0.295s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:46:52 devstack cinder-volume[88899]: DEBUG cinder.manager [None req-f948fb4a-c4d7-499f-b1bd-8d6be3de0b53 None None] Notifying Schedulers of capabilities ... {{(pid=88899) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 08:46:52 devstack cinder-volume[88899]: DEBUG oslo_service.periodic_task [None req-f948fb4a-c4d7-499f-b1bd-8d6be3de0b53 None None] Running periodic task VolumeManager._thread_info {{(pid=88899) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 03 08:46:52 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-f948fb4a-c4d7-499f-b1bd-8d6be3de0b53 None None] thread count: 29 {{(pid=88899) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 03 08:46:52 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-f948fb4a-c4d7-499f-b1bd-8d6be3de0b53 None None] thread info: [<_MainThread(MainThread, started 132234320248960)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88899) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 03 08:46:52 devstack sudo[108224]: pam_unix(sudo:session): session closed for user root Aug 03 08:46:52 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-412160b2-eae1-45f4-af96-27eed7ef4032 tempest-VolumeImageDependencyTests-1692488225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-44b78dc0-8107-46b1-804f-b5e842f1203f.50dea396-00b5-453e-b2cc-b46328406f59" returned: 0 in 0.263s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:46:52 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-412160b2-eae1-45f4-af96-27eed7ef4032 tempest-VolumeImageDependencyTests-1692488225 None] Lock "cinder-quobyte-50dea396-00b5-453e-b2cc-b46328406f59" released by "_delete_snapshot" :: held 1.448s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:46:52 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-412160b2-eae1-45f4-af96-27eed7ef4032 tempest-VolumeImageDependencyTests-1692488225 None] Lock "cinder-quobyte-44b78dc0-8107-46b1-804f-b5e842f1203f" released by "delete_snapshot" :: held 1.476s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:46:52 devstack cinder-volume[88899]: DEBUG cinder.quota [None req-412160b2-eae1-45f4-af96-27eed7ef4032 tempest-VolumeImageDependencyTests-1692488225 None] Created reservations ['3af7d08b-5680-4265-8756-5cab8e8b1b7a', '331e3ba4-d6bd-409b-bc0e-84e32fe4b64b', '2b15ac28-0108-442d-a438-93c83e9c5905', '8746c6bf-ceee-48ad-a8a2-c413af2cd44f'] {{(pid=88899) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 08:46:52 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-412160b2-eae1-45f4-af96-27eed7ef4032 tempest-VolumeImageDependencyTests-1692488225 None] Delete snapshot completed successfully. Aug 03 08:46:52 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-412160b2-eae1-45f4-af96-27eed7ef4032 tempest-VolumeImageDependencyTests-1692488225 None] Lock "cinder-50dea396-00b5-453e-b2cc-b46328406f59-delete_snapshot" released by "delete_snapshot" :: held 1.640s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:46:53 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-9aa97ef0-2160-4063-aa8a-0a56c1799d2f tempest-VolumeImageDependencyTests-1692488225 None] Acquiring lock "cinder-8b7246d1-a8ce-4c7e-80b4-d67326caa3dc-delete_volume" by "delete_volume" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:46:53 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-9aa97ef0-2160-4063-aa8a-0a56c1799d2f tempest-VolumeImageDependencyTests-1692488225 None] Lock "cinder-8b7246d1-a8ce-4c7e-80b4-d67326caa3dc-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:46:53 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-9aa97ef0-2160-4063-aa8a-0a56c1799d2f tempest-VolumeImageDependencyTests-1692488225 None] Acquiring lock "cinder-quobyte-8b7246d1-a8ce-4c7e-80b4-d67326caa3dc" by "delete_volume" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:46:53 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-9aa97ef0-2160-4063-aa8a-0a56c1799d2f tempest-VolumeImageDependencyTests-1692488225 None] Lock "cinder-quobyte-8b7246d1-a8ce-4c7e-80b4-d67326caa3dc" acquired by "delete_volume" :: waited 0.022s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:46:53 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c177ee2-2923-4d0a-bb51-377b0ca49643]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:46:53 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-9aa97ef0-2160-4063-aa8a-0a56c1799d2f tempest-VolumeImageDependencyTests-1692488225 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-8b7246d1-a8ce-4c7e-80b4-d67326caa3dc {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:46:53 devstack sudo[108227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-8b7246d1-a8ce-4c7e-80b4-d67326caa3dc Aug 03 08:46:53 devstack sudo[108227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:46:53 devstack sudo[108227]: pam_unix(sudo:session): session closed for user root Aug 03 08:46:53 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-9aa97ef0-2160-4063-aa8a-0a56c1799d2f tempest-VolumeImageDependencyTests-1692488225 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-8b7246d1-a8ce-4c7e-80b4-d67326caa3dc" returned: 0 in 0.421s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:46:53 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-9aa97ef0-2160-4063-aa8a-0a56c1799d2f tempest-VolumeImageDependencyTests-1692488225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-8b7246d1-a8ce-4c7e-80b4-d67326caa3dc {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:46:53 devstack sudo[108234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-8b7246d1-a8ce-4c7e-80b4-d67326caa3dc Aug 03 08:46:53 devstack sudo[108234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:46:53 devstack sudo[108234]: pam_unix(sudo:session): session closed for user root Aug 03 08:46:53 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-9aa97ef0-2160-4063-aa8a-0a56c1799d2f tempest-VolumeImageDependencyTests-1692488225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-8b7246d1-a8ce-4c7e-80b4-d67326caa3dc" returned: 0 in 0.271s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:46:53 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-9aa97ef0-2160-4063-aa8a-0a56c1799d2f tempest-VolumeImageDependencyTests-1692488225 None] Lock "cinder-quobyte-8b7246d1-a8ce-4c7e-80b4-d67326caa3dc" released by "delete_volume" :: held 0.733s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:46:54 devstack cinder-volume[88899]: DEBUG cinder.quota [None req-9aa97ef0-2160-4063-aa8a-0a56c1799d2f tempest-VolumeImageDependencyTests-1692488225 None] Created reservations ['4b5d66f0-09b5-4f74-8f53-a4b24abc879f', '105b2ceb-33be-4631-941f-3e6e0d0a3f21', '0576e556-8713-4ae4-b8f9-22c9f5e47961', '62e3f045-4cf8-4c14-8b59-b17d8b5a0e51'] {{(pid=88899) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 08:46:54 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-9aa97ef0-2160-4063-aa8a-0a56c1799d2f tempest-VolumeImageDependencyTests-1692488225 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:46:54 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-9aa97ef0-2160-4063-aa8a-0a56c1799d2f tempest-VolumeImageDependencyTests-1692488225 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:46:54 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-9aa97ef0-2160-4063-aa8a-0a56c1799d2f tempest-VolumeImageDependencyTests-1692488225 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:46:54 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-9aa97ef0-2160-4063-aa8a-0a56c1799d2f tempest-VolumeImageDependencyTests-1692488225 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:46:54 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-9aa97ef0-2160-4063-aa8a-0a56c1799d2f tempest-VolumeImageDependencyTests-1692488225 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:46:54 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-9aa97ef0-2160-4063-aa8a-0a56c1799d2f tempest-VolumeImageDependencyTests-1692488225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:46:54 devstack sudo[108237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a Aug 03 08:46:54 devstack sudo[108237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:46:54 devstack sudo[108237]: pam_unix(sudo:session): session closed for user root Aug 03 08:46:54 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-9aa97ef0-2160-4063-aa8a-0a56c1799d2f tempest-VolumeImageDependencyTests-1692488225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a" returned: 0 in 0.275s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:46:54 devstack cinder-volume[88899]: DEBUG cinder.manager [None req-9aa97ef0-2160-4063-aa8a-0a56c1799d2f tempest-VolumeImageDependencyTests-1692488225 None] Notifying Schedulers of capabilities ... {{(pid=88899) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 08:46:54 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-9aa97ef0-2160-4063-aa8a-0a56c1799d2f tempest-VolumeImageDependencyTests-1692488225 None] Deleted volume successfully. Aug 03 08:46:54 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-9aa97ef0-2160-4063-aa8a-0a56c1799d2f tempest-VolumeImageDependencyTests-1692488225 None] Lock "cinder-8b7246d1-a8ce-4c7e-80b4-d67326caa3dc-delete_volume" released by "delete_volume" :: held 1.246s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:46:54 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-0557788e-698f-4082-ae6e-7b24e5f2b731 tempest-VolumeImageDependencyTests-1692488225 None] Acquiring lock "cinder-44b78dc0-8107-46b1-804f-b5e842f1203f-delete_volume" by "delete_volume" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:46:54 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-0557788e-698f-4082-ae6e-7b24e5f2b731 tempest-VolumeImageDependencyTests-1692488225 None] Lock "cinder-44b78dc0-8107-46b1-804f-b5e842f1203f-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:46:54 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-0557788e-698f-4082-ae6e-7b24e5f2b731 tempest-VolumeImageDependencyTests-1692488225 None] Acquiring lock "cinder-quobyte-44b78dc0-8107-46b1-804f-b5e842f1203f" by "delete_volume" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:46:54 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-0557788e-698f-4082-ae6e-7b24e5f2b731 tempest-VolumeImageDependencyTests-1692488225 None] Lock "cinder-quobyte-44b78dc0-8107-46b1-804f-b5e842f1203f" acquired by "delete_volume" :: waited 0.015s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:46:54 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[816e7b9f-ae56-43e1-81d9-b4078ec1d08b]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:46:54 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-0557788e-698f-4082-ae6e-7b24e5f2b731 tempest-VolumeImageDependencyTests-1692488225 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-44b78dc0-8107-46b1-804f-b5e842f1203f {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:46:54 devstack sudo[108240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-44b78dc0-8107-46b1-804f-b5e842f1203f Aug 03 08:46:54 devstack sudo[108240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:46:54 devstack sudo[108240]: pam_unix(sudo:session): session closed for user root Aug 03 08:46:54 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-0557788e-698f-4082-ae6e-7b24e5f2b731 tempest-VolumeImageDependencyTests-1692488225 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-44b78dc0-8107-46b1-804f-b5e842f1203f" returned: 0 in 0.351s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:46:54 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-0557788e-698f-4082-ae6e-7b24e5f2b731 tempest-VolumeImageDependencyTests-1692488225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-44b78dc0-8107-46b1-804f-b5e842f1203f {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:46:55 devstack sudo[108245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-44b78dc0-8107-46b1-804f-b5e842f1203f Aug 03 08:46:55 devstack sudo[108245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:46:55 devstack sudo[108245]: pam_unix(sudo:session): session closed for user root Aug 03 08:46:55 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-0557788e-698f-4082-ae6e-7b24e5f2b731 tempest-VolumeImageDependencyTests-1692488225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-44b78dc0-8107-46b1-804f-b5e842f1203f" returned: 0 in 0.261s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:46:55 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-0557788e-698f-4082-ae6e-7b24e5f2b731 tempest-VolumeImageDependencyTests-1692488225 None] Lock "cinder-quobyte-44b78dc0-8107-46b1-804f-b5e842f1203f" released by "delete_volume" :: held 0.678s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:46:55 devstack cinder-volume[88899]: DEBUG cinder.quota [None req-0557788e-698f-4082-ae6e-7b24e5f2b731 tempest-VolumeImageDependencyTests-1692488225 None] Created reservations ['e4e38912-65be-4a21-adcb-304f418ee863', '22de65e7-5bf0-43cb-9a0f-7d6fe929c29e', 'e8db87fa-70f0-43af-9241-8feeb1d20561', '7d45f401-729a-49ea-a83c-1604dae126c7'] {{(pid=88899) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 08:46:55 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-0557788e-698f-4082-ae6e-7b24e5f2b731 tempest-VolumeImageDependencyTests-1692488225 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:46:55 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-0557788e-698f-4082-ae6e-7b24e5f2b731 tempest-VolumeImageDependencyTests-1692488225 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:46:55 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-0557788e-698f-4082-ae6e-7b24e5f2b731 tempest-VolumeImageDependencyTests-1692488225 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:46:55 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-0557788e-698f-4082-ae6e-7b24e5f2b731 tempest-VolumeImageDependencyTests-1692488225 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:46:55 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-0557788e-698f-4082-ae6e-7b24e5f2b731 tempest-VolumeImageDependencyTests-1692488225 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:46:55 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-0557788e-698f-4082-ae6e-7b24e5f2b731 tempest-VolumeImageDependencyTests-1692488225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:46:55 devstack sudo[108248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a Aug 03 08:46:55 devstack sudo[108248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:46:55 devstack sudo[108248]: pam_unix(sudo:session): session closed for user root Aug 03 08:46:55 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-0557788e-698f-4082-ae6e-7b24e5f2b731 tempest-VolumeImageDependencyTests-1692488225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a" returned: 0 in 0.276s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:46:55 devstack cinder-volume[88899]: DEBUG cinder.manager [None req-0557788e-698f-4082-ae6e-7b24e5f2b731 tempest-VolumeImageDependencyTests-1692488225 None] Notifying Schedulers of capabilities ... {{(pid=88899) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 08:46:55 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-0557788e-698f-4082-ae6e-7b24e5f2b731 tempest-VolumeImageDependencyTests-1692488225 None] Deleted volume successfully. Aug 03 08:46:55 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-0557788e-698f-4082-ae6e-7b24e5f2b731 tempest-VolumeImageDependencyTests-1692488225 None] Lock "cinder-44b78dc0-8107-46b1-804f-b5e842f1203f-delete_volume" released by "delete_volume" :: held 1.175s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:46:55 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-4737d8f1-6c69-4455-a8b1-7544d5ead6b5 tempest-VolumeImageDependencyTests-1692488225 None] Acquiring lock "cinder-24be8730-eebe-4fae-a364-4cbd51c37f8f-delete_volume" by "delete_volume" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:46:55 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-4737d8f1-6c69-4455-a8b1-7544d5ead6b5 tempest-VolumeImageDependencyTests-1692488225 None] Lock "cinder-24be8730-eebe-4fae-a364-4cbd51c37f8f-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:46:56 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-4737d8f1-6c69-4455-a8b1-7544d5ead6b5 tempest-VolumeImageDependencyTests-1692488225 None] Acquiring lock "cinder-quobyte-24be8730-eebe-4fae-a364-4cbd51c37f8f" by "delete_volume" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:46:56 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-4737d8f1-6c69-4455-a8b1-7544d5ead6b5 tempest-VolumeImageDependencyTests-1692488225 None] Lock "cinder-quobyte-24be8730-eebe-4fae-a364-4cbd51c37f8f" acquired by "delete_volume" :: waited 0.020s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:46:56 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd289ba8-d695-4f69-acea-f50a751791cf]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:46:56 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-4737d8f1-6c69-4455-a8b1-7544d5ead6b5 tempest-VolumeImageDependencyTests-1692488225 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-24be8730-eebe-4fae-a364-4cbd51c37f8f {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:46:56 devstack sudo[108263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-24be8730-eebe-4fae-a364-4cbd51c37f8f Aug 03 08:46:56 devstack sudo[108263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:46:56 devstack sudo[108263]: pam_unix(sudo:session): session closed for user root Aug 03 08:46:56 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-4737d8f1-6c69-4455-a8b1-7544d5ead6b5 tempest-VolumeImageDependencyTests-1692488225 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-24be8730-eebe-4fae-a364-4cbd51c37f8f" returned: 0 in 0.388s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:46:56 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-4737d8f1-6c69-4455-a8b1-7544d5ead6b5 tempest-VolumeImageDependencyTests-1692488225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-24be8730-eebe-4fae-a364-4cbd51c37f8f {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:46:56 devstack sudo[108268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-24be8730-eebe-4fae-a364-4cbd51c37f8f Aug 03 08:46:56 devstack sudo[108268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:46:56 devstack sudo[108268]: pam_unix(sudo:session): session closed for user root Aug 03 08:46:56 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-4737d8f1-6c69-4455-a8b1-7544d5ead6b5 tempest-VolumeImageDependencyTests-1692488225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-24be8730-eebe-4fae-a364-4cbd51c37f8f" returned: 0 in 0.255s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:46:56 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-4737d8f1-6c69-4455-a8b1-7544d5ead6b5 tempest-VolumeImageDependencyTests-1692488225 None] Lock "cinder-quobyte-24be8730-eebe-4fae-a364-4cbd51c37f8f" released by "delete_volume" :: held 0.680s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:46:56 devstack cinder-volume[88899]: DEBUG cinder.quota [None req-4737d8f1-6c69-4455-a8b1-7544d5ead6b5 tempest-VolumeImageDependencyTests-1692488225 None] Created reservations ['00ca5f29-4a08-4517-aca0-db18192828b4', '2f1f94fd-bc2b-44ed-b91e-727238e41eeb', '77847945-063f-4478-8fa3-c94d0864cb75', '54121e37-f6ae-4693-ab27-80fcbe92e094'] {{(pid=88899) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 08:46:56 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-4737d8f1-6c69-4455-a8b1-7544d5ead6b5 tempest-VolumeImageDependencyTests-1692488225 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:46:56 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-4737d8f1-6c69-4455-a8b1-7544d5ead6b5 tempest-VolumeImageDependencyTests-1692488225 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:46:56 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-4737d8f1-6c69-4455-a8b1-7544d5ead6b5 tempest-VolumeImageDependencyTests-1692488225 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:46:56 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-4737d8f1-6c69-4455-a8b1-7544d5ead6b5 tempest-VolumeImageDependencyTests-1692488225 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:46:56 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-4737d8f1-6c69-4455-a8b1-7544d5ead6b5 tempest-VolumeImageDependencyTests-1692488225 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:46:56 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-4737d8f1-6c69-4455-a8b1-7544d5ead6b5 tempest-VolumeImageDependencyTests-1692488225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:46:56 devstack sudo[108271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a Aug 03 08:46:56 devstack sudo[108271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:46:57 devstack sudo[108271]: pam_unix(sudo:session): session closed for user root Aug 03 08:46:57 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-4737d8f1-6c69-4455-a8b1-7544d5ead6b5 tempest-VolumeImageDependencyTests-1692488225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a" returned: 0 in 0.245s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:46:57 devstack cinder-volume[88899]: DEBUG cinder.manager [None req-4737d8f1-6c69-4455-a8b1-7544d5ead6b5 tempest-VolumeImageDependencyTests-1692488225 None] Notifying Schedulers of capabilities ... {{(pid=88899) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 08:46:57 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-4737d8f1-6c69-4455-a8b1-7544d5ead6b5 tempest-VolumeImageDependencyTests-1692488225 None] Deleted volume successfully. Aug 03 08:46:57 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-4737d8f1-6c69-4455-a8b1-7544d5ead6b5 tempest-VolumeImageDependencyTests-1692488225 None] Lock "cinder-24be8730-eebe-4fae-a364-4cbd51c37f8f-delete_volume" released by "delete_volume" :: held 1.131s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:47:06 devstack cinder-volume[88899]: DEBUG dbcounter [-] [88899] Writing DB stats cinder:UPDATE=37,cinder:SELECT=30,cinder:INSERT=23,cinder:DELETE=2 {{(pid=88899) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 03 08:47:07 devstack cinder-volume[88899]: DEBUG dbcounter [-] [88899] Writing DB stats cinder:SELECT=54,cinder:INSERT=23,cinder:UPDATE=51,cinder:DELETE=5 {{(pid=88899) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 03 08:47:08 devstack cinder-volume[88899]: INFO cinder.volume.manager [req-7e10575c-8d76-4f49-bf61-7478e2f5885c req-ace1dcb8-80d1-46ab-a669-a4f23a143423 tempest-TestShelveInstance-1134734811 None] Terminate volume connection completed successfully. Aug 03 08:47:08 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [req-7e10575c-8d76-4f49-bf61-7478e2f5885c req-ace1dcb8-80d1-46ab-a669-a4f23a143423 tempest-TestShelveInstance-1134734811 None] Deleting attachment a08c3b76-538d-4361-8e4f-394900cfdb61. {{(pid=88899) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 03 08:47:08 devstack cinder-volume[88899]: DEBUG cinder.coordination [req-7e10575c-8d76-4f49-bf61-7478e2f5885c req-d3e6af3b-d414-43c6-9e53-2bf1d61fb843 tempest-TestShelveInstance-1134734811 None] Acquiring lock "cinder-5dd62159-5525-4bf9-8830-803d9e606d29-delete_volume" by "delete_volume" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:47:08 devstack cinder-volume[88899]: DEBUG cinder.coordination [req-7e10575c-8d76-4f49-bf61-7478e2f5885c req-d3e6af3b-d414-43c6-9e53-2bf1d61fb843 tempest-TestShelveInstance-1134734811 None] Lock "cinder-5dd62159-5525-4bf9-8830-803d9e606d29-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:47:08 devstack cinder-volume[88899]: DEBUG cinder.coordination [req-7e10575c-8d76-4f49-bf61-7478e2f5885c req-d3e6af3b-d414-43c6-9e53-2bf1d61fb843 tempest-TestShelveInstance-1134734811 None] Acquiring lock "cinder-quobyte-5dd62159-5525-4bf9-8830-803d9e606d29" by "delete_volume" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:47:08 devstack cinder-volume[88899]: DEBUG cinder.coordination [req-7e10575c-8d76-4f49-bf61-7478e2f5885c req-d3e6af3b-d414-43c6-9e53-2bf1d61fb843 tempest-TestShelveInstance-1134734811 None] Lock "cinder-quobyte-5dd62159-5525-4bf9-8830-803d9e606d29" acquired by "delete_volume" :: waited 0.020s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:47:08 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a3b2637-54dd-453b-8dac-7b4c43e38993]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:47:08 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [req-7e10575c-8d76-4f49-bf61-7478e2f5885c req-d3e6af3b-d414-43c6-9e53-2bf1d61fb843 tempest-TestShelveInstance-1134734811 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-5dd62159-5525-4bf9-8830-803d9e606d29 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:47:09 devstack sudo[108373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-5dd62159-5525-4bf9-8830-803d9e606d29 Aug 03 08:47:09 devstack sudo[108373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:47:09 devstack sudo[108373]: pam_unix(sudo:session): session closed for user root Aug 03 08:47:09 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [req-7e10575c-8d76-4f49-bf61-7478e2f5885c req-d3e6af3b-d414-43c6-9e53-2bf1d61fb843 tempest-TestShelveInstance-1134734811 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-5dd62159-5525-4bf9-8830-803d9e606d29" returned: 0 in 0.506s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:47:09 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [req-7e10575c-8d76-4f49-bf61-7478e2f5885c req-d3e6af3b-d414-43c6-9e53-2bf1d61fb843 tempest-TestShelveInstance-1134734811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-5dd62159-5525-4bf9-8830-803d9e606d29 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:47:09 devstack sudo[108378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-5dd62159-5525-4bf9-8830-803d9e606d29 Aug 03 08:47:09 devstack sudo[108378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:47:09 devstack sudo[108378]: pam_unix(sudo:session): session closed for user root Aug 03 08:47:09 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [req-7e10575c-8d76-4f49-bf61-7478e2f5885c req-d3e6af3b-d414-43c6-9e53-2bf1d61fb843 tempest-TestShelveInstance-1134734811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-5dd62159-5525-4bf9-8830-803d9e606d29" returned: 0 in 0.282s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:47:09 devstack cinder-volume[88899]: DEBUG cinder.coordination [req-7e10575c-8d76-4f49-bf61-7478e2f5885c req-d3e6af3b-d414-43c6-9e53-2bf1d61fb843 tempest-TestShelveInstance-1134734811 None] Lock "cinder-quobyte-5dd62159-5525-4bf9-8830-803d9e606d29" released by "delete_volume" :: held 0.865s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:47:09 devstack cinder-volume[88899]: DEBUG cinder.quota [req-7e10575c-8d76-4f49-bf61-7478e2f5885c req-d3e6af3b-d414-43c6-9e53-2bf1d61fb843 tempest-TestShelveInstance-1134734811 None] Created reservations ['cc378cec-cb28-49da-9ed3-0d09bd792c44', '98522a41-2c23-43c2-aa54-7edb0e10a2e8', '56e97899-6148-48ac-b0b2-12dd3fecc35b', 'd2189ea5-c3d5-40fc-97c4-ea955d0d21f9'] {{(pid=88899) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 08:47:09 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [req-7e10575c-8d76-4f49-bf61-7478e2f5885c req-d3e6af3b-d414-43c6-9e53-2bf1d61fb843 tempest-TestShelveInstance-1134734811 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:47:09 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [req-7e10575c-8d76-4f49-bf61-7478e2f5885c req-d3e6af3b-d414-43c6-9e53-2bf1d61fb843 tempest-TestShelveInstance-1134734811 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:47:09 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [req-7e10575c-8d76-4f49-bf61-7478e2f5885c req-d3e6af3b-d414-43c6-9e53-2bf1d61fb843 tempest-TestShelveInstance-1134734811 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:47:09 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [req-7e10575c-8d76-4f49-bf61-7478e2f5885c req-d3e6af3b-d414-43c6-9e53-2bf1d61fb843 tempest-TestShelveInstance-1134734811 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:47:09 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [req-7e10575c-8d76-4f49-bf61-7478e2f5885c req-d3e6af3b-d414-43c6-9e53-2bf1d61fb843 tempest-TestShelveInstance-1134734811 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:47:09 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [req-7e10575c-8d76-4f49-bf61-7478e2f5885c req-d3e6af3b-d414-43c6-9e53-2bf1d61fb843 tempest-TestShelveInstance-1134734811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:47:10 devstack sudo[108381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a Aug 03 08:47:10 devstack sudo[108381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:47:10 devstack sudo[108381]: pam_unix(sudo:session): session closed for user root Aug 03 08:47:10 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [req-7e10575c-8d76-4f49-bf61-7478e2f5885c req-d3e6af3b-d414-43c6-9e53-2bf1d61fb843 tempest-TestShelveInstance-1134734811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a" returned: 0 in 0.376s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:47:10 devstack cinder-volume[88899]: DEBUG cinder.manager [req-7e10575c-8d76-4f49-bf61-7478e2f5885c req-d3e6af3b-d414-43c6-9e53-2bf1d61fb843 tempest-TestShelveInstance-1134734811 None] Notifying Schedulers of capabilities ... {{(pid=88899) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 08:47:10 devstack cinder-volume[88899]: INFO cinder.volume.manager [req-7e10575c-8d76-4f49-bf61-7478e2f5885c req-d3e6af3b-d414-43c6-9e53-2bf1d61fb843 tempest-TestShelveInstance-1134734811 None] Deleted volume successfully. Aug 03 08:47:10 devstack cinder-volume[88899]: DEBUG cinder.coordination [req-7e10575c-8d76-4f49-bf61-7478e2f5885c req-d3e6af3b-d414-43c6-9e53-2bf1d61fb843 tempest-TestShelveInstance-1134734811 None] Lock "cinder-5dd62159-5525-4bf9-8830-803d9e606d29-delete_volume" released by "delete_volume" :: held 1.532s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:47:19 devstack cinder-volume[88899]: DEBUG dbcounter [-] [88899] Writing DB stats cinder:SELECT=7,cinder:INSERT=2,cinder:UPDATE=10 {{(pid=88899) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 03 08:47:20 devstack cinder-volume[88899]: DEBUG dbcounter [-] [88899] Writing DB stats cinder:SELECT=5,cinder:UPDATE=6,cinder:INSERT=2,cinder:DELETE=1 {{(pid=88899) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 03 08:47:26 devstack cinder-volume[88899]: DEBUG cinder.volume.flows.manager.create_volume [None req-d3432cb0-6ca7-4c91-93d6-47dff7356c2a tempest-SnapshotDependencyTests-880179703 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88899) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 08:47:26 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-d3432cb0-6ca7-4c91-93d6-47dff7356c2a tempest-SnapshotDependencyTests-880179703 None] Flow 'volume_create_manager' (670de7e3-ccb7-4382-ae87-b4966bdedbab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:47:26 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-d3432cb0-6ca7-4c91-93d6-47dff7356c2a tempest-SnapshotDependencyTests-880179703 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71314566-2e16-4389-8941-b3b58bbe80cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:47:26 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-d3432cb0-6ca7-4c91-93d6-47dff7356c2a tempest-SnapshotDependencyTests-880179703 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71314566-2e16-4389-8941-b3b58bbe80cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:47:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-92999864',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=62d6a5f4-893c-45ec-be5d-6e7db90db97e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a3adcf99c550411ba684525f6f9ad059',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:47:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:47:26Z,use_quota=True,user_id='b86883fb08c147fd858d23db5fea63a2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8bde7129-1dc4-42ab-b852-ab32c61b4921),volume_type_id=8bde7129-1dc4-42ab-b852-ab32c61b4921)' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:47:26 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-d3432cb0-6ca7-4c91-93d6-47dff7356c2a tempest-SnapshotDependencyTests-880179703 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (daad0322-e3a1-4dd8-a2e6-ff29ae95c59e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:47:26 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-d3432cb0-6ca7-4c91-93d6-47dff7356c2a tempest-SnapshotDependencyTests-880179703 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (daad0322-e3a1-4dd8-a2e6-ff29ae95c59e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:47:26 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-d3432cb0-6ca7-4c91-93d6-47dff7356c2a tempest-SnapshotDependencyTests-880179703 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34e0541f-dad3-4209-bc3a-366d343aa063) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:47:26 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-d3432cb0-6ca7-4c91-93d6-47dff7356c2a tempest-SnapshotDependencyTests-880179703 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34e0541f-dad3-4209-bc3a-366d343aa063) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '62d6a5f4-893c-45ec-be5d-6e7db90db97e', 'volume_name': 'volume-62d6a5f4-893c-45ec-be5d-6e7db90db97e', 'volume_size': 1}' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:47:26 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-d3432cb0-6ca7-4c91-93d6-47dff7356c2a tempest-SnapshotDependencyTests-880179703 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c5948bc-7e42-456a-a85c-5c11c77b1c0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:47:26 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-d3432cb0-6ca7-4c91-93d6-47dff7356c2a tempest-SnapshotDependencyTests-880179703 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c5948bc-7e42-456a-a85c-5c11c77b1c0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:47:26 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-d3432cb0-6ca7-4c91-93d6-47dff7356c2a tempest-SnapshotDependencyTests-880179703 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0de9875f-5240-452e-8616-c43f00cae622) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:47:26 devstack cinder-volume[88899]: INFO cinder.volume.flows.manager.create_volume [None req-d3432cb0-6ca7-4c91-93d6-47dff7356c2a tempest-SnapshotDependencyTests-880179703 None] Volume 62d6a5f4-893c-45ec-be5d-6e7db90db97e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-62d6a5f4-893c-45ec-be5d-6e7db90db97e', 'volume_size': 1} Aug 03 08:47:26 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-d3432cb0-6ca7-4c91-93d6-47dff7356c2a tempest-SnapshotDependencyTests-880179703 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:47:26 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-d3432cb0-6ca7-4c91-93d6-47dff7356c2a tempest-SnapshotDependencyTests-880179703 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:47:26 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-d3432cb0-6ca7-4c91-93d6-47dff7356c2a tempest-SnapshotDependencyTests-880179703 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:47:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-92999864',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=62d6a5f4-893c-45ec-be5d-6e7db90db97e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a3adcf99c550411ba684525f6f9ad059',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:47:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:47:26Z,use_quota=True,user_id='b86883fb08c147fd858d23db5fea63a2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8bde7129-1dc4-42ab-b852-ab32c61b4921),volume_type_id=8bde7129-1dc4-42ab-b852-ab32c61b4921)}" {{(pid=88899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 08:47:26 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-d3432cb0-6ca7-4c91-93d6-47dff7356c2a tempest-SnapshotDependencyTests-880179703 None] Creating volume 62d6a5f4-893c-45ec-be5d-6e7db90db97e {{(pid=88899) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 08:47:26 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-d3432cb0-6ca7-4c91-93d6-47dff7356c2a tempest-SnapshotDependencyTests-880179703 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:47:26 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-d3432cb0-6ca7-4c91-93d6-47dff7356c2a tempest-SnapshotDependencyTests-880179703 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:47:26 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-d3432cb0-6ca7-4c91-93d6-47dff7356c2a tempest-SnapshotDependencyTests-880179703 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:47:26 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-d3432cb0-6ca7-4c91-93d6-47dff7356c2a tempest-SnapshotDependencyTests-880179703 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:47:26 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-d3432cb0-6ca7-4c91-93d6-47dff7356c2a tempest-SnapshotDependencyTests-880179703 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:47:26 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-d3432cb0-6ca7-4c91-93d6-47dff7356c2a tempest-SnapshotDependencyTests-880179703 None] Selected osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385 as target Quobyte volume. {{(pid=88899) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 08:47:26 devstack cinder-volume[88899]: INFO cinder.volume.drivers.remotefs [None req-d3432cb0-6ca7-4c91-93d6-47dff7356c2a tempest-SnapshotDependencyTests-880179703 None] casted to osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385 Aug 03 08:47:26 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-d3432cb0-6ca7-4c91-93d6-47dff7356c2a tempest-SnapshotDependencyTests-880179703 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-62d6a5f4-893c-45ec-be5d-6e7db90db97e 1073741824 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:47:26 devstack sudo[108395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-62d6a5f4-893c-45ec-be5d-6e7db90db97e 1073741824 Aug 03 08:47:26 devstack sudo[108395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:47:26 devstack sudo[108395]: pam_unix(sudo:session): session closed for user root Aug 03 08:47:26 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-d3432cb0-6ca7-4c91-93d6-47dff7356c2a tempest-SnapshotDependencyTests-880179703 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-62d6a5f4-893c-45ec-be5d-6e7db90db97e 1073741824" returned: 0 in 0.410s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:47:26 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-d3432cb0-6ca7-4c91-93d6-47dff7356c2a tempest-SnapshotDependencyTests-880179703 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-62d6a5f4-893c-45ec-be5d-6e7db90db97e {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:47:26 devstack sudo[108401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-62d6a5f4-893c-45ec-be5d-6e7db90db97e Aug 03 08:47:26 devstack sudo[108401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:47:27 devstack sudo[108401]: pam_unix(sudo:session): session closed for user root Aug 03 08:47:27 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-d3432cb0-6ca7-4c91-93d6-47dff7356c2a tempest-SnapshotDependencyTests-880179703 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-62d6a5f4-893c-45ec-be5d-6e7db90db97e" returned: 0 in 0.250s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:47:27 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-d3432cb0-6ca7-4c91-93d6-47dff7356c2a tempest-SnapshotDependencyTests-880179703 None] <== create_volume: return (704ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'} {{(pid=88899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 08:47:27 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-d3432cb0-6ca7-4c91-93d6-47dff7356c2a tempest-SnapshotDependencyTests-880179703 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.708s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:47:27 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-d3432cb0-6ca7-4c91-93d6-47dff7356c2a tempest-SnapshotDependencyTests-880179703 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0de9875f-5240-452e-8616-c43f00cae622) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-62d6a5f4-893c-45ec-be5d-6e7db90db97e', 'volume_size': 1}' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:47:27 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-d3432cb0-6ca7-4c91-93d6-47dff7356c2a tempest-SnapshotDependencyTests-880179703 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b34159b9-9111-4d30-b644-01d63673eeb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:47:27 devstack cinder-volume[88899]: INFO cinder.volume.flows.manager.create_volume [None req-d3432cb0-6ca7-4c91-93d6-47dff7356c2a tempest-SnapshotDependencyTests-880179703 None] Volume volume-62d6a5f4-893c-45ec-be5d-6e7db90db97e (62d6a5f4-893c-45ec-be5d-6e7db90db97e): created successfully Aug 03 08:47:27 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-d3432cb0-6ca7-4c91-93d6-47dff7356c2a tempest-SnapshotDependencyTests-880179703 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b34159b9-9111-4d30-b644-01d63673eeb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:47:27 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-d3432cb0-6ca7-4c91-93d6-47dff7356c2a tempest-SnapshotDependencyTests-880179703 None] Flow 'volume_create_manager' (670de7e3-ccb7-4382-ae87-b4966bdedbab) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:47:27 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-d3432cb0-6ca7-4c91-93d6-47dff7356c2a tempest-SnapshotDependencyTests-880179703 None] Created volume successfully. Aug 03 08:47:27 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-136a702a-8f22-4e05-877c-ae5a84bea9b3 tempest-SnapshotDependencyTests-880179703 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:47:27 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-136a702a-8f22-4e05-877c-ae5a84bea9b3 tempest-SnapshotDependencyTests-880179703 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:47:27 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-136a702a-8f22-4e05-877c-ae5a84bea9b3 tempest-SnapshotDependencyTests-880179703 None] Creating offline snapshot 5780a563-10b7-48f4-b548-e793bf910005 of volume 62d6a5f4-893c-45ec-be5d-6e7db90db97e {{(pid=88899) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 03 08:47:27 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[824d9f78-3cdf-4ff1-8697-e809372254dc]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:47:27 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-136a702a-8f22-4e05-877c-ae5a84bea9b3 tempest-SnapshotDependencyTests-880179703 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-62d6a5f4-893c-45ec-be5d-6e7db90db97e {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:47:27 devstack sudo[108404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-62d6a5f4-893c-45ec-be5d-6e7db90db97e Aug 03 08:47:27 devstack sudo[108404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:47:27 devstack sudo[108404]: pam_unix(sudo:session): session closed for user root Aug 03 08:47:28 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-136a702a-8f22-4e05-877c-ae5a84bea9b3 tempest-SnapshotDependencyTests-880179703 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-62d6a5f4-893c-45ec-be5d-6e7db90db97e" returned: 0 in 0.368s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:47:28 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-136a702a-8f22-4e05-877c-ae5a84bea9b3 tempest-SnapshotDependencyTests-880179703 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-62d6a5f4-893c-45ec-be5d-6e7db90db97e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-62d6a5f4-893c-45ec-be5d-6e7db90db97e.5780a563-10b7-48f4-b548-e793bf910005 1G {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:47:28 devstack sudo[108409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-62d6a5f4-893c-45ec-be5d-6e7db90db97e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-62d6a5f4-893c-45ec-be5d-6e7db90db97e.5780a563-10b7-48f4-b548-e793bf910005 1G Aug 03 08:47:28 devstack sudo[108409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:47:28 devstack sudo[108409]: pam_unix(sudo:session): session closed for user root Aug 03 08:47:28 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-136a702a-8f22-4e05-877c-ae5a84bea9b3 tempest-SnapshotDependencyTests-880179703 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-62d6a5f4-893c-45ec-be5d-6e7db90db97e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-62d6a5f4-893c-45ec-be5d-6e7db90db97e.5780a563-10b7-48f4-b548-e793bf910005 1G" returned: 0 in 0.454s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:47:28 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-136a702a-8f22-4e05-877c-ae5a84bea9b3 tempest-SnapshotDependencyTests-880179703 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-62d6a5f4-893c-45ec-be5d-6e7db90db97e -F qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-62d6a5f4-893c-45ec-be5d-6e7db90db97e.5780a563-10b7-48f4-b548-e793bf910005 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:47:28 devstack sudo[108415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-62d6a5f4-893c-45ec-be5d-6e7db90db97e -F qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-62d6a5f4-893c-45ec-be5d-6e7db90db97e.5780a563-10b7-48f4-b548-e793bf910005 Aug 03 08:47:28 devstack sudo[108415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:47:28 devstack sudo[108415]: pam_unix(sudo:session): session closed for user root Aug 03 08:47:28 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-136a702a-8f22-4e05-877c-ae5a84bea9b3 tempest-SnapshotDependencyTests-880179703 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-62d6a5f4-893c-45ec-be5d-6e7db90db97e -F qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-62d6a5f4-893c-45ec-be5d-6e7db90db97e.5780a563-10b7-48f4-b548-e793bf910005" returned: 0 in 0.292s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:47:28 devstack cinder-volume[88899]: WARNING cinder.volume.drivers.remotefs [None req-136a702a-8f22-4e05-877c-ae5a84bea9b3 tempest-SnapshotDependencyTests-880179703 None] /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-62d6a5f4-893c-45ec-be5d-6e7db90db97e.5780a563-10b7-48f4-b548-e793bf910005 is being set with open permissions: ugo+rw Aug 03 08:47:28 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-136a702a-8f22-4e05-877c-ae5a84bea9b3 tempest-SnapshotDependencyTests-880179703 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-62d6a5f4-893c-45ec-be5d-6e7db90db97e.5780a563-10b7-48f4-b548-e793bf910005 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:47:28 devstack sudo[108421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-62d6a5f4-893c-45ec-be5d-6e7db90db97e.5780a563-10b7-48f4-b548-e793bf910005 Aug 03 08:47:28 devstack sudo[108421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:47:29 devstack sudo[108421]: pam_unix(sudo:session): session closed for user root Aug 03 08:47:29 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-136a702a-8f22-4e05-877c-ae5a84bea9b3 tempest-SnapshotDependencyTests-880179703 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-62d6a5f4-893c-45ec-be5d-6e7db90db97e.5780a563-10b7-48f4-b548-e793bf910005" returned: 0 in 0.259s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:47:29 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-136a702a-8f22-4e05-877c-ae5a84bea9b3 tempest-SnapshotDependencyTests-880179703 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-62d6a5f4-893c-45ec-be5d-6e7db90db97e.info {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:47:29 devstack sudo[108424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-62d6a5f4-893c-45ec-be5d-6e7db90db97e.info Aug 03 08:47:29 devstack sudo[108424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:47:29 devstack sudo[108424]: pam_unix(sudo:session): session closed for user root Aug 03 08:47:29 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-136a702a-8f22-4e05-877c-ae5a84bea9b3 tempest-SnapshotDependencyTests-880179703 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-62d6a5f4-893c-45ec-be5d-6e7db90db97e.info" returned: 0 in 0.254s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:47:29 devstack cinder-volume[88899]: WARNING cinder.volume.drivers.remotefs [None req-136a702a-8f22-4e05-877c-ae5a84bea9b3 tempest-SnapshotDependencyTests-880179703 None] /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-62d6a5f4-893c-45ec-be5d-6e7db90db97e.info is being set with open permissions: ugo+rw Aug 03 08:47:29 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-136a702a-8f22-4e05-877c-ae5a84bea9b3 tempest-SnapshotDependencyTests-880179703 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-62d6a5f4-893c-45ec-be5d-6e7db90db97e.info {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:47:29 devstack sudo[108427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-62d6a5f4-893c-45ec-be5d-6e7db90db97e.info Aug 03 08:47:29 devstack sudo[108427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:47:29 devstack sudo[108427]: pam_unix(sudo:session): session closed for user root Aug 03 08:47:29 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-136a702a-8f22-4e05-877c-ae5a84bea9b3 tempest-SnapshotDependencyTests-880179703 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-62d6a5f4-893c-45ec-be5d-6e7db90db97e.info" returned: 0 in 0.316s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:47:29 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-136a702a-8f22-4e05-877c-ae5a84bea9b3 tempest-SnapshotDependencyTests-880179703 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.054s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:47:29 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-136a702a-8f22-4e05-877c-ae5a84bea9b3 tempest-SnapshotDependencyTests-880179703 None] Create snapshot completed successfully Aug 03 08:47:31 devstack cinder-volume[88899]: DEBUG cinder.volume.flows.manager.create_volume [None req-0c22b875-c5e1-4c48-826a-6694522aba6d tempest-SnapshotDependencyTests-880179703 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88899) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 08:47:31 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-0c22b875-c5e1-4c48-826a-6694522aba6d tempest-SnapshotDependencyTests-880179703 None] Flow 'volume_create_manager' (dc398008-e461-4ce4-8e65-0b7305138b3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:47:31 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-0c22b875-c5e1-4c48-826a-6694522aba6d tempest-SnapshotDependencyTests-880179703 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f2f0b845-159e-4bee-9c1d-ff752ed84659) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:47:31 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-0c22b875-c5e1-4c48-826a-6694522aba6d tempest-SnapshotDependencyTests-880179703 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f2f0b845-159e-4bee-9c1d-ff752ed84659) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:47:31Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a6aae9ed-abe5-4ce3-8c8b-a7db03046a55,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a3adcf99c550411ba684525f6f9ad059',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:47:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=5780a563-10b7-48f4-b548-e793bf910005,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:47:31Z,use_quota=True,user_id='b86883fb08c147fd858d23db5fea63a2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8bde7129-1dc4-42ab-b852-ab32c61b4921),volume_type_id=8bde7129-1dc4-42ab-b852-ab32c61b4921)' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:47:31 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-0c22b875-c5e1-4c48-826a-6694522aba6d tempest-SnapshotDependencyTests-880179703 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57d42708-c43a-4f13-8651-34185e6c4928) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:47:31 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-0c22b875-c5e1-4c48-826a-6694522aba6d tempest-SnapshotDependencyTests-880179703 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57d42708-c43a-4f13-8651-34185e6c4928) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:47:31 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-0c22b875-c5e1-4c48-826a-6694522aba6d tempest-SnapshotDependencyTests-880179703 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2cdaa70d-7103-4e1c-aceb-b061bbf64fd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:47:31 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-0c22b875-c5e1-4c48-826a-6694522aba6d tempest-SnapshotDependencyTests-880179703 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2cdaa70d-7103-4e1c-aceb-b061bbf64fd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'a6aae9ed-abe5-4ce3-8c8b-a7db03046a55', 'volume_name': 'volume-a6aae9ed-abe5-4ce3-8c8b-a7db03046a55', 'volume_size': 1, 'snapshot_id': '5780a563-10b7-48f4-b548-e793bf910005'}' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:47:31 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-0c22b875-c5e1-4c48-826a-6694522aba6d tempest-SnapshotDependencyTests-880179703 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ef69682-9235-4e91-b847-fdfcfd476225) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:47:31 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-0c22b875-c5e1-4c48-826a-6694522aba6d tempest-SnapshotDependencyTests-880179703 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ef69682-9235-4e91-b847-fdfcfd476225) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:47:31 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-0c22b875-c5e1-4c48-826a-6694522aba6d tempest-SnapshotDependencyTests-880179703 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f84f5f9c-0703-42c9-98e0-d8df4cb7390b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:47:31 devstack cinder-volume[88899]: INFO cinder.volume.flows.manager.create_volume [None req-0c22b875-c5e1-4c48-826a-6694522aba6d tempest-SnapshotDependencyTests-880179703 None] Volume a6aae9ed-abe5-4ce3-8c8b-a7db03046a55: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-a6aae9ed-abe5-4ce3-8c8b-a7db03046a55', 'volume_size': 1, 'snapshot_id': '5780a563-10b7-48f4-b548-e793bf910005'} Aug 03 08:47:31 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-0c22b875-c5e1-4c48-826a-6694522aba6d tempest-SnapshotDependencyTests-880179703 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:47:31 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-0c22b875-c5e1-4c48-826a-6694522aba6d tempest-SnapshotDependencyTests-880179703 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:47:31 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-0c22b875-c5e1-4c48-826a-6694522aba6d tempest-SnapshotDependencyTests-880179703 None] Acquiring lock "cinder-quobyte-5780a563-10b7-48f4-b548-e793bf910005-a6aae9ed-abe5-4ce3-8c8b-a7db03046a55" by "_create_volume_from_snapshot" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:47:31 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-0c22b875-c5e1-4c48-826a-6694522aba6d tempest-SnapshotDependencyTests-880179703 None] Lock "cinder-quobyte-5780a563-10b7-48f4-b548-e793bf910005-a6aae9ed-abe5-4ce3-8c8b-a7db03046a55" acquired by "_create_volume_from_snapshot" :: waited 0.018s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:47:31 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-0c22b875-c5e1-4c48-826a-6694522aba6d tempest-SnapshotDependencyTests-880179703 None] Creating volume a6aae9ed-abe5-4ce3-8c8b-a7db03046a55 from snapshot 5780a563-10b7-48f4-b548-e793bf910005 {{(pid=88899) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Aug 03 08:47:31 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-0c22b875-c5e1-4c48-826a-6694522aba6d tempest-SnapshotDependencyTests-880179703 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:47:31 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-0c22b875-c5e1-4c48-826a-6694522aba6d tempest-SnapshotDependencyTests-880179703 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:47:31 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-0c22b875-c5e1-4c48-826a-6694522aba6d tempest-SnapshotDependencyTests-880179703 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:47:31 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-0c22b875-c5e1-4c48-826a-6694522aba6d tempest-SnapshotDependencyTests-880179703 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:47:31 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-0c22b875-c5e1-4c48-826a-6694522aba6d tempest-SnapshotDependencyTests-880179703 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:47:31 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-0c22b875-c5e1-4c48-826a-6694522aba6d tempest-SnapshotDependencyTests-880179703 None] Selected osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385 as target Quobyte volume. {{(pid=88899) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 08:47:31 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-0c22b875-c5e1-4c48-826a-6694522aba6d tempest-SnapshotDependencyTests-880179703 None] Acquiring lock "cinder-quobyte-a6aae9ed-abe5-4ce3-8c8b-a7db03046a55" by "_copy_volume_from_snapshot" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:47:31 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-0c22b875-c5e1-4c48-826a-6694522aba6d tempest-SnapshotDependencyTests-880179703 None] Lock "cinder-quobyte-a6aae9ed-abe5-4ce3-8c8b-a7db03046a55" acquired by "_copy_volume_from_snapshot" :: waited 0.020s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:47:31 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-0c22b875-c5e1-4c48-826a-6694522aba6d tempest-SnapshotDependencyTests-880179703 None] snapshot: 5780a563-10b7-48f4-b548-e793bf910005, volume: a6aae9ed-abe5-4ce3-8c8b-a7db03046a55, {{(pid=88899) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Aug 03 08:47:31 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-0c22b875-c5e1-4c48-826a-6694522aba6d tempest-SnapshotDependencyTests-880179703 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:47:31 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-0c22b875-c5e1-4c48-826a-6694522aba6d tempest-SnapshotDependencyTests-880179703 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:47:31 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-0c22b875-c5e1-4c48-826a-6694522aba6d tempest-SnapshotDependencyTests-880179703 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:47:31 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-0c22b875-c5e1-4c48-826a-6694522aba6d tempest-SnapshotDependencyTests-880179703 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:47:31 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-0c22b875-c5e1-4c48-826a-6694522aba6d tempest-SnapshotDependencyTests-880179703 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:47:31 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[671f4beb-d5c2-44c3-9d1e-f730368e0102]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:47:31 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-0c22b875-c5e1-4c48-826a-6694522aba6d tempest-SnapshotDependencyTests-880179703 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-62d6a5f4-893c-45ec-be5d-6e7db90db97e.5780a563-10b7-48f4-b548-e793bf910005 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:47:31 devstack sudo[108431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-62d6a5f4-893c-45ec-be5d-6e7db90db97e.5780a563-10b7-48f4-b548-e793bf910005 Aug 03 08:47:31 devstack sudo[108431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:47:32 devstack sudo[108431]: pam_unix(sudo:session): session closed for user root Aug 03 08:47:32 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-0c22b875-c5e1-4c48-826a-6694522aba6d tempest-SnapshotDependencyTests-880179703 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-62d6a5f4-893c-45ec-be5d-6e7db90db97e.5780a563-10b7-48f4-b548-e793bf910005" returned: 0 in 0.394s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:47:32 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-0c22b875-c5e1-4c48-826a-6694522aba6d tempest-SnapshotDependencyTests-880179703 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-62d6a5f4-893c-45ec-be5d-6e7db90db97e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88899) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 03 08:47:32 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[090763a4-1566-4693-bd6f-50c302a1e98f]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:47:32 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-0c22b875-c5e1-4c48-826a-6694522aba6d tempest-SnapshotDependencyTests-880179703 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-62d6a5f4-893c-45ec-be5d-6e7db90db97e {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:47:32 devstack sudo[108436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-62d6a5f4-893c-45ec-be5d-6e7db90db97e Aug 03 08:47:32 devstack sudo[108436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:47:32 devstack sudo[108436]: pam_unix(sudo:session): session closed for user root Aug 03 08:47:32 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-0c22b875-c5e1-4c48-826a-6694522aba6d tempest-SnapshotDependencyTests-880179703 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-62d6a5f4-893c-45ec-be5d-6e7db90db97e" returned: 0 in 0.380s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:47:32 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-0c22b875-c5e1-4c48-826a-6694522aba6d tempest-SnapshotDependencyTests-880179703 None] will copy from snapshot at /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-62d6a5f4-893c-45ec-be5d-6e7db90db97e {{(pid=88899) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Aug 03 08:47:32 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-0c22b875-c5e1-4c48-826a-6694522aba6d tempest-SnapshotDependencyTests-880179703 None] Creating direct copy from snapshot {{(pid=88899) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Aug 03 08:47:32 devstack cinder-volume[88899]: DEBUG cinder.utils [None req-0c22b875-c5e1-4c48-826a-6694522aba6d tempest-SnapshotDependencyTests-880179703 None] Path /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-a6aae9ed-abe5-4ce3-8c8b-a7db03046a55 not found in is_blk_device check {{(pid=88899) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Aug 03 08:47:32 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-0c22b875-c5e1-4c48-826a-6694522aba6d tempest-SnapshotDependencyTests-880179703 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-62d6a5f4-893c-45ec-be5d-6e7db90db97e /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-a6aae9ed-abe5-4ce3-8c8b-a7db03046a55 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:47:32 devstack sudo[108441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-62d6a5f4-893c-45ec-be5d-6e7db90db97e /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-a6aae9ed-abe5-4ce3-8c8b-a7db03046a55 Aug 03 08:47:32 devstack sudo[108441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:47:37 devstack sudo[108441]: pam_unix(sudo:session): session closed for user root Aug 03 08:47:37 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-0c22b875-c5e1-4c48-826a-6694522aba6d tempest-SnapshotDependencyTests-880179703 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-62d6a5f4-893c-45ec-be5d-6e7db90db97e /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-a6aae9ed-abe5-4ce3-8c8b-a7db03046a55" returned: 0 in 4.877s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:47:37 devstack cinder-volume[88899]: DEBUG cinder.image.image_utils [None req-0c22b875-c5e1-4c48-826a-6694522aba6d tempest-SnapshotDependencyTests-880179703 None] Image conversion details: src /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-62d6a5f4-893c-45ec-be5d-6e7db90db97e, size 1024.00 MB, duration 4.88 sec, destination /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-a6aae9ed-abe5-4ce3-8c8b-a7db03046a55 {{(pid=88899) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 03 08:47:37 devstack cinder-volume[88899]: INFO cinder.image.image_utils [None req-0c22b875-c5e1-4c48-826a-6694522aba6d tempest-SnapshotDependencyTests-880179703 None] Converted 1024.00 MB image at 209.90 MB/s Aug 03 08:47:37 devstack cinder-volume[88899]: WARNING cinder.volume.drivers.remotefs [None req-0c22b875-c5e1-4c48-826a-6694522aba6d tempest-SnapshotDependencyTests-880179703 None] /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-a6aae9ed-abe5-4ce3-8c8b-a7db03046a55 is being set with open permissions: ugo+rw Aug 03 08:47:37 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-0c22b875-c5e1-4c48-826a-6694522aba6d tempest-SnapshotDependencyTests-880179703 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-a6aae9ed-abe5-4ce3-8c8b-a7db03046a55 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:47:37 devstack sudo[108456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-a6aae9ed-abe5-4ce3-8c8b-a7db03046a55 Aug 03 08:47:37 devstack sudo[108456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:47:37 devstack sudo[108456]: pam_unix(sudo:session): session closed for user root Aug 03 08:47:37 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-0c22b875-c5e1-4c48-826a-6694522aba6d tempest-SnapshotDependencyTests-880179703 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-a6aae9ed-abe5-4ce3-8c8b-a7db03046a55" returned: 0 in 0.265s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:47:37 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-0c22b875-c5e1-4c48-826a-6694522aba6d tempest-SnapshotDependencyTests-880179703 None] Lock "cinder-quobyte-a6aae9ed-abe5-4ce3-8c8b-a7db03046a55" released by "_copy_volume_from_snapshot" :: held 6.041s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:47:37 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-0c22b875-c5e1-4c48-826a-6694522aba6d tempest-SnapshotDependencyTests-880179703 None] Lock "cinder-quobyte-5780a563-10b7-48f4-b548-e793bf910005-a6aae9ed-abe5-4ce3-8c8b-a7db03046a55" released by "_create_volume_from_snapshot" :: held 6.125s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:47:37 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-0c22b875-c5e1-4c48-826a-6694522aba6d tempest-SnapshotDependencyTests-880179703 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.144s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:47:37 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-0c22b875-c5e1-4c48-826a-6694522aba6d tempest-SnapshotDependencyTests-880179703 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f84f5f9c-0703-42c9-98e0-d8df4cb7390b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a6aae9ed-abe5-4ce3-8c8b-a7db03046a55', 'volume_size': 1, 'snapshot_id': '5780a563-10b7-48f4-b548-e793bf910005'}' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:47:37 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-0c22b875-c5e1-4c48-826a-6694522aba6d tempest-SnapshotDependencyTests-880179703 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2621c2c2-575e-4394-8e26-c427891cad33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:47:37 devstack cinder-volume[88899]: INFO cinder.volume.flows.manager.create_volume [None req-0c22b875-c5e1-4c48-826a-6694522aba6d tempest-SnapshotDependencyTests-880179703 None] Volume volume-a6aae9ed-abe5-4ce3-8c8b-a7db03046a55 (a6aae9ed-abe5-4ce3-8c8b-a7db03046a55): created successfully Aug 03 08:47:37 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-0c22b875-c5e1-4c48-826a-6694522aba6d tempest-SnapshotDependencyTests-880179703 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2621c2c2-575e-4394-8e26-c427891cad33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:47:37 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-0c22b875-c5e1-4c48-826a-6694522aba6d tempest-SnapshotDependencyTests-880179703 None] Flow 'volume_create_manager' (dc398008-e461-4ce4-8e65-0b7305138b3c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:47:37 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-0c22b875-c5e1-4c48-826a-6694522aba6d tempest-SnapshotDependencyTests-880179703 None] Created volume successfully. Aug 03 08:47:38 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-8a1e92b1-c602-41c1-a9c9-1a487d34c720 tempest-SnapshotDependencyTests-880179703 None] Acquiring lock "cinder-5780a563-10b7-48f4-b548-e793bf910005-delete_snapshot" by "delete_snapshot" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:47:38 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-8a1e92b1-c602-41c1-a9c9-1a487d34c720 tempest-SnapshotDependencyTests-880179703 None] Lock "cinder-5780a563-10b7-48f4-b548-e793bf910005-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:47:38 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-8a1e92b1-c602-41c1-a9c9-1a487d34c720 tempest-SnapshotDependencyTests-880179703 None] Acquiring lock "cinder-quobyte-62d6a5f4-893c-45ec-be5d-6e7db90db97e" by "delete_snapshot" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:47:38 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-8a1e92b1-c602-41c1-a9c9-1a487d34c720 tempest-SnapshotDependencyTests-880179703 None] Lock "cinder-quobyte-62d6a5f4-893c-45ec-be5d-6e7db90db97e" acquired by "delete_snapshot" :: waited 0.017s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:47:38 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-8a1e92b1-c602-41c1-a9c9-1a487d34c720 tempest-SnapshotDependencyTests-880179703 None] Acquiring lock "cinder-quobyte-5780a563-10b7-48f4-b548-e793bf910005" by "_delete_snapshot" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:47:38 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-8a1e92b1-c602-41c1-a9c9-1a487d34c720 tempest-SnapshotDependencyTests-880179703 None] Lock "cinder-quobyte-5780a563-10b7-48f4-b548-e793bf910005" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:47:38 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-8a1e92b1-c602-41c1-a9c9-1a487d34c720 tempest-SnapshotDependencyTests-880179703 None] Deleting offline snapshot 5780a563-10b7-48f4-b548-e793bf910005 of volume 62d6a5f4-893c-45ec-be5d-6e7db90db97e {{(pid=88899) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 03 08:47:38 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-8a1e92b1-c602-41c1-a9c9-1a487d34c720 tempest-SnapshotDependencyTests-880179703 None] snapshot_file for this snap is: volume-62d6a5f4-893c-45ec-be5d-6e7db90db97e.5780a563-10b7-48f4-b548-e793bf910005 {{(pid=88899) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 03 08:47:38 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c6e2acd-db46-4373-924d-923e58280b8e]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:47:38 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-8a1e92b1-c602-41c1-a9c9-1a487d34c720 tempest-SnapshotDependencyTests-880179703 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-62d6a5f4-893c-45ec-be5d-6e7db90db97e.5780a563-10b7-48f4-b548-e793bf910005 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:47:38 devstack sudo[108460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-62d6a5f4-893c-45ec-be5d-6e7db90db97e.5780a563-10b7-48f4-b548-e793bf910005 Aug 03 08:47:38 devstack sudo[108460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:47:38 devstack sudo[108460]: pam_unix(sudo:session): session closed for user root Aug 03 08:47:38 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-8a1e92b1-c602-41c1-a9c9-1a487d34c720 tempest-SnapshotDependencyTests-880179703 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-62d6a5f4-893c-45ec-be5d-6e7db90db97e.5780a563-10b7-48f4-b548-e793bf910005" returned: 0 in 0.392s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:47:38 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-8a1e92b1-c602-41c1-a9c9-1a487d34c720 tempest-SnapshotDependencyTests-880179703 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-62d6a5f4-893c-45ec-be5d-6e7db90db97e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88899) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 03 08:47:38 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[937d1361-4d12-47d3-84f0-c54b623be693]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:47:38 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-8a1e92b1-c602-41c1-a9c9-1a487d34c720 tempest-SnapshotDependencyTests-880179703 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-62d6a5f4-893c-45ec-be5d-6e7db90db97e {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:47:38 devstack sudo[108465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-62d6a5f4-893c-45ec-be5d-6e7db90db97e Aug 03 08:47:38 devstack sudo[108465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:47:39 devstack sudo[108465]: pam_unix(sudo:session): session closed for user root Aug 03 08:47:39 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-8a1e92b1-c602-41c1-a9c9-1a487d34c720 tempest-SnapshotDependencyTests-880179703 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-62d6a5f4-893c-45ec-be5d-6e7db90db97e" returned: 0 in 0.590s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:47:39 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-8a1e92b1-c602-41c1-a9c9-1a487d34c720 tempest-SnapshotDependencyTests-880179703 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-62d6a5f4-893c-45ec-be5d-6e7db90db97e.5780a563-10b7-48f4-b548-e793bf910005 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:47:39 devstack sudo[108470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-62d6a5f4-893c-45ec-be5d-6e7db90db97e.5780a563-10b7-48f4-b548-e793bf910005 Aug 03 08:47:39 devstack sudo[108470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:47:39 devstack sudo[108470]: pam_unix(sudo:session): session closed for user root Aug 03 08:47:39 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-8a1e92b1-c602-41c1-a9c9-1a487d34c720 tempest-SnapshotDependencyTests-880179703 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-62d6a5f4-893c-45ec-be5d-6e7db90db97e.5780a563-10b7-48f4-b548-e793bf910005" returned: 0 in 0.372s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:47:39 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-8a1e92b1-c602-41c1-a9c9-1a487d34c720 tempest-SnapshotDependencyTests-880179703 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-62d6a5f4-893c-45ec-be5d-6e7db90db97e.5780a563-10b7-48f4-b548-e793bf910005 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:47:39 devstack sudo[108476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-62d6a5f4-893c-45ec-be5d-6e7db90db97e.5780a563-10b7-48f4-b548-e793bf910005 Aug 03 08:47:39 devstack sudo[108476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:47:40 devstack sudo[108476]: pam_unix(sudo:session): session closed for user root Aug 03 08:47:40 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-8a1e92b1-c602-41c1-a9c9-1a487d34c720 tempest-SnapshotDependencyTests-880179703 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-62d6a5f4-893c-45ec-be5d-6e7db90db97e.5780a563-10b7-48f4-b548-e793bf910005" returned: 0 in 0.245s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:47:40 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-8a1e92b1-c602-41c1-a9c9-1a487d34c720 tempest-SnapshotDependencyTests-880179703 None] Lock "cinder-quobyte-5780a563-10b7-48f4-b548-e793bf910005" released by "_delete_snapshot" :: held 1.716s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:47:40 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-8a1e92b1-c602-41c1-a9c9-1a487d34c720 tempest-SnapshotDependencyTests-880179703 None] Lock "cinder-quobyte-62d6a5f4-893c-45ec-be5d-6e7db90db97e" released by "delete_snapshot" :: held 1.738s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:47:40 devstack cinder-volume[88899]: DEBUG cinder.quota [None req-8a1e92b1-c602-41c1-a9c9-1a487d34c720 tempest-SnapshotDependencyTests-880179703 None] Created reservations ['41e2b951-5e64-44e9-b863-212d7fdddd37', '98db17ce-a5e2-4980-a98a-876f3511b7c8', 'e69fed71-ffe8-4286-916a-02c16c36383f', '1587a096-d460-42d7-8e7d-083418baec9d'] {{(pid=88899) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 08:47:40 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-8a1e92b1-c602-41c1-a9c9-1a487d34c720 tempest-SnapshotDependencyTests-880179703 None] Delete snapshot completed successfully. Aug 03 08:47:40 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-8a1e92b1-c602-41c1-a9c9-1a487d34c720 tempest-SnapshotDependencyTests-880179703 None] Lock "cinder-5780a563-10b7-48f4-b548-e793bf910005-delete_snapshot" released by "delete_snapshot" :: held 1.883s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:47:40 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-ec175535-93cd-468a-aeb0-850fc1e2c1c6 tempest-SnapshotDependencyTests-880179703 None] Acquiring lock "cinder-62d6a5f4-893c-45ec-be5d-6e7db90db97e-delete_volume" by "delete_volume" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:47:40 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-ec175535-93cd-468a-aeb0-850fc1e2c1c6 tempest-SnapshotDependencyTests-880179703 None] Lock "cinder-62d6a5f4-893c-45ec-be5d-6e7db90db97e-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:47:40 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-ec175535-93cd-468a-aeb0-850fc1e2c1c6 tempest-SnapshotDependencyTests-880179703 None] Acquiring lock "cinder-quobyte-62d6a5f4-893c-45ec-be5d-6e7db90db97e" by "delete_volume" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:47:40 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-ec175535-93cd-468a-aeb0-850fc1e2c1c6 tempest-SnapshotDependencyTests-880179703 None] Lock "cinder-quobyte-62d6a5f4-893c-45ec-be5d-6e7db90db97e" acquired by "delete_volume" :: waited 0.016s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:47:40 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[9eec6967-2111-4864-8e42-7bad5dd7c8b1]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:47:40 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-ec175535-93cd-468a-aeb0-850fc1e2c1c6 tempest-SnapshotDependencyTests-880179703 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-62d6a5f4-893c-45ec-be5d-6e7db90db97e {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:47:40 devstack sudo[108479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-62d6a5f4-893c-45ec-be5d-6e7db90db97e Aug 03 08:47:40 devstack sudo[108479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:47:41 devstack sudo[108479]: pam_unix(sudo:session): session closed for user root Aug 03 08:47:41 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-ec175535-93cd-468a-aeb0-850fc1e2c1c6 tempest-SnapshotDependencyTests-880179703 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-62d6a5f4-893c-45ec-be5d-6e7db90db97e" returned: 0 in 0.381s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:47:41 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-ec175535-93cd-468a-aeb0-850fc1e2c1c6 tempest-SnapshotDependencyTests-880179703 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-62d6a5f4-893c-45ec-be5d-6e7db90db97e {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:47:41 devstack sudo[108484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-62d6a5f4-893c-45ec-be5d-6e7db90db97e Aug 03 08:47:41 devstack sudo[108484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:47:41 devstack sudo[108484]: pam_unix(sudo:session): session closed for user root Aug 03 08:47:41 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-ec175535-93cd-468a-aeb0-850fc1e2c1c6 tempest-SnapshotDependencyTests-880179703 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-62d6a5f4-893c-45ec-be5d-6e7db90db97e" returned: 0 in 0.253s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:47:41 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-ec175535-93cd-468a-aeb0-850fc1e2c1c6 tempest-SnapshotDependencyTests-880179703 None] Lock "cinder-quobyte-62d6a5f4-893c-45ec-be5d-6e7db90db97e" released by "delete_volume" :: held 0.701s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:47:41 devstack cinder-volume[88899]: DEBUG cinder.quota [None req-ec175535-93cd-468a-aeb0-850fc1e2c1c6 tempest-SnapshotDependencyTests-880179703 None] Created reservations ['b8d4b2ad-7118-4563-a721-802084b39274', '6d0b3e4e-9f0a-4f18-af22-a4d978d6ff8a', '2c8079a5-f063-4f6f-8443-4d6602121377', 'eb89a808-8a13-4ba6-bf57-dca49a9fb382'] {{(pid=88899) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 08:47:41 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-ec175535-93cd-468a-aeb0-850fc1e2c1c6 tempest-SnapshotDependencyTests-880179703 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:47:41 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-ec175535-93cd-468a-aeb0-850fc1e2c1c6 tempest-SnapshotDependencyTests-880179703 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:47:41 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-ec175535-93cd-468a-aeb0-850fc1e2c1c6 tempest-SnapshotDependencyTests-880179703 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:47:41 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-ec175535-93cd-468a-aeb0-850fc1e2c1c6 tempest-SnapshotDependencyTests-880179703 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:47:41 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-ec175535-93cd-468a-aeb0-850fc1e2c1c6 tempest-SnapshotDependencyTests-880179703 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:47:41 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-ec175535-93cd-468a-aeb0-850fc1e2c1c6 tempest-SnapshotDependencyTests-880179703 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:47:41 devstack sudo[108487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a Aug 03 08:47:41 devstack sudo[108487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:47:41 devstack sudo[108487]: pam_unix(sudo:session): session closed for user root Aug 03 08:47:41 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-ec175535-93cd-468a-aeb0-850fc1e2c1c6 tempest-SnapshotDependencyTests-880179703 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a" returned: 0 in 0.277s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:47:41 devstack cinder-volume[88899]: DEBUG cinder.manager [None req-ec175535-93cd-468a-aeb0-850fc1e2c1c6 tempest-SnapshotDependencyTests-880179703 None] Notifying Schedulers of capabilities ... {{(pid=88899) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 08:47:41 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-48a9dee4-e171-41aa-82f0-64175bd53ee9 tempest-SnapshotDependencyTests-880179703 None] Acquiring lock "cinder-a6aae9ed-abe5-4ce3-8c8b-a7db03046a55-delete_volume" by "delete_volume" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:47:41 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-ec175535-93cd-468a-aeb0-850fc1e2c1c6 tempest-SnapshotDependencyTests-880179703 None] Deleted volume successfully. Aug 03 08:47:41 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-48a9dee4-e171-41aa-82f0-64175bd53ee9 tempest-SnapshotDependencyTests-880179703 None] Lock "cinder-a6aae9ed-abe5-4ce3-8c8b-a7db03046a55-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:47:41 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-ec175535-93cd-468a-aeb0-850fc1e2c1c6 tempest-SnapshotDependencyTests-880179703 None] Lock "cinder-62d6a5f4-893c-45ec-be5d-6e7db90db97e-delete_volume" released by "delete_volume" :: held 1.210s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:47:41 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-48a9dee4-e171-41aa-82f0-64175bd53ee9 tempest-SnapshotDependencyTests-880179703 None] Acquiring lock "cinder-quobyte-a6aae9ed-abe5-4ce3-8c8b-a7db03046a55" by "delete_volume" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:47:41 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-48a9dee4-e171-41aa-82f0-64175bd53ee9 tempest-SnapshotDependencyTests-880179703 None] Lock "cinder-quobyte-a6aae9ed-abe5-4ce3-8c8b-a7db03046a55" acquired by "delete_volume" :: waited 0.015s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:47:41 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c61535f-1a0b-44c6-9bee-75a6018e0ed4]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:47:41 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-48a9dee4-e171-41aa-82f0-64175bd53ee9 tempest-SnapshotDependencyTests-880179703 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-a6aae9ed-abe5-4ce3-8c8b-a7db03046a55 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:47:41 devstack sudo[108490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-a6aae9ed-abe5-4ce3-8c8b-a7db03046a55 Aug 03 08:47:41 devstack sudo[108490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:47:42 devstack sudo[108490]: pam_unix(sudo:session): session closed for user root Aug 03 08:47:42 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-48a9dee4-e171-41aa-82f0-64175bd53ee9 tempest-SnapshotDependencyTests-880179703 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-a6aae9ed-abe5-4ce3-8c8b-a7db03046a55" returned: 0 in 0.452s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:47:42 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-48a9dee4-e171-41aa-82f0-64175bd53ee9 tempest-SnapshotDependencyTests-880179703 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-a6aae9ed-abe5-4ce3-8c8b-a7db03046a55 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:47:42 devstack sudo[108495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-a6aae9ed-abe5-4ce3-8c8b-a7db03046a55 Aug 03 08:47:42 devstack sudo[108495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:47:42 devstack sudo[108495]: pam_unix(sudo:session): session closed for user root Aug 03 08:47:42 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-48a9dee4-e171-41aa-82f0-64175bd53ee9 tempest-SnapshotDependencyTests-880179703 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-a6aae9ed-abe5-4ce3-8c8b-a7db03046a55" returned: 0 in 0.283s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:47:42 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-48a9dee4-e171-41aa-82f0-64175bd53ee9 tempest-SnapshotDependencyTests-880179703 None] Lock "cinder-quobyte-a6aae9ed-abe5-4ce3-8c8b-a7db03046a55" released by "delete_volume" :: held 0.778s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:47:42 devstack cinder-volume[88899]: DEBUG cinder.quota [None req-48a9dee4-e171-41aa-82f0-64175bd53ee9 tempest-SnapshotDependencyTests-880179703 None] Created reservations ['3efccbdb-3961-40dd-88cb-ae9d5692c103', 'd29eb66e-0e0b-436f-b62e-146886ab219f', '62acbd00-bdf2-469f-a3e1-3b4a693d3d95', 'a599c5dc-c3f8-409f-840d-0b4731962b83'] {{(pid=88899) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 08:47:42 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-48a9dee4-e171-41aa-82f0-64175bd53ee9 tempest-SnapshotDependencyTests-880179703 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:47:42 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-48a9dee4-e171-41aa-82f0-64175bd53ee9 tempest-SnapshotDependencyTests-880179703 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:47:42 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-48a9dee4-e171-41aa-82f0-64175bd53ee9 tempest-SnapshotDependencyTests-880179703 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:47:42 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-48a9dee4-e171-41aa-82f0-64175bd53ee9 tempest-SnapshotDependencyTests-880179703 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:47:42 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-48a9dee4-e171-41aa-82f0-64175bd53ee9 tempest-SnapshotDependencyTests-880179703 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:47:42 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-48a9dee4-e171-41aa-82f0-64175bd53ee9 tempest-SnapshotDependencyTests-880179703 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:47:42 devstack sudo[108498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a Aug 03 08:47:42 devstack sudo[108498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:47:43 devstack sudo[108498]: pam_unix(sudo:session): session closed for user root Aug 03 08:47:43 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-48a9dee4-e171-41aa-82f0-64175bd53ee9 tempest-SnapshotDependencyTests-880179703 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a" returned: 0 in 0.299s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:47:43 devstack cinder-volume[88899]: DEBUG cinder.manager [None req-48a9dee4-e171-41aa-82f0-64175bd53ee9 tempest-SnapshotDependencyTests-880179703 None] Notifying Schedulers of capabilities ... {{(pid=88899) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 08:47:43 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-48a9dee4-e171-41aa-82f0-64175bd53ee9 tempest-SnapshotDependencyTests-880179703 None] Deleted volume successfully. Aug 03 08:47:43 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-48a9dee4-e171-41aa-82f0-64175bd53ee9 tempest-SnapshotDependencyTests-880179703 None] Lock "cinder-a6aae9ed-abe5-4ce3-8c8b-a7db03046a55-delete_volume" released by "delete_volume" :: held 1.325s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:47:51 devstack cinder-volume[88899]: DEBUG cinder.volume.flows.manager.create_volume [None req-75f96091-86d3-4e56-a1af-f64ec1f94755 tempest-TestStampPattern-1427052539 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88899) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 08:47:51 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-75f96091-86d3-4e56-a1af-f64ec1f94755 tempest-TestStampPattern-1427052539 None] Flow 'volume_create_manager' (d45f0447-d011-4405-86e7-8da7312804e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:47:51 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-75f96091-86d3-4e56-a1af-f64ec1f94755 tempest-TestStampPattern-1427052539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2d2fee2-a5cc-41c3-bcac-089ca666acf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:47:51 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-75f96091-86d3-4e56-a1af-f64ec1f94755 tempest-TestStampPattern-1427052539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2d2fee2-a5cc-41c3-bcac-089ca666acf0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:47:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-2030564054',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=92bc63bc-774a-4ee4-85b7-c964b3456d0d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f4ec78b660e64a8a82159d1251ad5bc5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:47:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:47:51Z,use_quota=True,user_id='ea1d89e5fbc64ea2bed4171a04c25f65',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8bde7129-1dc4-42ab-b852-ab32c61b4921),volume_type_id=8bde7129-1dc4-42ab-b852-ab32c61b4921)' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:47:51 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-75f96091-86d3-4e56-a1af-f64ec1f94755 tempest-TestStampPattern-1427052539 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82c0d0d5-92fd-4e43-9f37-2db03e8c7a52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:47:51 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-75f96091-86d3-4e56-a1af-f64ec1f94755 tempest-TestStampPattern-1427052539 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82c0d0d5-92fd-4e43-9f37-2db03e8c7a52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:47:51 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-75f96091-86d3-4e56-a1af-f64ec1f94755 tempest-TestStampPattern-1427052539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (89f938d4-7087-4d10-a0e8-bf397725d290) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:47:51 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-75f96091-86d3-4e56-a1af-f64ec1f94755 tempest-TestStampPattern-1427052539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (89f938d4-7087-4d10-a0e8-bf397725d290) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '92bc63bc-774a-4ee4-85b7-c964b3456d0d', 'volume_name': 'volume-92bc63bc-774a-4ee4-85b7-c964b3456d0d', 'volume_size': 1}' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:47:51 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-75f96091-86d3-4e56-a1af-f64ec1f94755 tempest-TestStampPattern-1427052539 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (57afd475-ec6e-4ee2-8171-45b59f2c447c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:47:51 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-75f96091-86d3-4e56-a1af-f64ec1f94755 tempest-TestStampPattern-1427052539 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (57afd475-ec6e-4ee2-8171-45b59f2c447c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:47:51 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-75f96091-86d3-4e56-a1af-f64ec1f94755 tempest-TestStampPattern-1427052539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d6a84ef-91d3-4c24-bb78-febba3e6baa9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:47:51 devstack cinder-volume[88899]: INFO cinder.volume.flows.manager.create_volume [None req-75f96091-86d3-4e56-a1af-f64ec1f94755 tempest-TestStampPattern-1427052539 None] Volume 92bc63bc-774a-4ee4-85b7-c964b3456d0d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-92bc63bc-774a-4ee4-85b7-c964b3456d0d', 'volume_size': 1} Aug 03 08:47:51 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-75f96091-86d3-4e56-a1af-f64ec1f94755 tempest-TestStampPattern-1427052539 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:47:51 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-75f96091-86d3-4e56-a1af-f64ec1f94755 tempest-TestStampPattern-1427052539 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:47:51 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-75f96091-86d3-4e56-a1af-f64ec1f94755 tempest-TestStampPattern-1427052539 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:47:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-2030564054',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=92bc63bc-774a-4ee4-85b7-c964b3456d0d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f4ec78b660e64a8a82159d1251ad5bc5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:47:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:47:51Z,use_quota=True,user_id='ea1d89e5fbc64ea2bed4171a04c25f65',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8bde7129-1dc4-42ab-b852-ab32c61b4921),volume_type_id=8bde7129-1dc4-42ab-b852-ab32c61b4921)}" {{(pid=88899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 08:47:51 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-75f96091-86d3-4e56-a1af-f64ec1f94755 tempest-TestStampPattern-1427052539 None] Creating volume 92bc63bc-774a-4ee4-85b7-c964b3456d0d {{(pid=88899) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 08:47:51 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-75f96091-86d3-4e56-a1af-f64ec1f94755 tempest-TestStampPattern-1427052539 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:47:51 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-75f96091-86d3-4e56-a1af-f64ec1f94755 tempest-TestStampPattern-1427052539 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:47:51 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-75f96091-86d3-4e56-a1af-f64ec1f94755 tempest-TestStampPattern-1427052539 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:47:51 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-75f96091-86d3-4e56-a1af-f64ec1f94755 tempest-TestStampPattern-1427052539 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:47:51 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-75f96091-86d3-4e56-a1af-f64ec1f94755 tempest-TestStampPattern-1427052539 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:47:51 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-75f96091-86d3-4e56-a1af-f64ec1f94755 tempest-TestStampPattern-1427052539 None] Selected osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385 as target Quobyte volume. {{(pid=88899) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 08:47:51 devstack cinder-volume[88899]: INFO cinder.volume.drivers.remotefs [None req-75f96091-86d3-4e56-a1af-f64ec1f94755 tempest-TestStampPattern-1427052539 None] casted to osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385 Aug 03 08:47:51 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-75f96091-86d3-4e56-a1af-f64ec1f94755 tempest-TestStampPattern-1427052539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-92bc63bc-774a-4ee4-85b7-c964b3456d0d 1073741824 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:47:51 devstack sudo[108509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-92bc63bc-774a-4ee4-85b7-c964b3456d0d 1073741824 Aug 03 08:47:51 devstack sudo[108509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:47:51 devstack cinder-volume[88899]: DEBUG oslo_service.periodic_task [None req-f948fb4a-c4d7-499f-b1bd-8d6be3de0b53 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88899) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 03 08:47:51 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-f948fb4a-c4d7-499f-b1bd-8d6be3de0b53 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:47:51 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-f948fb4a-c4d7-499f-b1bd-8d6be3de0b53 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:47:51 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-f948fb4a-c4d7-499f-b1bd-8d6be3de0b53 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:47:51 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-f948fb4a-c4d7-499f-b1bd-8d6be3de0b53 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:47:51 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-f948fb4a-c4d7-499f-b1bd-8d6be3de0b53 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:47:51 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-f948fb4a-c4d7-499f-b1bd-8d6be3de0b53 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:47:51 devstack sudo[108514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a Aug 03 08:47:51 devstack sudo[108514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:47:52 devstack sudo[108509]: pam_unix(sudo:session): session closed for user root Aug 03 08:47:52 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-75f96091-86d3-4e56-a1af-f64ec1f94755 tempest-TestStampPattern-1427052539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-92bc63bc-774a-4ee4-85b7-c964b3456d0d 1073741824" returned: 0 in 0.584s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:47:52 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-75f96091-86d3-4e56-a1af-f64ec1f94755 tempest-TestStampPattern-1427052539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-92bc63bc-774a-4ee4-85b7-c964b3456d0d {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:47:52 devstack sudo[108518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-92bc63bc-774a-4ee4-85b7-c964b3456d0d Aug 03 08:47:52 devstack sudo[108518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:47:52 devstack sudo[108514]: pam_unix(sudo:session): session closed for user root Aug 03 08:47:52 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-f948fb4a-c4d7-499f-b1bd-8d6be3de0b53 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a" returned: 0 in 0.354s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:47:52 devstack cinder-volume[88899]: DEBUG cinder.manager [None req-f948fb4a-c4d7-499f-b1bd-8d6be3de0b53 None None] Notifying Schedulers of capabilities ... {{(pid=88899) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 08:47:52 devstack cinder-volume[88899]: DEBUG oslo_service.periodic_task [None req-f948fb4a-c4d7-499f-b1bd-8d6be3de0b53 None None] Running periodic task VolumeManager._thread_info {{(pid=88899) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 03 08:47:52 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-f948fb4a-c4d7-499f-b1bd-8d6be3de0b53 None None] thread count: 29 {{(pid=88899) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 03 08:47:52 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-f948fb4a-c4d7-499f-b1bd-8d6be3de0b53 None None] thread info: [<_MainThread(MainThread, started 132234320248960)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88899) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 03 08:47:52 devstack sudo[108518]: pam_unix(sudo:session): session closed for user root Aug 03 08:47:52 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-75f96091-86d3-4e56-a1af-f64ec1f94755 tempest-TestStampPattern-1427052539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-92bc63bc-774a-4ee4-85b7-c964b3456d0d" returned: 0 in 0.289s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:47:52 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-75f96091-86d3-4e56-a1af-f64ec1f94755 tempest-TestStampPattern-1427052539 None] <== create_volume: return (956ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'} {{(pid=88899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 08:47:52 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-75f96091-86d3-4e56-a1af-f64ec1f94755 tempest-TestStampPattern-1427052539 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.958s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:47:52 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-75f96091-86d3-4e56-a1af-f64ec1f94755 tempest-TestStampPattern-1427052539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d6a84ef-91d3-4c24-bb78-febba3e6baa9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-92bc63bc-774a-4ee4-85b7-c964b3456d0d', 'volume_size': 1}' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:47:52 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-75f96091-86d3-4e56-a1af-f64ec1f94755 tempest-TestStampPattern-1427052539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe7ccdfc-f816-4627-bc5d-bb6575562767) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:47:52 devstack cinder-volume[88899]: INFO cinder.volume.flows.manager.create_volume [None req-75f96091-86d3-4e56-a1af-f64ec1f94755 tempest-TestStampPattern-1427052539 None] Volume volume-92bc63bc-774a-4ee4-85b7-c964b3456d0d (92bc63bc-774a-4ee4-85b7-c964b3456d0d): created successfully Aug 03 08:47:52 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-75f96091-86d3-4e56-a1af-f64ec1f94755 tempest-TestStampPattern-1427052539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe7ccdfc-f816-4627-bc5d-bb6575562767) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:47:52 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-75f96091-86d3-4e56-a1af-f64ec1f94755 tempest-TestStampPattern-1427052539 None] Flow 'volume_create_manager' (d45f0447-d011-4405-86e7-8da7312804e8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:47:52 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-75f96091-86d3-4e56-a1af-f64ec1f94755 tempest-TestStampPattern-1427052539 None] Created volume successfully. Aug 03 08:48:02 devstack cinder-volume[88899]: DEBUG dbcounter [-] [88899] Writing DB stats cinder:SELECT=31,cinder:UPDATE=29,cinder:DELETE=3,cinder:INSERT=9 {{(pid=88899) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 03 08:48:02 devstack cinder-volume[88899]: DEBUG dbcounter [-] [88899] Writing DB stats cinder:UPDATE=36,cinder:INSERT=7,cinder:DELETE=3,cinder:SELECT=23 {{(pid=88899) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 03 08:48:23 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [req-288f7862-0ca1-4cec-8552-a82dc049f0e0 req-a51b9342-bdeb-43d1-9c09-6da97551c4e8 tempest-TestStampPattern-1427052539 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:48:23 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [req-288f7862-0ca1-4cec-8552-a82dc049f0e0 req-a51b9342-bdeb-43d1-9c09-6da97551c4e8 tempest-TestStampPattern-1427052539 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:48:23 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [req-288f7862-0ca1-4cec-8552-a82dc049f0e0 req-a51b9342-bdeb-43d1-9c09-6da97551c4e8 tempest-TestStampPattern-1427052539 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.011s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:48:23 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [req-288f7862-0ca1-4cec-8552-a82dc049f0e0 req-a51b9342-bdeb-43d1-9c09-6da97551c4e8 tempest-TestStampPattern-1427052539 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385', 'name': 'volume-92bc63bc-774a-4ee4-85b7-c964b3456d0d', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '690c5cfd-b75e-4a31-9835-691c5a62516e', 'enforce_multipath': True} {{(pid=88899) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 03 08:48:23 devstack cinder-volume[88899]: INFO cinder.volume.manager [req-288f7862-0ca1-4cec-8552-a82dc049f0e0 req-a51b9342-bdeb-43d1-9c09-6da97551c4e8 tempest-TestStampPattern-1427052539 None] attachment_update completed successfully. Aug 03 08:48:28 devstack cinder-volume[88899]: INFO cinder.volume.manager [req-d4abe08b-b53b-4d3d-a848-4e018699dddb req-4c0beaa9-d9d1-43e0-923f-59ba57daef75 tempest-TestStampPattern-1427052539 None] Terminate volume connection completed successfully. Aug 03 08:48:28 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [req-d4abe08b-b53b-4d3d-a848-4e018699dddb req-4c0beaa9-d9d1-43e0-923f-59ba57daef75 tempest-TestStampPattern-1427052539 None] Deleting attachment 690c5cfd-b75e-4a31-9835-691c5a62516e. {{(pid=88899) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 03 08:48:29 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-4fb66dee-8621-4b27-8b71-9e39f7e222f9 tempest-TestStampPattern-1427052539 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:48:29 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-4fb66dee-8621-4b27-8b71-9e39f7e222f9 tempest-TestStampPattern-1427052539 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:48:29 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-4fb66dee-8621-4b27-8b71-9e39f7e222f9 tempest-TestStampPattern-1427052539 None] Creating offline snapshot c9519ecc-f1d5-40fb-a1cb-fda6ce937170 of volume 92bc63bc-774a-4ee4-85b7-c964b3456d0d {{(pid=88899) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 03 08:48:29 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[555fd69f-0246-4598-bfd5-bccf4b2f1025]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:48:29 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-4fb66dee-8621-4b27-8b71-9e39f7e222f9 tempest-TestStampPattern-1427052539 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-92bc63bc-774a-4ee4-85b7-c964b3456d0d {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:48:29 devstack sudo[109141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-92bc63bc-774a-4ee4-85b7-c964b3456d0d Aug 03 08:48:29 devstack sudo[109141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:48:29 devstack sudo[109141]: pam_unix(sudo:session): session closed for user root Aug 03 08:48:29 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-4fb66dee-8621-4b27-8b71-9e39f7e222f9 tempest-TestStampPattern-1427052539 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-92bc63bc-774a-4ee4-85b7-c964b3456d0d" returned: 0 in 0.349s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:48:29 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-4fb66dee-8621-4b27-8b71-9e39f7e222f9 tempest-TestStampPattern-1427052539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-92bc63bc-774a-4ee4-85b7-c964b3456d0d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-92bc63bc-774a-4ee4-85b7-c964b3456d0d.c9519ecc-f1d5-40fb-a1cb-fda6ce937170 1G {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:48:29 devstack sudo[109146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-92bc63bc-774a-4ee4-85b7-c964b3456d0d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-92bc63bc-774a-4ee4-85b7-c964b3456d0d.c9519ecc-f1d5-40fb-a1cb-fda6ce937170 1G Aug 03 08:48:29 devstack sudo[109146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:48:30 devstack sudo[109146]: pam_unix(sudo:session): session closed for user root Aug 03 08:48:30 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-4fb66dee-8621-4b27-8b71-9e39f7e222f9 tempest-TestStampPattern-1427052539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-92bc63bc-774a-4ee4-85b7-c964b3456d0d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-92bc63bc-774a-4ee4-85b7-c964b3456d0d.c9519ecc-f1d5-40fb-a1cb-fda6ce937170 1G" returned: 0 in 0.398s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:48:30 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-4fb66dee-8621-4b27-8b71-9e39f7e222f9 tempest-TestStampPattern-1427052539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-92bc63bc-774a-4ee4-85b7-c964b3456d0d -F qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-92bc63bc-774a-4ee4-85b7-c964b3456d0d.c9519ecc-f1d5-40fb-a1cb-fda6ce937170 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:48:30 devstack sudo[109153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-92bc63bc-774a-4ee4-85b7-c964b3456d0d -F qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-92bc63bc-774a-4ee4-85b7-c964b3456d0d.c9519ecc-f1d5-40fb-a1cb-fda6ce937170 Aug 03 08:48:30 devstack sudo[109153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:48:30 devstack sudo[109153]: pam_unix(sudo:session): session closed for user root Aug 03 08:48:30 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-4fb66dee-8621-4b27-8b71-9e39f7e222f9 tempest-TestStampPattern-1427052539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-92bc63bc-774a-4ee4-85b7-c964b3456d0d -F qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-92bc63bc-774a-4ee4-85b7-c964b3456d0d.c9519ecc-f1d5-40fb-a1cb-fda6ce937170" returned: 0 in 0.286s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:48:30 devstack cinder-volume[88899]: WARNING cinder.volume.drivers.remotefs [None req-4fb66dee-8621-4b27-8b71-9e39f7e222f9 tempest-TestStampPattern-1427052539 None] /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-92bc63bc-774a-4ee4-85b7-c964b3456d0d.c9519ecc-f1d5-40fb-a1cb-fda6ce937170 is being set with open permissions: ugo+rw Aug 03 08:48:30 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-4fb66dee-8621-4b27-8b71-9e39f7e222f9 tempest-TestStampPattern-1427052539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-92bc63bc-774a-4ee4-85b7-c964b3456d0d.c9519ecc-f1d5-40fb-a1cb-fda6ce937170 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:48:30 devstack sudo[109158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-92bc63bc-774a-4ee4-85b7-c964b3456d0d.c9519ecc-f1d5-40fb-a1cb-fda6ce937170 Aug 03 08:48:30 devstack sudo[109158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:48:30 devstack sudo[109158]: pam_unix(sudo:session): session closed for user root Aug 03 08:48:30 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-4fb66dee-8621-4b27-8b71-9e39f7e222f9 tempest-TestStampPattern-1427052539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-92bc63bc-774a-4ee4-85b7-c964b3456d0d.c9519ecc-f1d5-40fb-a1cb-fda6ce937170" returned: 0 in 0.241s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:48:30 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-4fb66dee-8621-4b27-8b71-9e39f7e222f9 tempest-TestStampPattern-1427052539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-92bc63bc-774a-4ee4-85b7-c964b3456d0d.info {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:48:30 devstack sudo[109161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-92bc63bc-774a-4ee4-85b7-c964b3456d0d.info Aug 03 08:48:30 devstack sudo[109161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:48:31 devstack sudo[109161]: pam_unix(sudo:session): session closed for user root Aug 03 08:48:31 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-4fb66dee-8621-4b27-8b71-9e39f7e222f9 tempest-TestStampPattern-1427052539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-92bc63bc-774a-4ee4-85b7-c964b3456d0d.info" returned: 0 in 0.241s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:48:31 devstack cinder-volume[88899]: WARNING cinder.volume.drivers.remotefs [None req-4fb66dee-8621-4b27-8b71-9e39f7e222f9 tempest-TestStampPattern-1427052539 None] /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-92bc63bc-774a-4ee4-85b7-c964b3456d0d.info is being set with open permissions: ugo+rw Aug 03 08:48:31 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-4fb66dee-8621-4b27-8b71-9e39f7e222f9 tempest-TestStampPattern-1427052539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-92bc63bc-774a-4ee4-85b7-c964b3456d0d.info {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:48:31 devstack sudo[109164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-92bc63bc-774a-4ee4-85b7-c964b3456d0d.info Aug 03 08:48:31 devstack sudo[109164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:48:31 devstack sudo[109164]: pam_unix(sudo:session): session closed for user root Aug 03 08:48:31 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-4fb66dee-8621-4b27-8b71-9e39f7e222f9 tempest-TestStampPattern-1427052539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-92bc63bc-774a-4ee4-85b7-c964b3456d0d.info" returned: 0 in 0.260s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:48:31 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-4fb66dee-8621-4b27-8b71-9e39f7e222f9 tempest-TestStampPattern-1427052539 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.861s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:48:31 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-4fb66dee-8621-4b27-8b71-9e39f7e222f9 tempest-TestStampPattern-1427052539 None] Create snapshot completed successfully Aug 03 08:48:38 devstack cinder-volume[88899]: DEBUG cinder.volume.flows.manager.create_volume [None req-6b3cd972-5047-49e9-87a8-a13617fcce7b tempest-TestStampPattern-1427052539 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88899) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 08:48:38 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-6b3cd972-5047-49e9-87a8-a13617fcce7b tempest-TestStampPattern-1427052539 None] Flow 'volume_create_manager' (f63e6c5e-7ee2-4bd0-9109-9240c8e447ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:48:38 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-6b3cd972-5047-49e9-87a8-a13617fcce7b tempest-TestStampPattern-1427052539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90e850a5-1b8b-412a-b7a4-f52264733145) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:48:38 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-6b3cd972-5047-49e9-87a8-a13617fcce7b tempest-TestStampPattern-1427052539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90e850a5-1b8b-412a-b7a4-f52264733145) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:48:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-290150478',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=beafd1da-f073-4186-be63-da9d92c5f9db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f4ec78b660e64a8a82159d1251ad5bc5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:48:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=c9519ecc-f1d5-40fb-a1cb-fda6ce937170,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:48:38Z,use_quota=True,user_id='ea1d89e5fbc64ea2bed4171a04c25f65',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8bde7129-1dc4-42ab-b852-ab32c61b4921),volume_type_id=8bde7129-1dc4-42ab-b852-ab32c61b4921)' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:48:38 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-6b3cd972-5047-49e9-87a8-a13617fcce7b tempest-TestStampPattern-1427052539 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9199bcff-2e69-41cd-83ff-b8857d017987) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:48:38 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-6b3cd972-5047-49e9-87a8-a13617fcce7b tempest-TestStampPattern-1427052539 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9199bcff-2e69-41cd-83ff-b8857d017987) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:48:38 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-6b3cd972-5047-49e9-87a8-a13617fcce7b tempest-TestStampPattern-1427052539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8592a617-a575-4b02-a9ae-c37f1539e590) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:48:38 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-6b3cd972-5047-49e9-87a8-a13617fcce7b tempest-TestStampPattern-1427052539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8592a617-a575-4b02-a9ae-c37f1539e590) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'beafd1da-f073-4186-be63-da9d92c5f9db', 'volume_name': 'volume-beafd1da-f073-4186-be63-da9d92c5f9db', 'volume_size': 1, 'snapshot_id': 'c9519ecc-f1d5-40fb-a1cb-fda6ce937170'}' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:48:38 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-6b3cd972-5047-49e9-87a8-a13617fcce7b tempest-TestStampPattern-1427052539 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31055e80-f2aa-4a04-82d1-d53f4330d655) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:48:38 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-6b3cd972-5047-49e9-87a8-a13617fcce7b tempest-TestStampPattern-1427052539 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31055e80-f2aa-4a04-82d1-d53f4330d655) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:48:38 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-6b3cd972-5047-49e9-87a8-a13617fcce7b tempest-TestStampPattern-1427052539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ae764cc-f06f-49a0-bec7-dd9c53bcff96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:48:38 devstack cinder-volume[88899]: INFO cinder.volume.flows.manager.create_volume [None req-6b3cd972-5047-49e9-87a8-a13617fcce7b tempest-TestStampPattern-1427052539 None] Volume beafd1da-f073-4186-be63-da9d92c5f9db: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-beafd1da-f073-4186-be63-da9d92c5f9db', 'volume_size': 1, 'snapshot_id': 'c9519ecc-f1d5-40fb-a1cb-fda6ce937170'} Aug 03 08:48:38 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-6b3cd972-5047-49e9-87a8-a13617fcce7b tempest-TestStampPattern-1427052539 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:48:38 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-6b3cd972-5047-49e9-87a8-a13617fcce7b tempest-TestStampPattern-1427052539 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:48:38 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-6b3cd972-5047-49e9-87a8-a13617fcce7b tempest-TestStampPattern-1427052539 None] Acquiring lock "cinder-quobyte-c9519ecc-f1d5-40fb-a1cb-fda6ce937170-beafd1da-f073-4186-be63-da9d92c5f9db" by "_create_volume_from_snapshot" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:48:38 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-6b3cd972-5047-49e9-87a8-a13617fcce7b tempest-TestStampPattern-1427052539 None] Lock "cinder-quobyte-c9519ecc-f1d5-40fb-a1cb-fda6ce937170-beafd1da-f073-4186-be63-da9d92c5f9db" acquired by "_create_volume_from_snapshot" :: waited 0.015s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:48:38 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-6b3cd972-5047-49e9-87a8-a13617fcce7b tempest-TestStampPattern-1427052539 None] Creating volume beafd1da-f073-4186-be63-da9d92c5f9db from snapshot c9519ecc-f1d5-40fb-a1cb-fda6ce937170 {{(pid=88899) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Aug 03 08:48:38 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-6b3cd972-5047-49e9-87a8-a13617fcce7b tempest-TestStampPattern-1427052539 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:48:38 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-6b3cd972-5047-49e9-87a8-a13617fcce7b tempest-TestStampPattern-1427052539 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:48:38 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-6b3cd972-5047-49e9-87a8-a13617fcce7b tempest-TestStampPattern-1427052539 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:48:38 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-6b3cd972-5047-49e9-87a8-a13617fcce7b tempest-TestStampPattern-1427052539 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:48:38 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-6b3cd972-5047-49e9-87a8-a13617fcce7b tempest-TestStampPattern-1427052539 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:48:38 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-6b3cd972-5047-49e9-87a8-a13617fcce7b tempest-TestStampPattern-1427052539 None] Selected osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385 as target Quobyte volume. {{(pid=88899) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 08:48:38 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-6b3cd972-5047-49e9-87a8-a13617fcce7b tempest-TestStampPattern-1427052539 None] Acquiring lock "cinder-quobyte-beafd1da-f073-4186-be63-da9d92c5f9db" by "_copy_volume_from_snapshot" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:48:38 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-6b3cd972-5047-49e9-87a8-a13617fcce7b tempest-TestStampPattern-1427052539 None] Lock "cinder-quobyte-beafd1da-f073-4186-be63-da9d92c5f9db" acquired by "_copy_volume_from_snapshot" :: waited 0.015s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:48:38 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-6b3cd972-5047-49e9-87a8-a13617fcce7b tempest-TestStampPattern-1427052539 None] snapshot: c9519ecc-f1d5-40fb-a1cb-fda6ce937170, volume: beafd1da-f073-4186-be63-da9d92c5f9db, {{(pid=88899) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Aug 03 08:48:38 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-6b3cd972-5047-49e9-87a8-a13617fcce7b tempest-TestStampPattern-1427052539 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:48:38 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-6b3cd972-5047-49e9-87a8-a13617fcce7b tempest-TestStampPattern-1427052539 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:48:38 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-6b3cd972-5047-49e9-87a8-a13617fcce7b tempest-TestStampPattern-1427052539 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:48:38 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-6b3cd972-5047-49e9-87a8-a13617fcce7b tempest-TestStampPattern-1427052539 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:48:38 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-6b3cd972-5047-49e9-87a8-a13617fcce7b tempest-TestStampPattern-1427052539 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:48:38 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[4380240a-c79c-4d11-9922-681ab15b0fca]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:48:38 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-6b3cd972-5047-49e9-87a8-a13617fcce7b tempest-TestStampPattern-1427052539 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-92bc63bc-774a-4ee4-85b7-c964b3456d0d.c9519ecc-f1d5-40fb-a1cb-fda6ce937170 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:48:38 devstack sudo[109199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-92bc63bc-774a-4ee4-85b7-c964b3456d0d.c9519ecc-f1d5-40fb-a1cb-fda6ce937170 Aug 03 08:48:38 devstack sudo[109199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:48:38 devstack sudo[109199]: pam_unix(sudo:session): session closed for user root Aug 03 08:48:38 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-6b3cd972-5047-49e9-87a8-a13617fcce7b tempest-TestStampPattern-1427052539 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-92bc63bc-774a-4ee4-85b7-c964b3456d0d.c9519ecc-f1d5-40fb-a1cb-fda6ce937170" returned: 0 in 0.384s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:48:38 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-6b3cd972-5047-49e9-87a8-a13617fcce7b tempest-TestStampPattern-1427052539 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-92bc63bc-774a-4ee4-85b7-c964b3456d0d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88899) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 03 08:48:38 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2122db8-3697-4676-817a-f60f76647ef9]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:48:38 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-6b3cd972-5047-49e9-87a8-a13617fcce7b tempest-TestStampPattern-1427052539 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-92bc63bc-774a-4ee4-85b7-c964b3456d0d {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:48:38 devstack sudo[109206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-92bc63bc-774a-4ee4-85b7-c964b3456d0d Aug 03 08:48:38 devstack sudo[109206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:48:39 devstack sudo[109206]: pam_unix(sudo:session): session closed for user root Aug 03 08:48:39 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-6b3cd972-5047-49e9-87a8-a13617fcce7b tempest-TestStampPattern-1427052539 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-92bc63bc-774a-4ee4-85b7-c964b3456d0d" returned: 0 in 0.387s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:48:39 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-6b3cd972-5047-49e9-87a8-a13617fcce7b tempest-TestStampPattern-1427052539 None] will copy from snapshot at /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-92bc63bc-774a-4ee4-85b7-c964b3456d0d {{(pid=88899) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Aug 03 08:48:39 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-6b3cd972-5047-49e9-87a8-a13617fcce7b tempest-TestStampPattern-1427052539 None] Creating direct copy from snapshot {{(pid=88899) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Aug 03 08:48:39 devstack cinder-volume[88899]: DEBUG cinder.utils [None req-6b3cd972-5047-49e9-87a8-a13617fcce7b tempest-TestStampPattern-1427052539 None] Path /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-beafd1da-f073-4186-be63-da9d92c5f9db not found in is_blk_device check {{(pid=88899) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Aug 03 08:48:39 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-6b3cd972-5047-49e9-87a8-a13617fcce7b tempest-TestStampPattern-1427052539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-92bc63bc-774a-4ee4-85b7-c964b3456d0d /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-beafd1da-f073-4186-be63-da9d92c5f9db {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:48:39 devstack sudo[109214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-92bc63bc-774a-4ee4-85b7-c964b3456d0d /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-beafd1da-f073-4186-be63-da9d92c5f9db Aug 03 08:48:39 devstack sudo[109214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:48:44 devstack sudo[109214]: pam_unix(sudo:session): session closed for user root Aug 03 08:48:44 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-6b3cd972-5047-49e9-87a8-a13617fcce7b tempest-TestStampPattern-1427052539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-92bc63bc-774a-4ee4-85b7-c964b3456d0d /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-beafd1da-f073-4186-be63-da9d92c5f9db" returned: 0 in 4.856s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:48:44 devstack cinder-volume[88899]: DEBUG cinder.image.image_utils [None req-6b3cd972-5047-49e9-87a8-a13617fcce7b tempest-TestStampPattern-1427052539 None] Image conversion details: src /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-92bc63bc-774a-4ee4-85b7-c964b3456d0d, size 1024.00 MB, duration 4.86 sec, destination /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-beafd1da-f073-4186-be63-da9d92c5f9db {{(pid=88899) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 03 08:48:44 devstack cinder-volume[88899]: INFO cinder.image.image_utils [None req-6b3cd972-5047-49e9-87a8-a13617fcce7b tempest-TestStampPattern-1427052539 None] Converted 1024.00 MB image at 210.69 MB/s Aug 03 08:48:44 devstack cinder-volume[88899]: WARNING cinder.volume.drivers.remotefs [None req-6b3cd972-5047-49e9-87a8-a13617fcce7b tempest-TestStampPattern-1427052539 None] /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-beafd1da-f073-4186-be63-da9d92c5f9db is being set with open permissions: ugo+rw Aug 03 08:48:44 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-6b3cd972-5047-49e9-87a8-a13617fcce7b tempest-TestStampPattern-1427052539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-beafd1da-f073-4186-be63-da9d92c5f9db {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:48:44 devstack sudo[109228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-beafd1da-f073-4186-be63-da9d92c5f9db Aug 03 08:48:44 devstack sudo[109228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:48:44 devstack sudo[109228]: pam_unix(sudo:session): session closed for user root Aug 03 08:48:44 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-6b3cd972-5047-49e9-87a8-a13617fcce7b tempest-TestStampPattern-1427052539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-beafd1da-f073-4186-be63-da9d92c5f9db" returned: 0 in 0.283s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:48:44 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-6b3cd972-5047-49e9-87a8-a13617fcce7b tempest-TestStampPattern-1427052539 None] Lock "cinder-quobyte-beafd1da-f073-4186-be63-da9d92c5f9db" released by "_copy_volume_from_snapshot" :: held 6.009s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:48:44 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-6b3cd972-5047-49e9-87a8-a13617fcce7b tempest-TestStampPattern-1427052539 None] Lock "cinder-quobyte-c9519ecc-f1d5-40fb-a1cb-fda6ce937170-beafd1da-f073-4186-be63-da9d92c5f9db" released by "_create_volume_from_snapshot" :: held 6.079s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:48:44 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-6b3cd972-5047-49e9-87a8-a13617fcce7b tempest-TestStampPattern-1427052539 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.095s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:48:44 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-6b3cd972-5047-49e9-87a8-a13617fcce7b tempest-TestStampPattern-1427052539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ae764cc-f06f-49a0-bec7-dd9c53bcff96) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-beafd1da-f073-4186-be63-da9d92c5f9db', 'volume_size': 1, 'snapshot_id': 'c9519ecc-f1d5-40fb-a1cb-fda6ce937170'}' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:48:44 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-6b3cd972-5047-49e9-87a8-a13617fcce7b tempest-TestStampPattern-1427052539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd50ba20-09b0-41a2-bff6-c921d4ce1a89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:48:44 devstack cinder-volume[88899]: INFO cinder.volume.flows.manager.create_volume [None req-6b3cd972-5047-49e9-87a8-a13617fcce7b tempest-TestStampPattern-1427052539 None] Volume volume-beafd1da-f073-4186-be63-da9d92c5f9db (beafd1da-f073-4186-be63-da9d92c5f9db): created successfully Aug 03 08:48:44 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-6b3cd972-5047-49e9-87a8-a13617fcce7b tempest-TestStampPattern-1427052539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd50ba20-09b0-41a2-bff6-c921d4ce1a89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:48:44 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-6b3cd972-5047-49e9-87a8-a13617fcce7b tempest-TestStampPattern-1427052539 None] Flow 'volume_create_manager' (f63e6c5e-7ee2-4bd0-9109-9240c8e447ba) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:48:44 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-6b3cd972-5047-49e9-87a8-a13617fcce7b tempest-TestStampPattern-1427052539 None] Created volume successfully. Aug 03 08:48:51 devstack cinder-volume[88899]: DEBUG oslo_service.periodic_task [None req-f948fb4a-c4d7-499f-b1bd-8d6be3de0b53 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88899) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 03 08:48:51 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-f948fb4a-c4d7-499f-b1bd-8d6be3de0b53 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:48:51 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-f948fb4a-c4d7-499f-b1bd-8d6be3de0b53 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:48:51 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-f948fb4a-c4d7-499f-b1bd-8d6be3de0b53 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:48:51 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-f948fb4a-c4d7-499f-b1bd-8d6be3de0b53 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:48:51 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-f948fb4a-c4d7-499f-b1bd-8d6be3de0b53 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:48:51 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-f948fb4a-c4d7-499f-b1bd-8d6be3de0b53 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:48:51 devstack sudo[109316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a Aug 03 08:48:51 devstack sudo[109316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:48:52 devstack sudo[109316]: pam_unix(sudo:session): session closed for user root Aug 03 08:48:52 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-f948fb4a-c4d7-499f-b1bd-8d6be3de0b53 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a" returned: 0 in 0.274s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:48:52 devstack cinder-volume[88899]: DEBUG cinder.manager [None req-f948fb4a-c4d7-499f-b1bd-8d6be3de0b53 None None] Notifying Schedulers of capabilities ... {{(pid=88899) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 08:48:52 devstack cinder-volume[88899]: DEBUG oslo_service.periodic_task [None req-f948fb4a-c4d7-499f-b1bd-8d6be3de0b53 None None] Running periodic task VolumeManager._thread_info {{(pid=88899) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 03 08:48:52 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-f948fb4a-c4d7-499f-b1bd-8d6be3de0b53 None None] thread count: 29 {{(pid=88899) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 03 08:48:52 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-f948fb4a-c4d7-499f-b1bd-8d6be3de0b53 None None] thread info: [<_MainThread(MainThread, started 132234320248960)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88899) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 03 08:48:54 devstack cinder-volume[88899]: DEBUG dbcounter [-] [88899] Writing DB stats cinder:SELECT=10,cinder:UPDATE=6,cinder:INSERT=1 {{(pid=88899) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 03 08:48:54 devstack cinder-volume[88899]: DEBUG dbcounter [-] [88899] Writing DB stats cinder:SELECT=19,cinder:UPDATE=6,cinder:DELETE=2,cinder:INSERT=1 {{(pid=88899) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 03 08:49:15 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [req-d8c6392a-d5b3-444c-ac2e-5fbbf5a6303c req-347419a4-ad7c-4c31-96ff-1033b8849137 tempest-TestStampPattern-1427052539 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:49:15 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [req-d8c6392a-d5b3-444c-ac2e-5fbbf5a6303c req-347419a4-ad7c-4c31-96ff-1033b8849137 tempest-TestStampPattern-1427052539 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:49:15 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [req-d8c6392a-d5b3-444c-ac2e-5fbbf5a6303c req-347419a4-ad7c-4c31-96ff-1033b8849137 tempest-TestStampPattern-1427052539 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.014s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:49:15 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [req-d8c6392a-d5b3-444c-ac2e-5fbbf5a6303c req-347419a4-ad7c-4c31-96ff-1033b8849137 tempest-TestStampPattern-1427052539 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385', 'name': 'volume-beafd1da-f073-4186-be63-da9d92c5f9db', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '903b02f9-a9eb-4366-9a3f-8af3bd6ecdf7', 'enforce_multipath': True} {{(pid=88899) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 03 08:49:15 devstack cinder-volume[88899]: INFO cinder.volume.manager [req-d8c6392a-d5b3-444c-ac2e-5fbbf5a6303c req-347419a4-ad7c-4c31-96ff-1033b8849137 tempest-TestStampPattern-1427052539 None] attachment_update completed successfully. Aug 03 08:49:18 devstack cinder-volume[88899]: INFO cinder.volume.manager [req-5ae0265a-a210-4474-8adc-62eaa1b79829 req-61f11ea9-f658-480b-9fb2-dfee8e71a29e tempest-TestStampPattern-1427052539 None] Terminate volume connection completed successfully. Aug 03 08:49:18 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [req-5ae0265a-a210-4474-8adc-62eaa1b79829 req-61f11ea9-f658-480b-9fb2-dfee8e71a29e tempest-TestStampPattern-1427052539 None] Deleting attachment 903b02f9-a9eb-4366-9a3f-8af3bd6ecdf7. {{(pid=88899) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 03 08:49:22 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-cfce3051-e8d1-4521-b242-4fe0adc37c9f tempest-TestStampPattern-1427052539 None] Acquiring lock "cinder-beafd1da-f073-4186-be63-da9d92c5f9db-delete_volume" by "delete_volume" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:49:22 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-cfce3051-e8d1-4521-b242-4fe0adc37c9f tempest-TestStampPattern-1427052539 None] Lock "cinder-beafd1da-f073-4186-be63-da9d92c5f9db-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:49:22 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-cfce3051-e8d1-4521-b242-4fe0adc37c9f tempest-TestStampPattern-1427052539 None] Acquiring lock "cinder-quobyte-beafd1da-f073-4186-be63-da9d92c5f9db" by "delete_volume" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:49:22 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-cfce3051-e8d1-4521-b242-4fe0adc37c9f tempest-TestStampPattern-1427052539 None] Lock "cinder-quobyte-beafd1da-f073-4186-be63-da9d92c5f9db" acquired by "delete_volume" :: waited 0.016s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:49:22 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ef2184a-b5df-4e77-9e7e-8bdd02d38c9c]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:49:22 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-cfce3051-e8d1-4521-b242-4fe0adc37c9f tempest-TestStampPattern-1427052539 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-beafd1da-f073-4186-be63-da9d92c5f9db {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:49:22 devstack sudo[109869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-beafd1da-f073-4186-be63-da9d92c5f9db Aug 03 08:49:22 devstack sudo[109869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:49:23 devstack sudo[109869]: pam_unix(sudo:session): session closed for user root Aug 03 08:49:23 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-cfce3051-e8d1-4521-b242-4fe0adc37c9f tempest-TestStampPattern-1427052539 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-beafd1da-f073-4186-be63-da9d92c5f9db" returned: 0 in 0.344s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:49:23 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-cfce3051-e8d1-4521-b242-4fe0adc37c9f tempest-TestStampPattern-1427052539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-beafd1da-f073-4186-be63-da9d92c5f9db {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:49:23 devstack sudo[109874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-beafd1da-f073-4186-be63-da9d92c5f9db Aug 03 08:49:23 devstack sudo[109874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:49:23 devstack sudo[109874]: pam_unix(sudo:session): session closed for user root Aug 03 08:49:23 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-cfce3051-e8d1-4521-b242-4fe0adc37c9f tempest-TestStampPattern-1427052539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-beafd1da-f073-4186-be63-da9d92c5f9db" returned: 0 in 0.238s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:49:23 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-cfce3051-e8d1-4521-b242-4fe0adc37c9f tempest-TestStampPattern-1427052539 None] Lock "cinder-quobyte-beafd1da-f073-4186-be63-da9d92c5f9db" released by "delete_volume" :: held 0.617s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:49:23 devstack cinder-volume[88899]: DEBUG cinder.quota [None req-cfce3051-e8d1-4521-b242-4fe0adc37c9f tempest-TestStampPattern-1427052539 None] Created reservations ['6d7d592d-e4a0-402a-a123-30790926a896', '4e3a7d69-f17a-41f1-90a4-231475befb4d', '825ced24-e9e2-470e-99fe-d71b8239a8c7', 'b750300b-2552-4fe3-9f36-93af2b5076dc'] {{(pid=88899) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 08:49:23 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-cfce3051-e8d1-4521-b242-4fe0adc37c9f tempest-TestStampPattern-1427052539 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:49:23 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-cfce3051-e8d1-4521-b242-4fe0adc37c9f tempest-TestStampPattern-1427052539 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:49:23 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-cfce3051-e8d1-4521-b242-4fe0adc37c9f tempest-TestStampPattern-1427052539 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:49:23 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-cfce3051-e8d1-4521-b242-4fe0adc37c9f tempest-TestStampPattern-1427052539 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:49:23 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-cfce3051-e8d1-4521-b242-4fe0adc37c9f tempest-TestStampPattern-1427052539 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:49:23 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-cfce3051-e8d1-4521-b242-4fe0adc37c9f tempest-TestStampPattern-1427052539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:49:23 devstack sudo[109877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a Aug 03 08:49:23 devstack sudo[109877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:49:23 devstack sudo[109877]: pam_unix(sudo:session): session closed for user root Aug 03 08:49:23 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-cfce3051-e8d1-4521-b242-4fe0adc37c9f tempest-TestStampPattern-1427052539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a" returned: 0 in 0.236s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:49:23 devstack cinder-volume[88899]: DEBUG cinder.manager [None req-cfce3051-e8d1-4521-b242-4fe0adc37c9f tempest-TestStampPattern-1427052539 None] Notifying Schedulers of capabilities ... {{(pid=88899) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 08:49:23 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-cfce3051-e8d1-4521-b242-4fe0adc37c9f tempest-TestStampPattern-1427052539 None] Deleted volume successfully. Aug 03 08:49:23 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-cfce3051-e8d1-4521-b242-4fe0adc37c9f tempest-TestStampPattern-1427052539 None] Lock "cinder-beafd1da-f073-4186-be63-da9d92c5f9db-delete_volume" released by "delete_volume" :: held 1.043s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:49:24 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-0be8b8fc-cb94-4413-9002-68abcbec4991 tempest-TestStampPattern-1427052539 None] Acquiring lock "cinder-c9519ecc-f1d5-40fb-a1cb-fda6ce937170-delete_snapshot" by "delete_snapshot" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:49:24 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-0be8b8fc-cb94-4413-9002-68abcbec4991 tempest-TestStampPattern-1427052539 None] Lock "cinder-c9519ecc-f1d5-40fb-a1cb-fda6ce937170-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:49:24 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-0be8b8fc-cb94-4413-9002-68abcbec4991 tempest-TestStampPattern-1427052539 None] Acquiring lock "cinder-quobyte-92bc63bc-774a-4ee4-85b7-c964b3456d0d" by "delete_snapshot" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:49:24 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-0be8b8fc-cb94-4413-9002-68abcbec4991 tempest-TestStampPattern-1427052539 None] Lock "cinder-quobyte-92bc63bc-774a-4ee4-85b7-c964b3456d0d" acquired by "delete_snapshot" :: waited 0.016s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:49:24 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-0be8b8fc-cb94-4413-9002-68abcbec4991 tempest-TestStampPattern-1427052539 None] Acquiring lock "cinder-quobyte-c9519ecc-f1d5-40fb-a1cb-fda6ce937170" by "_delete_snapshot" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:49:24 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-0be8b8fc-cb94-4413-9002-68abcbec4991 tempest-TestStampPattern-1427052539 None] Lock "cinder-quobyte-c9519ecc-f1d5-40fb-a1cb-fda6ce937170" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:49:24 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-0be8b8fc-cb94-4413-9002-68abcbec4991 tempest-TestStampPattern-1427052539 None] Deleting offline snapshot c9519ecc-f1d5-40fb-a1cb-fda6ce937170 of volume 92bc63bc-774a-4ee4-85b7-c964b3456d0d {{(pid=88899) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 03 08:49:24 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-0be8b8fc-cb94-4413-9002-68abcbec4991 tempest-TestStampPattern-1427052539 None] snapshot_file for this snap is: volume-92bc63bc-774a-4ee4-85b7-c964b3456d0d.c9519ecc-f1d5-40fb-a1cb-fda6ce937170 {{(pid=88899) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 03 08:49:24 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[568c0fc6-10de-4ce5-bc90-1ac66e82e98e]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:49:24 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-0be8b8fc-cb94-4413-9002-68abcbec4991 tempest-TestStampPattern-1427052539 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-92bc63bc-774a-4ee4-85b7-c964b3456d0d.c9519ecc-f1d5-40fb-a1cb-fda6ce937170 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:49:24 devstack sudo[109880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-92bc63bc-774a-4ee4-85b7-c964b3456d0d.c9519ecc-f1d5-40fb-a1cb-fda6ce937170 Aug 03 08:49:24 devstack sudo[109880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:49:24 devstack sudo[109880]: pam_unix(sudo:session): session closed for user root Aug 03 08:49:24 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-0be8b8fc-cb94-4413-9002-68abcbec4991 tempest-TestStampPattern-1427052539 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-92bc63bc-774a-4ee4-85b7-c964b3456d0d.c9519ecc-f1d5-40fb-a1cb-fda6ce937170" returned: 0 in 0.336s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:49:24 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-0be8b8fc-cb94-4413-9002-68abcbec4991 tempest-TestStampPattern-1427052539 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-92bc63bc-774a-4ee4-85b7-c964b3456d0d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88899) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 03 08:49:24 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1f0269a-d632-4d83-87dc-c626896b4b85]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:49:24 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-0be8b8fc-cb94-4413-9002-68abcbec4991 tempest-TestStampPattern-1427052539 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-92bc63bc-774a-4ee4-85b7-c964b3456d0d {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:49:24 devstack sudo[109885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-92bc63bc-774a-4ee4-85b7-c964b3456d0d Aug 03 08:49:24 devstack sudo[109885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:49:24 devstack sudo[109885]: pam_unix(sudo:session): session closed for user root Aug 03 08:49:24 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-0be8b8fc-cb94-4413-9002-68abcbec4991 tempest-TestStampPattern-1427052539 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-92bc63bc-774a-4ee4-85b7-c964b3456d0d" returned: 0 in 0.498s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:49:24 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-0be8b8fc-cb94-4413-9002-68abcbec4991 tempest-TestStampPattern-1427052539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-92bc63bc-774a-4ee4-85b7-c964b3456d0d.c9519ecc-f1d5-40fb-a1cb-fda6ce937170 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:49:25 devstack sudo[109890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-92bc63bc-774a-4ee4-85b7-c964b3456d0d.c9519ecc-f1d5-40fb-a1cb-fda6ce937170 Aug 03 08:49:25 devstack sudo[109890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:49:25 devstack sudo[109890]: pam_unix(sudo:session): session closed for user root Aug 03 08:49:25 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-0be8b8fc-cb94-4413-9002-68abcbec4991 tempest-TestStampPattern-1427052539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-92bc63bc-774a-4ee4-85b7-c964b3456d0d.c9519ecc-f1d5-40fb-a1cb-fda6ce937170" returned: 0 in 0.320s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:49:25 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-0be8b8fc-cb94-4413-9002-68abcbec4991 tempest-TestStampPattern-1427052539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-92bc63bc-774a-4ee4-85b7-c964b3456d0d.c9519ecc-f1d5-40fb-a1cb-fda6ce937170 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:49:25 devstack sudo[109895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-92bc63bc-774a-4ee4-85b7-c964b3456d0d.c9519ecc-f1d5-40fb-a1cb-fda6ce937170 Aug 03 08:49:25 devstack sudo[109895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:49:25 devstack sudo[109895]: pam_unix(sudo:session): session closed for user root Aug 03 08:49:25 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-0be8b8fc-cb94-4413-9002-68abcbec4991 tempest-TestStampPattern-1427052539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-92bc63bc-774a-4ee4-85b7-c964b3456d0d.c9519ecc-f1d5-40fb-a1cb-fda6ce937170" returned: 0 in 0.232s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:49:25 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-0be8b8fc-cb94-4413-9002-68abcbec4991 tempest-TestStampPattern-1427052539 None] Lock "cinder-quobyte-c9519ecc-f1d5-40fb-a1cb-fda6ce937170" released by "_delete_snapshot" :: held 1.482s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:49:25 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-0be8b8fc-cb94-4413-9002-68abcbec4991 tempest-TestStampPattern-1427052539 None] Lock "cinder-quobyte-92bc63bc-774a-4ee4-85b7-c964b3456d0d" released by "delete_snapshot" :: held 1.509s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:49:25 devstack cinder-volume[88899]: DEBUG cinder.quota [None req-0be8b8fc-cb94-4413-9002-68abcbec4991 tempest-TestStampPattern-1427052539 None] Created reservations ['19cee4f2-36ca-4c5d-8487-05df4a79bcbe', 'fec3a45e-62c4-41c6-82e3-b8eda29a87e8', 'c8b8936d-a62f-43d9-9e85-6aabc4585ac3', '391290fa-f7db-4dc7-9632-9b7779fd184b'] {{(pid=88899) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 08:49:25 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-0be8b8fc-cb94-4413-9002-68abcbec4991 tempest-TestStampPattern-1427052539 None] Delete snapshot completed successfully. Aug 03 08:49:25 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-0be8b8fc-cb94-4413-9002-68abcbec4991 tempest-TestStampPattern-1427052539 None] Lock "cinder-c9519ecc-f1d5-40fb-a1cb-fda6ce937170-delete_snapshot" released by "delete_snapshot" :: held 1.637s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:49:29 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-dead1c0e-7896-4115-8902-5d46a0931235 tempest-TestStampPattern-1427052539 None] Acquiring lock "cinder-92bc63bc-774a-4ee4-85b7-c964b3456d0d-delete_volume" by "delete_volume" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:49:29 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-dead1c0e-7896-4115-8902-5d46a0931235 tempest-TestStampPattern-1427052539 None] Lock "cinder-92bc63bc-774a-4ee4-85b7-c964b3456d0d-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:49:29 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-dead1c0e-7896-4115-8902-5d46a0931235 tempest-TestStampPattern-1427052539 None] Acquiring lock "cinder-quobyte-92bc63bc-774a-4ee4-85b7-c964b3456d0d" by "delete_volume" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:49:29 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-dead1c0e-7896-4115-8902-5d46a0931235 tempest-TestStampPattern-1427052539 None] Lock "cinder-quobyte-92bc63bc-774a-4ee4-85b7-c964b3456d0d" acquired by "delete_volume" :: waited 0.017s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:49:29 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[885ab9a2-096f-4824-9871-ae4b446dbc9a]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:49:29 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-dead1c0e-7896-4115-8902-5d46a0931235 tempest-TestStampPattern-1427052539 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-92bc63bc-774a-4ee4-85b7-c964b3456d0d {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:49:29 devstack sudo[109929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-92bc63bc-774a-4ee4-85b7-c964b3456d0d Aug 03 08:49:29 devstack sudo[109929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:49:30 devstack sudo[109929]: pam_unix(sudo:session): session closed for user root Aug 03 08:49:30 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-dead1c0e-7896-4115-8902-5d46a0931235 tempest-TestStampPattern-1427052539 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-92bc63bc-774a-4ee4-85b7-c964b3456d0d" returned: 0 in 0.366s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:49:30 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-dead1c0e-7896-4115-8902-5d46a0931235 tempest-TestStampPattern-1427052539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-92bc63bc-774a-4ee4-85b7-c964b3456d0d {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:49:30 devstack sudo[109935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-92bc63bc-774a-4ee4-85b7-c964b3456d0d Aug 03 08:49:30 devstack sudo[109935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:49:30 devstack sudo[109935]: pam_unix(sudo:session): session closed for user root Aug 03 08:49:30 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-dead1c0e-7896-4115-8902-5d46a0931235 tempest-TestStampPattern-1427052539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-92bc63bc-774a-4ee4-85b7-c964b3456d0d" returned: 0 in 0.237s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:49:30 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-dead1c0e-7896-4115-8902-5d46a0931235 tempest-TestStampPattern-1427052539 None] Lock "cinder-quobyte-92bc63bc-774a-4ee4-85b7-c964b3456d0d" released by "delete_volume" :: held 0.662s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:49:30 devstack cinder-volume[88899]: DEBUG cinder.quota [None req-dead1c0e-7896-4115-8902-5d46a0931235 tempest-TestStampPattern-1427052539 None] Created reservations ['7217c64c-b232-47f7-b524-da4d4fc28974', 'ba1576e5-caec-407f-94eb-62cfe71f5ecf', 'd1467bce-9d51-43f6-866b-fbbc3e9cb0b1', '97c429f4-1617-452e-8670-f5b4c6a24432'] {{(pid=88899) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 08:49:30 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-dead1c0e-7896-4115-8902-5d46a0931235 tempest-TestStampPattern-1427052539 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:49:30 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-dead1c0e-7896-4115-8902-5d46a0931235 tempest-TestStampPattern-1427052539 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:49:30 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-dead1c0e-7896-4115-8902-5d46a0931235 tempest-TestStampPattern-1427052539 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:49:30 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-dead1c0e-7896-4115-8902-5d46a0931235 tempest-TestStampPattern-1427052539 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:49:30 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-dead1c0e-7896-4115-8902-5d46a0931235 tempest-TestStampPattern-1427052539 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:49:30 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-dead1c0e-7896-4115-8902-5d46a0931235 tempest-TestStampPattern-1427052539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:49:30 devstack sudo[109938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a Aug 03 08:49:30 devstack sudo[109938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:49:30 devstack sudo[109938]: pam_unix(sudo:session): session closed for user root Aug 03 08:49:30 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-dead1c0e-7896-4115-8902-5d46a0931235 tempest-TestStampPattern-1427052539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a" returned: 0 in 0.242s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:49:30 devstack cinder-volume[88899]: DEBUG cinder.manager [None req-dead1c0e-7896-4115-8902-5d46a0931235 tempest-TestStampPattern-1427052539 None] Notifying Schedulers of capabilities ... {{(pid=88899) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 08:49:30 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-dead1c0e-7896-4115-8902-5d46a0931235 tempest-TestStampPattern-1427052539 None] Deleted volume successfully. Aug 03 08:49:30 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-dead1c0e-7896-4115-8902-5d46a0931235 tempest-TestStampPattern-1427052539 None] Lock "cinder-92bc63bc-774a-4ee4-85b7-c964b3456d0d-delete_volume" released by "delete_volume" :: held 1.104s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:49:40 devstack cinder-volume[88899]: DEBUG dbcounter [-] [88899] Writing DB stats cinder:SELECT=21,cinder:UPDATE=24,cinder:INSERT=6,cinder:DELETE=1 {{(pid=88899) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 03 08:49:40 devstack cinder-volume[88899]: DEBUG dbcounter [-] [88899] Writing DB stats cinder:SELECT=25,cinder:UPDATE=22,cinder:INSERT=6,cinder:DELETE=1 {{(pid=88899) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 03 08:49:51 devstack cinder-volume[88899]: DEBUG oslo_service.periodic_task [None req-f948fb4a-c4d7-499f-b1bd-8d6be3de0b53 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88899) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 03 08:49:51 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-f948fb4a-c4d7-499f-b1bd-8d6be3de0b53 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:49:51 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-f948fb4a-c4d7-499f-b1bd-8d6be3de0b53 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:49:51 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-f948fb4a-c4d7-499f-b1bd-8d6be3de0b53 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:49:51 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-f948fb4a-c4d7-499f-b1bd-8d6be3de0b53 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:49:51 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-f948fb4a-c4d7-499f-b1bd-8d6be3de0b53 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:49:51 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-f948fb4a-c4d7-499f-b1bd-8d6be3de0b53 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:49:51 devstack sudo[109950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a Aug 03 08:49:51 devstack sudo[109950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:49:52 devstack sudo[109950]: pam_unix(sudo:session): session closed for user root Aug 03 08:49:52 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-f948fb4a-c4d7-499f-b1bd-8d6be3de0b53 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a" returned: 0 in 0.294s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:49:52 devstack cinder-volume[88899]: DEBUG cinder.manager [None req-f948fb4a-c4d7-499f-b1bd-8d6be3de0b53 None None] Notifying Schedulers of capabilities ... {{(pid=88899) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 08:49:52 devstack cinder-volume[88899]: DEBUG oslo_service.periodic_task [None req-f948fb4a-c4d7-499f-b1bd-8d6be3de0b53 None None] Running periodic task VolumeManager._thread_info {{(pid=88899) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 03 08:49:52 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-f948fb4a-c4d7-499f-b1bd-8d6be3de0b53 None None] thread count: 29 {{(pid=88899) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 03 08:49:52 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-f948fb4a-c4d7-499f-b1bd-8d6be3de0b53 None None] thread info: [<_MainThread(MainThread, started 132234320248960)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88899) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 03 08:49:52 devstack cinder-volume[88899]: DEBUG dbcounter [-] [88899] Writing DB stats cinder:SELECT=1 {{(pid=88899) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 03 08:49:52 devstack cinder-volume[88899]: DEBUG dbcounter [-] [88899] Writing DB stats cinder:UPDATE=1 {{(pid=88899) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 03 08:50:00 devstack cinder-volume[88899]: DEBUG cinder.volume.flows.manager.create_volume [None req-0f2ee8dc-30b4-4f15-87a0-2674c5a494e9 tempest-TestVolumeBootPattern-702574089 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88899) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 08:50:00 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-0f2ee8dc-30b4-4f15-87a0-2674c5a494e9 tempest-TestVolumeBootPattern-702574089 None] Flow 'volume_create_manager' (beece2fc-b86c-46b0-a67f-4eac6af78811) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:50:00 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-0f2ee8dc-30b4-4f15-87a0-2674c5a494e9 tempest-TestVolumeBootPattern-702574089 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79c648af-7dc3-4cd4-9f0b-8c3c355bfbc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:50:00 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-0f2ee8dc-30b4-4f15-87a0-2674c5a494e9 tempest-TestVolumeBootPattern-702574089 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79c648af-7dc3-4cd4-9f0b-8c3c355bfbc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:50:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestVolumeBootPattern-volume-origin-1429794902',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c7e08fc1-6ddb-450f-ab86-f1fd8da53a6e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f39c82555704844b062bd9116b8b7df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:50:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:50:01Z,use_quota=True,user_id='71532453450b4f31849b7ac6abc6354c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8bde7129-1dc4-42ab-b852-ab32c61b4921),volume_type_id=8bde7129-1dc4-42ab-b852-ab32c61b4921)' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:50:00 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-0f2ee8dc-30b4-4f15-87a0-2674c5a494e9 tempest-TestVolumeBootPattern-702574089 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (790aadc0-14f9-444e-96ba-29a75864e1e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:50:00 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-0f2ee8dc-30b4-4f15-87a0-2674c5a494e9 tempest-TestVolumeBootPattern-702574089 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (790aadc0-14f9-444e-96ba-29a75864e1e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:50:00 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-0f2ee8dc-30b4-4f15-87a0-2674c5a494e9 tempest-TestVolumeBootPattern-702574089 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf2ab370-2ae4-4581-b4a8-3acf71368848) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:50:00 devstack cinder-volume[88899]: DEBUG cinder.image.glance [None req-0f2ee8dc-30b4-4f15-87a0-2674c5a494e9 tempest-TestVolumeBootPattern-702574089 None] Creating Keystone auth plugin from conf {{(pid=88899) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Aug 03 08:50:01 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-0f2ee8dc-30b4-4f15-87a0-2674c5a494e9 tempest-TestVolumeBootPattern-702574089 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf2ab370-2ae4-4581-b4a8-3acf71368848) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'c7e08fc1-6ddb-450f-ab86-f1fd8da53a6e', 'volume_name': 'volume-c7e08fc1-6ddb-450f-ab86-f1fd8da53a6e', 'volume_size': 1, 'image_id': '37045a76-b9b1-4156-b15f-85c62a8616c3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/37045a76-b9b1-4156-b15f-85c62a8616c3', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'adee82974e9f41769efcb3f4a0eef199', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '37045a76-b9b1-4156-b15f-85c62a8616c3', 'created_at': datetime.datetime(2026, 8, 3, 6, 23, 4, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 3, 6, 23, 6, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/37045a76-b9b1-4156-b15f-85c62a8616c3/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:50:01 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-0f2ee8dc-30b4-4f15-87a0-2674c5a494e9 tempest-TestVolumeBootPattern-702574089 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a28c7749-a006-483d-a718-809415ff63bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:50:01 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-0f2ee8dc-30b4-4f15-87a0-2674c5a494e9 tempest-TestVolumeBootPattern-702574089 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a28c7749-a006-483d-a718-809415ff63bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:50:01 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-0f2ee8dc-30b4-4f15-87a0-2674c5a494e9 tempest-TestVolumeBootPattern-702574089 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3266936-bb59-47d3-abc1-2c6815370dc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:50:01 devstack cinder-volume[88899]: INFO cinder.volume.flows.manager.create_volume [None req-0f2ee8dc-30b4-4f15-87a0-2674c5a494e9 tempest-TestVolumeBootPattern-702574089 None] Volume c7e08fc1-6ddb-450f-ab86-f1fd8da53a6e: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-c7e08fc1-6ddb-450f-ab86-f1fd8da53a6e', 'volume_size': 1, 'image_id': '37045a76-b9b1-4156-b15f-85c62a8616c3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/37045a76-b9b1-4156-b15f-85c62a8616c3', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'adee82974e9f41769efcb3f4a0eef199', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '37045a76-b9b1-4156-b15f-85c62a8616c3', 'created_at': datetime.datetime(2026, 8, 3, 6, 23, 4, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 3, 6, 23, 6, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/37045a76-b9b1-4156-b15f-85c62a8616c3/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Aug 03 08:50:01 devstack cinder-volume[88899]: DEBUG cinder.volume.flows.manager.create_volume [None req-0f2ee8dc-30b4-4f15-87a0-2674c5a494e9 tempest-TestVolumeBootPattern-702574089 None] Trying to clone c7e08fc1-6ddb-450f-ab86-f1fd8da53a6e from image 37045a76-b9b1-4156-b15f-85c62a8616c3 at location (None, [{'url': 'file:///opt/stack/data/glance/images/37045a76-b9b1-4156-b15f-85c62a8616c3', 'metadata': {}}]). {{(pid=88899) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Aug 03 08:50:01 devstack cinder-volume[88899]: DEBUG cinder.image.image_utils [None req-0f2ee8dc-30b4-4f15-87a0-2674c5a494e9 tempest-TestVolumeBootPattern-702574089 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_37045a76-b9b1-4156-b15f-85c62a8616c3_jwka7rhbdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=88899) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Aug 03 08:50:01 devstack cinder-volume[88899]: INFO cinder.image.image_utils [None req-0f2ee8dc-30b4-4f15-87a0-2674c5a494e9 tempest-TestVolumeBootPattern-702574089 None] Image download 20.69 MB at 20.69 MB/s Aug 03 08:50:01 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[31752843-7ff5-452c-9373-4e226b3d9fa7]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:50:01 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-0f2ee8dc-30b4-4f15-87a0-2674c5a494e9 tempest-TestVolumeBootPattern-702574089 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_37045a76-b9b1-4156-b15f-85c62a8616c3_jwka7rhbdevstack@QuobyteHD {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:50:01 devstack sudo[109957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_37045a76-b9b1-4156-b15f-85c62a8616c3_jwka7rhbdevstack@QuobyteHD Aug 03 08:50:01 devstack sudo[109957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:50:01 devstack sudo[109957]: pam_unix(sudo:session): session closed for user root Aug 03 08:50:01 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-0f2ee8dc-30b4-4f15-87a0-2674c5a494e9 tempest-TestVolumeBootPattern-702574089 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_37045a76-b9b1-4156-b15f-85c62a8616c3_jwka7rhbdevstack@QuobyteHD" returned: 0 in 0.315s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:50:01 devstack cinder-volume[88899]: DEBUG cinder.image.image_utils [None req-0f2ee8dc-30b4-4f15-87a0-2674c5a494e9 tempest-TestVolumeBootPattern-702574089 None] Temporary image 37045a76-b9b1-4156-b15f-85c62a8616c3 is fetched for user 71532453450b4f31849b7ac6abc6354c. {{(pid=88899) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Aug 03 08:50:01 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddff0471-c527-4c8b-b9b3-f8e9a8922afe]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:50:01 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-0f2ee8dc-30b4-4f15-87a0-2674c5a494e9 tempest-TestVolumeBootPattern-702574089 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_37045a76-b9b1-4156-b15f-85c62a8616c3_jwka7rhbdevstack@QuobyteHD {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:50:01 devstack sudo[109962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_37045a76-b9b1-4156-b15f-85c62a8616c3_jwka7rhbdevstack@QuobyteHD Aug 03 08:50:01 devstack sudo[109962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:50:02 devstack sudo[109962]: pam_unix(sudo:session): session closed for user root Aug 03 08:50:02 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-0f2ee8dc-30b4-4f15-87a0-2674c5a494e9 tempest-TestVolumeBootPattern-702574089 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_37045a76-b9b1-4156-b15f-85c62a8616c3_jwka7rhbdevstack@QuobyteHD" returned: 0 in 0.312s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:50:02 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-0f2ee8dc-30b4-4f15-87a0-2674c5a494e9 tempest-TestVolumeBootPattern-702574089 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:50:02 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-0f2ee8dc-30b4-4f15-87a0-2674c5a494e9 tempest-TestVolumeBootPattern-702574089 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:50:02 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-0f2ee8dc-30b4-4f15-87a0-2674c5a494e9 tempest-TestVolumeBootPattern-702574089 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:50:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestVolumeBootPattern-volume-origin-1429794902',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c7e08fc1-6ddb-450f-ab86-f1fd8da53a6e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f39c82555704844b062bd9116b8b7df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:50:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:50:01Z,use_quota=True,user_id='71532453450b4f31849b7ac6abc6354c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8bde7129-1dc4-42ab-b852-ab32c61b4921),volume_type_id=8bde7129-1dc4-42ab-b852-ab32c61b4921)}" {{(pid=88899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 08:50:02 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-0f2ee8dc-30b4-4f15-87a0-2674c5a494e9 tempest-TestVolumeBootPattern-702574089 None] Creating volume c7e08fc1-6ddb-450f-ab86-f1fd8da53a6e {{(pid=88899) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 08:50:02 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-0f2ee8dc-30b4-4f15-87a0-2674c5a494e9 tempest-TestVolumeBootPattern-702574089 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:50:02 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-0f2ee8dc-30b4-4f15-87a0-2674c5a494e9 tempest-TestVolumeBootPattern-702574089 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:50:02 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-0f2ee8dc-30b4-4f15-87a0-2674c5a494e9 tempest-TestVolumeBootPattern-702574089 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:50:02 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-0f2ee8dc-30b4-4f15-87a0-2674c5a494e9 tempest-TestVolumeBootPattern-702574089 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:50:02 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-0f2ee8dc-30b4-4f15-87a0-2674c5a494e9 tempest-TestVolumeBootPattern-702574089 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:50:02 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-0f2ee8dc-30b4-4f15-87a0-2674c5a494e9 tempest-TestVolumeBootPattern-702574089 None] Selected osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385 as target Quobyte volume. {{(pid=88899) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 08:50:02 devstack cinder-volume[88899]: INFO cinder.volume.drivers.remotefs [None req-0f2ee8dc-30b4-4f15-87a0-2674c5a494e9 tempest-TestVolumeBootPattern-702574089 None] casted to osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385 Aug 03 08:50:02 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-0f2ee8dc-30b4-4f15-87a0-2674c5a494e9 tempest-TestVolumeBootPattern-702574089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c7e08fc1-6ddb-450f-ab86-f1fd8da53a6e 1073741824 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:50:02 devstack sudo[109967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c7e08fc1-6ddb-450f-ab86-f1fd8da53a6e 1073741824 Aug 03 08:50:02 devstack sudo[109967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:50:02 devstack sudo[109967]: pam_unix(sudo:session): session closed for user root Aug 03 08:50:02 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-0f2ee8dc-30b4-4f15-87a0-2674c5a494e9 tempest-TestVolumeBootPattern-702574089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c7e08fc1-6ddb-450f-ab86-f1fd8da53a6e 1073741824" returned: 0 in 0.393s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:50:02 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-0f2ee8dc-30b4-4f15-87a0-2674c5a494e9 tempest-TestVolumeBootPattern-702574089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c7e08fc1-6ddb-450f-ab86-f1fd8da53a6e {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:50:02 devstack sudo[109972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c7e08fc1-6ddb-450f-ab86-f1fd8da53a6e Aug 03 08:50:02 devstack sudo[109972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:50:02 devstack sudo[109972]: pam_unix(sudo:session): session closed for user root Aug 03 08:50:02 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-0f2ee8dc-30b4-4f15-87a0-2674c5a494e9 tempest-TestVolumeBootPattern-702574089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c7e08fc1-6ddb-450f-ab86-f1fd8da53a6e" returned: 0 in 0.232s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:50:02 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-0f2ee8dc-30b4-4f15-87a0-2674c5a494e9 tempest-TestVolumeBootPattern-702574089 None] <== create_volume: return (665ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'} {{(pid=88899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 08:50:02 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-0f2ee8dc-30b4-4f15-87a0-2674c5a494e9 tempest-TestVolumeBootPattern-702574089 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.668s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:50:02 devstack cinder-volume[88899]: DEBUG cinder.volume.volume_utils [None req-0f2ee8dc-30b4-4f15-87a0-2674c5a494e9 tempest-TestVolumeBootPattern-702574089 None] Attempting download of 37045a76-b9b1-4156-b15f-85c62a8616c3 ((None, [{'url': 'file:///opt/stack/data/glance/images/37045a76-b9b1-4156-b15f-85c62a8616c3', 'metadata': {}}])) to volume c7e08fc1-6ddb-450f-ab86-f1fd8da53a6e. {{(pid=88899) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Aug 03 08:50:02 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[1183ae92-e551-494c-8b46-738ba47e41ca]: (4, 'raw') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:50:02 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-0f2ee8dc-30b4-4f15-87a0-2674c5a494e9 tempest-TestVolumeBootPattern-702574089 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_37045a76-b9b1-4156-b15f-85c62a8616c3_rue2snr7 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:50:02 devstack sudo[109975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_37045a76-b9b1-4156-b15f-85c62a8616c3_rue2snr7 Aug 03 08:50:02 devstack sudo[109975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:50:03 devstack sudo[109975]: pam_unix(sudo:session): session closed for user root Aug 03 08:50:03 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-0f2ee8dc-30b4-4f15-87a0-2674c5a494e9 tempest-TestVolumeBootPattern-702574089 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_37045a76-b9b1-4156-b15f-85c62a8616c3_rue2snr7" returned: 0 in 0.323s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:50:03 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-0f2ee8dc-30b4-4f15-87a0-2674c5a494e9 tempest-TestVolumeBootPattern-702574089 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_37045a76-b9b1-4156-b15f-85c62a8616c3_rue2snr7 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:50:03 devstack sudo[109979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_37045a76-b9b1-4156-b15f-85c62a8616c3_rue2snr7 Aug 03 08:50:03 devstack sudo[109979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:50:03 devstack sudo[109979]: pam_unix(sudo:session): session closed for user root Aug 03 08:50:03 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-0f2ee8dc-30b4-4f15-87a0-2674c5a494e9 tempest-TestVolumeBootPattern-702574089 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_37045a76-b9b1-4156-b15f-85c62a8616c3_rue2snr7" returned: 1 in 0.307s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:50:03 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-0f2ee8dc-30b4-4f15-87a0-2674c5a494e9 tempest-TestVolumeBootPattern-702574089 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_37045a76-b9b1-4156-b15f-85c62a8616c3_rue2snr7' failed. Not Retrying. {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 03 08:50:03 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e9926cb-8e6d-4c5c-8177-a20e4594cf80]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:50:03 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-0f2ee8dc-30b4-4f15-87a0-2674c5a494e9 tempest-TestVolumeBootPattern-702574089 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_37045a76-b9b1-4156-b15f-85c62a8616c3_jwka7rhbdevstack@QuobyteHD {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:50:03 devstack sudo[109983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_37045a76-b9b1-4156-b15f-85c62a8616c3_jwka7rhbdevstack@QuobyteHD Aug 03 08:50:03 devstack sudo[109983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:50:03 devstack sudo[109983]: pam_unix(sudo:session): session closed for user root Aug 03 08:50:03 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-0f2ee8dc-30b4-4f15-87a0-2674c5a494e9 tempest-TestVolumeBootPattern-702574089 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_37045a76-b9b1-4156-b15f-85c62a8616c3_jwka7rhbdevstack@QuobyteHD" returned: 0 in 0.310s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:50:03 devstack cinder-volume[88899]: DEBUG cinder.image.image_utils [None req-0f2ee8dc-30b4-4f15-87a0-2674c5a494e9 tempest-TestVolumeBootPattern-702574089 None] 37045a76-b9b1-4156-b15f-85c62a8616c3 was qcow2, converting to qcow2 {{(pid=88899) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Aug 03 08:50:03 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-0f2ee8dc-30b4-4f15-87a0-2674c5a494e9 tempest-TestVolumeBootPattern-702574089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_37045a76-b9b1-4156-b15f-85c62a8616c3_jwka7rhbdevstack@QuobyteHD /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c7e08fc1-6ddb-450f-ab86-f1fd8da53a6e {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:50:03 devstack sudo[109988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_37045a76-b9b1-4156-b15f-85c62a8616c3_jwka7rhbdevstack@QuobyteHD /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c7e08fc1-6ddb-450f-ab86-f1fd8da53a6e Aug 03 08:50:03 devstack sudo[109988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:50:05 devstack sudo[109988]: pam_unix(sudo:session): session closed for user root Aug 03 08:50:05 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-0f2ee8dc-30b4-4f15-87a0-2674c5a494e9 tempest-TestVolumeBootPattern-702574089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_37045a76-b9b1-4156-b15f-85c62a8616c3_jwka7rhbdevstack@QuobyteHD /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c7e08fc1-6ddb-450f-ab86-f1fd8da53a6e" returned: 0 in 1.627s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:50:05 devstack cinder-volume[88899]: DEBUG cinder.image.image_utils [None req-0f2ee8dc-30b4-4f15-87a0-2674c5a494e9 tempest-TestVolumeBootPattern-702574089 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_37045a76-b9b1-4156-b15f-85c62a8616c3_jwka7rhbdevstack@QuobyteHD, size 112.00 MB, duration 1.63 sec, destination /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c7e08fc1-6ddb-450f-ab86-f1fd8da53a6e {{(pid=88899) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 03 08:50:05 devstack cinder-volume[88899]: INFO cinder.image.image_utils [None req-0f2ee8dc-30b4-4f15-87a0-2674c5a494e9 tempest-TestVolumeBootPattern-702574089 None] Converted 112.00 MB image at 68.77 MB/s Aug 03 08:50:05 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-0f2ee8dc-30b4-4f15-87a0-2674c5a494e9 tempest-TestVolumeBootPattern-702574089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c7e08fc1-6ddb-450f-ab86-f1fd8da53a6e 1G {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:50:05 devstack sudo[110033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c7e08fc1-6ddb-450f-ab86-f1fd8da53a6e 1G Aug 03 08:50:05 devstack sudo[110033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:50:05 devstack sudo[110033]: pam_unix(sudo:session): session closed for user root Aug 03 08:50:05 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-0f2ee8dc-30b4-4f15-87a0-2674c5a494e9 tempest-TestVolumeBootPattern-702574089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c7e08fc1-6ddb-450f-ab86-f1fd8da53a6e 1G" returned: 0 in 0.337s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:50:05 devstack cinder-volume[88899]: DEBUG cinder.volume.volume_utils [None req-0f2ee8dc-30b4-4f15-87a0-2674c5a494e9 tempest-TestVolumeBootPattern-702574089 None] Downloaded image 37045a76-b9b1-4156-b15f-85c62a8616c3 ((None, [{'url': 'file:///opt/stack/data/glance/images/37045a76-b9b1-4156-b15f-85c62a8616c3', 'metadata': {}}])) to volume c7e08fc1-6ddb-450f-ab86-f1fd8da53a6e successfully. {{(pid=88899) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Aug 03 08:50:05 devstack cinder-volume[88899]: DEBUG cinder.image.image_utils [None req-0f2ee8dc-30b4-4f15-87a0-2674c5a494e9 tempest-TestVolumeBootPattern-702574089 None] Temporary image 37045a76-b9b1-4156-b15f-85c62a8616c3 for user 71532453450b4f31849b7ac6abc6354c is deleted. {{(pid=88899) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Aug 03 08:50:05 devstack cinder-volume[88899]: DEBUG cinder.volume.volume_utils [None req-0f2ee8dc-30b4-4f15-87a0-2674c5a494e9 tempest-TestVolumeBootPattern-702574089 None] Marking volume c7e08fc1-6ddb-450f-ab86-f1fd8da53a6e as bootable. {{(pid=88899) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Aug 03 08:50:05 devstack cinder-volume[88899]: DEBUG cinder.volume.flows.manager.create_volume [None req-0f2ee8dc-30b4-4f15-87a0-2674c5a494e9 tempest-TestVolumeBootPattern-702574089 None] Copying metadata from image 37045a76-b9b1-4156-b15f-85c62a8616c3 to c7e08fc1-6ddb-450f-ab86-f1fd8da53a6e. {{(pid=88899) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Aug 03 08:50:05 devstack cinder-volume[88899]: DEBUG cinder.volume.flows.manager.create_volume [None req-0f2ee8dc-30b4-4f15-87a0-2674c5a494e9 tempest-TestVolumeBootPattern-702574089 None] Creating volume glance metadata for volume c7e08fc1-6ddb-450f-ab86-f1fd8da53a6e backed by image 37045a76-b9b1-4156-b15f-85c62a8616c3 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '37045a76-b9b1-4156-b15f-85c62a8616c3', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=88899) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Aug 03 08:50:05 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-0f2ee8dc-30b4-4f15-87a0-2674c5a494e9 tempest-TestVolumeBootPattern-702574089 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3266936-bb59-47d3-abc1-2c6815370dc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c7e08fc1-6ddb-450f-ab86-f1fd8da53a6e', 'volume_size': 1, 'image_id': '37045a76-b9b1-4156-b15f-85c62a8616c3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/37045a76-b9b1-4156-b15f-85c62a8616c3', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'adee82974e9f41769efcb3f4a0eef199', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '37045a76-b9b1-4156-b15f-85c62a8616c3', 'created_at': datetime.datetime(2026, 8, 3, 6, 23, 4, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 3, 6, 23, 6, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/37045a76-b9b1-4156-b15f-85c62a8616c3/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:50:05 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-0f2ee8dc-30b4-4f15-87a0-2674c5a494e9 tempest-TestVolumeBootPattern-702574089 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f6fc413-c26f-4d57-b6ad-d6e0ef622282) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:50:05 devstack cinder-volume[88899]: INFO cinder.volume.flows.manager.create_volume [None req-0f2ee8dc-30b4-4f15-87a0-2674c5a494e9 tempest-TestVolumeBootPattern-702574089 None] Volume volume-c7e08fc1-6ddb-450f-ab86-f1fd8da53a6e (c7e08fc1-6ddb-450f-ab86-f1fd8da53a6e): created successfully Aug 03 08:50:05 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-0f2ee8dc-30b4-4f15-87a0-2674c5a494e9 tempest-TestVolumeBootPattern-702574089 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f6fc413-c26f-4d57-b6ad-d6e0ef622282) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:50:05 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-0f2ee8dc-30b4-4f15-87a0-2674c5a494e9 tempest-TestVolumeBootPattern-702574089 None] Flow 'volume_create_manager' (beece2fc-b86c-46b0-a67f-4eac6af78811) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:50:05 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-0f2ee8dc-30b4-4f15-87a0-2674c5a494e9 tempest-TestVolumeBootPattern-702574089 None] Created volume successfully. Aug 03 08:50:10 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [req-417e2542-0ad2-4767-a7b2-4afdd635e972 req-df652d63-9fec-4e33-877a-d5c5eed03593 tempest-TestVolumeBootPattern-702574089 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:50:10 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [req-417e2542-0ad2-4767-a7b2-4afdd635e972 req-df652d63-9fec-4e33-877a-d5c5eed03593 tempest-TestVolumeBootPattern-702574089 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:50:10 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [req-417e2542-0ad2-4767-a7b2-4afdd635e972 req-df652d63-9fec-4e33-877a-d5c5eed03593 tempest-TestVolumeBootPattern-702574089 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.014s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:50:10 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [req-417e2542-0ad2-4767-a7b2-4afdd635e972 req-df652d63-9fec-4e33-877a-d5c5eed03593 tempest-TestVolumeBootPattern-702574089 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385', 'name': 'volume-c7e08fc1-6ddb-450f-ab86-f1fd8da53a6e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a3e693b6-4400-45c0-8226-60cc86d2b1a8', 'enforce_multipath': True} {{(pid=88899) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 03 08:50:10 devstack cinder-volume[88899]: INFO cinder.volume.manager [req-417e2542-0ad2-4767-a7b2-4afdd635e972 req-df652d63-9fec-4e33-877a-d5c5eed03593 tempest-TestVolumeBootPattern-702574089 None] attachment_update completed successfully. Aug 03 08:50:20 devstack cinder-volume[88899]: DEBUG dbcounter [-] [88899] Writing DB stats cinder:SELECT=17,cinder:INSERT=7,cinder:UPDATE=7 {{(pid=88899) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 03 08:50:20 devstack cinder-volume[88899]: DEBUG dbcounter [-] [88899] Writing DB stats cinder:UPDATE=5,cinder:SELECT=15,cinder:INSERT=7,cinder:DELETE=1 {{(pid=88899) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 03 08:50:39 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-7291e8a7-31dc-4441-a933-5b45e1ecf54d tempest-TestVolumeBootPattern-702574089 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:50:39 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-7291e8a7-31dc-4441-a933-5b45e1ecf54d tempest-TestVolumeBootPattern-702574089 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:50:39 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-7291e8a7-31dc-4441-a933-5b45e1ecf54d tempest-TestVolumeBootPattern-702574089 None] Creating online snapshot 7328475d-cec1-4dad-a3d8-ce366fceaff9 of volume c7e08fc1-6ddb-450f-ab86-f1fd8da53a6e {{(pid=88899) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 03 08:50:39 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[118595fd-7bbe-47da-85f2-b53b470be876]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:50:39 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-7291e8a7-31dc-4441-a933-5b45e1ecf54d tempest-TestVolumeBootPattern-702574089 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c7e08fc1-6ddb-450f-ab86-f1fd8da53a6e {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:50:39 devstack sudo[110569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c7e08fc1-6ddb-450f-ab86-f1fd8da53a6e Aug 03 08:50:39 devstack sudo[110569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:50:39 devstack sudo[110569]: pam_unix(sudo:session): session closed for user root Aug 03 08:50:39 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-7291e8a7-31dc-4441-a933-5b45e1ecf54d tempest-TestVolumeBootPattern-702574089 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c7e08fc1-6ddb-450f-ab86-f1fd8da53a6e" returned: 0 in 0.340s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:50:39 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-7291e8a7-31dc-4441-a933-5b45e1ecf54d tempest-TestVolumeBootPattern-702574089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c7e08fc1-6ddb-450f-ab86-f1fd8da53a6e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c7e08fc1-6ddb-450f-ab86-f1fd8da53a6e.7328475d-cec1-4dad-a3d8-ce366fceaff9 1G {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:50:39 devstack sudo[110574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c7e08fc1-6ddb-450f-ab86-f1fd8da53a6e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c7e08fc1-6ddb-450f-ab86-f1fd8da53a6e.7328475d-cec1-4dad-a3d8-ce366fceaff9 1G Aug 03 08:50:39 devstack sudo[110574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:50:39 devstack sudo[110574]: pam_unix(sudo:session): session closed for user root Aug 03 08:50:39 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-7291e8a7-31dc-4441-a933-5b45e1ecf54d tempest-TestVolumeBootPattern-702574089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c7e08fc1-6ddb-450f-ab86-f1fd8da53a6e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c7e08fc1-6ddb-450f-ab86-f1fd8da53a6e.7328475d-cec1-4dad-a3d8-ce366fceaff9 1G" returned: 0 in 0.387s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:50:39 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-7291e8a7-31dc-4441-a933-5b45e1ecf54d tempest-TestVolumeBootPattern-702574089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c7e08fc1-6ddb-450f-ab86-f1fd8da53a6e -F qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c7e08fc1-6ddb-450f-ab86-f1fd8da53a6e.7328475d-cec1-4dad-a3d8-ce366fceaff9 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:50:39 devstack sudo[110580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c7e08fc1-6ddb-450f-ab86-f1fd8da53a6e -F qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c7e08fc1-6ddb-450f-ab86-f1fd8da53a6e.7328475d-cec1-4dad-a3d8-ce366fceaff9 Aug 03 08:50:39 devstack sudo[110580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:50:40 devstack sudo[110580]: pam_unix(sudo:session): session closed for user root Aug 03 08:50:40 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-7291e8a7-31dc-4441-a933-5b45e1ecf54d tempest-TestVolumeBootPattern-702574089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c7e08fc1-6ddb-450f-ab86-f1fd8da53a6e -F qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c7e08fc1-6ddb-450f-ab86-f1fd8da53a6e.7328475d-cec1-4dad-a3d8-ce366fceaff9" returned: 0 in 0.284s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:50:40 devstack cinder-volume[88899]: WARNING cinder.volume.drivers.remotefs [None req-7291e8a7-31dc-4441-a933-5b45e1ecf54d tempest-TestVolumeBootPattern-702574089 None] /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c7e08fc1-6ddb-450f-ab86-f1fd8da53a6e.7328475d-cec1-4dad-a3d8-ce366fceaff9 is being set with open permissions: ugo+rw Aug 03 08:50:40 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-7291e8a7-31dc-4441-a933-5b45e1ecf54d tempest-TestVolumeBootPattern-702574089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c7e08fc1-6ddb-450f-ab86-f1fd8da53a6e.7328475d-cec1-4dad-a3d8-ce366fceaff9 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:50:40 devstack sudo[110586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c7e08fc1-6ddb-450f-ab86-f1fd8da53a6e.7328475d-cec1-4dad-a3d8-ce366fceaff9 Aug 03 08:50:40 devstack sudo[110586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:50:40 devstack sudo[110586]: pam_unix(sudo:session): session closed for user root Aug 03 08:50:40 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-7291e8a7-31dc-4441-a933-5b45e1ecf54d tempest-TestVolumeBootPattern-702574089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c7e08fc1-6ddb-450f-ab86-f1fd8da53a6e.7328475d-cec1-4dad-a3d8-ce366fceaff9" returned: 0 in 0.229s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:50:40 devstack cinder-volume[88899]: DEBUG cinder.compute.nova [None req-7291e8a7-31dc-4441-a933-5b45e1ecf54d tempest-TestVolumeBootPattern-702574089 None] Creating Keystone auth plugin from conf {{(pid=88899) novaclient /opt/stack/cinder/cinder/compute/nova.py:99}} Aug 03 08:50:40 devstack cinder-volume[88899]: DEBUG novaclient.v2.client [None req-7291e8a7-31dc-4441-a933-5b45e1ecf54d tempest-TestVolumeBootPattern-702574089 None] REQ: curl -g -i -X POST http://192.168.122.55/compute/v2.1/os-assisted-volume-snapshots -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}346c5cb0e184e64543110bc3d646f4346c77c4b7cf1f89815820ee691e964865" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-7291e8a7-31dc-4441-a933-5b45e1ecf54d" -H "X-Service-Token: {SHA256}c96e034f4f8a4d16079c50f41a6bc99d8f702fc5a9a0d1604994b54ce68306ce" -d '{"snapshot": {"volume_id": "c7e08fc1-6ddb-450f-ab86-f1fd8da53a6e", "create_info": {"type": "qcow2", "new_file": "volume-c7e08fc1-6ddb-450f-ab86-f1fd8da53a6e.7328475d-cec1-4dad-a3d8-ce366fceaff9", "snapshot_id": "7328475d-cec1-4dad-a3d8-ce366fceaff9"}}}' {{(pid=88899) _http_log_request /opt/stack/data/venv/lib/python3.12/site-packages/keystoneauth1/session.py:575}} Aug 03 08:50:40 devstack cinder-volume[88899]: DEBUG novaclient.v2.client [None req-7291e8a7-31dc-4441-a933-5b45e1ecf54d tempest-TestVolumeBootPattern-702574089 None] RESP: [200] Connection: close Content-Length: 78 Content-Type: application/json Date: Mon, 03 Aug 2026 06:50:40 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.58 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-130c9f6e-dcc9-4755-afba-4a7aef566f75 x-openstack-request-id: req-130c9f6e-dcc9-4755-afba-4a7aef566f75 {{(pid=88899) _http_log_response /opt/stack/data/venv/lib/python3.12/site-packages/keystoneauth1/session.py:616}} Aug 03 08:50:40 devstack cinder-volume[88899]: DEBUG novaclient.v2.client [None req-7291e8a7-31dc-4441-a933-5b45e1ecf54d tempest-TestVolumeBootPattern-702574089 None] RESP BODY: {"snapshot": {"id": null, "volumeId": "c7e08fc1-6ddb-450f-ab86-f1fd8da53a6e"}} {{(pid=88899) _http_log_response /opt/stack/data/venv/lib/python3.12/site-packages/keystoneauth1/session.py:651}} Aug 03 08:50:40 devstack cinder-volume[88899]: DEBUG novaclient.v2.client [None req-7291e8a7-31dc-4441-a933-5b45e1ecf54d tempest-TestVolumeBootPattern-702574089 None] POST call to compute for http://192.168.122.55/compute/v2.1/os-assisted-volume-snapshots used request id req-130c9f6e-dcc9-4755-afba-4a7aef566f75 {{(pid=88899) request /opt/stack/data/venv/lib/python3.12/site-packages/keystoneauth1/session.py:1076}} Aug 03 08:50:40 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-7291e8a7-31dc-4441-a933-5b45e1ecf54d tempest-TestVolumeBootPattern-702574089 None] nova call result: None {{(pid=88899) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1910}} Aug 03 08:50:40 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-7291e8a7-31dc-4441-a933-5b45e1ecf54d tempest-TestVolumeBootPattern-702574089 None] Status of snapshot 7328475d-cec1-4dad-a3d8-ce366fceaff9 is now creating {{(pid=88899) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Aug 03 08:50:41 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-7291e8a7-31dc-4441-a933-5b45e1ecf54d tempest-TestVolumeBootPattern-702574089 None] Status of snapshot 7328475d-cec1-4dad-a3d8-ce366fceaff9 is now creating {{(pid=88899) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Aug 03 08:50:42 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-7291e8a7-31dc-4441-a933-5b45e1ecf54d tempest-TestVolumeBootPattern-702574089 None] Status of snapshot 7328475d-cec1-4dad-a3d8-ce366fceaff9 is now creating {{(pid=88899) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Aug 03 08:50:43 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-7291e8a7-31dc-4441-a933-5b45e1ecf54d tempest-TestVolumeBootPattern-702574089 None] Status of snapshot 7328475d-cec1-4dad-a3d8-ce366fceaff9 is now creating {{(pid=88899) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Aug 03 08:50:44 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-7291e8a7-31dc-4441-a933-5b45e1ecf54d tempest-TestVolumeBootPattern-702574089 None] Status of snapshot 7328475d-cec1-4dad-a3d8-ce366fceaff9 is now creating {{(pid=88899) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Aug 03 08:50:45 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-7291e8a7-31dc-4441-a933-5b45e1ecf54d tempest-TestVolumeBootPattern-702574089 None] Status of snapshot 7328475d-cec1-4dad-a3d8-ce366fceaff9 is now creating {{(pid=88899) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Aug 03 08:50:46 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-7291e8a7-31dc-4441-a933-5b45e1ecf54d tempest-TestVolumeBootPattern-702574089 None] Status of snapshot 7328475d-cec1-4dad-a3d8-ce366fceaff9 is now creating {{(pid=88899) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Aug 03 08:50:47 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-7291e8a7-31dc-4441-a933-5b45e1ecf54d tempest-TestVolumeBootPattern-702574089 None] Status of snapshot 7328475d-cec1-4dad-a3d8-ce366fceaff9 is now creating {{(pid=88899) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Aug 03 08:50:48 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-7291e8a7-31dc-4441-a933-5b45e1ecf54d tempest-TestVolumeBootPattern-702574089 None] Status of snapshot 7328475d-cec1-4dad-a3d8-ce366fceaff9 is now creating {{(pid=88899) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Aug 03 08:50:49 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-7291e8a7-31dc-4441-a933-5b45e1ecf54d tempest-TestVolumeBootPattern-702574089 None] Status of snapshot 7328475d-cec1-4dad-a3d8-ce366fceaff9 is now creating {{(pid=88899) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Aug 03 08:50:50 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-7291e8a7-31dc-4441-a933-5b45e1ecf54d tempest-TestVolumeBootPattern-702574089 None] Status of snapshot 7328475d-cec1-4dad-a3d8-ce366fceaff9 is now creating {{(pid=88899) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Aug 03 08:50:51 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-7291e8a7-31dc-4441-a933-5b45e1ecf54d tempest-TestVolumeBootPattern-702574089 None] Status of snapshot 7328475d-cec1-4dad-a3d8-ce366fceaff9 is now creating {{(pid=88899) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Aug 03 08:50:51 devstack cinder-volume[88899]: DEBUG oslo_service.periodic_task [None req-f948fb4a-c4d7-499f-b1bd-8d6be3de0b53 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88899) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 03 08:50:51 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-f948fb4a-c4d7-499f-b1bd-8d6be3de0b53 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:50:51 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-f948fb4a-c4d7-499f-b1bd-8d6be3de0b53 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:50:51 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-f948fb4a-c4d7-499f-b1bd-8d6be3de0b53 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:50:51 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-f948fb4a-c4d7-499f-b1bd-8d6be3de0b53 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:50:51 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-f948fb4a-c4d7-499f-b1bd-8d6be3de0b53 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:50:51 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-f948fb4a-c4d7-499f-b1bd-8d6be3de0b53 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:50:51 devstack sudo[110595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a Aug 03 08:50:51 devstack sudo[110595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:50:52 devstack sudo[110595]: pam_unix(sudo:session): session closed for user root Aug 03 08:50:52 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-f948fb4a-c4d7-499f-b1bd-8d6be3de0b53 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a" returned: 0 in 0.251s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:50:52 devstack cinder-volume[88899]: DEBUG cinder.manager [None req-f948fb4a-c4d7-499f-b1bd-8d6be3de0b53 None None] Notifying Schedulers of capabilities ... {{(pid=88899) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 08:50:52 devstack cinder-volume[88899]: DEBUG oslo_service.periodic_task [None req-f948fb4a-c4d7-499f-b1bd-8d6be3de0b53 None None] Running periodic task VolumeManager._thread_info {{(pid=88899) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 03 08:50:52 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-f948fb4a-c4d7-499f-b1bd-8d6be3de0b53 None None] thread count: 29 {{(pid=88899) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 03 08:50:52 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-f948fb4a-c4d7-499f-b1bd-8d6be3de0b53 None None] thread info: [<_MainThread(MainThread, started 132234320248960)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88899) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 03 08:50:53 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-7291e8a7-31dc-4441-a933-5b45e1ecf54d tempest-TestVolumeBootPattern-702574089 None] Status of snapshot 7328475d-cec1-4dad-a3d8-ce366fceaff9 is now creating {{(pid=88899) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Aug 03 08:50:55 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-7291e8a7-31dc-4441-a933-5b45e1ecf54d tempest-TestVolumeBootPattern-702574089 None] Status of snapshot 7328475d-cec1-4dad-a3d8-ce366fceaff9 is now creating {{(pid=88899) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Aug 03 08:50:55 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-7291e8a7-31dc-4441-a933-5b45e1ecf54d tempest-TestVolumeBootPattern-702574089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c7e08fc1-6ddb-450f-ab86-f1fd8da53a6e.info {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:50:55 devstack sudo[110599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c7e08fc1-6ddb-450f-ab86-f1fd8da53a6e.info Aug 03 08:50:55 devstack sudo[110599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:50:56 devstack sudo[110599]: pam_unix(sudo:session): session closed for user root Aug 03 08:50:56 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-7291e8a7-31dc-4441-a933-5b45e1ecf54d tempest-TestVolumeBootPattern-702574089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c7e08fc1-6ddb-450f-ab86-f1fd8da53a6e.info" returned: 0 in 0.242s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:50:56 devstack cinder-volume[88899]: WARNING cinder.volume.drivers.remotefs [None req-7291e8a7-31dc-4441-a933-5b45e1ecf54d tempest-TestVolumeBootPattern-702574089 None] /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c7e08fc1-6ddb-450f-ab86-f1fd8da53a6e.info is being set with open permissions: ugo+rw Aug 03 08:50:56 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-7291e8a7-31dc-4441-a933-5b45e1ecf54d tempest-TestVolumeBootPattern-702574089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c7e08fc1-6ddb-450f-ab86-f1fd8da53a6e.info {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:50:56 devstack sudo[110602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c7e08fc1-6ddb-450f-ab86-f1fd8da53a6e.info Aug 03 08:50:56 devstack sudo[110602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:50:56 devstack sudo[110602]: pam_unix(sudo:session): session closed for user root Aug 03 08:50:56 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-7291e8a7-31dc-4441-a933-5b45e1ecf54d tempest-TestVolumeBootPattern-702574089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c7e08fc1-6ddb-450f-ab86-f1fd8da53a6e.info" returned: 0 in 0.242s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:50:56 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-7291e8a7-31dc-4441-a933-5b45e1ecf54d tempest-TestVolumeBootPattern-702574089 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 17.259s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:50:56 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-7291e8a7-31dc-4441-a933-5b45e1ecf54d tempest-TestVolumeBootPattern-702574089 None] Create snapshot completed successfully Aug 03 08:50:56 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-499929ae-900d-498e-b831-5c72a754ee2d tempest-TestVolumeBootPattern-702574089 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:50:56 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-499929ae-900d-498e-b831-5c72a754ee2d tempest-TestVolumeBootPattern-702574089 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:50:56 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-499929ae-900d-498e-b831-5c72a754ee2d tempest-TestVolumeBootPattern-702574089 None] Creating online snapshot f8653d6d-3ac7-4bbe-bc57-33463f8461e9 of volume c7e08fc1-6ddb-450f-ab86-f1fd8da53a6e {{(pid=88899) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 03 08:50:56 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5a62911-8560-4d89-b793-6631baf319f2]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:50:56 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-499929ae-900d-498e-b831-5c72a754ee2d tempest-TestVolumeBootPattern-702574089 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c7e08fc1-6ddb-450f-ab86-f1fd8da53a6e.7328475d-cec1-4dad-a3d8-ce366fceaff9 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:50:57 devstack sudo[110605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c7e08fc1-6ddb-450f-ab86-f1fd8da53a6e.7328475d-cec1-4dad-a3d8-ce366fceaff9 Aug 03 08:50:57 devstack sudo[110605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:50:57 devstack sudo[110605]: pam_unix(sudo:session): session closed for user root Aug 03 08:50:57 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-499929ae-900d-498e-b831-5c72a754ee2d tempest-TestVolumeBootPattern-702574089 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c7e08fc1-6ddb-450f-ab86-f1fd8da53a6e.7328475d-cec1-4dad-a3d8-ce366fceaff9" returned: 0 in 0.367s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:50:57 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-499929ae-900d-498e-b831-5c72a754ee2d tempest-TestVolumeBootPattern-702574089 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c7e08fc1-6ddb-450f-ab86-f1fd8da53a6e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88899) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 03 08:50:57 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-499929ae-900d-498e-b831-5c72a754ee2d tempest-TestVolumeBootPattern-702574089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c7e08fc1-6ddb-450f-ab86-f1fd8da53a6e.7328475d-cec1-4dad-a3d8-ce366fceaff9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c7e08fc1-6ddb-450f-ab86-f1fd8da53a6e.f8653d6d-3ac7-4bbe-bc57-33463f8461e9 1G {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:50:57 devstack sudo[110610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c7e08fc1-6ddb-450f-ab86-f1fd8da53a6e.7328475d-cec1-4dad-a3d8-ce366fceaff9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c7e08fc1-6ddb-450f-ab86-f1fd8da53a6e.f8653d6d-3ac7-4bbe-bc57-33463f8461e9 1G Aug 03 08:50:57 devstack sudo[110610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:50:57 devstack sudo[110610]: pam_unix(sudo:session): session closed for user root Aug 03 08:50:57 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-499929ae-900d-498e-b831-5c72a754ee2d tempest-TestVolumeBootPattern-702574089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c7e08fc1-6ddb-450f-ab86-f1fd8da53a6e.7328475d-cec1-4dad-a3d8-ce366fceaff9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c7e08fc1-6ddb-450f-ab86-f1fd8da53a6e.f8653d6d-3ac7-4bbe-bc57-33463f8461e9 1G" returned: 0 in 0.449s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:50:57 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-499929ae-900d-498e-b831-5c72a754ee2d tempest-TestVolumeBootPattern-702574089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c7e08fc1-6ddb-450f-ab86-f1fd8da53a6e.7328475d-cec1-4dad-a3d8-ce366fceaff9 -F qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c7e08fc1-6ddb-450f-ab86-f1fd8da53a6e.f8653d6d-3ac7-4bbe-bc57-33463f8461e9 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:50:57 devstack sudo[110618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c7e08fc1-6ddb-450f-ab86-f1fd8da53a6e.7328475d-cec1-4dad-a3d8-ce366fceaff9 -F qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c7e08fc1-6ddb-450f-ab86-f1fd8da53a6e.f8653d6d-3ac7-4bbe-bc57-33463f8461e9 Aug 03 08:50:57 devstack sudo[110618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:50:58 devstack sudo[110618]: pam_unix(sudo:session): session closed for user root Aug 03 08:50:58 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-499929ae-900d-498e-b831-5c72a754ee2d tempest-TestVolumeBootPattern-702574089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c7e08fc1-6ddb-450f-ab86-f1fd8da53a6e.7328475d-cec1-4dad-a3d8-ce366fceaff9 -F qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c7e08fc1-6ddb-450f-ab86-f1fd8da53a6e.f8653d6d-3ac7-4bbe-bc57-33463f8461e9" returned: 0 in 0.289s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:50:58 devstack cinder-volume[88899]: WARNING cinder.volume.drivers.remotefs [None req-499929ae-900d-498e-b831-5c72a754ee2d tempest-TestVolumeBootPattern-702574089 None] /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c7e08fc1-6ddb-450f-ab86-f1fd8da53a6e.f8653d6d-3ac7-4bbe-bc57-33463f8461e9 is being set with open permissions: ugo+rw Aug 03 08:50:58 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-499929ae-900d-498e-b831-5c72a754ee2d tempest-TestVolumeBootPattern-702574089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c7e08fc1-6ddb-450f-ab86-f1fd8da53a6e.f8653d6d-3ac7-4bbe-bc57-33463f8461e9 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:50:58 devstack sudo[110623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c7e08fc1-6ddb-450f-ab86-f1fd8da53a6e.f8653d6d-3ac7-4bbe-bc57-33463f8461e9 Aug 03 08:50:58 devstack sudo[110623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:50:58 devstack sudo[110623]: pam_unix(sudo:session): session closed for user root Aug 03 08:50:58 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-499929ae-900d-498e-b831-5c72a754ee2d tempest-TestVolumeBootPattern-702574089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c7e08fc1-6ddb-450f-ab86-f1fd8da53a6e.f8653d6d-3ac7-4bbe-bc57-33463f8461e9" returned: 0 in 0.261s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:50:58 devstack cinder-volume[88899]: DEBUG cinder.compute.nova [None req-499929ae-900d-498e-b831-5c72a754ee2d tempest-TestVolumeBootPattern-702574089 None] Creating Keystone auth plugin from conf {{(pid=88899) novaclient /opt/stack/cinder/cinder/compute/nova.py:99}} Aug 03 08:50:58 devstack cinder-volume[88899]: DEBUG novaclient.v2.client [None req-499929ae-900d-498e-b831-5c72a754ee2d tempest-TestVolumeBootPattern-702574089 None] REQ: curl -g -i -X POST http://192.168.122.55/compute/v2.1/os-assisted-volume-snapshots -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}65fabd26bc9e639b44408269d20ed2d4be039ac2de2079e56d72dbfb94120209" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-499929ae-900d-498e-b831-5c72a754ee2d" -H "X-Service-Token: {SHA256}c96e034f4f8a4d16079c50f41a6bc99d8f702fc5a9a0d1604994b54ce68306ce" -d '{"snapshot": {"volume_id": "c7e08fc1-6ddb-450f-ab86-f1fd8da53a6e", "create_info": {"type": "qcow2", "new_file": "volume-c7e08fc1-6ddb-450f-ab86-f1fd8da53a6e.f8653d6d-3ac7-4bbe-bc57-33463f8461e9", "snapshot_id": "f8653d6d-3ac7-4bbe-bc57-33463f8461e9"}}}' {{(pid=88899) _http_log_request /opt/stack/data/venv/lib/python3.12/site-packages/keystoneauth1/session.py:575}} Aug 03 08:50:58 devstack cinder-volume[88899]: DEBUG novaclient.v2.client [None req-499929ae-900d-498e-b831-5c72a754ee2d tempest-TestVolumeBootPattern-702574089 None] RESP: [200] Connection: close Content-Length: 78 Content-Type: application/json Date: Mon, 03 Aug 2026 06:50:58 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.58 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-a28c3e45-cbd1-40ff-a601-228a6e6c0341 x-openstack-request-id: req-a28c3e45-cbd1-40ff-a601-228a6e6c0341 {{(pid=88899) _http_log_response /opt/stack/data/venv/lib/python3.12/site-packages/keystoneauth1/session.py:616}} Aug 03 08:50:58 devstack cinder-volume[88899]: DEBUG novaclient.v2.client [None req-499929ae-900d-498e-b831-5c72a754ee2d tempest-TestVolumeBootPattern-702574089 None] RESP BODY: {"snapshot": {"id": null, "volumeId": "c7e08fc1-6ddb-450f-ab86-f1fd8da53a6e"}} {{(pid=88899) _http_log_response /opt/stack/data/venv/lib/python3.12/site-packages/keystoneauth1/session.py:651}} Aug 03 08:50:58 devstack cinder-volume[88899]: DEBUG novaclient.v2.client [None req-499929ae-900d-498e-b831-5c72a754ee2d tempest-TestVolumeBootPattern-702574089 None] POST call to compute for http://192.168.122.55/compute/v2.1/os-assisted-volume-snapshots used request id req-a28c3e45-cbd1-40ff-a601-228a6e6c0341 {{(pid=88899) request /opt/stack/data/venv/lib/python3.12/site-packages/keystoneauth1/session.py:1076}} Aug 03 08:50:58 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-499929ae-900d-498e-b831-5c72a754ee2d tempest-TestVolumeBootPattern-702574089 None] nova call result: None {{(pid=88899) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1910}} Aug 03 08:50:58 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-499929ae-900d-498e-b831-5c72a754ee2d tempest-TestVolumeBootPattern-702574089 None] Status of snapshot f8653d6d-3ac7-4bbe-bc57-33463f8461e9 is now creating {{(pid=88899) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Aug 03 08:50:59 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-499929ae-900d-498e-b831-5c72a754ee2d tempest-TestVolumeBootPattern-702574089 None] Status of snapshot f8653d6d-3ac7-4bbe-bc57-33463f8461e9 is now creating {{(pid=88899) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Aug 03 08:51:00 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-499929ae-900d-498e-b831-5c72a754ee2d tempest-TestVolumeBootPattern-702574089 None] Status of snapshot f8653d6d-3ac7-4bbe-bc57-33463f8461e9 is now creating {{(pid=88899) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Aug 03 08:51:01 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-499929ae-900d-498e-b831-5c72a754ee2d tempest-TestVolumeBootPattern-702574089 None] Status of snapshot f8653d6d-3ac7-4bbe-bc57-33463f8461e9 is now creating {{(pid=88899) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Aug 03 08:51:02 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-499929ae-900d-498e-b831-5c72a754ee2d tempest-TestVolumeBootPattern-702574089 None] Status of snapshot f8653d6d-3ac7-4bbe-bc57-33463f8461e9 is now creating {{(pid=88899) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Aug 03 08:51:03 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-499929ae-900d-498e-b831-5c72a754ee2d tempest-TestVolumeBootPattern-702574089 None] Status of snapshot f8653d6d-3ac7-4bbe-bc57-33463f8461e9 is now creating {{(pid=88899) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Aug 03 08:51:04 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-499929ae-900d-498e-b831-5c72a754ee2d tempest-TestVolumeBootPattern-702574089 None] Status of snapshot f8653d6d-3ac7-4bbe-bc57-33463f8461e9 is now creating {{(pid=88899) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Aug 03 08:51:05 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-499929ae-900d-498e-b831-5c72a754ee2d tempest-TestVolumeBootPattern-702574089 None] Status of snapshot f8653d6d-3ac7-4bbe-bc57-33463f8461e9 is now creating {{(pid=88899) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Aug 03 08:51:06 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-499929ae-900d-498e-b831-5c72a754ee2d tempest-TestVolumeBootPattern-702574089 None] Status of snapshot f8653d6d-3ac7-4bbe-bc57-33463f8461e9 is now creating {{(pid=88899) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Aug 03 08:51:07 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-499929ae-900d-498e-b831-5c72a754ee2d tempest-TestVolumeBootPattern-702574089 None] Status of snapshot f8653d6d-3ac7-4bbe-bc57-33463f8461e9 is now creating {{(pid=88899) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Aug 03 08:51:08 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-499929ae-900d-498e-b831-5c72a754ee2d tempest-TestVolumeBootPattern-702574089 None] Status of snapshot f8653d6d-3ac7-4bbe-bc57-33463f8461e9 is now creating {{(pid=88899) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Aug 03 08:51:09 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-499929ae-900d-498e-b831-5c72a754ee2d tempest-TestVolumeBootPattern-702574089 None] Status of snapshot f8653d6d-3ac7-4bbe-bc57-33463f8461e9 is now creating {{(pid=88899) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Aug 03 08:51:11 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-499929ae-900d-498e-b831-5c72a754ee2d tempest-TestVolumeBootPattern-702574089 None] Status of snapshot f8653d6d-3ac7-4bbe-bc57-33463f8461e9 is now creating {{(pid=88899) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Aug 03 08:51:13 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-499929ae-900d-498e-b831-5c72a754ee2d tempest-TestVolumeBootPattern-702574089 None] Status of snapshot f8653d6d-3ac7-4bbe-bc57-33463f8461e9 is now creating {{(pid=88899) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Aug 03 08:51:15 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-499929ae-900d-498e-b831-5c72a754ee2d tempest-TestVolumeBootPattern-702574089 None] Status of snapshot f8653d6d-3ac7-4bbe-bc57-33463f8461e9 is now creating {{(pid=88899) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Aug 03 08:51:15 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-499929ae-900d-498e-b831-5c72a754ee2d tempest-TestVolumeBootPattern-702574089 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 18.834s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:51:15 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-499929ae-900d-498e-b831-5c72a754ee2d tempest-TestVolumeBootPattern-702574089 None] Create snapshot completed successfully Aug 03 08:51:16 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-2977d46d-70f6-4211-86ff-67933d24a859 tempest-TestVolumeBootPattern-702574089 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:51:16 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-2977d46d-70f6-4211-86ff-67933d24a859 tempest-TestVolumeBootPattern-702574089 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:51:16 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-2977d46d-70f6-4211-86ff-67933d24a859 tempest-TestVolumeBootPattern-702574089 None] Creating online snapshot db23ec62-02b0-43b4-b5aa-1d08ee550ea7 of volume c7e08fc1-6ddb-450f-ab86-f1fd8da53a6e {{(pid=88899) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 03 08:51:16 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d8e9fe0-0e4c-4019-b64a-9fd2d3485d93]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:51:16 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-2977d46d-70f6-4211-86ff-67933d24a859 tempest-TestVolumeBootPattern-702574089 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c7e08fc1-6ddb-450f-ab86-f1fd8da53a6e.f8653d6d-3ac7-4bbe-bc57-33463f8461e9 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:51:16 devstack sudo[110681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c7e08fc1-6ddb-450f-ab86-f1fd8da53a6e.f8653d6d-3ac7-4bbe-bc57-33463f8461e9 Aug 03 08:51:16 devstack sudo[110681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:51:17 devstack sudo[110681]: pam_unix(sudo:session): session closed for user root Aug 03 08:51:17 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-2977d46d-70f6-4211-86ff-67933d24a859 tempest-TestVolumeBootPattern-702574089 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c7e08fc1-6ddb-450f-ab86-f1fd8da53a6e.f8653d6d-3ac7-4bbe-bc57-33463f8461e9" returned: 0 in 0.417s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:51:17 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-2977d46d-70f6-4211-86ff-67933d24a859 tempest-TestVolumeBootPattern-702574089 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c7e08fc1-6ddb-450f-ab86-f1fd8da53a6e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88899) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 03 08:51:17 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-2977d46d-70f6-4211-86ff-67933d24a859 tempest-TestVolumeBootPattern-702574089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c7e08fc1-6ddb-450f-ab86-f1fd8da53a6e.f8653d6d-3ac7-4bbe-bc57-33463f8461e9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c7e08fc1-6ddb-450f-ab86-f1fd8da53a6e.db23ec62-02b0-43b4-b5aa-1d08ee550ea7 1G {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:51:17 devstack sudo[110686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c7e08fc1-6ddb-450f-ab86-f1fd8da53a6e.f8653d6d-3ac7-4bbe-bc57-33463f8461e9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c7e08fc1-6ddb-450f-ab86-f1fd8da53a6e.db23ec62-02b0-43b4-b5aa-1d08ee550ea7 1G Aug 03 08:51:17 devstack sudo[110686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:51:17 devstack sudo[110686]: pam_unix(sudo:session): session closed for user root Aug 03 08:51:17 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-2977d46d-70f6-4211-86ff-67933d24a859 tempest-TestVolumeBootPattern-702574089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c7e08fc1-6ddb-450f-ab86-f1fd8da53a6e.f8653d6d-3ac7-4bbe-bc57-33463f8461e9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c7e08fc1-6ddb-450f-ab86-f1fd8da53a6e.db23ec62-02b0-43b4-b5aa-1d08ee550ea7 1G" returned: 0 in 0.456s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:51:17 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-2977d46d-70f6-4211-86ff-67933d24a859 tempest-TestVolumeBootPattern-702574089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c7e08fc1-6ddb-450f-ab86-f1fd8da53a6e.f8653d6d-3ac7-4bbe-bc57-33463f8461e9 -F qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c7e08fc1-6ddb-450f-ab86-f1fd8da53a6e.db23ec62-02b0-43b4-b5aa-1d08ee550ea7 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:51:17 devstack sudo[110691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c7e08fc1-6ddb-450f-ab86-f1fd8da53a6e.f8653d6d-3ac7-4bbe-bc57-33463f8461e9 -F qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c7e08fc1-6ddb-450f-ab86-f1fd8da53a6e.db23ec62-02b0-43b4-b5aa-1d08ee550ea7 Aug 03 08:51:17 devstack sudo[110691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:51:17 devstack sudo[110691]: pam_unix(sudo:session): session closed for user root Aug 03 08:51:17 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-2977d46d-70f6-4211-86ff-67933d24a859 tempest-TestVolumeBootPattern-702574089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c7e08fc1-6ddb-450f-ab86-f1fd8da53a6e.f8653d6d-3ac7-4bbe-bc57-33463f8461e9 -F qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c7e08fc1-6ddb-450f-ab86-f1fd8da53a6e.db23ec62-02b0-43b4-b5aa-1d08ee550ea7" returned: 0 in 0.294s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:51:17 devstack cinder-volume[88899]: WARNING cinder.volume.drivers.remotefs [None req-2977d46d-70f6-4211-86ff-67933d24a859 tempest-TestVolumeBootPattern-702574089 None] /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c7e08fc1-6ddb-450f-ab86-f1fd8da53a6e.db23ec62-02b0-43b4-b5aa-1d08ee550ea7 is being set with open permissions: ugo+rw Aug 03 08:51:17 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-2977d46d-70f6-4211-86ff-67933d24a859 tempest-TestVolumeBootPattern-702574089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c7e08fc1-6ddb-450f-ab86-f1fd8da53a6e.db23ec62-02b0-43b4-b5aa-1d08ee550ea7 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:51:18 devstack sudo[110696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c7e08fc1-6ddb-450f-ab86-f1fd8da53a6e.db23ec62-02b0-43b4-b5aa-1d08ee550ea7 Aug 03 08:51:18 devstack sudo[110696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:51:18 devstack sudo[110696]: pam_unix(sudo:session): session closed for user root Aug 03 08:51:18 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-2977d46d-70f6-4211-86ff-67933d24a859 tempest-TestVolumeBootPattern-702574089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c7e08fc1-6ddb-450f-ab86-f1fd8da53a6e.db23ec62-02b0-43b4-b5aa-1d08ee550ea7" returned: 0 in 0.244s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:51:18 devstack cinder-volume[88899]: DEBUG cinder.compute.nova [None req-2977d46d-70f6-4211-86ff-67933d24a859 tempest-TestVolumeBootPattern-702574089 None] Creating Keystone auth plugin from conf {{(pid=88899) novaclient /opt/stack/cinder/cinder/compute/nova.py:99}} Aug 03 08:51:18 devstack cinder-volume[88899]: DEBUG novaclient.v2.client [None req-2977d46d-70f6-4211-86ff-67933d24a859 tempest-TestVolumeBootPattern-702574089 None] REQ: curl -g -i -X POST http://192.168.122.55/compute/v2.1/os-assisted-volume-snapshots -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}5b25964cb8f75b6fcfc76c575f1c7998c9f9e0160eaf06da01a8b5ffe8398757" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-2977d46d-70f6-4211-86ff-67933d24a859" -H "X-Service-Token: {SHA256}c96e034f4f8a4d16079c50f41a6bc99d8f702fc5a9a0d1604994b54ce68306ce" -d '{"snapshot": {"volume_id": "c7e08fc1-6ddb-450f-ab86-f1fd8da53a6e", "create_info": {"type": "qcow2", "new_file": "volume-c7e08fc1-6ddb-450f-ab86-f1fd8da53a6e.db23ec62-02b0-43b4-b5aa-1d08ee550ea7", "snapshot_id": "db23ec62-02b0-43b4-b5aa-1d08ee550ea7"}}}' {{(pid=88899) _http_log_request /opt/stack/data/venv/lib/python3.12/site-packages/keystoneauth1/session.py:575}} Aug 03 08:51:18 devstack cinder-volume[88899]: DEBUG novaclient.v2.client [None req-2977d46d-70f6-4211-86ff-67933d24a859 tempest-TestVolumeBootPattern-702574089 None] RESP: [200] Connection: close Content-Length: 78 Content-Type: application/json Date: Mon, 03 Aug 2026 06:51:18 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.58 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-f464976a-2e56-4881-a99b-ef600452d8d8 x-openstack-request-id: req-f464976a-2e56-4881-a99b-ef600452d8d8 {{(pid=88899) _http_log_response /opt/stack/data/venv/lib/python3.12/site-packages/keystoneauth1/session.py:616}} Aug 03 08:51:18 devstack cinder-volume[88899]: DEBUG novaclient.v2.client [None req-2977d46d-70f6-4211-86ff-67933d24a859 tempest-TestVolumeBootPattern-702574089 None] RESP BODY: {"snapshot": {"id": null, "volumeId": "c7e08fc1-6ddb-450f-ab86-f1fd8da53a6e"}} {{(pid=88899) _http_log_response /opt/stack/data/venv/lib/python3.12/site-packages/keystoneauth1/session.py:651}} Aug 03 08:51:18 devstack cinder-volume[88899]: DEBUG novaclient.v2.client [None req-2977d46d-70f6-4211-86ff-67933d24a859 tempest-TestVolumeBootPattern-702574089 None] POST call to compute for http://192.168.122.55/compute/v2.1/os-assisted-volume-snapshots used request id req-f464976a-2e56-4881-a99b-ef600452d8d8 {{(pid=88899) request /opt/stack/data/venv/lib/python3.12/site-packages/keystoneauth1/session.py:1076}} Aug 03 08:51:18 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-2977d46d-70f6-4211-86ff-67933d24a859 tempest-TestVolumeBootPattern-702574089 None] nova call result: None {{(pid=88899) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1910}} Aug 03 08:51:18 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-2977d46d-70f6-4211-86ff-67933d24a859 tempest-TestVolumeBootPattern-702574089 None] Status of snapshot db23ec62-02b0-43b4-b5aa-1d08ee550ea7 is now creating {{(pid=88899) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Aug 03 08:51:19 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-2977d46d-70f6-4211-86ff-67933d24a859 tempest-TestVolumeBootPattern-702574089 None] Status of snapshot db23ec62-02b0-43b4-b5aa-1d08ee550ea7 is now creating {{(pid=88899) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Aug 03 08:51:20 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-2977d46d-70f6-4211-86ff-67933d24a859 tempest-TestVolumeBootPattern-702574089 None] Status of snapshot db23ec62-02b0-43b4-b5aa-1d08ee550ea7 is now creating {{(pid=88899) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Aug 03 08:51:21 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-2977d46d-70f6-4211-86ff-67933d24a859 tempest-TestVolumeBootPattern-702574089 None] Status of snapshot db23ec62-02b0-43b4-b5aa-1d08ee550ea7 is now creating {{(pid=88899) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Aug 03 08:51:22 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-2977d46d-70f6-4211-86ff-67933d24a859 tempest-TestVolumeBootPattern-702574089 None] Status of snapshot db23ec62-02b0-43b4-b5aa-1d08ee550ea7 is now creating {{(pid=88899) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Aug 03 08:51:23 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-2977d46d-70f6-4211-86ff-67933d24a859 tempest-TestVolumeBootPattern-702574089 None] Status of snapshot db23ec62-02b0-43b4-b5aa-1d08ee550ea7 is now creating {{(pid=88899) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Aug 03 08:51:24 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-2977d46d-70f6-4211-86ff-67933d24a859 tempest-TestVolumeBootPattern-702574089 None] Status of snapshot db23ec62-02b0-43b4-b5aa-1d08ee550ea7 is now creating {{(pid=88899) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Aug 03 08:51:25 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-2977d46d-70f6-4211-86ff-67933d24a859 tempest-TestVolumeBootPattern-702574089 None] Status of snapshot db23ec62-02b0-43b4-b5aa-1d08ee550ea7 is now creating {{(pid=88899) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Aug 03 08:51:26 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-2977d46d-70f6-4211-86ff-67933d24a859 tempest-TestVolumeBootPattern-702574089 None] Status of snapshot db23ec62-02b0-43b4-b5aa-1d08ee550ea7 is now creating {{(pid=88899) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Aug 03 08:51:27 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-2977d46d-70f6-4211-86ff-67933d24a859 tempest-TestVolumeBootPattern-702574089 None] Status of snapshot db23ec62-02b0-43b4-b5aa-1d08ee550ea7 is now creating {{(pid=88899) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Aug 03 08:51:28 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-2977d46d-70f6-4211-86ff-67933d24a859 tempest-TestVolumeBootPattern-702574089 None] Status of snapshot db23ec62-02b0-43b4-b5aa-1d08ee550ea7 is now creating {{(pid=88899) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Aug 03 08:51:29 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-2977d46d-70f6-4211-86ff-67933d24a859 tempest-TestVolumeBootPattern-702574089 None] Status of snapshot db23ec62-02b0-43b4-b5aa-1d08ee550ea7 is now creating {{(pid=88899) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Aug 03 08:51:31 devstack cinder-volume[88899]: DEBUG dbcounter [-] [88899] Writing DB stats cinder:SELECT=37,cinder:UPDATE=6,cinder:INSERT=12,cinder:DELETE=1 {{(pid=88899) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 03 08:51:31 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-2977d46d-70f6-4211-86ff-67933d24a859 tempest-TestVolumeBootPattern-702574089 None] Status of snapshot db23ec62-02b0-43b4-b5aa-1d08ee550ea7 is now creating {{(pid=88899) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Aug 03 08:51:33 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-2977d46d-70f6-4211-86ff-67933d24a859 tempest-TestVolumeBootPattern-702574089 None] Status of snapshot db23ec62-02b0-43b4-b5aa-1d08ee550ea7 is now creating {{(pid=88899) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Aug 03 08:51:33 devstack cinder-volume[88899]: DEBUG dbcounter [-] [88899] Writing DB stats cinder:SELECT=28,cinder:INSERT=15,cinder:UPDATE=3,cinder:DELETE=1 {{(pid=88899) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 03 08:51:33 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-2977d46d-70f6-4211-86ff-67933d24a859 tempest-TestVolumeBootPattern-702574089 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 16.854s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:51:33 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-2977d46d-70f6-4211-86ff-67933d24a859 tempest-TestVolumeBootPattern-702574089 None] Create snapshot completed successfully Aug 03 08:51:35 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-1756d945-d497-499e-b861-b19958f4c64c tempest-TestVolumeBootPattern-702574089 None] Acquiring lock "cinder-db23ec62-02b0-43b4-b5aa-1d08ee550ea7-delete_snapshot" by "delete_snapshot" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:51:35 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-1756d945-d497-499e-b861-b19958f4c64c tempest-TestVolumeBootPattern-702574089 None] Lock "cinder-db23ec62-02b0-43b4-b5aa-1d08ee550ea7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:51:35 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-1756d945-d497-499e-b861-b19958f4c64c tempest-TestVolumeBootPattern-702574089 None] Acquiring lock "cinder-quobyte-c7e08fc1-6ddb-450f-ab86-f1fd8da53a6e" by "delete_snapshot" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:51:35 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-1756d945-d497-499e-b861-b19958f4c64c tempest-TestVolumeBootPattern-702574089 None] Lock "cinder-quobyte-c7e08fc1-6ddb-450f-ab86-f1fd8da53a6e" acquired by "delete_snapshot" :: waited 0.017s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:51:35 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-1756d945-d497-499e-b861-b19958f4c64c tempest-TestVolumeBootPattern-702574089 None] Acquiring lock "cinder-quobyte-db23ec62-02b0-43b4-b5aa-1d08ee550ea7" by "_delete_snapshot" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:51:36 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-1756d945-d497-499e-b861-b19958f4c64c tempest-TestVolumeBootPattern-702574089 None] Lock "cinder-quobyte-db23ec62-02b0-43b4-b5aa-1d08ee550ea7" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:51:36 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-1756d945-d497-499e-b861-b19958f4c64c tempest-TestVolumeBootPattern-702574089 None] Deleting online snapshot db23ec62-02b0-43b4-b5aa-1d08ee550ea7 of volume c7e08fc1-6ddb-450f-ab86-f1fd8da53a6e {{(pid=88899) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 03 08:51:36 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-1756d945-d497-499e-b861-b19958f4c64c tempest-TestVolumeBootPattern-702574089 None] snapshot_file for this snap is: volume-c7e08fc1-6ddb-450f-ab86-f1fd8da53a6e.db23ec62-02b0-43b4-b5aa-1d08ee550ea7 {{(pid=88899) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 03 08:51:36 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf6bdbc9-7daf-4742-b738-743651805b44]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:51:36 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-1756d945-d497-499e-b861-b19958f4c64c tempest-TestVolumeBootPattern-702574089 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c7e08fc1-6ddb-450f-ab86-f1fd8da53a6e.db23ec62-02b0-43b4-b5aa-1d08ee550ea7 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:51:36 devstack sudo[110722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c7e08fc1-6ddb-450f-ab86-f1fd8da53a6e.db23ec62-02b0-43b4-b5aa-1d08ee550ea7 Aug 03 08:51:36 devstack sudo[110722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:51:36 devstack sudo[110722]: pam_unix(sudo:session): session closed for user root Aug 03 08:51:36 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-1756d945-d497-499e-b861-b19958f4c64c tempest-TestVolumeBootPattern-702574089 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c7e08fc1-6ddb-450f-ab86-f1fd8da53a6e.db23ec62-02b0-43b4-b5aa-1d08ee550ea7" returned: 0 in 0.355s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:51:36 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-1756d945-d497-499e-b861-b19958f4c64c tempest-TestVolumeBootPattern-702574089 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c7e08fc1-6ddb-450f-ab86-f1fd8da53a6e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88899) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 03 08:51:36 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbdc5e57-8fd6-4c76-b863-178f2308f4d9]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:51:36 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-1756d945-d497-499e-b861-b19958f4c64c tempest-TestVolumeBootPattern-702574089 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c7e08fc1-6ddb-450f-ab86-f1fd8da53a6e.f8653d6d-3ac7-4bbe-bc57-33463f8461e9 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:51:36 devstack sudo[110727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c7e08fc1-6ddb-450f-ab86-f1fd8da53a6e.f8653d6d-3ac7-4bbe-bc57-33463f8461e9 Aug 03 08:51:36 devstack sudo[110727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:51:36 devstack sudo[110727]: pam_unix(sudo:session): session closed for user root Aug 03 08:51:36 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-1756d945-d497-499e-b861-b19958f4c64c tempest-TestVolumeBootPattern-702574089 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c7e08fc1-6ddb-450f-ab86-f1fd8da53a6e.f8653d6d-3ac7-4bbe-bc57-33463f8461e9" returned: 0 in 0.360s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:51:36 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-1756d945-d497-499e-b861-b19958f4c64c tempest-TestVolumeBootPattern-702574089 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c7e08fc1-6ddb-450f-ab86-f1fd8da53a6e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88899) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 03 08:51:36 devstack cinder-volume[88899]: DEBUG cinder.compute.nova [None req-1756d945-d497-499e-b861-b19958f4c64c tempest-TestVolumeBootPattern-702574089 None] Creating Keystone auth plugin from conf {{(pid=88899) novaclient /opt/stack/cinder/cinder/compute/nova.py:99}} Aug 03 08:51:36 devstack cinder-volume[88899]: DEBUG novaclient.v2.client [None req-1756d945-d497-499e-b861-b19958f4c64c tempest-TestVolumeBootPattern-702574089 None] REQ: curl -g -i -X DELETE http://192.168.122.55/compute/v2.1/os-assisted-volume-snapshots/db23ec62-02b0-43b4-b5aa-1d08ee550ea7?delete_info={"file_to_merge": "volume-c7e08fc1-6ddb-450f-ab86-f1fd8da53a6e.7328475d-cec1-4dad-a3d8-ce366fceaff9", "merge_target_file": null, "type": "qcow2", "volume_id": "c7e08fc1-6ddb-450f-ab86-f1fd8da53a6e"} -H "Accept: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}bdf3ba1a9a0c7b13936ff5b150dfff1481cb936526c9922ab28ad9a7fa443706" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-1756d945-d497-499e-b861-b19958f4c64c" -H "X-Service-Token: {SHA256}c96e034f4f8a4d16079c50f41a6bc99d8f702fc5a9a0d1604994b54ce68306ce" {{(pid=88899) _http_log_request /opt/stack/data/venv/lib/python3.12/site-packages/keystoneauth1/session.py:575}} Aug 03 08:51:36 devstack cinder-volume[88899]: DEBUG novaclient.v2.client [None req-1756d945-d497-499e-b861-b19958f4c64c tempest-TestVolumeBootPattern-702574089 None] RESP: [204] Connection: close Content-Type: application/json Date: Mon, 03 Aug 2026 06:51:36 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.58 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-c18d9b81-3f88-4979-b714-e5c9e352285a x-openstack-request-id: req-c18d9b81-3f88-4979-b714-e5c9e352285a {{(pid=88899) _http_log_response /opt/stack/data/venv/lib/python3.12/site-packages/keystoneauth1/session.py:616}} Aug 03 08:51:36 devstack cinder-volume[88899]: DEBUG novaclient.v2.client [None req-1756d945-d497-499e-b861-b19958f4c64c tempest-TestVolumeBootPattern-702574089 None] DELETE call to compute for http://192.168.122.55/compute/v2.1/os-assisted-volume-snapshots/db23ec62-02b0-43b4-b5aa-1d08ee550ea7?delete_info=%7B%22file_to_merge%22:%20%22volume-c7e08fc1-6ddb-450f-ab86-f1fd8da53a6e.7328475d-cec1-4dad-a3d8-ce366fceaff9%22,%20%22merge_target_file%22:%20null,%20%22type%22:%20%22qcow2%22,%20%22volume_id%22:%20%22c7e08fc1-6ddb-450f-ab86-f1fd8da53a6e%22%7D used request id req-c18d9b81-3f88-4979-b714-e5c9e352285a {{(pid=88899) request /opt/stack/data/venv/lib/python3.12/site-packages/keystoneauth1/session.py:1076}} Aug 03 08:51:36 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-1756d945-d497-499e-b861-b19958f4c64c tempest-TestVolumeBootPattern-702574089 None] status of snapshot db23ec62-02b0-43b4-b5aa-1d08ee550ea7 is still "deleting"... waiting {{(pid=88899) _nova_assisted_vol_snap_delete /opt/stack/cinder/cinder/volume/drivers/remotefs.py:2054}} Aug 03 08:51:38 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-1756d945-d497-499e-b861-b19958f4c64c tempest-TestVolumeBootPattern-702574089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c7e08fc1-6ddb-450f-ab86-f1fd8da53a6e.f8653d6d-3ac7-4bbe-bc57-33463f8461e9 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:51:38 devstack sudo[110739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c7e08fc1-6ddb-450f-ab86-f1fd8da53a6e.f8653d6d-3ac7-4bbe-bc57-33463f8461e9 Aug 03 08:51:38 devstack sudo[110739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:51:38 devstack sudo[110739]: pam_unix(sudo:session): session closed for user root Aug 03 08:51:38 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-1756d945-d497-499e-b861-b19958f4c64c tempest-TestVolumeBootPattern-702574089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c7e08fc1-6ddb-450f-ab86-f1fd8da53a6e.f8653d6d-3ac7-4bbe-bc57-33463f8461e9" returned: 0 in 0.268s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:51:38 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-1756d945-d497-499e-b861-b19958f4c64c tempest-TestVolumeBootPattern-702574089 None] Lock "cinder-quobyte-db23ec62-02b0-43b4-b5aa-1d08ee550ea7" released by "_delete_snapshot" :: held 2.304s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:51:38 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-1756d945-d497-499e-b861-b19958f4c64c tempest-TestVolumeBootPattern-702574089 None] Lock "cinder-quobyte-c7e08fc1-6ddb-450f-ab86-f1fd8da53a6e" released by "delete_snapshot" :: held 2.328s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:51:38 devstack cinder-volume[88899]: DEBUG cinder.quota [None req-1756d945-d497-499e-b861-b19958f4c64c tempest-TestVolumeBootPattern-702574089 None] Created reservations ['833cd95c-d411-44f0-8ea1-0295362a3f13', 'b3c13fe4-7563-45b4-ae0e-444afbcc7b2c', '7d7de5ae-a088-4c4e-9776-fed6cb9fd6c2', '2bd8c97e-3471-4a87-b7ce-6197918d1bb3'] {{(pid=88899) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 08:51:38 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-1756d945-d497-499e-b861-b19958f4c64c tempest-TestVolumeBootPattern-702574089 None] Delete snapshot completed successfully. Aug 03 08:51:38 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-1756d945-d497-499e-b861-b19958f4c64c tempest-TestVolumeBootPattern-702574089 None] Lock "cinder-db23ec62-02b0-43b4-b5aa-1d08ee550ea7-delete_snapshot" released by "delete_snapshot" :: held 2.473s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:51:39 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-374c2c2f-d2b1-4196-b154-dedddcbada61 tempest-TestVolumeBootPattern-702574089 None] Acquiring lock "cinder-f8653d6d-3ac7-4bbe-bc57-33463f8461e9-delete_snapshot" by "delete_snapshot" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:51:39 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-374c2c2f-d2b1-4196-b154-dedddcbada61 tempest-TestVolumeBootPattern-702574089 None] Lock "cinder-f8653d6d-3ac7-4bbe-bc57-33463f8461e9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:51:39 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-374c2c2f-d2b1-4196-b154-dedddcbada61 tempest-TestVolumeBootPattern-702574089 None] Acquiring lock "cinder-quobyte-c7e08fc1-6ddb-450f-ab86-f1fd8da53a6e" by "delete_snapshot" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:51:39 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-374c2c2f-d2b1-4196-b154-dedddcbada61 tempest-TestVolumeBootPattern-702574089 None] Lock "cinder-quobyte-c7e08fc1-6ddb-450f-ab86-f1fd8da53a6e" acquired by "delete_snapshot" :: waited 0.018s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:51:39 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-374c2c2f-d2b1-4196-b154-dedddcbada61 tempest-TestVolumeBootPattern-702574089 None] Acquiring lock "cinder-quobyte-f8653d6d-3ac7-4bbe-bc57-33463f8461e9" by "_delete_snapshot" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:51:39 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-374c2c2f-d2b1-4196-b154-dedddcbada61 tempest-TestVolumeBootPattern-702574089 None] Lock "cinder-quobyte-f8653d6d-3ac7-4bbe-bc57-33463f8461e9" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:51:39 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-374c2c2f-d2b1-4196-b154-dedddcbada61 tempest-TestVolumeBootPattern-702574089 None] Deleting online snapshot f8653d6d-3ac7-4bbe-bc57-33463f8461e9 of volume c7e08fc1-6ddb-450f-ab86-f1fd8da53a6e {{(pid=88899) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 03 08:51:39 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-374c2c2f-d2b1-4196-b154-dedddcbada61 tempest-TestVolumeBootPattern-702574089 None] snapshot_file for this snap is: volume-c7e08fc1-6ddb-450f-ab86-f1fd8da53a6e.db23ec62-02b0-43b4-b5aa-1d08ee550ea7 {{(pid=88899) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 03 08:51:39 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a0b4e18-841c-4386-a909-2a4768002b5c]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:51:39 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-374c2c2f-d2b1-4196-b154-dedddcbada61 tempest-TestVolumeBootPattern-702574089 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c7e08fc1-6ddb-450f-ab86-f1fd8da53a6e.db23ec62-02b0-43b4-b5aa-1d08ee550ea7 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:51:39 devstack sudo[110743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c7e08fc1-6ddb-450f-ab86-f1fd8da53a6e.db23ec62-02b0-43b4-b5aa-1d08ee550ea7 Aug 03 08:51:39 devstack sudo[110743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:51:39 devstack sudo[110743]: pam_unix(sudo:session): session closed for user root Aug 03 08:51:39 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-374c2c2f-d2b1-4196-b154-dedddcbada61 tempest-TestVolumeBootPattern-702574089 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c7e08fc1-6ddb-450f-ab86-f1fd8da53a6e.db23ec62-02b0-43b4-b5aa-1d08ee550ea7" returned: 0 in 0.373s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:51:39 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-374c2c2f-d2b1-4196-b154-dedddcbada61 tempest-TestVolumeBootPattern-702574089 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c7e08fc1-6ddb-450f-ab86-f1fd8da53a6e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88899) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 03 08:51:39 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea3b8270-eaf2-4538-8b51-a48dfa8a28f5]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:51:39 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-374c2c2f-d2b1-4196-b154-dedddcbada61 tempest-TestVolumeBootPattern-702574089 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c7e08fc1-6ddb-450f-ab86-f1fd8da53a6e.7328475d-cec1-4dad-a3d8-ce366fceaff9 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:51:39 devstack sudo[110748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c7e08fc1-6ddb-450f-ab86-f1fd8da53a6e.7328475d-cec1-4dad-a3d8-ce366fceaff9 Aug 03 08:51:39 devstack sudo[110748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:51:40 devstack sudo[110748]: pam_unix(sudo:session): session closed for user root Aug 03 08:51:40 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-374c2c2f-d2b1-4196-b154-dedddcbada61 tempest-TestVolumeBootPattern-702574089 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c7e08fc1-6ddb-450f-ab86-f1fd8da53a6e.7328475d-cec1-4dad-a3d8-ce366fceaff9" returned: 0 in 0.374s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:51:40 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-374c2c2f-d2b1-4196-b154-dedddcbada61 tempest-TestVolumeBootPattern-702574089 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c7e08fc1-6ddb-450f-ab86-f1fd8da53a6e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88899) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 03 08:51:40 devstack cinder-volume[88899]: DEBUG cinder.compute.nova [None req-374c2c2f-d2b1-4196-b154-dedddcbada61 tempest-TestVolumeBootPattern-702574089 None] Creating Keystone auth plugin from conf {{(pid=88899) novaclient /opt/stack/cinder/cinder/compute/nova.py:99}} Aug 03 08:51:40 devstack cinder-volume[88899]: DEBUG novaclient.v2.client [None req-374c2c2f-d2b1-4196-b154-dedddcbada61 tempest-TestVolumeBootPattern-702574089 None] REQ: curl -g -i -X DELETE http://192.168.122.55/compute/v2.1/os-assisted-volume-snapshots/f8653d6d-3ac7-4bbe-bc57-33463f8461e9?delete_info={"file_to_merge": "volume-c7e08fc1-6ddb-450f-ab86-f1fd8da53a6e", "merge_target_file": null, "type": "qcow2", "volume_id": "c7e08fc1-6ddb-450f-ab86-f1fd8da53a6e"} -H "Accept: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}4e60a2b14d17f524e072bc7dfc4525f0ce66ebd07c3e52b623a585460f2274be" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-374c2c2f-d2b1-4196-b154-dedddcbada61" -H "X-Service-Token: {SHA256}c96e034f4f8a4d16079c50f41a6bc99d8f702fc5a9a0d1604994b54ce68306ce" {{(pid=88899) _http_log_request /opt/stack/data/venv/lib/python3.12/site-packages/keystoneauth1/session.py:575}} Aug 03 08:51:40 devstack cinder-volume[88899]: DEBUG novaclient.v2.client [None req-374c2c2f-d2b1-4196-b154-dedddcbada61 tempest-TestVolumeBootPattern-702574089 None] RESP: [204] Connection: close Content-Type: application/json Date: Mon, 03 Aug 2026 06:51:40 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.58 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-8a90e2ad-770a-46bd-b71c-55ffd6995ea6 x-openstack-request-id: req-8a90e2ad-770a-46bd-b71c-55ffd6995ea6 {{(pid=88899) _http_log_response /opt/stack/data/venv/lib/python3.12/site-packages/keystoneauth1/session.py:616}} Aug 03 08:51:40 devstack cinder-volume[88899]: DEBUG novaclient.v2.client [None req-374c2c2f-d2b1-4196-b154-dedddcbada61 tempest-TestVolumeBootPattern-702574089 None] DELETE call to compute for http://192.168.122.55/compute/v2.1/os-assisted-volume-snapshots/f8653d6d-3ac7-4bbe-bc57-33463f8461e9?delete_info=%7B%22file_to_merge%22:%20%22volume-c7e08fc1-6ddb-450f-ab86-f1fd8da53a6e%22,%20%22merge_target_file%22:%20null,%20%22type%22:%20%22qcow2%22,%20%22volume_id%22:%20%22c7e08fc1-6ddb-450f-ab86-f1fd8da53a6e%22%7D used request id req-8a90e2ad-770a-46bd-b71c-55ffd6995ea6 {{(pid=88899) request /opt/stack/data/venv/lib/python3.12/site-packages/keystoneauth1/session.py:1076}} Aug 03 08:51:40 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-374c2c2f-d2b1-4196-b154-dedddcbada61 tempest-TestVolumeBootPattern-702574089 None] status of snapshot f8653d6d-3ac7-4bbe-bc57-33463f8461e9 is still "deleting"... waiting {{(pid=88899) _nova_assisted_vol_snap_delete /opt/stack/cinder/cinder/volume/drivers/remotefs.py:2054}} Aug 03 08:51:41 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-374c2c2f-d2b1-4196-b154-dedddcbada61 tempest-TestVolumeBootPattern-702574089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c7e08fc1-6ddb-450f-ab86-f1fd8da53a6e.7328475d-cec1-4dad-a3d8-ce366fceaff9 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:51:41 devstack sudo[110760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c7e08fc1-6ddb-450f-ab86-f1fd8da53a6e.7328475d-cec1-4dad-a3d8-ce366fceaff9 Aug 03 08:51:41 devstack sudo[110760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:51:41 devstack sudo[110760]: pam_unix(sudo:session): session closed for user root Aug 03 08:51:41 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-374c2c2f-d2b1-4196-b154-dedddcbada61 tempest-TestVolumeBootPattern-702574089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c7e08fc1-6ddb-450f-ab86-f1fd8da53a6e.7328475d-cec1-4dad-a3d8-ce366fceaff9" returned: 0 in 0.243s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:51:41 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-374c2c2f-d2b1-4196-b154-dedddcbada61 tempest-TestVolumeBootPattern-702574089 None] Lock "cinder-quobyte-f8653d6d-3ac7-4bbe-bc57-33463f8461e9" released by "_delete_snapshot" :: held 2.308s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:51:41 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-374c2c2f-d2b1-4196-b154-dedddcbada61 tempest-TestVolumeBootPattern-702574089 None] Lock "cinder-quobyte-c7e08fc1-6ddb-450f-ab86-f1fd8da53a6e" released by "delete_snapshot" :: held 2.335s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:51:41 devstack cinder-volume[88899]: DEBUG cinder.quota [None req-374c2c2f-d2b1-4196-b154-dedddcbada61 tempest-TestVolumeBootPattern-702574089 None] Created reservations ['c4e11b7d-f743-4d03-b491-49203369c0b5', 'dd9a7927-e044-494a-b84b-124e1ce34ca1', '74a5f6d9-7322-4db2-ab07-67406eeb75e0', 'ed65364c-fc84-4830-b8b4-cc9c4ff7347f'] {{(pid=88899) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 08:51:41 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-374c2c2f-d2b1-4196-b154-dedddcbada61 tempest-TestVolumeBootPattern-702574089 None] Delete snapshot completed successfully. Aug 03 08:51:41 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-374c2c2f-d2b1-4196-b154-dedddcbada61 tempest-TestVolumeBootPattern-702574089 None] Lock "cinder-f8653d6d-3ac7-4bbe-bc57-33463f8461e9-delete_snapshot" released by "delete_snapshot" :: held 2.476s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:51:42 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-81742e13-c026-4bce-a14a-6859b2c5cd5b tempest-TestVolumeBootPattern-702574089 None] Acquiring lock "cinder-7328475d-cec1-4dad-a3d8-ce366fceaff9-delete_snapshot" by "delete_snapshot" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:51:42 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-81742e13-c026-4bce-a14a-6859b2c5cd5b tempest-TestVolumeBootPattern-702574089 None] Lock "cinder-7328475d-cec1-4dad-a3d8-ce366fceaff9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.014s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:51:42 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-81742e13-c026-4bce-a14a-6859b2c5cd5b tempest-TestVolumeBootPattern-702574089 None] Acquiring lock "cinder-quobyte-c7e08fc1-6ddb-450f-ab86-f1fd8da53a6e" by "delete_snapshot" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:51:42 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-81742e13-c026-4bce-a14a-6859b2c5cd5b tempest-TestVolumeBootPattern-702574089 None] Lock "cinder-quobyte-c7e08fc1-6ddb-450f-ab86-f1fd8da53a6e" acquired by "delete_snapshot" :: waited 0.014s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:51:42 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-81742e13-c026-4bce-a14a-6859b2c5cd5b tempest-TestVolumeBootPattern-702574089 None] Acquiring lock "cinder-quobyte-7328475d-cec1-4dad-a3d8-ce366fceaff9" by "_delete_snapshot" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:51:42 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-81742e13-c026-4bce-a14a-6859b2c5cd5b tempest-TestVolumeBootPattern-702574089 None] Lock "cinder-quobyte-7328475d-cec1-4dad-a3d8-ce366fceaff9" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:51:42 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-81742e13-c026-4bce-a14a-6859b2c5cd5b tempest-TestVolumeBootPattern-702574089 None] Deleting online snapshot 7328475d-cec1-4dad-a3d8-ce366fceaff9 of volume c7e08fc1-6ddb-450f-ab86-f1fd8da53a6e {{(pid=88899) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 03 08:51:42 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-81742e13-c026-4bce-a14a-6859b2c5cd5b tempest-TestVolumeBootPattern-702574089 None] snapshot_file for this snap is: volume-c7e08fc1-6ddb-450f-ab86-f1fd8da53a6e.db23ec62-02b0-43b4-b5aa-1d08ee550ea7 {{(pid=88899) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 03 08:51:42 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[a407b6cc-7f6c-4d3f-b2f4-6ec211034659]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:51:42 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-81742e13-c026-4bce-a14a-6859b2c5cd5b tempest-TestVolumeBootPattern-702574089 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c7e08fc1-6ddb-450f-ab86-f1fd8da53a6e.db23ec62-02b0-43b4-b5aa-1d08ee550ea7 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:51:42 devstack sudo[110763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c7e08fc1-6ddb-450f-ab86-f1fd8da53a6e.db23ec62-02b0-43b4-b5aa-1d08ee550ea7 Aug 03 08:51:42 devstack sudo[110763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:51:42 devstack sudo[110763]: pam_unix(sudo:session): session closed for user root Aug 03 08:51:42 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-81742e13-c026-4bce-a14a-6859b2c5cd5b tempest-TestVolumeBootPattern-702574089 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c7e08fc1-6ddb-450f-ab86-f1fd8da53a6e.db23ec62-02b0-43b4-b5aa-1d08ee550ea7" returned: 0 in 0.346s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:51:42 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-81742e13-c026-4bce-a14a-6859b2c5cd5b tempest-TestVolumeBootPattern-702574089 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c7e08fc1-6ddb-450f-ab86-f1fd8da53a6e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88899) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 03 08:51:42 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c7f5342-fb9b-4ef7-9361-965d7a8c8052]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:51:42 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-81742e13-c026-4bce-a14a-6859b2c5cd5b tempest-TestVolumeBootPattern-702574089 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c7e08fc1-6ddb-450f-ab86-f1fd8da53a6e {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:51:42 devstack sudo[110768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c7e08fc1-6ddb-450f-ab86-f1fd8da53a6e Aug 03 08:51:42 devstack sudo[110768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:51:43 devstack sudo[110768]: pam_unix(sudo:session): session closed for user root Aug 03 08:51:43 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-81742e13-c026-4bce-a14a-6859b2c5cd5b tempest-TestVolumeBootPattern-702574089 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c7e08fc1-6ddb-450f-ab86-f1fd8da53a6e" returned: 0 in 0.357s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:51:43 devstack cinder-volume[88899]: DEBUG cinder.compute.nova [None req-81742e13-c026-4bce-a14a-6859b2c5cd5b tempest-TestVolumeBootPattern-702574089 None] Creating Keystone auth plugin from conf {{(pid=88899) novaclient /opt/stack/cinder/cinder/compute/nova.py:99}} Aug 03 08:51:43 devstack cinder-volume[88899]: DEBUG novaclient.v2.client [None req-81742e13-c026-4bce-a14a-6859b2c5cd5b tempest-TestVolumeBootPattern-702574089 None] REQ: curl -g -i -X DELETE http://192.168.122.55/compute/v2.1/os-assisted-volume-snapshots/7328475d-cec1-4dad-a3d8-ce366fceaff9?delete_info={"file_to_merge": null, "merge_target_file": null, "type": "qcow2", "volume_id": "c7e08fc1-6ddb-450f-ab86-f1fd8da53a6e"} -H "Accept: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}2a5a0b9197742ca79cd2c2a6f1aa3dc01f79a5ddcc9834baaf1a8593b1dcb3c5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-81742e13-c026-4bce-a14a-6859b2c5cd5b" -H "X-Service-Token: {SHA256}c96e034f4f8a4d16079c50f41a6bc99d8f702fc5a9a0d1604994b54ce68306ce" {{(pid=88899) _http_log_request /opt/stack/data/venv/lib/python3.12/site-packages/keystoneauth1/session.py:575}} Aug 03 08:51:43 devstack cinder-volume[88899]: DEBUG novaclient.v2.client [None req-81742e13-c026-4bce-a14a-6859b2c5cd5b tempest-TestVolumeBootPattern-702574089 None] RESP: [204] Connection: close Content-Type: application/json Date: Mon, 03 Aug 2026 06:51:43 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.58 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-1df01e70-f6d2-4ff7-af88-306461c58ed5 x-openstack-request-id: req-1df01e70-f6d2-4ff7-af88-306461c58ed5 {{(pid=88899) _http_log_response /opt/stack/data/venv/lib/python3.12/site-packages/keystoneauth1/session.py:616}} Aug 03 08:51:43 devstack cinder-volume[88899]: DEBUG novaclient.v2.client [None req-81742e13-c026-4bce-a14a-6859b2c5cd5b tempest-TestVolumeBootPattern-702574089 None] DELETE call to compute for http://192.168.122.55/compute/v2.1/os-assisted-volume-snapshots/7328475d-cec1-4dad-a3d8-ce366fceaff9?delete_info=%7B%22file_to_merge%22:%20null,%20%22merge_target_file%22:%20null,%20%22type%22:%20%22qcow2%22,%20%22volume_id%22:%20%22c7e08fc1-6ddb-450f-ab86-f1fd8da53a6e%22%7D used request id req-1df01e70-f6d2-4ff7-af88-306461c58ed5 {{(pid=88899) request /opt/stack/data/venv/lib/python3.12/site-packages/keystoneauth1/session.py:1076}} Aug 03 08:51:43 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-81742e13-c026-4bce-a14a-6859b2c5cd5b tempest-TestVolumeBootPattern-702574089 None] status of snapshot 7328475d-cec1-4dad-a3d8-ce366fceaff9 is still "deleting"... waiting {{(pid=88899) _nova_assisted_vol_snap_delete /opt/stack/cinder/cinder/volume/drivers/remotefs.py:2054}} Aug 03 08:51:44 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-81742e13-c026-4bce-a14a-6859b2c5cd5b tempest-TestVolumeBootPattern-702574089 None] status of snapshot 7328475d-cec1-4dad-a3d8-ce366fceaff9 is still "deleting"... waiting {{(pid=88899) _nova_assisted_vol_snap_delete /opt/stack/cinder/cinder/volume/drivers/remotefs.py:2054}} Aug 03 08:51:45 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-81742e13-c026-4bce-a14a-6859b2c5cd5b tempest-TestVolumeBootPattern-702574089 None] status of snapshot 7328475d-cec1-4dad-a3d8-ce366fceaff9 is still "deleting"... waiting {{(pid=88899) _nova_assisted_vol_snap_delete /opt/stack/cinder/cinder/volume/drivers/remotefs.py:2054}} Aug 03 08:51:46 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-81742e13-c026-4bce-a14a-6859b2c5cd5b tempest-TestVolumeBootPattern-702574089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c7e08fc1-6ddb-450f-ab86-f1fd8da53a6e {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:51:46 devstack sudo[110782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c7e08fc1-6ddb-450f-ab86-f1fd8da53a6e Aug 03 08:51:46 devstack sudo[110782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:51:46 devstack sudo[110782]: pam_unix(sudo:session): session closed for user root Aug 03 08:51:46 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-81742e13-c026-4bce-a14a-6859b2c5cd5b tempest-TestVolumeBootPattern-702574089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c7e08fc1-6ddb-450f-ab86-f1fd8da53a6e" returned: 0 in 0.266s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:51:46 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-81742e13-c026-4bce-a14a-6859b2c5cd5b tempest-TestVolumeBootPattern-702574089 None] Lock "cinder-quobyte-7328475d-cec1-4dad-a3d8-ce366fceaff9" released by "_delete_snapshot" :: held 4.315s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:51:46 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-81742e13-c026-4bce-a14a-6859b2c5cd5b tempest-TestVolumeBootPattern-702574089 None] Lock "cinder-quobyte-c7e08fc1-6ddb-450f-ab86-f1fd8da53a6e" released by "delete_snapshot" :: held 4.340s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:51:46 devstack cinder-volume[88899]: DEBUG cinder.quota [None req-81742e13-c026-4bce-a14a-6859b2c5cd5b tempest-TestVolumeBootPattern-702574089 None] Created reservations ['b4e8cb97-8092-4572-a8a5-31c9403b8e6b', 'a5a02bfe-75a8-4c58-95a0-2e1510f6ba37', 'cc33a605-e311-4697-ae38-c922e971f42b', '121d75e4-83f3-48de-9307-f0bdaa91d105'] {{(pid=88899) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 08:51:46 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-81742e13-c026-4bce-a14a-6859b2c5cd5b tempest-TestVolumeBootPattern-702574089 None] Delete snapshot completed successfully. Aug 03 08:51:46 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-81742e13-c026-4bce-a14a-6859b2c5cd5b tempest-TestVolumeBootPattern-702574089 None] Lock "cinder-7328475d-cec1-4dad-a3d8-ce366fceaff9-delete_snapshot" released by "delete_snapshot" :: held 4.496s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:51:49 devstack cinder-volume[88899]: INFO cinder.volume.manager [req-539b14d6-507c-4900-968d-180e0d1db941 req-12c23e8e-2d4b-4012-a2c5-fb90f6959fa0 tempest-TestVolumeBootPattern-702574089 None] Terminate volume connection completed successfully. Aug 03 08:51:49 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [req-539b14d6-507c-4900-968d-180e0d1db941 req-12c23e8e-2d4b-4012-a2c5-fb90f6959fa0 tempest-TestVolumeBootPattern-702574089 None] Deleting attachment a3e693b6-4400-45c0-8226-60cc86d2b1a8. {{(pid=88899) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 03 08:51:51 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-f09e6354-1c1d-42a6-8cd9-838b591fc254 tempest-TestVolumeBootPattern-702574089 None] Acquiring lock "cinder-c7e08fc1-6ddb-450f-ab86-f1fd8da53a6e-delete_volume" by "delete_volume" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:51:51 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-f09e6354-1c1d-42a6-8cd9-838b591fc254 tempest-TestVolumeBootPattern-702574089 None] Lock "cinder-c7e08fc1-6ddb-450f-ab86-f1fd8da53a6e-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:51:51 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-f09e6354-1c1d-42a6-8cd9-838b591fc254 tempest-TestVolumeBootPattern-702574089 None] Acquiring lock "cinder-quobyte-c7e08fc1-6ddb-450f-ab86-f1fd8da53a6e" by "delete_volume" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:51:51 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-f09e6354-1c1d-42a6-8cd9-838b591fc254 tempest-TestVolumeBootPattern-702574089 None] Lock "cinder-quobyte-c7e08fc1-6ddb-450f-ab86-f1fd8da53a6e" acquired by "delete_volume" :: waited 0.014s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:51:51 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-f09e6354-1c1d-42a6-8cd9-838b591fc254 tempest-TestVolumeBootPattern-702574089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c7e08fc1-6ddb-450f-ab86-f1fd8da53a6e.db23ec62-02b0-43b4-b5aa-1d08ee550ea7 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:51:51 devstack sudo[110810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c7e08fc1-6ddb-450f-ab86-f1fd8da53a6e.db23ec62-02b0-43b4-b5aa-1d08ee550ea7 Aug 03 08:51:51 devstack sudo[110810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:51:51 devstack sudo[110810]: pam_unix(sudo:session): session closed for user root Aug 03 08:51:51 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-f09e6354-1c1d-42a6-8cd9-838b591fc254 tempest-TestVolumeBootPattern-702574089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c7e08fc1-6ddb-450f-ab86-f1fd8da53a6e.db23ec62-02b0-43b4-b5aa-1d08ee550ea7" returned: 0 in 0.255s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:51:51 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-f09e6354-1c1d-42a6-8cd9-838b591fc254 tempest-TestVolumeBootPattern-702574089 None] Lock "cinder-quobyte-c7e08fc1-6ddb-450f-ab86-f1fd8da53a6e" released by "delete_volume" :: held 0.299s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:51:51 devstack cinder-volume[88899]: DEBUG cinder.quota [None req-f09e6354-1c1d-42a6-8cd9-838b591fc254 tempest-TestVolumeBootPattern-702574089 None] Created reservations ['334cc98b-feea-4267-b1b4-6b6b0b8ecdf5', '633b6676-ed09-4629-9721-dcf5a49f3a30', 'f87805c6-8181-44ac-a01b-28404466f4cb', '8483f5da-c567-4109-ae06-9964e6ee4cae'] {{(pid=88899) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 08:51:51 devstack cinder-volume[88899]: DEBUG oslo_service.periodic_task [None req-f948fb4a-c4d7-499f-b1bd-8d6be3de0b53 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88899) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 03 08:51:51 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-f948fb4a-c4d7-499f-b1bd-8d6be3de0b53 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:51:51 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-f948fb4a-c4d7-499f-b1bd-8d6be3de0b53 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:51:51 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-f948fb4a-c4d7-499f-b1bd-8d6be3de0b53 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:51:51 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-f948fb4a-c4d7-499f-b1bd-8d6be3de0b53 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:51:51 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-f948fb4a-c4d7-499f-b1bd-8d6be3de0b53 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:51:51 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-f948fb4a-c4d7-499f-b1bd-8d6be3de0b53 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:51:51 devstack sudo[110813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a Aug 03 08:51:51 devstack sudo[110813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:51:52 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-f09e6354-1c1d-42a6-8cd9-838b591fc254 tempest-TestVolumeBootPattern-702574089 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:51:52 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-f09e6354-1c1d-42a6-8cd9-838b591fc254 tempest-TestVolumeBootPattern-702574089 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:51:52 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-f09e6354-1c1d-42a6-8cd9-838b591fc254 tempest-TestVolumeBootPattern-702574089 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:51:52 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-f09e6354-1c1d-42a6-8cd9-838b591fc254 tempest-TestVolumeBootPattern-702574089 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:51:52 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-f09e6354-1c1d-42a6-8cd9-838b591fc254 tempest-TestVolumeBootPattern-702574089 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:51:52 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-f09e6354-1c1d-42a6-8cd9-838b591fc254 tempest-TestVolumeBootPattern-702574089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:51:52 devstack sudo[110815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a Aug 03 08:51:52 devstack sudo[110815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:51:52 devstack sudo[110813]: pam_unix(sudo:session): session closed for user root Aug 03 08:51:52 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-f948fb4a-c4d7-499f-b1bd-8d6be3de0b53 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a" returned: 0 in 0.292s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:51:52 devstack cinder-volume[88899]: DEBUG cinder.manager [None req-f948fb4a-c4d7-499f-b1bd-8d6be3de0b53 None None] Notifying Schedulers of capabilities ... {{(pid=88899) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 08:51:52 devstack cinder-volume[88899]: DEBUG oslo_service.periodic_task [None req-f948fb4a-c4d7-499f-b1bd-8d6be3de0b53 None None] Running periodic task VolumeManager._thread_info {{(pid=88899) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 03 08:51:52 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-f948fb4a-c4d7-499f-b1bd-8d6be3de0b53 None None] thread count: 29 {{(pid=88899) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 03 08:51:52 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-f948fb4a-c4d7-499f-b1bd-8d6be3de0b53 None None] thread info: [<_MainThread(MainThread, started 132234320248960)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88899) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 03 08:51:52 devstack sudo[110815]: pam_unix(sudo:session): session closed for user root Aug 03 08:51:52 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-f09e6354-1c1d-42a6-8cd9-838b591fc254 tempest-TestVolumeBootPattern-702574089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a" returned: 0 in 0.269s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:51:52 devstack cinder-volume[88899]: DEBUG cinder.manager [None req-f09e6354-1c1d-42a6-8cd9-838b591fc254 tempest-TestVolumeBootPattern-702574089 None] Notifying Schedulers of capabilities ... {{(pid=88899) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 08:51:52 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-f09e6354-1c1d-42a6-8cd9-838b591fc254 tempest-TestVolumeBootPattern-702574089 None] Deleted volume successfully. Aug 03 08:51:52 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-f09e6354-1c1d-42a6-8cd9-838b591fc254 tempest-TestVolumeBootPattern-702574089 None] Lock "cinder-c7e08fc1-6ddb-450f-ab86-f1fd8da53a6e-delete_volume" released by "delete_volume" :: held 0.840s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:51:53 devstack cinder-volume[88899]: DEBUG cinder.volume.flows.manager.create_volume [None req-fac7b87a-fe13-4e49-b3dc-5bab029c41a6 tempest-TestVolumeBootPattern-702574089 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88899) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 08:51:53 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-fac7b87a-fe13-4e49-b3dc-5bab029c41a6 tempest-TestVolumeBootPattern-702574089 None] Flow 'volume_create_manager' (8e81aacf-9181-4d5c-b6bb-1facfa5da38d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:51:53 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-fac7b87a-fe13-4e49-b3dc-5bab029c41a6 tempest-TestVolumeBootPattern-702574089 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (50aae303-7f83-40c5-8a3b-616c53bf17bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:51:53 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-fac7b87a-fe13-4e49-b3dc-5bab029c41a6 tempest-TestVolumeBootPattern-702574089 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (50aae303-7f83-40c5-8a3b-616c53bf17bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:51:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestVolumeBootPattern-volume-origin-804559820',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=886ac27d-fbf7-4ff3-acab-5925150317a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f39c82555704844b062bd9116b8b7df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:51:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:51:53Z,use_quota=True,user_id='71532453450b4f31849b7ac6abc6354c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8bde7129-1dc4-42ab-b852-ab32c61b4921),volume_type_id=8bde7129-1dc4-42ab-b852-ab32c61b4921)' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:51:53 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-fac7b87a-fe13-4e49-b3dc-5bab029c41a6 tempest-TestVolumeBootPattern-702574089 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1fe4537-404e-4c66-a53a-6ad2563188e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:51:53 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-fac7b87a-fe13-4e49-b3dc-5bab029c41a6 tempest-TestVolumeBootPattern-702574089 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1fe4537-404e-4c66-a53a-6ad2563188e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:51:53 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-fac7b87a-fe13-4e49-b3dc-5bab029c41a6 tempest-TestVolumeBootPattern-702574089 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd3b12fb-6dde-43d2-8a4a-ebdd35f0bac9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:51:53 devstack cinder-volume[88899]: DEBUG cinder.image.glance [None req-fac7b87a-fe13-4e49-b3dc-5bab029c41a6 tempest-TestVolumeBootPattern-702574089 None] Creating Keystone auth plugin from conf {{(pid=88899) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Aug 03 08:51:53 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-fac7b87a-fe13-4e49-b3dc-5bab029c41a6 tempest-TestVolumeBootPattern-702574089 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd3b12fb-6dde-43d2-8a4a-ebdd35f0bac9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '886ac27d-fbf7-4ff3-acab-5925150317a5', 'volume_name': 'volume-886ac27d-fbf7-4ff3-acab-5925150317a5', 'volume_size': 1, 'image_id': '37045a76-b9b1-4156-b15f-85c62a8616c3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/37045a76-b9b1-4156-b15f-85c62a8616c3', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'adee82974e9f41769efcb3f4a0eef199', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '37045a76-b9b1-4156-b15f-85c62a8616c3', 'created_at': datetime.datetime(2026, 8, 3, 6, 23, 4, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 3, 6, 23, 6, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/37045a76-b9b1-4156-b15f-85c62a8616c3/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:51:53 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-fac7b87a-fe13-4e49-b3dc-5bab029c41a6 tempest-TestVolumeBootPattern-702574089 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f69ccd9b-d8c6-4023-8a73-2127ddc5d247) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:51:53 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-fac7b87a-fe13-4e49-b3dc-5bab029c41a6 tempest-TestVolumeBootPattern-702574089 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f69ccd9b-d8c6-4023-8a73-2127ddc5d247) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:51:53 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-fac7b87a-fe13-4e49-b3dc-5bab029c41a6 tempest-TestVolumeBootPattern-702574089 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae6bc393-8c90-47bf-9dcd-3db123508945) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:51:53 devstack cinder-volume[88899]: INFO cinder.volume.flows.manager.create_volume [None req-fac7b87a-fe13-4e49-b3dc-5bab029c41a6 tempest-TestVolumeBootPattern-702574089 None] Volume 886ac27d-fbf7-4ff3-acab-5925150317a5: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-886ac27d-fbf7-4ff3-acab-5925150317a5', 'volume_size': 1, 'image_id': '37045a76-b9b1-4156-b15f-85c62a8616c3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/37045a76-b9b1-4156-b15f-85c62a8616c3', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'adee82974e9f41769efcb3f4a0eef199', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '37045a76-b9b1-4156-b15f-85c62a8616c3', 'created_at': datetime.datetime(2026, 8, 3, 6, 23, 4, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 3, 6, 23, 6, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/37045a76-b9b1-4156-b15f-85c62a8616c3/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Aug 03 08:51:53 devstack cinder-volume[88899]: DEBUG cinder.volume.flows.manager.create_volume [None req-fac7b87a-fe13-4e49-b3dc-5bab029c41a6 tempest-TestVolumeBootPattern-702574089 None] Trying to clone 886ac27d-fbf7-4ff3-acab-5925150317a5 from image 37045a76-b9b1-4156-b15f-85c62a8616c3 at location (None, [{'url': 'file:///opt/stack/data/glance/images/37045a76-b9b1-4156-b15f-85c62a8616c3', 'metadata': {}}]). {{(pid=88899) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Aug 03 08:51:54 devstack cinder-volume[88899]: DEBUG cinder.image.image_utils [None req-fac7b87a-fe13-4e49-b3dc-5bab029c41a6 tempest-TestVolumeBootPattern-702574089 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_37045a76-b9b1-4156-b15f-85c62a8616c3_n8fa531ddevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=88899) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Aug 03 08:51:54 devstack cinder-volume[88899]: INFO cinder.image.image_utils [None req-fac7b87a-fe13-4e49-b3dc-5bab029c41a6 tempest-TestVolumeBootPattern-702574089 None] Image download 20.69 MB at 20.69 MB/s Aug 03 08:51:54 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb9aadb9-d2e0-496f-9431-bad5615662a8]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:51:54 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-fac7b87a-fe13-4e49-b3dc-5bab029c41a6 tempest-TestVolumeBootPattern-702574089 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_37045a76-b9b1-4156-b15f-85c62a8616c3_n8fa531ddevstack@QuobyteHD {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:51:54 devstack sudo[110820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_37045a76-b9b1-4156-b15f-85c62a8616c3_n8fa531ddevstack@QuobyteHD Aug 03 08:51:54 devstack sudo[110820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:51:54 devstack sudo[110820]: pam_unix(sudo:session): session closed for user root Aug 03 08:51:54 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-fac7b87a-fe13-4e49-b3dc-5bab029c41a6 tempest-TestVolumeBootPattern-702574089 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_37045a76-b9b1-4156-b15f-85c62a8616c3_n8fa531ddevstack@QuobyteHD" returned: 0 in 0.326s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:51:54 devstack cinder-volume[88899]: DEBUG cinder.image.image_utils [None req-fac7b87a-fe13-4e49-b3dc-5bab029c41a6 tempest-TestVolumeBootPattern-702574089 None] Temporary image 37045a76-b9b1-4156-b15f-85c62a8616c3 is fetched for user 71532453450b4f31849b7ac6abc6354c. {{(pid=88899) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Aug 03 08:51:54 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[9678a320-687e-42aa-ab2d-76569585ebef]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:51:54 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-fac7b87a-fe13-4e49-b3dc-5bab029c41a6 tempest-TestVolumeBootPattern-702574089 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_37045a76-b9b1-4156-b15f-85c62a8616c3_n8fa531ddevstack@QuobyteHD {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:51:54 devstack sudo[110825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_37045a76-b9b1-4156-b15f-85c62a8616c3_n8fa531ddevstack@QuobyteHD Aug 03 08:51:54 devstack sudo[110825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:51:54 devstack sudo[110825]: pam_unix(sudo:session): session closed for user root Aug 03 08:51:54 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-fac7b87a-fe13-4e49-b3dc-5bab029c41a6 tempest-TestVolumeBootPattern-702574089 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_37045a76-b9b1-4156-b15f-85c62a8616c3_n8fa531ddevstack@QuobyteHD" returned: 0 in 0.320s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:51:54 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-fac7b87a-fe13-4e49-b3dc-5bab029c41a6 tempest-TestVolumeBootPattern-702574089 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:51:54 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-fac7b87a-fe13-4e49-b3dc-5bab029c41a6 tempest-TestVolumeBootPattern-702574089 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:51:54 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-fac7b87a-fe13-4e49-b3dc-5bab029c41a6 tempest-TestVolumeBootPattern-702574089 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:51:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestVolumeBootPattern-volume-origin-804559820',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=886ac27d-fbf7-4ff3-acab-5925150317a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f39c82555704844b062bd9116b8b7df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:51:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:51:53Z,use_quota=True,user_id='71532453450b4f31849b7ac6abc6354c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8bde7129-1dc4-42ab-b852-ab32c61b4921),volume_type_id=8bde7129-1dc4-42ab-b852-ab32c61b4921)}" {{(pid=88899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 08:51:54 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-fac7b87a-fe13-4e49-b3dc-5bab029c41a6 tempest-TestVolumeBootPattern-702574089 None] Creating volume 886ac27d-fbf7-4ff3-acab-5925150317a5 {{(pid=88899) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 08:51:54 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-fac7b87a-fe13-4e49-b3dc-5bab029c41a6 tempest-TestVolumeBootPattern-702574089 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:51:54 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-fac7b87a-fe13-4e49-b3dc-5bab029c41a6 tempest-TestVolumeBootPattern-702574089 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:51:54 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-fac7b87a-fe13-4e49-b3dc-5bab029c41a6 tempest-TestVolumeBootPattern-702574089 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:51:54 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-fac7b87a-fe13-4e49-b3dc-5bab029c41a6 tempest-TestVolumeBootPattern-702574089 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:51:54 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-fac7b87a-fe13-4e49-b3dc-5bab029c41a6 tempest-TestVolumeBootPattern-702574089 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:51:54 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-fac7b87a-fe13-4e49-b3dc-5bab029c41a6 tempest-TestVolumeBootPattern-702574089 None] Selected osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385 as target Quobyte volume. {{(pid=88899) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 08:51:54 devstack cinder-volume[88899]: INFO cinder.volume.drivers.remotefs [None req-fac7b87a-fe13-4e49-b3dc-5bab029c41a6 tempest-TestVolumeBootPattern-702574089 None] casted to osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385 Aug 03 08:51:54 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-fac7b87a-fe13-4e49-b3dc-5bab029c41a6 tempest-TestVolumeBootPattern-702574089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-886ac27d-fbf7-4ff3-acab-5925150317a5 1073741824 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:51:54 devstack sudo[110830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-886ac27d-fbf7-4ff3-acab-5925150317a5 1073741824 Aug 03 08:51:54 devstack sudo[110830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:51:55 devstack sudo[110830]: pam_unix(sudo:session): session closed for user root Aug 03 08:51:55 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-fac7b87a-fe13-4e49-b3dc-5bab029c41a6 tempest-TestVolumeBootPattern-702574089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-886ac27d-fbf7-4ff3-acab-5925150317a5 1073741824" returned: 0 in 0.417s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:51:55 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-fac7b87a-fe13-4e49-b3dc-5bab029c41a6 tempest-TestVolumeBootPattern-702574089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-886ac27d-fbf7-4ff3-acab-5925150317a5 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:51:55 devstack sudo[110836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-886ac27d-fbf7-4ff3-acab-5925150317a5 Aug 03 08:51:55 devstack sudo[110836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:51:55 devstack sudo[110836]: pam_unix(sudo:session): session closed for user root Aug 03 08:51:55 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-fac7b87a-fe13-4e49-b3dc-5bab029c41a6 tempest-TestVolumeBootPattern-702574089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-886ac27d-fbf7-4ff3-acab-5925150317a5" returned: 0 in 0.258s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:51:55 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-fac7b87a-fe13-4e49-b3dc-5bab029c41a6 tempest-TestVolumeBootPattern-702574089 None] <== create_volume: return (718ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'} {{(pid=88899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 08:51:55 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-fac7b87a-fe13-4e49-b3dc-5bab029c41a6 tempest-TestVolumeBootPattern-702574089 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.721s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:51:55 devstack cinder-volume[88899]: DEBUG cinder.volume.volume_utils [None req-fac7b87a-fe13-4e49-b3dc-5bab029c41a6 tempest-TestVolumeBootPattern-702574089 None] Attempting download of 37045a76-b9b1-4156-b15f-85c62a8616c3 ((None, [{'url': 'file:///opt/stack/data/glance/images/37045a76-b9b1-4156-b15f-85c62a8616c3', 'metadata': {}}])) to volume 886ac27d-fbf7-4ff3-acab-5925150317a5. {{(pid=88899) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Aug 03 08:51:55 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef185e47-0b3d-47e1-9f24-0377d89bf791]: (4, 'raw') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:51:55 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-fac7b87a-fe13-4e49-b3dc-5bab029c41a6 tempest-TestVolumeBootPattern-702574089 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_37045a76-b9b1-4156-b15f-85c62a8616c3_p5ybilu1 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:51:55 devstack sudo[110839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_37045a76-b9b1-4156-b15f-85c62a8616c3_p5ybilu1 Aug 03 08:51:55 devstack sudo[110839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:51:55 devstack sudo[110839]: pam_unix(sudo:session): session closed for user root Aug 03 08:51:55 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-fac7b87a-fe13-4e49-b3dc-5bab029c41a6 tempest-TestVolumeBootPattern-702574089 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_37045a76-b9b1-4156-b15f-85c62a8616c3_p5ybilu1" returned: 0 in 0.355s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:51:55 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-fac7b87a-fe13-4e49-b3dc-5bab029c41a6 tempest-TestVolumeBootPattern-702574089 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_37045a76-b9b1-4156-b15f-85c62a8616c3_p5ybilu1 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:51:56 devstack sudo[110843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_37045a76-b9b1-4156-b15f-85c62a8616c3_p5ybilu1 Aug 03 08:51:56 devstack sudo[110843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:51:56 devstack sudo[110843]: pam_unix(sudo:session): session closed for user root Aug 03 08:51:56 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-fac7b87a-fe13-4e49-b3dc-5bab029c41a6 tempest-TestVolumeBootPattern-702574089 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_37045a76-b9b1-4156-b15f-85c62a8616c3_p5ybilu1" returned: 1 in 0.360s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:51:56 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-fac7b87a-fe13-4e49-b3dc-5bab029c41a6 tempest-TestVolumeBootPattern-702574089 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_37045a76-b9b1-4156-b15f-85c62a8616c3_p5ybilu1' failed. Not Retrying. {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 03 08:51:56 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[f13f5572-4ecf-4d9a-be58-f732c9b6430a]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:51:56 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-fac7b87a-fe13-4e49-b3dc-5bab029c41a6 tempest-TestVolumeBootPattern-702574089 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_37045a76-b9b1-4156-b15f-85c62a8616c3_n8fa531ddevstack@QuobyteHD {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:51:56 devstack sudo[110847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_37045a76-b9b1-4156-b15f-85c62a8616c3_n8fa531ddevstack@QuobyteHD Aug 03 08:51:56 devstack sudo[110847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:51:56 devstack sudo[110847]: pam_unix(sudo:session): session closed for user root Aug 03 08:51:56 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-fac7b87a-fe13-4e49-b3dc-5bab029c41a6 tempest-TestVolumeBootPattern-702574089 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_37045a76-b9b1-4156-b15f-85c62a8616c3_n8fa531ddevstack@QuobyteHD" returned: 0 in 0.334s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:51:56 devstack cinder-volume[88899]: DEBUG cinder.image.image_utils [None req-fac7b87a-fe13-4e49-b3dc-5bab029c41a6 tempest-TestVolumeBootPattern-702574089 None] 37045a76-b9b1-4156-b15f-85c62a8616c3 was qcow2, converting to qcow2 {{(pid=88899) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Aug 03 08:51:56 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-fac7b87a-fe13-4e49-b3dc-5bab029c41a6 tempest-TestVolumeBootPattern-702574089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_37045a76-b9b1-4156-b15f-85c62a8616c3_n8fa531ddevstack@QuobyteHD /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-886ac27d-fbf7-4ff3-acab-5925150317a5 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:51:56 devstack sudo[110852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_37045a76-b9b1-4156-b15f-85c62a8616c3_n8fa531ddevstack@QuobyteHD /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-886ac27d-fbf7-4ff3-acab-5925150317a5 Aug 03 08:51:56 devstack sudo[110852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:51:58 devstack sudo[110852]: pam_unix(sudo:session): session closed for user root Aug 03 08:51:58 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-fac7b87a-fe13-4e49-b3dc-5bab029c41a6 tempest-TestVolumeBootPattern-702574089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_37045a76-b9b1-4156-b15f-85c62a8616c3_n8fa531ddevstack@QuobyteHD /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-886ac27d-fbf7-4ff3-acab-5925150317a5" returned: 0 in 1.630s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:51:58 devstack cinder-volume[88899]: DEBUG cinder.image.image_utils [None req-fac7b87a-fe13-4e49-b3dc-5bab029c41a6 tempest-TestVolumeBootPattern-702574089 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_37045a76-b9b1-4156-b15f-85c62a8616c3_n8fa531ddevstack@QuobyteHD, size 112.00 MB, duration 1.63 sec, destination /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-886ac27d-fbf7-4ff3-acab-5925150317a5 {{(pid=88899) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 03 08:51:58 devstack cinder-volume[88899]: INFO cinder.image.image_utils [None req-fac7b87a-fe13-4e49-b3dc-5bab029c41a6 tempest-TestVolumeBootPattern-702574089 None] Converted 112.00 MB image at 68.67 MB/s Aug 03 08:51:58 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-fac7b87a-fe13-4e49-b3dc-5bab029c41a6 tempest-TestVolumeBootPattern-702574089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-886ac27d-fbf7-4ff3-acab-5925150317a5 1G {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:51:58 devstack sudo[110863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-886ac27d-fbf7-4ff3-acab-5925150317a5 1G Aug 03 08:51:58 devstack sudo[110863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:51:58 devstack sudo[110863]: pam_unix(sudo:session): session closed for user root Aug 03 08:51:58 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-fac7b87a-fe13-4e49-b3dc-5bab029c41a6 tempest-TestVolumeBootPattern-702574089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-886ac27d-fbf7-4ff3-acab-5925150317a5 1G" returned: 0 in 0.293s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:51:58 devstack cinder-volume[88899]: DEBUG cinder.volume.volume_utils [None req-fac7b87a-fe13-4e49-b3dc-5bab029c41a6 tempest-TestVolumeBootPattern-702574089 None] Downloaded image 37045a76-b9b1-4156-b15f-85c62a8616c3 ((None, [{'url': 'file:///opt/stack/data/glance/images/37045a76-b9b1-4156-b15f-85c62a8616c3', 'metadata': {}}])) to volume 886ac27d-fbf7-4ff3-acab-5925150317a5 successfully. {{(pid=88899) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Aug 03 08:51:58 devstack cinder-volume[88899]: DEBUG cinder.image.image_utils [None req-fac7b87a-fe13-4e49-b3dc-5bab029c41a6 tempest-TestVolumeBootPattern-702574089 None] Temporary image 37045a76-b9b1-4156-b15f-85c62a8616c3 for user 71532453450b4f31849b7ac6abc6354c is deleted. {{(pid=88899) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Aug 03 08:51:58 devstack cinder-volume[88899]: DEBUG cinder.volume.volume_utils [None req-fac7b87a-fe13-4e49-b3dc-5bab029c41a6 tempest-TestVolumeBootPattern-702574089 None] Marking volume 886ac27d-fbf7-4ff3-acab-5925150317a5 as bootable. {{(pid=88899) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Aug 03 08:51:58 devstack cinder-volume[88899]: DEBUG cinder.volume.flows.manager.create_volume [None req-fac7b87a-fe13-4e49-b3dc-5bab029c41a6 tempest-TestVolumeBootPattern-702574089 None] Copying metadata from image 37045a76-b9b1-4156-b15f-85c62a8616c3 to 886ac27d-fbf7-4ff3-acab-5925150317a5. {{(pid=88899) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Aug 03 08:51:58 devstack cinder-volume[88899]: DEBUG cinder.volume.flows.manager.create_volume [None req-fac7b87a-fe13-4e49-b3dc-5bab029c41a6 tempest-TestVolumeBootPattern-702574089 None] Creating volume glance metadata for volume 886ac27d-fbf7-4ff3-acab-5925150317a5 backed by image 37045a76-b9b1-4156-b15f-85c62a8616c3 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '37045a76-b9b1-4156-b15f-85c62a8616c3', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=88899) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Aug 03 08:51:58 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-fac7b87a-fe13-4e49-b3dc-5bab029c41a6 tempest-TestVolumeBootPattern-702574089 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae6bc393-8c90-47bf-9dcd-3db123508945) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-886ac27d-fbf7-4ff3-acab-5925150317a5', 'volume_size': 1, 'image_id': '37045a76-b9b1-4156-b15f-85c62a8616c3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/37045a76-b9b1-4156-b15f-85c62a8616c3', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'adee82974e9f41769efcb3f4a0eef199', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '37045a76-b9b1-4156-b15f-85c62a8616c3', 'created_at': datetime.datetime(2026, 8, 3, 6, 23, 4, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 3, 6, 23, 6, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/37045a76-b9b1-4156-b15f-85c62a8616c3/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:51:58 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-fac7b87a-fe13-4e49-b3dc-5bab029c41a6 tempest-TestVolumeBootPattern-702574089 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (445f770b-0365-4473-b908-310869a67cb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:51:58 devstack cinder-volume[88899]: INFO cinder.volume.flows.manager.create_volume [None req-fac7b87a-fe13-4e49-b3dc-5bab029c41a6 tempest-TestVolumeBootPattern-702574089 None] Volume volume-886ac27d-fbf7-4ff3-acab-5925150317a5 (886ac27d-fbf7-4ff3-acab-5925150317a5): created successfully Aug 03 08:51:58 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-fac7b87a-fe13-4e49-b3dc-5bab029c41a6 tempest-TestVolumeBootPattern-702574089 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (445f770b-0365-4473-b908-310869a67cb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:51:58 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-fac7b87a-fe13-4e49-b3dc-5bab029c41a6 tempest-TestVolumeBootPattern-702574089 None] Flow 'volume_create_manager' (8e81aacf-9181-4d5c-b6bb-1facfa5da38d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:51:58 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-fac7b87a-fe13-4e49-b3dc-5bab029c41a6 tempest-TestVolumeBootPattern-702574089 None] Created volume successfully. Aug 03 08:52:00 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-404fb385-f53e-47df-9045-98a1fae1d579 tempest-TestVolumeBootPattern-702574089 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:52:00 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-404fb385-f53e-47df-9045-98a1fae1d579 tempest-TestVolumeBootPattern-702574089 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:52:00 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-404fb385-f53e-47df-9045-98a1fae1d579 tempest-TestVolumeBootPattern-702574089 None] Creating offline snapshot becd85c6-c926-4e25-a807-34fb2d52712a of volume 886ac27d-fbf7-4ff3-acab-5925150317a5 {{(pid=88899) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 03 08:52:00 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc6a8f8f-3f64-4ee0-a89d-1a73848fde68]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:52:00 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-404fb385-f53e-47df-9045-98a1fae1d579 tempest-TestVolumeBootPattern-702574089 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-886ac27d-fbf7-4ff3-acab-5925150317a5 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:52:00 devstack sudo[110869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-886ac27d-fbf7-4ff3-acab-5925150317a5 Aug 03 08:52:00 devstack sudo[110869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:52:00 devstack sudo[110869]: pam_unix(sudo:session): session closed for user root Aug 03 08:52:00 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-404fb385-f53e-47df-9045-98a1fae1d579 tempest-TestVolumeBootPattern-702574089 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-886ac27d-fbf7-4ff3-acab-5925150317a5" returned: 0 in 0.350s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:52:00 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-404fb385-f53e-47df-9045-98a1fae1d579 tempest-TestVolumeBootPattern-702574089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-886ac27d-fbf7-4ff3-acab-5925150317a5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-886ac27d-fbf7-4ff3-acab-5925150317a5.becd85c6-c926-4e25-a807-34fb2d52712a 1G {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:52:00 devstack sudo[110874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-886ac27d-fbf7-4ff3-acab-5925150317a5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-886ac27d-fbf7-4ff3-acab-5925150317a5.becd85c6-c926-4e25-a807-34fb2d52712a 1G Aug 03 08:52:00 devstack sudo[110874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:52:00 devstack sudo[110874]: pam_unix(sudo:session): session closed for user root Aug 03 08:52:00 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-404fb385-f53e-47df-9045-98a1fae1d579 tempest-TestVolumeBootPattern-702574089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-886ac27d-fbf7-4ff3-acab-5925150317a5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-886ac27d-fbf7-4ff3-acab-5925150317a5.becd85c6-c926-4e25-a807-34fb2d52712a 1G" returned: 0 in 0.390s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:52:00 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-404fb385-f53e-47df-9045-98a1fae1d579 tempest-TestVolumeBootPattern-702574089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-886ac27d-fbf7-4ff3-acab-5925150317a5 -F qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-886ac27d-fbf7-4ff3-acab-5925150317a5.becd85c6-c926-4e25-a807-34fb2d52712a {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:52:00 devstack sudo[110879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-886ac27d-fbf7-4ff3-acab-5925150317a5 -F qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-886ac27d-fbf7-4ff3-acab-5925150317a5.becd85c6-c926-4e25-a807-34fb2d52712a Aug 03 08:52:00 devstack sudo[110879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:52:01 devstack sudo[110879]: pam_unix(sudo:session): session closed for user root Aug 03 08:52:01 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-404fb385-f53e-47df-9045-98a1fae1d579 tempest-TestVolumeBootPattern-702574089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-886ac27d-fbf7-4ff3-acab-5925150317a5 -F qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-886ac27d-fbf7-4ff3-acab-5925150317a5.becd85c6-c926-4e25-a807-34fb2d52712a" returned: 0 in 0.283s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:52:01 devstack cinder-volume[88899]: WARNING cinder.volume.drivers.remotefs [None req-404fb385-f53e-47df-9045-98a1fae1d579 tempest-TestVolumeBootPattern-702574089 None] /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-886ac27d-fbf7-4ff3-acab-5925150317a5.becd85c6-c926-4e25-a807-34fb2d52712a is being set with open permissions: ugo+rw Aug 03 08:52:01 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-404fb385-f53e-47df-9045-98a1fae1d579 tempest-TestVolumeBootPattern-702574089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-886ac27d-fbf7-4ff3-acab-5925150317a5.becd85c6-c926-4e25-a807-34fb2d52712a {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:52:01 devstack sudo[110884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-886ac27d-fbf7-4ff3-acab-5925150317a5.becd85c6-c926-4e25-a807-34fb2d52712a Aug 03 08:52:01 devstack sudo[110884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:52:01 devstack sudo[110884]: pam_unix(sudo:session): session closed for user root Aug 03 08:52:01 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-404fb385-f53e-47df-9045-98a1fae1d579 tempest-TestVolumeBootPattern-702574089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-886ac27d-fbf7-4ff3-acab-5925150317a5.becd85c6-c926-4e25-a807-34fb2d52712a" returned: 0 in 0.231s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:52:01 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-404fb385-f53e-47df-9045-98a1fae1d579 tempest-TestVolumeBootPattern-702574089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-886ac27d-fbf7-4ff3-acab-5925150317a5.info {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:52:01 devstack sudo[110887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-886ac27d-fbf7-4ff3-acab-5925150317a5.info Aug 03 08:52:01 devstack sudo[110887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:52:01 devstack sudo[110887]: pam_unix(sudo:session): session closed for user root Aug 03 08:52:01 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-404fb385-f53e-47df-9045-98a1fae1d579 tempest-TestVolumeBootPattern-702574089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-886ac27d-fbf7-4ff3-acab-5925150317a5.info" returned: 0 in 0.245s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:52:01 devstack cinder-volume[88899]: WARNING cinder.volume.drivers.remotefs [None req-404fb385-f53e-47df-9045-98a1fae1d579 tempest-TestVolumeBootPattern-702574089 None] /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-886ac27d-fbf7-4ff3-acab-5925150317a5.info is being set with open permissions: ugo+rw Aug 03 08:52:01 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-404fb385-f53e-47df-9045-98a1fae1d579 tempest-TestVolumeBootPattern-702574089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-886ac27d-fbf7-4ff3-acab-5925150317a5.info {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:52:01 devstack sudo[110890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-886ac27d-fbf7-4ff3-acab-5925150317a5.info Aug 03 08:52:01 devstack sudo[110890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:52:01 devstack sudo[110890]: pam_unix(sudo:session): session closed for user root Aug 03 08:52:01 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-404fb385-f53e-47df-9045-98a1fae1d579 tempest-TestVolumeBootPattern-702574089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-886ac27d-fbf7-4ff3-acab-5925150317a5.info" returned: 0 in 0.231s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:52:01 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-404fb385-f53e-47df-9045-98a1fae1d579 tempest-TestVolumeBootPattern-702574089 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.813s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:52:01 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-404fb385-f53e-47df-9045-98a1fae1d579 tempest-TestVolumeBootPattern-702574089 None] Create snapshot completed successfully Aug 03 08:52:04 devstack cinder-volume[88899]: DEBUG cinder.volume.flows.manager.create_volume [req-9664b208-bbb0-41fe-8f7f-08b3f54d06b5 req-52aed880-e571-44e3-958d-7255db9539e1 tempest-TestVolumeBootPattern-702574089 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88899) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 08:52:04 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [req-9664b208-bbb0-41fe-8f7f-08b3f54d06b5 req-52aed880-e571-44e3-958d-7255db9539e1 tempest-TestVolumeBootPattern-702574089 None] Flow 'volume_create_manager' (52f9b7ba-ab19-436e-97f4-8ed35b7aa30b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:52:04 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [req-9664b208-bbb0-41fe-8f7f-08b3f54d06b5 req-52aed880-e571-44e3-958d-7255db9539e1 tempest-TestVolumeBootPattern-702574089 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5bf45f38-54c4-4062-bdba-4c2c884ecbfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:52:04 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [req-9664b208-bbb0-41fe-8f7f-08b3f54d06b5 req-52aed880-e571-44e3-958d-7255db9539e1 tempest-TestVolumeBootPattern-702574089 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5bf45f38-54c4-4062-bdba-4c2c884ecbfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=True,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:52:04Z,deleted=False,deleted_at=None,display_description='',display_name='',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=268630e5-6c5a-439c-8588-3c9643279474,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f39c82555704844b062bd9116b8b7df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:52:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=becd85c6-c926-4e25-a807-34fb2d52712a,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:52:05Z,use_quota=True,user_id='71532453450b4f31849b7ac6abc6354c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8bde7129-1dc4-42ab-b852-ab32c61b4921),volume_type_id=8bde7129-1dc4-42ab-b852-ab32c61b4921)' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:52:04 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [req-9664b208-bbb0-41fe-8f7f-08b3f54d06b5 req-52aed880-e571-44e3-958d-7255db9539e1 tempest-TestVolumeBootPattern-702574089 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8573ca23-681a-4443-a7da-22063ca84c44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:52:04 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [req-9664b208-bbb0-41fe-8f7f-08b3f54d06b5 req-52aed880-e571-44e3-958d-7255db9539e1 tempest-TestVolumeBootPattern-702574089 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8573ca23-681a-4443-a7da-22063ca84c44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:52:04 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [req-9664b208-bbb0-41fe-8f7f-08b3f54d06b5 req-52aed880-e571-44e3-958d-7255db9539e1 tempest-TestVolumeBootPattern-702574089 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (568c8d54-d9da-4225-bc80-5bb818152b61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:52:04 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [req-9664b208-bbb0-41fe-8f7f-08b3f54d06b5 req-52aed880-e571-44e3-958d-7255db9539e1 tempest-TestVolumeBootPattern-702574089 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (568c8d54-d9da-4225-bc80-5bb818152b61) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '268630e5-6c5a-439c-8588-3c9643279474', 'volume_name': 'volume-268630e5-6c5a-439c-8588-3c9643279474', 'volume_size': 1, 'snapshot_id': 'becd85c6-c926-4e25-a807-34fb2d52712a'}' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:52:04 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [req-9664b208-bbb0-41fe-8f7f-08b3f54d06b5 req-52aed880-e571-44e3-958d-7255db9539e1 tempest-TestVolumeBootPattern-702574089 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a92b4311-e71d-4584-8e42-0859e05ec6a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:52:04 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [req-9664b208-bbb0-41fe-8f7f-08b3f54d06b5 req-52aed880-e571-44e3-958d-7255db9539e1 tempest-TestVolumeBootPattern-702574089 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a92b4311-e71d-4584-8e42-0859e05ec6a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:52:04 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [req-9664b208-bbb0-41fe-8f7f-08b3f54d06b5 req-52aed880-e571-44e3-958d-7255db9539e1 tempest-TestVolumeBootPattern-702574089 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9e27be4-9e35-45cd-a1f2-1d253d032d60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:52:04 devstack cinder-volume[88899]: INFO cinder.volume.flows.manager.create_volume [req-9664b208-bbb0-41fe-8f7f-08b3f54d06b5 req-52aed880-e571-44e3-958d-7255db9539e1 tempest-TestVolumeBootPattern-702574089 None] Volume 268630e5-6c5a-439c-8588-3c9643279474: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-268630e5-6c5a-439c-8588-3c9643279474', 'volume_size': 1, 'snapshot_id': 'becd85c6-c926-4e25-a807-34fb2d52712a'} Aug 03 08:52:04 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [req-9664b208-bbb0-41fe-8f7f-08b3f54d06b5 req-52aed880-e571-44e3-958d-7255db9539e1 tempest-TestVolumeBootPattern-702574089 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:52:04 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [req-9664b208-bbb0-41fe-8f7f-08b3f54d06b5 req-52aed880-e571-44e3-958d-7255db9539e1 tempest-TestVolumeBootPattern-702574089 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:52:04 devstack cinder-volume[88899]: DEBUG cinder.coordination [req-9664b208-bbb0-41fe-8f7f-08b3f54d06b5 req-52aed880-e571-44e3-958d-7255db9539e1 tempest-TestVolumeBootPattern-702574089 None] Acquiring lock "cinder-quobyte-becd85c6-c926-4e25-a807-34fb2d52712a-268630e5-6c5a-439c-8588-3c9643279474" by "_create_volume_from_snapshot" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:52:04 devstack cinder-volume[88899]: DEBUG cinder.coordination [req-9664b208-bbb0-41fe-8f7f-08b3f54d06b5 req-52aed880-e571-44e3-958d-7255db9539e1 tempest-TestVolumeBootPattern-702574089 None] Lock "cinder-quobyte-becd85c6-c926-4e25-a807-34fb2d52712a-268630e5-6c5a-439c-8588-3c9643279474" acquired by "_create_volume_from_snapshot" :: waited 0.019s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:52:04 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [req-9664b208-bbb0-41fe-8f7f-08b3f54d06b5 req-52aed880-e571-44e3-958d-7255db9539e1 tempest-TestVolumeBootPattern-702574089 None] Creating volume 268630e5-6c5a-439c-8588-3c9643279474 from snapshot becd85c6-c926-4e25-a807-34fb2d52712a {{(pid=88899) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Aug 03 08:52:04 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [req-9664b208-bbb0-41fe-8f7f-08b3f54d06b5 req-52aed880-e571-44e3-958d-7255db9539e1 tempest-TestVolumeBootPattern-702574089 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:52:04 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [req-9664b208-bbb0-41fe-8f7f-08b3f54d06b5 req-52aed880-e571-44e3-958d-7255db9539e1 tempest-TestVolumeBootPattern-702574089 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:52:04 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [req-9664b208-bbb0-41fe-8f7f-08b3f54d06b5 req-52aed880-e571-44e3-958d-7255db9539e1 tempest-TestVolumeBootPattern-702574089 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:52:04 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [req-9664b208-bbb0-41fe-8f7f-08b3f54d06b5 req-52aed880-e571-44e3-958d-7255db9539e1 tempest-TestVolumeBootPattern-702574089 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:52:04 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [req-9664b208-bbb0-41fe-8f7f-08b3f54d06b5 req-52aed880-e571-44e3-958d-7255db9539e1 tempest-TestVolumeBootPattern-702574089 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:52:04 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [req-9664b208-bbb0-41fe-8f7f-08b3f54d06b5 req-52aed880-e571-44e3-958d-7255db9539e1 tempest-TestVolumeBootPattern-702574089 None] Selected osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385 as target Quobyte volume. {{(pid=88899) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 08:52:04 devstack cinder-volume[88899]: DEBUG cinder.coordination [req-9664b208-bbb0-41fe-8f7f-08b3f54d06b5 req-52aed880-e571-44e3-958d-7255db9539e1 tempest-TestVolumeBootPattern-702574089 None] Acquiring lock "cinder-quobyte-268630e5-6c5a-439c-8588-3c9643279474" by "_copy_volume_from_snapshot" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:52:05 devstack cinder-volume[88899]: DEBUG cinder.coordination [req-9664b208-bbb0-41fe-8f7f-08b3f54d06b5 req-52aed880-e571-44e3-958d-7255db9539e1 tempest-TestVolumeBootPattern-702574089 None] Lock "cinder-quobyte-268630e5-6c5a-439c-8588-3c9643279474" acquired by "_copy_volume_from_snapshot" :: waited 0.014s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:52:05 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [req-9664b208-bbb0-41fe-8f7f-08b3f54d06b5 req-52aed880-e571-44e3-958d-7255db9539e1 tempest-TestVolumeBootPattern-702574089 None] snapshot: becd85c6-c926-4e25-a807-34fb2d52712a, volume: 268630e5-6c5a-439c-8588-3c9643279474, {{(pid=88899) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Aug 03 08:52:05 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [req-9664b208-bbb0-41fe-8f7f-08b3f54d06b5 req-52aed880-e571-44e3-958d-7255db9539e1 tempest-TestVolumeBootPattern-702574089 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:52:05 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [req-9664b208-bbb0-41fe-8f7f-08b3f54d06b5 req-52aed880-e571-44e3-958d-7255db9539e1 tempest-TestVolumeBootPattern-702574089 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:52:05 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [req-9664b208-bbb0-41fe-8f7f-08b3f54d06b5 req-52aed880-e571-44e3-958d-7255db9539e1 tempest-TestVolumeBootPattern-702574089 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:52:05 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [req-9664b208-bbb0-41fe-8f7f-08b3f54d06b5 req-52aed880-e571-44e3-958d-7255db9539e1 tempest-TestVolumeBootPattern-702574089 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:52:05 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [req-9664b208-bbb0-41fe-8f7f-08b3f54d06b5 req-52aed880-e571-44e3-958d-7255db9539e1 tempest-TestVolumeBootPattern-702574089 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:52:05 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed807ae4-3877-4162-bdd9-2e709bf533c1]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:52:05 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [req-9664b208-bbb0-41fe-8f7f-08b3f54d06b5 req-52aed880-e571-44e3-958d-7255db9539e1 tempest-TestVolumeBootPattern-702574089 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-886ac27d-fbf7-4ff3-acab-5925150317a5.becd85c6-c926-4e25-a807-34fb2d52712a {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:52:05 devstack sudo[110897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-886ac27d-fbf7-4ff3-acab-5925150317a5.becd85c6-c926-4e25-a807-34fb2d52712a Aug 03 08:52:05 devstack sudo[110897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:52:05 devstack sudo[110897]: pam_unix(sudo:session): session closed for user root Aug 03 08:52:05 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [req-9664b208-bbb0-41fe-8f7f-08b3f54d06b5 req-52aed880-e571-44e3-958d-7255db9539e1 tempest-TestVolumeBootPattern-702574089 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-886ac27d-fbf7-4ff3-acab-5925150317a5.becd85c6-c926-4e25-a807-34fb2d52712a" returned: 0 in 0.449s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:52:05 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [req-9664b208-bbb0-41fe-8f7f-08b3f54d06b5 req-52aed880-e571-44e3-958d-7255db9539e1 tempest-TestVolumeBootPattern-702574089 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-886ac27d-fbf7-4ff3-acab-5925150317a5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88899) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 03 08:52:05 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd065e45-3072-422c-81f6-af46289e403a]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:52:05 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [req-9664b208-bbb0-41fe-8f7f-08b3f54d06b5 req-52aed880-e571-44e3-958d-7255db9539e1 tempest-TestVolumeBootPattern-702574089 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-886ac27d-fbf7-4ff3-acab-5925150317a5 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:52:05 devstack sudo[110902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-886ac27d-fbf7-4ff3-acab-5925150317a5 Aug 03 08:52:05 devstack sudo[110902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:52:05 devstack sudo[110902]: pam_unix(sudo:session): session closed for user root Aug 03 08:52:05 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [req-9664b208-bbb0-41fe-8f7f-08b3f54d06b5 req-52aed880-e571-44e3-958d-7255db9539e1 tempest-TestVolumeBootPattern-702574089 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-886ac27d-fbf7-4ff3-acab-5925150317a5" returned: 0 in 0.385s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:52:05 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [req-9664b208-bbb0-41fe-8f7f-08b3f54d06b5 req-52aed880-e571-44e3-958d-7255db9539e1 tempest-TestVolumeBootPattern-702574089 None] will copy from snapshot at /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-886ac27d-fbf7-4ff3-acab-5925150317a5 {{(pid=88899) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Aug 03 08:52:05 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [req-9664b208-bbb0-41fe-8f7f-08b3f54d06b5 req-52aed880-e571-44e3-958d-7255db9539e1 tempest-TestVolumeBootPattern-702574089 None] Creating direct copy from snapshot {{(pid=88899) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Aug 03 08:52:05 devstack cinder-volume[88899]: DEBUG cinder.utils [req-9664b208-bbb0-41fe-8f7f-08b3f54d06b5 req-52aed880-e571-44e3-958d-7255db9539e1 tempest-TestVolumeBootPattern-702574089 None] Path /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-268630e5-6c5a-439c-8588-3c9643279474 not found in is_blk_device check {{(pid=88899) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Aug 03 08:52:05 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [req-9664b208-bbb0-41fe-8f7f-08b3f54d06b5 req-52aed880-e571-44e3-958d-7255db9539e1 tempest-TestVolumeBootPattern-702574089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-886ac27d-fbf7-4ff3-acab-5925150317a5 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-268630e5-6c5a-439c-8588-3c9643279474 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:52:05 devstack sudo[110920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-886ac27d-fbf7-4ff3-acab-5925150317a5 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-268630e5-6c5a-439c-8588-3c9643279474 Aug 03 08:52:05 devstack sudo[110920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:52:07 devstack sudo[110920]: pam_unix(sudo:session): session closed for user root Aug 03 08:52:07 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [req-9664b208-bbb0-41fe-8f7f-08b3f54d06b5 req-52aed880-e571-44e3-958d-7255db9539e1 tempest-TestVolumeBootPattern-702574089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-886ac27d-fbf7-4ff3-acab-5925150317a5 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-268630e5-6c5a-439c-8588-3c9643279474" returned: 0 in 1.302s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:52:07 devstack cinder-volume[88899]: DEBUG cinder.image.image_utils [req-9664b208-bbb0-41fe-8f7f-08b3f54d06b5 req-52aed880-e571-44e3-958d-7255db9539e1 tempest-TestVolumeBootPattern-702574089 None] Image conversion details: src /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-886ac27d-fbf7-4ff3-acab-5925150317a5, size 1024.00 MB, duration 1.30 sec, destination /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-268630e5-6c5a-439c-8588-3c9643279474 {{(pid=88899) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 03 08:52:07 devstack cinder-volume[88899]: INFO cinder.image.image_utils [req-9664b208-bbb0-41fe-8f7f-08b3f54d06b5 req-52aed880-e571-44e3-958d-7255db9539e1 tempest-TestVolumeBootPattern-702574089 None] Converted 1024.00 MB image at 785.70 MB/s Aug 03 08:52:07 devstack cinder-volume[88899]: WARNING cinder.volume.drivers.remotefs [req-9664b208-bbb0-41fe-8f7f-08b3f54d06b5 req-52aed880-e571-44e3-958d-7255db9539e1 tempest-TestVolumeBootPattern-702574089 None] /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-268630e5-6c5a-439c-8588-3c9643279474 is being set with open permissions: ugo+rw Aug 03 08:52:07 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [req-9664b208-bbb0-41fe-8f7f-08b3f54d06b5 req-52aed880-e571-44e3-958d-7255db9539e1 tempest-TestVolumeBootPattern-702574089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-268630e5-6c5a-439c-8588-3c9643279474 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:52:07 devstack sudo[110954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-268630e5-6c5a-439c-8588-3c9643279474 Aug 03 08:52:07 devstack sudo[110954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:52:07 devstack sudo[110954]: pam_unix(sudo:session): session closed for user root Aug 03 08:52:07 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [req-9664b208-bbb0-41fe-8f7f-08b3f54d06b5 req-52aed880-e571-44e3-958d-7255db9539e1 tempest-TestVolumeBootPattern-702574089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-268630e5-6c5a-439c-8588-3c9643279474" returned: 0 in 0.247s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:52:07 devstack cinder-volume[88899]: DEBUG cinder.coordination [req-9664b208-bbb0-41fe-8f7f-08b3f54d06b5 req-52aed880-e571-44e3-958d-7255db9539e1 tempest-TestVolumeBootPattern-702574089 None] Lock "cinder-quobyte-268630e5-6c5a-439c-8588-3c9643279474" released by "_copy_volume_from_snapshot" :: held 2.473s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:52:07 devstack cinder-volume[88899]: DEBUG cinder.coordination [req-9664b208-bbb0-41fe-8f7f-08b3f54d06b5 req-52aed880-e571-44e3-958d-7255db9539e1 tempest-TestVolumeBootPattern-702574089 None] Lock "cinder-quobyte-becd85c6-c926-4e25-a807-34fb2d52712a-268630e5-6c5a-439c-8588-3c9643279474" released by "_create_volume_from_snapshot" :: held 2.533s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:52:07 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [req-9664b208-bbb0-41fe-8f7f-08b3f54d06b5 req-52aed880-e571-44e3-958d-7255db9539e1 tempest-TestVolumeBootPattern-702574089 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 2.553s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:52:07 devstack cinder-volume[88899]: DEBUG cinder.volume.volume_utils [req-9664b208-bbb0-41fe-8f7f-08b3f54d06b5 req-52aed880-e571-44e3-958d-7255db9539e1 tempest-TestVolumeBootPattern-702574089 None] Marking volume 268630e5-6c5a-439c-8588-3c9643279474 as bootable. {{(pid=88899) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Aug 03 08:52:07 devstack cinder-volume[88899]: DEBUG cinder.volume.flows.manager.create_volume [req-9664b208-bbb0-41fe-8f7f-08b3f54d06b5 req-52aed880-e571-44e3-958d-7255db9539e1 tempest-TestVolumeBootPattern-702574089 None] Copying metadata from snapshot becd85c6-c926-4e25-a807-34fb2d52712a to 268630e5-6c5a-439c-8588-3c9643279474. {{(pid=88899) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:429}} Aug 03 08:52:07 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [req-9664b208-bbb0-41fe-8f7f-08b3f54d06b5 req-52aed880-e571-44e3-958d-7255db9539e1 tempest-TestVolumeBootPattern-702574089 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9e27be4-9e35-45cd-a1f2-1d253d032d60) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-268630e5-6c5a-439c-8588-3c9643279474', 'volume_size': 1, 'snapshot_id': 'becd85c6-c926-4e25-a807-34fb2d52712a'}' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:52:07 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [req-9664b208-bbb0-41fe-8f7f-08b3f54d06b5 req-52aed880-e571-44e3-958d-7255db9539e1 tempest-TestVolumeBootPattern-702574089 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a5cecba-2a6d-4c7e-9f30-6c7ff23731ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:52:07 devstack cinder-volume[88899]: INFO cinder.volume.flows.manager.create_volume [req-9664b208-bbb0-41fe-8f7f-08b3f54d06b5 req-52aed880-e571-44e3-958d-7255db9539e1 tempest-TestVolumeBootPattern-702574089 None] Volume volume-268630e5-6c5a-439c-8588-3c9643279474 (268630e5-6c5a-439c-8588-3c9643279474): created successfully Aug 03 08:52:07 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [req-9664b208-bbb0-41fe-8f7f-08b3f54d06b5 req-52aed880-e571-44e3-958d-7255db9539e1 tempest-TestVolumeBootPattern-702574089 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a5cecba-2a6d-4c7e-9f30-6c7ff23731ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:52:07 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [req-9664b208-bbb0-41fe-8f7f-08b3f54d06b5 req-52aed880-e571-44e3-958d-7255db9539e1 tempest-TestVolumeBootPattern-702574089 None] Flow 'volume_create_manager' (52f9b7ba-ab19-436e-97f4-8ed35b7aa30b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:52:07 devstack cinder-volume[88899]: INFO cinder.volume.manager [req-9664b208-bbb0-41fe-8f7f-08b3f54d06b5 req-52aed880-e571-44e3-958d-7255db9539e1 tempest-TestVolumeBootPattern-702574089 None] Created volume successfully. Aug 03 08:52:08 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [req-9664b208-bbb0-41fe-8f7f-08b3f54d06b5 req-eb8ddb20-1942-4c0e-b3d4-b0bf70aa66b2 tempest-TestVolumeBootPattern-702574089 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:52:08 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [req-9664b208-bbb0-41fe-8f7f-08b3f54d06b5 req-eb8ddb20-1942-4c0e-b3d4-b0bf70aa66b2 tempest-TestVolumeBootPattern-702574089 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:52:08 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [req-9664b208-bbb0-41fe-8f7f-08b3f54d06b5 req-eb8ddb20-1942-4c0e-b3d4-b0bf70aa66b2 tempest-TestVolumeBootPattern-702574089 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.013s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:52:08 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [req-9664b208-bbb0-41fe-8f7f-08b3f54d06b5 req-eb8ddb20-1942-4c0e-b3d4-b0bf70aa66b2 tempest-TestVolumeBootPattern-702574089 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385', 'name': 'volume-268630e5-6c5a-439c-8588-3c9643279474', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ce7ff26a-834f-40a1-a388-584a748e22d3', 'enforce_multipath': True} {{(pid=88899) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 03 08:52:08 devstack cinder-volume[88899]: INFO cinder.volume.manager [req-9664b208-bbb0-41fe-8f7f-08b3f54d06b5 req-eb8ddb20-1942-4c0e-b3d4-b0bf70aa66b2 tempest-TestVolumeBootPattern-702574089 None] attachment_update completed successfully. Aug 03 08:52:13 devstack cinder-volume[88899]: INFO cinder.volume.manager [req-e4012b22-daa0-4da9-a89b-645707fb43b6 req-58d6860d-872b-490e-8c9f-1aabe0c791d2 tempest-TestVolumeBootPattern-702574089 None] Terminate volume connection completed successfully. Aug 03 08:52:13 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [req-e4012b22-daa0-4da9-a89b-645707fb43b6 req-58d6860d-872b-490e-8c9f-1aabe0c791d2 tempest-TestVolumeBootPattern-702574089 None] Deleting attachment ce7ff26a-834f-40a1-a388-584a748e22d3. {{(pid=88899) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 03 08:52:14 devstack cinder-volume[88899]: DEBUG cinder.coordination [req-e4012b22-daa0-4da9-a89b-645707fb43b6 req-b2cf7b2a-ffe1-40a5-8a83-e6edb1e9036c tempest-TestVolumeBootPattern-702574089 None] Acquiring lock "cinder-268630e5-6c5a-439c-8588-3c9643279474-delete_volume" by "delete_volume" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:52:14 devstack cinder-volume[88899]: DEBUG cinder.coordination [req-e4012b22-daa0-4da9-a89b-645707fb43b6 req-b2cf7b2a-ffe1-40a5-8a83-e6edb1e9036c tempest-TestVolumeBootPattern-702574089 None] Lock "cinder-268630e5-6c5a-439c-8588-3c9643279474-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:52:14 devstack cinder-volume[88899]: DEBUG cinder.coordination [req-e4012b22-daa0-4da9-a89b-645707fb43b6 req-b2cf7b2a-ffe1-40a5-8a83-e6edb1e9036c tempest-TestVolumeBootPattern-702574089 None] Acquiring lock "cinder-quobyte-268630e5-6c5a-439c-8588-3c9643279474" by "delete_volume" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:52:14 devstack cinder-volume[88899]: DEBUG cinder.coordination [req-e4012b22-daa0-4da9-a89b-645707fb43b6 req-b2cf7b2a-ffe1-40a5-8a83-e6edb1e9036c tempest-TestVolumeBootPattern-702574089 None] Lock "cinder-quobyte-268630e5-6c5a-439c-8588-3c9643279474" acquired by "delete_volume" :: waited 0.029s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:52:14 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[7851a062-6e0a-4b20-a09e-a9cf90e91dd1]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:52:14 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [req-e4012b22-daa0-4da9-a89b-645707fb43b6 req-b2cf7b2a-ffe1-40a5-8a83-e6edb1e9036c tempest-TestVolumeBootPattern-702574089 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-268630e5-6c5a-439c-8588-3c9643279474 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:52:14 devstack sudo[111482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-268630e5-6c5a-439c-8588-3c9643279474 Aug 03 08:52:14 devstack sudo[111482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:52:14 devstack sudo[111482]: pam_unix(sudo:session): session closed for user root Aug 03 08:52:14 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [req-e4012b22-daa0-4da9-a89b-645707fb43b6 req-b2cf7b2a-ffe1-40a5-8a83-e6edb1e9036c tempest-TestVolumeBootPattern-702574089 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-268630e5-6c5a-439c-8588-3c9643279474" returned: 0 in 0.401s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:52:14 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [req-e4012b22-daa0-4da9-a89b-645707fb43b6 req-b2cf7b2a-ffe1-40a5-8a83-e6edb1e9036c tempest-TestVolumeBootPattern-702574089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-268630e5-6c5a-439c-8588-3c9643279474 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:52:14 devstack sudo[111487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-268630e5-6c5a-439c-8588-3c9643279474 Aug 03 08:52:14 devstack sudo[111487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:52:14 devstack sudo[111487]: pam_unix(sudo:session): session closed for user root Aug 03 08:52:14 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [req-e4012b22-daa0-4da9-a89b-645707fb43b6 req-b2cf7b2a-ffe1-40a5-8a83-e6edb1e9036c tempest-TestVolumeBootPattern-702574089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-268630e5-6c5a-439c-8588-3c9643279474" returned: 0 in 0.246s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:52:14 devstack cinder-volume[88899]: DEBUG cinder.coordination [req-e4012b22-daa0-4da9-a89b-645707fb43b6 req-b2cf7b2a-ffe1-40a5-8a83-e6edb1e9036c tempest-TestVolumeBootPattern-702574089 None] Lock "cinder-quobyte-268630e5-6c5a-439c-8588-3c9643279474" released by "delete_volume" :: held 0.715s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:52:14 devstack cinder-volume[88899]: DEBUG cinder.quota [req-e4012b22-daa0-4da9-a89b-645707fb43b6 req-b2cf7b2a-ffe1-40a5-8a83-e6edb1e9036c tempest-TestVolumeBootPattern-702574089 None] Created reservations ['c2df658c-932a-4822-abdd-d1bad2c3298b', '04b4073f-0e09-433f-8a9c-3ee76e30ecf1', '026f0623-9d73-42cf-a7c7-54a7499049f0', '4d273b6f-4cd9-4ee5-af8f-85117360c609'] {{(pid=88899) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 08:52:15 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [req-e4012b22-daa0-4da9-a89b-645707fb43b6 req-b2cf7b2a-ffe1-40a5-8a83-e6edb1e9036c tempest-TestVolumeBootPattern-702574089 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:52:15 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [req-e4012b22-daa0-4da9-a89b-645707fb43b6 req-b2cf7b2a-ffe1-40a5-8a83-e6edb1e9036c tempest-TestVolumeBootPattern-702574089 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:52:15 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [req-e4012b22-daa0-4da9-a89b-645707fb43b6 req-b2cf7b2a-ffe1-40a5-8a83-e6edb1e9036c tempest-TestVolumeBootPattern-702574089 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:52:15 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [req-e4012b22-daa0-4da9-a89b-645707fb43b6 req-b2cf7b2a-ffe1-40a5-8a83-e6edb1e9036c tempest-TestVolumeBootPattern-702574089 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:52:15 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [req-e4012b22-daa0-4da9-a89b-645707fb43b6 req-b2cf7b2a-ffe1-40a5-8a83-e6edb1e9036c tempest-TestVolumeBootPattern-702574089 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:52:15 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [req-e4012b22-daa0-4da9-a89b-645707fb43b6 req-b2cf7b2a-ffe1-40a5-8a83-e6edb1e9036c tempest-TestVolumeBootPattern-702574089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:52:15 devstack sudo[111490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a Aug 03 08:52:15 devstack sudo[111490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:52:15 devstack sudo[111490]: pam_unix(sudo:session): session closed for user root Aug 03 08:52:15 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [req-e4012b22-daa0-4da9-a89b-645707fb43b6 req-b2cf7b2a-ffe1-40a5-8a83-e6edb1e9036c tempest-TestVolumeBootPattern-702574089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a" returned: 0 in 0.247s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:52:15 devstack cinder-volume[88899]: DEBUG cinder.manager [req-e4012b22-daa0-4da9-a89b-645707fb43b6 req-b2cf7b2a-ffe1-40a5-8a83-e6edb1e9036c tempest-TestVolumeBootPattern-702574089 None] Notifying Schedulers of capabilities ... {{(pid=88899) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 08:52:15 devstack cinder-volume[88899]: INFO cinder.volume.manager [req-e4012b22-daa0-4da9-a89b-645707fb43b6 req-b2cf7b2a-ffe1-40a5-8a83-e6edb1e9036c tempest-TestVolumeBootPattern-702574089 None] Deleted volume successfully. Aug 03 08:52:15 devstack cinder-volume[88899]: DEBUG cinder.coordination [req-e4012b22-daa0-4da9-a89b-645707fb43b6 req-b2cf7b2a-ffe1-40a5-8a83-e6edb1e9036c tempest-TestVolumeBootPattern-702574089 None] Lock "cinder-268630e5-6c5a-439c-8588-3c9643279474-delete_volume" released by "delete_volume" :: held 1.183s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:52:16 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-8e854b44-5cf4-41b0-a32b-9faf598101d1 tempest-TestVolumeBootPattern-702574089 None] Acquiring lock "cinder-becd85c6-c926-4e25-a807-34fb2d52712a-delete_snapshot" by "delete_snapshot" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:52:16 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-8e854b44-5cf4-41b0-a32b-9faf598101d1 tempest-TestVolumeBootPattern-702574089 None] Lock "cinder-becd85c6-c926-4e25-a807-34fb2d52712a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:52:16 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-8e854b44-5cf4-41b0-a32b-9faf598101d1 tempest-TestVolumeBootPattern-702574089 None] Acquiring lock "cinder-quobyte-886ac27d-fbf7-4ff3-acab-5925150317a5" by "delete_snapshot" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:52:16 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-8e854b44-5cf4-41b0-a32b-9faf598101d1 tempest-TestVolumeBootPattern-702574089 None] Lock "cinder-quobyte-886ac27d-fbf7-4ff3-acab-5925150317a5" acquired by "delete_snapshot" :: waited 0.016s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:52:16 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-8e854b44-5cf4-41b0-a32b-9faf598101d1 tempest-TestVolumeBootPattern-702574089 None] Acquiring lock "cinder-quobyte-becd85c6-c926-4e25-a807-34fb2d52712a" by "_delete_snapshot" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:52:16 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-8e854b44-5cf4-41b0-a32b-9faf598101d1 tempest-TestVolumeBootPattern-702574089 None] Lock "cinder-quobyte-becd85c6-c926-4e25-a807-34fb2d52712a" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:52:16 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-8e854b44-5cf4-41b0-a32b-9faf598101d1 tempest-TestVolumeBootPattern-702574089 None] Deleting offline snapshot becd85c6-c926-4e25-a807-34fb2d52712a of volume 886ac27d-fbf7-4ff3-acab-5925150317a5 {{(pid=88899) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 03 08:52:16 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-8e854b44-5cf4-41b0-a32b-9faf598101d1 tempest-TestVolumeBootPattern-702574089 None] snapshot_file for this snap is: volume-886ac27d-fbf7-4ff3-acab-5925150317a5.becd85c6-c926-4e25-a807-34fb2d52712a {{(pid=88899) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 03 08:52:16 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[667d8ba7-3606-415f-b400-39e3d39b5b95]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:52:16 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-8e854b44-5cf4-41b0-a32b-9faf598101d1 tempest-TestVolumeBootPattern-702574089 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-886ac27d-fbf7-4ff3-acab-5925150317a5.becd85c6-c926-4e25-a807-34fb2d52712a {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:52:16 devstack sudo[111493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-886ac27d-fbf7-4ff3-acab-5925150317a5.becd85c6-c926-4e25-a807-34fb2d52712a Aug 03 08:52:16 devstack sudo[111493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:52:16 devstack sudo[111493]: pam_unix(sudo:session): session closed for user root Aug 03 08:52:16 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-8e854b44-5cf4-41b0-a32b-9faf598101d1 tempest-TestVolumeBootPattern-702574089 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-886ac27d-fbf7-4ff3-acab-5925150317a5.becd85c6-c926-4e25-a807-34fb2d52712a" returned: 0 in 0.368s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:52:16 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-8e854b44-5cf4-41b0-a32b-9faf598101d1 tempest-TestVolumeBootPattern-702574089 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-886ac27d-fbf7-4ff3-acab-5925150317a5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88899) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 03 08:52:16 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[f72a4cb3-083b-40fb-9962-5bce8bf887ae]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:52:16 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-8e854b44-5cf4-41b0-a32b-9faf598101d1 tempest-TestVolumeBootPattern-702574089 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-886ac27d-fbf7-4ff3-acab-5925150317a5 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:52:16 devstack sudo[111498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-886ac27d-fbf7-4ff3-acab-5925150317a5 Aug 03 08:52:16 devstack sudo[111498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:52:16 devstack sudo[111498]: pam_unix(sudo:session): session closed for user root Aug 03 08:52:16 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-8e854b44-5cf4-41b0-a32b-9faf598101d1 tempest-TestVolumeBootPattern-702574089 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-886ac27d-fbf7-4ff3-acab-5925150317a5" returned: 0 in 0.361s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:52:16 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-8e854b44-5cf4-41b0-a32b-9faf598101d1 tempest-TestVolumeBootPattern-702574089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-886ac27d-fbf7-4ff3-acab-5925150317a5.becd85c6-c926-4e25-a807-34fb2d52712a {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:52:16 devstack sudo[111503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-886ac27d-fbf7-4ff3-acab-5925150317a5.becd85c6-c926-4e25-a807-34fb2d52712a Aug 03 08:52:16 devstack sudo[111503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:52:17 devstack sudo[111503]: pam_unix(sudo:session): session closed for user root Aug 03 08:52:17 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-8e854b44-5cf4-41b0-a32b-9faf598101d1 tempest-TestVolumeBootPattern-702574089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-886ac27d-fbf7-4ff3-acab-5925150317a5.becd85c6-c926-4e25-a807-34fb2d52712a" returned: 0 in 0.338s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:52:17 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-8e854b44-5cf4-41b0-a32b-9faf598101d1 tempest-TestVolumeBootPattern-702574089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-886ac27d-fbf7-4ff3-acab-5925150317a5.becd85c6-c926-4e25-a807-34fb2d52712a {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:52:17 devstack sudo[111508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-886ac27d-fbf7-4ff3-acab-5925150317a5.becd85c6-c926-4e25-a807-34fb2d52712a Aug 03 08:52:17 devstack sudo[111508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:52:17 devstack sudo[111508]: pam_unix(sudo:session): session closed for user root Aug 03 08:52:17 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-8e854b44-5cf4-41b0-a32b-9faf598101d1 tempest-TestVolumeBootPattern-702574089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-886ac27d-fbf7-4ff3-acab-5925150317a5.becd85c6-c926-4e25-a807-34fb2d52712a" returned: 0 in 0.238s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:52:17 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-8e854b44-5cf4-41b0-a32b-9faf598101d1 tempest-TestVolumeBootPattern-702574089 None] Lock "cinder-quobyte-becd85c6-c926-4e25-a807-34fb2d52712a" released by "_delete_snapshot" :: held 1.404s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:52:17 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-8e854b44-5cf4-41b0-a32b-9faf598101d1 tempest-TestVolumeBootPattern-702574089 None] Lock "cinder-quobyte-886ac27d-fbf7-4ff3-acab-5925150317a5" released by "delete_snapshot" :: held 1.433s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:52:17 devstack cinder-volume[88899]: DEBUG cinder.quota [None req-8e854b44-5cf4-41b0-a32b-9faf598101d1 tempest-TestVolumeBootPattern-702574089 None] Created reservations ['5e3d5ddd-a5df-4b7d-86fc-26638757436e', '52035bdd-7f04-42b2-9af4-838fca91a969', '71a46ca8-191c-4bd3-95ae-fbdd355f4d41', '977657c2-efb3-418f-a4b0-a908401fcabc'] {{(pid=88899) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 08:52:17 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-8e854b44-5cf4-41b0-a32b-9faf598101d1 tempest-TestVolumeBootPattern-702574089 None] Delete snapshot completed successfully. Aug 03 08:52:17 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-8e854b44-5cf4-41b0-a32b-9faf598101d1 tempest-TestVolumeBootPattern-702574089 None] Lock "cinder-becd85c6-c926-4e25-a807-34fb2d52712a-delete_snapshot" released by "delete_snapshot" :: held 1.580s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:52:18 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-31cddbb8-fa2a-41aa-bb44-b5db63a3b8b4 tempest-TestVolumeBootPattern-702574089 None] Acquiring lock "cinder-886ac27d-fbf7-4ff3-acab-5925150317a5-delete_volume" by "delete_volume" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:52:18 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-31cddbb8-fa2a-41aa-bb44-b5db63a3b8b4 tempest-TestVolumeBootPattern-702574089 None] Lock "cinder-886ac27d-fbf7-4ff3-acab-5925150317a5-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:52:18 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-31cddbb8-fa2a-41aa-bb44-b5db63a3b8b4 tempest-TestVolumeBootPattern-702574089 None] Acquiring lock "cinder-quobyte-886ac27d-fbf7-4ff3-acab-5925150317a5" by "delete_volume" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:52:18 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-31cddbb8-fa2a-41aa-bb44-b5db63a3b8b4 tempest-TestVolumeBootPattern-702574089 None] Lock "cinder-quobyte-886ac27d-fbf7-4ff3-acab-5925150317a5" acquired by "delete_volume" :: waited 0.018s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:52:18 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ae064ab-8cea-4c32-b29c-3ea2a498758c]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:52:18 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-31cddbb8-fa2a-41aa-bb44-b5db63a3b8b4 tempest-TestVolumeBootPattern-702574089 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-886ac27d-fbf7-4ff3-acab-5925150317a5 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:52:18 devstack sudo[111511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-886ac27d-fbf7-4ff3-acab-5925150317a5 Aug 03 08:52:18 devstack sudo[111511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:52:18 devstack sudo[111511]: pam_unix(sudo:session): session closed for user root Aug 03 08:52:18 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-31cddbb8-fa2a-41aa-bb44-b5db63a3b8b4 tempest-TestVolumeBootPattern-702574089 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-886ac27d-fbf7-4ff3-acab-5925150317a5" returned: 0 in 0.371s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:52:18 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-31cddbb8-fa2a-41aa-bb44-b5db63a3b8b4 tempest-TestVolumeBootPattern-702574089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-886ac27d-fbf7-4ff3-acab-5925150317a5 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:52:18 devstack sudo[111517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-886ac27d-fbf7-4ff3-acab-5925150317a5 Aug 03 08:52:18 devstack sudo[111517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:52:19 devstack sudo[111517]: pam_unix(sudo:session): session closed for user root Aug 03 08:52:19 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-31cddbb8-fa2a-41aa-bb44-b5db63a3b8b4 tempest-TestVolumeBootPattern-702574089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-886ac27d-fbf7-4ff3-acab-5925150317a5" returned: 0 in 0.247s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:52:19 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-31cddbb8-fa2a-41aa-bb44-b5db63a3b8b4 tempest-TestVolumeBootPattern-702574089 None] Lock "cinder-quobyte-886ac27d-fbf7-4ff3-acab-5925150317a5" released by "delete_volume" :: held 0.677s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:52:19 devstack cinder-volume[88899]: DEBUG cinder.quota [None req-31cddbb8-fa2a-41aa-bb44-b5db63a3b8b4 tempest-TestVolumeBootPattern-702574089 None] Created reservations ['70253998-94f8-455b-a1e3-fe7f5639a64f', '09cdcdb3-8a13-4c4b-b204-7d60006078ea', '0f3ce8cf-eb94-4852-8391-4694a3afd283', '324ceeb6-b7ee-445e-b3ca-1a4363f17429'] {{(pid=88899) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 08:52:19 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-31cddbb8-fa2a-41aa-bb44-b5db63a3b8b4 tempest-TestVolumeBootPattern-702574089 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:52:19 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-31cddbb8-fa2a-41aa-bb44-b5db63a3b8b4 tempest-TestVolumeBootPattern-702574089 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:52:19 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-31cddbb8-fa2a-41aa-bb44-b5db63a3b8b4 tempest-TestVolumeBootPattern-702574089 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:52:19 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-31cddbb8-fa2a-41aa-bb44-b5db63a3b8b4 tempest-TestVolumeBootPattern-702574089 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:52:19 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-31cddbb8-fa2a-41aa-bb44-b5db63a3b8b4 tempest-TestVolumeBootPattern-702574089 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:52:19 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-31cddbb8-fa2a-41aa-bb44-b5db63a3b8b4 tempest-TestVolumeBootPattern-702574089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:52:19 devstack sudo[111520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a Aug 03 08:52:19 devstack sudo[111520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:52:19 devstack sudo[111520]: pam_unix(sudo:session): session closed for user root Aug 03 08:52:19 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-31cddbb8-fa2a-41aa-bb44-b5db63a3b8b4 tempest-TestVolumeBootPattern-702574089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a" returned: 0 in 0.273s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:52:19 devstack cinder-volume[88899]: DEBUG cinder.manager [None req-31cddbb8-fa2a-41aa-bb44-b5db63a3b8b4 tempest-TestVolumeBootPattern-702574089 None] Notifying Schedulers of capabilities ... {{(pid=88899) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 08:52:19 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-31cddbb8-fa2a-41aa-bb44-b5db63a3b8b4 tempest-TestVolumeBootPattern-702574089 None] Deleted volume successfully. Aug 03 08:52:19 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-31cddbb8-fa2a-41aa-bb44-b5db63a3b8b4 tempest-TestVolumeBootPattern-702574089 None] Lock "cinder-886ac27d-fbf7-4ff3-acab-5925150317a5-delete_volume" released by "delete_volume" :: held 1.160s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:52:29 devstack cinder-volume[88899]: DEBUG dbcounter [-] [88899] Writing DB stats cinder:SELECT=72,cinder:INSERT=37,cinder:UPDATE=55,cinder:DELETE=3 {{(pid=88899) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 03 08:52:29 devstack cinder-volume[88899]: DEBUG cinder.volume.flows.manager.create_volume [None req-58d6f56c-48c3-4a4b-b377-1bef71c2d8bf tempest-CreateVolumesFromSourceVolumeTest-452209925 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88899) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 08:52:29 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-58d6f56c-48c3-4a4b-b377-1bef71c2d8bf tempest-CreateVolumesFromSourceVolumeTest-452209925 None] Flow 'volume_create_manager' (da0f04d0-bf90-4a2e-8ded-c7104a079909) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:52:29 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-58d6f56c-48c3-4a4b-b377-1bef71c2d8bf tempest-CreateVolumesFromSourceVolumeTest-452209925 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab03ac29-1610-4491-af68-b7746eaef995) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:52:29 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-58d6f56c-48c3-4a4b-b377-1bef71c2d8bf tempest-CreateVolumesFromSourceVolumeTest-452209925 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab03ac29-1610-4491-af68-b7746eaef995) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:52:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1846783152',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a57cc4c-85a7-4f42-a1a6-893f67979d04,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0dcf43ecc38643728ba4336f51883471',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:52:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:52:29Z,use_quota=True,user_id='58c13db48b5f4c41a21a7d6f96dfef1e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8bde7129-1dc4-42ab-b852-ab32c61b4921),volume_type_id=8bde7129-1dc4-42ab-b852-ab32c61b4921)' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:52:29 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-58d6f56c-48c3-4a4b-b377-1bef71c2d8bf tempest-CreateVolumesFromSourceVolumeTest-452209925 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cda81857-25af-4471-804c-9852a4387935) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:52:29 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-58d6f56c-48c3-4a4b-b377-1bef71c2d8bf tempest-CreateVolumesFromSourceVolumeTest-452209925 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cda81857-25af-4471-804c-9852a4387935) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:52:29 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-58d6f56c-48c3-4a4b-b377-1bef71c2d8bf tempest-CreateVolumesFromSourceVolumeTest-452209925 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (42735eb9-7016-4f3c-b604-ef672b4f36ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:52:29 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-58d6f56c-48c3-4a4b-b377-1bef71c2d8bf tempest-CreateVolumesFromSourceVolumeTest-452209925 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (42735eb9-7016-4f3c-b604-ef672b4f36ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9a57cc4c-85a7-4f42-a1a6-893f67979d04', 'volume_name': 'volume-9a57cc4c-85a7-4f42-a1a6-893f67979d04', 'volume_size': 1}' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:52:29 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-58d6f56c-48c3-4a4b-b377-1bef71c2d8bf tempest-CreateVolumesFromSourceVolumeTest-452209925 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (763ad030-1568-4317-801b-147aab6c5faa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:52:29 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-58d6f56c-48c3-4a4b-b377-1bef71c2d8bf tempest-CreateVolumesFromSourceVolumeTest-452209925 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (763ad030-1568-4317-801b-147aab6c5faa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:52:29 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-58d6f56c-48c3-4a4b-b377-1bef71c2d8bf tempest-CreateVolumesFromSourceVolumeTest-452209925 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9967ba22-9cb1-4347-a406-9112669e64e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:52:29 devstack cinder-volume[88899]: INFO cinder.volume.flows.manager.create_volume [None req-58d6f56c-48c3-4a4b-b377-1bef71c2d8bf tempest-CreateVolumesFromSourceVolumeTest-452209925 None] Volume 9a57cc4c-85a7-4f42-a1a6-893f67979d04: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9a57cc4c-85a7-4f42-a1a6-893f67979d04', 'volume_size': 1} Aug 03 08:52:29 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-58d6f56c-48c3-4a4b-b377-1bef71c2d8bf tempest-CreateVolumesFromSourceVolumeTest-452209925 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:52:29 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-58d6f56c-48c3-4a4b-b377-1bef71c2d8bf tempest-CreateVolumesFromSourceVolumeTest-452209925 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:52:29 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-58d6f56c-48c3-4a4b-b377-1bef71c2d8bf tempest-CreateVolumesFromSourceVolumeTest-452209925 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:52:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1846783152',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a57cc4c-85a7-4f42-a1a6-893f67979d04,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0dcf43ecc38643728ba4336f51883471',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:52:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:52:29Z,use_quota=True,user_id='58c13db48b5f4c41a21a7d6f96dfef1e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8bde7129-1dc4-42ab-b852-ab32c61b4921),volume_type_id=8bde7129-1dc4-42ab-b852-ab32c61b4921)}" {{(pid=88899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 08:52:29 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-58d6f56c-48c3-4a4b-b377-1bef71c2d8bf tempest-CreateVolumesFromSourceVolumeTest-452209925 None] Creating volume 9a57cc4c-85a7-4f42-a1a6-893f67979d04 {{(pid=88899) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 08:52:29 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-58d6f56c-48c3-4a4b-b377-1bef71c2d8bf tempest-CreateVolumesFromSourceVolumeTest-452209925 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:52:29 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-58d6f56c-48c3-4a4b-b377-1bef71c2d8bf tempest-CreateVolumesFromSourceVolumeTest-452209925 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:52:29 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-58d6f56c-48c3-4a4b-b377-1bef71c2d8bf tempest-CreateVolumesFromSourceVolumeTest-452209925 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:52:29 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-58d6f56c-48c3-4a4b-b377-1bef71c2d8bf tempest-CreateVolumesFromSourceVolumeTest-452209925 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:52:29 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-58d6f56c-48c3-4a4b-b377-1bef71c2d8bf tempest-CreateVolumesFromSourceVolumeTest-452209925 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:52:29 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-58d6f56c-48c3-4a4b-b377-1bef71c2d8bf tempest-CreateVolumesFromSourceVolumeTest-452209925 None] Selected osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385 as target Quobyte volume. {{(pid=88899) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 08:52:29 devstack cinder-volume[88899]: INFO cinder.volume.drivers.remotefs [None req-58d6f56c-48c3-4a4b-b377-1bef71c2d8bf tempest-CreateVolumesFromSourceVolumeTest-452209925 None] casted to osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385 Aug 03 08:52:29 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-58d6f56c-48c3-4a4b-b377-1bef71c2d8bf tempest-CreateVolumesFromSourceVolumeTest-452209925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-9a57cc4c-85a7-4f42-a1a6-893f67979d04 1073741824 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:52:29 devstack sudo[111528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-9a57cc4c-85a7-4f42-a1a6-893f67979d04 1073741824 Aug 03 08:52:29 devstack sudo[111528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:52:29 devstack sudo[111528]: pam_unix(sudo:session): session closed for user root Aug 03 08:52:29 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-58d6f56c-48c3-4a4b-b377-1bef71c2d8bf tempest-CreateVolumesFromSourceVolumeTest-452209925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-9a57cc4c-85a7-4f42-a1a6-893f67979d04 1073741824" returned: 0 in 0.426s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:52:29 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-58d6f56c-48c3-4a4b-b377-1bef71c2d8bf tempest-CreateVolumesFromSourceVolumeTest-452209925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-9a57cc4c-85a7-4f42-a1a6-893f67979d04 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:52:29 devstack sudo[111533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-9a57cc4c-85a7-4f42-a1a6-893f67979d04 Aug 03 08:52:29 devstack sudo[111533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:52:30 devstack sudo[111533]: pam_unix(sudo:session): session closed for user root Aug 03 08:52:30 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-58d6f56c-48c3-4a4b-b377-1bef71c2d8bf tempest-CreateVolumesFromSourceVolumeTest-452209925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-9a57cc4c-85a7-4f42-a1a6-893f67979d04" returned: 0 in 0.231s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:52:30 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-58d6f56c-48c3-4a4b-b377-1bef71c2d8bf tempest-CreateVolumesFromSourceVolumeTest-452209925 None] <== create_volume: return (697ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'} {{(pid=88899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 08:52:30 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-58d6f56c-48c3-4a4b-b377-1bef71c2d8bf tempest-CreateVolumesFromSourceVolumeTest-452209925 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.699s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:52:30 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-58d6f56c-48c3-4a4b-b377-1bef71c2d8bf tempest-CreateVolumesFromSourceVolumeTest-452209925 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9967ba22-9cb1-4347-a406-9112669e64e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9a57cc4c-85a7-4f42-a1a6-893f67979d04', 'volume_size': 1}' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:52:30 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-58d6f56c-48c3-4a4b-b377-1bef71c2d8bf tempest-CreateVolumesFromSourceVolumeTest-452209925 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ae9c557-88b0-4f4e-b0b4-f015e589a716) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:52:30 devstack cinder-volume[88899]: INFO cinder.volume.flows.manager.create_volume [None req-58d6f56c-48c3-4a4b-b377-1bef71c2d8bf tempest-CreateVolumesFromSourceVolumeTest-452209925 None] Volume volume-9a57cc4c-85a7-4f42-a1a6-893f67979d04 (9a57cc4c-85a7-4f42-a1a6-893f67979d04): created successfully Aug 03 08:52:30 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-58d6f56c-48c3-4a4b-b377-1bef71c2d8bf tempest-CreateVolumesFromSourceVolumeTest-452209925 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ae9c557-88b0-4f4e-b0b4-f015e589a716) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:52:30 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-58d6f56c-48c3-4a4b-b377-1bef71c2d8bf tempest-CreateVolumesFromSourceVolumeTest-452209925 None] Flow 'volume_create_manager' (da0f04d0-bf90-4a2e-8ded-c7104a079909) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:52:30 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-58d6f56c-48c3-4a4b-b377-1bef71c2d8bf tempest-CreateVolumesFromSourceVolumeTest-452209925 None] Created volume successfully. Aug 03 08:52:30 devstack cinder-volume[88899]: DEBUG cinder.volume.flows.manager.create_volume [None req-8990d3f9-7591-49e4-897a-71c60706ebed tempest-CreateVolumesFromSourceVolumeTest-452209925 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88899) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 08:52:30 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-8990d3f9-7591-49e4-897a-71c60706ebed tempest-CreateVolumesFromSourceVolumeTest-452209925 None] Flow 'volume_create_manager' (de9faead-7707-4367-9dd1-3ea7eadc625d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:52:30 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-8990d3f9-7591-49e4-897a-71c60706ebed tempest-CreateVolumesFromSourceVolumeTest-452209925 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c03eb07a-d79f-4c8e-998f-8a6fbb21c708) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:52:30 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-8990d3f9-7591-49e4-897a-71c60706ebed tempest-CreateVolumesFromSourceVolumeTest-452209925 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c03eb07a-d79f-4c8e-998f-8a6fbb21c708) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:52:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1869876505',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4211fe8a-3a38-4c2f-8767-78916eee5d22,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0dcf43ecc38643728ba4336f51883471',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:52:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:52:31Z,use_quota=True,user_id='58c13db48b5f4c41a21a7d6f96dfef1e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8bde7129-1dc4-42ab-b852-ab32c61b4921),volume_type_id=8bde7129-1dc4-42ab-b852-ab32c61b4921)' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:52:30 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-8990d3f9-7591-49e4-897a-71c60706ebed tempest-CreateVolumesFromSourceVolumeTest-452209925 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (002a1233-c547-48d0-845b-b7763972b45f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:52:30 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-8990d3f9-7591-49e4-897a-71c60706ebed tempest-CreateVolumesFromSourceVolumeTest-452209925 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (002a1233-c547-48d0-845b-b7763972b45f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:52:30 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-8990d3f9-7591-49e4-897a-71c60706ebed tempest-CreateVolumesFromSourceVolumeTest-452209925 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b2d876f8-3643-4f22-85a4-7a3557f484b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:52:30 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-8990d3f9-7591-49e4-897a-71c60706ebed tempest-CreateVolumesFromSourceVolumeTest-452209925 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b2d876f8-3643-4f22-85a4-7a3557f484b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4211fe8a-3a38-4c2f-8767-78916eee5d22', 'volume_name': 'volume-4211fe8a-3a38-4c2f-8767-78916eee5d22', 'volume_size': 1}' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:52:30 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-8990d3f9-7591-49e4-897a-71c60706ebed tempest-CreateVolumesFromSourceVolumeTest-452209925 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ccbee404-b7b3-4b5c-a284-28c0798cf0f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:52:30 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-8990d3f9-7591-49e4-897a-71c60706ebed tempest-CreateVolumesFromSourceVolumeTest-452209925 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ccbee404-b7b3-4b5c-a284-28c0798cf0f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:52:30 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-8990d3f9-7591-49e4-897a-71c60706ebed tempest-CreateVolumesFromSourceVolumeTest-452209925 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27e2bd0d-3cca-40f2-9aff-c51a471bad2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:52:30 devstack cinder-volume[88899]: INFO cinder.volume.flows.manager.create_volume [None req-8990d3f9-7591-49e4-897a-71c60706ebed tempest-CreateVolumesFromSourceVolumeTest-452209925 None] Volume 4211fe8a-3a38-4c2f-8767-78916eee5d22: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4211fe8a-3a38-4c2f-8767-78916eee5d22', 'volume_size': 1} Aug 03 08:52:30 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-8990d3f9-7591-49e4-897a-71c60706ebed tempest-CreateVolumesFromSourceVolumeTest-452209925 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:52:30 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-8990d3f9-7591-49e4-897a-71c60706ebed tempest-CreateVolumesFromSourceVolumeTest-452209925 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:52:30 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-8990d3f9-7591-49e4-897a-71c60706ebed tempest-CreateVolumesFromSourceVolumeTest-452209925 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:52:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1869876505',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4211fe8a-3a38-4c2f-8767-78916eee5d22,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0dcf43ecc38643728ba4336f51883471',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:52:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:52:31Z,use_quota=True,user_id='58c13db48b5f4c41a21a7d6f96dfef1e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8bde7129-1dc4-42ab-b852-ab32c61b4921),volume_type_id=8bde7129-1dc4-42ab-b852-ab32c61b4921)}" {{(pid=88899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 08:52:30 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-8990d3f9-7591-49e4-897a-71c60706ebed tempest-CreateVolumesFromSourceVolumeTest-452209925 None] Creating volume 4211fe8a-3a38-4c2f-8767-78916eee5d22 {{(pid=88899) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 08:52:30 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-8990d3f9-7591-49e4-897a-71c60706ebed tempest-CreateVolumesFromSourceVolumeTest-452209925 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:52:30 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-8990d3f9-7591-49e4-897a-71c60706ebed tempest-CreateVolumesFromSourceVolumeTest-452209925 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:52:30 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-8990d3f9-7591-49e4-897a-71c60706ebed tempest-CreateVolumesFromSourceVolumeTest-452209925 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:52:30 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-8990d3f9-7591-49e4-897a-71c60706ebed tempest-CreateVolumesFromSourceVolumeTest-452209925 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:52:30 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-8990d3f9-7591-49e4-897a-71c60706ebed tempest-CreateVolumesFromSourceVolumeTest-452209925 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:52:30 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-8990d3f9-7591-49e4-897a-71c60706ebed tempest-CreateVolumesFromSourceVolumeTest-452209925 None] Selected osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385 as target Quobyte volume. {{(pid=88899) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 08:52:30 devstack cinder-volume[88899]: INFO cinder.volume.drivers.remotefs [None req-8990d3f9-7591-49e4-897a-71c60706ebed tempest-CreateVolumesFromSourceVolumeTest-452209925 None] casted to osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385 Aug 03 08:52:30 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-8990d3f9-7591-49e4-897a-71c60706ebed tempest-CreateVolumesFromSourceVolumeTest-452209925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-4211fe8a-3a38-4c2f-8767-78916eee5d22 1073741824 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:52:30 devstack sudo[111537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-4211fe8a-3a38-4c2f-8767-78916eee5d22 1073741824 Aug 03 08:52:30 devstack sudo[111537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:52:31 devstack cinder-volume[88899]: DEBUG cinder.volume.flows.manager.create_volume [None req-514cfc7f-1c87-46e8-bac6-5aa51ac99e95 tempest-CreateVolumesFromSourceVolumeTest-452209925 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88899) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 08:52:31 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-514cfc7f-1c87-46e8-bac6-5aa51ac99e95 tempest-CreateVolumesFromSourceVolumeTest-452209925 None] Flow 'volume_create_manager' (4a11d31f-5240-4213-a7dc-e6ac104307c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:52:31 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-514cfc7f-1c87-46e8-bac6-5aa51ac99e95 tempest-CreateVolumesFromSourceVolumeTest-452209925 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2aa157b8-d84f-42d8-aea7-8fa5238c600d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:52:31 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-514cfc7f-1c87-46e8-bac6-5aa51ac99e95 tempest-CreateVolumesFromSourceVolumeTest-452209925 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2aa157b8-d84f-42d8-aea7-8fa5238c600d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:52:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-386098055',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ec1bfdcf-58c8-4801-9c27-7c8e58243962,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0dcf43ecc38643728ba4336f51883471',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:52:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:52:31Z,use_quota=True,user_id='58c13db48b5f4c41a21a7d6f96dfef1e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8bde7129-1dc4-42ab-b852-ab32c61b4921),volume_type_id=8bde7129-1dc4-42ab-b852-ab32c61b4921)' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:52:31 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-514cfc7f-1c87-46e8-bac6-5aa51ac99e95 tempest-CreateVolumesFromSourceVolumeTest-452209925 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (69f3258f-9ec3-4108-b87c-b7bcf73da2bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:52:31 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-514cfc7f-1c87-46e8-bac6-5aa51ac99e95 tempest-CreateVolumesFromSourceVolumeTest-452209925 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (69f3258f-9ec3-4108-b87c-b7bcf73da2bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:52:31 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-514cfc7f-1c87-46e8-bac6-5aa51ac99e95 tempest-CreateVolumesFromSourceVolumeTest-452209925 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ff3ef40-b22d-48d3-ac07-308ba6064c3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:52:31 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-514cfc7f-1c87-46e8-bac6-5aa51ac99e95 tempest-CreateVolumesFromSourceVolumeTest-452209925 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ff3ef40-b22d-48d3-ac07-308ba6064c3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ec1bfdcf-58c8-4801-9c27-7c8e58243962', 'volume_name': 'volume-ec1bfdcf-58c8-4801-9c27-7c8e58243962', 'volume_size': 1}' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:52:31 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-514cfc7f-1c87-46e8-bac6-5aa51ac99e95 tempest-CreateVolumesFromSourceVolumeTest-452209925 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c851e17-c2d8-4018-94d4-b55457dd99ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:52:31 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-514cfc7f-1c87-46e8-bac6-5aa51ac99e95 tempest-CreateVolumesFromSourceVolumeTest-452209925 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c851e17-c2d8-4018-94d4-b55457dd99ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:52:31 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-514cfc7f-1c87-46e8-bac6-5aa51ac99e95 tempest-CreateVolumesFromSourceVolumeTest-452209925 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (319b44a3-8b7f-4aed-9fe3-b44c8b13870e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:52:31 devstack cinder-volume[88899]: INFO cinder.volume.flows.manager.create_volume [None req-514cfc7f-1c87-46e8-bac6-5aa51ac99e95 tempest-CreateVolumesFromSourceVolumeTest-452209925 None] Volume ec1bfdcf-58c8-4801-9c27-7c8e58243962: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ec1bfdcf-58c8-4801-9c27-7c8e58243962', 'volume_size': 1} Aug 03 08:52:31 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-514cfc7f-1c87-46e8-bac6-5aa51ac99e95 tempest-CreateVolumesFromSourceVolumeTest-452209925 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:52:31 devstack sudo[111537]: pam_unix(sudo:session): session closed for user root Aug 03 08:52:31 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-8990d3f9-7591-49e4-897a-71c60706ebed tempest-CreateVolumesFromSourceVolumeTest-452209925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-4211fe8a-3a38-4c2f-8767-78916eee5d22 1073741824" returned: 0 in 0.519s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:52:31 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-8990d3f9-7591-49e4-897a-71c60706ebed tempest-CreateVolumesFromSourceVolumeTest-452209925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-4211fe8a-3a38-4c2f-8767-78916eee5d22 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:52:31 devstack sudo[111543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-4211fe8a-3a38-4c2f-8767-78916eee5d22 Aug 03 08:52:31 devstack sudo[111543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:52:31 devstack cinder-volume[88899]: DEBUG cinder.volume.flows.manager.create_volume [None req-cf9dd25c-0937-49ea-a5eb-ff2bfaaa599f tempest-CreateVolumesFromSourceVolumeTest-452209925 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88899) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 08:52:31 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-cf9dd25c-0937-49ea-a5eb-ff2bfaaa599f tempest-CreateVolumesFromSourceVolumeTest-452209925 None] Flow 'volume_create_manager' (65630533-fd9b-417f-9fa4-32bdd3b427c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:52:31 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-cf9dd25c-0937-49ea-a5eb-ff2bfaaa599f tempest-CreateVolumesFromSourceVolumeTest-452209925 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e6bef90-a822-474b-b8e3-ab827f89e39d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:52:31 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-cf9dd25c-0937-49ea-a5eb-ff2bfaaa599f tempest-CreateVolumesFromSourceVolumeTest-452209925 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e6bef90-a822-474b-b8e3-ab827f89e39d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:52:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-680752714',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dbb223a0-839b-436c-99bc-ee9827647322,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0dcf43ecc38643728ba4336f51883471',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:52:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:52:31Z,use_quota=True,user_id='58c13db48b5f4c41a21a7d6f96dfef1e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8bde7129-1dc4-42ab-b852-ab32c61b4921),volume_type_id=8bde7129-1dc4-42ab-b852-ab32c61b4921)' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:52:31 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-cf9dd25c-0937-49ea-a5eb-ff2bfaaa599f tempest-CreateVolumesFromSourceVolumeTest-452209925 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c126348b-aa3e-4df1-9eaa-ee32ad04fe0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:52:31 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-cf9dd25c-0937-49ea-a5eb-ff2bfaaa599f tempest-CreateVolumesFromSourceVolumeTest-452209925 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c126348b-aa3e-4df1-9eaa-ee32ad04fe0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:52:31 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-cf9dd25c-0937-49ea-a5eb-ff2bfaaa599f tempest-CreateVolumesFromSourceVolumeTest-452209925 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (56b69fbe-c12d-4509-8d7a-c27f41e81cf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:52:31 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-cf9dd25c-0937-49ea-a5eb-ff2bfaaa599f tempest-CreateVolumesFromSourceVolumeTest-452209925 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (56b69fbe-c12d-4509-8d7a-c27f41e81cf5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dbb223a0-839b-436c-99bc-ee9827647322', 'volume_name': 'volume-dbb223a0-839b-436c-99bc-ee9827647322', 'volume_size': 1}' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:52:31 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-cf9dd25c-0937-49ea-a5eb-ff2bfaaa599f tempest-CreateVolumesFromSourceVolumeTest-452209925 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31189d1e-8627-48b8-a964-954ed29bac40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:52:31 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-cf9dd25c-0937-49ea-a5eb-ff2bfaaa599f tempest-CreateVolumesFromSourceVolumeTest-452209925 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31189d1e-8627-48b8-a964-954ed29bac40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:52:31 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-cf9dd25c-0937-49ea-a5eb-ff2bfaaa599f tempest-CreateVolumesFromSourceVolumeTest-452209925 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43d45292-4441-4381-8667-8285db766345) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:52:31 devstack cinder-volume[88899]: INFO cinder.volume.flows.manager.create_volume [None req-cf9dd25c-0937-49ea-a5eb-ff2bfaaa599f tempest-CreateVolumesFromSourceVolumeTest-452209925 None] Volume dbb223a0-839b-436c-99bc-ee9827647322: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dbb223a0-839b-436c-99bc-ee9827647322', 'volume_size': 1} Aug 03 08:52:31 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-cf9dd25c-0937-49ea-a5eb-ff2bfaaa599f tempest-CreateVolumesFromSourceVolumeTest-452209925 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:52:31 devstack sudo[111543]: pam_unix(sudo:session): session closed for user root Aug 03 08:52:31 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-8990d3f9-7591-49e4-897a-71c60706ebed tempest-CreateVolumesFromSourceVolumeTest-452209925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-4211fe8a-3a38-4c2f-8767-78916eee5d22" returned: 0 in 0.268s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:52:31 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-8990d3f9-7591-49e4-897a-71c60706ebed tempest-CreateVolumesFromSourceVolumeTest-452209925 None] <== create_volume: return (840ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'} {{(pid=88899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 08:52:31 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-8990d3f9-7591-49e4-897a-71c60706ebed tempest-CreateVolumesFromSourceVolumeTest-452209925 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.842s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:52:31 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-514cfc7f-1c87-46e8-bac6-5aa51ac99e95 tempest-CreateVolumesFromSourceVolumeTest-452209925 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.487s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:52:31 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-514cfc7f-1c87-46e8-bac6-5aa51ac99e95 tempest-CreateVolumesFromSourceVolumeTest-452209925 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:52:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-386098055',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ec1bfdcf-58c8-4801-9c27-7c8e58243962,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0dcf43ecc38643728ba4336f51883471',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:52:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:52:31Z,use_quota=True,user_id='58c13db48b5f4c41a21a7d6f96dfef1e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8bde7129-1dc4-42ab-b852-ab32c61b4921),volume_type_id=8bde7129-1dc4-42ab-b852-ab32c61b4921)}" {{(pid=88899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 08:52:31 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-514cfc7f-1c87-46e8-bac6-5aa51ac99e95 tempest-CreateVolumesFromSourceVolumeTest-452209925 None] Creating volume ec1bfdcf-58c8-4801-9c27-7c8e58243962 {{(pid=88899) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 08:52:31 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-514cfc7f-1c87-46e8-bac6-5aa51ac99e95 tempest-CreateVolumesFromSourceVolumeTest-452209925 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:52:31 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-514cfc7f-1c87-46e8-bac6-5aa51ac99e95 tempest-CreateVolumesFromSourceVolumeTest-452209925 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:52:31 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-514cfc7f-1c87-46e8-bac6-5aa51ac99e95 tempest-CreateVolumesFromSourceVolumeTest-452209925 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:52:31 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-514cfc7f-1c87-46e8-bac6-5aa51ac99e95 tempest-CreateVolumesFromSourceVolumeTest-452209925 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:52:31 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-514cfc7f-1c87-46e8-bac6-5aa51ac99e95 tempest-CreateVolumesFromSourceVolumeTest-452209925 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:52:31 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-514cfc7f-1c87-46e8-bac6-5aa51ac99e95 tempest-CreateVolumesFromSourceVolumeTest-452209925 None] Selected osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385 as target Quobyte volume. {{(pid=88899) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 08:52:31 devstack cinder-volume[88899]: INFO cinder.volume.drivers.remotefs [None req-514cfc7f-1c87-46e8-bac6-5aa51ac99e95 tempest-CreateVolumesFromSourceVolumeTest-452209925 None] casted to osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385 Aug 03 08:52:31 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-514cfc7f-1c87-46e8-bac6-5aa51ac99e95 tempest-CreateVolumesFromSourceVolumeTest-452209925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-ec1bfdcf-58c8-4801-9c27-7c8e58243962 1073741824 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:52:31 devstack sudo[111546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-ec1bfdcf-58c8-4801-9c27-7c8e58243962 1073741824 Aug 03 08:52:31 devstack sudo[111546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:52:31 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-8990d3f9-7591-49e4-897a-71c60706ebed tempest-CreateVolumesFromSourceVolumeTest-452209925 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27e2bd0d-3cca-40f2-9aff-c51a471bad2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4211fe8a-3a38-4c2f-8767-78916eee5d22', 'volume_size': 1}' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:52:31 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-8990d3f9-7591-49e4-897a-71c60706ebed tempest-CreateVolumesFromSourceVolumeTest-452209925 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f783c425-af34-46da-a13a-b72dcde3a2da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:52:31 devstack cinder-volume[88899]: DEBUG dbcounter [-] [88899] Writing DB stats cinder:SELECT=77,cinder:INSERT=46,cinder:DELETE=4,cinder:UPDATE=69 {{(pid=88899) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 03 08:52:31 devstack cinder-volume[88899]: INFO cinder.volume.flows.manager.create_volume [None req-8990d3f9-7591-49e4-897a-71c60706ebed tempest-CreateVolumesFromSourceVolumeTest-452209925 None] Volume volume-4211fe8a-3a38-4c2f-8767-78916eee5d22 (4211fe8a-3a38-4c2f-8767-78916eee5d22): created successfully Aug 03 08:52:31 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-8990d3f9-7591-49e4-897a-71c60706ebed tempest-CreateVolumesFromSourceVolumeTest-452209925 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f783c425-af34-46da-a13a-b72dcde3a2da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:52:31 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-8990d3f9-7591-49e4-897a-71c60706ebed tempest-CreateVolumesFromSourceVolumeTest-452209925 None] Flow 'volume_create_manager' (de9faead-7707-4367-9dd1-3ea7eadc625d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:52:31 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-8990d3f9-7591-49e4-897a-71c60706ebed tempest-CreateVolumesFromSourceVolumeTest-452209925 None] Created volume successfully. Aug 03 08:52:31 devstack cinder-volume[88899]: DEBUG cinder.volume.flows.manager.create_volume [None req-388ebe0d-5c9a-4902-b58e-43153d8b769e tempest-CreateVolumesFromSourceVolumeTest-452209925 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88899) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 08:52:31 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-388ebe0d-5c9a-4902-b58e-43153d8b769e tempest-CreateVolumesFromSourceVolumeTest-452209925 None] Flow 'volume_create_manager' (6ec11ada-bb6c-4c76-8a64-277dab4ff02d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:52:31 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-388ebe0d-5c9a-4902-b58e-43153d8b769e tempest-CreateVolumesFromSourceVolumeTest-452209925 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (04575dac-33f5-4e28-a5aa-273ce0157b47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:52:31 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-388ebe0d-5c9a-4902-b58e-43153d8b769e tempest-CreateVolumesFromSourceVolumeTest-452209925 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (04575dac-33f5-4e28-a5aa-273ce0157b47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:52:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-121921634',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0731e9e5-eae2-4ffa-8485-51f6e8277836,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0dcf43ecc38643728ba4336f51883471',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:52:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:52:32Z,use_quota=True,user_id='58c13db48b5f4c41a21a7d6f96dfef1e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8bde7129-1dc4-42ab-b852-ab32c61b4921),volume_type_id=8bde7129-1dc4-42ab-b852-ab32c61b4921)' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:52:31 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-388ebe0d-5c9a-4902-b58e-43153d8b769e tempest-CreateVolumesFromSourceVolumeTest-452209925 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (905aed0e-a7c3-4ae1-8ad6-32bad99f7e07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:52:31 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-388ebe0d-5c9a-4902-b58e-43153d8b769e tempest-CreateVolumesFromSourceVolumeTest-452209925 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (905aed0e-a7c3-4ae1-8ad6-32bad99f7e07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:52:31 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-388ebe0d-5c9a-4902-b58e-43153d8b769e tempest-CreateVolumesFromSourceVolumeTest-452209925 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fabf392b-35d2-4769-a2f0-b9ad558c86ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:52:31 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-388ebe0d-5c9a-4902-b58e-43153d8b769e tempest-CreateVolumesFromSourceVolumeTest-452209925 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fabf392b-35d2-4769-a2f0-b9ad558c86ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0731e9e5-eae2-4ffa-8485-51f6e8277836', 'volume_name': 'volume-0731e9e5-eae2-4ffa-8485-51f6e8277836', 'volume_size': 1}' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:52:31 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-388ebe0d-5c9a-4902-b58e-43153d8b769e tempest-CreateVolumesFromSourceVolumeTest-452209925 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9043fe4-cf02-4327-9ed3-d2af4a794986) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:52:31 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-388ebe0d-5c9a-4902-b58e-43153d8b769e tempest-CreateVolumesFromSourceVolumeTest-452209925 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9043fe4-cf02-4327-9ed3-d2af4a794986) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:52:31 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-388ebe0d-5c9a-4902-b58e-43153d8b769e tempest-CreateVolumesFromSourceVolumeTest-452209925 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (398be227-583d-4d6f-be18-daec934ef6c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:52:31 devstack cinder-volume[88899]: INFO cinder.volume.flows.manager.create_volume [None req-388ebe0d-5c9a-4902-b58e-43153d8b769e tempest-CreateVolumesFromSourceVolumeTest-452209925 None] Volume 0731e9e5-eae2-4ffa-8485-51f6e8277836: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0731e9e5-eae2-4ffa-8485-51f6e8277836', 'volume_size': 1} Aug 03 08:52:31 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-388ebe0d-5c9a-4902-b58e-43153d8b769e tempest-CreateVolumesFromSourceVolumeTest-452209925 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:52:32 devstack sudo[111546]: pam_unix(sudo:session): session closed for user root Aug 03 08:52:32 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-514cfc7f-1c87-46e8-bac6-5aa51ac99e95 tempest-CreateVolumesFromSourceVolumeTest-452209925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-ec1bfdcf-58c8-4801-9c27-7c8e58243962 1073741824" returned: 0 in 0.504s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:52:32 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-514cfc7f-1c87-46e8-bac6-5aa51ac99e95 tempest-CreateVolumesFromSourceVolumeTest-452209925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-ec1bfdcf-58c8-4801-9c27-7c8e58243962 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:52:32 devstack sudo[111552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-ec1bfdcf-58c8-4801-9c27-7c8e58243962 Aug 03 08:52:32 devstack sudo[111552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:52:32 devstack cinder-volume[88899]: DEBUG cinder.volume.flows.manager.create_volume [None req-98cc502f-13f1-408d-9b3f-f60a5cc33e53 tempest-CreateVolumesFromSourceVolumeTest-452209925 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88899) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 08:52:32 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-98cc502f-13f1-408d-9b3f-f60a5cc33e53 tempest-CreateVolumesFromSourceVolumeTest-452209925 None] Flow 'volume_create_manager' (dbac6dc3-a513-434c-8f12-28692c340587) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:52:32 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-98cc502f-13f1-408d-9b3f-f60a5cc33e53 tempest-CreateVolumesFromSourceVolumeTest-452209925 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5704812-66cf-4d6f-9d6d-9df1858e7976) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:52:32 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-98cc502f-13f1-408d-9b3f-f60a5cc33e53 tempest-CreateVolumesFromSourceVolumeTest-452209925 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5704812-66cf-4d6f-9d6d-9df1858e7976) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:52:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1966028285',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e88c541f-734f-4164-ac72-e6751192c0c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0dcf43ecc38643728ba4336f51883471',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:52:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:52:32Z,use_quota=True,user_id='58c13db48b5f4c41a21a7d6f96dfef1e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8bde7129-1dc4-42ab-b852-ab32c61b4921),volume_type_id=8bde7129-1dc4-42ab-b852-ab32c61b4921)' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:52:32 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-98cc502f-13f1-408d-9b3f-f60a5cc33e53 tempest-CreateVolumesFromSourceVolumeTest-452209925 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3deefd1b-b388-4cd3-908f-05d1f03f03f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:52:32 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-98cc502f-13f1-408d-9b3f-f60a5cc33e53 tempest-CreateVolumesFromSourceVolumeTest-452209925 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3deefd1b-b388-4cd3-908f-05d1f03f03f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:52:32 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-98cc502f-13f1-408d-9b3f-f60a5cc33e53 tempest-CreateVolumesFromSourceVolumeTest-452209925 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce9a4994-8e31-4123-9ffa-755f5ea371cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:52:32 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-98cc502f-13f1-408d-9b3f-f60a5cc33e53 tempest-CreateVolumesFromSourceVolumeTest-452209925 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce9a4994-8e31-4123-9ffa-755f5ea371cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e88c541f-734f-4164-ac72-e6751192c0c3', 'volume_name': 'volume-e88c541f-734f-4164-ac72-e6751192c0c3', 'volume_size': 1}' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:52:32 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-98cc502f-13f1-408d-9b3f-f60a5cc33e53 tempest-CreateVolumesFromSourceVolumeTest-452209925 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (247a7843-f846-4164-877a-5003105743a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:52:32 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-98cc502f-13f1-408d-9b3f-f60a5cc33e53 tempest-CreateVolumesFromSourceVolumeTest-452209925 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (247a7843-f846-4164-877a-5003105743a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:52:32 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-98cc502f-13f1-408d-9b3f-f60a5cc33e53 tempest-CreateVolumesFromSourceVolumeTest-452209925 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fcba7af7-f3a9-4990-8c9b-28196745e153) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:52:32 devstack cinder-volume[88899]: INFO cinder.volume.flows.manager.create_volume [None req-98cc502f-13f1-408d-9b3f-f60a5cc33e53 tempest-CreateVolumesFromSourceVolumeTest-452209925 None] Volume e88c541f-734f-4164-ac72-e6751192c0c3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e88c541f-734f-4164-ac72-e6751192c0c3', 'volume_size': 1} Aug 03 08:52:32 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-98cc502f-13f1-408d-9b3f-f60a5cc33e53 tempest-CreateVolumesFromSourceVolumeTest-452209925 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:52:32 devstack sudo[111552]: pam_unix(sudo:session): session closed for user root Aug 03 08:52:32 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-514cfc7f-1c87-46e8-bac6-5aa51ac99e95 tempest-CreateVolumesFromSourceVolumeTest-452209925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-ec1bfdcf-58c8-4801-9c27-7c8e58243962" returned: 0 in 0.263s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:52:32 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-514cfc7f-1c87-46e8-bac6-5aa51ac99e95 tempest-CreateVolumesFromSourceVolumeTest-452209925 None] <== create_volume: return (816ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'} {{(pid=88899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 08:52:32 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-514cfc7f-1c87-46e8-bac6-5aa51ac99e95 tempest-CreateVolumesFromSourceVolumeTest-452209925 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.819s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:52:32 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-cf9dd25c-0937-49ea-a5eb-ff2bfaaa599f tempest-CreateVolumesFromSourceVolumeTest-452209925 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.914s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:52:32 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-cf9dd25c-0937-49ea-a5eb-ff2bfaaa599f tempest-CreateVolumesFromSourceVolumeTest-452209925 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:52:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-680752714',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dbb223a0-839b-436c-99bc-ee9827647322,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0dcf43ecc38643728ba4336f51883471',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:52:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:52:31Z,use_quota=True,user_id='58c13db48b5f4c41a21a7d6f96dfef1e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8bde7129-1dc4-42ab-b852-ab32c61b4921),volume_type_id=8bde7129-1dc4-42ab-b852-ab32c61b4921)}" {{(pid=88899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 08:52:32 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-cf9dd25c-0937-49ea-a5eb-ff2bfaaa599f tempest-CreateVolumesFromSourceVolumeTest-452209925 None] Creating volume dbb223a0-839b-436c-99bc-ee9827647322 {{(pid=88899) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 08:52:32 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-cf9dd25c-0937-49ea-a5eb-ff2bfaaa599f tempest-CreateVolumesFromSourceVolumeTest-452209925 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:52:32 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-cf9dd25c-0937-49ea-a5eb-ff2bfaaa599f tempest-CreateVolumesFromSourceVolumeTest-452209925 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:52:32 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-cf9dd25c-0937-49ea-a5eb-ff2bfaaa599f tempest-CreateVolumesFromSourceVolumeTest-452209925 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:52:32 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-cf9dd25c-0937-49ea-a5eb-ff2bfaaa599f tempest-CreateVolumesFromSourceVolumeTest-452209925 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:52:32 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-cf9dd25c-0937-49ea-a5eb-ff2bfaaa599f tempest-CreateVolumesFromSourceVolumeTest-452209925 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:52:32 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-cf9dd25c-0937-49ea-a5eb-ff2bfaaa599f tempest-CreateVolumesFromSourceVolumeTest-452209925 None] Selected osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385 as target Quobyte volume. {{(pid=88899) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 08:52:32 devstack cinder-volume[88899]: INFO cinder.volume.drivers.remotefs [None req-cf9dd25c-0937-49ea-a5eb-ff2bfaaa599f tempest-CreateVolumesFromSourceVolumeTest-452209925 None] casted to osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385 Aug 03 08:52:32 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-cf9dd25c-0937-49ea-a5eb-ff2bfaaa599f tempest-CreateVolumesFromSourceVolumeTest-452209925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-dbb223a0-839b-436c-99bc-ee9827647322 1073741824 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:52:32 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-514cfc7f-1c87-46e8-bac6-5aa51ac99e95 tempest-CreateVolumesFromSourceVolumeTest-452209925 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (319b44a3-8b7f-4aed-9fe3-b44c8b13870e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ec1bfdcf-58c8-4801-9c27-7c8e58243962', 'volume_size': 1}' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:52:32 devstack sudo[111555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-dbb223a0-839b-436c-99bc-ee9827647322 1073741824 Aug 03 08:52:32 devstack sudo[111555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:52:32 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-514cfc7f-1c87-46e8-bac6-5aa51ac99e95 tempest-CreateVolumesFromSourceVolumeTest-452209925 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4dca6f6e-5024-4178-97b2-37ce4ce06259) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:52:32 devstack cinder-volume[88899]: INFO cinder.volume.flows.manager.create_volume [None req-514cfc7f-1c87-46e8-bac6-5aa51ac99e95 tempest-CreateVolumesFromSourceVolumeTest-452209925 None] Volume volume-ec1bfdcf-58c8-4801-9c27-7c8e58243962 (ec1bfdcf-58c8-4801-9c27-7c8e58243962): created successfully Aug 03 08:52:32 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-514cfc7f-1c87-46e8-bac6-5aa51ac99e95 tempest-CreateVolumesFromSourceVolumeTest-452209925 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4dca6f6e-5024-4178-97b2-37ce4ce06259) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:52:32 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-514cfc7f-1c87-46e8-bac6-5aa51ac99e95 tempest-CreateVolumesFromSourceVolumeTest-452209925 None] Flow 'volume_create_manager' (4a11d31f-5240-4213-a7dc-e6ac104307c2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:52:32 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-514cfc7f-1c87-46e8-bac6-5aa51ac99e95 tempest-CreateVolumesFromSourceVolumeTest-452209925 None] Created volume successfully. Aug 03 08:52:32 devstack sudo[111555]: pam_unix(sudo:session): session closed for user root Aug 03 08:52:32 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-cf9dd25c-0937-49ea-a5eb-ff2bfaaa599f tempest-CreateVolumesFromSourceVolumeTest-452209925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-dbb223a0-839b-436c-99bc-ee9827647322 1073741824" returned: 0 in 0.415s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:52:32 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-cf9dd25c-0937-49ea-a5eb-ff2bfaaa599f tempest-CreateVolumesFromSourceVolumeTest-452209925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-dbb223a0-839b-436c-99bc-ee9827647322 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:52:32 devstack sudo[111562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-dbb223a0-839b-436c-99bc-ee9827647322 Aug 03 08:52:32 devstack sudo[111562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:52:33 devstack sudo[111562]: pam_unix(sudo:session): session closed for user root Aug 03 08:52:33 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-cf9dd25c-0937-49ea-a5eb-ff2bfaaa599f tempest-CreateVolumesFromSourceVolumeTest-452209925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-dbb223a0-839b-436c-99bc-ee9827647322" returned: 0 in 0.240s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:52:33 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-cf9dd25c-0937-49ea-a5eb-ff2bfaaa599f tempest-CreateVolumesFromSourceVolumeTest-452209925 None] <== create_volume: return (693ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'} {{(pid=88899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 08:52:33 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-cf9dd25c-0937-49ea-a5eb-ff2bfaaa599f tempest-CreateVolumesFromSourceVolumeTest-452209925 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.695s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:52:33 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-388ebe0d-5c9a-4902-b58e-43153d8b769e tempest-CreateVolumesFromSourceVolumeTest-452209925 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.212s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:52:33 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-388ebe0d-5c9a-4902-b58e-43153d8b769e tempest-CreateVolumesFromSourceVolumeTest-452209925 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:52:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-121921634',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0731e9e5-eae2-4ffa-8485-51f6e8277836,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0dcf43ecc38643728ba4336f51883471',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:52:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:52:32Z,use_quota=True,user_id='58c13db48b5f4c41a21a7d6f96dfef1e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8bde7129-1dc4-42ab-b852-ab32c61b4921),volume_type_id=8bde7129-1dc4-42ab-b852-ab32c61b4921)}" {{(pid=88899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 08:52:33 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-388ebe0d-5c9a-4902-b58e-43153d8b769e tempest-CreateVolumesFromSourceVolumeTest-452209925 None] Creating volume 0731e9e5-eae2-4ffa-8485-51f6e8277836 {{(pid=88899) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 08:52:33 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-388ebe0d-5c9a-4902-b58e-43153d8b769e tempest-CreateVolumesFromSourceVolumeTest-452209925 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:52:33 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-388ebe0d-5c9a-4902-b58e-43153d8b769e tempest-CreateVolumesFromSourceVolumeTest-452209925 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:52:33 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-388ebe0d-5c9a-4902-b58e-43153d8b769e tempest-CreateVolumesFromSourceVolumeTest-452209925 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:52:33 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-388ebe0d-5c9a-4902-b58e-43153d8b769e tempest-CreateVolumesFromSourceVolumeTest-452209925 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:52:33 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-388ebe0d-5c9a-4902-b58e-43153d8b769e tempest-CreateVolumesFromSourceVolumeTest-452209925 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:52:33 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-388ebe0d-5c9a-4902-b58e-43153d8b769e tempest-CreateVolumesFromSourceVolumeTest-452209925 None] Selected osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385 as target Quobyte volume. {{(pid=88899) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 08:52:33 devstack cinder-volume[88899]: INFO cinder.volume.drivers.remotefs [None req-388ebe0d-5c9a-4902-b58e-43153d8b769e tempest-CreateVolumesFromSourceVolumeTest-452209925 None] casted to osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385 Aug 03 08:52:33 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-388ebe0d-5c9a-4902-b58e-43153d8b769e tempest-CreateVolumesFromSourceVolumeTest-452209925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-0731e9e5-eae2-4ffa-8485-51f6e8277836 1073741824 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:52:33 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-cf9dd25c-0937-49ea-a5eb-ff2bfaaa599f tempest-CreateVolumesFromSourceVolumeTest-452209925 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43d45292-4441-4381-8667-8285db766345) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dbb223a0-839b-436c-99bc-ee9827647322', 'volume_size': 1}' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:52:33 devstack sudo[111565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-0731e9e5-eae2-4ffa-8485-51f6e8277836 1073741824 Aug 03 08:52:33 devstack sudo[111565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:52:33 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-cf9dd25c-0937-49ea-a5eb-ff2bfaaa599f tempest-CreateVolumesFromSourceVolumeTest-452209925 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8374af7e-a592-482e-8fa3-bf5f0186d069) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:52:33 devstack cinder-volume[88899]: INFO cinder.volume.flows.manager.create_volume [None req-cf9dd25c-0937-49ea-a5eb-ff2bfaaa599f tempest-CreateVolumesFromSourceVolumeTest-452209925 None] Volume volume-dbb223a0-839b-436c-99bc-ee9827647322 (dbb223a0-839b-436c-99bc-ee9827647322): created successfully Aug 03 08:52:33 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-cf9dd25c-0937-49ea-a5eb-ff2bfaaa599f tempest-CreateVolumesFromSourceVolumeTest-452209925 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8374af7e-a592-482e-8fa3-bf5f0186d069) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:52:33 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-cf9dd25c-0937-49ea-a5eb-ff2bfaaa599f tempest-CreateVolumesFromSourceVolumeTest-452209925 None] Flow 'volume_create_manager' (65630533-fd9b-417f-9fa4-32bdd3b427c9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:52:33 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-cf9dd25c-0937-49ea-a5eb-ff2bfaaa599f tempest-CreateVolumesFromSourceVolumeTest-452209925 None] Created volume successfully. Aug 03 08:52:33 devstack sudo[111565]: pam_unix(sudo:session): session closed for user root Aug 03 08:52:33 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-388ebe0d-5c9a-4902-b58e-43153d8b769e tempest-CreateVolumesFromSourceVolumeTest-452209925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-0731e9e5-eae2-4ffa-8485-51f6e8277836 1073741824" returned: 0 in 0.424s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:52:33 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-388ebe0d-5c9a-4902-b58e-43153d8b769e tempest-CreateVolumesFromSourceVolumeTest-452209925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-0731e9e5-eae2-4ffa-8485-51f6e8277836 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:52:33 devstack sudo[111570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-0731e9e5-eae2-4ffa-8485-51f6e8277836 Aug 03 08:52:33 devstack sudo[111570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:52:33 devstack sudo[111570]: pam_unix(sudo:session): session closed for user root Aug 03 08:52:33 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-388ebe0d-5c9a-4902-b58e-43153d8b769e tempest-CreateVolumesFromSourceVolumeTest-452209925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-0731e9e5-eae2-4ffa-8485-51f6e8277836" returned: 0 in 0.243s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:52:33 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-388ebe0d-5c9a-4902-b58e-43153d8b769e tempest-CreateVolumesFromSourceVolumeTest-452209925 None] <== create_volume: return (705ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'} {{(pid=88899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 08:52:33 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-388ebe0d-5c9a-4902-b58e-43153d8b769e tempest-CreateVolumesFromSourceVolumeTest-452209925 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.708s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:52:33 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-98cc502f-13f1-408d-9b3f-f60a5cc33e53 tempest-CreateVolumesFromSourceVolumeTest-452209925 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.532s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:52:33 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-98cc502f-13f1-408d-9b3f-f60a5cc33e53 tempest-CreateVolumesFromSourceVolumeTest-452209925 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:52:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1966028285',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e88c541f-734f-4164-ac72-e6751192c0c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0dcf43ecc38643728ba4336f51883471',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:52:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:52:32Z,use_quota=True,user_id='58c13db48b5f4c41a21a7d6f96dfef1e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8bde7129-1dc4-42ab-b852-ab32c61b4921),volume_type_id=8bde7129-1dc4-42ab-b852-ab32c61b4921)}" {{(pid=88899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 08:52:33 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-98cc502f-13f1-408d-9b3f-f60a5cc33e53 tempest-CreateVolumesFromSourceVolumeTest-452209925 None] Creating volume e88c541f-734f-4164-ac72-e6751192c0c3 {{(pid=88899) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 08:52:33 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-98cc502f-13f1-408d-9b3f-f60a5cc33e53 tempest-CreateVolumesFromSourceVolumeTest-452209925 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:52:33 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-98cc502f-13f1-408d-9b3f-f60a5cc33e53 tempest-CreateVolumesFromSourceVolumeTest-452209925 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:52:33 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-98cc502f-13f1-408d-9b3f-f60a5cc33e53 tempest-CreateVolumesFromSourceVolumeTest-452209925 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:52:33 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-98cc502f-13f1-408d-9b3f-f60a5cc33e53 tempest-CreateVolumesFromSourceVolumeTest-452209925 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:52:33 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-98cc502f-13f1-408d-9b3f-f60a5cc33e53 tempest-CreateVolumesFromSourceVolumeTest-452209925 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:52:33 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-98cc502f-13f1-408d-9b3f-f60a5cc33e53 tempest-CreateVolumesFromSourceVolumeTest-452209925 None] Selected osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385 as target Quobyte volume. {{(pid=88899) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 08:52:33 devstack cinder-volume[88899]: INFO cinder.volume.drivers.remotefs [None req-98cc502f-13f1-408d-9b3f-f60a5cc33e53 tempest-CreateVolumesFromSourceVolumeTest-452209925 None] casted to osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385 Aug 03 08:52:33 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-98cc502f-13f1-408d-9b3f-f60a5cc33e53 tempest-CreateVolumesFromSourceVolumeTest-452209925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-e88c541f-734f-4164-ac72-e6751192c0c3 1073741824 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:52:33 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-388ebe0d-5c9a-4902-b58e-43153d8b769e tempest-CreateVolumesFromSourceVolumeTest-452209925 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (398be227-583d-4d6f-be18-daec934ef6c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0731e9e5-eae2-4ffa-8485-51f6e8277836', 'volume_size': 1}' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:52:33 devstack sudo[111573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-e88c541f-734f-4164-ac72-e6751192c0c3 1073741824 Aug 03 08:52:33 devstack sudo[111573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:52:33 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-388ebe0d-5c9a-4902-b58e-43153d8b769e tempest-CreateVolumesFromSourceVolumeTest-452209925 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49405adf-4e42-4aa9-a6af-3cbc4a1c76e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:52:33 devstack cinder-volume[88899]: INFO cinder.volume.flows.manager.create_volume [None req-388ebe0d-5c9a-4902-b58e-43153d8b769e tempest-CreateVolumesFromSourceVolumeTest-452209925 None] Volume volume-0731e9e5-eae2-4ffa-8485-51f6e8277836 (0731e9e5-eae2-4ffa-8485-51f6e8277836): created successfully Aug 03 08:52:33 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-388ebe0d-5c9a-4902-b58e-43153d8b769e tempest-CreateVolumesFromSourceVolumeTest-452209925 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49405adf-4e42-4aa9-a6af-3cbc4a1c76e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:52:33 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-388ebe0d-5c9a-4902-b58e-43153d8b769e tempest-CreateVolumesFromSourceVolumeTest-452209925 None] Flow 'volume_create_manager' (6ec11ada-bb6c-4c76-8a64-277dab4ff02d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:52:33 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-388ebe0d-5c9a-4902-b58e-43153d8b769e tempest-CreateVolumesFromSourceVolumeTest-452209925 None] Created volume successfully. Aug 03 08:52:34 devstack sudo[111573]: pam_unix(sudo:session): session closed for user root Aug 03 08:52:34 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-98cc502f-13f1-408d-9b3f-f60a5cc33e53 tempest-CreateVolumesFromSourceVolumeTest-452209925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-e88c541f-734f-4164-ac72-e6751192c0c3 1073741824" returned: 0 in 0.423s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:52:34 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-98cc502f-13f1-408d-9b3f-f60a5cc33e53 tempest-CreateVolumesFromSourceVolumeTest-452209925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-e88c541f-734f-4164-ac72-e6751192c0c3 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:52:34 devstack sudo[111578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-e88c541f-734f-4164-ac72-e6751192c0c3 Aug 03 08:52:34 devstack sudo[111578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:52:34 devstack sudo[111578]: pam_unix(sudo:session): session closed for user root Aug 03 08:52:34 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-98cc502f-13f1-408d-9b3f-f60a5cc33e53 tempest-CreateVolumesFromSourceVolumeTest-452209925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-e88c541f-734f-4164-ac72-e6751192c0c3" returned: 0 in 0.241s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:52:34 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-98cc502f-13f1-408d-9b3f-f60a5cc33e53 tempest-CreateVolumesFromSourceVolumeTest-452209925 None] <== create_volume: return (701ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'} {{(pid=88899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 08:52:34 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-98cc502f-13f1-408d-9b3f-f60a5cc33e53 tempest-CreateVolumesFromSourceVolumeTest-452209925 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.704s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:52:34 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-98cc502f-13f1-408d-9b3f-f60a5cc33e53 tempest-CreateVolumesFromSourceVolumeTest-452209925 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fcba7af7-f3a9-4990-8c9b-28196745e153) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e88c541f-734f-4164-ac72-e6751192c0c3', 'volume_size': 1}' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:52:34 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-98cc502f-13f1-408d-9b3f-f60a5cc33e53 tempest-CreateVolumesFromSourceVolumeTest-452209925 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a4f242a-2f9c-4990-8c2f-c2953efaa80d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:52:34 devstack cinder-volume[88899]: INFO cinder.volume.flows.manager.create_volume [None req-98cc502f-13f1-408d-9b3f-f60a5cc33e53 tempest-CreateVolumesFromSourceVolumeTest-452209925 None] Volume volume-e88c541f-734f-4164-ac72-e6751192c0c3 (e88c541f-734f-4164-ac72-e6751192c0c3): created successfully Aug 03 08:52:34 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-98cc502f-13f1-408d-9b3f-f60a5cc33e53 tempest-CreateVolumesFromSourceVolumeTest-452209925 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a4f242a-2f9c-4990-8c2f-c2953efaa80d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:52:34 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-98cc502f-13f1-408d-9b3f-f60a5cc33e53 tempest-CreateVolumesFromSourceVolumeTest-452209925 None] Flow 'volume_create_manager' (dbac6dc3-a513-434c-8f12-28692c340587) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:52:34 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-98cc502f-13f1-408d-9b3f-f60a5cc33e53 tempest-CreateVolumesFromSourceVolumeTest-452209925 None] Created volume successfully. Aug 03 08:52:35 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-59596f3b-0afa-4323-89cc-b4a0fd614372 tempest-CreateVolumesFromSourceVolumeTest-452209925 None] Acquiring lock "cinder-e88c541f-734f-4164-ac72-e6751192c0c3-delete_volume" by "delete_volume" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:52:35 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-59596f3b-0afa-4323-89cc-b4a0fd614372 tempest-CreateVolumesFromSourceVolumeTest-452209925 None] Lock "cinder-e88c541f-734f-4164-ac72-e6751192c0c3-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:52:35 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-59596f3b-0afa-4323-89cc-b4a0fd614372 tempest-CreateVolumesFromSourceVolumeTest-452209925 None] Acquiring lock "cinder-quobyte-e88c541f-734f-4164-ac72-e6751192c0c3" by "delete_volume" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:52:35 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-59596f3b-0afa-4323-89cc-b4a0fd614372 tempest-CreateVolumesFromSourceVolumeTest-452209925 None] Lock "cinder-quobyte-e88c541f-734f-4164-ac72-e6751192c0c3" acquired by "delete_volume" :: waited 0.018s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:52:35 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[63298eae-68af-4e9f-8bb1-fbe96892e126]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:52:35 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-59596f3b-0afa-4323-89cc-b4a0fd614372 tempest-CreateVolumesFromSourceVolumeTest-452209925 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-e88c541f-734f-4164-ac72-e6751192c0c3 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:52:35 devstack sudo[111581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-e88c541f-734f-4164-ac72-e6751192c0c3 Aug 03 08:52:35 devstack sudo[111581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:52:35 devstack sudo[111581]: pam_unix(sudo:session): session closed for user root Aug 03 08:52:36 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-59596f3b-0afa-4323-89cc-b4a0fd614372 tempest-CreateVolumesFromSourceVolumeTest-452209925 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-e88c541f-734f-4164-ac72-e6751192c0c3" returned: 0 in 0.346s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:52:36 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-59596f3b-0afa-4323-89cc-b4a0fd614372 tempest-CreateVolumesFromSourceVolumeTest-452209925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-e88c541f-734f-4164-ac72-e6751192c0c3 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:52:36 devstack sudo[111586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-e88c541f-734f-4164-ac72-e6751192c0c3 Aug 03 08:52:36 devstack sudo[111586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:52:36 devstack sudo[111586]: pam_unix(sudo:session): session closed for user root Aug 03 08:52:36 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-59596f3b-0afa-4323-89cc-b4a0fd614372 tempest-CreateVolumesFromSourceVolumeTest-452209925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-e88c541f-734f-4164-ac72-e6751192c0c3" returned: 0 in 0.235s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:52:36 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-59596f3b-0afa-4323-89cc-b4a0fd614372 tempest-CreateVolumesFromSourceVolumeTest-452209925 None] Lock "cinder-quobyte-e88c541f-734f-4164-ac72-e6751192c0c3" released by "delete_volume" :: held 0.619s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:52:36 devstack cinder-volume[88899]: DEBUG cinder.quota [None req-59596f3b-0afa-4323-89cc-b4a0fd614372 tempest-CreateVolumesFromSourceVolumeTest-452209925 None] Created reservations ['2d8d3ffa-73d5-4db3-a574-4372f317b7f7', '744c5a83-002c-4328-bca2-23dd95eff152', '8c7b594f-9164-43ed-af58-97a8836b83c1', 'fd6dbff6-52cc-4ef7-ae6a-2ff3492f6b1d'] {{(pid=88899) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 08:52:36 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-59596f3b-0afa-4323-89cc-b4a0fd614372 tempest-CreateVolumesFromSourceVolumeTest-452209925 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:52:36 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-59596f3b-0afa-4323-89cc-b4a0fd614372 tempest-CreateVolumesFromSourceVolumeTest-452209925 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:52:36 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-59596f3b-0afa-4323-89cc-b4a0fd614372 tempest-CreateVolumesFromSourceVolumeTest-452209925 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:52:36 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-59596f3b-0afa-4323-89cc-b4a0fd614372 tempest-CreateVolumesFromSourceVolumeTest-452209925 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:52:36 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-59596f3b-0afa-4323-89cc-b4a0fd614372 tempest-CreateVolumesFromSourceVolumeTest-452209925 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:52:36 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-59596f3b-0afa-4323-89cc-b4a0fd614372 tempest-CreateVolumesFromSourceVolumeTest-452209925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:52:36 devstack sudo[111589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a Aug 03 08:52:36 devstack sudo[111589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:52:36 devstack sudo[111589]: pam_unix(sudo:session): session closed for user root Aug 03 08:52:36 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-59596f3b-0afa-4323-89cc-b4a0fd614372 tempest-CreateVolumesFromSourceVolumeTest-452209925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a" returned: 0 in 0.235s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:52:36 devstack cinder-volume[88899]: DEBUG cinder.manager [None req-59596f3b-0afa-4323-89cc-b4a0fd614372 tempest-CreateVolumesFromSourceVolumeTest-452209925 None] Notifying Schedulers of capabilities ... {{(pid=88899) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 08:52:36 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-59596f3b-0afa-4323-89cc-b4a0fd614372 tempest-CreateVolumesFromSourceVolumeTest-452209925 None] Deleted volume successfully. Aug 03 08:52:36 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-59596f3b-0afa-4323-89cc-b4a0fd614372 tempest-CreateVolumesFromSourceVolumeTest-452209925 None] Lock "cinder-e88c541f-734f-4164-ac72-e6751192c0c3-delete_volume" released by "delete_volume" :: held 1.041s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:52:36 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-bedc4301-d21f-447b-845f-3bec588cf09a tempest-CreateVolumesFromSourceVolumeTest-452209925 None] Acquiring lock "cinder-0731e9e5-eae2-4ffa-8485-51f6e8277836-delete_volume" by "delete_volume" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:52:36 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-bedc4301-d21f-447b-845f-3bec588cf09a tempest-CreateVolumesFromSourceVolumeTest-452209925 None] Lock "cinder-0731e9e5-eae2-4ffa-8485-51f6e8277836-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:52:36 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-bedc4301-d21f-447b-845f-3bec588cf09a tempest-CreateVolumesFromSourceVolumeTest-452209925 None] Acquiring lock "cinder-quobyte-0731e9e5-eae2-4ffa-8485-51f6e8277836" by "delete_volume" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:52:36 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-bedc4301-d21f-447b-845f-3bec588cf09a tempest-CreateVolumesFromSourceVolumeTest-452209925 None] Lock "cinder-quobyte-0731e9e5-eae2-4ffa-8485-51f6e8277836" acquired by "delete_volume" :: waited 0.014s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:52:36 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4a34252-8346-4083-a0ad-ba540e6c1407]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:52:36 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-bedc4301-d21f-447b-845f-3bec588cf09a tempest-CreateVolumesFromSourceVolumeTest-452209925 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-0731e9e5-eae2-4ffa-8485-51f6e8277836 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:52:36 devstack sudo[111592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-0731e9e5-eae2-4ffa-8485-51f6e8277836 Aug 03 08:52:36 devstack sudo[111592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:52:37 devstack sudo[111592]: pam_unix(sudo:session): session closed for user root Aug 03 08:52:37 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-bedc4301-d21f-447b-845f-3bec588cf09a tempest-CreateVolumesFromSourceVolumeTest-452209925 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-0731e9e5-eae2-4ffa-8485-51f6e8277836" returned: 0 in 0.335s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:52:37 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-bedc4301-d21f-447b-845f-3bec588cf09a tempest-CreateVolumesFromSourceVolumeTest-452209925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-0731e9e5-eae2-4ffa-8485-51f6e8277836 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:52:37 devstack sudo[111597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-0731e9e5-eae2-4ffa-8485-51f6e8277836 Aug 03 08:52:37 devstack sudo[111597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:52:37 devstack sudo[111597]: pam_unix(sudo:session): session closed for user root Aug 03 08:52:37 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-bedc4301-d21f-447b-845f-3bec588cf09a tempest-CreateVolumesFromSourceVolumeTest-452209925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-0731e9e5-eae2-4ffa-8485-51f6e8277836" returned: 0 in 0.241s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:52:37 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-bedc4301-d21f-447b-845f-3bec588cf09a tempest-CreateVolumesFromSourceVolumeTest-452209925 None] Lock "cinder-quobyte-0731e9e5-eae2-4ffa-8485-51f6e8277836" released by "delete_volume" :: held 0.614s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:52:37 devstack cinder-volume[88899]: DEBUG cinder.quota [None req-bedc4301-d21f-447b-845f-3bec588cf09a tempest-CreateVolumesFromSourceVolumeTest-452209925 None] Created reservations ['e44f1f16-23a9-48bf-972f-2c28f42ed08a', '10af11f3-6bc3-4c5d-93a3-6cda7a4865aa', '1165b7a1-9191-4f5c-80e9-99fba940fe7d', '8197d340-4759-4323-a82b-4ef8b2f548c4'] {{(pid=88899) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 08:52:37 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-bedc4301-d21f-447b-845f-3bec588cf09a tempest-CreateVolumesFromSourceVolumeTest-452209925 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:52:37 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-bedc4301-d21f-447b-845f-3bec588cf09a tempest-CreateVolumesFromSourceVolumeTest-452209925 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:52:37 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-bedc4301-d21f-447b-845f-3bec588cf09a tempest-CreateVolumesFromSourceVolumeTest-452209925 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:52:37 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-bedc4301-d21f-447b-845f-3bec588cf09a tempest-CreateVolumesFromSourceVolumeTest-452209925 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:52:37 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-bedc4301-d21f-447b-845f-3bec588cf09a tempest-CreateVolumesFromSourceVolumeTest-452209925 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:52:37 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-bedc4301-d21f-447b-845f-3bec588cf09a tempest-CreateVolumesFromSourceVolumeTest-452209925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:52:37 devstack sudo[111600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a Aug 03 08:52:37 devstack sudo[111600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:52:37 devstack sudo[111600]: pam_unix(sudo:session): session closed for user root Aug 03 08:52:37 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-bedc4301-d21f-447b-845f-3bec588cf09a tempest-CreateVolumesFromSourceVolumeTest-452209925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a" returned: 0 in 0.232s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:52:37 devstack cinder-volume[88899]: DEBUG cinder.manager [None req-bedc4301-d21f-447b-845f-3bec588cf09a tempest-CreateVolumesFromSourceVolumeTest-452209925 None] Notifying Schedulers of capabilities ... {{(pid=88899) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 08:52:37 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-bedc4301-d21f-447b-845f-3bec588cf09a tempest-CreateVolumesFromSourceVolumeTest-452209925 None] Deleted volume successfully. Aug 03 08:52:37 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-bedc4301-d21f-447b-845f-3bec588cf09a tempest-CreateVolumesFromSourceVolumeTest-452209925 None] Lock "cinder-0731e9e5-eae2-4ffa-8485-51f6e8277836-delete_volume" released by "delete_volume" :: held 1.022s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:52:37 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-c10bda5c-aaeb-494f-bfb9-bfcdc049b721 tempest-CreateVolumesFromSourceVolumeTest-452209925 None] Acquiring lock "cinder-dbb223a0-839b-436c-99bc-ee9827647322-delete_volume" by "delete_volume" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:52:37 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-c10bda5c-aaeb-494f-bfb9-bfcdc049b721 tempest-CreateVolumesFromSourceVolumeTest-452209925 None] Lock "cinder-dbb223a0-839b-436c-99bc-ee9827647322-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:52:37 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-c10bda5c-aaeb-494f-bfb9-bfcdc049b721 tempest-CreateVolumesFromSourceVolumeTest-452209925 None] Acquiring lock "cinder-quobyte-dbb223a0-839b-436c-99bc-ee9827647322" by "delete_volume" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:52:37 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-c10bda5c-aaeb-494f-bfb9-bfcdc049b721 tempest-CreateVolumesFromSourceVolumeTest-452209925 None] Lock "cinder-quobyte-dbb223a0-839b-436c-99bc-ee9827647322" acquired by "delete_volume" :: waited 0.012s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:52:37 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[55e5ce16-c3ba-44b8-8ef7-d4f84a4026ba]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:52:37 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-c10bda5c-aaeb-494f-bfb9-bfcdc049b721 tempest-CreateVolumesFromSourceVolumeTest-452209925 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-dbb223a0-839b-436c-99bc-ee9827647322 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:52:38 devstack sudo[111603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-dbb223a0-839b-436c-99bc-ee9827647322 Aug 03 08:52:38 devstack sudo[111603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:52:38 devstack sudo[111603]: pam_unix(sudo:session): session closed for user root Aug 03 08:52:38 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-c10bda5c-aaeb-494f-bfb9-bfcdc049b721 tempest-CreateVolumesFromSourceVolumeTest-452209925 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-dbb223a0-839b-436c-99bc-ee9827647322" returned: 0 in 0.350s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:52:38 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-c10bda5c-aaeb-494f-bfb9-bfcdc049b721 tempest-CreateVolumesFromSourceVolumeTest-452209925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-dbb223a0-839b-436c-99bc-ee9827647322 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:52:38 devstack sudo[111608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-dbb223a0-839b-436c-99bc-ee9827647322 Aug 03 08:52:38 devstack sudo[111608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:52:38 devstack sudo[111608]: pam_unix(sudo:session): session closed for user root Aug 03 08:52:38 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-c10bda5c-aaeb-494f-bfb9-bfcdc049b721 tempest-CreateVolumesFromSourceVolumeTest-452209925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-dbb223a0-839b-436c-99bc-ee9827647322" returned: 0 in 0.229s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:52:38 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-c10bda5c-aaeb-494f-bfb9-bfcdc049b721 tempest-CreateVolumesFromSourceVolumeTest-452209925 None] Lock "cinder-quobyte-dbb223a0-839b-436c-99bc-ee9827647322" released by "delete_volume" :: held 0.614s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:52:38 devstack cinder-volume[88899]: DEBUG cinder.quota [None req-c10bda5c-aaeb-494f-bfb9-bfcdc049b721 tempest-CreateVolumesFromSourceVolumeTest-452209925 None] Created reservations ['ca394adc-fbd2-4576-87e6-d1dbac952cdf', 'b6306fe2-3824-4a6a-b1a6-9d13cbc096a3', '040da8c6-395b-4e89-b68f-a954681d9a9c', '65d45316-40a5-4393-bbcf-f03943870514'] {{(pid=88899) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 08:52:38 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-c10bda5c-aaeb-494f-bfb9-bfcdc049b721 tempest-CreateVolumesFromSourceVolumeTest-452209925 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:52:38 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-c10bda5c-aaeb-494f-bfb9-bfcdc049b721 tempest-CreateVolumesFromSourceVolumeTest-452209925 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:52:38 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-c10bda5c-aaeb-494f-bfb9-bfcdc049b721 tempest-CreateVolumesFromSourceVolumeTest-452209925 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:52:38 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-c10bda5c-aaeb-494f-bfb9-bfcdc049b721 tempest-CreateVolumesFromSourceVolumeTest-452209925 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:52:38 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-c10bda5c-aaeb-494f-bfb9-bfcdc049b721 tempest-CreateVolumesFromSourceVolumeTest-452209925 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:52:38 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-c10bda5c-aaeb-494f-bfb9-bfcdc049b721 tempest-CreateVolumesFromSourceVolumeTest-452209925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:52:38 devstack sudo[111612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a Aug 03 08:52:38 devstack sudo[111612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:52:38 devstack sudo[111612]: pam_unix(sudo:session): session closed for user root Aug 03 08:52:38 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-c10bda5c-aaeb-494f-bfb9-bfcdc049b721 tempest-CreateVolumesFromSourceVolumeTest-452209925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a" returned: 0 in 0.247s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:52:38 devstack cinder-volume[88899]: DEBUG cinder.manager [None req-c10bda5c-aaeb-494f-bfb9-bfcdc049b721 tempest-CreateVolumesFromSourceVolumeTest-452209925 None] Notifying Schedulers of capabilities ... {{(pid=88899) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 08:52:38 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-c10bda5c-aaeb-494f-bfb9-bfcdc049b721 tempest-CreateVolumesFromSourceVolumeTest-452209925 None] Deleted volume successfully. Aug 03 08:52:38 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-c10bda5c-aaeb-494f-bfb9-bfcdc049b721 tempest-CreateVolumesFromSourceVolumeTest-452209925 None] Lock "cinder-dbb223a0-839b-436c-99bc-ee9827647322-delete_volume" released by "delete_volume" :: held 1.058s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:52:39 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-f8a806d9-71f4-4677-ab82-a2931015ccda tempest-CreateVolumesFromSourceVolumeTest-452209925 None] Acquiring lock "cinder-ec1bfdcf-58c8-4801-9c27-7c8e58243962-delete_volume" by "delete_volume" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:52:39 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-f8a806d9-71f4-4677-ab82-a2931015ccda tempest-CreateVolumesFromSourceVolumeTest-452209925 None] Lock "cinder-ec1bfdcf-58c8-4801-9c27-7c8e58243962-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:52:39 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-f8a806d9-71f4-4677-ab82-a2931015ccda tempest-CreateVolumesFromSourceVolumeTest-452209925 None] Acquiring lock "cinder-quobyte-ec1bfdcf-58c8-4801-9c27-7c8e58243962" by "delete_volume" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:52:39 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-f8a806d9-71f4-4677-ab82-a2931015ccda tempest-CreateVolumesFromSourceVolumeTest-452209925 None] Lock "cinder-quobyte-ec1bfdcf-58c8-4801-9c27-7c8e58243962" acquired by "delete_volume" :: waited 0.014s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:52:39 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[f57c51ec-eb63-42a6-a1eb-860a54c8f9f2]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:52:39 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-f8a806d9-71f4-4677-ab82-a2931015ccda tempest-CreateVolumesFromSourceVolumeTest-452209925 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-ec1bfdcf-58c8-4801-9c27-7c8e58243962 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:52:39 devstack sudo[111615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-ec1bfdcf-58c8-4801-9c27-7c8e58243962 Aug 03 08:52:39 devstack sudo[111615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:52:39 devstack sudo[111615]: pam_unix(sudo:session): session closed for user root Aug 03 08:52:39 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-f8a806d9-71f4-4677-ab82-a2931015ccda tempest-CreateVolumesFromSourceVolumeTest-452209925 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-ec1bfdcf-58c8-4801-9c27-7c8e58243962" returned: 0 in 0.351s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:52:39 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-f8a806d9-71f4-4677-ab82-a2931015ccda tempest-CreateVolumesFromSourceVolumeTest-452209925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-ec1bfdcf-58c8-4801-9c27-7c8e58243962 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:52:39 devstack sudo[111620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-ec1bfdcf-58c8-4801-9c27-7c8e58243962 Aug 03 08:52:39 devstack sudo[111620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:52:39 devstack sudo[111620]: pam_unix(sudo:session): session closed for user root Aug 03 08:52:39 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-f8a806d9-71f4-4677-ab82-a2931015ccda tempest-CreateVolumesFromSourceVolumeTest-452209925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-ec1bfdcf-58c8-4801-9c27-7c8e58243962" returned: 0 in 0.235s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:52:39 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-f8a806d9-71f4-4677-ab82-a2931015ccda tempest-CreateVolumesFromSourceVolumeTest-452209925 None] Lock "cinder-quobyte-ec1bfdcf-58c8-4801-9c27-7c8e58243962" released by "delete_volume" :: held 0.622s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:52:39 devstack cinder-volume[88899]: DEBUG cinder.quota [None req-f8a806d9-71f4-4677-ab82-a2931015ccda tempest-CreateVolumesFromSourceVolumeTest-452209925 None] Created reservations ['db634b1d-8af4-445a-aa42-346c928585ef', 'f9394d8b-d8b0-4ad0-9356-765af1972ceb', '908eaeaa-56fa-4d8f-a71e-90b15ec8a7db', '2dded844-893d-44f5-b58d-c853ee84447e'] {{(pid=88899) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 08:52:39 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-f8a806d9-71f4-4677-ab82-a2931015ccda tempest-CreateVolumesFromSourceVolumeTest-452209925 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:52:39 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-f8a806d9-71f4-4677-ab82-a2931015ccda tempest-CreateVolumesFromSourceVolumeTest-452209925 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:52:39 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-f8a806d9-71f4-4677-ab82-a2931015ccda tempest-CreateVolumesFromSourceVolumeTest-452209925 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:52:39 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-f8a806d9-71f4-4677-ab82-a2931015ccda tempest-CreateVolumesFromSourceVolumeTest-452209925 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:52:39 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-f8a806d9-71f4-4677-ab82-a2931015ccda tempest-CreateVolumesFromSourceVolumeTest-452209925 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:52:39 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-f8a806d9-71f4-4677-ab82-a2931015ccda tempest-CreateVolumesFromSourceVolumeTest-452209925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:52:39 devstack sudo[111623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a Aug 03 08:52:39 devstack sudo[111623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:52:40 devstack sudo[111623]: pam_unix(sudo:session): session closed for user root Aug 03 08:52:40 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-f8a806d9-71f4-4677-ab82-a2931015ccda tempest-CreateVolumesFromSourceVolumeTest-452209925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a" returned: 0 in 0.232s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:52:40 devstack cinder-volume[88899]: DEBUG cinder.manager [None req-f8a806d9-71f4-4677-ab82-a2931015ccda tempest-CreateVolumesFromSourceVolumeTest-452209925 None] Notifying Schedulers of capabilities ... {{(pid=88899) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 08:52:40 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-f8a806d9-71f4-4677-ab82-a2931015ccda tempest-CreateVolumesFromSourceVolumeTest-452209925 None] Deleted volume successfully. Aug 03 08:52:40 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-f8a806d9-71f4-4677-ab82-a2931015ccda tempest-CreateVolumesFromSourceVolumeTest-452209925 None] Lock "cinder-ec1bfdcf-58c8-4801-9c27-7c8e58243962-delete_volume" released by "delete_volume" :: held 1.040s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:52:40 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-c7189a9a-77d6-4113-969d-06250568dcda tempest-CreateVolumesFromSourceVolumeTest-452209925 None] Acquiring lock "cinder-4211fe8a-3a38-4c2f-8767-78916eee5d22-delete_volume" by "delete_volume" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:52:40 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-c7189a9a-77d6-4113-969d-06250568dcda tempest-CreateVolumesFromSourceVolumeTest-452209925 None] Lock "cinder-4211fe8a-3a38-4c2f-8767-78916eee5d22-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:52:40 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-c7189a9a-77d6-4113-969d-06250568dcda tempest-CreateVolumesFromSourceVolumeTest-452209925 None] Acquiring lock "cinder-quobyte-4211fe8a-3a38-4c2f-8767-78916eee5d22" by "delete_volume" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:52:40 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-c7189a9a-77d6-4113-969d-06250568dcda tempest-CreateVolumesFromSourceVolumeTest-452209925 None] Lock "cinder-quobyte-4211fe8a-3a38-4c2f-8767-78916eee5d22" acquired by "delete_volume" :: waited 0.016s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:52:40 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[34ddc59d-babd-4375-a0ef-830237cdb1f1]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:52:40 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-c7189a9a-77d6-4113-969d-06250568dcda tempest-CreateVolumesFromSourceVolumeTest-452209925 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-4211fe8a-3a38-4c2f-8767-78916eee5d22 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:52:40 devstack sudo[111626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-4211fe8a-3a38-4c2f-8767-78916eee5d22 Aug 03 08:52:40 devstack sudo[111626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:52:40 devstack sudo[111626]: pam_unix(sudo:session): session closed for user root Aug 03 08:52:40 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-c7189a9a-77d6-4113-969d-06250568dcda tempest-CreateVolumesFromSourceVolumeTest-452209925 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-4211fe8a-3a38-4c2f-8767-78916eee5d22" returned: 0 in 0.329s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:52:40 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-c7189a9a-77d6-4113-969d-06250568dcda tempest-CreateVolumesFromSourceVolumeTest-452209925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-4211fe8a-3a38-4c2f-8767-78916eee5d22 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:52:40 devstack sudo[111631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-4211fe8a-3a38-4c2f-8767-78916eee5d22 Aug 03 08:52:40 devstack sudo[111631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:52:40 devstack sudo[111631]: pam_unix(sudo:session): session closed for user root Aug 03 08:52:40 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-c7189a9a-77d6-4113-969d-06250568dcda tempest-CreateVolumesFromSourceVolumeTest-452209925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-4211fe8a-3a38-4c2f-8767-78916eee5d22" returned: 0 in 0.234s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:52:40 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-c7189a9a-77d6-4113-969d-06250568dcda tempest-CreateVolumesFromSourceVolumeTest-452209925 None] Lock "cinder-quobyte-4211fe8a-3a38-4c2f-8767-78916eee5d22" released by "delete_volume" :: held 0.598s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:52:40 devstack cinder-volume[88899]: DEBUG cinder.quota [None req-c7189a9a-77d6-4113-969d-06250568dcda tempest-CreateVolumesFromSourceVolumeTest-452209925 None] Created reservations ['9b8965b7-4fd0-4091-8cab-369a4465798b', '1bf892d0-4a56-48db-b7c5-7635f9d7bfa4', '0f4d45ca-edfb-4127-8f39-8dc3e313a451', '1ee700cd-1425-4d4f-a365-06716154a730'] {{(pid=88899) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 08:52:40 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-c7189a9a-77d6-4113-969d-06250568dcda tempest-CreateVolumesFromSourceVolumeTest-452209925 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:52:40 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-c7189a9a-77d6-4113-969d-06250568dcda tempest-CreateVolumesFromSourceVolumeTest-452209925 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:52:40 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-c7189a9a-77d6-4113-969d-06250568dcda tempest-CreateVolumesFromSourceVolumeTest-452209925 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:52:40 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-c7189a9a-77d6-4113-969d-06250568dcda tempest-CreateVolumesFromSourceVolumeTest-452209925 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:52:40 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-c7189a9a-77d6-4113-969d-06250568dcda tempest-CreateVolumesFromSourceVolumeTest-452209925 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:52:40 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-c7189a9a-77d6-4113-969d-06250568dcda tempest-CreateVolumesFromSourceVolumeTest-452209925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:52:40 devstack sudo[111634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a Aug 03 08:52:40 devstack sudo[111634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:52:41 devstack sudo[111634]: pam_unix(sudo:session): session closed for user root Aug 03 08:52:41 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-c7189a9a-77d6-4113-969d-06250568dcda tempest-CreateVolumesFromSourceVolumeTest-452209925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a" returned: 0 in 0.232s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:52:41 devstack cinder-volume[88899]: DEBUG cinder.manager [None req-c7189a9a-77d6-4113-969d-06250568dcda tempest-CreateVolumesFromSourceVolumeTest-452209925 None] Notifying Schedulers of capabilities ... {{(pid=88899) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 08:52:41 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-c7189a9a-77d6-4113-969d-06250568dcda tempest-CreateVolumesFromSourceVolumeTest-452209925 None] Deleted volume successfully. Aug 03 08:52:41 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-c7189a9a-77d6-4113-969d-06250568dcda tempest-CreateVolumesFromSourceVolumeTest-452209925 None] Lock "cinder-4211fe8a-3a38-4c2f-8767-78916eee5d22-delete_volume" released by "delete_volume" :: held 1.008s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:52:41 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-6f5cefcc-1a09-431b-99c9-11fce78b4f10 tempest-CreateVolumesFromSourceVolumeTest-452209925 None] Acquiring lock "cinder-9a57cc4c-85a7-4f42-a1a6-893f67979d04-delete_volume" by "delete_volume" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:52:41 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-6f5cefcc-1a09-431b-99c9-11fce78b4f10 tempest-CreateVolumesFromSourceVolumeTest-452209925 None] Lock "cinder-9a57cc4c-85a7-4f42-a1a6-893f67979d04-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:52:41 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-6f5cefcc-1a09-431b-99c9-11fce78b4f10 tempest-CreateVolumesFromSourceVolumeTest-452209925 None] Acquiring lock "cinder-quobyte-9a57cc4c-85a7-4f42-a1a6-893f67979d04" by "delete_volume" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:52:41 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-6f5cefcc-1a09-431b-99c9-11fce78b4f10 tempest-CreateVolumesFromSourceVolumeTest-452209925 None] Lock "cinder-quobyte-9a57cc4c-85a7-4f42-a1a6-893f67979d04" acquired by "delete_volume" :: waited 0.018s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:52:41 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5afa570-a300-4cb6-8898-32ccb60b03fc]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:52:41 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-6f5cefcc-1a09-431b-99c9-11fce78b4f10 tempest-CreateVolumesFromSourceVolumeTest-452209925 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-9a57cc4c-85a7-4f42-a1a6-893f67979d04 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:52:41 devstack sudo[111637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-9a57cc4c-85a7-4f42-a1a6-893f67979d04 Aug 03 08:52:41 devstack sudo[111637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:52:41 devstack sudo[111637]: pam_unix(sudo:session): session closed for user root Aug 03 08:52:41 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-6f5cefcc-1a09-431b-99c9-11fce78b4f10 tempest-CreateVolumesFromSourceVolumeTest-452209925 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-9a57cc4c-85a7-4f42-a1a6-893f67979d04" returned: 0 in 0.362s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:52:41 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-6f5cefcc-1a09-431b-99c9-11fce78b4f10 tempest-CreateVolumesFromSourceVolumeTest-452209925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-9a57cc4c-85a7-4f42-a1a6-893f67979d04 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:52:41 devstack sudo[111642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-9a57cc4c-85a7-4f42-a1a6-893f67979d04 Aug 03 08:52:41 devstack sudo[111642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:52:42 devstack sudo[111642]: pam_unix(sudo:session): session closed for user root Aug 03 08:52:42 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-6f5cefcc-1a09-431b-99c9-11fce78b4f10 tempest-CreateVolumesFromSourceVolumeTest-452209925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-9a57cc4c-85a7-4f42-a1a6-893f67979d04" returned: 0 in 0.252s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:52:42 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-6f5cefcc-1a09-431b-99c9-11fce78b4f10 tempest-CreateVolumesFromSourceVolumeTest-452209925 None] Lock "cinder-quobyte-9a57cc4c-85a7-4f42-a1a6-893f67979d04" released by "delete_volume" :: held 0.650s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:52:42 devstack cinder-volume[88899]: DEBUG cinder.quota [None req-6f5cefcc-1a09-431b-99c9-11fce78b4f10 tempest-CreateVolumesFromSourceVolumeTest-452209925 None] Created reservations ['9fa15712-4a50-420b-a62e-ca2a7bc60eb4', '2bc84deb-451f-4bc8-b9fa-eb381f0d5a9b', '1c329aa4-97ea-4e03-9422-174e70726561', '0983edd5-5d24-4b4f-b426-cea41b09740c'] {{(pid=88899) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 08:52:42 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-6f5cefcc-1a09-431b-99c9-11fce78b4f10 tempest-CreateVolumesFromSourceVolumeTest-452209925 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:52:42 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-6f5cefcc-1a09-431b-99c9-11fce78b4f10 tempest-CreateVolumesFromSourceVolumeTest-452209925 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:52:42 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-6f5cefcc-1a09-431b-99c9-11fce78b4f10 tempest-CreateVolumesFromSourceVolumeTest-452209925 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:52:42 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-6f5cefcc-1a09-431b-99c9-11fce78b4f10 tempest-CreateVolumesFromSourceVolumeTest-452209925 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:52:42 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-6f5cefcc-1a09-431b-99c9-11fce78b4f10 tempest-CreateVolumesFromSourceVolumeTest-452209925 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:52:42 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-6f5cefcc-1a09-431b-99c9-11fce78b4f10 tempest-CreateVolumesFromSourceVolumeTest-452209925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:52:42 devstack sudo[111645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a Aug 03 08:52:42 devstack sudo[111645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:52:42 devstack sudo[111645]: pam_unix(sudo:session): session closed for user root Aug 03 08:52:42 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-6f5cefcc-1a09-431b-99c9-11fce78b4f10 tempest-CreateVolumesFromSourceVolumeTest-452209925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a" returned: 0 in 0.242s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:52:42 devstack cinder-volume[88899]: DEBUG cinder.manager [None req-6f5cefcc-1a09-431b-99c9-11fce78b4f10 tempest-CreateVolumesFromSourceVolumeTest-452209925 None] Notifying Schedulers of capabilities ... {{(pid=88899) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 08:52:42 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-6f5cefcc-1a09-431b-99c9-11fce78b4f10 tempest-CreateVolumesFromSourceVolumeTest-452209925 None] Deleted volume successfully. Aug 03 08:52:42 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-6f5cefcc-1a09-431b-99c9-11fce78b4f10 tempest-CreateVolumesFromSourceVolumeTest-452209925 None] Lock "cinder-9a57cc4c-85a7-4f42-a1a6-893f67979d04-delete_volume" released by "delete_volume" :: held 1.111s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:52:45 devstack cinder-volume[88899]: DEBUG cinder.volume.flows.manager.create_volume [None req-51996e96-0aaf-4b14-9682-4c9786d64bf8 tempest-ProjectReaderTests-10449547 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88899) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 08:52:45 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-51996e96-0aaf-4b14-9682-4c9786d64bf8 tempest-ProjectReaderTests-10449547 None] Flow 'volume_create_manager' (194bfc17-7d4b-46ee-a3c8-436b862eff51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:52:45 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-51996e96-0aaf-4b14-9682-4c9786d64bf8 tempest-ProjectReaderTests-10449547 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ea2dc8e-6c70-41c1-b4f6-e89c0e2a823b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:52:45 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-51996e96-0aaf-4b14-9682-4c9786d64bf8 tempest-ProjectReaderTests-10449547 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ea2dc8e-6c70-41c1-b4f6-e89c0e2a823b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:52:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-195151853',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba45733c-34e1-43d4-af7e-bfe62a8307c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6237b793de2b4f28ab479bfba1103704',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:52:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:52:46Z,use_quota=True,user_id='9871d96c6e934953aad7c79e37e80213',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8bde7129-1dc4-42ab-b852-ab32c61b4921),volume_type_id=8bde7129-1dc4-42ab-b852-ab32c61b4921)' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:52:45 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-51996e96-0aaf-4b14-9682-4c9786d64bf8 tempest-ProjectReaderTests-10449547 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f1fa0bc-c018-4aec-8687-1520b2425a99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:52:45 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-51996e96-0aaf-4b14-9682-4c9786d64bf8 tempest-ProjectReaderTests-10449547 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f1fa0bc-c018-4aec-8687-1520b2425a99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:52:45 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-51996e96-0aaf-4b14-9682-4c9786d64bf8 tempest-ProjectReaderTests-10449547 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9254b912-5639-43ef-8559-cb7d8ed0141f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:52:45 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-51996e96-0aaf-4b14-9682-4c9786d64bf8 tempest-ProjectReaderTests-10449547 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9254b912-5639-43ef-8559-cb7d8ed0141f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ba45733c-34e1-43d4-af7e-bfe62a8307c4', 'volume_name': 'volume-ba45733c-34e1-43d4-af7e-bfe62a8307c4', 'volume_size': 1}' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:52:45 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-51996e96-0aaf-4b14-9682-4c9786d64bf8 tempest-ProjectReaderTests-10449547 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce045cad-b5f9-4410-bee3-d9f4da1c49bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:52:45 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-51996e96-0aaf-4b14-9682-4c9786d64bf8 tempest-ProjectReaderTests-10449547 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce045cad-b5f9-4410-bee3-d9f4da1c49bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:52:45 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-51996e96-0aaf-4b14-9682-4c9786d64bf8 tempest-ProjectReaderTests-10449547 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13071fae-ab8f-4696-83bb-5d3fc6ece03b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:52:45 devstack cinder-volume[88899]: INFO cinder.volume.flows.manager.create_volume [None req-51996e96-0aaf-4b14-9682-4c9786d64bf8 tempest-ProjectReaderTests-10449547 None] Volume ba45733c-34e1-43d4-af7e-bfe62a8307c4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ba45733c-34e1-43d4-af7e-bfe62a8307c4', 'volume_size': 1} Aug 03 08:52:45 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-51996e96-0aaf-4b14-9682-4c9786d64bf8 tempest-ProjectReaderTests-10449547 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:52:45 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-51996e96-0aaf-4b14-9682-4c9786d64bf8 tempest-ProjectReaderTests-10449547 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:52:45 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-51996e96-0aaf-4b14-9682-4c9786d64bf8 tempest-ProjectReaderTests-10449547 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:52:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-195151853',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba45733c-34e1-43d4-af7e-bfe62a8307c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6237b793de2b4f28ab479bfba1103704',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:52:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:52:46Z,use_quota=True,user_id='9871d96c6e934953aad7c79e37e80213',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8bde7129-1dc4-42ab-b852-ab32c61b4921),volume_type_id=8bde7129-1dc4-42ab-b852-ab32c61b4921)}" {{(pid=88899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 08:52:45 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-51996e96-0aaf-4b14-9682-4c9786d64bf8 tempest-ProjectReaderTests-10449547 None] Creating volume ba45733c-34e1-43d4-af7e-bfe62a8307c4 {{(pid=88899) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 08:52:45 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-51996e96-0aaf-4b14-9682-4c9786d64bf8 tempest-ProjectReaderTests-10449547 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:52:45 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-51996e96-0aaf-4b14-9682-4c9786d64bf8 tempest-ProjectReaderTests-10449547 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:52:45 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-51996e96-0aaf-4b14-9682-4c9786d64bf8 tempest-ProjectReaderTests-10449547 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:52:45 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-51996e96-0aaf-4b14-9682-4c9786d64bf8 tempest-ProjectReaderTests-10449547 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:52:45 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-51996e96-0aaf-4b14-9682-4c9786d64bf8 tempest-ProjectReaderTests-10449547 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:52:45 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-51996e96-0aaf-4b14-9682-4c9786d64bf8 tempest-ProjectReaderTests-10449547 None] Selected osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385 as target Quobyte volume. {{(pid=88899) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 08:52:45 devstack cinder-volume[88899]: INFO cinder.volume.drivers.remotefs [None req-51996e96-0aaf-4b14-9682-4c9786d64bf8 tempest-ProjectReaderTests-10449547 None] casted to osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385 Aug 03 08:52:45 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-51996e96-0aaf-4b14-9682-4c9786d64bf8 tempest-ProjectReaderTests-10449547 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-ba45733c-34e1-43d4-af7e-bfe62a8307c4 1073741824 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:52:45 devstack sudo[111648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-ba45733c-34e1-43d4-af7e-bfe62a8307c4 1073741824 Aug 03 08:52:45 devstack sudo[111648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:52:46 devstack sudo[111648]: pam_unix(sudo:session): session closed for user root Aug 03 08:52:46 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-51996e96-0aaf-4b14-9682-4c9786d64bf8 tempest-ProjectReaderTests-10449547 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-ba45733c-34e1-43d4-af7e-bfe62a8307c4 1073741824" returned: 0 in 0.410s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:52:46 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-51996e96-0aaf-4b14-9682-4c9786d64bf8 tempest-ProjectReaderTests-10449547 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-ba45733c-34e1-43d4-af7e-bfe62a8307c4 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:52:46 devstack sudo[111654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-ba45733c-34e1-43d4-af7e-bfe62a8307c4 Aug 03 08:52:46 devstack sudo[111654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:52:46 devstack sudo[111654]: pam_unix(sudo:session): session closed for user root Aug 03 08:52:46 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-51996e96-0aaf-4b14-9682-4c9786d64bf8 tempest-ProjectReaderTests-10449547 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-ba45733c-34e1-43d4-af7e-bfe62a8307c4" returned: 0 in 0.248s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:52:46 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-51996e96-0aaf-4b14-9682-4c9786d64bf8 tempest-ProjectReaderTests-10449547 None] <== create_volume: return (702ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'} {{(pid=88899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 08:52:46 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-51996e96-0aaf-4b14-9682-4c9786d64bf8 tempest-ProjectReaderTests-10449547 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.705s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:52:46 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-51996e96-0aaf-4b14-9682-4c9786d64bf8 tempest-ProjectReaderTests-10449547 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13071fae-ab8f-4696-83bb-5d3fc6ece03b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ba45733c-34e1-43d4-af7e-bfe62a8307c4', 'volume_size': 1}' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:52:46 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-51996e96-0aaf-4b14-9682-4c9786d64bf8 tempest-ProjectReaderTests-10449547 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f80f660a-85d3-4909-960a-8dc9312ec47a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:52:46 devstack cinder-volume[88899]: INFO cinder.volume.flows.manager.create_volume [None req-51996e96-0aaf-4b14-9682-4c9786d64bf8 tempest-ProjectReaderTests-10449547 None] Volume volume-ba45733c-34e1-43d4-af7e-bfe62a8307c4 (ba45733c-34e1-43d4-af7e-bfe62a8307c4): created successfully Aug 03 08:52:46 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-51996e96-0aaf-4b14-9682-4c9786d64bf8 tempest-ProjectReaderTests-10449547 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f80f660a-85d3-4909-960a-8dc9312ec47a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:52:46 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-51996e96-0aaf-4b14-9682-4c9786d64bf8 tempest-ProjectReaderTests-10449547 None] Flow 'volume_create_manager' (194bfc17-7d4b-46ee-a3c8-436b862eff51) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:52:46 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-51996e96-0aaf-4b14-9682-4c9786d64bf8 tempest-ProjectReaderTests-10449547 None] Created volume successfully. Aug 03 08:52:47 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-10593b51-d791-4618-b1ee-faddf27f1023 tempest-ProjectReaderTests-10449547 None] Acquiring lock "cinder-ba45733c-34e1-43d4-af7e-bfe62a8307c4-delete_volume" by "delete_volume" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:52:47 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-10593b51-d791-4618-b1ee-faddf27f1023 tempest-ProjectReaderTests-10449547 None] Lock "cinder-ba45733c-34e1-43d4-af7e-bfe62a8307c4-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:52:47 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-10593b51-d791-4618-b1ee-faddf27f1023 tempest-ProjectReaderTests-10449547 None] Acquiring lock "cinder-quobyte-ba45733c-34e1-43d4-af7e-bfe62a8307c4" by "delete_volume" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:52:47 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-10593b51-d791-4618-b1ee-faddf27f1023 tempest-ProjectReaderTests-10449547 None] Lock "cinder-quobyte-ba45733c-34e1-43d4-af7e-bfe62a8307c4" acquired by "delete_volume" :: waited 0.015s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:52:47 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbcb1ab0-b267-4e71-894a-b8cab77d6ba5]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:52:47 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-10593b51-d791-4618-b1ee-faddf27f1023 tempest-ProjectReaderTests-10449547 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-ba45733c-34e1-43d4-af7e-bfe62a8307c4 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:52:47 devstack sudo[111657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-ba45733c-34e1-43d4-af7e-bfe62a8307c4 Aug 03 08:52:47 devstack sudo[111657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:52:47 devstack sudo[111657]: pam_unix(sudo:session): session closed for user root Aug 03 08:52:47 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-10593b51-d791-4618-b1ee-faddf27f1023 tempest-ProjectReaderTests-10449547 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-ba45733c-34e1-43d4-af7e-bfe62a8307c4" returned: 0 in 0.364s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:52:47 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-10593b51-d791-4618-b1ee-faddf27f1023 tempest-ProjectReaderTests-10449547 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-ba45733c-34e1-43d4-af7e-bfe62a8307c4 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:52:47 devstack sudo[111662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-ba45733c-34e1-43d4-af7e-bfe62a8307c4 Aug 03 08:52:47 devstack sudo[111662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:52:47 devstack sudo[111662]: pam_unix(sudo:session): session closed for user root Aug 03 08:52:47 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-10593b51-d791-4618-b1ee-faddf27f1023 tempest-ProjectReaderTests-10449547 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-ba45733c-34e1-43d4-af7e-bfe62a8307c4" returned: 0 in 0.247s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:52:47 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-10593b51-d791-4618-b1ee-faddf27f1023 tempest-ProjectReaderTests-10449547 None] Lock "cinder-quobyte-ba45733c-34e1-43d4-af7e-bfe62a8307c4" released by "delete_volume" :: held 0.655s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:52:47 devstack cinder-volume[88899]: DEBUG cinder.quota [None req-10593b51-d791-4618-b1ee-faddf27f1023 tempest-ProjectReaderTests-10449547 None] Created reservations ['cdaf649e-29c0-41dc-88b2-b5cc42506b6d', '9f2be2ad-702c-4937-841b-038ad227923a', '6cc9ae51-b180-4fff-b276-b1656765ef90', '9d65b187-053c-4b7a-b20f-778b7324c6ab'] {{(pid=88899) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 08:52:47 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-10593b51-d791-4618-b1ee-faddf27f1023 tempest-ProjectReaderTests-10449547 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:52:47 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-10593b51-d791-4618-b1ee-faddf27f1023 tempest-ProjectReaderTests-10449547 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:52:47 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-10593b51-d791-4618-b1ee-faddf27f1023 tempest-ProjectReaderTests-10449547 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:52:47 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-10593b51-d791-4618-b1ee-faddf27f1023 tempest-ProjectReaderTests-10449547 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:52:47 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-10593b51-d791-4618-b1ee-faddf27f1023 tempest-ProjectReaderTests-10449547 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:52:47 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-10593b51-d791-4618-b1ee-faddf27f1023 tempest-ProjectReaderTests-10449547 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:52:47 devstack sudo[111665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a Aug 03 08:52:47 devstack sudo[111665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:52:48 devstack sudo[111665]: pam_unix(sudo:session): session closed for user root Aug 03 08:52:48 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-10593b51-d791-4618-b1ee-faddf27f1023 tempest-ProjectReaderTests-10449547 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a" returned: 0 in 0.247s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:52:48 devstack cinder-volume[88899]: DEBUG cinder.manager [None req-10593b51-d791-4618-b1ee-faddf27f1023 tempest-ProjectReaderTests-10449547 None] Notifying Schedulers of capabilities ... {{(pid=88899) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 08:52:48 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-10593b51-d791-4618-b1ee-faddf27f1023 tempest-ProjectReaderTests-10449547 None] Deleted volume successfully. Aug 03 08:52:48 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-10593b51-d791-4618-b1ee-faddf27f1023 tempest-ProjectReaderTests-10449547 None] Lock "cinder-ba45733c-34e1-43d4-af7e-bfe62a8307c4-delete_volume" released by "delete_volume" :: held 1.120s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:52:48 devstack cinder-volume[88899]: DEBUG cinder.volume.flows.manager.create_volume [None req-53b4a8e0-cec8-4abd-95b9-7338b524dee2 tempest-ProjectReaderTests-10449547 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88899) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 08:52:48 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-53b4a8e0-cec8-4abd-95b9-7338b524dee2 tempest-ProjectReaderTests-10449547 None] Flow 'volume_create_manager' (7572284f-3a62-427a-8f38-e9ad056e539b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:52:48 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-53b4a8e0-cec8-4abd-95b9-7338b524dee2 tempest-ProjectReaderTests-10449547 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e84fd738-54bf-49cf-85ae-aa0d7812086e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:52:48 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-53b4a8e0-cec8-4abd-95b9-7338b524dee2 tempest-ProjectReaderTests-10449547 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e84fd738-54bf-49cf-85ae-aa0d7812086e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:52:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-155320260',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb4de04f-66b8-4025-85cc-36c8c0763815,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6237b793de2b4f28ab479bfba1103704',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:52:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:52:49Z,use_quota=True,user_id='9871d96c6e934953aad7c79e37e80213',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8bde7129-1dc4-42ab-b852-ab32c61b4921),volume_type_id=8bde7129-1dc4-42ab-b852-ab32c61b4921)' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:52:48 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-53b4a8e0-cec8-4abd-95b9-7338b524dee2 tempest-ProjectReaderTests-10449547 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3916f5c0-ac9d-486c-be33-cfefc97fca94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:52:48 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-53b4a8e0-cec8-4abd-95b9-7338b524dee2 tempest-ProjectReaderTests-10449547 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3916f5c0-ac9d-486c-be33-cfefc97fca94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:52:48 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-53b4a8e0-cec8-4abd-95b9-7338b524dee2 tempest-ProjectReaderTests-10449547 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4470f08d-66f4-41a3-8bbe-5124e28cb275) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:52:48 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-53b4a8e0-cec8-4abd-95b9-7338b524dee2 tempest-ProjectReaderTests-10449547 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4470f08d-66f4-41a3-8bbe-5124e28cb275) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bb4de04f-66b8-4025-85cc-36c8c0763815', 'volume_name': 'volume-bb4de04f-66b8-4025-85cc-36c8c0763815', 'volume_size': 1}' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:52:48 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-53b4a8e0-cec8-4abd-95b9-7338b524dee2 tempest-ProjectReaderTests-10449547 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d85d0e73-b581-496c-adce-54d735f6d79f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:52:48 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-53b4a8e0-cec8-4abd-95b9-7338b524dee2 tempest-ProjectReaderTests-10449547 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d85d0e73-b581-496c-adce-54d735f6d79f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:52:48 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-53b4a8e0-cec8-4abd-95b9-7338b524dee2 tempest-ProjectReaderTests-10449547 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a807ad7c-2a5d-4e06-b102-3bd94a2bceb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:52:48 devstack cinder-volume[88899]: INFO cinder.volume.flows.manager.create_volume [None req-53b4a8e0-cec8-4abd-95b9-7338b524dee2 tempest-ProjectReaderTests-10449547 None] Volume bb4de04f-66b8-4025-85cc-36c8c0763815: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bb4de04f-66b8-4025-85cc-36c8c0763815', 'volume_size': 1} Aug 03 08:52:48 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-53b4a8e0-cec8-4abd-95b9-7338b524dee2 tempest-ProjectReaderTests-10449547 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:52:48 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-53b4a8e0-cec8-4abd-95b9-7338b524dee2 tempest-ProjectReaderTests-10449547 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:52:48 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-53b4a8e0-cec8-4abd-95b9-7338b524dee2 tempest-ProjectReaderTests-10449547 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:52:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-155320260',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb4de04f-66b8-4025-85cc-36c8c0763815,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6237b793de2b4f28ab479bfba1103704',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:52:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:52:49Z,use_quota=True,user_id='9871d96c6e934953aad7c79e37e80213',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8bde7129-1dc4-42ab-b852-ab32c61b4921),volume_type_id=8bde7129-1dc4-42ab-b852-ab32c61b4921)}" {{(pid=88899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 08:52:48 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-53b4a8e0-cec8-4abd-95b9-7338b524dee2 tempest-ProjectReaderTests-10449547 None] Creating volume bb4de04f-66b8-4025-85cc-36c8c0763815 {{(pid=88899) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 08:52:48 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-53b4a8e0-cec8-4abd-95b9-7338b524dee2 tempest-ProjectReaderTests-10449547 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:52:48 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-53b4a8e0-cec8-4abd-95b9-7338b524dee2 tempest-ProjectReaderTests-10449547 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:52:48 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-53b4a8e0-cec8-4abd-95b9-7338b524dee2 tempest-ProjectReaderTests-10449547 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:52:48 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-53b4a8e0-cec8-4abd-95b9-7338b524dee2 tempest-ProjectReaderTests-10449547 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:52:48 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-53b4a8e0-cec8-4abd-95b9-7338b524dee2 tempest-ProjectReaderTests-10449547 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:52:48 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-53b4a8e0-cec8-4abd-95b9-7338b524dee2 tempest-ProjectReaderTests-10449547 None] Selected osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385 as target Quobyte volume. {{(pid=88899) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 08:52:48 devstack cinder-volume[88899]: INFO cinder.volume.drivers.remotefs [None req-53b4a8e0-cec8-4abd-95b9-7338b524dee2 tempest-ProjectReaderTests-10449547 None] casted to osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385 Aug 03 08:52:48 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-53b4a8e0-cec8-4abd-95b9-7338b524dee2 tempest-ProjectReaderTests-10449547 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-bb4de04f-66b8-4025-85cc-36c8c0763815 1073741824 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:52:48 devstack sudo[111671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-bb4de04f-66b8-4025-85cc-36c8c0763815 1073741824 Aug 03 08:52:48 devstack sudo[111671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:52:49 devstack sudo[111671]: pam_unix(sudo:session): session closed for user root Aug 03 08:52:49 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-53b4a8e0-cec8-4abd-95b9-7338b524dee2 tempest-ProjectReaderTests-10449547 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-bb4de04f-66b8-4025-85cc-36c8c0763815 1073741824" returned: 0 in 0.399s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:52:49 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-53b4a8e0-cec8-4abd-95b9-7338b524dee2 tempest-ProjectReaderTests-10449547 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-bb4de04f-66b8-4025-85cc-36c8c0763815 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:52:49 devstack sudo[111677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-bb4de04f-66b8-4025-85cc-36c8c0763815 Aug 03 08:52:49 devstack sudo[111677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:52:49 devstack sudo[111677]: pam_unix(sudo:session): session closed for user root Aug 03 08:52:49 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-53b4a8e0-cec8-4abd-95b9-7338b524dee2 tempest-ProjectReaderTests-10449547 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-bb4de04f-66b8-4025-85cc-36c8c0763815" returned: 0 in 0.232s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:52:49 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-53b4a8e0-cec8-4abd-95b9-7338b524dee2 tempest-ProjectReaderTests-10449547 None] <== create_volume: return (675ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'} {{(pid=88899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 08:52:49 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-53b4a8e0-cec8-4abd-95b9-7338b524dee2 tempest-ProjectReaderTests-10449547 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.677s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:52:49 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-53b4a8e0-cec8-4abd-95b9-7338b524dee2 tempest-ProjectReaderTests-10449547 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a807ad7c-2a5d-4e06-b102-3bd94a2bceb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bb4de04f-66b8-4025-85cc-36c8c0763815', 'volume_size': 1}' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:52:49 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-53b4a8e0-cec8-4abd-95b9-7338b524dee2 tempest-ProjectReaderTests-10449547 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33cf6a24-22bd-4358-b68e-f07eddd54ff2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:52:49 devstack cinder-volume[88899]: INFO cinder.volume.flows.manager.create_volume [None req-53b4a8e0-cec8-4abd-95b9-7338b524dee2 tempest-ProjectReaderTests-10449547 None] Volume volume-bb4de04f-66b8-4025-85cc-36c8c0763815 (bb4de04f-66b8-4025-85cc-36c8c0763815): created successfully Aug 03 08:52:49 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-53b4a8e0-cec8-4abd-95b9-7338b524dee2 tempest-ProjectReaderTests-10449547 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33cf6a24-22bd-4358-b68e-f07eddd54ff2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:52:49 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-53b4a8e0-cec8-4abd-95b9-7338b524dee2 tempest-ProjectReaderTests-10449547 None] Flow 'volume_create_manager' (7572284f-3a62-427a-8f38-e9ad056e539b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:52:49 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-53b4a8e0-cec8-4abd-95b9-7338b524dee2 tempest-ProjectReaderTests-10449547 None] Created volume successfully. Aug 03 08:52:49 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-6fbe28eb-6c40-47d2-b514-107a0d45f74e tempest-ProjectReaderTests-10449547 None] Acquiring lock "cinder-bb4de04f-66b8-4025-85cc-36c8c0763815-delete_volume" by "delete_volume" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:52:49 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-6fbe28eb-6c40-47d2-b514-107a0d45f74e tempest-ProjectReaderTests-10449547 None] Lock "cinder-bb4de04f-66b8-4025-85cc-36c8c0763815-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:52:49 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-6fbe28eb-6c40-47d2-b514-107a0d45f74e tempest-ProjectReaderTests-10449547 None] Acquiring lock "cinder-quobyte-bb4de04f-66b8-4025-85cc-36c8c0763815" by "delete_volume" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:52:49 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-6fbe28eb-6c40-47d2-b514-107a0d45f74e tempest-ProjectReaderTests-10449547 None] Lock "cinder-quobyte-bb4de04f-66b8-4025-85cc-36c8c0763815" acquired by "delete_volume" :: waited 0.016s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:52:49 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c621e59-a2e4-4b9e-ac09-f392ca492666]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:52:49 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-6fbe28eb-6c40-47d2-b514-107a0d45f74e tempest-ProjectReaderTests-10449547 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-bb4de04f-66b8-4025-85cc-36c8c0763815 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:52:49 devstack sudo[111680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-bb4de04f-66b8-4025-85cc-36c8c0763815 Aug 03 08:52:49 devstack sudo[111680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:52:50 devstack sudo[111680]: pam_unix(sudo:session): session closed for user root Aug 03 08:52:50 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-6fbe28eb-6c40-47d2-b514-107a0d45f74e tempest-ProjectReaderTests-10449547 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-bb4de04f-66b8-4025-85cc-36c8c0763815" returned: 0 in 0.339s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:52:50 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-6fbe28eb-6c40-47d2-b514-107a0d45f74e tempest-ProjectReaderTests-10449547 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-bb4de04f-66b8-4025-85cc-36c8c0763815 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:52:50 devstack sudo[111685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-bb4de04f-66b8-4025-85cc-36c8c0763815 Aug 03 08:52:50 devstack sudo[111685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:52:50 devstack sudo[111685]: pam_unix(sudo:session): session closed for user root Aug 03 08:52:50 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-6fbe28eb-6c40-47d2-b514-107a0d45f74e tempest-ProjectReaderTests-10449547 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-bb4de04f-66b8-4025-85cc-36c8c0763815" returned: 0 in 0.250s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:52:50 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-6fbe28eb-6c40-47d2-b514-107a0d45f74e tempest-ProjectReaderTests-10449547 None] Lock "cinder-quobyte-bb4de04f-66b8-4025-85cc-36c8c0763815" released by "delete_volume" :: held 0.628s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:52:50 devstack cinder-volume[88899]: DEBUG cinder.quota [None req-6fbe28eb-6c40-47d2-b514-107a0d45f74e tempest-ProjectReaderTests-10449547 None] Created reservations ['69f3196f-ea8c-4a2d-ad98-08df1a7f16cb', '11ac4bb0-9631-47aa-9beb-15557bc1c9b7', '051908c9-4ece-413d-ab61-88d84fe2d936', '82daf614-1d54-4204-855e-a830280fd7e6'] {{(pid=88899) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 08:52:50 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-6fbe28eb-6c40-47d2-b514-107a0d45f74e tempest-ProjectReaderTests-10449547 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:52:50 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-6fbe28eb-6c40-47d2-b514-107a0d45f74e tempest-ProjectReaderTests-10449547 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:52:50 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-6fbe28eb-6c40-47d2-b514-107a0d45f74e tempest-ProjectReaderTests-10449547 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:52:50 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-6fbe28eb-6c40-47d2-b514-107a0d45f74e tempest-ProjectReaderTests-10449547 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:52:50 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-6fbe28eb-6c40-47d2-b514-107a0d45f74e tempest-ProjectReaderTests-10449547 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:52:50 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-6fbe28eb-6c40-47d2-b514-107a0d45f74e tempest-ProjectReaderTests-10449547 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:52:50 devstack sudo[111688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a Aug 03 08:52:50 devstack sudo[111688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:52:50 devstack sudo[111688]: pam_unix(sudo:session): session closed for user root Aug 03 08:52:50 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-6fbe28eb-6c40-47d2-b514-107a0d45f74e tempest-ProjectReaderTests-10449547 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a" returned: 0 in 0.244s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:52:50 devstack cinder-volume[88899]: DEBUG cinder.manager [None req-6fbe28eb-6c40-47d2-b514-107a0d45f74e tempest-ProjectReaderTests-10449547 None] Notifying Schedulers of capabilities ... {{(pid=88899) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 08:52:50 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-6fbe28eb-6c40-47d2-b514-107a0d45f74e tempest-ProjectReaderTests-10449547 None] Deleted volume successfully. Aug 03 08:52:50 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-6fbe28eb-6c40-47d2-b514-107a0d45f74e tempest-ProjectReaderTests-10449547 None] Lock "cinder-bb4de04f-66b8-4025-85cc-36c8c0763815-delete_volume" released by "delete_volume" :: held 1.079s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:52:51 devstack cinder-volume[88899]: DEBUG oslo_service.periodic_task [None req-f948fb4a-c4d7-499f-b1bd-8d6be3de0b53 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88899) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 03 08:52:51 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-f948fb4a-c4d7-499f-b1bd-8d6be3de0b53 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:52:51 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-f948fb4a-c4d7-499f-b1bd-8d6be3de0b53 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:52:51 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-f948fb4a-c4d7-499f-b1bd-8d6be3de0b53 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:52:51 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-f948fb4a-c4d7-499f-b1bd-8d6be3de0b53 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:52:51 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-f948fb4a-c4d7-499f-b1bd-8d6be3de0b53 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:52:51 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-f948fb4a-c4d7-499f-b1bd-8d6be3de0b53 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:52:51 devstack sudo[111692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a Aug 03 08:52:51 devstack sudo[111692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:52:52 devstack sudo[111692]: pam_unix(sudo:session): session closed for user root Aug 03 08:52:52 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-f948fb4a-c4d7-499f-b1bd-8d6be3de0b53 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a" returned: 0 in 0.307s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:52:52 devstack cinder-volume[88899]: DEBUG cinder.manager [None req-f948fb4a-c4d7-499f-b1bd-8d6be3de0b53 None None] Notifying Schedulers of capabilities ... {{(pid=88899) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 08:52:52 devstack cinder-volume[88899]: DEBUG oslo_service.periodic_task [None req-f948fb4a-c4d7-499f-b1bd-8d6be3de0b53 None None] Running periodic task VolumeManager._thread_info {{(pid=88899) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 03 08:52:52 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-f948fb4a-c4d7-499f-b1bd-8d6be3de0b53 None None] thread count: 29 {{(pid=88899) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 03 08:52:52 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-f948fb4a-c4d7-499f-b1bd-8d6be3de0b53 None None] thread info: [<_MainThread(MainThread, started 132234320248960)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88899) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 03 08:53:00 devstack cinder-volume[88899]: DEBUG dbcounter [-] [88899] Writing DB stats cinder:UPDATE=83,cinder:SELECT=54,cinder:INSERT=15,cinder:DELETE=8 {{(pid=88899) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 03 08:53:00 devstack cinder-volume[88899]: DEBUG dbcounter [-] [88899] Writing DB stats cinder:SELECT=51,cinder:INSERT=25,cinder:UPDATE=85,cinder:DELETE=8 {{(pid=88899) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 03 08:53:03 devstack cinder-volume[88899]: DEBUG cinder.volume.flows.manager.create_volume [None req-53fffbbd-9e40-464a-917e-3a029b989718 tempest-VolumeDependencyTests-1512358985 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88899) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 08:53:03 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-53fffbbd-9e40-464a-917e-3a029b989718 tempest-VolumeDependencyTests-1512358985 None] Flow 'volume_create_manager' (4e8bbc23-25c0-4772-a9f2-e0d2c6ba31b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:53:03 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-53fffbbd-9e40-464a-917e-3a029b989718 tempest-VolumeDependencyTests-1512358985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8dbb1569-d8bd-4e3d-8224-303aed795d2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:53:03 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-53fffbbd-9e40-464a-917e-3a029b989718 tempest-VolumeDependencyTests-1512358985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8dbb1569-d8bd-4e3d-8224-303aed795d2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:53:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1780468758',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a8ead30-8de5-46a9-a84e-9425b673c7c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d30b387eb9b94bb589dfe04f0d2eac6d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:53:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:53:04Z,use_quota=True,user_id='12ab9b4d5d894d608b06e312639537e8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8bde7129-1dc4-42ab-b852-ab32c61b4921),volume_type_id=8bde7129-1dc4-42ab-b852-ab32c61b4921)' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:53:03 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-53fffbbd-9e40-464a-917e-3a029b989718 tempest-VolumeDependencyTests-1512358985 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22a108ab-f7ba-4943-a07f-00a0b54be5dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:53:03 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-53fffbbd-9e40-464a-917e-3a029b989718 tempest-VolumeDependencyTests-1512358985 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22a108ab-f7ba-4943-a07f-00a0b54be5dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:53:03 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-53fffbbd-9e40-464a-917e-3a029b989718 tempest-VolumeDependencyTests-1512358985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c7726b51-57d0-444e-a4c4-fbd830488a05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:53:03 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-53fffbbd-9e40-464a-917e-3a029b989718 tempest-VolumeDependencyTests-1512358985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c7726b51-57d0-444e-a4c4-fbd830488a05) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7a8ead30-8de5-46a9-a84e-9425b673c7c3', 'volume_name': 'volume-7a8ead30-8de5-46a9-a84e-9425b673c7c3', 'volume_size': 1}' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:53:03 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-53fffbbd-9e40-464a-917e-3a029b989718 tempest-VolumeDependencyTests-1512358985 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31b46fcf-00ff-43f6-be90-b4ff797dd7d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:53:03 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-53fffbbd-9e40-464a-917e-3a029b989718 tempest-VolumeDependencyTests-1512358985 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31b46fcf-00ff-43f6-be90-b4ff797dd7d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:53:03 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-53fffbbd-9e40-464a-917e-3a029b989718 tempest-VolumeDependencyTests-1512358985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3b3a0f2-af00-468f-b94e-f795f1c2666b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:53:03 devstack cinder-volume[88899]: INFO cinder.volume.flows.manager.create_volume [None req-53fffbbd-9e40-464a-917e-3a029b989718 tempest-VolumeDependencyTests-1512358985 None] Volume 7a8ead30-8de5-46a9-a84e-9425b673c7c3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7a8ead30-8de5-46a9-a84e-9425b673c7c3', 'volume_size': 1} Aug 03 08:53:03 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-53fffbbd-9e40-464a-917e-3a029b989718 tempest-VolumeDependencyTests-1512358985 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:53:03 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-53fffbbd-9e40-464a-917e-3a029b989718 tempest-VolumeDependencyTests-1512358985 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:53:03 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-53fffbbd-9e40-464a-917e-3a029b989718 tempest-VolumeDependencyTests-1512358985 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:53:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1780468758',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a8ead30-8de5-46a9-a84e-9425b673c7c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d30b387eb9b94bb589dfe04f0d2eac6d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:53:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:53:04Z,use_quota=True,user_id='12ab9b4d5d894d608b06e312639537e8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8bde7129-1dc4-42ab-b852-ab32c61b4921),volume_type_id=8bde7129-1dc4-42ab-b852-ab32c61b4921)}" {{(pid=88899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 08:53:03 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-53fffbbd-9e40-464a-917e-3a029b989718 tempest-VolumeDependencyTests-1512358985 None] Creating volume 7a8ead30-8de5-46a9-a84e-9425b673c7c3 {{(pid=88899) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 08:53:03 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-53fffbbd-9e40-464a-917e-3a029b989718 tempest-VolumeDependencyTests-1512358985 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:53:03 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-53fffbbd-9e40-464a-917e-3a029b989718 tempest-VolumeDependencyTests-1512358985 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:53:03 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-53fffbbd-9e40-464a-917e-3a029b989718 tempest-VolumeDependencyTests-1512358985 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:53:03 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-53fffbbd-9e40-464a-917e-3a029b989718 tempest-VolumeDependencyTests-1512358985 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:53:03 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-53fffbbd-9e40-464a-917e-3a029b989718 tempest-VolumeDependencyTests-1512358985 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:53:03 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-53fffbbd-9e40-464a-917e-3a029b989718 tempest-VolumeDependencyTests-1512358985 None] Selected osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385 as target Quobyte volume. {{(pid=88899) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 08:53:03 devstack cinder-volume[88899]: INFO cinder.volume.drivers.remotefs [None req-53fffbbd-9e40-464a-917e-3a029b989718 tempest-VolumeDependencyTests-1512358985 None] casted to osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385 Aug 03 08:53:03 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-53fffbbd-9e40-464a-917e-3a029b989718 tempest-VolumeDependencyTests-1512358985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-7a8ead30-8de5-46a9-a84e-9425b673c7c3 1073741824 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:53:03 devstack sudo[111734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-7a8ead30-8de5-46a9-a84e-9425b673c7c3 1073741824 Aug 03 08:53:03 devstack sudo[111734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:53:04 devstack cinder-volume[88899]: DEBUG cinder.volume.flows.manager.create_volume [None req-5c7427dd-8355-4b07-b644-46564dafd1d0 tempest-CreateVolumesFromImageTest-934288853 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88899) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 08:53:04 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-5c7427dd-8355-4b07-b644-46564dafd1d0 tempest-CreateVolumesFromImageTest-934288853 None] Flow 'volume_create_manager' (3fde3d40-2ffe-4745-a280-d88173b72bf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:53:04 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-5c7427dd-8355-4b07-b644-46564dafd1d0 tempest-CreateVolumesFromImageTest-934288853 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c305bc5-fa49-4071-9afd-25774979633a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:53:04 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-5c7427dd-8355-4b07-b644-46564dafd1d0 tempest-CreateVolumesFromImageTest-934288853 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c305bc5-fa49-4071-9afd-25774979633a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:53:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-560283862',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a2aabb09-c00f-4251-bb2a-1dbc840f9022,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8243333dc23147b9a5f3ec351af350a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:53:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:53:04Z,use_quota=True,user_id='a729ad21415940e49a5d60e19f09a97e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8bde7129-1dc4-42ab-b852-ab32c61b4921),volume_type_id=8bde7129-1dc4-42ab-b852-ab32c61b4921)' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:53:04 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-5c7427dd-8355-4b07-b644-46564dafd1d0 tempest-CreateVolumesFromImageTest-934288853 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7fcbcfa1-ca64-471a-8308-c7298ea71171) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:53:04 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-5c7427dd-8355-4b07-b644-46564dafd1d0 tempest-CreateVolumesFromImageTest-934288853 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7fcbcfa1-ca64-471a-8308-c7298ea71171) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:53:04 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-5c7427dd-8355-4b07-b644-46564dafd1d0 tempest-CreateVolumesFromImageTest-934288853 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa447eff-010c-4e60-a09f-32fc0d4fcf4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:53:04 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-5c7427dd-8355-4b07-b644-46564dafd1d0 tempest-CreateVolumesFromImageTest-934288853 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa447eff-010c-4e60-a09f-32fc0d4fcf4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a2aabb09-c00f-4251-bb2a-1dbc840f9022', 'volume_name': 'volume-a2aabb09-c00f-4251-bb2a-1dbc840f9022', 'volume_size': 1}' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:53:04 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-5c7427dd-8355-4b07-b644-46564dafd1d0 tempest-CreateVolumesFromImageTest-934288853 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae14b017-26fc-4b81-bd37-d34f57e8ab00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:53:04 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-5c7427dd-8355-4b07-b644-46564dafd1d0 tempest-CreateVolumesFromImageTest-934288853 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae14b017-26fc-4b81-bd37-d34f57e8ab00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:53:04 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-5c7427dd-8355-4b07-b644-46564dafd1d0 tempest-CreateVolumesFromImageTest-934288853 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed897140-7b32-4235-9a07-37826d98795d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:53:04 devstack cinder-volume[88899]: INFO cinder.volume.flows.manager.create_volume [None req-5c7427dd-8355-4b07-b644-46564dafd1d0 tempest-CreateVolumesFromImageTest-934288853 None] Volume a2aabb09-c00f-4251-bb2a-1dbc840f9022: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a2aabb09-c00f-4251-bb2a-1dbc840f9022', 'volume_size': 1} Aug 03 08:53:04 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-5c7427dd-8355-4b07-b644-46564dafd1d0 tempest-CreateVolumesFromImageTest-934288853 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:53:04 devstack sudo[111734]: pam_unix(sudo:session): session closed for user root Aug 03 08:53:04 devstack cinder-volume[88899]: DEBUG cinder.volume.flows.manager.create_volume [None req-1ea5f51c-a8d3-48a2-b337-3a6476e64d21 tempest-CreateVolumesFromImageTest-934288853 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88899) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 08:53:04 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-1ea5f51c-a8d3-48a2-b337-3a6476e64d21 tempest-CreateVolumesFromImageTest-934288853 None] Flow 'volume_create_manager' (0a5a51b2-5486-43b6-8319-31e99a1941e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:53:04 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-1ea5f51c-a8d3-48a2-b337-3a6476e64d21 tempest-CreateVolumesFromImageTest-934288853 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2ea9285-a26c-4ff9-9983-cb8700d402f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:53:04 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-53fffbbd-9e40-464a-917e-3a029b989718 tempest-VolumeDependencyTests-1512358985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-7a8ead30-8de5-46a9-a84e-9425b673c7c3 1073741824" returned: 0 in 0.809s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:53:04 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-1ea5f51c-a8d3-48a2-b337-3a6476e64d21 tempest-CreateVolumesFromImageTest-934288853 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2ea9285-a26c-4ff9-9983-cb8700d402f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:53:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-880947183',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36438ac9-8a0c-4b65-82be-20e579348379,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8243333dc23147b9a5f3ec351af350a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:53:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:53:04Z,use_quota=True,user_id='a729ad21415940e49a5d60e19f09a97e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8bde7129-1dc4-42ab-b852-ab32c61b4921),volume_type_id=8bde7129-1dc4-42ab-b852-ab32c61b4921)' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:53:04 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-1ea5f51c-a8d3-48a2-b337-3a6476e64d21 tempest-CreateVolumesFromImageTest-934288853 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe0b97f8-4597-4098-bb62-cbb49048a5a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:53:04 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-1ea5f51c-a8d3-48a2-b337-3a6476e64d21 tempest-CreateVolumesFromImageTest-934288853 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe0b97f8-4597-4098-bb62-cbb49048a5a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:53:04 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-1ea5f51c-a8d3-48a2-b337-3a6476e64d21 tempest-CreateVolumesFromImageTest-934288853 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf25cdc5-c6a3-4d41-899d-0d47189e1434) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:53:04 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-1ea5f51c-a8d3-48a2-b337-3a6476e64d21 tempest-CreateVolumesFromImageTest-934288853 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf25cdc5-c6a3-4d41-899d-0d47189e1434) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '36438ac9-8a0c-4b65-82be-20e579348379', 'volume_name': 'volume-36438ac9-8a0c-4b65-82be-20e579348379', 'volume_size': 1}' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:53:04 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-1ea5f51c-a8d3-48a2-b337-3a6476e64d21 tempest-CreateVolumesFromImageTest-934288853 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d389715-ffc8-4984-84e2-794a80669e92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:53:04 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-1ea5f51c-a8d3-48a2-b337-3a6476e64d21 tempest-CreateVolumesFromImageTest-934288853 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d389715-ffc8-4984-84e2-794a80669e92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:53:04 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-1ea5f51c-a8d3-48a2-b337-3a6476e64d21 tempest-CreateVolumesFromImageTest-934288853 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a37dcc40-9de4-41b4-865c-cc1eb4469361) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:53:04 devstack cinder-volume[88899]: INFO cinder.volume.flows.manager.create_volume [None req-1ea5f51c-a8d3-48a2-b337-3a6476e64d21 tempest-CreateVolumesFromImageTest-934288853 None] Volume 36438ac9-8a0c-4b65-82be-20e579348379: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-36438ac9-8a0c-4b65-82be-20e579348379', 'volume_size': 1} Aug 03 08:53:04 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-1ea5f51c-a8d3-48a2-b337-3a6476e64d21 tempest-CreateVolumesFromImageTest-934288853 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:53:04 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-53fffbbd-9e40-464a-917e-3a029b989718 tempest-VolumeDependencyTests-1512358985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-7a8ead30-8de5-46a9-a84e-9425b673c7c3 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:53:04 devstack sudo[111740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-7a8ead30-8de5-46a9-a84e-9425b673c7c3 Aug 03 08:53:04 devstack sudo[111740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:53:04 devstack cinder-volume[88899]: DEBUG cinder.volume.flows.manager.create_volume [None req-0dd7930e-1a7b-46ce-8f74-02202f9b3a94 tempest-CreateVolumesFromImageTest-934288853 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88899) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 08:53:05 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-0dd7930e-1a7b-46ce-8f74-02202f9b3a94 tempest-CreateVolumesFromImageTest-934288853 None] Flow 'volume_create_manager' (52ca8ad7-4c51-46c0-b7aa-4d1ef8151510) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:53:05 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-0dd7930e-1a7b-46ce-8f74-02202f9b3a94 tempest-CreateVolumesFromImageTest-934288853 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7155355b-7495-4f23-85c2-6396d18c293f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:53:05 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-0dd7930e-1a7b-46ce-8f74-02202f9b3a94 tempest-CreateVolumesFromImageTest-934288853 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7155355b-7495-4f23-85c2-6396d18c293f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:53:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2078527216',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2fdaf9a5-33fc-44d4-8945-b87a69a6577f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8243333dc23147b9a5f3ec351af350a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:53:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:53:05Z,use_quota=True,user_id='a729ad21415940e49a5d60e19f09a97e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8bde7129-1dc4-42ab-b852-ab32c61b4921),volume_type_id=8bde7129-1dc4-42ab-b852-ab32c61b4921)' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:53:05 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-0dd7930e-1a7b-46ce-8f74-02202f9b3a94 tempest-CreateVolumesFromImageTest-934288853 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (036fc908-fb41-48e8-88b6-e4dcfcb2e5a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:53:05 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-0dd7930e-1a7b-46ce-8f74-02202f9b3a94 tempest-CreateVolumesFromImageTest-934288853 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (036fc908-fb41-48e8-88b6-e4dcfcb2e5a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:53:05 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-0dd7930e-1a7b-46ce-8f74-02202f9b3a94 tempest-CreateVolumesFromImageTest-934288853 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae9ab644-2bc9-43bb-ab79-970b0e97f85b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:53:05 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-0dd7930e-1a7b-46ce-8f74-02202f9b3a94 tempest-CreateVolumesFromImageTest-934288853 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae9ab644-2bc9-43bb-ab79-970b0e97f85b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2fdaf9a5-33fc-44d4-8945-b87a69a6577f', 'volume_name': 'volume-2fdaf9a5-33fc-44d4-8945-b87a69a6577f', 'volume_size': 1}' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:53:05 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-0dd7930e-1a7b-46ce-8f74-02202f9b3a94 tempest-CreateVolumesFromImageTest-934288853 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff183fb0-f259-4665-9807-28644b0a43aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:53:05 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-0dd7930e-1a7b-46ce-8f74-02202f9b3a94 tempest-CreateVolumesFromImageTest-934288853 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff183fb0-f259-4665-9807-28644b0a43aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:53:05 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-0dd7930e-1a7b-46ce-8f74-02202f9b3a94 tempest-CreateVolumesFromImageTest-934288853 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (554aadcb-f86e-44ca-a8f8-a2204c1ecb06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:53:05 devstack cinder-volume[88899]: INFO cinder.volume.flows.manager.create_volume [None req-0dd7930e-1a7b-46ce-8f74-02202f9b3a94 tempest-CreateVolumesFromImageTest-934288853 None] Volume 2fdaf9a5-33fc-44d4-8945-b87a69a6577f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2fdaf9a5-33fc-44d4-8945-b87a69a6577f', 'volume_size': 1} Aug 03 08:53:05 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-0dd7930e-1a7b-46ce-8f74-02202f9b3a94 tempest-CreateVolumesFromImageTest-934288853 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:53:05 devstack cinder-volume[88899]: DEBUG cinder.volume.flows.manager.create_volume [None req-dfad97aa-1e20-425b-8af3-0a52479250f3 tempest-CreateVolumesFromImageTest-934288853 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88899) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 08:53:05 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-dfad97aa-1e20-425b-8af3-0a52479250f3 tempest-CreateVolumesFromImageTest-934288853 None] Flow 'volume_create_manager' (e2503787-dfa2-41ca-bfc3-de76c2c27a89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:53:05 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-dfad97aa-1e20-425b-8af3-0a52479250f3 tempest-CreateVolumesFromImageTest-934288853 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90ac48d2-45ea-4c1d-96d1-168370173417) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:53:05 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-dfad97aa-1e20-425b-8af3-0a52479250f3 tempest-CreateVolumesFromImageTest-934288853 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90ac48d2-45ea-4c1d-96d1-168370173417) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:53:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1058820314',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d0a2c22-ae4d-420b-8dab-9a108f887e4d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8243333dc23147b9a5f3ec351af350a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:53:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:53:05Z,use_quota=True,user_id='a729ad21415940e49a5d60e19f09a97e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8bde7129-1dc4-42ab-b852-ab32c61b4921),volume_type_id=8bde7129-1dc4-42ab-b852-ab32c61b4921)' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:53:05 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-dfad97aa-1e20-425b-8af3-0a52479250f3 tempest-CreateVolumesFromImageTest-934288853 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (927b380b-52a6-4b0e-aee7-367abb02a0f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:53:05 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-dfad97aa-1e20-425b-8af3-0a52479250f3 tempest-CreateVolumesFromImageTest-934288853 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (927b380b-52a6-4b0e-aee7-367abb02a0f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:53:05 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-dfad97aa-1e20-425b-8af3-0a52479250f3 tempest-CreateVolumesFromImageTest-934288853 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c2cc999-a1ac-47ee-b83e-435493bbaa1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:53:05 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-dfad97aa-1e20-425b-8af3-0a52479250f3 tempest-CreateVolumesFromImageTest-934288853 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c2cc999-a1ac-47ee-b83e-435493bbaa1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2d0a2c22-ae4d-420b-8dab-9a108f887e4d', 'volume_name': 'volume-2d0a2c22-ae4d-420b-8dab-9a108f887e4d', 'volume_size': 1}' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:53:05 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-dfad97aa-1e20-425b-8af3-0a52479250f3 tempest-CreateVolumesFromImageTest-934288853 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83f66ba8-1ba8-4700-9a4e-5c92bef7f0a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:53:05 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-dfad97aa-1e20-425b-8af3-0a52479250f3 tempest-CreateVolumesFromImageTest-934288853 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83f66ba8-1ba8-4700-9a4e-5c92bef7f0a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:53:05 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-dfad97aa-1e20-425b-8af3-0a52479250f3 tempest-CreateVolumesFromImageTest-934288853 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b932bc6-9c94-4e17-97d1-05e311c5f045) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:53:05 devstack cinder-volume[88899]: INFO cinder.volume.flows.manager.create_volume [None req-dfad97aa-1e20-425b-8af3-0a52479250f3 tempest-CreateVolumesFromImageTest-934288853 None] Volume 2d0a2c22-ae4d-420b-8dab-9a108f887e4d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2d0a2c22-ae4d-420b-8dab-9a108f887e4d', 'volume_size': 1} Aug 03 08:53:05 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-dfad97aa-1e20-425b-8af3-0a52479250f3 tempest-CreateVolumesFromImageTest-934288853 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:53:05 devstack sudo[111740]: pam_unix(sudo:session): session closed for user root Aug 03 08:53:05 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-53fffbbd-9e40-464a-917e-3a029b989718 tempest-VolumeDependencyTests-1512358985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-7a8ead30-8de5-46a9-a84e-9425b673c7c3" returned: 0 in 0.487s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:53:05 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-53fffbbd-9e40-464a-917e-3a029b989718 tempest-VolumeDependencyTests-1512358985 None] <== create_volume: return (1432ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'} {{(pid=88899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 08:53:05 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-53fffbbd-9e40-464a-917e-3a029b989718 tempest-VolumeDependencyTests-1512358985 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.436s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:53:05 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-5c7427dd-8355-4b07-b644-46564dafd1d0 tempest-CreateVolumesFromImageTest-934288853 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.163s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:53:05 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-5c7427dd-8355-4b07-b644-46564dafd1d0 tempest-CreateVolumesFromImageTest-934288853 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:53:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-560283862',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a2aabb09-c00f-4251-bb2a-1dbc840f9022,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8243333dc23147b9a5f3ec351af350a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:53:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:53:04Z,use_quota=True,user_id='a729ad21415940e49a5d60e19f09a97e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8bde7129-1dc4-42ab-b852-ab32c61b4921),volume_type_id=8bde7129-1dc4-42ab-b852-ab32c61b4921)}" {{(pid=88899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 08:53:05 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-5c7427dd-8355-4b07-b644-46564dafd1d0 tempest-CreateVolumesFromImageTest-934288853 None] Creating volume a2aabb09-c00f-4251-bb2a-1dbc840f9022 {{(pid=88899) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 08:53:05 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-5c7427dd-8355-4b07-b644-46564dafd1d0 tempest-CreateVolumesFromImageTest-934288853 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:53:05 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-5c7427dd-8355-4b07-b644-46564dafd1d0 tempest-CreateVolumesFromImageTest-934288853 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:53:05 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-5c7427dd-8355-4b07-b644-46564dafd1d0 tempest-CreateVolumesFromImageTest-934288853 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:53:05 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-5c7427dd-8355-4b07-b644-46564dafd1d0 tempest-CreateVolumesFromImageTest-934288853 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:53:05 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-5c7427dd-8355-4b07-b644-46564dafd1d0 tempest-CreateVolumesFromImageTest-934288853 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:53:05 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-5c7427dd-8355-4b07-b644-46564dafd1d0 tempest-CreateVolumesFromImageTest-934288853 None] Selected osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385 as target Quobyte volume. {{(pid=88899) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 08:53:05 devstack cinder-volume[88899]: INFO cinder.volume.drivers.remotefs [None req-5c7427dd-8355-4b07-b644-46564dafd1d0 tempest-CreateVolumesFromImageTest-934288853 None] casted to osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385 Aug 03 08:53:05 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-5c7427dd-8355-4b07-b644-46564dafd1d0 tempest-CreateVolumesFromImageTest-934288853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-a2aabb09-c00f-4251-bb2a-1dbc840f9022 1073741824 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:53:05 devstack sudo[111743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-a2aabb09-c00f-4251-bb2a-1dbc840f9022 1073741824 Aug 03 08:53:05 devstack sudo[111743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:53:05 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-53fffbbd-9e40-464a-917e-3a029b989718 tempest-VolumeDependencyTests-1512358985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3b3a0f2-af00-468f-b94e-f795f1c2666b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7a8ead30-8de5-46a9-a84e-9425b673c7c3', 'volume_size': 1}' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:53:05 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-53fffbbd-9e40-464a-917e-3a029b989718 tempest-VolumeDependencyTests-1512358985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ecc96e36-5a4b-4dae-b81c-9f1a7404167b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:53:05 devstack cinder-volume[88899]: INFO cinder.volume.flows.manager.create_volume [None req-53fffbbd-9e40-464a-917e-3a029b989718 tempest-VolumeDependencyTests-1512358985 None] Volume volume-7a8ead30-8de5-46a9-a84e-9425b673c7c3 (7a8ead30-8de5-46a9-a84e-9425b673c7c3): created successfully Aug 03 08:53:05 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-53fffbbd-9e40-464a-917e-3a029b989718 tempest-VolumeDependencyTests-1512358985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ecc96e36-5a4b-4dae-b81c-9f1a7404167b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:53:05 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-53fffbbd-9e40-464a-917e-3a029b989718 tempest-VolumeDependencyTests-1512358985 None] Flow 'volume_create_manager' (4e8bbc23-25c0-4772-a9f2-e0d2c6ba31b4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:53:05 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-53fffbbd-9e40-464a-917e-3a029b989718 tempest-VolumeDependencyTests-1512358985 None] Created volume successfully. Aug 03 08:53:05 devstack cinder-volume[88899]: DEBUG cinder.volume.flows.manager.create_volume [None req-b24d3c95-4f46-44bb-b55d-c087f9653d3d tempest-CreateVolumesFromImageTest-934288853 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88899) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 08:53:05 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-b24d3c95-4f46-44bb-b55d-c087f9653d3d tempest-CreateVolumesFromImageTest-934288853 None] Flow 'volume_create_manager' (4aea908f-ca9e-4571-b52a-125687727a89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:53:05 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-b24d3c95-4f46-44bb-b55d-c087f9653d3d tempest-CreateVolumesFromImageTest-934288853 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8437d1f4-2d9a-47fa-a677-0751f9ba400b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:53:05 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-b24d3c95-4f46-44bb-b55d-c087f9653d3d tempest-CreateVolumesFromImageTest-934288853 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8437d1f4-2d9a-47fa-a677-0751f9ba400b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:53:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-23493787',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3bab51b3-a492-4c99-b41f-2e0e243b9709,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8243333dc23147b9a5f3ec351af350a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:53:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:53:06Z,use_quota=True,user_id='a729ad21415940e49a5d60e19f09a97e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8bde7129-1dc4-42ab-b852-ab32c61b4921),volume_type_id=8bde7129-1dc4-42ab-b852-ab32c61b4921)' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:53:05 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-b24d3c95-4f46-44bb-b55d-c087f9653d3d tempest-CreateVolumesFromImageTest-934288853 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e1a7318-e53a-4aa3-8465-6eba6a3ae14f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:53:05 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-b24d3c95-4f46-44bb-b55d-c087f9653d3d tempest-CreateVolumesFromImageTest-934288853 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e1a7318-e53a-4aa3-8465-6eba6a3ae14f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:53:05 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-b24d3c95-4f46-44bb-b55d-c087f9653d3d tempest-CreateVolumesFromImageTest-934288853 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f518e534-81f3-4447-b56a-cc3143b32daf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:53:05 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-b24d3c95-4f46-44bb-b55d-c087f9653d3d tempest-CreateVolumesFromImageTest-934288853 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f518e534-81f3-4447-b56a-cc3143b32daf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3bab51b3-a492-4c99-b41f-2e0e243b9709', 'volume_name': 'volume-3bab51b3-a492-4c99-b41f-2e0e243b9709', 'volume_size': 1}' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:53:05 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-b24d3c95-4f46-44bb-b55d-c087f9653d3d tempest-CreateVolumesFromImageTest-934288853 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c863e67-cce2-4007-a9c4-50359c65c984) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:53:05 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-b24d3c95-4f46-44bb-b55d-c087f9653d3d tempest-CreateVolumesFromImageTest-934288853 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c863e67-cce2-4007-a9c4-50359c65c984) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:53:05 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-b24d3c95-4f46-44bb-b55d-c087f9653d3d tempest-CreateVolumesFromImageTest-934288853 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7c54dce-7380-44f8-b4df-d5594fe0c087) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:53:05 devstack cinder-volume[88899]: INFO cinder.volume.flows.manager.create_volume [None req-b24d3c95-4f46-44bb-b55d-c087f9653d3d tempest-CreateVolumesFromImageTest-934288853 None] Volume 3bab51b3-a492-4c99-b41f-2e0e243b9709: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3bab51b3-a492-4c99-b41f-2e0e243b9709', 'volume_size': 1} Aug 03 08:53:05 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-b24d3c95-4f46-44bb-b55d-c087f9653d3d tempest-CreateVolumesFromImageTest-934288853 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:53:05 devstack sudo[111743]: pam_unix(sudo:session): session closed for user root Aug 03 08:53:05 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-5c7427dd-8355-4b07-b644-46564dafd1d0 tempest-CreateVolumesFromImageTest-934288853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-a2aabb09-c00f-4251-bb2a-1dbc840f9022 1073741824" returned: 0 in 0.583s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:53:06 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-5c7427dd-8355-4b07-b644-46564dafd1d0 tempest-CreateVolumesFromImageTest-934288853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-a2aabb09-c00f-4251-bb2a-1dbc840f9022 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:53:06 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-bcd1e750-cdb6-4b9f-8960-5b82b18ddcce tempest-VolumeDependencyTests-1512358985 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:53:06 devstack sudo[111749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-a2aabb09-c00f-4251-bb2a-1dbc840f9022 Aug 03 08:53:06 devstack sudo[111749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:53:06 devstack sudo[111749]: pam_unix(sudo:session): session closed for user root Aug 03 08:53:06 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-5c7427dd-8355-4b07-b644-46564dafd1d0 tempest-CreateVolumesFromImageTest-934288853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-a2aabb09-c00f-4251-bb2a-1dbc840f9022" returned: 0 in 0.284s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:53:06 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-5c7427dd-8355-4b07-b644-46564dafd1d0 tempest-CreateVolumesFromImageTest-934288853 None] <== create_volume: return (938ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'} {{(pid=88899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 08:53:06 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-5c7427dd-8355-4b07-b644-46564dafd1d0 tempest-CreateVolumesFromImageTest-934288853 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.946s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:53:06 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-1ea5f51c-a8d3-48a2-b337-3a6476e64d21 tempest-CreateVolumesFromImageTest-934288853 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.496s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:53:06 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-1ea5f51c-a8d3-48a2-b337-3a6476e64d21 tempest-CreateVolumesFromImageTest-934288853 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:53:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-880947183',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36438ac9-8a0c-4b65-82be-20e579348379,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8243333dc23147b9a5f3ec351af350a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:53:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:53:04Z,use_quota=True,user_id='a729ad21415940e49a5d60e19f09a97e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8bde7129-1dc4-42ab-b852-ab32c61b4921),volume_type_id=8bde7129-1dc4-42ab-b852-ab32c61b4921)}" {{(pid=88899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 08:53:06 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-1ea5f51c-a8d3-48a2-b337-3a6476e64d21 tempest-CreateVolumesFromImageTest-934288853 None] Creating volume 36438ac9-8a0c-4b65-82be-20e579348379 {{(pid=88899) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 08:53:06 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-1ea5f51c-a8d3-48a2-b337-3a6476e64d21 tempest-CreateVolumesFromImageTest-934288853 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:53:06 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-1ea5f51c-a8d3-48a2-b337-3a6476e64d21 tempest-CreateVolumesFromImageTest-934288853 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:53:06 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-1ea5f51c-a8d3-48a2-b337-3a6476e64d21 tempest-CreateVolumesFromImageTest-934288853 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:53:06 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-1ea5f51c-a8d3-48a2-b337-3a6476e64d21 tempest-CreateVolumesFromImageTest-934288853 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:53:06 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-1ea5f51c-a8d3-48a2-b337-3a6476e64d21 tempest-CreateVolumesFromImageTest-934288853 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:53:06 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-1ea5f51c-a8d3-48a2-b337-3a6476e64d21 tempest-CreateVolumesFromImageTest-934288853 None] Selected osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385 as target Quobyte volume. {{(pid=88899) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 08:53:06 devstack cinder-volume[88899]: INFO cinder.volume.drivers.remotefs [None req-1ea5f51c-a8d3-48a2-b337-3a6476e64d21 tempest-CreateVolumesFromImageTest-934288853 None] casted to osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385 Aug 03 08:53:06 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-1ea5f51c-a8d3-48a2-b337-3a6476e64d21 tempest-CreateVolumesFromImageTest-934288853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-36438ac9-8a0c-4b65-82be-20e579348379 1073741824 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:53:06 devstack sudo[111752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-36438ac9-8a0c-4b65-82be-20e579348379 1073741824 Aug 03 08:53:06 devstack sudo[111752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:53:06 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-5c7427dd-8355-4b07-b644-46564dafd1d0 tempest-CreateVolumesFromImageTest-934288853 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed897140-7b32-4235-9a07-37826d98795d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a2aabb09-c00f-4251-bb2a-1dbc840f9022', 'volume_size': 1}' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:53:06 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-5c7427dd-8355-4b07-b644-46564dafd1d0 tempest-CreateVolumesFromImageTest-934288853 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c63cc942-b1f0-47dc-9bf9-9cea120c9b60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:53:06 devstack cinder-volume[88899]: INFO cinder.volume.flows.manager.create_volume [None req-5c7427dd-8355-4b07-b644-46564dafd1d0 tempest-CreateVolumesFromImageTest-934288853 None] Volume volume-a2aabb09-c00f-4251-bb2a-1dbc840f9022 (a2aabb09-c00f-4251-bb2a-1dbc840f9022): created successfully Aug 03 08:53:06 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-5c7427dd-8355-4b07-b644-46564dafd1d0 tempest-CreateVolumesFromImageTest-934288853 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c63cc942-b1f0-47dc-9bf9-9cea120c9b60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:53:06 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-5c7427dd-8355-4b07-b644-46564dafd1d0 tempest-CreateVolumesFromImageTest-934288853 None] Flow 'volume_create_manager' (3fde3d40-2ffe-4745-a280-d88173b72bf3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:53:06 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-5c7427dd-8355-4b07-b644-46564dafd1d0 tempest-CreateVolumesFromImageTest-934288853 None] Created volume successfully. Aug 03 08:53:06 devstack sudo[111752]: pam_unix(sudo:session): session closed for user root Aug 03 08:53:06 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-1ea5f51c-a8d3-48a2-b337-3a6476e64d21 tempest-CreateVolumesFromImageTest-934288853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-36438ac9-8a0c-4b65-82be-20e579348379 1073741824" returned: 0 in 0.590s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:53:06 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-1ea5f51c-a8d3-48a2-b337-3a6476e64d21 tempest-CreateVolumesFromImageTest-934288853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-36438ac9-8a0c-4b65-82be-20e579348379 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:53:06 devstack sudo[111794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-36438ac9-8a0c-4b65-82be-20e579348379 Aug 03 08:53:06 devstack sudo[111794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:53:07 devstack sudo[111794]: pam_unix(sudo:session): session closed for user root Aug 03 08:53:07 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-1ea5f51c-a8d3-48a2-b337-3a6476e64d21 tempest-CreateVolumesFromImageTest-934288853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-36438ac9-8a0c-4b65-82be-20e579348379" returned: 0 in 0.308s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:53:07 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-1ea5f51c-a8d3-48a2-b337-3a6476e64d21 tempest-CreateVolumesFromImageTest-934288853 None] <== create_volume: return (944ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'} {{(pid=88899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 08:53:07 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-1ea5f51c-a8d3-48a2-b337-3a6476e64d21 tempest-CreateVolumesFromImageTest-934288853 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.949s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:53:07 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-0dd7930e-1a7b-46ce-8f74-02202f9b3a94 tempest-CreateVolumesFromImageTest-934288853 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.128s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:53:07 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-0dd7930e-1a7b-46ce-8f74-02202f9b3a94 tempest-CreateVolumesFromImageTest-934288853 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:53:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2078527216',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2fdaf9a5-33fc-44d4-8945-b87a69a6577f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8243333dc23147b9a5f3ec351af350a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:53:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:53:05Z,use_quota=True,user_id='a729ad21415940e49a5d60e19f09a97e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8bde7129-1dc4-42ab-b852-ab32c61b4921),volume_type_id=8bde7129-1dc4-42ab-b852-ab32c61b4921)}" {{(pid=88899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 08:53:07 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-0dd7930e-1a7b-46ce-8f74-02202f9b3a94 tempest-CreateVolumesFromImageTest-934288853 None] Creating volume 2fdaf9a5-33fc-44d4-8945-b87a69a6577f {{(pid=88899) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 08:53:07 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-0dd7930e-1a7b-46ce-8f74-02202f9b3a94 tempest-CreateVolumesFromImageTest-934288853 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:53:07 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-0dd7930e-1a7b-46ce-8f74-02202f9b3a94 tempest-CreateVolumesFromImageTest-934288853 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:53:07 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-0dd7930e-1a7b-46ce-8f74-02202f9b3a94 tempest-CreateVolumesFromImageTest-934288853 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:53:07 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-0dd7930e-1a7b-46ce-8f74-02202f9b3a94 tempest-CreateVolumesFromImageTest-934288853 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:53:07 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-0dd7930e-1a7b-46ce-8f74-02202f9b3a94 tempest-CreateVolumesFromImageTest-934288853 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:53:07 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-0dd7930e-1a7b-46ce-8f74-02202f9b3a94 tempest-CreateVolumesFromImageTest-934288853 None] Selected osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385 as target Quobyte volume. {{(pid=88899) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 08:53:07 devstack cinder-volume[88899]: INFO cinder.volume.drivers.remotefs [None req-0dd7930e-1a7b-46ce-8f74-02202f9b3a94 tempest-CreateVolumesFromImageTest-934288853 None] casted to osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385 Aug 03 08:53:07 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-0dd7930e-1a7b-46ce-8f74-02202f9b3a94 tempest-CreateVolumesFromImageTest-934288853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-2fdaf9a5-33fc-44d4-8945-b87a69a6577f 1073741824 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:53:07 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-1ea5f51c-a8d3-48a2-b337-3a6476e64d21 tempest-CreateVolumesFromImageTest-934288853 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a37dcc40-9de4-41b4-865c-cc1eb4469361) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-36438ac9-8a0c-4b65-82be-20e579348379', 'volume_size': 1}' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:53:07 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-1ea5f51c-a8d3-48a2-b337-3a6476e64d21 tempest-CreateVolumesFromImageTest-934288853 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99eae260-0102-4819-b46b-9383a917ff20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:53:07 devstack sudo[111797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-2fdaf9a5-33fc-44d4-8945-b87a69a6577f 1073741824 Aug 03 08:53:07 devstack sudo[111797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:53:07 devstack cinder-volume[88899]: INFO cinder.volume.flows.manager.create_volume [None req-1ea5f51c-a8d3-48a2-b337-3a6476e64d21 tempest-CreateVolumesFromImageTest-934288853 None] Volume volume-36438ac9-8a0c-4b65-82be-20e579348379 (36438ac9-8a0c-4b65-82be-20e579348379): created successfully Aug 03 08:53:07 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-1ea5f51c-a8d3-48a2-b337-3a6476e64d21 tempest-CreateVolumesFromImageTest-934288853 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99eae260-0102-4819-b46b-9383a917ff20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:53:07 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-1ea5f51c-a8d3-48a2-b337-3a6476e64d21 tempest-CreateVolumesFromImageTest-934288853 None] Flow 'volume_create_manager' (0a5a51b2-5486-43b6-8319-31e99a1941e3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:53:07 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-1ea5f51c-a8d3-48a2-b337-3a6476e64d21 tempest-CreateVolumesFromImageTest-934288853 None] Created volume successfully. Aug 03 08:53:07 devstack sudo[111797]: pam_unix(sudo:session): session closed for user root Aug 03 08:53:07 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-0dd7930e-1a7b-46ce-8f74-02202f9b3a94 tempest-CreateVolumesFromImageTest-934288853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-2fdaf9a5-33fc-44d4-8945-b87a69a6577f 1073741824" returned: 0 in 0.544s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:53:07 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-0dd7930e-1a7b-46ce-8f74-02202f9b3a94 tempest-CreateVolumesFromImageTest-934288853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-2fdaf9a5-33fc-44d4-8945-b87a69a6577f {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:53:07 devstack sudo[111803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-2fdaf9a5-33fc-44d4-8945-b87a69a6577f Aug 03 08:53:07 devstack sudo[111803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:53:08 devstack sudo[111803]: pam_unix(sudo:session): session closed for user root Aug 03 08:53:08 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-0dd7930e-1a7b-46ce-8f74-02202f9b3a94 tempest-CreateVolumesFromImageTest-934288853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-2fdaf9a5-33fc-44d4-8945-b87a69a6577f" returned: 0 in 0.278s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:53:08 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-0dd7930e-1a7b-46ce-8f74-02202f9b3a94 tempest-CreateVolumesFromImageTest-934288853 None] <== create_volume: return (864ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'} {{(pid=88899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 08:53:08 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-0dd7930e-1a7b-46ce-8f74-02202f9b3a94 tempest-CreateVolumesFromImageTest-934288853 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.867s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:53:08 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-dfad97aa-1e20-425b-8af3-0a52479250f3 tempest-CreateVolumesFromImageTest-934288853 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.886s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:53:08 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-dfad97aa-1e20-425b-8af3-0a52479250f3 tempest-CreateVolumesFromImageTest-934288853 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:53:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1058820314',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d0a2c22-ae4d-420b-8dab-9a108f887e4d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8243333dc23147b9a5f3ec351af350a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:53:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:53:05Z,use_quota=True,user_id='a729ad21415940e49a5d60e19f09a97e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8bde7129-1dc4-42ab-b852-ab32c61b4921),volume_type_id=8bde7129-1dc4-42ab-b852-ab32c61b4921)}" {{(pid=88899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 08:53:08 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-dfad97aa-1e20-425b-8af3-0a52479250f3 tempest-CreateVolumesFromImageTest-934288853 None] Creating volume 2d0a2c22-ae4d-420b-8dab-9a108f887e4d {{(pid=88899) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 08:53:08 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-dfad97aa-1e20-425b-8af3-0a52479250f3 tempest-CreateVolumesFromImageTest-934288853 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:53:08 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-dfad97aa-1e20-425b-8af3-0a52479250f3 tempest-CreateVolumesFromImageTest-934288853 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:53:08 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-dfad97aa-1e20-425b-8af3-0a52479250f3 tempest-CreateVolumesFromImageTest-934288853 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:53:08 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-dfad97aa-1e20-425b-8af3-0a52479250f3 tempest-CreateVolumesFromImageTest-934288853 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:53:08 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-dfad97aa-1e20-425b-8af3-0a52479250f3 tempest-CreateVolumesFromImageTest-934288853 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:53:08 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-dfad97aa-1e20-425b-8af3-0a52479250f3 tempest-CreateVolumesFromImageTest-934288853 None] Selected osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385 as target Quobyte volume. {{(pid=88899) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 08:53:08 devstack cinder-volume[88899]: INFO cinder.volume.drivers.remotefs [None req-dfad97aa-1e20-425b-8af3-0a52479250f3 tempest-CreateVolumesFromImageTest-934288853 None] casted to osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385 Aug 03 08:53:08 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-dfad97aa-1e20-425b-8af3-0a52479250f3 tempest-CreateVolumesFromImageTest-934288853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-2d0a2c22-ae4d-420b-8dab-9a108f887e4d 1073741824 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:53:08 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-0dd7930e-1a7b-46ce-8f74-02202f9b3a94 tempest-CreateVolumesFromImageTest-934288853 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (554aadcb-f86e-44ca-a8f8-a2204c1ecb06) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2fdaf9a5-33fc-44d4-8945-b87a69a6577f', 'volume_size': 1}' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:53:08 devstack sudo[111806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-2d0a2c22-ae4d-420b-8dab-9a108f887e4d 1073741824 Aug 03 08:53:08 devstack sudo[111806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:53:08 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-0dd7930e-1a7b-46ce-8f74-02202f9b3a94 tempest-CreateVolumesFromImageTest-934288853 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13e11448-33d1-4d83-b61f-f69b8aa6e140) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:53:08 devstack cinder-volume[88899]: INFO cinder.volume.flows.manager.create_volume [None req-0dd7930e-1a7b-46ce-8f74-02202f9b3a94 tempest-CreateVolumesFromImageTest-934288853 None] Volume volume-2fdaf9a5-33fc-44d4-8945-b87a69a6577f (2fdaf9a5-33fc-44d4-8945-b87a69a6577f): created successfully Aug 03 08:53:08 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-0dd7930e-1a7b-46ce-8f74-02202f9b3a94 tempest-CreateVolumesFromImageTest-934288853 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13e11448-33d1-4d83-b61f-f69b8aa6e140) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:53:08 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-0dd7930e-1a7b-46ce-8f74-02202f9b3a94 tempest-CreateVolumesFromImageTest-934288853 None] Flow 'volume_create_manager' (52ca8ad7-4c51-46c0-b7aa-4d1ef8151510) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:53:08 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-0dd7930e-1a7b-46ce-8f74-02202f9b3a94 tempest-CreateVolumesFromImageTest-934288853 None] Created volume successfully. Aug 03 08:53:08 devstack sudo[111806]: pam_unix(sudo:session): session closed for user root Aug 03 08:53:08 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-dfad97aa-1e20-425b-8af3-0a52479250f3 tempest-CreateVolumesFromImageTest-934288853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-2d0a2c22-ae4d-420b-8dab-9a108f887e4d 1073741824" returned: 0 in 0.545s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:53:08 devstack cinder-volume[88899]: DEBUG cinder.volume.flows.manager.create_volume [None req-1e3a4496-9de3-453d-b577-c14140128ce6 tempest-VolumeAndVolumeTypeFromImageTest-731356096 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88899) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 08:53:08 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-1e3a4496-9de3-453d-b577-c14140128ce6 tempest-VolumeAndVolumeTypeFromImageTest-731356096 None] Flow 'volume_create_manager' (d1ccfa11-b81f-4a79-bfda-a8ddedc31208) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:53:08 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-1e3a4496-9de3-453d-b577-c14140128ce6 tempest-VolumeAndVolumeTypeFromImageTest-731356096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26a85fea-0108-45fb-994e-85514239ab01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:53:08 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-1e3a4496-9de3-453d-b577-c14140128ce6 tempest-VolumeAndVolumeTypeFromImageTest-731356096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26a85fea-0108-45fb-994e-85514239ab01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:53:08Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b92ad942-1638-4aa8-9d9a-4836fa5fa48c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a89e44985d894db19945ef19281547cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:53:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:53:09Z,use_quota=True,user_id='d4ef2dd90b55416596bed2b264da298a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(86c50d06-450b-4ba9-b990-db1823d5445a),volume_type_id=86c50d06-450b-4ba9-b990-db1823d5445a)' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:53:08 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-1e3a4496-9de3-453d-b577-c14140128ce6 tempest-VolumeAndVolumeTypeFromImageTest-731356096 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cab1c9ab-295f-462e-b518-f711bd17623a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:53:08 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-1e3a4496-9de3-453d-b577-c14140128ce6 tempest-VolumeAndVolumeTypeFromImageTest-731356096 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cab1c9ab-295f-462e-b518-f711bd17623a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:53:08 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-1e3a4496-9de3-453d-b577-c14140128ce6 tempest-VolumeAndVolumeTypeFromImageTest-731356096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a0c9880-cb87-4939-8d1c-eb0f6d6a46f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:53:08 devstack cinder-volume[88899]: DEBUG cinder.image.glance [None req-1e3a4496-9de3-453d-b577-c14140128ce6 tempest-VolumeAndVolumeTypeFromImageTest-731356096 None] Creating Keystone auth plugin from conf {{(pid=88899) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Aug 03 08:53:08 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-dfad97aa-1e20-425b-8af3-0a52479250f3 tempest-CreateVolumesFromImageTest-934288853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-2d0a2c22-ae4d-420b-8dab-9a108f887e4d {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:53:08 devstack sudo[111813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-2d0a2c22-ae4d-420b-8dab-9a108f887e4d Aug 03 08:53:08 devstack sudo[111813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:53:09 devstack sudo[111813]: pam_unix(sudo:session): session closed for user root Aug 03 08:53:09 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-dfad97aa-1e20-425b-8af3-0a52479250f3 tempest-CreateVolumesFromImageTest-934288853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-2d0a2c22-ae4d-420b-8dab-9a108f887e4d" returned: 0 in 0.281s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:53:09 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-dfad97aa-1e20-425b-8af3-0a52479250f3 tempest-CreateVolumesFromImageTest-934288853 None] <== create_volume: return (941ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'} {{(pid=88899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 08:53:09 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-dfad97aa-1e20-425b-8af3-0a52479250f3 tempest-CreateVolumesFromImageTest-934288853 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.946s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:53:09 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-b24d3c95-4f46-44bb-b55d-c087f9653d3d tempest-CreateVolumesFromImageTest-934288853 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.270s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:53:09 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-b24d3c95-4f46-44bb-b55d-c087f9653d3d tempest-CreateVolumesFromImageTest-934288853 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:53:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-23493787',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3bab51b3-a492-4c99-b41f-2e0e243b9709,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8243333dc23147b9a5f3ec351af350a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:53:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:53:06Z,use_quota=True,user_id='a729ad21415940e49a5d60e19f09a97e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8bde7129-1dc4-42ab-b852-ab32c61b4921),volume_type_id=8bde7129-1dc4-42ab-b852-ab32c61b4921)}" {{(pid=88899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 08:53:09 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-b24d3c95-4f46-44bb-b55d-c087f9653d3d tempest-CreateVolumesFromImageTest-934288853 None] Creating volume 3bab51b3-a492-4c99-b41f-2e0e243b9709 {{(pid=88899) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 08:53:09 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-b24d3c95-4f46-44bb-b55d-c087f9653d3d tempest-CreateVolumesFromImageTest-934288853 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:53:09 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-b24d3c95-4f46-44bb-b55d-c087f9653d3d tempest-CreateVolumesFromImageTest-934288853 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:53:09 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-b24d3c95-4f46-44bb-b55d-c087f9653d3d tempest-CreateVolumesFromImageTest-934288853 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:53:09 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-b24d3c95-4f46-44bb-b55d-c087f9653d3d tempest-CreateVolumesFromImageTest-934288853 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:53:09 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-b24d3c95-4f46-44bb-b55d-c087f9653d3d tempest-CreateVolumesFromImageTest-934288853 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:53:09 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-b24d3c95-4f46-44bb-b55d-c087f9653d3d tempest-CreateVolumesFromImageTest-934288853 None] Selected osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385 as target Quobyte volume. {{(pid=88899) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 08:53:09 devstack cinder-volume[88899]: INFO cinder.volume.drivers.remotefs [None req-b24d3c95-4f46-44bb-b55d-c087f9653d3d tempest-CreateVolumesFromImageTest-934288853 None] casted to osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385 Aug 03 08:53:09 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-b24d3c95-4f46-44bb-b55d-c087f9653d3d tempest-CreateVolumesFromImageTest-934288853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-3bab51b3-a492-4c99-b41f-2e0e243b9709 1073741824 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:53:09 devstack sudo[111816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-3bab51b3-a492-4c99-b41f-2e0e243b9709 1073741824 Aug 03 08:53:09 devstack sudo[111816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:53:09 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-dfad97aa-1e20-425b-8af3-0a52479250f3 tempest-CreateVolumesFromImageTest-934288853 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b932bc6-9c94-4e17-97d1-05e311c5f045) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2d0a2c22-ae4d-420b-8dab-9a108f887e4d', 'volume_size': 1}' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:53:09 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-dfad97aa-1e20-425b-8af3-0a52479250f3 tempest-CreateVolumesFromImageTest-934288853 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (759eaf62-6633-492d-98ff-db1755a215f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:53:09 devstack cinder-volume[88899]: INFO cinder.volume.flows.manager.create_volume [None req-dfad97aa-1e20-425b-8af3-0a52479250f3 tempest-CreateVolumesFromImageTest-934288853 None] Volume volume-2d0a2c22-ae4d-420b-8dab-9a108f887e4d (2d0a2c22-ae4d-420b-8dab-9a108f887e4d): created successfully Aug 03 08:53:09 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-dfad97aa-1e20-425b-8af3-0a52479250f3 tempest-CreateVolumesFromImageTest-934288853 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (759eaf62-6633-492d-98ff-db1755a215f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:53:09 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-dfad97aa-1e20-425b-8af3-0a52479250f3 tempest-CreateVolumesFromImageTest-934288853 None] Flow 'volume_create_manager' (e2503787-dfa2-41ca-bfc3-de76c2c27a89) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:53:09 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-dfad97aa-1e20-425b-8af3-0a52479250f3 tempest-CreateVolumesFromImageTest-934288853 None] Created volume successfully. Aug 03 08:53:09 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-1e3a4496-9de3-453d-b577-c14140128ce6 tempest-VolumeAndVolumeTypeFromImageTest-731356096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a0c9880-cb87-4939-8d1c-eb0f6d6a46f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'b92ad942-1638-4aa8-9d9a-4836fa5fa48c', 'volume_name': 'volume-b92ad942-1638-4aa8-9d9a-4836fa5fa48c', 'volume_size': 1, 'image_id': 'a1efef6b-1cb4-4fac-b1bf-82f7347a3d14', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a1efef6b-1cb4-4fac-b1bf-82f7347a3d14', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'd66629d33443417f92158deb3ce3c836', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'a89e44985d894db19945ef19281547cc', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'b0cb8ceedc02d657af9f84dfd010dbe22c1b9227c70fa63d30573a504027d0018a8febee7daa594df55b4cc3d510c82ccd2f1bf24af025f14a523d08e1e3356f', 'id': 'a1efef6b-1cb4-4fac-b1bf-82f7347a3d14', 'created_at': datetime.datetime(2026, 8, 3, 6, 53, 6, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 3, 6, 53, 8, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a1efef6b-1cb4-4fac-b1bf-82f7347a3d14/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:53:09 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-1e3a4496-9de3-453d-b577-c14140128ce6 tempest-VolumeAndVolumeTypeFromImageTest-731356096 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b96b34f-41d3-454e-bf2d-f7f818f430dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:53:09 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-1e3a4496-9de3-453d-b577-c14140128ce6 tempest-VolumeAndVolumeTypeFromImageTest-731356096 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b96b34f-41d3-454e-bf2d-f7f818f430dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:53:09 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-1e3a4496-9de3-453d-b577-c14140128ce6 tempest-VolumeAndVolumeTypeFromImageTest-731356096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ac9ed14-84ce-4868-a780-122e9c441ec5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:53:09 devstack cinder-volume[88899]: INFO cinder.volume.flows.manager.create_volume [None req-1e3a4496-9de3-453d-b577-c14140128ce6 tempest-VolumeAndVolumeTypeFromImageTest-731356096 None] Volume b92ad942-1638-4aa8-9d9a-4836fa5fa48c: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-b92ad942-1638-4aa8-9d9a-4836fa5fa48c', 'volume_size': 1, 'image_id': 'a1efef6b-1cb4-4fac-b1bf-82f7347a3d14', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a1efef6b-1cb4-4fac-b1bf-82f7347a3d14', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'd66629d33443417f92158deb3ce3c836', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'a89e44985d894db19945ef19281547cc', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'b0cb8ceedc02d657af9f84dfd010dbe22c1b9227c70fa63d30573a504027d0018a8febee7daa594df55b4cc3d510c82ccd2f1bf24af025f14a523d08e1e3356f', 'id': 'a1efef6b-1cb4-4fac-b1bf-82f7347a3d14', 'created_at': datetime.datetime(2026, 8, 3, 6, 53, 6, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 3, 6, 53, 8, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a1efef6b-1cb4-4fac-b1bf-82f7347a3d14/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Aug 03 08:53:09 devstack cinder-volume[88899]: DEBUG cinder.volume.flows.manager.create_volume [None req-1e3a4496-9de3-453d-b577-c14140128ce6 tempest-VolumeAndVolumeTypeFromImageTest-731356096 None] Trying to clone b92ad942-1638-4aa8-9d9a-4836fa5fa48c from image a1efef6b-1cb4-4fac-b1bf-82f7347a3d14 at location (None, [{'url': 'file:///opt/stack/data/glance/images/a1efef6b-1cb4-4fac-b1bf-82f7347a3d14', 'metadata': {}}]). {{(pid=88899) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Aug 03 08:53:09 devstack cinder-volume[88899]: DEBUG cinder.image.image_utils [None req-1e3a4496-9de3-453d-b577-c14140128ce6 tempest-VolumeAndVolumeTypeFromImageTest-731356096 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_a1efef6b-1cb4-4fac-b1bf-82f7347a3d14_qw_x4aksdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=88899) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Aug 03 08:53:09 devstack cinder-volume[88899]: INFO cinder.image.image_utils [None req-1e3a4496-9de3-453d-b577-c14140128ce6 tempest-VolumeAndVolumeTypeFromImageTest-731356096 None] Image download 0.00 MB at 0.00 MB/s Aug 03 08:53:09 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7158cfe-e3bc-4f1e-b2a7-c87f28ec18ca]: (4, 'raw') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:53:09 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-1e3a4496-9de3-453d-b577-c14140128ce6 tempest-VolumeAndVolumeTypeFromImageTest-731356096 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a1efef6b-1cb4-4fac-b1bf-82f7347a3d14_qw_x4aksdevstack@QuobyteHD {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:53:09 devstack sudo[111821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a1efef6b-1cb4-4fac-b1bf-82f7347a3d14_qw_x4aksdevstack@QuobyteHD Aug 03 08:53:09 devstack sudo[111821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:53:09 devstack sudo[111816]: pam_unix(sudo:session): session closed for user root Aug 03 08:53:09 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-b24d3c95-4f46-44bb-b55d-c087f9653d3d tempest-CreateVolumesFromImageTest-934288853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-3bab51b3-a492-4c99-b41f-2e0e243b9709 1073741824" returned: 0 in 0.539s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:53:09 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-b24d3c95-4f46-44bb-b55d-c087f9653d3d tempest-CreateVolumesFromImageTest-934288853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-3bab51b3-a492-4c99-b41f-2e0e243b9709 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:53:09 devstack sudo[111824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-3bab51b3-a492-4c99-b41f-2e0e243b9709 Aug 03 08:53:09 devstack sudo[111824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:53:09 devstack sudo[111821]: pam_unix(sudo:session): session closed for user root Aug 03 08:53:09 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-1e3a4496-9de3-453d-b577-c14140128ce6 tempest-VolumeAndVolumeTypeFromImageTest-731356096 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a1efef6b-1cb4-4fac-b1bf-82f7347a3d14_qw_x4aksdevstack@QuobyteHD" returned: 0 in 0.359s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:53:09 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-1e3a4496-9de3-453d-b577-c14140128ce6 tempest-VolumeAndVolumeTypeFromImageTest-731356096 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a1efef6b-1cb4-4fac-b1bf-82f7347a3d14_qw_x4aksdevstack@QuobyteHD {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:53:09 devstack sudo[111828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a1efef6b-1cb4-4fac-b1bf-82f7347a3d14_qw_x4aksdevstack@QuobyteHD Aug 03 08:53:09 devstack sudo[111828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:53:09 devstack sudo[111824]: pam_unix(sudo:session): session closed for user root Aug 03 08:53:09 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-b24d3c95-4f46-44bb-b55d-c087f9653d3d tempest-CreateVolumesFromImageTest-934288853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-3bab51b3-a492-4c99-b41f-2e0e243b9709" returned: 0 in 0.270s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:53:09 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-b24d3c95-4f46-44bb-b55d-c087f9653d3d tempest-CreateVolumesFromImageTest-934288853 None] <== create_volume: return (864ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'} {{(pid=88899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 08:53:09 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-b24d3c95-4f46-44bb-b55d-c087f9653d3d tempest-CreateVolumesFromImageTest-934288853 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.867s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:53:09 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-bcd1e750-cdb6-4b9f-8960-5b82b18ddcce tempest-VolumeDependencyTests-1512358985 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.920s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:53:09 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-b24d3c95-4f46-44bb-b55d-c087f9653d3d tempest-CreateVolumesFromImageTest-934288853 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7c54dce-7380-44f8-b4df-d5594fe0c087) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3bab51b3-a492-4c99-b41f-2e0e243b9709', 'volume_size': 1}' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:53:09 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-b24d3c95-4f46-44bb-b55d-c087f9653d3d tempest-CreateVolumesFromImageTest-934288853 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (569741b7-6ccc-46fa-a0e7-698f0ccc803d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:53:10 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-bcd1e750-cdb6-4b9f-8960-5b82b18ddcce tempest-VolumeDependencyTests-1512358985 None] Creating offline snapshot 7a40132f-52ed-4711-ba9b-088821b45487 of volume 7a8ead30-8de5-46a9-a84e-9425b673c7c3 {{(pid=88899) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 03 08:53:10 devstack cinder-volume[88899]: INFO cinder.volume.flows.manager.create_volume [None req-b24d3c95-4f46-44bb-b55d-c087f9653d3d tempest-CreateVolumesFromImageTest-934288853 None] Volume volume-3bab51b3-a492-4c99-b41f-2e0e243b9709 (3bab51b3-a492-4c99-b41f-2e0e243b9709): created successfully Aug 03 08:53:10 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-b24d3c95-4f46-44bb-b55d-c087f9653d3d tempest-CreateVolumesFromImageTest-934288853 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (569741b7-6ccc-46fa-a0e7-698f0ccc803d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:53:10 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-b24d3c95-4f46-44bb-b55d-c087f9653d3d tempest-CreateVolumesFromImageTest-934288853 None] Flow 'volume_create_manager' (4aea908f-ca9e-4571-b52a-125687727a89) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:53:10 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7e279db-7471-425f-968e-b5027ecdc154]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:53:10 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-bcd1e750-cdb6-4b9f-8960-5b82b18ddcce tempest-VolumeDependencyTests-1512358985 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-7a8ead30-8de5-46a9-a84e-9425b673c7c3 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:53:10 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-b24d3c95-4f46-44bb-b55d-c087f9653d3d tempest-CreateVolumesFromImageTest-934288853 None] Created volume successfully. Aug 03 08:53:10 devstack sudo[111828]: pam_unix(sudo:session): session closed for user root Aug 03 08:53:10 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-1e3a4496-9de3-453d-b577-c14140128ce6 tempest-VolumeAndVolumeTypeFromImageTest-731356096 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a1efef6b-1cb4-4fac-b1bf-82f7347a3d14_qw_x4aksdevstack@QuobyteHD" returned: 1 in 0.473s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:53:10 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-1e3a4496-9de3-453d-b577-c14140128ce6 tempest-VolumeAndVolumeTypeFromImageTest-731356096 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a1efef6b-1cb4-4fac-b1bf-82f7347a3d14_qw_x4aksdevstack@QuobyteHD' failed. Not Retrying. {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 03 08:53:10 devstack cinder-volume[88899]: DEBUG cinder.image.image_utils [None req-1e3a4496-9de3-453d-b577-c14140128ce6 tempest-VolumeAndVolumeTypeFromImageTest-731356096 None] Temporary image a1efef6b-1cb4-4fac-b1bf-82f7347a3d14 is fetched for user d4ef2dd90b55416596bed2b264da298a. {{(pid=88899) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Aug 03 08:53:10 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-ad6923ca-ddbe-43ae-844f-d0bb201dd925 tempest-CreateVolumesFromImageTest-934288853 None] Acquiring lock "cinder-3bab51b3-a492-4c99-b41f-2e0e243b9709-delete_volume" by "delete_volume" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:53:10 devstack sudo[111831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-7a8ead30-8de5-46a9-a84e-9425b673c7c3 Aug 03 08:53:10 devstack sudo[111831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:53:10 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-ad6923ca-ddbe-43ae-844f-d0bb201dd925 tempest-CreateVolumesFromImageTest-934288853 None] Lock "cinder-3bab51b3-a492-4c99-b41f-2e0e243b9709-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:53:10 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-ad6923ca-ddbe-43ae-844f-d0bb201dd925 tempest-CreateVolumesFromImageTest-934288853 None] Acquiring lock "cinder-quobyte-3bab51b3-a492-4c99-b41f-2e0e243b9709" by "delete_volume" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:53:10 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-ad6923ca-ddbe-43ae-844f-d0bb201dd925 tempest-CreateVolumesFromImageTest-934288853 None] Lock "cinder-quobyte-3bab51b3-a492-4c99-b41f-2e0e243b9709" acquired by "delete_volume" :: waited 0.024s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:53:10 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[4578618f-d3d9-4402-8139-4a18dc118304]: (4, 'raw') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:53:10 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-1e3a4496-9de3-453d-b577-c14140128ce6 tempest-VolumeAndVolumeTypeFromImageTest-731356096 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a1efef6b-1cb4-4fac-b1bf-82f7347a3d14_qw_x4aksdevstack@QuobyteHD {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:53:10 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab578442-fe82-468e-830c-22439ad0cdb4]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:53:10 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-ad6923ca-ddbe-43ae-844f-d0bb201dd925 tempest-CreateVolumesFromImageTest-934288853 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-3bab51b3-a492-4c99-b41f-2e0e243b9709 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:53:10 devstack sudo[111837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-3bab51b3-a492-4c99-b41f-2e0e243b9709 Aug 03 08:53:10 devstack sudo[111837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:53:10 devstack sudo[111836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a1efef6b-1cb4-4fac-b1bf-82f7347a3d14_qw_x4aksdevstack@QuobyteHD Aug 03 08:53:10 devstack sudo[111836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:53:10 devstack sudo[111831]: pam_unix(sudo:session): session closed for user root Aug 03 08:53:10 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-bcd1e750-cdb6-4b9f-8960-5b82b18ddcce tempest-VolumeDependencyTests-1512358985 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-7a8ead30-8de5-46a9-a84e-9425b673c7c3" returned: 0 in 0.563s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:53:10 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-bcd1e750-cdb6-4b9f-8960-5b82b18ddcce tempest-VolumeDependencyTests-1512358985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-7a8ead30-8de5-46a9-a84e-9425b673c7c3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-7a8ead30-8de5-46a9-a84e-9425b673c7c3.7a40132f-52ed-4711-ba9b-088821b45487 1G {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:53:10 devstack cinder-volume[88899]: DEBUG cinder.volume.flows.manager.create_volume [None req-a5ab125b-619e-40b9-89bd-44842b767bbe tempest-ProjectMemberTests-1353074417 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88899) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 08:53:10 devstack sudo[111844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-7a8ead30-8de5-46a9-a84e-9425b673c7c3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-7a8ead30-8de5-46a9-a84e-9425b673c7c3.7a40132f-52ed-4711-ba9b-088821b45487 1G Aug 03 08:53:10 devstack sudo[111844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:53:10 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-a5ab125b-619e-40b9-89bd-44842b767bbe tempest-ProjectMemberTests-1353074417 None] Flow 'volume_create_manager' (f6fb4806-aa9b-451c-a61f-b62f7386c1d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:53:10 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-a5ab125b-619e-40b9-89bd-44842b767bbe tempest-ProjectMemberTests-1353074417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f010a596-db6e-4e90-9b6f-e4512468010e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:53:10 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-a5ab125b-619e-40b9-89bd-44842b767bbe tempest-ProjectMemberTests-1353074417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f010a596-db6e-4e90-9b6f-e4512468010e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:53:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-629368750',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=90e29bc4-3f11-4cbb-89c9-2b08888e5edb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b723e915839a4036ad739740ec4db0cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:53:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:53:11Z,use_quota=True,user_id='d9152484679b4fb79b0d8896a2a67eb9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8bde7129-1dc4-42ab-b852-ab32c61b4921),volume_type_id=8bde7129-1dc4-42ab-b852-ab32c61b4921)' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:53:10 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-a5ab125b-619e-40b9-89bd-44842b767bbe tempest-ProjectMemberTests-1353074417 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2988192c-7716-4dd4-8453-fb24b65dfd0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:53:10 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-a5ab125b-619e-40b9-89bd-44842b767bbe tempest-ProjectMemberTests-1353074417 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2988192c-7716-4dd4-8453-fb24b65dfd0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:53:10 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-a5ab125b-619e-40b9-89bd-44842b767bbe tempest-ProjectMemberTests-1353074417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1bc23e67-6945-427c-8441-0888e4431df0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:53:10 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-a5ab125b-619e-40b9-89bd-44842b767bbe tempest-ProjectMemberTests-1353074417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1bc23e67-6945-427c-8441-0888e4431df0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '90e29bc4-3f11-4cbb-89c9-2b08888e5edb', 'volume_name': 'volume-90e29bc4-3f11-4cbb-89c9-2b08888e5edb', 'volume_size': 1}' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:53:10 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-a5ab125b-619e-40b9-89bd-44842b767bbe tempest-ProjectMemberTests-1353074417 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89dd7f44-7e10-488d-b3c3-57d7fe209f23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:53:10 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-a5ab125b-619e-40b9-89bd-44842b767bbe tempest-ProjectMemberTests-1353074417 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89dd7f44-7e10-488d-b3c3-57d7fe209f23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:53:10 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-a5ab125b-619e-40b9-89bd-44842b767bbe tempest-ProjectMemberTests-1353074417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf47a306-5d7a-4929-9d8b-7e0a00188849) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:53:10 devstack cinder-volume[88899]: INFO cinder.volume.flows.manager.create_volume [None req-a5ab125b-619e-40b9-89bd-44842b767bbe tempest-ProjectMemberTests-1353074417 None] Volume 90e29bc4-3f11-4cbb-89c9-2b08888e5edb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-90e29bc4-3f11-4cbb-89c9-2b08888e5edb', 'volume_size': 1} Aug 03 08:53:10 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-a5ab125b-619e-40b9-89bd-44842b767bbe tempest-ProjectMemberTests-1353074417 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:53:10 devstack sudo[111836]: pam_unix(sudo:session): session closed for user root Aug 03 08:53:10 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-1e3a4496-9de3-453d-b577-c14140128ce6 tempest-VolumeAndVolumeTypeFromImageTest-731356096 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a1efef6b-1cb4-4fac-b1bf-82f7347a3d14_qw_x4aksdevstack@QuobyteHD" returned: 0 in 0.394s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:53:10 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-1e3a4496-9de3-453d-b577-c14140128ce6 tempest-VolumeAndVolumeTypeFromImageTest-731356096 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a1efef6b-1cb4-4fac-b1bf-82f7347a3d14_qw_x4aksdevstack@QuobyteHD {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:53:10 devstack sudo[111837]: pam_unix(sudo:session): session closed for user root Aug 03 08:53:10 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-ad6923ca-ddbe-43ae-844f-d0bb201dd925 tempest-CreateVolumesFromImageTest-934288853 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-3bab51b3-a492-4c99-b41f-2e0e243b9709" returned: 0 in 0.404s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:53:10 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-ad6923ca-ddbe-43ae-844f-d0bb201dd925 tempest-CreateVolumesFromImageTest-934288853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-3bab51b3-a492-4c99-b41f-2e0e243b9709 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:53:10 devstack sudo[111853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-3bab51b3-a492-4c99-b41f-2e0e243b9709 Aug 03 08:53:10 devstack sudo[111853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:53:10 devstack sudo[111852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a1efef6b-1cb4-4fac-b1bf-82f7347a3d14_qw_x4aksdevstack@QuobyteHD Aug 03 08:53:10 devstack sudo[111852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:53:11 devstack sudo[111853]: pam_unix(sudo:session): session closed for user root Aug 03 08:53:11 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-ad6923ca-ddbe-43ae-844f-d0bb201dd925 tempest-CreateVolumesFromImageTest-934288853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-3bab51b3-a492-4c99-b41f-2e0e243b9709" returned: 0 in 0.252s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:53:11 devstack sudo[111844]: pam_unix(sudo:session): session closed for user root Aug 03 08:53:11 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-bcd1e750-cdb6-4b9f-8960-5b82b18ddcce tempest-VolumeDependencyTests-1512358985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-7a8ead30-8de5-46a9-a84e-9425b673c7c3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-7a8ead30-8de5-46a9-a84e-9425b673c7c3.7a40132f-52ed-4711-ba9b-088821b45487 1G" returned: 0 in 0.473s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:53:11 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-bcd1e750-cdb6-4b9f-8960-5b82b18ddcce tempest-VolumeDependencyTests-1512358985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7a8ead30-8de5-46a9-a84e-9425b673c7c3 -F qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-7a8ead30-8de5-46a9-a84e-9425b673c7c3.7a40132f-52ed-4711-ba9b-088821b45487 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:53:11 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-ad6923ca-ddbe-43ae-844f-d0bb201dd925 tempest-CreateVolumesFromImageTest-934288853 None] Lock "cinder-quobyte-3bab51b3-a492-4c99-b41f-2e0e243b9709" released by "delete_volume" :: held 0.734s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:53:11 devstack sudo[111863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7a8ead30-8de5-46a9-a84e-9425b673c7c3 -F qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-7a8ead30-8de5-46a9-a84e-9425b673c7c3.7a40132f-52ed-4711-ba9b-088821b45487 Aug 03 08:53:11 devstack sudo[111863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:53:11 devstack sudo[111852]: pam_unix(sudo:session): session closed for user root Aug 03 08:53:11 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-1e3a4496-9de3-453d-b577-c14140128ce6 tempest-VolumeAndVolumeTypeFromImageTest-731356096 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a1efef6b-1cb4-4fac-b1bf-82f7347a3d14_qw_x4aksdevstack@QuobyteHD" returned: 1 in 0.343s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:53:11 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-1e3a4496-9de3-453d-b577-c14140128ce6 tempest-VolumeAndVolumeTypeFromImageTest-731356096 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a1efef6b-1cb4-4fac-b1bf-82f7347a3d14_qw_x4aksdevstack@QuobyteHD' failed. Not Retrying. {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 03 08:53:11 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-1e3a4496-9de3-453d-b577-c14140128ce6 tempest-VolumeAndVolumeTypeFromImageTest-731356096 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:53:11 devstack cinder-volume[88899]: DEBUG cinder.quota [None req-ad6923ca-ddbe-43ae-844f-d0bb201dd925 tempest-CreateVolumesFromImageTest-934288853 None] Created reservations ['91cc330e-4c5b-4c68-9ef5-240f246ed14e', '458ce57c-28b4-43e8-a247-5efa74a5df0c', 'c1fddf7c-5f39-4031-b529-2375b8e2c40d', '0f2f8db5-6269-4161-bc55-521ac5a0aef0'] {{(pid=88899) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 08:53:11 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-ad6923ca-ddbe-43ae-844f-d0bb201dd925 tempest-CreateVolumesFromImageTest-934288853 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:53:11 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-ad6923ca-ddbe-43ae-844f-d0bb201dd925 tempest-CreateVolumesFromImageTest-934288853 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:53:11 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-ad6923ca-ddbe-43ae-844f-d0bb201dd925 tempest-CreateVolumesFromImageTest-934288853 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:53:11 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-ad6923ca-ddbe-43ae-844f-d0bb201dd925 tempest-CreateVolumesFromImageTest-934288853 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:53:11 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-ad6923ca-ddbe-43ae-844f-d0bb201dd925 tempest-CreateVolumesFromImageTest-934288853 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:53:11 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-ad6923ca-ddbe-43ae-844f-d0bb201dd925 tempest-CreateVolumesFromImageTest-934288853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:53:11 devstack sudo[111865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a Aug 03 08:53:11 devstack sudo[111865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:53:11 devstack sudo[111863]: pam_unix(sudo:session): session closed for user root Aug 03 08:53:11 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-bcd1e750-cdb6-4b9f-8960-5b82b18ddcce tempest-VolumeDependencyTests-1512358985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7a8ead30-8de5-46a9-a84e-9425b673c7c3 -F qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-7a8ead30-8de5-46a9-a84e-9425b673c7c3.7a40132f-52ed-4711-ba9b-088821b45487" returned: 0 in 0.342s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:53:11 devstack cinder-volume[88899]: WARNING cinder.volume.drivers.remotefs [None req-bcd1e750-cdb6-4b9f-8960-5b82b18ddcce tempest-VolumeDependencyTests-1512358985 None] /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-7a8ead30-8de5-46a9-a84e-9425b673c7c3.7a40132f-52ed-4711-ba9b-088821b45487 is being set with open permissions: ugo+rw Aug 03 08:53:11 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-bcd1e750-cdb6-4b9f-8960-5b82b18ddcce tempest-VolumeDependencyTests-1512358985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-7a8ead30-8de5-46a9-a84e-9425b673c7c3.7a40132f-52ed-4711-ba9b-088821b45487 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:53:11 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-9e39ffdf-72a2-444c-b46b-6f4f6d73408a tempest-CreateVolumesFromImageTest-934288853 None] Acquiring lock "cinder-2d0a2c22-ae4d-420b-8dab-9a108f887e4d-delete_volume" by "delete_volume" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:53:11 devstack sudo[111870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-7a8ead30-8de5-46a9-a84e-9425b673c7c3.7a40132f-52ed-4711-ba9b-088821b45487 Aug 03 08:53:11 devstack sudo[111870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:53:11 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-9e39ffdf-72a2-444c-b46b-6f4f6d73408a tempest-CreateVolumesFromImageTest-934288853 None] Lock "cinder-2d0a2c22-ae4d-420b-8dab-9a108f887e4d-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:53:11 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-9e39ffdf-72a2-444c-b46b-6f4f6d73408a tempest-CreateVolumesFromImageTest-934288853 None] Acquiring lock "cinder-quobyte-2d0a2c22-ae4d-420b-8dab-9a108f887e4d" by "delete_volume" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:53:11 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-9e39ffdf-72a2-444c-b46b-6f4f6d73408a tempest-CreateVolumesFromImageTest-934288853 None] Lock "cinder-quobyte-2d0a2c22-ae4d-420b-8dab-9a108f887e4d" acquired by "delete_volume" :: waited 0.017s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:53:11 devstack sudo[111865]: pam_unix(sudo:session): session closed for user root Aug 03 08:53:11 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[186c5caf-e27f-4d1f-aad3-4418ab487683]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:53:11 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-9e39ffdf-72a2-444c-b46b-6f4f6d73408a tempest-CreateVolumesFromImageTest-934288853 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-2d0a2c22-ae4d-420b-8dab-9a108f887e4d {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:53:11 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-ad6923ca-ddbe-43ae-844f-d0bb201dd925 tempest-CreateVolumesFromImageTest-934288853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a" returned: 0 in 0.296s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:53:11 devstack cinder-volume[88899]: DEBUG cinder.manager [None req-ad6923ca-ddbe-43ae-844f-d0bb201dd925 tempest-CreateVolumesFromImageTest-934288853 None] Notifying Schedulers of capabilities ... {{(pid=88899) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 08:53:11 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-ad6923ca-ddbe-43ae-844f-d0bb201dd925 tempest-CreateVolumesFromImageTest-934288853 None] Deleted volume successfully. Aug 03 08:53:11 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-ad6923ca-ddbe-43ae-844f-d0bb201dd925 tempest-CreateVolumesFromImageTest-934288853 None] Lock "cinder-3bab51b3-a492-4c99-b41f-2e0e243b9709-delete_volume" released by "delete_volume" :: held 1.342s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:53:11 devstack sudo[111873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-2d0a2c22-ae4d-420b-8dab-9a108f887e4d Aug 03 08:53:11 devstack sudo[111873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:53:11 devstack sudo[111870]: pam_unix(sudo:session): session closed for user root Aug 03 08:53:11 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-bcd1e750-cdb6-4b9f-8960-5b82b18ddcce tempest-VolumeDependencyTests-1512358985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-7a8ead30-8de5-46a9-a84e-9425b673c7c3.7a40132f-52ed-4711-ba9b-088821b45487" returned: 0 in 0.313s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:53:11 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-bcd1e750-cdb6-4b9f-8960-5b82b18ddcce tempest-VolumeDependencyTests-1512358985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-7a8ead30-8de5-46a9-a84e-9425b673c7c3.info {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:53:11 devstack sudo[111876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-7a8ead30-8de5-46a9-a84e-9425b673c7c3.info Aug 03 08:53:11 devstack sudo[111876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:53:11 devstack sudo[111873]: pam_unix(sudo:session): session closed for user root Aug 03 08:53:11 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-9e39ffdf-72a2-444c-b46b-6f4f6d73408a tempest-CreateVolumesFromImageTest-934288853 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-2d0a2c22-ae4d-420b-8dab-9a108f887e4d" returned: 0 in 0.387s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:53:11 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-9e39ffdf-72a2-444c-b46b-6f4f6d73408a tempest-CreateVolumesFromImageTest-934288853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-2d0a2c22-ae4d-420b-8dab-9a108f887e4d {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:53:12 devstack sudo[111884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-2d0a2c22-ae4d-420b-8dab-9a108f887e4d Aug 03 08:53:12 devstack sudo[111884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:53:12 devstack sudo[111876]: pam_unix(sudo:session): session closed for user root Aug 03 08:53:12 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-bcd1e750-cdb6-4b9f-8960-5b82b18ddcce tempest-VolumeDependencyTests-1512358985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-7a8ead30-8de5-46a9-a84e-9425b673c7c3.info" returned: 0 in 0.254s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:53:12 devstack cinder-volume[88899]: WARNING cinder.volume.drivers.remotefs [None req-bcd1e750-cdb6-4b9f-8960-5b82b18ddcce tempest-VolumeDependencyTests-1512358985 None] /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-7a8ead30-8de5-46a9-a84e-9425b673c7c3.info is being set with open permissions: ugo+rw Aug 03 08:53:12 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-bcd1e750-cdb6-4b9f-8960-5b82b18ddcce tempest-VolumeDependencyTests-1512358985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-7a8ead30-8de5-46a9-a84e-9425b673c7c3.info {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:53:12 devstack sudo[111890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-7a8ead30-8de5-46a9-a84e-9425b673c7c3.info Aug 03 08:53:12 devstack sudo[111890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:53:12 devstack sudo[111884]: pam_unix(sudo:session): session closed for user root Aug 03 08:53:12 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-9e39ffdf-72a2-444c-b46b-6f4f6d73408a tempest-CreateVolumesFromImageTest-934288853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-2d0a2c22-ae4d-420b-8dab-9a108f887e4d" returned: 0 in 0.249s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:53:12 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-9e39ffdf-72a2-444c-b46b-6f4f6d73408a tempest-CreateVolumesFromImageTest-934288853 None] Lock "cinder-quobyte-2d0a2c22-ae4d-420b-8dab-9a108f887e4d" released by "delete_volume" :: held 0.687s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:53:12 devstack cinder-volume[88899]: DEBUG cinder.quota [None req-9e39ffdf-72a2-444c-b46b-6f4f6d73408a tempest-CreateVolumesFromImageTest-934288853 None] Created reservations ['04f5deff-1a56-45b2-862a-c5d9219e1f13', '7198fbef-993f-4ed0-9863-9bab2abd6b17', '88cc15c3-2905-4493-8835-c26911055c05', '3ad8812c-edac-41bd-b451-94612e5c0a80'] {{(pid=88899) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 08:53:12 devstack sudo[111890]: pam_unix(sudo:session): session closed for user root Aug 03 08:53:12 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-bcd1e750-cdb6-4b9f-8960-5b82b18ddcce tempest-VolumeDependencyTests-1512358985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-7a8ead30-8de5-46a9-a84e-9425b673c7c3.info" returned: 0 in 0.267s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:53:12 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-bcd1e750-cdb6-4b9f-8960-5b82b18ddcce tempest-VolumeDependencyTests-1512358985 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.373s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:53:12 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-a5ab125b-619e-40b9-89bd-44842b767bbe tempest-ProjectMemberTests-1353074417 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.539s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:53:12 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-a5ab125b-619e-40b9-89bd-44842b767bbe tempest-ProjectMemberTests-1353074417 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:53:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-629368750',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=90e29bc4-3f11-4cbb-89c9-2b08888e5edb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b723e915839a4036ad739740ec4db0cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:53:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:53:11Z,use_quota=True,user_id='d9152484679b4fb79b0d8896a2a67eb9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8bde7129-1dc4-42ab-b852-ab32c61b4921),volume_type_id=8bde7129-1dc4-42ab-b852-ab32c61b4921)}" {{(pid=88899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 08:53:12 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-a5ab125b-619e-40b9-89bd-44842b767bbe tempest-ProjectMemberTests-1353074417 None] Creating volume 90e29bc4-3f11-4cbb-89c9-2b08888e5edb {{(pid=88899) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 08:53:12 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-a5ab125b-619e-40b9-89bd-44842b767bbe tempest-ProjectMemberTests-1353074417 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:53:12 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-a5ab125b-619e-40b9-89bd-44842b767bbe tempest-ProjectMemberTests-1353074417 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:53:12 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-a5ab125b-619e-40b9-89bd-44842b767bbe tempest-ProjectMemberTests-1353074417 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:53:12 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-a5ab125b-619e-40b9-89bd-44842b767bbe tempest-ProjectMemberTests-1353074417 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:53:12 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-a5ab125b-619e-40b9-89bd-44842b767bbe tempest-ProjectMemberTests-1353074417 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:53:12 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-a5ab125b-619e-40b9-89bd-44842b767bbe tempest-ProjectMemberTests-1353074417 None] Selected osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385 as target Quobyte volume. {{(pid=88899) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 08:53:12 devstack cinder-volume[88899]: INFO cinder.volume.drivers.remotefs [None req-a5ab125b-619e-40b9-89bd-44842b767bbe tempest-ProjectMemberTests-1353074417 None] casted to osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385 Aug 03 08:53:12 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-a5ab125b-619e-40b9-89bd-44842b767bbe tempest-ProjectMemberTests-1353074417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-90e29bc4-3f11-4cbb-89c9-2b08888e5edb 1073741824 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:53:12 devstack sudo[111894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-90e29bc4-3f11-4cbb-89c9-2b08888e5edb 1073741824 Aug 03 08:53:12 devstack sudo[111894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:53:12 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-bcd1e750-cdb6-4b9f-8960-5b82b18ddcce tempest-VolumeDependencyTests-1512358985 None] Create snapshot completed successfully Aug 03 08:53:12 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-9e39ffdf-72a2-444c-b46b-6f4f6d73408a tempest-CreateVolumesFromImageTest-934288853 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:53:12 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-9e39ffdf-72a2-444c-b46b-6f4f6d73408a tempest-CreateVolumesFromImageTest-934288853 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:53:12 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-9e39ffdf-72a2-444c-b46b-6f4f6d73408a tempest-CreateVolumesFromImageTest-934288853 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:53:12 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-9e39ffdf-72a2-444c-b46b-6f4f6d73408a tempest-CreateVolumesFromImageTest-934288853 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:53:12 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-9e39ffdf-72a2-444c-b46b-6f4f6d73408a tempest-CreateVolumesFromImageTest-934288853 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:53:12 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-9e39ffdf-72a2-444c-b46b-6f4f6d73408a tempest-CreateVolumesFromImageTest-934288853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:53:12 devstack sudo[111896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a Aug 03 08:53:12 devstack sudo[111896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:53:12 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-2bd18391-a3ce-419a-844e-d9b6f85ae2a0 tempest-CreateVolumesFromImageTest-934288853 None] Acquiring lock "cinder-2fdaf9a5-33fc-44d4-8945-b87a69a6577f-delete_volume" by "delete_volume" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:53:12 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-2bd18391-a3ce-419a-844e-d9b6f85ae2a0 tempest-CreateVolumesFromImageTest-934288853 None] Lock "cinder-2fdaf9a5-33fc-44d4-8945-b87a69a6577f-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:53:12 devstack sudo[111896]: pam_unix(sudo:session): session closed for user root Aug 03 08:53:12 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-9e39ffdf-72a2-444c-b46b-6f4f6d73408a tempest-CreateVolumesFromImageTest-934288853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a" returned: 0 in 0.280s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:53:12 devstack cinder-volume[88899]: DEBUG cinder.manager [None req-9e39ffdf-72a2-444c-b46b-6f4f6d73408a tempest-CreateVolumesFromImageTest-934288853 None] Notifying Schedulers of capabilities ... {{(pid=88899) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 08:53:12 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-9e39ffdf-72a2-444c-b46b-6f4f6d73408a tempest-CreateVolumesFromImageTest-934288853 None] Deleted volume successfully. Aug 03 08:53:12 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-2bd18391-a3ce-419a-844e-d9b6f85ae2a0 tempest-CreateVolumesFromImageTest-934288853 None] Acquiring lock "cinder-quobyte-2fdaf9a5-33fc-44d4-8945-b87a69a6577f" by "delete_volume" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:53:12 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-9e39ffdf-72a2-444c-b46b-6f4f6d73408a tempest-CreateVolumesFromImageTest-934288853 None] Lock "cinder-2d0a2c22-ae4d-420b-8dab-9a108f887e4d-delete_volume" released by "delete_volume" :: held 1.265s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:53:12 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-2bd18391-a3ce-419a-844e-d9b6f85ae2a0 tempest-CreateVolumesFromImageTest-934288853 None] Lock "cinder-quobyte-2fdaf9a5-33fc-44d4-8945-b87a69a6577f" acquired by "delete_volume" :: waited 0.015s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:53:12 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[c566769c-7ad9-4671-aa81-d240d0b17fef]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:53:12 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-2bd18391-a3ce-419a-844e-d9b6f85ae2a0 tempest-CreateVolumesFromImageTest-934288853 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-2fdaf9a5-33fc-44d4-8945-b87a69a6577f {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:53:12 devstack sudo[111894]: pam_unix(sudo:session): session closed for user root Aug 03 08:53:12 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-a5ab125b-619e-40b9-89bd-44842b767bbe tempest-ProjectMemberTests-1353074417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-90e29bc4-3f11-4cbb-89c9-2b08888e5edb 1073741824" returned: 0 in 0.522s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:53:12 devstack sudo[111903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-2fdaf9a5-33fc-44d4-8945-b87a69a6577f Aug 03 08:53:12 devstack sudo[111903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:53:12 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-a5ab125b-619e-40b9-89bd-44842b767bbe tempest-ProjectMemberTests-1353074417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-90e29bc4-3f11-4cbb-89c9-2b08888e5edb {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:53:12 devstack sudo[111905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-90e29bc4-3f11-4cbb-89c9-2b08888e5edb Aug 03 08:53:12 devstack sudo[111905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:53:13 devstack sudo[111905]: pam_unix(sudo:session): session closed for user root Aug 03 08:53:13 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-a5ab125b-619e-40b9-89bd-44842b767bbe tempest-ProjectMemberTests-1353074417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-90e29bc4-3f11-4cbb-89c9-2b08888e5edb" returned: 0 in 0.248s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:53:13 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-a5ab125b-619e-40b9-89bd-44842b767bbe tempest-ProjectMemberTests-1353074417 None] <== create_volume: return (823ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'} {{(pid=88899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 08:53:13 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-a5ab125b-619e-40b9-89bd-44842b767bbe tempest-ProjectMemberTests-1353074417 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.827s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:53:13 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-1e3a4496-9de3-453d-b577-c14140128ce6 tempest-VolumeAndVolumeTypeFromImageTest-731356096 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.019s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:53:13 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-1e3a4496-9de3-453d-b577-c14140128ce6 tempest-VolumeAndVolumeTypeFromImageTest-731356096 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:53:08Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b92ad942-1638-4aa8-9d9a-4836fa5fa48c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a89e44985d894db19945ef19281547cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:53:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:53:09Z,use_quota=True,user_id='d4ef2dd90b55416596bed2b264da298a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(86c50d06-450b-4ba9-b990-db1823d5445a),volume_type_id=86c50d06-450b-4ba9-b990-db1823d5445a)}" {{(pid=88899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 08:53:13 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-1e3a4496-9de3-453d-b577-c14140128ce6 tempest-VolumeAndVolumeTypeFromImageTest-731356096 None] Creating volume b92ad942-1638-4aa8-9d9a-4836fa5fa48c {{(pid=88899) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 08:53:13 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-1e3a4496-9de3-453d-b577-c14140128ce6 tempest-VolumeAndVolumeTypeFromImageTest-731356096 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:53:13 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-1e3a4496-9de3-453d-b577-c14140128ce6 tempest-VolumeAndVolumeTypeFromImageTest-731356096 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:53:13 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-1e3a4496-9de3-453d-b577-c14140128ce6 tempest-VolumeAndVolumeTypeFromImageTest-731356096 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:53:13 devstack sudo[111903]: pam_unix(sudo:session): session closed for user root Aug 03 08:53:13 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-1e3a4496-9de3-453d-b577-c14140128ce6 tempest-VolumeAndVolumeTypeFromImageTest-731356096 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:53:13 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-1e3a4496-9de3-453d-b577-c14140128ce6 tempest-VolumeAndVolumeTypeFromImageTest-731356096 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:53:13 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-1e3a4496-9de3-453d-b577-c14140128ce6 tempest-VolumeAndVolumeTypeFromImageTest-731356096 None] Selected osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385 as target Quobyte volume. {{(pid=88899) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 08:53:13 devstack cinder-volume[88899]: INFO cinder.volume.drivers.remotefs [None req-1e3a4496-9de3-453d-b577-c14140128ce6 tempest-VolumeAndVolumeTypeFromImageTest-731356096 None] casted to osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385 Aug 03 08:53:13 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-1e3a4496-9de3-453d-b577-c14140128ce6 tempest-VolumeAndVolumeTypeFromImageTest-731356096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-b92ad942-1638-4aa8-9d9a-4836fa5fa48c 1073741824 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:53:13 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-2bd18391-a3ce-419a-844e-d9b6f85ae2a0 tempest-CreateVolumesFromImageTest-934288853 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-2fdaf9a5-33fc-44d4-8945-b87a69a6577f" returned: 0 in 0.414s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:53:13 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-2bd18391-a3ce-419a-844e-d9b6f85ae2a0 tempest-CreateVolumesFromImageTest-934288853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-2fdaf9a5-33fc-44d4-8945-b87a69a6577f {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:53:13 devstack sudo[111911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-b92ad942-1638-4aa8-9d9a-4836fa5fa48c 1073741824 Aug 03 08:53:13 devstack sudo[111911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:53:13 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-a5ab125b-619e-40b9-89bd-44842b767bbe tempest-ProjectMemberTests-1353074417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf47a306-5d7a-4929-9d8b-7e0a00188849) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-90e29bc4-3f11-4cbb-89c9-2b08888e5edb', 'volume_size': 1}' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:53:13 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-a5ab125b-619e-40b9-89bd-44842b767bbe tempest-ProjectMemberTests-1353074417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (796fe2f9-c8e0-477f-b2e6-8e8096e3af49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:53:13 devstack sudo[111913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-2fdaf9a5-33fc-44d4-8945-b87a69a6577f Aug 03 08:53:13 devstack sudo[111913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:53:13 devstack cinder-volume[88899]: INFO cinder.volume.flows.manager.create_volume [None req-a5ab125b-619e-40b9-89bd-44842b767bbe tempest-ProjectMemberTests-1353074417 None] Volume volume-90e29bc4-3f11-4cbb-89c9-2b08888e5edb (90e29bc4-3f11-4cbb-89c9-2b08888e5edb): created successfully Aug 03 08:53:13 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-a5ab125b-619e-40b9-89bd-44842b767bbe tempest-ProjectMemberTests-1353074417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (796fe2f9-c8e0-477f-b2e6-8e8096e3af49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:53:13 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-a5ab125b-619e-40b9-89bd-44842b767bbe tempest-ProjectMemberTests-1353074417 None] Flow 'volume_create_manager' (f6fb4806-aa9b-451c-a61f-b62f7386c1d8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:53:13 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-a5ab125b-619e-40b9-89bd-44842b767bbe tempest-ProjectMemberTests-1353074417 None] Created volume successfully. Aug 03 08:53:13 devstack sudo[111913]: pam_unix(sudo:session): session closed for user root Aug 03 08:53:13 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-2bd18391-a3ce-419a-844e-d9b6f85ae2a0 tempest-CreateVolumesFromImageTest-934288853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-2fdaf9a5-33fc-44d4-8945-b87a69a6577f" returned: 0 in 0.273s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:53:13 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-2bd18391-a3ce-419a-844e-d9b6f85ae2a0 tempest-CreateVolumesFromImageTest-934288853 None] Lock "cinder-quobyte-2fdaf9a5-33fc-44d4-8945-b87a69a6577f" released by "delete_volume" :: held 0.731s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:53:13 devstack cinder-volume[88899]: DEBUG cinder.quota [None req-2bd18391-a3ce-419a-844e-d9b6f85ae2a0 tempest-CreateVolumesFromImageTest-934288853 None] Created reservations ['73ff9615-fe34-4ec4-90dc-d8a1ed35109c', '7427c72a-86de-47cb-a914-f9efb533ab3e', '0a2e2266-e2c2-4102-893c-7cc6f7fc6892', '6d3f3285-1348-43c9-aded-450c44949cbc'] {{(pid=88899) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 08:53:13 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-2bd18391-a3ce-419a-844e-d9b6f85ae2a0 tempest-CreateVolumesFromImageTest-934288853 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:53:13 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-2bd18391-a3ce-419a-844e-d9b6f85ae2a0 tempest-CreateVolumesFromImageTest-934288853 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:53:13 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-2bd18391-a3ce-419a-844e-d9b6f85ae2a0 tempest-CreateVolumesFromImageTest-934288853 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:53:13 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-2bd18391-a3ce-419a-844e-d9b6f85ae2a0 tempest-CreateVolumesFromImageTest-934288853 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:53:13 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-2bd18391-a3ce-419a-844e-d9b6f85ae2a0 tempest-CreateVolumesFromImageTest-934288853 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:53:13 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-2bd18391-a3ce-419a-844e-d9b6f85ae2a0 tempest-CreateVolumesFromImageTest-934288853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:53:13 devstack sudo[111911]: pam_unix(sudo:session): session closed for user root Aug 03 08:53:13 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-1e3a4496-9de3-453d-b577-c14140128ce6 tempest-VolumeAndVolumeTypeFromImageTest-731356096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-b92ad942-1638-4aa8-9d9a-4836fa5fa48c 1073741824" returned: 0 in 0.479s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:53:13 devstack sudo[111921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a Aug 03 08:53:13 devstack sudo[111921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:53:13 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-1e3a4496-9de3-453d-b577-c14140128ce6 tempest-VolumeAndVolumeTypeFromImageTest-731356096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-b92ad942-1638-4aa8-9d9a-4836fa5fa48c {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:53:13 devstack sudo[111923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-b92ad942-1638-4aa8-9d9a-4836fa5fa48c Aug 03 08:53:13 devstack sudo[111923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:53:13 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-92642ff9-9cc5-4e89-9bab-b6855d956da2 tempest-CreateVolumesFromImageTest-934288853 None] Acquiring lock "cinder-36438ac9-8a0c-4b65-82be-20e579348379-delete_volume" by "delete_volume" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:53:13 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-92642ff9-9cc5-4e89-9bab-b6855d956da2 tempest-CreateVolumesFromImageTest-934288853 None] Lock "cinder-36438ac9-8a0c-4b65-82be-20e579348379-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:53:14 devstack sudo[111921]: pam_unix(sudo:session): session closed for user root Aug 03 08:53:14 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-2bd18391-a3ce-419a-844e-d9b6f85ae2a0 tempest-CreateVolumesFromImageTest-934288853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a" returned: 0 in 0.396s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:53:14 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-92642ff9-9cc5-4e89-9bab-b6855d956da2 tempest-CreateVolumesFromImageTest-934288853 None] Acquiring lock "cinder-quobyte-36438ac9-8a0c-4b65-82be-20e579348379" by "delete_volume" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:53:14 devstack cinder-volume[88899]: DEBUG cinder.manager [None req-2bd18391-a3ce-419a-844e-d9b6f85ae2a0 tempest-CreateVolumesFromImageTest-934288853 None] Notifying Schedulers of capabilities ... {{(pid=88899) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 08:53:14 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-2bd18391-a3ce-419a-844e-d9b6f85ae2a0 tempest-CreateVolumesFromImageTest-934288853 None] Deleted volume successfully. Aug 03 08:53:14 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-92642ff9-9cc5-4e89-9bab-b6855d956da2 tempest-CreateVolumesFromImageTest-934288853 None] Lock "cinder-quobyte-36438ac9-8a0c-4b65-82be-20e579348379" acquired by "delete_volume" :: waited 0.029s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:53:14 devstack cinder-volume[88899]: DEBUG cinder.volume.flows.manager.create_volume [None req-24251bcd-a0fa-4c39-ad4c-c4da89cc0909 tempest-VolumeDependencyTests-1512358985 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88899) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 08:53:14 devstack sudo[111923]: pam_unix(sudo:session): session closed for user root Aug 03 08:53:14 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b105c43-40ce-4b97-af87-a97d69eb5b98]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:53:14 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-2bd18391-a3ce-419a-844e-d9b6f85ae2a0 tempest-CreateVolumesFromImageTest-934288853 None] Lock "cinder-2fdaf9a5-33fc-44d4-8945-b87a69a6577f-delete_volume" released by "delete_volume" :: held 1.429s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:53:14 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-92642ff9-9cc5-4e89-9bab-b6855d956da2 tempest-CreateVolumesFromImageTest-934288853 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-36438ac9-8a0c-4b65-82be-20e579348379 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:53:14 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-1e3a4496-9de3-453d-b577-c14140128ce6 tempest-VolumeAndVolumeTypeFromImageTest-731356096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-b92ad942-1638-4aa8-9d9a-4836fa5fa48c" returned: 0 in 0.422s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:53:14 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-1e3a4496-9de3-453d-b577-c14140128ce6 tempest-VolumeAndVolumeTypeFromImageTest-731356096 None] <== create_volume: return (961ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'} {{(pid=88899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 08:53:14 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-1e3a4496-9de3-453d-b577-c14140128ce6 tempest-VolumeAndVolumeTypeFromImageTest-731356096 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.967s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:53:14 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-24251bcd-a0fa-4c39-ad4c-c4da89cc0909 tempest-VolumeDependencyTests-1512358985 None] Flow 'volume_create_manager' (5fb4ea91-b8d7-4cc2-9b2a-f1a2f9de19a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:53:14 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-24251bcd-a0fa-4c39-ad4c-c4da89cc0909 tempest-VolumeDependencyTests-1512358985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (943b2f4f-ec04-4382-b61b-1b46844f70f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:53:14 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-24251bcd-a0fa-4c39-ad4c-c4da89cc0909 tempest-VolumeDependencyTests-1512358985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (943b2f4f-ec04-4382-b61b-1b46844f70f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:53:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1520456704',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b1ea719-0de3-48d6-ab8a-b62a8b3ce570,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d30b387eb9b94bb589dfe04f0d2eac6d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:53:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=7a40132f-52ed-4711-ba9b-088821b45487,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:53:14Z,use_quota=True,user_id='12ab9b4d5d894d608b06e312639537e8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8bde7129-1dc4-42ab-b852-ab32c61b4921),volume_type_id=8bde7129-1dc4-42ab-b852-ab32c61b4921)' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:53:14 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-24251bcd-a0fa-4c39-ad4c-c4da89cc0909 tempest-VolumeDependencyTests-1512358985 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a1c7e76-04ef-41ef-b567-a048ae01e650) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:53:14 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-24251bcd-a0fa-4c39-ad4c-c4da89cc0909 tempest-VolumeDependencyTests-1512358985 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a1c7e76-04ef-41ef-b567-a048ae01e650) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:53:14 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-24251bcd-a0fa-4c39-ad4c-c4da89cc0909 tempest-VolumeDependencyTests-1512358985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f9f1dab0-f217-452c-8bf7-898b1ad192e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:53:14 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-24251bcd-a0fa-4c39-ad4c-c4da89cc0909 tempest-VolumeDependencyTests-1512358985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f9f1dab0-f217-452c-8bf7-898b1ad192e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '1b1ea719-0de3-48d6-ab8a-b62a8b3ce570', 'volume_name': 'volume-1b1ea719-0de3-48d6-ab8a-b62a8b3ce570', 'volume_size': 1, 'snapshot_id': '7a40132f-52ed-4711-ba9b-088821b45487'}' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:53:14 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-24251bcd-a0fa-4c39-ad4c-c4da89cc0909 tempest-VolumeDependencyTests-1512358985 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e4727526-5c7e-4a54-9f75-7176640d4836) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:53:14 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-24251bcd-a0fa-4c39-ad4c-c4da89cc0909 tempest-VolumeDependencyTests-1512358985 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e4727526-5c7e-4a54-9f75-7176640d4836) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:53:14 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-24251bcd-a0fa-4c39-ad4c-c4da89cc0909 tempest-VolumeDependencyTests-1512358985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3706b097-0d59-4b7c-b7b7-2dccc352d632) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:53:14 devstack cinder-volume[88899]: INFO cinder.volume.flows.manager.create_volume [None req-24251bcd-a0fa-4c39-ad4c-c4da89cc0909 tempest-VolumeDependencyTests-1512358985 None] Volume 1b1ea719-0de3-48d6-ab8a-b62a8b3ce570: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-1b1ea719-0de3-48d6-ab8a-b62a8b3ce570', 'volume_size': 1, 'snapshot_id': '7a40132f-52ed-4711-ba9b-088821b45487'} Aug 03 08:53:14 devstack cinder-volume[88899]: DEBUG cinder.volume.volume_utils [None req-1e3a4496-9de3-453d-b577-c14140128ce6 tempest-VolumeAndVolumeTypeFromImageTest-731356096 None] Attempting download of a1efef6b-1cb4-4fac-b1bf-82f7347a3d14 ((None, [{'url': 'file:///opt/stack/data/glance/images/a1efef6b-1cb4-4fac-b1bf-82f7347a3d14', 'metadata': {}}])) to volume b92ad942-1638-4aa8-9d9a-4836fa5fa48c. {{(pid=88899) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Aug 03 08:53:14 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-24251bcd-a0fa-4c39-ad4c-c4da89cc0909 tempest-VolumeDependencyTests-1512358985 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:53:14 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-24251bcd-a0fa-4c39-ad4c-c4da89cc0909 tempest-VolumeDependencyTests-1512358985 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:53:14 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-24251bcd-a0fa-4c39-ad4c-c4da89cc0909 tempest-VolumeDependencyTests-1512358985 None] Acquiring lock "cinder-quobyte-7a40132f-52ed-4711-ba9b-088821b45487-1b1ea719-0de3-48d6-ab8a-b62a8b3ce570" by "_create_volume_from_snapshot" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:53:14 devstack sudo[111927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-36438ac9-8a0c-4b65-82be-20e579348379 Aug 03 08:53:14 devstack sudo[111927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:53:14 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-24251bcd-a0fa-4c39-ad4c-c4da89cc0909 tempest-VolumeDependencyTests-1512358985 None] Lock "cinder-quobyte-7a40132f-52ed-4711-ba9b-088821b45487-1b1ea719-0de3-48d6-ab8a-b62a8b3ce570" acquired by "_create_volume_from_snapshot" :: waited 0.031s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:53:14 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-24251bcd-a0fa-4c39-ad4c-c4da89cc0909 tempest-VolumeDependencyTests-1512358985 None] Creating volume 1b1ea719-0de3-48d6-ab8a-b62a8b3ce570 from snapshot 7a40132f-52ed-4711-ba9b-088821b45487 {{(pid=88899) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Aug 03 08:53:14 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-24251bcd-a0fa-4c39-ad4c-c4da89cc0909 tempest-VolumeDependencyTests-1512358985 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:53:14 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-24251bcd-a0fa-4c39-ad4c-c4da89cc0909 tempest-VolumeDependencyTests-1512358985 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:53:14 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-24251bcd-a0fa-4c39-ad4c-c4da89cc0909 tempest-VolumeDependencyTests-1512358985 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:53:14 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-24251bcd-a0fa-4c39-ad4c-c4da89cc0909 tempest-VolumeDependencyTests-1512358985 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:53:14 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-24251bcd-a0fa-4c39-ad4c-c4da89cc0909 tempest-VolumeDependencyTests-1512358985 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:53:14 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-24251bcd-a0fa-4c39-ad4c-c4da89cc0909 tempest-VolumeDependencyTests-1512358985 None] Selected osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385 as target Quobyte volume. {{(pid=88899) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 08:53:14 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-24251bcd-a0fa-4c39-ad4c-c4da89cc0909 tempest-VolumeDependencyTests-1512358985 None] Acquiring lock "cinder-quobyte-1b1ea719-0de3-48d6-ab8a-b62a8b3ce570" by "_copy_volume_from_snapshot" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:53:14 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-24251bcd-a0fa-4c39-ad4c-c4da89cc0909 tempest-VolumeDependencyTests-1512358985 None] Lock "cinder-quobyte-1b1ea719-0de3-48d6-ab8a-b62a8b3ce570" acquired by "_copy_volume_from_snapshot" :: waited 0.028s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:53:14 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-24251bcd-a0fa-4c39-ad4c-c4da89cc0909 tempest-VolumeDependencyTests-1512358985 None] snapshot: 7a40132f-52ed-4711-ba9b-088821b45487, volume: 1b1ea719-0de3-48d6-ab8a-b62a8b3ce570, {{(pid=88899) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Aug 03 08:53:14 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ca180f2-305c-4918-ba23-2aa084be899d]: (4, 'raw') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:53:14 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-1e3a4496-9de3-453d-b577-c14140128ce6 tempest-VolumeAndVolumeTypeFromImageTest-731356096 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a1efef6b-1cb4-4fac-b1bf-82f7347a3d14_40t88xka {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:53:14 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-24251bcd-a0fa-4c39-ad4c-c4da89cc0909 tempest-VolumeDependencyTests-1512358985 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:53:14 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-24251bcd-a0fa-4c39-ad4c-c4da89cc0909 tempest-VolumeDependencyTests-1512358985 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:53:14 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-24251bcd-a0fa-4c39-ad4c-c4da89cc0909 tempest-VolumeDependencyTests-1512358985 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:53:14 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-24251bcd-a0fa-4c39-ad4c-c4da89cc0909 tempest-VolumeDependencyTests-1512358985 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:53:14 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-24251bcd-a0fa-4c39-ad4c-c4da89cc0909 tempest-VolumeDependencyTests-1512358985 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:53:14 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-8899fb14-2cab-4701-abeb-f76179c17a89 tempest-ProjectMemberTests-1353074417 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:53:14 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb22b05e-7951-4e76-9936-45f9080dea50]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:53:14 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-24251bcd-a0fa-4c39-ad4c-c4da89cc0909 tempest-VolumeDependencyTests-1512358985 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-7a8ead30-8de5-46a9-a84e-9425b673c7c3.7a40132f-52ed-4711-ba9b-088821b45487 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:53:14 devstack sudo[111929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a1efef6b-1cb4-4fac-b1bf-82f7347a3d14_40t88xka Aug 03 08:53:14 devstack sudo[111929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:53:14 devstack sudo[111930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-7a8ead30-8de5-46a9-a84e-9425b673c7c3.7a40132f-52ed-4711-ba9b-088821b45487 Aug 03 08:53:14 devstack sudo[111930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:53:14 devstack sudo[111927]: pam_unix(sudo:session): session closed for user root Aug 03 08:53:14 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-92642ff9-9cc5-4e89-9bab-b6855d956da2 tempest-CreateVolumesFromImageTest-934288853 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-36438ac9-8a0c-4b65-82be-20e579348379" returned: 0 in 0.428s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:53:14 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-92642ff9-9cc5-4e89-9bab-b6855d956da2 tempest-CreateVolumesFromImageTest-934288853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-36438ac9-8a0c-4b65-82be-20e579348379 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:53:14 devstack sudo[111937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-36438ac9-8a0c-4b65-82be-20e579348379 Aug 03 08:53:14 devstack sudo[111937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:53:14 devstack sudo[111929]: pam_unix(sudo:session): session closed for user root Aug 03 08:53:14 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-1e3a4496-9de3-453d-b577-c14140128ce6 tempest-VolumeAndVolumeTypeFromImageTest-731356096 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a1efef6b-1cb4-4fac-b1bf-82f7347a3d14_40t88xka" returned: 0 in 0.332s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:53:14 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-1e3a4496-9de3-453d-b577-c14140128ce6 tempest-VolumeAndVolumeTypeFromImageTest-731356096 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a1efef6b-1cb4-4fac-b1bf-82f7347a3d14_40t88xka {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:53:14 devstack sudo[111941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a1efef6b-1cb4-4fac-b1bf-82f7347a3d14_40t88xka Aug 03 08:53:14 devstack sudo[111941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:53:14 devstack sudo[111930]: pam_unix(sudo:session): session closed for user root Aug 03 08:53:14 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-24251bcd-a0fa-4c39-ad4c-c4da89cc0909 tempest-VolumeDependencyTests-1512358985 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-7a8ead30-8de5-46a9-a84e-9425b673c7c3.7a40132f-52ed-4711-ba9b-088821b45487" returned: 0 in 0.378s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:53:14 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-24251bcd-a0fa-4c39-ad4c-c4da89cc0909 tempest-VolumeDependencyTests-1512358985 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7a8ead30-8de5-46a9-a84e-9425b673c7c3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88899) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 03 08:53:14 devstack sudo[111937]: pam_unix(sudo:session): session closed for user root Aug 03 08:53:14 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-92642ff9-9cc5-4e89-9bab-b6855d956da2 tempest-CreateVolumesFromImageTest-934288853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-36438ac9-8a0c-4b65-82be-20e579348379" returned: 0 in 0.246s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:53:14 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6f71dfd-857f-42cb-98a3-c34f7ec9f00f]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:53:14 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-24251bcd-a0fa-4c39-ad4c-c4da89cc0909 tempest-VolumeDependencyTests-1512358985 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-7a8ead30-8de5-46a9-a84e-9425b673c7c3 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:53:14 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-92642ff9-9cc5-4e89-9bab-b6855d956da2 tempest-CreateVolumesFromImageTest-934288853 None] Lock "cinder-quobyte-36438ac9-8a0c-4b65-82be-20e579348379" released by "delete_volume" :: held 0.746s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:53:14 devstack cinder-volume[88899]: DEBUG cinder.quota [None req-92642ff9-9cc5-4e89-9bab-b6855d956da2 tempest-CreateVolumesFromImageTest-934288853 None] Created reservations ['05decdb9-9fb2-4931-acd7-8e1b796fd730', 'ad7f862e-227f-424a-ba2c-030c122269f0', 'c37c20c7-defa-4574-903a-d1631ca59a8d', '1ed1b5a0-6f7a-4f1c-8dff-d9594a921a67'] {{(pid=88899) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 08:53:14 devstack sudo[111948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-7a8ead30-8de5-46a9-a84e-9425b673c7c3 Aug 03 08:53:14 devstack sudo[111948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:53:14 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-92642ff9-9cc5-4e89-9bab-b6855d956da2 tempest-CreateVolumesFromImageTest-934288853 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:53:14 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-92642ff9-9cc5-4e89-9bab-b6855d956da2 tempest-CreateVolumesFromImageTest-934288853 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:53:14 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-92642ff9-9cc5-4e89-9bab-b6855d956da2 tempest-CreateVolumesFromImageTest-934288853 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:53:14 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-92642ff9-9cc5-4e89-9bab-b6855d956da2 tempest-CreateVolumesFromImageTest-934288853 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:53:14 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-92642ff9-9cc5-4e89-9bab-b6855d956da2 tempest-CreateVolumesFromImageTest-934288853 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:53:14 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-92642ff9-9cc5-4e89-9bab-b6855d956da2 tempest-CreateVolumesFromImageTest-934288853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:53:15 devstack sudo[111941]: pam_unix(sudo:session): session closed for user root Aug 03 08:53:15 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-1e3a4496-9de3-453d-b577-c14140128ce6 tempest-VolumeAndVolumeTypeFromImageTest-731356096 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a1efef6b-1cb4-4fac-b1bf-82f7347a3d14_40t88xka" returned: 1 in 0.341s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:53:15 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-1e3a4496-9de3-453d-b577-c14140128ce6 tempest-VolumeAndVolumeTypeFromImageTest-731356096 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a1efef6b-1cb4-4fac-b1bf-82f7347a3d14_40t88xka' failed. Not Retrying. {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 03 08:53:15 devstack sudo[111952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a Aug 03 08:53:15 devstack sudo[111952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:53:15 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[049befd3-45dc-4ca0-be60-10e5cccd5f5f]: (4, 'raw') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:53:15 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-1e3a4496-9de3-453d-b577-c14140128ce6 tempest-VolumeAndVolumeTypeFromImageTest-731356096 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a1efef6b-1cb4-4fac-b1bf-82f7347a3d14_qw_x4aksdevstack@QuobyteHD {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:53:15 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-6610df76-08e8-49e9-8e9f-8983e7b3bc97 tempest-CreateVolumesFromImageTest-934288853 None] Acquiring lock "cinder-a2aabb09-c00f-4251-bb2a-1dbc840f9022-delete_volume" by "delete_volume" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:53:15 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-6610df76-08e8-49e9-8e9f-8983e7b3bc97 tempest-CreateVolumesFromImageTest-934288853 None] Lock "cinder-a2aabb09-c00f-4251-bb2a-1dbc840f9022-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:53:15 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-6610df76-08e8-49e9-8e9f-8983e7b3bc97 tempest-CreateVolumesFromImageTest-934288853 None] Acquiring lock "cinder-quobyte-a2aabb09-c00f-4251-bb2a-1dbc840f9022" by "delete_volume" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:53:15 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-6610df76-08e8-49e9-8e9f-8983e7b3bc97 tempest-CreateVolumesFromImageTest-934288853 None] Lock "cinder-quobyte-a2aabb09-c00f-4251-bb2a-1dbc840f9022" acquired by "delete_volume" :: waited 0.016s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:53:15 devstack sudo[111954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a1efef6b-1cb4-4fac-b1bf-82f7347a3d14_qw_x4aksdevstack@QuobyteHD Aug 03 08:53:15 devstack sudo[111954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:53:15 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[e22db5f1-2789-4f2d-91ed-b34a46f384e9]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:53:15 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-6610df76-08e8-49e9-8e9f-8983e7b3bc97 tempest-CreateVolumesFromImageTest-934288853 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-a2aabb09-c00f-4251-bb2a-1dbc840f9022 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:53:15 devstack sudo[111948]: pam_unix(sudo:session): session closed for user root Aug 03 08:53:15 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-24251bcd-a0fa-4c39-ad4c-c4da89cc0909 tempest-VolumeDependencyTests-1512358985 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-7a8ead30-8de5-46a9-a84e-9425b673c7c3" returned: 0 in 0.473s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:53:15 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-24251bcd-a0fa-4c39-ad4c-c4da89cc0909 tempest-VolumeDependencyTests-1512358985 None] will copy from snapshot at /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-7a8ead30-8de5-46a9-a84e-9425b673c7c3 {{(pid=88899) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Aug 03 08:53:15 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-24251bcd-a0fa-4c39-ad4c-c4da89cc0909 tempest-VolumeDependencyTests-1512358985 None] Creating direct copy from snapshot {{(pid=88899) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Aug 03 08:53:15 devstack cinder-volume[88899]: DEBUG cinder.utils [None req-24251bcd-a0fa-4c39-ad4c-c4da89cc0909 tempest-VolumeDependencyTests-1512358985 None] Path /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-1b1ea719-0de3-48d6-ab8a-b62a8b3ce570 not found in is_blk_device check {{(pid=88899) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Aug 03 08:53:15 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-24251bcd-a0fa-4c39-ad4c-c4da89cc0909 tempest-VolumeDependencyTests-1512358985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-7a8ead30-8de5-46a9-a84e-9425b673c7c3 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-1b1ea719-0de3-48d6-ab8a-b62a8b3ce570 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:53:15 devstack sudo[111962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-7a8ead30-8de5-46a9-a84e-9425b673c7c3 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-1b1ea719-0de3-48d6-ab8a-b62a8b3ce570 Aug 03 08:53:15 devstack sudo[111962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:53:15 devstack sudo[111952]: pam_unix(sudo:session): session closed for user root Aug 03 08:53:15 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-92642ff9-9cc5-4e89-9bab-b6855d956da2 tempest-CreateVolumesFromImageTest-934288853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a" returned: 0 in 0.370s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:53:15 devstack cinder-volume[88899]: DEBUG cinder.manager [None req-92642ff9-9cc5-4e89-9bab-b6855d956da2 tempest-CreateVolumesFromImageTest-934288853 None] Notifying Schedulers of capabilities ... {{(pid=88899) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 08:53:15 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-92642ff9-9cc5-4e89-9bab-b6855d956da2 tempest-CreateVolumesFromImageTest-934288853 None] Deleted volume successfully. Aug 03 08:53:15 devstack sudo[111960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-a2aabb09-c00f-4251-bb2a-1dbc840f9022 Aug 03 08:53:15 devstack sudo[111960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:53:15 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-92642ff9-9cc5-4e89-9bab-b6855d956da2 tempest-CreateVolumesFromImageTest-934288853 None] Lock "cinder-36438ac9-8a0c-4b65-82be-20e579348379-delete_volume" released by "delete_volume" :: held 1.452s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:53:15 devstack sudo[111954]: pam_unix(sudo:session): session closed for user root Aug 03 08:53:15 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-1e3a4496-9de3-453d-b577-c14140128ce6 tempest-VolumeAndVolumeTypeFromImageTest-731356096 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a1efef6b-1cb4-4fac-b1bf-82f7347a3d14_qw_x4aksdevstack@QuobyteHD" returned: 0 in 0.457s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:53:15 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-1e3a4496-9de3-453d-b577-c14140128ce6 tempest-VolumeAndVolumeTypeFromImageTest-731356096 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a1efef6b-1cb4-4fac-b1bf-82f7347a3d14_qw_x4aksdevstack@QuobyteHD {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:53:15 devstack sudo[111967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a1efef6b-1cb4-4fac-b1bf-82f7347a3d14_qw_x4aksdevstack@QuobyteHD Aug 03 08:53:15 devstack sudo[111967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:53:15 devstack sudo[111960]: pam_unix(sudo:session): session closed for user root Aug 03 08:53:15 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-6610df76-08e8-49e9-8e9f-8983e7b3bc97 tempest-CreateVolumesFromImageTest-934288853 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-a2aabb09-c00f-4251-bb2a-1dbc840f9022" returned: 0 in 0.399s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:53:15 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-6610df76-08e8-49e9-8e9f-8983e7b3bc97 tempest-CreateVolumesFromImageTest-934288853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-a2aabb09-c00f-4251-bb2a-1dbc840f9022 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:53:15 devstack sudo[111975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-a2aabb09-c00f-4251-bb2a-1dbc840f9022 Aug 03 08:53:15 devstack sudo[111975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:53:15 devstack sudo[111967]: pam_unix(sudo:session): session closed for user root Aug 03 08:53:15 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-1e3a4496-9de3-453d-b577-c14140128ce6 tempest-VolumeAndVolumeTypeFromImageTest-731356096 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a1efef6b-1cb4-4fac-b1bf-82f7347a3d14_qw_x4aksdevstack@QuobyteHD" returned: 1 in 0.425s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:53:15 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-1e3a4496-9de3-453d-b577-c14140128ce6 tempest-VolumeAndVolumeTypeFromImageTest-731356096 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a1efef6b-1cb4-4fac-b1bf-82f7347a3d14_qw_x4aksdevstack@QuobyteHD' failed. Not Retrying. {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 03 08:53:15 devstack cinder-volume[88899]: DEBUG cinder.image.image_utils [None req-1e3a4496-9de3-453d-b577-c14140128ce6 tempest-VolumeAndVolumeTypeFromImageTest-731356096 None] a1efef6b-1cb4-4fac-b1bf-82f7347a3d14 was raw, converting to qcow2 {{(pid=88899) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Aug 03 08:53:15 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-1e3a4496-9de3-453d-b577-c14140128ce6 tempest-VolumeAndVolumeTypeFromImageTest-731356096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_a1efef6b-1cb4-4fac-b1bf-82f7347a3d14_qw_x4aksdevstack@QuobyteHD /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-b92ad942-1638-4aa8-9d9a-4836fa5fa48c {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:53:15 devstack sudo[111975]: pam_unix(sudo:session): session closed for user root Aug 03 08:53:15 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-6610df76-08e8-49e9-8e9f-8983e7b3bc97 tempest-CreateVolumesFromImageTest-934288853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-a2aabb09-c00f-4251-bb2a-1dbc840f9022" returned: 0 in 0.348s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:53:16 devstack sudo[111988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_a1efef6b-1cb4-4fac-b1bf-82f7347a3d14_qw_x4aksdevstack@QuobyteHD /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-b92ad942-1638-4aa8-9d9a-4836fa5fa48c Aug 03 08:53:16 devstack sudo[111988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:53:16 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-6610df76-08e8-49e9-8e9f-8983e7b3bc97 tempest-CreateVolumesFromImageTest-934288853 None] Lock "cinder-quobyte-a2aabb09-c00f-4251-bb2a-1dbc840f9022" released by "delete_volume" :: held 0.816s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:53:16 devstack cinder-volume[88899]: DEBUG cinder.quota [None req-6610df76-08e8-49e9-8e9f-8983e7b3bc97 tempest-CreateVolumesFromImageTest-934288853 None] Created reservations ['0ad76ccc-0ec9-4a23-8de1-d2ef57bcb1de', '70c7680b-840a-4c43-8f39-80c4b1c946dd', '91c7e44b-4fa3-4e3c-b366-d71ee6fd1751', '69c343ad-719e-412e-a71a-13b84382f857'] {{(pid=88899) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 08:53:16 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-6610df76-08e8-49e9-8e9f-8983e7b3bc97 tempest-CreateVolumesFromImageTest-934288853 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:53:16 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-6610df76-08e8-49e9-8e9f-8983e7b3bc97 tempest-CreateVolumesFromImageTest-934288853 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:53:16 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-6610df76-08e8-49e9-8e9f-8983e7b3bc97 tempest-CreateVolumesFromImageTest-934288853 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:53:16 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-6610df76-08e8-49e9-8e9f-8983e7b3bc97 tempest-CreateVolumesFromImageTest-934288853 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:53:16 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-6610df76-08e8-49e9-8e9f-8983e7b3bc97 tempest-CreateVolumesFromImageTest-934288853 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:53:16 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-6610df76-08e8-49e9-8e9f-8983e7b3bc97 tempest-CreateVolumesFromImageTest-934288853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:53:16 devstack sudo[111991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a Aug 03 08:53:16 devstack sudo[111991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:53:17 devstack sudo[111991]: pam_unix(sudo:session): session closed for user root Aug 03 08:53:17 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-6610df76-08e8-49e9-8e9f-8983e7b3bc97 tempest-CreateVolumesFromImageTest-934288853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a" returned: 0 in 0.662s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:53:17 devstack cinder-volume[88899]: DEBUG cinder.manager [None req-6610df76-08e8-49e9-8e9f-8983e7b3bc97 tempest-CreateVolumesFromImageTest-934288853 None] Notifying Schedulers of capabilities ... {{(pid=88899) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 08:53:17 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-6610df76-08e8-49e9-8e9f-8983e7b3bc97 tempest-CreateVolumesFromImageTest-934288853 None] Deleted volume successfully. Aug 03 08:53:17 devstack sudo[111988]: pam_unix(sudo:session): session closed for user root Aug 03 08:53:17 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-1e3a4496-9de3-453d-b577-c14140128ce6 tempest-VolumeAndVolumeTypeFromImageTest-731356096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_a1efef6b-1cb4-4fac-b1bf-82f7347a3d14_qw_x4aksdevstack@QuobyteHD /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-b92ad942-1638-4aa8-9d9a-4836fa5fa48c" returned: 0 in 1.188s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:53:17 devstack cinder-volume[88899]: DEBUG cinder.image.image_utils [None req-1e3a4496-9de3-453d-b577-c14140128ce6 tempest-VolumeAndVolumeTypeFromImageTest-731356096 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_a1efef6b-1cb4-4fac-b1bf-82f7347a3d14_qw_x4aksdevstack@QuobyteHD, size 0.00 MB, duration 1.19 sec, destination /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-b92ad942-1638-4aa8-9d9a-4836fa5fa48c {{(pid=88899) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 03 08:53:17 devstack cinder-volume[88899]: INFO cinder.image.image_utils [None req-1e3a4496-9de3-453d-b577-c14140128ce6 tempest-VolumeAndVolumeTypeFromImageTest-731356096 None] Converted 0.00 MB image at 0.00 MB/s Aug 03 08:53:17 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-1e3a4496-9de3-453d-b577-c14140128ce6 tempest-VolumeAndVolumeTypeFromImageTest-731356096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-b92ad942-1638-4aa8-9d9a-4836fa5fa48c 1G {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:53:17 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-6610df76-08e8-49e9-8e9f-8983e7b3bc97 tempest-CreateVolumesFromImageTest-934288853 None] Lock "cinder-a2aabb09-c00f-4251-bb2a-1dbc840f9022-delete_volume" released by "delete_volume" :: held 2.027s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:53:17 devstack sudo[111997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-b92ad942-1638-4aa8-9d9a-4836fa5fa48c 1G Aug 03 08:53:17 devstack sudo[111997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:53:17 devstack sudo[111997]: pam_unix(sudo:session): session closed for user root Aug 03 08:53:17 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-1e3a4496-9de3-453d-b577-c14140128ce6 tempest-VolumeAndVolumeTypeFromImageTest-731356096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-b92ad942-1638-4aa8-9d9a-4836fa5fa48c 1G" returned: 0 in 0.695s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:53:17 devstack cinder-volume[88899]: DEBUG cinder.volume.volume_utils [None req-1e3a4496-9de3-453d-b577-c14140128ce6 tempest-VolumeAndVolumeTypeFromImageTest-731356096 None] Downloaded image a1efef6b-1cb4-4fac-b1bf-82f7347a3d14 ((None, [{'url': 'file:///opt/stack/data/glance/images/a1efef6b-1cb4-4fac-b1bf-82f7347a3d14', 'metadata': {}}])) to volume b92ad942-1638-4aa8-9d9a-4836fa5fa48c successfully. {{(pid=88899) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Aug 03 08:53:17 devstack cinder-volume[88899]: DEBUG cinder.image.image_utils [None req-1e3a4496-9de3-453d-b577-c14140128ce6 tempest-VolumeAndVolumeTypeFromImageTest-731356096 None] Temporary image a1efef6b-1cb4-4fac-b1bf-82f7347a3d14 for user d4ef2dd90b55416596bed2b264da298a is deleted. {{(pid=88899) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Aug 03 08:53:17 devstack cinder-volume[88899]: DEBUG cinder.volume.volume_utils [None req-1e3a4496-9de3-453d-b577-c14140128ce6 tempest-VolumeAndVolumeTypeFromImageTest-731356096 None] Marking volume b92ad942-1638-4aa8-9d9a-4836fa5fa48c as bootable. {{(pid=88899) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Aug 03 08:53:17 devstack cinder-volume[88899]: DEBUG cinder.volume.flows.manager.create_volume [None req-1e3a4496-9de3-453d-b577-c14140128ce6 tempest-VolumeAndVolumeTypeFromImageTest-731356096 None] Copying metadata from image a1efef6b-1cb4-4fac-b1bf-82f7347a3d14 to b92ad942-1638-4aa8-9d9a-4836fa5fa48c. {{(pid=88899) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Aug 03 08:53:17 devstack cinder-volume[88899]: DEBUG cinder.volume.flows.manager.create_volume [None req-1e3a4496-9de3-453d-b577-c14140128ce6 tempest-VolumeAndVolumeTypeFromImageTest-731356096 None] Creating volume glance metadata for volume b92ad942-1638-4aa8-9d9a-4836fa5fa48c backed by image a1efef6b-1cb4-4fac-b1bf-82f7347a3d14 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': 'a1efef6b-1cb4-4fac-b1bf-82f7347a3d14', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': 'd66629d33443417f92158deb3ce3c836', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=88899) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Aug 03 08:53:18 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-1e3a4496-9de3-453d-b577-c14140128ce6 tempest-VolumeAndVolumeTypeFromImageTest-731356096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ac9ed14-84ce-4868-a780-122e9c441ec5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b92ad942-1638-4aa8-9d9a-4836fa5fa48c', 'volume_size': 1, 'image_id': 'a1efef6b-1cb4-4fac-b1bf-82f7347a3d14', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a1efef6b-1cb4-4fac-b1bf-82f7347a3d14', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'd66629d33443417f92158deb3ce3c836', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'a89e44985d894db19945ef19281547cc', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'b0cb8ceedc02d657af9f84dfd010dbe22c1b9227c70fa63d30573a504027d0018a8febee7daa594df55b4cc3d510c82ccd2f1bf24af025f14a523d08e1e3356f', 'id': 'a1efef6b-1cb4-4fac-b1bf-82f7347a3d14', 'created_at': datetime.datetime(2026, 8, 3, 6, 53, 6, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 3, 6, 53, 8, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a1efef6b-1cb4-4fac-b1bf-82f7347a3d14/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:53:18 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-1e3a4496-9de3-453d-b577-c14140128ce6 tempest-VolumeAndVolumeTypeFromImageTest-731356096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5af8d4fd-42c2-42e5-bab9-39bce8a2a745) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:53:18 devstack cinder-volume[88899]: INFO cinder.volume.flows.manager.create_volume [None req-1e3a4496-9de3-453d-b577-c14140128ce6 tempest-VolumeAndVolumeTypeFromImageTest-731356096 None] Volume volume-b92ad942-1638-4aa8-9d9a-4836fa5fa48c (b92ad942-1638-4aa8-9d9a-4836fa5fa48c): created successfully Aug 03 08:53:18 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-1e3a4496-9de3-453d-b577-c14140128ce6 tempest-VolumeAndVolumeTypeFromImageTest-731356096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5af8d4fd-42c2-42e5-bab9-39bce8a2a745) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:53:18 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-1e3a4496-9de3-453d-b577-c14140128ce6 tempest-VolumeAndVolumeTypeFromImageTest-731356096 None] Flow 'volume_create_manager' (d1ccfa11-b81f-4a79-bfda-a8ddedc31208) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:53:18 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-1e3a4496-9de3-453d-b577-c14140128ce6 tempest-VolumeAndVolumeTypeFromImageTest-731356096 None] Created volume successfully. Aug 03 08:53:18 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-d735845e-911a-4850-ad4b-7d5b3e78bf43 tempest-VolumeAndVolumeTypeFromImageTest-731356096 None] Acquiring lock "cinder-b92ad942-1638-4aa8-9d9a-4836fa5fa48c-delete_volume" by "delete_volume" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:53:19 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-d735845e-911a-4850-ad4b-7d5b3e78bf43 tempest-VolumeAndVolumeTypeFromImageTest-731356096 None] Lock "cinder-b92ad942-1638-4aa8-9d9a-4836fa5fa48c-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:53:19 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-d735845e-911a-4850-ad4b-7d5b3e78bf43 tempest-VolumeAndVolumeTypeFromImageTest-731356096 None] Acquiring lock "cinder-quobyte-b92ad942-1638-4aa8-9d9a-4836fa5fa48c" by "delete_volume" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:53:19 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-d735845e-911a-4850-ad4b-7d5b3e78bf43 tempest-VolumeAndVolumeTypeFromImageTest-731356096 None] Lock "cinder-quobyte-b92ad942-1638-4aa8-9d9a-4836fa5fa48c" acquired by "delete_volume" :: waited 0.056s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:53:19 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a405f5f-9c8e-40e9-896b-62ed66bad533]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:53:19 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-d735845e-911a-4850-ad4b-7d5b3e78bf43 tempest-VolumeAndVolumeTypeFromImageTest-731356096 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-b92ad942-1638-4aa8-9d9a-4836fa5fa48c {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:53:19 devstack sudo[112003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-b92ad942-1638-4aa8-9d9a-4836fa5fa48c Aug 03 08:53:19 devstack sudo[112003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:53:20 devstack sudo[112003]: pam_unix(sudo:session): session closed for user root Aug 03 08:53:20 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-d735845e-911a-4850-ad4b-7d5b3e78bf43 tempest-VolumeAndVolumeTypeFromImageTest-731356096 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-b92ad942-1638-4aa8-9d9a-4836fa5fa48c" returned: 0 in 0.836s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:53:20 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-d735845e-911a-4850-ad4b-7d5b3e78bf43 tempest-VolumeAndVolumeTypeFromImageTest-731356096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-b92ad942-1638-4aa8-9d9a-4836fa5fa48c {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:53:20 devstack sudo[112008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-b92ad942-1638-4aa8-9d9a-4836fa5fa48c Aug 03 08:53:20 devstack sudo[112008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:53:20 devstack sudo[111962]: pam_unix(sudo:session): session closed for user root Aug 03 08:53:20 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-24251bcd-a0fa-4c39-ad4c-c4da89cc0909 tempest-VolumeDependencyTests-1512358985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-7a8ead30-8de5-46a9-a84e-9425b673c7c3 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-1b1ea719-0de3-48d6-ab8a-b62a8b3ce570" returned: 0 in 5.294s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:53:20 devstack cinder-volume[88899]: DEBUG cinder.image.image_utils [None req-24251bcd-a0fa-4c39-ad4c-c4da89cc0909 tempest-VolumeDependencyTests-1512358985 None] Image conversion details: src /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-7a8ead30-8de5-46a9-a84e-9425b673c7c3, size 1024.00 MB, duration 5.30 sec, destination /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-1b1ea719-0de3-48d6-ab8a-b62a8b3ce570 {{(pid=88899) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 03 08:53:20 devstack cinder-volume[88899]: INFO cinder.image.image_utils [None req-24251bcd-a0fa-4c39-ad4c-c4da89cc0909 tempest-VolumeDependencyTests-1512358985 None] Converted 1024.00 MB image at 193.37 MB/s Aug 03 08:53:20 devstack cinder-volume[88899]: WARNING cinder.volume.drivers.remotefs [None req-24251bcd-a0fa-4c39-ad4c-c4da89cc0909 tempest-VolumeDependencyTests-1512358985 None] /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-1b1ea719-0de3-48d6-ab8a-b62a8b3ce570 is being set with open permissions: ugo+rw Aug 03 08:53:20 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-24251bcd-a0fa-4c39-ad4c-c4da89cc0909 tempest-VolumeDependencyTests-1512358985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-1b1ea719-0de3-48d6-ab8a-b62a8b3ce570 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:53:20 devstack sudo[112011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-1b1ea719-0de3-48d6-ab8a-b62a8b3ce570 Aug 03 08:53:20 devstack sudo[112011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:53:20 devstack sudo[112008]: pam_unix(sudo:session): session closed for user root Aug 03 08:53:20 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-d735845e-911a-4850-ad4b-7d5b3e78bf43 tempest-VolumeAndVolumeTypeFromImageTest-731356096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-b92ad942-1638-4aa8-9d9a-4836fa5fa48c" returned: 0 in 0.549s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:53:20 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-d735845e-911a-4850-ad4b-7d5b3e78bf43 tempest-VolumeAndVolumeTypeFromImageTest-731356096 None] Lock "cinder-quobyte-b92ad942-1638-4aa8-9d9a-4836fa5fa48c" released by "delete_volume" :: held 1.489s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:53:20 devstack cinder-volume[88899]: DEBUG cinder.quota [None req-d735845e-911a-4850-ad4b-7d5b3e78bf43 tempest-VolumeAndVolumeTypeFromImageTest-731356096 None] Created reservations ['3880af4b-a9ab-45c2-9f23-5222c3da681a', '7378215b-3b32-4bf0-9cbb-433478da5dab', 'a77903f4-ea50-4a4f-9948-c3ac7ac401c7', '075c4f8c-2523-41ae-a517-4ae506eb2460'] {{(pid=88899) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 08:53:20 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-d735845e-911a-4850-ad4b-7d5b3e78bf43 tempest-VolumeAndVolumeTypeFromImageTest-731356096 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:53:20 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-d735845e-911a-4850-ad4b-7d5b3e78bf43 tempest-VolumeAndVolumeTypeFromImageTest-731356096 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:53:20 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-d735845e-911a-4850-ad4b-7d5b3e78bf43 tempest-VolumeAndVolumeTypeFromImageTest-731356096 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:53:20 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-d735845e-911a-4850-ad4b-7d5b3e78bf43 tempest-VolumeAndVolumeTypeFromImageTest-731356096 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:53:20 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-d735845e-911a-4850-ad4b-7d5b3e78bf43 tempest-VolumeAndVolumeTypeFromImageTest-731356096 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:53:20 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-d735845e-911a-4850-ad4b-7d5b3e78bf43 tempest-VolumeAndVolumeTypeFromImageTest-731356096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:53:20 devstack sudo[112014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a Aug 03 08:53:20 devstack sudo[112014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:53:20 devstack sudo[112011]: pam_unix(sudo:session): session closed for user root Aug 03 08:53:20 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-24251bcd-a0fa-4c39-ad4c-c4da89cc0909 tempest-VolumeDependencyTests-1512358985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-1b1ea719-0de3-48d6-ab8a-b62a8b3ce570" returned: 0 in 0.261s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:53:20 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-24251bcd-a0fa-4c39-ad4c-c4da89cc0909 tempest-VolumeDependencyTests-1512358985 None] Lock "cinder-quobyte-1b1ea719-0de3-48d6-ab8a-b62a8b3ce570" released by "_copy_volume_from_snapshot" :: held 6.530s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:53:20 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-24251bcd-a0fa-4c39-ad4c-c4da89cc0909 tempest-VolumeDependencyTests-1512358985 None] Lock "cinder-quobyte-7a40132f-52ed-4711-ba9b-088821b45487-1b1ea719-0de3-48d6-ab8a-b62a8b3ce570" released by "_create_volume_from_snapshot" :: held 6.621s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:53:20 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-24251bcd-a0fa-4c39-ad4c-c4da89cc0909 tempest-VolumeDependencyTests-1512358985 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.653s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:53:20 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-8899fb14-2cab-4701-abeb-f76179c17a89 tempest-ProjectMemberTests-1353074417 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 6.513s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:53:20 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-8899fb14-2cab-4701-abeb-f76179c17a89 tempest-ProjectMemberTests-1353074417 None] Creating offline snapshot 53471fd1-47dd-4736-a826-56a3fdf08407 of volume 90e29bc4-3f11-4cbb-89c9-2b08888e5edb {{(pid=88899) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 03 08:53:20 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-24251bcd-a0fa-4c39-ad4c-c4da89cc0909 tempest-VolumeDependencyTests-1512358985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3706b097-0d59-4b7c-b7b7-2dccc352d632) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1b1ea719-0de3-48d6-ab8a-b62a8b3ce570', 'volume_size': 1, 'snapshot_id': '7a40132f-52ed-4711-ba9b-088821b45487'}' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:53:20 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-24251bcd-a0fa-4c39-ad4c-c4da89cc0909 tempest-VolumeDependencyTests-1512358985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3bc7671a-93cc-4ceb-a7e8-5b4965461edd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:53:20 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[44adb9df-630b-4fb1-ac07-df33eeb224f5]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:53:20 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-8899fb14-2cab-4701-abeb-f76179c17a89 tempest-ProjectMemberTests-1353074417 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-90e29bc4-3f11-4cbb-89c9-2b08888e5edb {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:53:20 devstack cinder-volume[88899]: INFO cinder.volume.flows.manager.create_volume [None req-24251bcd-a0fa-4c39-ad4c-c4da89cc0909 tempest-VolumeDependencyTests-1512358985 None] Volume volume-1b1ea719-0de3-48d6-ab8a-b62a8b3ce570 (1b1ea719-0de3-48d6-ab8a-b62a8b3ce570): created successfully Aug 03 08:53:20 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-24251bcd-a0fa-4c39-ad4c-c4da89cc0909 tempest-VolumeDependencyTests-1512358985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3bc7671a-93cc-4ceb-a7e8-5b4965461edd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:53:20 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-24251bcd-a0fa-4c39-ad4c-c4da89cc0909 tempest-VolumeDependencyTests-1512358985 None] Flow 'volume_create_manager' (5fb4ea91-b8d7-4cc2-9b2a-f1a2f9de19a6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:53:21 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-24251bcd-a0fa-4c39-ad4c-c4da89cc0909 tempest-VolumeDependencyTests-1512358985 None] Created volume successfully. Aug 03 08:53:21 devstack sudo[112014]: pam_unix(sudo:session): session closed for user root Aug 03 08:53:21 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-d735845e-911a-4850-ad4b-7d5b3e78bf43 tempest-VolumeAndVolumeTypeFromImageTest-731356096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a" returned: 0 in 0.274s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:53:21 devstack cinder-volume[88899]: DEBUG cinder.manager [None req-d735845e-911a-4850-ad4b-7d5b3e78bf43 tempest-VolumeAndVolumeTypeFromImageTest-731356096 None] Notifying Schedulers of capabilities ... {{(pid=88899) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 08:53:21 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-d735845e-911a-4850-ad4b-7d5b3e78bf43 tempest-VolumeAndVolumeTypeFromImageTest-731356096 None] Deleted volume successfully. Aug 03 08:53:21 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-d735845e-911a-4850-ad4b-7d5b3e78bf43 tempest-VolumeAndVolumeTypeFromImageTest-731356096 None] Lock "cinder-b92ad942-1638-4aa8-9d9a-4836fa5fa48c-delete_volume" released by "delete_volume" :: held 2.085s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:53:21 devstack sudo[112016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-90e29bc4-3f11-4cbb-89c9-2b08888e5edb Aug 03 08:53:21 devstack sudo[112016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:53:21 devstack sudo[112016]: pam_unix(sudo:session): session closed for user root Aug 03 08:53:21 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-8899fb14-2cab-4701-abeb-f76179c17a89 tempest-ProjectMemberTests-1353074417 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-90e29bc4-3f11-4cbb-89c9-2b08888e5edb" returned: 0 in 0.431s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:53:21 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-8899fb14-2cab-4701-abeb-f76179c17a89 tempest-ProjectMemberTests-1353074417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-90e29bc4-3f11-4cbb-89c9-2b08888e5edb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-90e29bc4-3f11-4cbb-89c9-2b08888e5edb.53471fd1-47dd-4736-a826-56a3fdf08407 1G {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:53:21 devstack sudo[112022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-90e29bc4-3f11-4cbb-89c9-2b08888e5edb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-90e29bc4-3f11-4cbb-89c9-2b08888e5edb.53471fd1-47dd-4736-a826-56a3fdf08407 1G Aug 03 08:53:21 devstack sudo[112022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:53:21 devstack sudo[112022]: pam_unix(sudo:session): session closed for user root Aug 03 08:53:21 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-8899fb14-2cab-4701-abeb-f76179c17a89 tempest-ProjectMemberTests-1353074417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-90e29bc4-3f11-4cbb-89c9-2b08888e5edb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-90e29bc4-3f11-4cbb-89c9-2b08888e5edb.53471fd1-47dd-4736-a826-56a3fdf08407 1G" returned: 0 in 0.536s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:53:21 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-8899fb14-2cab-4701-abeb-f76179c17a89 tempest-ProjectMemberTests-1353074417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-90e29bc4-3f11-4cbb-89c9-2b08888e5edb -F qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-90e29bc4-3f11-4cbb-89c9-2b08888e5edb.53471fd1-47dd-4736-a826-56a3fdf08407 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:53:21 devstack sudo[112028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-90e29bc4-3f11-4cbb-89c9-2b08888e5edb -F qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-90e29bc4-3f11-4cbb-89c9-2b08888e5edb.53471fd1-47dd-4736-a826-56a3fdf08407 Aug 03 08:53:21 devstack sudo[112028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:53:22 devstack cinder-volume[88899]: DEBUG cinder.volume.flows.manager.create_volume [None req-bd0aefcd-0ce7-4330-8ac3-dbad81d993ad tempest-CreateVolumesFromSnapshotTest-2011744404 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88899) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 08:53:22 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-bd0aefcd-0ce7-4330-8ac3-dbad81d993ad tempest-CreateVolumesFromSnapshotTest-2011744404 None] Flow 'volume_create_manager' (7c51a147-fb20-46bd-a486-174f917bda60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:53:22 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-bd0aefcd-0ce7-4330-8ac3-dbad81d993ad tempest-CreateVolumesFromSnapshotTest-2011744404 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4a61dad-b2a7-48b2-a4fe-e436211c39fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:53:22 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-bd0aefcd-0ce7-4330-8ac3-dbad81d993ad tempest-CreateVolumesFromSnapshotTest-2011744404 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4a61dad-b2a7-48b2-a4fe-e436211c39fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:53:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-603929461',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=12cb2f26-c24e-4b7c-b6ac-768e61e7676e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c48ec6495e45472bb1d655075844c178',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:53:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:53:22Z,use_quota=True,user_id='7544fdd40c9c4f319f124d229d006559',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8bde7129-1dc4-42ab-b852-ab32c61b4921),volume_type_id=8bde7129-1dc4-42ab-b852-ab32c61b4921)' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:53:22 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-bd0aefcd-0ce7-4330-8ac3-dbad81d993ad tempest-CreateVolumesFromSnapshotTest-2011744404 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ec332be-9c09-44b4-8504-81de9d3c8101) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:53:22 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-bd0aefcd-0ce7-4330-8ac3-dbad81d993ad tempest-CreateVolumesFromSnapshotTest-2011744404 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ec332be-9c09-44b4-8504-81de9d3c8101) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:53:22 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-bd0aefcd-0ce7-4330-8ac3-dbad81d993ad tempest-CreateVolumesFromSnapshotTest-2011744404 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f0fc46bb-ed66-4499-a162-89fe9c9be244) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:53:22 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-bd0aefcd-0ce7-4330-8ac3-dbad81d993ad tempest-CreateVolumesFromSnapshotTest-2011744404 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f0fc46bb-ed66-4499-a162-89fe9c9be244) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '12cb2f26-c24e-4b7c-b6ac-768e61e7676e', 'volume_name': 'volume-12cb2f26-c24e-4b7c-b6ac-768e61e7676e', 'volume_size': 1}' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:53:22 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-bd0aefcd-0ce7-4330-8ac3-dbad81d993ad tempest-CreateVolumesFromSnapshotTest-2011744404 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31bf4c0e-c1c0-4041-8b91-5b74d25eb7c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:53:22 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-bd0aefcd-0ce7-4330-8ac3-dbad81d993ad tempest-CreateVolumesFromSnapshotTest-2011744404 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31bf4c0e-c1c0-4041-8b91-5b74d25eb7c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:53:22 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-bd0aefcd-0ce7-4330-8ac3-dbad81d993ad tempest-CreateVolumesFromSnapshotTest-2011744404 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e97e30a2-dad9-4277-a7f4-5a7dce23ef66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:53:22 devstack cinder-volume[88899]: INFO cinder.volume.flows.manager.create_volume [None req-bd0aefcd-0ce7-4330-8ac3-dbad81d993ad tempest-CreateVolumesFromSnapshotTest-2011744404 None] Volume 12cb2f26-c24e-4b7c-b6ac-768e61e7676e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-12cb2f26-c24e-4b7c-b6ac-768e61e7676e', 'volume_size': 1} Aug 03 08:53:22 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-bd0aefcd-0ce7-4330-8ac3-dbad81d993ad tempest-CreateVolumesFromSnapshotTest-2011744404 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:53:22 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-d0a2a266-ad30-44a0-8ce7-aed01f958b42 tempest-VolumeDependencyTests-1512358985 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:53:22 devstack sudo[112028]: pam_unix(sudo:session): session closed for user root Aug 03 08:53:22 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-8899fb14-2cab-4701-abeb-f76179c17a89 tempest-ProjectMemberTests-1353074417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-90e29bc4-3f11-4cbb-89c9-2b08888e5edb -F qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-90e29bc4-3f11-4cbb-89c9-2b08888e5edb.53471fd1-47dd-4736-a826-56a3fdf08407" returned: 0 in 0.366s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:53:22 devstack cinder-volume[88899]: WARNING cinder.volume.drivers.remotefs [None req-8899fb14-2cab-4701-abeb-f76179c17a89 tempest-ProjectMemberTests-1353074417 None] /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-90e29bc4-3f11-4cbb-89c9-2b08888e5edb.53471fd1-47dd-4736-a826-56a3fdf08407 is being set with open permissions: ugo+rw Aug 03 08:53:22 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-8899fb14-2cab-4701-abeb-f76179c17a89 tempest-ProjectMemberTests-1353074417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-90e29bc4-3f11-4cbb-89c9-2b08888e5edb.53471fd1-47dd-4736-a826-56a3fdf08407 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:53:22 devstack sudo[112034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-90e29bc4-3f11-4cbb-89c9-2b08888e5edb.53471fd1-47dd-4736-a826-56a3fdf08407 Aug 03 08:53:22 devstack sudo[112034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:53:22 devstack sudo[112034]: pam_unix(sudo:session): session closed for user root Aug 03 08:53:22 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-8899fb14-2cab-4701-abeb-f76179c17a89 tempest-ProjectMemberTests-1353074417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-90e29bc4-3f11-4cbb-89c9-2b08888e5edb.53471fd1-47dd-4736-a826-56a3fdf08407" returned: 0 in 0.234s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:53:22 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-8899fb14-2cab-4701-abeb-f76179c17a89 tempest-ProjectMemberTests-1353074417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-90e29bc4-3f11-4cbb-89c9-2b08888e5edb.info {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:53:22 devstack sudo[112037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-90e29bc4-3f11-4cbb-89c9-2b08888e5edb.info Aug 03 08:53:22 devstack sudo[112037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:53:22 devstack sudo[112037]: pam_unix(sudo:session): session closed for user root Aug 03 08:53:22 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-8899fb14-2cab-4701-abeb-f76179c17a89 tempest-ProjectMemberTests-1353074417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-90e29bc4-3f11-4cbb-89c9-2b08888e5edb.info" returned: 0 in 0.258s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:53:22 devstack cinder-volume[88899]: WARNING cinder.volume.drivers.remotefs [None req-8899fb14-2cab-4701-abeb-f76179c17a89 tempest-ProjectMemberTests-1353074417 None] /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-90e29bc4-3f11-4cbb-89c9-2b08888e5edb.info is being set with open permissions: ugo+rw Aug 03 08:53:22 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-8899fb14-2cab-4701-abeb-f76179c17a89 tempest-ProjectMemberTests-1353074417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-90e29bc4-3f11-4cbb-89c9-2b08888e5edb.info {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:53:22 devstack sudo[112040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-90e29bc4-3f11-4cbb-89c9-2b08888e5edb.info Aug 03 08:53:22 devstack sudo[112040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:53:23 devstack sudo[112040]: pam_unix(sudo:session): session closed for user root Aug 03 08:53:23 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-8899fb14-2cab-4701-abeb-f76179c17a89 tempest-ProjectMemberTests-1353074417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-90e29bc4-3f11-4cbb-89c9-2b08888e5edb.info" returned: 0 in 0.267s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:53:23 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-8899fb14-2cab-4701-abeb-f76179c17a89 tempest-ProjectMemberTests-1353074417 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.213s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:53:23 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-bd0aefcd-0ce7-4330-8ac3-dbad81d993ad tempest-CreateVolumesFromSnapshotTest-2011744404 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.986s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:53:23 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-bd0aefcd-0ce7-4330-8ac3-dbad81d993ad tempest-CreateVolumesFromSnapshotTest-2011744404 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:53:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-603929461',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=12cb2f26-c24e-4b7c-b6ac-768e61e7676e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c48ec6495e45472bb1d655075844c178',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:53:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:53:22Z,use_quota=True,user_id='7544fdd40c9c4f319f124d229d006559',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8bde7129-1dc4-42ab-b852-ab32c61b4921),volume_type_id=8bde7129-1dc4-42ab-b852-ab32c61b4921)}" {{(pid=88899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 08:53:23 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-bd0aefcd-0ce7-4330-8ac3-dbad81d993ad tempest-CreateVolumesFromSnapshotTest-2011744404 None] Creating volume 12cb2f26-c24e-4b7c-b6ac-768e61e7676e {{(pid=88899) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 08:53:23 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-bd0aefcd-0ce7-4330-8ac3-dbad81d993ad tempest-CreateVolumesFromSnapshotTest-2011744404 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:53:23 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-bd0aefcd-0ce7-4330-8ac3-dbad81d993ad tempest-CreateVolumesFromSnapshotTest-2011744404 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:53:23 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-bd0aefcd-0ce7-4330-8ac3-dbad81d993ad tempest-CreateVolumesFromSnapshotTest-2011744404 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:53:23 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-bd0aefcd-0ce7-4330-8ac3-dbad81d993ad tempest-CreateVolumesFromSnapshotTest-2011744404 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:53:23 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-bd0aefcd-0ce7-4330-8ac3-dbad81d993ad tempest-CreateVolumesFromSnapshotTest-2011744404 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:53:23 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-bd0aefcd-0ce7-4330-8ac3-dbad81d993ad tempest-CreateVolumesFromSnapshotTest-2011744404 None] Selected osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385 as target Quobyte volume. {{(pid=88899) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 08:53:23 devstack cinder-volume[88899]: INFO cinder.volume.drivers.remotefs [None req-bd0aefcd-0ce7-4330-8ac3-dbad81d993ad tempest-CreateVolumesFromSnapshotTest-2011744404 None] casted to osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385 Aug 03 08:53:23 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-bd0aefcd-0ce7-4330-8ac3-dbad81d993ad tempest-CreateVolumesFromSnapshotTest-2011744404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-12cb2f26-c24e-4b7c-b6ac-768e61e7676e 1073741824 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:53:23 devstack sudo[112043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-12cb2f26-c24e-4b7c-b6ac-768e61e7676e 1073741824 Aug 03 08:53:23 devstack sudo[112043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:53:23 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-8899fb14-2cab-4701-abeb-f76179c17a89 tempest-ProjectMemberTests-1353074417 None] Create snapshot completed successfully Aug 03 08:53:23 devstack sudo[112043]: pam_unix(sudo:session): session closed for user root Aug 03 08:53:23 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-bd0aefcd-0ce7-4330-8ac3-dbad81d993ad tempest-CreateVolumesFromSnapshotTest-2011744404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-12cb2f26-c24e-4b7c-b6ac-768e61e7676e 1073741824" returned: 0 in 0.473s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:53:23 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-bd0aefcd-0ce7-4330-8ac3-dbad81d993ad tempest-CreateVolumesFromSnapshotTest-2011744404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-12cb2f26-c24e-4b7c-b6ac-768e61e7676e {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:53:23 devstack sudo[112049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-12cb2f26-c24e-4b7c-b6ac-768e61e7676e Aug 03 08:53:23 devstack sudo[112049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:53:23 devstack sudo[112049]: pam_unix(sudo:session): session closed for user root Aug 03 08:53:23 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-bd0aefcd-0ce7-4330-8ac3-dbad81d993ad tempest-CreateVolumesFromSnapshotTest-2011744404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-12cb2f26-c24e-4b7c-b6ac-768e61e7676e" returned: 0 in 0.263s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:53:23 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-bd0aefcd-0ce7-4330-8ac3-dbad81d993ad tempest-CreateVolumesFromSnapshotTest-2011744404 None] <== create_volume: return (785ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'} {{(pid=88899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 08:53:23 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-bd0aefcd-0ce7-4330-8ac3-dbad81d993ad tempest-CreateVolumesFromSnapshotTest-2011744404 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.791s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:53:23 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-d0a2a266-ad30-44a0-8ce7-aed01f958b42 tempest-VolumeDependencyTests-1512358985 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.713s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:53:23 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-bd0aefcd-0ce7-4330-8ac3-dbad81d993ad tempest-CreateVolumesFromSnapshotTest-2011744404 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e97e30a2-dad9-4277-a7f4-5a7dce23ef66) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-12cb2f26-c24e-4b7c-b6ac-768e61e7676e', 'volume_size': 1}' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:53:23 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-bd0aefcd-0ce7-4330-8ac3-dbad81d993ad tempest-CreateVolumesFromSnapshotTest-2011744404 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c809174-feb4-4ec4-8db6-d5850aaeca55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:53:23 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-d0a2a266-ad30-44a0-8ce7-aed01f958b42 tempest-VolumeDependencyTests-1512358985 None] Creating offline snapshot 2020514f-ed33-440d-ac66-99bda5184fc5 of volume 1b1ea719-0de3-48d6-ab8a-b62a8b3ce570 {{(pid=88899) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 03 08:53:23 devstack cinder-volume[88899]: INFO cinder.volume.flows.manager.create_volume [None req-bd0aefcd-0ce7-4330-8ac3-dbad81d993ad tempest-CreateVolumesFromSnapshotTest-2011744404 None] Volume volume-12cb2f26-c24e-4b7c-b6ac-768e61e7676e (12cb2f26-c24e-4b7c-b6ac-768e61e7676e): created successfully Aug 03 08:53:23 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-bd0aefcd-0ce7-4330-8ac3-dbad81d993ad tempest-CreateVolumesFromSnapshotTest-2011744404 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c809174-feb4-4ec4-8db6-d5850aaeca55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:53:24 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-bd0aefcd-0ce7-4330-8ac3-dbad81d993ad tempest-CreateVolumesFromSnapshotTest-2011744404 None] Flow 'volume_create_manager' (7c51a147-fb20-46bd-a486-174f917bda60) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:53:24 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[dec61d0c-5d12-4364-b2f5-40ffaf4d3961]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:53:24 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-d0a2a266-ad30-44a0-8ce7-aed01f958b42 tempest-VolumeDependencyTests-1512358985 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-1b1ea719-0de3-48d6-ab8a-b62a8b3ce570 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:53:24 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-bd0aefcd-0ce7-4330-8ac3-dbad81d993ad tempest-CreateVolumesFromSnapshotTest-2011744404 None] Created volume successfully. Aug 03 08:53:24 devstack sudo[112052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-1b1ea719-0de3-48d6-ab8a-b62a8b3ce570 Aug 03 08:53:24 devstack sudo[112052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:53:24 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-9b20d63a-43f3-42da-ac37-8151cd665898 tempest-ProjectMemberTests-1353074417 None] Acquiring lock "cinder-53471fd1-47dd-4736-a826-56a3fdf08407-delete_snapshot" by "delete_snapshot" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:53:24 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-9b20d63a-43f3-42da-ac37-8151cd665898 tempest-ProjectMemberTests-1353074417 None] Lock "cinder-53471fd1-47dd-4736-a826-56a3fdf08407-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:53:24 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-9b20d63a-43f3-42da-ac37-8151cd665898 tempest-ProjectMemberTests-1353074417 None] Acquiring lock "cinder-quobyte-90e29bc4-3f11-4cbb-89c9-2b08888e5edb" by "delete_snapshot" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:53:24 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-9b20d63a-43f3-42da-ac37-8151cd665898 tempest-ProjectMemberTests-1353074417 None] Lock "cinder-quobyte-90e29bc4-3f11-4cbb-89c9-2b08888e5edb" acquired by "delete_snapshot" :: waited 0.024s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:53:24 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-9b20d63a-43f3-42da-ac37-8151cd665898 tempest-ProjectMemberTests-1353074417 None] Acquiring lock "cinder-quobyte-53471fd1-47dd-4736-a826-56a3fdf08407" by "_delete_snapshot" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:53:24 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-9b20d63a-43f3-42da-ac37-8151cd665898 tempest-ProjectMemberTests-1353074417 None] Lock "cinder-quobyte-53471fd1-47dd-4736-a826-56a3fdf08407" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:53:24 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-9b20d63a-43f3-42da-ac37-8151cd665898 tempest-ProjectMemberTests-1353074417 None] Deleting offline snapshot 53471fd1-47dd-4736-a826-56a3fdf08407 of volume 90e29bc4-3f11-4cbb-89c9-2b08888e5edb {{(pid=88899) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 03 08:53:24 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-9b20d63a-43f3-42da-ac37-8151cd665898 tempest-ProjectMemberTests-1353074417 None] snapshot_file for this snap is: volume-90e29bc4-3f11-4cbb-89c9-2b08888e5edb.53471fd1-47dd-4736-a826-56a3fdf08407 {{(pid=88899) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 03 08:53:24 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[f062b2ce-1f6a-4ee0-b2bb-4fca69d6e1eb]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:53:24 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-9b20d63a-43f3-42da-ac37-8151cd665898 tempest-ProjectMemberTests-1353074417 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-90e29bc4-3f11-4cbb-89c9-2b08888e5edb.53471fd1-47dd-4736-a826-56a3fdf08407 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:53:24 devstack sudo[112054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-90e29bc4-3f11-4cbb-89c9-2b08888e5edb.53471fd1-47dd-4736-a826-56a3fdf08407 Aug 03 08:53:24 devstack sudo[112054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:53:24 devstack sudo[112052]: pam_unix(sudo:session): session closed for user root Aug 03 08:53:24 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-d0a2a266-ad30-44a0-8ce7-aed01f958b42 tempest-VolumeDependencyTests-1512358985 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-1b1ea719-0de3-48d6-ab8a-b62a8b3ce570" returned: 0 in 0.538s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:53:24 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-d0a2a266-ad30-44a0-8ce7-aed01f958b42 tempest-VolumeDependencyTests-1512358985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-1b1ea719-0de3-48d6-ab8a-b62a8b3ce570,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-1b1ea719-0de3-48d6-ab8a-b62a8b3ce570.2020514f-ed33-440d-ac66-99bda5184fc5 1G {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:53:24 devstack sudo[112059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-1b1ea719-0de3-48d6-ab8a-b62a8b3ce570,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-1b1ea719-0de3-48d6-ab8a-b62a8b3ce570.2020514f-ed33-440d-ac66-99bda5184fc5 1G Aug 03 08:53:24 devstack sudo[112059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:53:24 devstack sudo[112054]: pam_unix(sudo:session): session closed for user root Aug 03 08:53:24 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-9b20d63a-43f3-42da-ac37-8151cd665898 tempest-ProjectMemberTests-1353074417 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-90e29bc4-3f11-4cbb-89c9-2b08888e5edb.53471fd1-47dd-4736-a826-56a3fdf08407" returned: 0 in 0.414s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:53:24 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-9b20d63a-43f3-42da-ac37-8151cd665898 tempest-ProjectMemberTests-1353074417 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-90e29bc4-3f11-4cbb-89c9-2b08888e5edb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88899) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 03 08:53:24 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[9966494a-3c78-4459-9970-947357897892]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:53:24 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-9b20d63a-43f3-42da-ac37-8151cd665898 tempest-ProjectMemberTests-1353074417 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-90e29bc4-3f11-4cbb-89c9-2b08888e5edb {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:53:24 devstack sudo[112068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-90e29bc4-3f11-4cbb-89c9-2b08888e5edb Aug 03 08:53:24 devstack sudo[112068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:53:25 devstack sudo[112059]: pam_unix(sudo:session): session closed for user root Aug 03 08:53:25 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-d0a2a266-ad30-44a0-8ce7-aed01f958b42 tempest-VolumeDependencyTests-1512358985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-1b1ea719-0de3-48d6-ab8a-b62a8b3ce570,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-1b1ea719-0de3-48d6-ab8a-b62a8b3ce570.2020514f-ed33-440d-ac66-99bda5184fc5 1G" returned: 0 in 0.480s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:53:25 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-d0a2a266-ad30-44a0-8ce7-aed01f958b42 tempest-VolumeDependencyTests-1512358985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1b1ea719-0de3-48d6-ab8a-b62a8b3ce570 -F qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-1b1ea719-0de3-48d6-ab8a-b62a8b3ce570.2020514f-ed33-440d-ac66-99bda5184fc5 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:53:25 devstack sudo[112071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1b1ea719-0de3-48d6-ab8a-b62a8b3ce570 -F qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-1b1ea719-0de3-48d6-ab8a-b62a8b3ce570.2020514f-ed33-440d-ac66-99bda5184fc5 Aug 03 08:53:25 devstack sudo[112071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:53:25 devstack sudo[112068]: pam_unix(sudo:session): session closed for user root Aug 03 08:53:25 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-9b20d63a-43f3-42da-ac37-8151cd665898 tempest-ProjectMemberTests-1353074417 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-90e29bc4-3f11-4cbb-89c9-2b08888e5edb" returned: 0 in 0.451s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:53:25 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-9b20d63a-43f3-42da-ac37-8151cd665898 tempest-ProjectMemberTests-1353074417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-90e29bc4-3f11-4cbb-89c9-2b08888e5edb.53471fd1-47dd-4736-a826-56a3fdf08407 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:53:25 devstack sudo[112076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-90e29bc4-3f11-4cbb-89c9-2b08888e5edb.53471fd1-47dd-4736-a826-56a3fdf08407 Aug 03 08:53:25 devstack sudo[112076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:53:25 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-d71cd711-36d2-4d9c-95ca-4901875136a0 tempest-CreateVolumesFromSnapshotTest-2011744404 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:53:25 devstack sudo[112071]: pam_unix(sudo:session): session closed for user root Aug 03 08:53:25 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-d0a2a266-ad30-44a0-8ce7-aed01f958b42 tempest-VolumeDependencyTests-1512358985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1b1ea719-0de3-48d6-ab8a-b62a8b3ce570 -F qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-1b1ea719-0de3-48d6-ab8a-b62a8b3ce570.2020514f-ed33-440d-ac66-99bda5184fc5" returned: 0 in 0.455s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:53:25 devstack cinder-volume[88899]: WARNING cinder.volume.drivers.remotefs [None req-d0a2a266-ad30-44a0-8ce7-aed01f958b42 tempest-VolumeDependencyTests-1512358985 None] /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-1b1ea719-0de3-48d6-ab8a-b62a8b3ce570.2020514f-ed33-440d-ac66-99bda5184fc5 is being set with open permissions: ugo+rw Aug 03 08:53:25 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-d0a2a266-ad30-44a0-8ce7-aed01f958b42 tempest-VolumeDependencyTests-1512358985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-1b1ea719-0de3-48d6-ab8a-b62a8b3ce570.2020514f-ed33-440d-ac66-99bda5184fc5 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:53:25 devstack sudo[112081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-1b1ea719-0de3-48d6-ab8a-b62a8b3ce570.2020514f-ed33-440d-ac66-99bda5184fc5 Aug 03 08:53:25 devstack sudo[112081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:53:25 devstack sudo[112076]: pam_unix(sudo:session): session closed for user root Aug 03 08:53:25 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-9b20d63a-43f3-42da-ac37-8151cd665898 tempest-ProjectMemberTests-1353074417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-90e29bc4-3f11-4cbb-89c9-2b08888e5edb.53471fd1-47dd-4736-a826-56a3fdf08407" returned: 0 in 0.447s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:53:25 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-9b20d63a-43f3-42da-ac37-8151cd665898 tempest-ProjectMemberTests-1353074417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-90e29bc4-3f11-4cbb-89c9-2b08888e5edb.53471fd1-47dd-4736-a826-56a3fdf08407 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:53:25 devstack sudo[112081]: pam_unix(sudo:session): session closed for user root Aug 03 08:53:25 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-d0a2a266-ad30-44a0-8ce7-aed01f958b42 tempest-VolumeDependencyTests-1512358985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-1b1ea719-0de3-48d6-ab8a-b62a8b3ce570.2020514f-ed33-440d-ac66-99bda5184fc5" returned: 0 in 0.266s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:53:25 devstack sudo[112087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-90e29bc4-3f11-4cbb-89c9-2b08888e5edb.53471fd1-47dd-4736-a826-56a3fdf08407 Aug 03 08:53:25 devstack sudo[112087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:53:25 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-d0a2a266-ad30-44a0-8ce7-aed01f958b42 tempest-VolumeDependencyTests-1512358985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-1b1ea719-0de3-48d6-ab8a-b62a8b3ce570.info {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:53:25 devstack sudo[112089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-1b1ea719-0de3-48d6-ab8a-b62a8b3ce570.info Aug 03 08:53:25 devstack sudo[112089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:53:25 devstack sudo[112087]: pam_unix(sudo:session): session closed for user root Aug 03 08:53:25 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-9b20d63a-43f3-42da-ac37-8151cd665898 tempest-ProjectMemberTests-1353074417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-90e29bc4-3f11-4cbb-89c9-2b08888e5edb.53471fd1-47dd-4736-a826-56a3fdf08407" returned: 0 in 0.262s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:53:26 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-9b20d63a-43f3-42da-ac37-8151cd665898 tempest-ProjectMemberTests-1353074417 None] Lock "cinder-quobyte-53471fd1-47dd-4736-a826-56a3fdf08407" released by "_delete_snapshot" :: held 1.717s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:53:26 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-9b20d63a-43f3-42da-ac37-8151cd665898 tempest-ProjectMemberTests-1353074417 None] Lock "cinder-quobyte-90e29bc4-3f11-4cbb-89c9-2b08888e5edb" released by "delete_snapshot" :: held 1.750s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:53:26 devstack sudo[112089]: pam_unix(sudo:session): session closed for user root Aug 03 08:53:26 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-d0a2a266-ad30-44a0-8ce7-aed01f958b42 tempest-VolumeDependencyTests-1512358985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-1b1ea719-0de3-48d6-ab8a-b62a8b3ce570.info" returned: 0 in 0.275s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:53:26 devstack cinder-volume[88899]: WARNING cinder.volume.drivers.remotefs [None req-d0a2a266-ad30-44a0-8ce7-aed01f958b42 tempest-VolumeDependencyTests-1512358985 None] /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-1b1ea719-0de3-48d6-ab8a-b62a8b3ce570.info is being set with open permissions: ugo+rw Aug 03 08:53:26 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-d0a2a266-ad30-44a0-8ce7-aed01f958b42 tempest-VolumeDependencyTests-1512358985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-1b1ea719-0de3-48d6-ab8a-b62a8b3ce570.info {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:53:26 devstack sudo[112093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-1b1ea719-0de3-48d6-ab8a-b62a8b3ce570.info Aug 03 08:53:26 devstack sudo[112093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:53:26 devstack cinder-volume[88899]: DEBUG cinder.quota [None req-9b20d63a-43f3-42da-ac37-8151cd665898 tempest-ProjectMemberTests-1353074417 None] Created reservations ['b424a47f-421b-4e79-af4d-dbf143a7e208', '5667af53-b94d-4012-b795-675a576d9adf', '15420467-b21f-42c1-906c-c486aef6236d', '8115436a-1c2c-4765-96f3-fd4d2a69b487'] {{(pid=88899) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 08:53:26 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-9b20d63a-43f3-42da-ac37-8151cd665898 tempest-ProjectMemberTests-1353074417 None] Delete snapshot completed successfully. Aug 03 08:53:26 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-9b20d63a-43f3-42da-ac37-8151cd665898 tempest-ProjectMemberTests-1353074417 None] Lock "cinder-53471fd1-47dd-4736-a826-56a3fdf08407-delete_snapshot" released by "delete_snapshot" :: held 1.945s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:53:26 devstack sudo[112093]: pam_unix(sudo:session): session closed for user root Aug 03 08:53:26 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-d0a2a266-ad30-44a0-8ce7-aed01f958b42 tempest-VolumeDependencyTests-1512358985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-1b1ea719-0de3-48d6-ab8a-b62a8b3ce570.info" returned: 0 in 0.258s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:53:26 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-d0a2a266-ad30-44a0-8ce7-aed01f958b42 tempest-VolumeDependencyTests-1512358985 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.416s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:53:26 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-d71cd711-36d2-4d9c-95ca-4901875136a0 tempest-CreateVolumesFromSnapshotTest-2011744404 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.869s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:53:26 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-d71cd711-36d2-4d9c-95ca-4901875136a0 tempest-CreateVolumesFromSnapshotTest-2011744404 None] Creating offline snapshot 37e9d66f-44cb-4ac6-a724-cc67c84b0a21 of volume 12cb2f26-c24e-4b7c-b6ac-768e61e7676e {{(pid=88899) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 03 08:53:26 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-d0a2a266-ad30-44a0-8ce7-aed01f958b42 tempest-VolumeDependencyTests-1512358985 None] Create snapshot completed successfully Aug 03 08:53:26 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[48729c34-4d2a-4201-891b-24cf7a7f7cec]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:53:26 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-d71cd711-36d2-4d9c-95ca-4901875136a0 tempest-CreateVolumesFromSnapshotTest-2011744404 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-12cb2f26-c24e-4b7c-b6ac-768e61e7676e {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:53:26 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-96a95d0c-5335-4bd5-a269-65893144d15f tempest-ProjectMemberTests-1353074417 None] Acquiring lock "cinder-90e29bc4-3f11-4cbb-89c9-2b08888e5edb-delete_volume" by "delete_volume" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:53:26 devstack sudo[112096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-12cb2f26-c24e-4b7c-b6ac-768e61e7676e Aug 03 08:53:26 devstack sudo[112096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:53:26 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-96a95d0c-5335-4bd5-a269-65893144d15f tempest-ProjectMemberTests-1353074417 None] Lock "cinder-90e29bc4-3f11-4cbb-89c9-2b08888e5edb-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:53:26 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-96a95d0c-5335-4bd5-a269-65893144d15f tempest-ProjectMemberTests-1353074417 None] Acquiring lock "cinder-quobyte-90e29bc4-3f11-4cbb-89c9-2b08888e5edb" by "delete_volume" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:53:26 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-96a95d0c-5335-4bd5-a269-65893144d15f tempest-ProjectMemberTests-1353074417 None] Lock "cinder-quobyte-90e29bc4-3f11-4cbb-89c9-2b08888e5edb" acquired by "delete_volume" :: waited 0.017s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:53:26 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c9fb4a4-a8fd-42dc-a2f6-4057797dfd8e]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:53:26 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-96a95d0c-5335-4bd5-a269-65893144d15f tempest-ProjectMemberTests-1353074417 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-90e29bc4-3f11-4cbb-89c9-2b08888e5edb {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:53:26 devstack sudo[112098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-90e29bc4-3f11-4cbb-89c9-2b08888e5edb Aug 03 08:53:26 devstack sudo[112098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:53:26 devstack sudo[112096]: pam_unix(sudo:session): session closed for user root Aug 03 08:53:26 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-d71cd711-36d2-4d9c-95ca-4901875136a0 tempest-CreateVolumesFromSnapshotTest-2011744404 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-12cb2f26-c24e-4b7c-b6ac-768e61e7676e" returned: 0 in 0.434s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:53:26 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-d71cd711-36d2-4d9c-95ca-4901875136a0 tempest-CreateVolumesFromSnapshotTest-2011744404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-12cb2f26-c24e-4b7c-b6ac-768e61e7676e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-12cb2f26-c24e-4b7c-b6ac-768e61e7676e.37e9d66f-44cb-4ac6-a724-cc67c84b0a21 1G {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:53:26 devstack sudo[112104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-12cb2f26-c24e-4b7c-b6ac-768e61e7676e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-12cb2f26-c24e-4b7c-b6ac-768e61e7676e.37e9d66f-44cb-4ac6-a724-cc67c84b0a21 1G Aug 03 08:53:26 devstack sudo[112104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:53:27 devstack sudo[112098]: pam_unix(sudo:session): session closed for user root Aug 03 08:53:27 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-96a95d0c-5335-4bd5-a269-65893144d15f tempest-ProjectMemberTests-1353074417 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-90e29bc4-3f11-4cbb-89c9-2b08888e5edb" returned: 0 in 0.383s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:53:27 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-96a95d0c-5335-4bd5-a269-65893144d15f tempest-ProjectMemberTests-1353074417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-90e29bc4-3f11-4cbb-89c9-2b08888e5edb {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:53:27 devstack sudo[112109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-90e29bc4-3f11-4cbb-89c9-2b08888e5edb Aug 03 08:53:27 devstack sudo[112109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:53:27 devstack sudo[112109]: pam_unix(sudo:session): session closed for user root Aug 03 08:53:27 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-96a95d0c-5335-4bd5-a269-65893144d15f tempest-ProjectMemberTests-1353074417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-90e29bc4-3f11-4cbb-89c9-2b08888e5edb" returned: 0 in 0.282s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:53:27 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-96a95d0c-5335-4bd5-a269-65893144d15f tempest-ProjectMemberTests-1353074417 None] Lock "cinder-quobyte-90e29bc4-3f11-4cbb-89c9-2b08888e5edb" released by "delete_volume" :: held 0.742s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:53:27 devstack sudo[112104]: pam_unix(sudo:session): session closed for user root Aug 03 08:53:27 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-d71cd711-36d2-4d9c-95ca-4901875136a0 tempest-CreateVolumesFromSnapshotTest-2011744404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-12cb2f26-c24e-4b7c-b6ac-768e61e7676e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-12cb2f26-c24e-4b7c-b6ac-768e61e7676e.37e9d66f-44cb-4ac6-a724-cc67c84b0a21 1G" returned: 0 in 0.537s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:53:27 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-d71cd711-36d2-4d9c-95ca-4901875136a0 tempest-CreateVolumesFromSnapshotTest-2011744404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-12cb2f26-c24e-4b7c-b6ac-768e61e7676e -F qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-12cb2f26-c24e-4b7c-b6ac-768e61e7676e.37e9d66f-44cb-4ac6-a724-cc67c84b0a21 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:53:27 devstack cinder-volume[88899]: DEBUG cinder.quota [None req-96a95d0c-5335-4bd5-a269-65893144d15f tempest-ProjectMemberTests-1353074417 None] Created reservations ['dba96246-8768-4758-af44-710b7340da1d', '8c82491f-6f38-469a-878b-44b62149cec8', 'e515cda0-db67-4691-b72e-b3e3ab717866', '3a70acb0-ae7d-4773-a4ef-ef8b8a7feed6'] {{(pid=88899) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 08:53:27 devstack sudo[112116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-12cb2f26-c24e-4b7c-b6ac-768e61e7676e -F qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-12cb2f26-c24e-4b7c-b6ac-768e61e7676e.37e9d66f-44cb-4ac6-a724-cc67c84b0a21 Aug 03 08:53:27 devstack sudo[112116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:53:27 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-96a95d0c-5335-4bd5-a269-65893144d15f tempest-ProjectMemberTests-1353074417 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:53:27 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-96a95d0c-5335-4bd5-a269-65893144d15f tempest-ProjectMemberTests-1353074417 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:53:27 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-96a95d0c-5335-4bd5-a269-65893144d15f tempest-ProjectMemberTests-1353074417 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:53:27 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-96a95d0c-5335-4bd5-a269-65893144d15f tempest-ProjectMemberTests-1353074417 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:53:27 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-96a95d0c-5335-4bd5-a269-65893144d15f tempest-ProjectMemberTests-1353074417 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:53:27 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-96a95d0c-5335-4bd5-a269-65893144d15f tempest-ProjectMemberTests-1353074417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:53:27 devstack sudo[112118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a Aug 03 08:53:27 devstack sudo[112118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:53:27 devstack sudo[112118]: pam_unix(sudo:session): session closed for user root Aug 03 08:53:27 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-96a95d0c-5335-4bd5-a269-65893144d15f tempest-ProjectMemberTests-1353074417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a" returned: 0 in 0.438s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:53:27 devstack cinder-volume[88899]: DEBUG cinder.manager [None req-96a95d0c-5335-4bd5-a269-65893144d15f tempest-ProjectMemberTests-1353074417 None] Notifying Schedulers of capabilities ... {{(pid=88899) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 08:53:27 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-96a95d0c-5335-4bd5-a269-65893144d15f tempest-ProjectMemberTests-1353074417 None] Deleted volume successfully. Aug 03 08:53:27 devstack sudo[112116]: pam_unix(sudo:session): session closed for user root Aug 03 08:53:27 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-d71cd711-36d2-4d9c-95ca-4901875136a0 tempest-CreateVolumesFromSnapshotTest-2011744404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-12cb2f26-c24e-4b7c-b6ac-768e61e7676e -F qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-12cb2f26-c24e-4b7c-b6ac-768e61e7676e.37e9d66f-44cb-4ac6-a724-cc67c84b0a21" returned: 0 in 0.579s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:53:27 devstack cinder-volume[88899]: WARNING cinder.volume.drivers.remotefs [None req-d71cd711-36d2-4d9c-95ca-4901875136a0 tempest-CreateVolumesFromSnapshotTest-2011744404 None] /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-12cb2f26-c24e-4b7c-b6ac-768e61e7676e.37e9d66f-44cb-4ac6-a724-cc67c84b0a21 is being set with open permissions: ugo+rw Aug 03 08:53:27 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-d71cd711-36d2-4d9c-95ca-4901875136a0 tempest-CreateVolumesFromSnapshotTest-2011744404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-12cb2f26-c24e-4b7c-b6ac-768e61e7676e.37e9d66f-44cb-4ac6-a724-cc67c84b0a21 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:53:28 devstack sudo[112124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-12cb2f26-c24e-4b7c-b6ac-768e61e7676e.37e9d66f-44cb-4ac6-a724-cc67c84b0a21 Aug 03 08:53:28 devstack sudo[112124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:53:28 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-96a95d0c-5335-4bd5-a269-65893144d15f tempest-ProjectMemberTests-1353074417 None] Lock "cinder-90e29bc4-3f11-4cbb-89c9-2b08888e5edb-delete_volume" released by "delete_volume" :: held 1.499s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:53:28 devstack cinder-volume[88899]: DEBUG cinder.volume.flows.manager.create_volume [None req-4e397f56-f50e-4982-838e-534dd88eb844 tempest-VolumeDependencyTests-1512358985 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88899) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 08:53:28 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-4e397f56-f50e-4982-838e-534dd88eb844 tempest-VolumeDependencyTests-1512358985 None] Flow 'volume_create_manager' (da43c8fe-4cd7-4294-b4f6-7c6f607842f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:53:28 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-4e397f56-f50e-4982-838e-534dd88eb844 tempest-VolumeDependencyTests-1512358985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f7b8204a-7715-43a7-90bb-7a83b060780b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:53:28 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-4e397f56-f50e-4982-838e-534dd88eb844 tempest-VolumeDependencyTests-1512358985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f7b8204a-7715-43a7-90bb-7a83b060780b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:53:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1095579540',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b24bb72-96b2-432f-aa36-80783dfd40ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d30b387eb9b94bb589dfe04f0d2eac6d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:53:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=2020514f-ed33-440d-ac66-99bda5184fc5,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:53:28Z,use_quota=True,user_id='12ab9b4d5d894d608b06e312639537e8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8bde7129-1dc4-42ab-b852-ab32c61b4921),volume_type_id=8bde7129-1dc4-42ab-b852-ab32c61b4921)' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:53:28 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-4e397f56-f50e-4982-838e-534dd88eb844 tempest-VolumeDependencyTests-1512358985 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d94af395-bfae-45fe-9180-6b766bd04dbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:53:28 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-4e397f56-f50e-4982-838e-534dd88eb844 tempest-VolumeDependencyTests-1512358985 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d94af395-bfae-45fe-9180-6b766bd04dbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:53:28 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-4e397f56-f50e-4982-838e-534dd88eb844 tempest-VolumeDependencyTests-1512358985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c9e4063-767d-4b44-8736-189843cc458f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:53:28 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-4e397f56-f50e-4982-838e-534dd88eb844 tempest-VolumeDependencyTests-1512358985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c9e4063-767d-4b44-8736-189843cc458f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '4b24bb72-96b2-432f-aa36-80783dfd40ca', 'volume_name': 'volume-4b24bb72-96b2-432f-aa36-80783dfd40ca', 'volume_size': 1, 'snapshot_id': '2020514f-ed33-440d-ac66-99bda5184fc5'}' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:53:28 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-4e397f56-f50e-4982-838e-534dd88eb844 tempest-VolumeDependencyTests-1512358985 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d646b56-495a-461d-b3f2-75b5ff5f1c05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:53:28 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-4e397f56-f50e-4982-838e-534dd88eb844 tempest-VolumeDependencyTests-1512358985 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d646b56-495a-461d-b3f2-75b5ff5f1c05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:53:28 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-4e397f56-f50e-4982-838e-534dd88eb844 tempest-VolumeDependencyTests-1512358985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d9e40703-cbc7-4979-a43a-ddf45ebf0654) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:53:28 devstack cinder-volume[88899]: INFO cinder.volume.flows.manager.create_volume [None req-4e397f56-f50e-4982-838e-534dd88eb844 tempest-VolumeDependencyTests-1512358985 None] Volume 4b24bb72-96b2-432f-aa36-80783dfd40ca: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-4b24bb72-96b2-432f-aa36-80783dfd40ca', 'volume_size': 1, 'snapshot_id': '2020514f-ed33-440d-ac66-99bda5184fc5'} Aug 03 08:53:28 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-4e397f56-f50e-4982-838e-534dd88eb844 tempest-VolumeDependencyTests-1512358985 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:53:28 devstack sudo[112124]: pam_unix(sudo:session): session closed for user root Aug 03 08:53:28 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-d71cd711-36d2-4d9c-95ca-4901875136a0 tempest-CreateVolumesFromSnapshotTest-2011744404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-12cb2f26-c24e-4b7c-b6ac-768e61e7676e.37e9d66f-44cb-4ac6-a724-cc67c84b0a21" returned: 0 in 0.382s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:53:28 devstack cinder-volume[88899]: DEBUG cinder.volume.flows.manager.create_volume [None req-dde1040c-fa95-4ed2-84c6-897d842430ac tempest-ProjectMemberTests-1353074417 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88899) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 08:53:28 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-dde1040c-fa95-4ed2-84c6-897d842430ac tempest-ProjectMemberTests-1353074417 None] Flow 'volume_create_manager' (c2ac0683-64f8-4615-bb0b-a2711b372078) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:53:28 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-dde1040c-fa95-4ed2-84c6-897d842430ac tempest-ProjectMemberTests-1353074417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7cb4f80c-f8d5-494a-a9bf-0bdb9b529446) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:53:28 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-dde1040c-fa95-4ed2-84c6-897d842430ac tempest-ProjectMemberTests-1353074417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7cb4f80c-f8d5-494a-a9bf-0bdb9b529446) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:53:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1545893204',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=428cac50-82ad-4eab-ae80-c9b5769f62ab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b723e915839a4036ad739740ec4db0cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:53:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:53:28Z,use_quota=True,user_id='d9152484679b4fb79b0d8896a2a67eb9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8bde7129-1dc4-42ab-b852-ab32c61b4921),volume_type_id=8bde7129-1dc4-42ab-b852-ab32c61b4921)' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:53:28 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-dde1040c-fa95-4ed2-84c6-897d842430ac tempest-ProjectMemberTests-1353074417 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b98a5ac4-01f3-4815-8390-17edcfbb335e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:53:28 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-dde1040c-fa95-4ed2-84c6-897d842430ac tempest-ProjectMemberTests-1353074417 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b98a5ac4-01f3-4815-8390-17edcfbb335e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:53:28 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-dde1040c-fa95-4ed2-84c6-897d842430ac tempest-ProjectMemberTests-1353074417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba28d8ea-e7f3-41d3-9ff1-436402d30a59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:53:28 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-dde1040c-fa95-4ed2-84c6-897d842430ac tempest-ProjectMemberTests-1353074417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba28d8ea-e7f3-41d3-9ff1-436402d30a59) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '428cac50-82ad-4eab-ae80-c9b5769f62ab', 'volume_name': 'volume-428cac50-82ad-4eab-ae80-c9b5769f62ab', 'volume_size': 1}' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:53:28 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-dde1040c-fa95-4ed2-84c6-897d842430ac tempest-ProjectMemberTests-1353074417 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (66d5f058-7e3d-4959-a24a-990aac9d0f5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:53:28 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-dde1040c-fa95-4ed2-84c6-897d842430ac tempest-ProjectMemberTests-1353074417 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (66d5f058-7e3d-4959-a24a-990aac9d0f5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:53:28 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-dde1040c-fa95-4ed2-84c6-897d842430ac tempest-ProjectMemberTests-1353074417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b42cbad-01e1-4799-997a-04af2f5d45ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:53:28 devstack cinder-volume[88899]: INFO cinder.volume.flows.manager.create_volume [None req-dde1040c-fa95-4ed2-84c6-897d842430ac tempest-ProjectMemberTests-1353074417 None] Volume 428cac50-82ad-4eab-ae80-c9b5769f62ab: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-428cac50-82ad-4eab-ae80-c9b5769f62ab', 'volume_size': 1} Aug 03 08:53:28 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-dde1040c-fa95-4ed2-84c6-897d842430ac tempest-ProjectMemberTests-1353074417 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:53:28 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-d71cd711-36d2-4d9c-95ca-4901875136a0 tempest-CreateVolumesFromSnapshotTest-2011744404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-12cb2f26-c24e-4b7c-b6ac-768e61e7676e.info {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:53:28 devstack sudo[112127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-12cb2f26-c24e-4b7c-b6ac-768e61e7676e.info Aug 03 08:53:28 devstack sudo[112127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:53:28 devstack sudo[112127]: pam_unix(sudo:session): session closed for user root Aug 03 08:53:28 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-d71cd711-36d2-4d9c-95ca-4901875136a0 tempest-CreateVolumesFromSnapshotTest-2011744404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-12cb2f26-c24e-4b7c-b6ac-768e61e7676e.info" returned: 0 in 0.257s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:53:28 devstack cinder-volume[88899]: WARNING cinder.volume.drivers.remotefs [None req-d71cd711-36d2-4d9c-95ca-4901875136a0 tempest-CreateVolumesFromSnapshotTest-2011744404 None] /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-12cb2f26-c24e-4b7c-b6ac-768e61e7676e.info is being set with open permissions: ugo+rw Aug 03 08:53:28 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-d71cd711-36d2-4d9c-95ca-4901875136a0 tempest-CreateVolumesFromSnapshotTest-2011744404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-12cb2f26-c24e-4b7c-b6ac-768e61e7676e.info {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:53:28 devstack sudo[112131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-12cb2f26-c24e-4b7c-b6ac-768e61e7676e.info Aug 03 08:53:28 devstack sudo[112131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:53:28 devstack sudo[112131]: pam_unix(sudo:session): session closed for user root Aug 03 08:53:28 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-d71cd711-36d2-4d9c-95ca-4901875136a0 tempest-CreateVolumesFromSnapshotTest-2011744404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-12cb2f26-c24e-4b7c-b6ac-768e61e7676e.info" returned: 0 in 0.271s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:53:29 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-d71cd711-36d2-4d9c-95ca-4901875136a0 tempest-CreateVolumesFromSnapshotTest-2011744404 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.668s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:53:29 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-4e397f56-f50e-4982-838e-534dd88eb844 tempest-VolumeDependencyTests-1512358985 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.777s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:53:29 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-4e397f56-f50e-4982-838e-534dd88eb844 tempest-VolumeDependencyTests-1512358985 None] Acquiring lock "cinder-quobyte-2020514f-ed33-440d-ac66-99bda5184fc5-4b24bb72-96b2-432f-aa36-80783dfd40ca" by "_create_volume_from_snapshot" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:53:29 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-4e397f56-f50e-4982-838e-534dd88eb844 tempest-VolumeDependencyTests-1512358985 None] Lock "cinder-quobyte-2020514f-ed33-440d-ac66-99bda5184fc5-4b24bb72-96b2-432f-aa36-80783dfd40ca" acquired by "_create_volume_from_snapshot" :: waited 0.026s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:53:29 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-4e397f56-f50e-4982-838e-534dd88eb844 tempest-VolumeDependencyTests-1512358985 None] Creating volume 4b24bb72-96b2-432f-aa36-80783dfd40ca from snapshot 2020514f-ed33-440d-ac66-99bda5184fc5 {{(pid=88899) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Aug 03 08:53:29 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-4e397f56-f50e-4982-838e-534dd88eb844 tempest-VolumeDependencyTests-1512358985 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:53:29 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-4e397f56-f50e-4982-838e-534dd88eb844 tempest-VolumeDependencyTests-1512358985 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:53:29 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-4e397f56-f50e-4982-838e-534dd88eb844 tempest-VolumeDependencyTests-1512358985 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:53:29 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-4e397f56-f50e-4982-838e-534dd88eb844 tempest-VolumeDependencyTests-1512358985 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:53:29 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-4e397f56-f50e-4982-838e-534dd88eb844 tempest-VolumeDependencyTests-1512358985 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:53:29 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-4e397f56-f50e-4982-838e-534dd88eb844 tempest-VolumeDependencyTests-1512358985 None] Selected osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385 as target Quobyte volume. {{(pid=88899) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 08:53:29 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-4e397f56-f50e-4982-838e-534dd88eb844 tempest-VolumeDependencyTests-1512358985 None] Acquiring lock "cinder-quobyte-4b24bb72-96b2-432f-aa36-80783dfd40ca" by "_copy_volume_from_snapshot" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:53:29 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-d71cd711-36d2-4d9c-95ca-4901875136a0 tempest-CreateVolumesFromSnapshotTest-2011744404 None] Create snapshot completed successfully Aug 03 08:53:29 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-4e397f56-f50e-4982-838e-534dd88eb844 tempest-VolumeDependencyTests-1512358985 None] Lock "cinder-quobyte-4b24bb72-96b2-432f-aa36-80783dfd40ca" acquired by "_copy_volume_from_snapshot" :: waited 0.020s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:53:29 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-4e397f56-f50e-4982-838e-534dd88eb844 tempest-VolumeDependencyTests-1512358985 None] snapshot: 2020514f-ed33-440d-ac66-99bda5184fc5, volume: 4b24bb72-96b2-432f-aa36-80783dfd40ca, {{(pid=88899) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Aug 03 08:53:29 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-4e397f56-f50e-4982-838e-534dd88eb844 tempest-VolumeDependencyTests-1512358985 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:53:29 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-4e397f56-f50e-4982-838e-534dd88eb844 tempest-VolumeDependencyTests-1512358985 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:53:29 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-4e397f56-f50e-4982-838e-534dd88eb844 tempest-VolumeDependencyTests-1512358985 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:53:29 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-4e397f56-f50e-4982-838e-534dd88eb844 tempest-VolumeDependencyTests-1512358985 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:53:29 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-4e397f56-f50e-4982-838e-534dd88eb844 tempest-VolumeDependencyTests-1512358985 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:53:29 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8e84b8c-f7f8-4590-8eb6-5433c9956146]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:53:29 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-4e397f56-f50e-4982-838e-534dd88eb844 tempest-VolumeDependencyTests-1512358985 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-1b1ea719-0de3-48d6-ab8a-b62a8b3ce570.2020514f-ed33-440d-ac66-99bda5184fc5 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:53:29 devstack cinder-volume[88899]: DEBUG cinder.volume.flows.manager.create_volume [None req-a81dacbb-4764-4cda-80ee-64ca831060c9 tempest-VolumeImageDependencyTests-942168115 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88899) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 08:53:29 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-a81dacbb-4764-4cda-80ee-64ca831060c9 tempest-VolumeImageDependencyTests-942168115 None] Flow 'volume_create_manager' (65e682c0-4ba7-4015-8483-1f9224f313d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:53:29 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-a81dacbb-4764-4cda-80ee-64ca831060c9 tempest-VolumeImageDependencyTests-942168115 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9aa74cf5-1fd0-4ea6-8828-89ee0e29fe87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:53:29 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-a81dacbb-4764-4cda-80ee-64ca831060c9 tempest-VolumeImageDependencyTests-942168115 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9aa74cf5-1fd0-4ea6-8828-89ee0e29fe87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:53:29Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d50f3846-58cd-476d-9c37-57aa92522f39,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fb20ce3648d1497fb23ac775415e7a44',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:53:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:53:29Z,use_quota=True,user_id='ec19afbca65f4a8185b3231a39404ec7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8bde7129-1dc4-42ab-b852-ab32c61b4921),volume_type_id=8bde7129-1dc4-42ab-b852-ab32c61b4921)' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:53:29 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-a81dacbb-4764-4cda-80ee-64ca831060c9 tempest-VolumeImageDependencyTests-942168115 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eedfd0eb-5d4a-4251-a790-b75a7762b54f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:53:29 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-a81dacbb-4764-4cda-80ee-64ca831060c9 tempest-VolumeImageDependencyTests-942168115 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eedfd0eb-5d4a-4251-a790-b75a7762b54f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:53:29 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-a81dacbb-4764-4cda-80ee-64ca831060c9 tempest-VolumeImageDependencyTests-942168115 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (767cb0b0-a9e5-4b4d-a864-174ed9f33854) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:53:29 devstack cinder-volume[88899]: DEBUG cinder.image.glance [None req-a81dacbb-4764-4cda-80ee-64ca831060c9 tempest-VolumeImageDependencyTests-942168115 None] Creating Keystone auth plugin from conf {{(pid=88899) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Aug 03 08:53:29 devstack sudo[112134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-1b1ea719-0de3-48d6-ab8a-b62a8b3ce570.2020514f-ed33-440d-ac66-99bda5184fc5 Aug 03 08:53:29 devstack sudo[112134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:53:29 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-a81dacbb-4764-4cda-80ee-64ca831060c9 tempest-VolumeImageDependencyTests-942168115 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (767cb0b0-a9e5-4b4d-a864-174ed9f33854) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'd50f3846-58cd-476d-9c37-57aa92522f39', 'volume_name': 'volume-d50f3846-58cd-476d-9c37-57aa92522f39', 'volume_size': 1, 'image_id': '1435848d-019d-4424-831a-f8b222a6c758', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1435848d-019d-4424-831a-f8b222a6c758', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '760a94e30d47b29c6af6873ce229b36e', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'fb20ce3648d1497fb23ac775415e7a44', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '58057695f21c01b2828f619724c516ede91cf41bbb4e9d7dbb6550d2417348d86b863c799759ebf0bfaca6b4cffe95366e93156cc53a8d7da150a42d88963540', 'id': '1435848d-019d-4424-831a-f8b222a6c758', 'created_at': datetime.datetime(2026, 8, 3, 6, 53, 27, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 3, 6, 53, 28, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1435848d-019d-4424-831a-f8b222a6c758/file', 'properties': {}}, 'image_service': }' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:53:29 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-a81dacbb-4764-4cda-80ee-64ca831060c9 tempest-VolumeImageDependencyTests-942168115 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f00b761a-396d-498c-8e2d-75649ae6f27c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:53:29 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-a81dacbb-4764-4cda-80ee-64ca831060c9 tempest-VolumeImageDependencyTests-942168115 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f00b761a-396d-498c-8e2d-75649ae6f27c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:53:29 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-a81dacbb-4764-4cda-80ee-64ca831060c9 tempest-VolumeImageDependencyTests-942168115 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ba421e3-e322-4462-8be7-eac54ebbb9a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:53:29 devstack cinder-volume[88899]: INFO cinder.volume.flows.manager.create_volume [None req-a81dacbb-4764-4cda-80ee-64ca831060c9 tempest-VolumeImageDependencyTests-942168115 None] Volume d50f3846-58cd-476d-9c37-57aa92522f39: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-d50f3846-58cd-476d-9c37-57aa92522f39', 'volume_size': 1, 'image_id': '1435848d-019d-4424-831a-f8b222a6c758', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1435848d-019d-4424-831a-f8b222a6c758', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '760a94e30d47b29c6af6873ce229b36e', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'fb20ce3648d1497fb23ac775415e7a44', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '58057695f21c01b2828f619724c516ede91cf41bbb4e9d7dbb6550d2417348d86b863c799759ebf0bfaca6b4cffe95366e93156cc53a8d7da150a42d88963540', 'id': '1435848d-019d-4424-831a-f8b222a6c758', 'created_at': datetime.datetime(2026, 8, 3, 6, 53, 27, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 3, 6, 53, 28, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1435848d-019d-4424-831a-f8b222a6c758/file', 'properties': {}}, 'image_service': } Aug 03 08:53:29 devstack cinder-volume[88899]: DEBUG cinder.volume.flows.manager.create_volume [None req-a81dacbb-4764-4cda-80ee-64ca831060c9 tempest-VolumeImageDependencyTests-942168115 None] Trying to clone d50f3846-58cd-476d-9c37-57aa92522f39 from image 1435848d-019d-4424-831a-f8b222a6c758 at location (None, [{'url': 'file:///opt/stack/data/glance/images/1435848d-019d-4424-831a-f8b222a6c758', 'metadata': {}}]). {{(pid=88899) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Aug 03 08:53:29 devstack sudo[112134]: pam_unix(sudo:session): session closed for user root Aug 03 08:53:29 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-4e397f56-f50e-4982-838e-534dd88eb844 tempest-VolumeDependencyTests-1512358985 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-1b1ea719-0de3-48d6-ab8a-b62a8b3ce570.2020514f-ed33-440d-ac66-99bda5184fc5" returned: 0 in 0.374s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:53:29 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-4e397f56-f50e-4982-838e-534dd88eb844 tempest-VolumeDependencyTests-1512358985 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1b1ea719-0de3-48d6-ab8a-b62a8b3ce570(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88899) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 03 08:53:29 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[a15401e8-79f1-4fce-a4c1-0947da82c4ff]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:53:29 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-4e397f56-f50e-4982-838e-534dd88eb844 tempest-VolumeDependencyTests-1512358985 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-1b1ea719-0de3-48d6-ab8a-b62a8b3ce570 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:53:29 devstack cinder-volume[88899]: DEBUG cinder.image.image_utils [None req-a81dacbb-4764-4cda-80ee-64ca831060c9 tempest-VolumeImageDependencyTests-942168115 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_1435848d-019d-4424-831a-f8b222a6c758_xl4ke8w1devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=88899) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Aug 03 08:53:29 devstack cinder-volume[88899]: INFO cinder.image.image_utils [None req-a81dacbb-4764-4cda-80ee-64ca831060c9 tempest-VolumeImageDependencyTests-942168115 None] Image download 0.00 MB at 0.00 MB/s Aug 03 08:53:29 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a1426a4-7395-4c57-ae14-ed147999752c]: (4, 'raw') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:53:29 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-a81dacbb-4764-4cda-80ee-64ca831060c9 tempest-VolumeImageDependencyTests-942168115 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1435848d-019d-4424-831a-f8b222a6c758_xl4ke8w1devstack@QuobyteHD {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:53:29 devstack sudo[112139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-1b1ea719-0de3-48d6-ab8a-b62a8b3ce570 Aug 03 08:53:29 devstack sudo[112139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:53:29 devstack sudo[112140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1435848d-019d-4424-831a-f8b222a6c758_xl4ke8w1devstack@QuobyteHD Aug 03 08:53:29 devstack sudo[112140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:53:29 devstack sudo[112139]: pam_unix(sudo:session): session closed for user root Aug 03 08:53:29 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-4e397f56-f50e-4982-838e-534dd88eb844 tempest-VolumeDependencyTests-1512358985 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-1b1ea719-0de3-48d6-ab8a-b62a8b3ce570" returned: 0 in 0.408s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:53:29 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-4e397f56-f50e-4982-838e-534dd88eb844 tempest-VolumeDependencyTests-1512358985 None] will copy from snapshot at /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-1b1ea719-0de3-48d6-ab8a-b62a8b3ce570 {{(pid=88899) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Aug 03 08:53:29 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-4e397f56-f50e-4982-838e-534dd88eb844 tempest-VolumeDependencyTests-1512358985 None] Creating direct copy from snapshot {{(pid=88899) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Aug 03 08:53:29 devstack cinder-volume[88899]: DEBUG cinder.utils [None req-4e397f56-f50e-4982-838e-534dd88eb844 tempest-VolumeDependencyTests-1512358985 None] Path /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-4b24bb72-96b2-432f-aa36-80783dfd40ca not found in is_blk_device check {{(pid=88899) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Aug 03 08:53:29 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-4e397f56-f50e-4982-838e-534dd88eb844 tempest-VolumeDependencyTests-1512358985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-1b1ea719-0de3-48d6-ab8a-b62a8b3ce570 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-4b24bb72-96b2-432f-aa36-80783dfd40ca {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:53:29 devstack sudo[112140]: pam_unix(sudo:session): session closed for user root Aug 03 08:53:29 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-a81dacbb-4764-4cda-80ee-64ca831060c9 tempest-VolumeImageDependencyTests-942168115 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1435848d-019d-4424-831a-f8b222a6c758_xl4ke8w1devstack@QuobyteHD" returned: 0 in 0.351s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:53:29 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-a81dacbb-4764-4cda-80ee-64ca831060c9 tempest-VolumeImageDependencyTests-942168115 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1435848d-019d-4424-831a-f8b222a6c758_xl4ke8w1devstack@QuobyteHD {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:53:29 devstack sudo[112148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-1b1ea719-0de3-48d6-ab8a-b62a8b3ce570 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-4b24bb72-96b2-432f-aa36-80783dfd40ca Aug 03 08:53:29 devstack sudo[112148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:53:30 devstack sudo[112149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1435848d-019d-4424-831a-f8b222a6c758_xl4ke8w1devstack@QuobyteHD Aug 03 08:53:30 devstack sudo[112149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:53:30 devstack cinder-volume[88899]: DEBUG cinder.volume.flows.manager.create_volume [None req-ea4d993b-2dfa-4bef-87e1-03894c1216cf tempest-CreateVolumesFromSnapshotTest-2011744404 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88899) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 08:53:30 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-ea4d993b-2dfa-4bef-87e1-03894c1216cf tempest-CreateVolumesFromSnapshotTest-2011744404 None] Flow 'volume_create_manager' (b214a492-687b-4189-961b-77ab7ae6ac3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:53:30 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-ea4d993b-2dfa-4bef-87e1-03894c1216cf tempest-CreateVolumesFromSnapshotTest-2011744404 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d3d2686-305d-49d3-957b-70f5720e6b33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:53:30 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-ea4d993b-2dfa-4bef-87e1-03894c1216cf tempest-CreateVolumesFromSnapshotTest-2011744404 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d3d2686-305d-49d3-957b-70f5720e6b33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:53:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1342573330',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=091ab459-ad7c-4a1e-9033-d1d690cf93cf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c48ec6495e45472bb1d655075844c178',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:53:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:53:30Z,use_quota=True,user_id='7544fdd40c9c4f319f124d229d006559',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8bde7129-1dc4-42ab-b852-ab32c61b4921),volume_type_id=8bde7129-1dc4-42ab-b852-ab32c61b4921)' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:53:30 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-ea4d993b-2dfa-4bef-87e1-03894c1216cf tempest-CreateVolumesFromSnapshotTest-2011744404 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34d6264a-85cb-4732-ab10-6421a89e83c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:53:30 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-ea4d993b-2dfa-4bef-87e1-03894c1216cf tempest-CreateVolumesFromSnapshotTest-2011744404 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34d6264a-85cb-4732-ab10-6421a89e83c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:53:30 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-ea4d993b-2dfa-4bef-87e1-03894c1216cf tempest-CreateVolumesFromSnapshotTest-2011744404 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33d834ee-5066-4d0d-9f1a-787d023419f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:53:30 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-ea4d993b-2dfa-4bef-87e1-03894c1216cf tempest-CreateVolumesFromSnapshotTest-2011744404 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33d834ee-5066-4d0d-9f1a-787d023419f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '091ab459-ad7c-4a1e-9033-d1d690cf93cf', 'volume_name': 'volume-091ab459-ad7c-4a1e-9033-d1d690cf93cf', 'volume_size': 1}' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:53:30 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-ea4d993b-2dfa-4bef-87e1-03894c1216cf tempest-CreateVolumesFromSnapshotTest-2011744404 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74a9b9ef-d9a5-4737-98f3-44b70eb38c23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:53:30 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-ea4d993b-2dfa-4bef-87e1-03894c1216cf tempest-CreateVolumesFromSnapshotTest-2011744404 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74a9b9ef-d9a5-4737-98f3-44b70eb38c23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:53:30 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-ea4d993b-2dfa-4bef-87e1-03894c1216cf tempest-CreateVolumesFromSnapshotTest-2011744404 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db3f091a-bfdc-425e-b477-0acc511cd19a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:53:30 devstack cinder-volume[88899]: INFO cinder.volume.flows.manager.create_volume [None req-ea4d993b-2dfa-4bef-87e1-03894c1216cf tempest-CreateVolumesFromSnapshotTest-2011744404 None] Volume 091ab459-ad7c-4a1e-9033-d1d690cf93cf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-091ab459-ad7c-4a1e-9033-d1d690cf93cf', 'volume_size': 1} Aug 03 08:53:30 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-ea4d993b-2dfa-4bef-87e1-03894c1216cf tempest-CreateVolumesFromSnapshotTest-2011744404 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:53:30 devstack sudo[112149]: pam_unix(sudo:session): session closed for user root Aug 03 08:53:30 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-a81dacbb-4764-4cda-80ee-64ca831060c9 tempest-VolumeImageDependencyTests-942168115 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1435848d-019d-4424-831a-f8b222a6c758_xl4ke8w1devstack@QuobyteHD" returned: 1 in 0.472s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:53:30 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-a81dacbb-4764-4cda-80ee-64ca831060c9 tempest-VolumeImageDependencyTests-942168115 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1435848d-019d-4424-831a-f8b222a6c758_xl4ke8w1devstack@QuobyteHD' failed. Not Retrying. {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 03 08:53:30 devstack cinder-volume[88899]: DEBUG cinder.image.image_utils [None req-a81dacbb-4764-4cda-80ee-64ca831060c9 tempest-VolumeImageDependencyTests-942168115 None] Temporary image 1435848d-019d-4424-831a-f8b222a6c758 is fetched for user ec19afbca65f4a8185b3231a39404ec7. {{(pid=88899) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Aug 03 08:53:30 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b488647-4ed1-4b37-b2c9-b0559224d9b6]: (4, 'raw') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:53:30 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-a81dacbb-4764-4cda-80ee-64ca831060c9 tempest-VolumeImageDependencyTests-942168115 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1435848d-019d-4424-831a-f8b222a6c758_xl4ke8w1devstack@QuobyteHD {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:53:30 devstack sudo[112148]: pam_unix(sudo:session): session closed for user root Aug 03 08:53:30 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-4e397f56-f50e-4982-838e-534dd88eb844 tempest-VolumeDependencyTests-1512358985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-1b1ea719-0de3-48d6-ab8a-b62a8b3ce570 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-4b24bb72-96b2-432f-aa36-80783dfd40ca" returned: 0 in 0.658s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:53:30 devstack cinder-volume[88899]: DEBUG cinder.image.image_utils [None req-4e397f56-f50e-4982-838e-534dd88eb844 tempest-VolumeDependencyTests-1512358985 None] Image conversion details: src /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-1b1ea719-0de3-48d6-ab8a-b62a8b3ce570, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-4b24bb72-96b2-432f-aa36-80783dfd40ca {{(pid=88899) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 03 08:53:30 devstack cinder-volume[88899]: INFO cinder.image.image_utils [None req-4e397f56-f50e-4982-838e-534dd88eb844 tempest-VolumeDependencyTests-1512358985 None] Converted 1024.00 MB image at 1024.00 MB/s Aug 03 08:53:30 devstack cinder-volume[88899]: WARNING cinder.volume.drivers.remotefs [None req-4e397f56-f50e-4982-838e-534dd88eb844 tempest-VolumeDependencyTests-1512358985 None] /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-4b24bb72-96b2-432f-aa36-80783dfd40ca is being set with open permissions: ugo+rw Aug 03 08:53:30 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-4e397f56-f50e-4982-838e-534dd88eb844 tempest-VolumeDependencyTests-1512358985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-4b24bb72-96b2-432f-aa36-80783dfd40ca {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:53:30 devstack sudo[112161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-4b24bb72-96b2-432f-aa36-80783dfd40ca Aug 03 08:53:30 devstack sudo[112161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:53:30 devstack cinder-volume[88899]: DEBUG cinder.volume.flows.manager.create_volume [None req-5ea9ca6b-7255-407c-a768-e74da92f7c09 tempest-CreateVolumesFromSnapshotTest-2011744404 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88899) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 08:53:30 devstack sudo[112160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1435848d-019d-4424-831a-f8b222a6c758_xl4ke8w1devstack@QuobyteHD Aug 03 08:53:30 devstack sudo[112160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:53:30 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-5ea9ca6b-7255-407c-a768-e74da92f7c09 tempest-CreateVolumesFromSnapshotTest-2011744404 None] Flow 'volume_create_manager' (a3b4ddbb-9e9a-4193-a6bb-34fe0e50e3dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:53:30 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-5ea9ca6b-7255-407c-a768-e74da92f7c09 tempest-CreateVolumesFromSnapshotTest-2011744404 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fee985db-8b9f-4aac-8af5-feac00f1b923) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:53:30 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-5ea9ca6b-7255-407c-a768-e74da92f7c09 tempest-CreateVolumesFromSnapshotTest-2011744404 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fee985db-8b9f-4aac-8af5-feac00f1b923) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:53:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-914206896',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8212e20b-b962-484c-87c9-a005a5381f5e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c48ec6495e45472bb1d655075844c178',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:53:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:53:31Z,use_quota=True,user_id='7544fdd40c9c4f319f124d229d006559',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8bde7129-1dc4-42ab-b852-ab32c61b4921),volume_type_id=8bde7129-1dc4-42ab-b852-ab32c61b4921)' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:53:30 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-5ea9ca6b-7255-407c-a768-e74da92f7c09 tempest-CreateVolumesFromSnapshotTest-2011744404 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (092cc9f3-06cb-49e8-a8ea-a380ea08a5f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:53:30 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-5ea9ca6b-7255-407c-a768-e74da92f7c09 tempest-CreateVolumesFromSnapshotTest-2011744404 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (092cc9f3-06cb-49e8-a8ea-a380ea08a5f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:53:30 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-5ea9ca6b-7255-407c-a768-e74da92f7c09 tempest-CreateVolumesFromSnapshotTest-2011744404 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01f7f3b7-ef1f-4953-bd26-05ff0914d765) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:53:30 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-5ea9ca6b-7255-407c-a768-e74da92f7c09 tempest-CreateVolumesFromSnapshotTest-2011744404 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01f7f3b7-ef1f-4953-bd26-05ff0914d765) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8212e20b-b962-484c-87c9-a005a5381f5e', 'volume_name': 'volume-8212e20b-b962-484c-87c9-a005a5381f5e', 'volume_size': 1}' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:53:30 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-5ea9ca6b-7255-407c-a768-e74da92f7c09 tempest-CreateVolumesFromSnapshotTest-2011744404 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c78395f-bc30-447e-9444-2c24972bbb12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:53:30 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-5ea9ca6b-7255-407c-a768-e74da92f7c09 tempest-CreateVolumesFromSnapshotTest-2011744404 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c78395f-bc30-447e-9444-2c24972bbb12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:53:30 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-5ea9ca6b-7255-407c-a768-e74da92f7c09 tempest-CreateVolumesFromSnapshotTest-2011744404 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd254951-8784-42a7-b941-2dad57579485) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:53:30 devstack cinder-volume[88899]: INFO cinder.volume.flows.manager.create_volume [None req-5ea9ca6b-7255-407c-a768-e74da92f7c09 tempest-CreateVolumesFromSnapshotTest-2011744404 None] Volume 8212e20b-b962-484c-87c9-a005a5381f5e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8212e20b-b962-484c-87c9-a005a5381f5e', 'volume_size': 1} Aug 03 08:53:30 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-5ea9ca6b-7255-407c-a768-e74da92f7c09 tempest-CreateVolumesFromSnapshotTest-2011744404 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:53:30 devstack sudo[112161]: pam_unix(sudo:session): session closed for user root Aug 03 08:53:30 devstack sudo[112160]: pam_unix(sudo:session): session closed for user root Aug 03 08:53:30 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-a81dacbb-4764-4cda-80ee-64ca831060c9 tempest-VolumeImageDependencyTests-942168115 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1435848d-019d-4424-831a-f8b222a6c758_xl4ke8w1devstack@QuobyteHD" returned: 0 in 0.409s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:53:30 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-a81dacbb-4764-4cda-80ee-64ca831060c9 tempest-VolumeImageDependencyTests-942168115 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1435848d-019d-4424-831a-f8b222a6c758_xl4ke8w1devstack@QuobyteHD {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:53:30 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-4e397f56-f50e-4982-838e-534dd88eb844 tempest-VolumeDependencyTests-1512358985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-4b24bb72-96b2-432f-aa36-80783dfd40ca" returned: 0 in 0.364s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:53:30 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-4e397f56-f50e-4982-838e-534dd88eb844 tempest-VolumeDependencyTests-1512358985 None] Lock "cinder-quobyte-4b24bb72-96b2-432f-aa36-80783dfd40ca" released by "_copy_volume_from_snapshot" :: held 1.920s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:53:31 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-4e397f56-f50e-4982-838e-534dd88eb844 tempest-VolumeDependencyTests-1512358985 None] Lock "cinder-quobyte-2020514f-ed33-440d-ac66-99bda5184fc5-4b24bb72-96b2-432f-aa36-80783dfd40ca" released by "_create_volume_from_snapshot" :: held 2.025s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:53:31 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-4e397f56-f50e-4982-838e-534dd88eb844 tempest-VolumeDependencyTests-1512358985 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 2.052s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:53:31 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-dde1040c-fa95-4ed2-84c6-897d842430ac tempest-ProjectMemberTests-1353074417 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.621s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:53:31 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-dde1040c-fa95-4ed2-84c6-897d842430ac tempest-ProjectMemberTests-1353074417 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:53:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1545893204',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=428cac50-82ad-4eab-ae80-c9b5769f62ab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b723e915839a4036ad739740ec4db0cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:53:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:53:28Z,use_quota=True,user_id='d9152484679b4fb79b0d8896a2a67eb9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8bde7129-1dc4-42ab-b852-ab32c61b4921),volume_type_id=8bde7129-1dc4-42ab-b852-ab32c61b4921)}" {{(pid=88899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 08:53:31 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-dde1040c-fa95-4ed2-84c6-897d842430ac tempest-ProjectMemberTests-1353074417 None] Creating volume 428cac50-82ad-4eab-ae80-c9b5769f62ab {{(pid=88899) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 08:53:31 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-dde1040c-fa95-4ed2-84c6-897d842430ac tempest-ProjectMemberTests-1353074417 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:53:31 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-dde1040c-fa95-4ed2-84c6-897d842430ac tempest-ProjectMemberTests-1353074417 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:53:31 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-dde1040c-fa95-4ed2-84c6-897d842430ac tempest-ProjectMemberTests-1353074417 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:53:31 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-dde1040c-fa95-4ed2-84c6-897d842430ac tempest-ProjectMemberTests-1353074417 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:53:31 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-dde1040c-fa95-4ed2-84c6-897d842430ac tempest-ProjectMemberTests-1353074417 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:53:31 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-dde1040c-fa95-4ed2-84c6-897d842430ac tempest-ProjectMemberTests-1353074417 None] Selected osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385 as target Quobyte volume. {{(pid=88899) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 08:53:31 devstack cinder-volume[88899]: INFO cinder.volume.drivers.remotefs [None req-dde1040c-fa95-4ed2-84c6-897d842430ac tempest-ProjectMemberTests-1353074417 None] casted to osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385 Aug 03 08:53:31 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-dde1040c-fa95-4ed2-84c6-897d842430ac tempest-ProjectMemberTests-1353074417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-428cac50-82ad-4eab-ae80-c9b5769f62ab 1073741824 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:53:31 devstack sudo[112167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1435848d-019d-4424-831a-f8b222a6c758_xl4ke8w1devstack@QuobyteHD Aug 03 08:53:31 devstack sudo[112167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:53:31 devstack sudo[112168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-428cac50-82ad-4eab-ae80-c9b5769f62ab 1073741824 Aug 03 08:53:31 devstack sudo[112168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:53:31 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-4e397f56-f50e-4982-838e-534dd88eb844 tempest-VolumeDependencyTests-1512358985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d9e40703-cbc7-4979-a43a-ddf45ebf0654) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4b24bb72-96b2-432f-aa36-80783dfd40ca', 'volume_size': 1, 'snapshot_id': '2020514f-ed33-440d-ac66-99bda5184fc5'}' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:53:31 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-4e397f56-f50e-4982-838e-534dd88eb844 tempest-VolumeDependencyTests-1512358985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e747be43-c1e4-4486-ab1b-452aed871b8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:53:31 devstack cinder-volume[88899]: DEBUG cinder.volume.flows.manager.create_volume [None req-a41cc30f-a0f0-4c71-8e95-b32cd718fa40 tempest-CreateVolumesFromSnapshotTest-2011744404 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88899) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 08:53:31 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-a41cc30f-a0f0-4c71-8e95-b32cd718fa40 tempest-CreateVolumesFromSnapshotTest-2011744404 None] Flow 'volume_create_manager' (85379c2e-aea1-4ddb-8dd9-47eb86e3b6fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:53:31 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-a41cc30f-a0f0-4c71-8e95-b32cd718fa40 tempest-CreateVolumesFromSnapshotTest-2011744404 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ddd5cc1d-257d-4c34-b1ae-243e61550aec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:53:31 devstack cinder-volume[88899]: INFO cinder.volume.flows.manager.create_volume [None req-4e397f56-f50e-4982-838e-534dd88eb844 tempest-VolumeDependencyTests-1512358985 None] Volume volume-4b24bb72-96b2-432f-aa36-80783dfd40ca (4b24bb72-96b2-432f-aa36-80783dfd40ca): created successfully Aug 03 08:53:31 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-4e397f56-f50e-4982-838e-534dd88eb844 tempest-VolumeDependencyTests-1512358985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e747be43-c1e4-4486-ab1b-452aed871b8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:53:31 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-4e397f56-f50e-4982-838e-534dd88eb844 tempest-VolumeDependencyTests-1512358985 None] Flow 'volume_create_manager' (da43c8fe-4cd7-4294-b4f6-7c6f607842f9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:53:31 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-a41cc30f-a0f0-4c71-8e95-b32cd718fa40 tempest-CreateVolumesFromSnapshotTest-2011744404 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ddd5cc1d-257d-4c34-b1ae-243e61550aec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:53:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1901563698',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa9dc0ab-aa99-48ed-9db0-3b2ea84bd0fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c48ec6495e45472bb1d655075844c178',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:53:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:53:31Z,use_quota=True,user_id='7544fdd40c9c4f319f124d229d006559',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8bde7129-1dc4-42ab-b852-ab32c61b4921),volume_type_id=8bde7129-1dc4-42ab-b852-ab32c61b4921)' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:53:31 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-a41cc30f-a0f0-4c71-8e95-b32cd718fa40 tempest-CreateVolumesFromSnapshotTest-2011744404 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8795264-0dfb-47b7-a275-80bc88682c5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:53:31 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-a41cc30f-a0f0-4c71-8e95-b32cd718fa40 tempest-CreateVolumesFromSnapshotTest-2011744404 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8795264-0dfb-47b7-a275-80bc88682c5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:53:31 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-a41cc30f-a0f0-4c71-8e95-b32cd718fa40 tempest-CreateVolumesFromSnapshotTest-2011744404 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (453ae65a-0825-47ed-8c48-7204fa63f15c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:53:31 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-a41cc30f-a0f0-4c71-8e95-b32cd718fa40 tempest-CreateVolumesFromSnapshotTest-2011744404 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (453ae65a-0825-47ed-8c48-7204fa63f15c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aa9dc0ab-aa99-48ed-9db0-3b2ea84bd0fe', 'volume_name': 'volume-aa9dc0ab-aa99-48ed-9db0-3b2ea84bd0fe', 'volume_size': 1}' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:53:31 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-a41cc30f-a0f0-4c71-8e95-b32cd718fa40 tempest-CreateVolumesFromSnapshotTest-2011744404 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (191b0704-639f-4421-99e2-85ff4898e3d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:53:31 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-a41cc30f-a0f0-4c71-8e95-b32cd718fa40 tempest-CreateVolumesFromSnapshotTest-2011744404 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (191b0704-639f-4421-99e2-85ff4898e3d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:53:31 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-a41cc30f-a0f0-4c71-8e95-b32cd718fa40 tempest-CreateVolumesFromSnapshotTest-2011744404 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (105bfaac-1529-4794-aac0-1408d0608f19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:53:31 devstack cinder-volume[88899]: INFO cinder.volume.flows.manager.create_volume [None req-a41cc30f-a0f0-4c71-8e95-b32cd718fa40 tempest-CreateVolumesFromSnapshotTest-2011744404 None] Volume aa9dc0ab-aa99-48ed-9db0-3b2ea84bd0fe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aa9dc0ab-aa99-48ed-9db0-3b2ea84bd0fe', 'volume_size': 1} Aug 03 08:53:31 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-a41cc30f-a0f0-4c71-8e95-b32cd718fa40 tempest-CreateVolumesFromSnapshotTest-2011744404 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:53:31 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-4e397f56-f50e-4982-838e-534dd88eb844 tempest-VolumeDependencyTests-1512358985 None] Created volume successfully. Aug 03 08:53:31 devstack sudo[112167]: pam_unix(sudo:session): session closed for user root Aug 03 08:53:31 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-a81dacbb-4764-4cda-80ee-64ca831060c9 tempest-VolumeImageDependencyTests-942168115 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1435848d-019d-4424-831a-f8b222a6c758_xl4ke8w1devstack@QuobyteHD" returned: 1 in 0.629s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:53:31 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-a81dacbb-4764-4cda-80ee-64ca831060c9 tempest-VolumeImageDependencyTests-942168115 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1435848d-019d-4424-831a-f8b222a6c758_xl4ke8w1devstack@QuobyteHD' failed. Not Retrying. {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 03 08:53:31 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-a81dacbb-4764-4cda-80ee-64ca831060c9 tempest-VolumeImageDependencyTests-942168115 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:53:31 devstack cinder-volume[88899]: DEBUG cinder.volume.flows.manager.create_volume [None req-a903a5d3-0963-4edb-a888-d2039dca399c tempest-CreateVolumesFromSnapshotTest-2011744404 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88899) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 08:53:31 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-a903a5d3-0963-4edb-a888-d2039dca399c tempest-CreateVolumesFromSnapshotTest-2011744404 None] Flow 'volume_create_manager' (b9f061ea-5a7e-4ef9-a987-0888b48d045d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:53:31 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-a903a5d3-0963-4edb-a888-d2039dca399c tempest-CreateVolumesFromSnapshotTest-2011744404 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b79bde1a-6d3c-4b24-a740-24cd432bedad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:53:31 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-a903a5d3-0963-4edb-a888-d2039dca399c tempest-CreateVolumesFromSnapshotTest-2011744404 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b79bde1a-6d3c-4b24-a740-24cd432bedad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:53:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-423228165',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=94f2ac18-1b2a-43e7-a6ae-1f3c02b1396b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c48ec6495e45472bb1d655075844c178',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:53:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:53:32Z,use_quota=True,user_id='7544fdd40c9c4f319f124d229d006559',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8bde7129-1dc4-42ab-b852-ab32c61b4921),volume_type_id=8bde7129-1dc4-42ab-b852-ab32c61b4921)' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:53:31 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-a903a5d3-0963-4edb-a888-d2039dca399c tempest-CreateVolumesFromSnapshotTest-2011744404 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14b3a24c-2eca-48f4-bc8f-f50d307e888b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:53:31 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-a903a5d3-0963-4edb-a888-d2039dca399c tempest-CreateVolumesFromSnapshotTest-2011744404 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14b3a24c-2eca-48f4-bc8f-f50d307e888b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:53:31 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-a903a5d3-0963-4edb-a888-d2039dca399c tempest-CreateVolumesFromSnapshotTest-2011744404 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70d84eb4-82b4-4a41-a660-e19380ce7549) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:53:31 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-a903a5d3-0963-4edb-a888-d2039dca399c tempest-CreateVolumesFromSnapshotTest-2011744404 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70d84eb4-82b4-4a41-a660-e19380ce7549) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '94f2ac18-1b2a-43e7-a6ae-1f3c02b1396b', 'volume_name': 'volume-94f2ac18-1b2a-43e7-a6ae-1f3c02b1396b', 'volume_size': 1}' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:53:31 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-a903a5d3-0963-4edb-a888-d2039dca399c tempest-CreateVolumesFromSnapshotTest-2011744404 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e9c8e543-8d30-4052-89f7-6b573a7fca40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:53:31 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-a903a5d3-0963-4edb-a888-d2039dca399c tempest-CreateVolumesFromSnapshotTest-2011744404 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e9c8e543-8d30-4052-89f7-6b573a7fca40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:53:31 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-a903a5d3-0963-4edb-a888-d2039dca399c tempest-CreateVolumesFromSnapshotTest-2011744404 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d633e155-9d21-4618-b323-0e98070be602) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:53:31 devstack cinder-volume[88899]: INFO cinder.volume.flows.manager.create_volume [None req-a903a5d3-0963-4edb-a888-d2039dca399c tempest-CreateVolumesFromSnapshotTest-2011744404 None] Volume 94f2ac18-1b2a-43e7-a6ae-1f3c02b1396b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-94f2ac18-1b2a-43e7-a6ae-1f3c02b1396b', 'volume_size': 1} Aug 03 08:53:31 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-a903a5d3-0963-4edb-a888-d2039dca399c tempest-CreateVolumesFromSnapshotTest-2011744404 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:53:31 devstack sudo[112168]: pam_unix(sudo:session): session closed for user root Aug 03 08:53:31 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-dde1040c-fa95-4ed2-84c6-897d842430ac tempest-ProjectMemberTests-1353074417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-428cac50-82ad-4eab-ae80-c9b5769f62ab 1073741824" returned: 0 in 0.688s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:53:31 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-dde1040c-fa95-4ed2-84c6-897d842430ac tempest-ProjectMemberTests-1353074417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-428cac50-82ad-4eab-ae80-c9b5769f62ab {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:53:31 devstack sudo[112178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-428cac50-82ad-4eab-ae80-c9b5769f62ab Aug 03 08:53:31 devstack sudo[112178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:53:31 devstack cinder-volume[88899]: DEBUG cinder.volume.flows.manager.create_volume [None req-d467aaf7-4ae7-4879-8f58-369e691350a0 tempest-CreateVolumesFromSnapshotTest-2011744404 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88899) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 08:53:32 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-d467aaf7-4ae7-4879-8f58-369e691350a0 tempest-CreateVolumesFromSnapshotTest-2011744404 None] Flow 'volume_create_manager' (93cd7023-a926-43f0-b4bf-d7e8e7450ced) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:53:32 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-d467aaf7-4ae7-4879-8f58-369e691350a0 tempest-CreateVolumesFromSnapshotTest-2011744404 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (22bd43a0-2026-4c47-bcf3-bb51bc4dd920) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:53:32 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-d467aaf7-4ae7-4879-8f58-369e691350a0 tempest-CreateVolumesFromSnapshotTest-2011744404 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (22bd43a0-2026-4c47-bcf3-bb51bc4dd920) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:53:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2067645550',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=313508d2-c010-4c42-a7f4-3fd9c83503f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c48ec6495e45472bb1d655075844c178',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:53:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:53:32Z,use_quota=True,user_id='7544fdd40c9c4f319f124d229d006559',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8bde7129-1dc4-42ab-b852-ab32c61b4921),volume_type_id=8bde7129-1dc4-42ab-b852-ab32c61b4921)' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:53:32 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-d467aaf7-4ae7-4879-8f58-369e691350a0 tempest-CreateVolumesFromSnapshotTest-2011744404 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37e236bc-3d2a-4d08-b9b7-c5bfffe5b0c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:53:32 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-d467aaf7-4ae7-4879-8f58-369e691350a0 tempest-CreateVolumesFromSnapshotTest-2011744404 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37e236bc-3d2a-4d08-b9b7-c5bfffe5b0c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:53:32 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-d467aaf7-4ae7-4879-8f58-369e691350a0 tempest-CreateVolumesFromSnapshotTest-2011744404 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3fcaa8bc-fbc2-4e3a-9598-e030e59a87c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:53:32 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-d467aaf7-4ae7-4879-8f58-369e691350a0 tempest-CreateVolumesFromSnapshotTest-2011744404 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3fcaa8bc-fbc2-4e3a-9598-e030e59a87c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '313508d2-c010-4c42-a7f4-3fd9c83503f9', 'volume_name': 'volume-313508d2-c010-4c42-a7f4-3fd9c83503f9', 'volume_size': 1}' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:53:32 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-d467aaf7-4ae7-4879-8f58-369e691350a0 tempest-CreateVolumesFromSnapshotTest-2011744404 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc91227e-3935-45aa-a848-6dacf7bf776e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:53:32 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-d467aaf7-4ae7-4879-8f58-369e691350a0 tempest-CreateVolumesFromSnapshotTest-2011744404 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc91227e-3935-45aa-a848-6dacf7bf776e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:53:32 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-d467aaf7-4ae7-4879-8f58-369e691350a0 tempest-CreateVolumesFromSnapshotTest-2011744404 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9922c2e6-55df-4852-9645-b745ac86a566) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:53:32 devstack cinder-volume[88899]: INFO cinder.volume.flows.manager.create_volume [None req-d467aaf7-4ae7-4879-8f58-369e691350a0 tempest-CreateVolumesFromSnapshotTest-2011744404 None] Volume 313508d2-c010-4c42-a7f4-3fd9c83503f9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-313508d2-c010-4c42-a7f4-3fd9c83503f9', 'volume_size': 1} Aug 03 08:53:32 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-d467aaf7-4ae7-4879-8f58-369e691350a0 tempest-CreateVolumesFromSnapshotTest-2011744404 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:53:32 devstack sudo[112178]: pam_unix(sudo:session): session closed for user root Aug 03 08:53:32 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-dde1040c-fa95-4ed2-84c6-897d842430ac tempest-ProjectMemberTests-1353074417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-428cac50-82ad-4eab-ae80-c9b5769f62ab" returned: 0 in 0.265s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:53:32 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-dde1040c-fa95-4ed2-84c6-897d842430ac tempest-ProjectMemberTests-1353074417 None] <== create_volume: return (1006ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'} {{(pid=88899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 08:53:32 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-dde1040c-fa95-4ed2-84c6-897d842430ac tempest-ProjectMemberTests-1353074417 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.009s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:53:32 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-ea4d993b-2dfa-4bef-87e1-03894c1216cf tempest-CreateVolumesFromSnapshotTest-2011744404 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.743s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:53:32 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-ea4d993b-2dfa-4bef-87e1-03894c1216cf tempest-CreateVolumesFromSnapshotTest-2011744404 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:53:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1342573330',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=091ab459-ad7c-4a1e-9033-d1d690cf93cf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c48ec6495e45472bb1d655075844c178',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:53:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:53:30Z,use_quota=True,user_id='7544fdd40c9c4f319f124d229d006559',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8bde7129-1dc4-42ab-b852-ab32c61b4921),volume_type_id=8bde7129-1dc4-42ab-b852-ab32c61b4921)}" {{(pid=88899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 08:53:32 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-ea4d993b-2dfa-4bef-87e1-03894c1216cf tempest-CreateVolumesFromSnapshotTest-2011744404 None] Creating volume 091ab459-ad7c-4a1e-9033-d1d690cf93cf {{(pid=88899) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 08:53:32 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-ea4d993b-2dfa-4bef-87e1-03894c1216cf tempest-CreateVolumesFromSnapshotTest-2011744404 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:53:32 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-ea4d993b-2dfa-4bef-87e1-03894c1216cf tempest-CreateVolumesFromSnapshotTest-2011744404 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:53:32 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-ea4d993b-2dfa-4bef-87e1-03894c1216cf tempest-CreateVolumesFromSnapshotTest-2011744404 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:53:32 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-ea4d993b-2dfa-4bef-87e1-03894c1216cf tempest-CreateVolumesFromSnapshotTest-2011744404 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:53:32 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-ea4d993b-2dfa-4bef-87e1-03894c1216cf tempest-CreateVolumesFromSnapshotTest-2011744404 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:53:32 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-ea4d993b-2dfa-4bef-87e1-03894c1216cf tempest-CreateVolumesFromSnapshotTest-2011744404 None] Selected osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385 as target Quobyte volume. {{(pid=88899) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 08:53:32 devstack cinder-volume[88899]: INFO cinder.volume.drivers.remotefs [None req-ea4d993b-2dfa-4bef-87e1-03894c1216cf tempest-CreateVolumesFromSnapshotTest-2011744404 None] casted to osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385 Aug 03 08:53:32 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-ea4d993b-2dfa-4bef-87e1-03894c1216cf tempest-CreateVolumesFromSnapshotTest-2011744404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-091ab459-ad7c-4a1e-9033-d1d690cf93cf 1073741824 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:53:32 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-dde1040c-fa95-4ed2-84c6-897d842430ac tempest-ProjectMemberTests-1353074417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b42cbad-01e1-4799-997a-04af2f5d45ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-428cac50-82ad-4eab-ae80-c9b5769f62ab', 'volume_size': 1}' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:53:32 devstack sudo[112181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-091ab459-ad7c-4a1e-9033-d1d690cf93cf 1073741824 Aug 03 08:53:32 devstack sudo[112181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:53:32 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-dde1040c-fa95-4ed2-84c6-897d842430ac tempest-ProjectMemberTests-1353074417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8ea22ae-f9db-42f0-9207-fb94ea072dbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:53:32 devstack cinder-volume[88899]: INFO cinder.volume.flows.manager.create_volume [None req-dde1040c-fa95-4ed2-84c6-897d842430ac tempest-ProjectMemberTests-1353074417 None] Volume volume-428cac50-82ad-4eab-ae80-c9b5769f62ab (428cac50-82ad-4eab-ae80-c9b5769f62ab): created successfully Aug 03 08:53:32 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-dde1040c-fa95-4ed2-84c6-897d842430ac tempest-ProjectMemberTests-1353074417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8ea22ae-f9db-42f0-9207-fb94ea072dbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:53:32 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-dde1040c-fa95-4ed2-84c6-897d842430ac tempest-ProjectMemberTests-1353074417 None] Flow 'volume_create_manager' (c2ac0683-64f8-4615-bb0b-a2711b372078) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:53:32 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-dde1040c-fa95-4ed2-84c6-897d842430ac tempest-ProjectMemberTests-1353074417 None] Created volume successfully. Aug 03 08:53:32 devstack sudo[112181]: pam_unix(sudo:session): session closed for user root Aug 03 08:53:32 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-ea4d993b-2dfa-4bef-87e1-03894c1216cf tempest-CreateVolumesFromSnapshotTest-2011744404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-091ab459-ad7c-4a1e-9033-d1d690cf93cf 1073741824" returned: 0 in 0.476s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:53:32 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-ea4d993b-2dfa-4bef-87e1-03894c1216cf tempest-CreateVolumesFromSnapshotTest-2011744404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-091ab459-ad7c-4a1e-9033-d1d690cf93cf {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:53:32 devstack sudo[112189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-091ab459-ad7c-4a1e-9033-d1d690cf93cf Aug 03 08:53:32 devstack sudo[112189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:53:32 devstack cinder-volume[88899]: DEBUG cinder.volume.flows.manager.create_volume [None req-c59605df-5b05-4f62-a436-7f0cb63b056f tempest-VolumeDependencyTests-1512358985 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88899) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 08:53:32 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-c59605df-5b05-4f62-a436-7f0cb63b056f tempest-VolumeDependencyTests-1512358985 None] Flow 'volume_create_manager' (eb19340a-001f-49f0-8d41-730ec382cf71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:53:32 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-c59605df-5b05-4f62-a436-7f0cb63b056f tempest-VolumeDependencyTests-1512358985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a16e9100-ff4c-4bcf-aed1-c17287d4e0e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:53:32 devstack sudo[112189]: pam_unix(sudo:session): session closed for user root Aug 03 08:53:32 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-ea4d993b-2dfa-4bef-87e1-03894c1216cf tempest-CreateVolumesFromSnapshotTest-2011744404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-091ab459-ad7c-4a1e-9033-d1d690cf93cf" returned: 0 in 0.322s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:53:32 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-ea4d993b-2dfa-4bef-87e1-03894c1216cf tempest-CreateVolumesFromSnapshotTest-2011744404 None] <== create_volume: return (854ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'} {{(pid=88899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 08:53:32 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-ea4d993b-2dfa-4bef-87e1-03894c1216cf tempest-CreateVolumesFromSnapshotTest-2011744404 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.857s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:53:32 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-5ea9ca6b-7255-407c-a768-e74da92f7c09 tempest-CreateVolumesFromSnapshotTest-2011744404 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.149s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:53:32 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-5ea9ca6b-7255-407c-a768-e74da92f7c09 tempest-CreateVolumesFromSnapshotTest-2011744404 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:53:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-914206896',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8212e20b-b962-484c-87c9-a005a5381f5e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c48ec6495e45472bb1d655075844c178',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:53:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:53:31Z,use_quota=True,user_id='7544fdd40c9c4f319f124d229d006559',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8bde7129-1dc4-42ab-b852-ab32c61b4921),volume_type_id=8bde7129-1dc4-42ab-b852-ab32c61b4921)}" {{(pid=88899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 08:53:32 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-5ea9ca6b-7255-407c-a768-e74da92f7c09 tempest-CreateVolumesFromSnapshotTest-2011744404 None] Creating volume 8212e20b-b962-484c-87c9-a005a5381f5e {{(pid=88899) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 08:53:32 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-5ea9ca6b-7255-407c-a768-e74da92f7c09 tempest-CreateVolumesFromSnapshotTest-2011744404 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:53:32 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-5ea9ca6b-7255-407c-a768-e74da92f7c09 tempest-CreateVolumesFromSnapshotTest-2011744404 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:53:32 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-5ea9ca6b-7255-407c-a768-e74da92f7c09 tempest-CreateVolumesFromSnapshotTest-2011744404 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:53:32 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-5ea9ca6b-7255-407c-a768-e74da92f7c09 tempest-CreateVolumesFromSnapshotTest-2011744404 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:53:32 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-5ea9ca6b-7255-407c-a768-e74da92f7c09 tempest-CreateVolumesFromSnapshotTest-2011744404 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:53:32 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-5ea9ca6b-7255-407c-a768-e74da92f7c09 tempest-CreateVolumesFromSnapshotTest-2011744404 None] Selected osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385 as target Quobyte volume. {{(pid=88899) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 08:53:32 devstack cinder-volume[88899]: INFO cinder.volume.drivers.remotefs [None req-5ea9ca6b-7255-407c-a768-e74da92f7c09 tempest-CreateVolumesFromSnapshotTest-2011744404 None] casted to osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385 Aug 03 08:53:32 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-5ea9ca6b-7255-407c-a768-e74da92f7c09 tempest-CreateVolumesFromSnapshotTest-2011744404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-8212e20b-b962-484c-87c9-a005a5381f5e 1073741824 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:53:32 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-c59605df-5b05-4f62-a436-7f0cb63b056f tempest-VolumeDependencyTests-1512358985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a16e9100-ff4c-4bcf-aed1-c17287d4e0e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:53:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1875829461',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ec448af7-0d13-45ba-9422-d77537c4249c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d30b387eb9b94bb589dfe04f0d2eac6d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:53:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=4b24bb72-96b2-432f-aa36-80783dfd40ca,status='creating',terminated_at=None,updated_at=2026-08-03T06:53:33Z,use_quota=True,user_id='12ab9b4d5d894d608b06e312639537e8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8bde7129-1dc4-42ab-b852-ab32c61b4921),volume_type_id=8bde7129-1dc4-42ab-b852-ab32c61b4921)' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:53:32 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-c59605df-5b05-4f62-a436-7f0cb63b056f tempest-VolumeDependencyTests-1512358985 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (84e7ced2-f471-435f-b28b-df79c16ffc39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:53:32 devstack sudo[112192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-8212e20b-b962-484c-87c9-a005a5381f5e 1073741824 Aug 03 08:53:32 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-c59605df-5b05-4f62-a436-7f0cb63b056f tempest-VolumeDependencyTests-1512358985 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (84e7ced2-f471-435f-b28b-df79c16ffc39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:53:32 devstack sudo[112192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:53:32 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-c59605df-5b05-4f62-a436-7f0cb63b056f tempest-VolumeDependencyTests-1512358985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3586b17-5be1-4df1-817d-1ad9465f332b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:53:33 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-4fc68b44-fb1a-4b15-933d-610e17d809ae tempest-ProjectMemberTests-1353074417 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:53:33 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-ea4d993b-2dfa-4bef-87e1-03894c1216cf tempest-CreateVolumesFromSnapshotTest-2011744404 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db3f091a-bfdc-425e-b477-0acc511cd19a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-091ab459-ad7c-4a1e-9033-d1d690cf93cf', 'volume_size': 1}' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:53:33 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-ea4d993b-2dfa-4bef-87e1-03894c1216cf tempest-CreateVolumesFromSnapshotTest-2011744404 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (812e35e5-8140-41c1-8295-7a5839e12eb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:53:33 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-c59605df-5b05-4f62-a436-7f0cb63b056f tempest-VolumeDependencyTests-1512358985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3586b17-5be1-4df1-817d-1ad9465f332b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'ec448af7-0d13-45ba-9422-d77537c4249c', 'volume_name': 'volume-ec448af7-0d13-45ba-9422-d77537c4249c', 'volume_size': 1, 'source_volid': '4b24bb72-96b2-432f-aa36-80783dfd40ca', 'source_volstatus': 'available'}' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:53:33 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-c59605df-5b05-4f62-a436-7f0cb63b056f tempest-VolumeDependencyTests-1512358985 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5baa3986-4d59-4652-abcb-43e9a52a5bdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:53:33 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-c59605df-5b05-4f62-a436-7f0cb63b056f tempest-VolumeDependencyTests-1512358985 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5baa3986-4d59-4652-abcb-43e9a52a5bdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:53:33 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-c59605df-5b05-4f62-a436-7f0cb63b056f tempest-VolumeDependencyTests-1512358985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f929be47-059b-4696-b8bb-a12647bebd2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:53:33 devstack cinder-volume[88899]: INFO cinder.volume.flows.manager.create_volume [None req-c59605df-5b05-4f62-a436-7f0cb63b056f tempest-VolumeDependencyTests-1512358985 None] Volume ec448af7-0d13-45ba-9422-d77537c4249c: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-ec448af7-0d13-45ba-9422-d77537c4249c', 'volume_size': 1, 'source_volid': '4b24bb72-96b2-432f-aa36-80783dfd40ca', 'source_volstatus': 'available'} Aug 03 08:53:33 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-c59605df-5b05-4f62-a436-7f0cb63b056f tempest-VolumeDependencyTests-1512358985 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:53:33 devstack cinder-volume[88899]: INFO cinder.volume.flows.manager.create_volume [None req-ea4d993b-2dfa-4bef-87e1-03894c1216cf tempest-CreateVolumesFromSnapshotTest-2011744404 None] Volume volume-091ab459-ad7c-4a1e-9033-d1d690cf93cf (091ab459-ad7c-4a1e-9033-d1d690cf93cf): created successfully Aug 03 08:53:33 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-ea4d993b-2dfa-4bef-87e1-03894c1216cf tempest-CreateVolumesFromSnapshotTest-2011744404 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (812e35e5-8140-41c1-8295-7a5839e12eb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:53:33 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-ea4d993b-2dfa-4bef-87e1-03894c1216cf tempest-CreateVolumesFromSnapshotTest-2011744404 None] Flow 'volume_create_manager' (b214a492-687b-4189-961b-77ab7ae6ac3b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:53:33 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-ea4d993b-2dfa-4bef-87e1-03894c1216cf tempest-CreateVolumesFromSnapshotTest-2011744404 None] Created volume successfully. Aug 03 08:53:33 devstack sudo[112192]: pam_unix(sudo:session): session closed for user root Aug 03 08:53:33 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-5ea9ca6b-7255-407c-a768-e74da92f7c09 tempest-CreateVolumesFromSnapshotTest-2011744404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-8212e20b-b962-484c-87c9-a005a5381f5e 1073741824" returned: 0 in 0.436s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:53:33 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-5ea9ca6b-7255-407c-a768-e74da92f7c09 tempest-CreateVolumesFromSnapshotTest-2011744404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-8212e20b-b962-484c-87c9-a005a5381f5e {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:53:33 devstack sudo[112198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-8212e20b-b962-484c-87c9-a005a5381f5e Aug 03 08:53:33 devstack sudo[112198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:53:33 devstack sudo[112198]: pam_unix(sudo:session): session closed for user root Aug 03 08:53:33 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-5ea9ca6b-7255-407c-a768-e74da92f7c09 tempest-CreateVolumesFromSnapshotTest-2011744404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-8212e20b-b962-484c-87c9-a005a5381f5e" returned: 0 in 0.270s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:53:33 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-5ea9ca6b-7255-407c-a768-e74da92f7c09 tempest-CreateVolumesFromSnapshotTest-2011744404 None] <== create_volume: return (741ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'} {{(pid=88899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 08:53:33 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-5ea9ca6b-7255-407c-a768-e74da92f7c09 tempest-CreateVolumesFromSnapshotTest-2011744404 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.744s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:53:33 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-a41cc30f-a0f0-4c71-8e95-b32cd718fa40 tempest-CreateVolumesFromSnapshotTest-2011744404 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.293s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:53:33 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-a41cc30f-a0f0-4c71-8e95-b32cd718fa40 tempest-CreateVolumesFromSnapshotTest-2011744404 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:53:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1901563698',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa9dc0ab-aa99-48ed-9db0-3b2ea84bd0fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c48ec6495e45472bb1d655075844c178',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:53:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:53:31Z,use_quota=True,user_id='7544fdd40c9c4f319f124d229d006559',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8bde7129-1dc4-42ab-b852-ab32c61b4921),volume_type_id=8bde7129-1dc4-42ab-b852-ab32c61b4921)}" {{(pid=88899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 08:53:33 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-a41cc30f-a0f0-4c71-8e95-b32cd718fa40 tempest-CreateVolumesFromSnapshotTest-2011744404 None] Creating volume aa9dc0ab-aa99-48ed-9db0-3b2ea84bd0fe {{(pid=88899) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 08:53:33 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-a41cc30f-a0f0-4c71-8e95-b32cd718fa40 tempest-CreateVolumesFromSnapshotTest-2011744404 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:53:33 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-a41cc30f-a0f0-4c71-8e95-b32cd718fa40 tempest-CreateVolumesFromSnapshotTest-2011744404 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:53:33 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-a41cc30f-a0f0-4c71-8e95-b32cd718fa40 tempest-CreateVolumesFromSnapshotTest-2011744404 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:53:33 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-a41cc30f-a0f0-4c71-8e95-b32cd718fa40 tempest-CreateVolumesFromSnapshotTest-2011744404 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:53:33 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-a41cc30f-a0f0-4c71-8e95-b32cd718fa40 tempest-CreateVolumesFromSnapshotTest-2011744404 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:53:33 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-a41cc30f-a0f0-4c71-8e95-b32cd718fa40 tempest-CreateVolumesFromSnapshotTest-2011744404 None] Selected osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385 as target Quobyte volume. {{(pid=88899) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 08:53:33 devstack cinder-volume[88899]: INFO cinder.volume.drivers.remotefs [None req-a41cc30f-a0f0-4c71-8e95-b32cd718fa40 tempest-CreateVolumesFromSnapshotTest-2011744404 None] casted to osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385 Aug 03 08:53:33 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-a41cc30f-a0f0-4c71-8e95-b32cd718fa40 tempest-CreateVolumesFromSnapshotTest-2011744404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-aa9dc0ab-aa99-48ed-9db0-3b2ea84bd0fe 1073741824 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:53:33 devstack sudo[112201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-aa9dc0ab-aa99-48ed-9db0-3b2ea84bd0fe 1073741824 Aug 03 08:53:33 devstack sudo[112201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:53:33 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-5ea9ca6b-7255-407c-a768-e74da92f7c09 tempest-CreateVolumesFromSnapshotTest-2011744404 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd254951-8784-42a7-b941-2dad57579485) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8212e20b-b962-484c-87c9-a005a5381f5e', 'volume_size': 1}' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:53:33 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-5ea9ca6b-7255-407c-a768-e74da92f7c09 tempest-CreateVolumesFromSnapshotTest-2011744404 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3e233c7-93a2-45dd-902b-f5dbda3dc769) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:53:33 devstack cinder-volume[88899]: INFO cinder.volume.flows.manager.create_volume [None req-5ea9ca6b-7255-407c-a768-e74da92f7c09 tempest-CreateVolumesFromSnapshotTest-2011744404 None] Volume volume-8212e20b-b962-484c-87c9-a005a5381f5e (8212e20b-b962-484c-87c9-a005a5381f5e): created successfully Aug 03 08:53:33 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-5ea9ca6b-7255-407c-a768-e74da92f7c09 tempest-CreateVolumesFromSnapshotTest-2011744404 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3e233c7-93a2-45dd-902b-f5dbda3dc769) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:53:33 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-5ea9ca6b-7255-407c-a768-e74da92f7c09 tempest-CreateVolumesFromSnapshotTest-2011744404 None] Flow 'volume_create_manager' (a3b4ddbb-9e9a-4193-a6bb-34fe0e50e3dd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:53:33 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-5ea9ca6b-7255-407c-a768-e74da92f7c09 tempest-CreateVolumesFromSnapshotTest-2011744404 None] Created volume successfully. Aug 03 08:53:34 devstack sudo[112201]: pam_unix(sudo:session): session closed for user root Aug 03 08:53:34 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-a41cc30f-a0f0-4c71-8e95-b32cd718fa40 tempest-CreateVolumesFromSnapshotTest-2011744404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-aa9dc0ab-aa99-48ed-9db0-3b2ea84bd0fe 1073741824" returned: 0 in 0.476s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:53:34 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-a41cc30f-a0f0-4c71-8e95-b32cd718fa40 tempest-CreateVolumesFromSnapshotTest-2011744404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-aa9dc0ab-aa99-48ed-9db0-3b2ea84bd0fe {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:53:34 devstack sudo[112207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-aa9dc0ab-aa99-48ed-9db0-3b2ea84bd0fe Aug 03 08:53:34 devstack sudo[112207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:53:34 devstack sudo[112207]: pam_unix(sudo:session): session closed for user root Aug 03 08:53:34 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-a41cc30f-a0f0-4c71-8e95-b32cd718fa40 tempest-CreateVolumesFromSnapshotTest-2011744404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-aa9dc0ab-aa99-48ed-9db0-3b2ea84bd0fe" returned: 0 in 0.248s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:53:34 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-a41cc30f-a0f0-4c71-8e95-b32cd718fa40 tempest-CreateVolumesFromSnapshotTest-2011744404 None] <== create_volume: return (771ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'} {{(pid=88899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 08:53:34 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-a41cc30f-a0f0-4c71-8e95-b32cd718fa40 tempest-CreateVolumesFromSnapshotTest-2011744404 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.774s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:53:34 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-a81dacbb-4764-4cda-80ee-64ca831060c9 tempest-VolumeImageDependencyTests-942168115 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.885s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:53:34 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-a81dacbb-4764-4cda-80ee-64ca831060c9 tempest-VolumeImageDependencyTests-942168115 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:53:29Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d50f3846-58cd-476d-9c37-57aa92522f39,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fb20ce3648d1497fb23ac775415e7a44',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:53:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:53:29Z,use_quota=True,user_id='ec19afbca65f4a8185b3231a39404ec7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8bde7129-1dc4-42ab-b852-ab32c61b4921),volume_type_id=8bde7129-1dc4-42ab-b852-ab32c61b4921)}" {{(pid=88899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 08:53:34 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-a81dacbb-4764-4cda-80ee-64ca831060c9 tempest-VolumeImageDependencyTests-942168115 None] Creating volume d50f3846-58cd-476d-9c37-57aa92522f39 {{(pid=88899) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 08:53:34 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-a81dacbb-4764-4cda-80ee-64ca831060c9 tempest-VolumeImageDependencyTests-942168115 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:53:34 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-a81dacbb-4764-4cda-80ee-64ca831060c9 tempest-VolumeImageDependencyTests-942168115 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:53:34 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-a81dacbb-4764-4cda-80ee-64ca831060c9 tempest-VolumeImageDependencyTests-942168115 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:53:34 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-a81dacbb-4764-4cda-80ee-64ca831060c9 tempest-VolumeImageDependencyTests-942168115 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:53:34 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-a81dacbb-4764-4cda-80ee-64ca831060c9 tempest-VolumeImageDependencyTests-942168115 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:53:34 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-a81dacbb-4764-4cda-80ee-64ca831060c9 tempest-VolumeImageDependencyTests-942168115 None] Selected osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385 as target Quobyte volume. {{(pid=88899) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 08:53:34 devstack cinder-volume[88899]: INFO cinder.volume.drivers.remotefs [None req-a81dacbb-4764-4cda-80ee-64ca831060c9 tempest-VolumeImageDependencyTests-942168115 None] casted to osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385 Aug 03 08:53:34 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-a81dacbb-4764-4cda-80ee-64ca831060c9 tempest-VolumeImageDependencyTests-942168115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-d50f3846-58cd-476d-9c37-57aa92522f39 1073741824 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:53:34 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-a41cc30f-a0f0-4c71-8e95-b32cd718fa40 tempest-CreateVolumesFromSnapshotTest-2011744404 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (105bfaac-1529-4794-aac0-1408d0608f19) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aa9dc0ab-aa99-48ed-9db0-3b2ea84bd0fe', 'volume_size': 1}' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:53:34 devstack sudo[112210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-d50f3846-58cd-476d-9c37-57aa92522f39 1073741824 Aug 03 08:53:34 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-a41cc30f-a0f0-4c71-8e95-b32cd718fa40 tempest-CreateVolumesFromSnapshotTest-2011744404 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a99cef3-7fd8-4776-9759-1ac4eca9844f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:53:34 devstack sudo[112210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:53:34 devstack cinder-volume[88899]: INFO cinder.volume.flows.manager.create_volume [None req-a41cc30f-a0f0-4c71-8e95-b32cd718fa40 tempest-CreateVolumesFromSnapshotTest-2011744404 None] Volume volume-aa9dc0ab-aa99-48ed-9db0-3b2ea84bd0fe (aa9dc0ab-aa99-48ed-9db0-3b2ea84bd0fe): created successfully Aug 03 08:53:34 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-a41cc30f-a0f0-4c71-8e95-b32cd718fa40 tempest-CreateVolumesFromSnapshotTest-2011744404 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a99cef3-7fd8-4776-9759-1ac4eca9844f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:53:34 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-a41cc30f-a0f0-4c71-8e95-b32cd718fa40 tempest-CreateVolumesFromSnapshotTest-2011744404 None] Flow 'volume_create_manager' (85379c2e-aea1-4ddb-8dd9-47eb86e3b6fc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:53:34 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-a41cc30f-a0f0-4c71-8e95-b32cd718fa40 tempest-CreateVolumesFromSnapshotTest-2011744404 None] Created volume successfully. Aug 03 08:53:34 devstack sudo[112210]: pam_unix(sudo:session): session closed for user root Aug 03 08:53:34 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-a81dacbb-4764-4cda-80ee-64ca831060c9 tempest-VolumeImageDependencyTests-942168115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-d50f3846-58cd-476d-9c37-57aa92522f39 1073741824" returned: 0 in 0.432s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:53:34 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-a81dacbb-4764-4cda-80ee-64ca831060c9 tempest-VolumeImageDependencyTests-942168115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-d50f3846-58cd-476d-9c37-57aa92522f39 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:53:34 devstack sudo[112216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-d50f3846-58cd-476d-9c37-57aa92522f39 Aug 03 08:53:34 devstack sudo[112216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:53:35 devstack sudo[112216]: pam_unix(sudo:session): session closed for user root Aug 03 08:53:35 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-a81dacbb-4764-4cda-80ee-64ca831060c9 tempest-VolumeImageDependencyTests-942168115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-d50f3846-58cd-476d-9c37-57aa92522f39" returned: 0 in 0.240s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:53:35 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-a81dacbb-4764-4cda-80ee-64ca831060c9 tempest-VolumeImageDependencyTests-942168115 None] <== create_volume: return (711ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'} {{(pid=88899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 08:53:35 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-a81dacbb-4764-4cda-80ee-64ca831060c9 tempest-VolumeImageDependencyTests-942168115 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.714s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:53:35 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-a903a5d3-0963-4edb-a888-d2039dca399c tempest-CreateVolumesFromSnapshotTest-2011744404 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.497s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:53:35 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-a903a5d3-0963-4edb-a888-d2039dca399c tempest-CreateVolumesFromSnapshotTest-2011744404 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:53:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-423228165',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=94f2ac18-1b2a-43e7-a6ae-1f3c02b1396b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c48ec6495e45472bb1d655075844c178',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:53:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:53:32Z,use_quota=True,user_id='7544fdd40c9c4f319f124d229d006559',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8bde7129-1dc4-42ab-b852-ab32c61b4921),volume_type_id=8bde7129-1dc4-42ab-b852-ab32c61b4921)}" {{(pid=88899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 08:53:35 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-a903a5d3-0963-4edb-a888-d2039dca399c tempest-CreateVolumesFromSnapshotTest-2011744404 None] Creating volume 94f2ac18-1b2a-43e7-a6ae-1f3c02b1396b {{(pid=88899) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 08:53:35 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-a903a5d3-0963-4edb-a888-d2039dca399c tempest-CreateVolumesFromSnapshotTest-2011744404 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:53:35 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-a903a5d3-0963-4edb-a888-d2039dca399c tempest-CreateVolumesFromSnapshotTest-2011744404 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:53:35 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-a903a5d3-0963-4edb-a888-d2039dca399c tempest-CreateVolumesFromSnapshotTest-2011744404 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:53:35 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-a903a5d3-0963-4edb-a888-d2039dca399c tempest-CreateVolumesFromSnapshotTest-2011744404 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:53:35 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-a903a5d3-0963-4edb-a888-d2039dca399c tempest-CreateVolumesFromSnapshotTest-2011744404 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:53:35 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-a903a5d3-0963-4edb-a888-d2039dca399c tempest-CreateVolumesFromSnapshotTest-2011744404 None] Selected osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385 as target Quobyte volume. {{(pid=88899) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 08:53:35 devstack cinder-volume[88899]: INFO cinder.volume.drivers.remotefs [None req-a903a5d3-0963-4edb-a888-d2039dca399c tempest-CreateVolumesFromSnapshotTest-2011744404 None] casted to osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385 Aug 03 08:53:35 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-a903a5d3-0963-4edb-a888-d2039dca399c tempest-CreateVolumesFromSnapshotTest-2011744404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-94f2ac18-1b2a-43e7-a6ae-1f3c02b1396b 1073741824 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:53:35 devstack sudo[112219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-94f2ac18-1b2a-43e7-a6ae-1f3c02b1396b 1073741824 Aug 03 08:53:35 devstack sudo[112219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:53:35 devstack cinder-volume[88899]: DEBUG cinder.volume.volume_utils [None req-a81dacbb-4764-4cda-80ee-64ca831060c9 tempest-VolumeImageDependencyTests-942168115 None] Attempting download of 1435848d-019d-4424-831a-f8b222a6c758 ((None, [{'url': 'file:///opt/stack/data/glance/images/1435848d-019d-4424-831a-f8b222a6c758', 'metadata': {}}])) to volume d50f3846-58cd-476d-9c37-57aa92522f39. {{(pid=88899) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Aug 03 08:53:35 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dfb7883-2234-4250-8e17-82e2a43bfd26]: (4, 'raw') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:53:35 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-a81dacbb-4764-4cda-80ee-64ca831060c9 tempest-VolumeImageDependencyTests-942168115 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1435848d-019d-4424-831a-f8b222a6c758_op04goth {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:53:35 devstack sudo[112221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1435848d-019d-4424-831a-f8b222a6c758_op04goth Aug 03 08:53:35 devstack sudo[112221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:53:35 devstack sudo[112221]: pam_unix(sudo:session): session closed for user root Aug 03 08:53:35 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-a81dacbb-4764-4cda-80ee-64ca831060c9 tempest-VolumeImageDependencyTests-942168115 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1435848d-019d-4424-831a-f8b222a6c758_op04goth" returned: 0 in 0.337s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:53:35 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-a81dacbb-4764-4cda-80ee-64ca831060c9 tempest-VolumeImageDependencyTests-942168115 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1435848d-019d-4424-831a-f8b222a6c758_op04goth {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:53:35 devstack sudo[112219]: pam_unix(sudo:session): session closed for user root Aug 03 08:53:35 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-a903a5d3-0963-4edb-a888-d2039dca399c tempest-CreateVolumesFromSnapshotTest-2011744404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-94f2ac18-1b2a-43e7-a6ae-1f3c02b1396b 1073741824" returned: 0 in 0.449s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:53:35 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-a903a5d3-0963-4edb-a888-d2039dca399c tempest-CreateVolumesFromSnapshotTest-2011744404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-94f2ac18-1b2a-43e7-a6ae-1f3c02b1396b {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:53:35 devstack sudo[112230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-94f2ac18-1b2a-43e7-a6ae-1f3c02b1396b Aug 03 08:53:35 devstack sudo[112230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:53:35 devstack sudo[112229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1435848d-019d-4424-831a-f8b222a6c758_op04goth Aug 03 08:53:35 devstack sudo[112229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:53:35 devstack sudo[112230]: pam_unix(sudo:session): session closed for user root Aug 03 08:53:35 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-a903a5d3-0963-4edb-a888-d2039dca399c tempest-CreateVolumesFromSnapshotTest-2011744404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-94f2ac18-1b2a-43e7-a6ae-1f3c02b1396b" returned: 0 in 0.247s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:53:35 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-a903a5d3-0963-4edb-a888-d2039dca399c tempest-CreateVolumesFromSnapshotTest-2011744404 None] <== create_volume: return (745ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'} {{(pid=88899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 08:53:35 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-a903a5d3-0963-4edb-a888-d2039dca399c tempest-CreateVolumesFromSnapshotTest-2011744404 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.748s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:53:35 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-d467aaf7-4ae7-4879-8f58-369e691350a0 tempest-CreateVolumesFromSnapshotTest-2011744404 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.873s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:53:35 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-d467aaf7-4ae7-4879-8f58-369e691350a0 tempest-CreateVolumesFromSnapshotTest-2011744404 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:53:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2067645550',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=313508d2-c010-4c42-a7f4-3fd9c83503f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c48ec6495e45472bb1d655075844c178',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:53:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:53:32Z,use_quota=True,user_id='7544fdd40c9c4f319f124d229d006559',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8bde7129-1dc4-42ab-b852-ab32c61b4921),volume_type_id=8bde7129-1dc4-42ab-b852-ab32c61b4921)}" {{(pid=88899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 08:53:35 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-d467aaf7-4ae7-4879-8f58-369e691350a0 tempest-CreateVolumesFromSnapshotTest-2011744404 None] Creating volume 313508d2-c010-4c42-a7f4-3fd9c83503f9 {{(pid=88899) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 08:53:35 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-d467aaf7-4ae7-4879-8f58-369e691350a0 tempest-CreateVolumesFromSnapshotTest-2011744404 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:53:35 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-d467aaf7-4ae7-4879-8f58-369e691350a0 tempest-CreateVolumesFromSnapshotTest-2011744404 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:53:35 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-d467aaf7-4ae7-4879-8f58-369e691350a0 tempest-CreateVolumesFromSnapshotTest-2011744404 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:53:35 devstack sudo[112229]: pam_unix(sudo:session): session closed for user root Aug 03 08:53:35 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-d467aaf7-4ae7-4879-8f58-369e691350a0 tempest-CreateVolumesFromSnapshotTest-2011744404 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:53:35 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-d467aaf7-4ae7-4879-8f58-369e691350a0 tempest-CreateVolumesFromSnapshotTest-2011744404 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:53:35 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-d467aaf7-4ae7-4879-8f58-369e691350a0 tempest-CreateVolumesFromSnapshotTest-2011744404 None] Selected osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385 as target Quobyte volume. {{(pid=88899) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 08:53:35 devstack cinder-volume[88899]: INFO cinder.volume.drivers.remotefs [None req-d467aaf7-4ae7-4879-8f58-369e691350a0 tempest-CreateVolumesFromSnapshotTest-2011744404 None] casted to osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385 Aug 03 08:53:35 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-d467aaf7-4ae7-4879-8f58-369e691350a0 tempest-CreateVolumesFromSnapshotTest-2011744404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-313508d2-c010-4c42-a7f4-3fd9c83503f9 1073741824 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:53:35 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-a903a5d3-0963-4edb-a888-d2039dca399c tempest-CreateVolumesFromSnapshotTest-2011744404 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d633e155-9d21-4618-b323-0e98070be602) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-94f2ac18-1b2a-43e7-a6ae-1f3c02b1396b', 'volume_size': 1}' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:53:35 devstack sudo[112236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-313508d2-c010-4c42-a7f4-3fd9c83503f9 1073741824 Aug 03 08:53:35 devstack sudo[112236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:53:35 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-a903a5d3-0963-4edb-a888-d2039dca399c tempest-CreateVolumesFromSnapshotTest-2011744404 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5daccb26-f567-479a-8a21-5dc1a868e51f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:53:35 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-a81dacbb-4764-4cda-80ee-64ca831060c9 tempest-VolumeImageDependencyTests-942168115 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1435848d-019d-4424-831a-f8b222a6c758_op04goth" returned: 1 in 0.361s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:53:35 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-a81dacbb-4764-4cda-80ee-64ca831060c9 tempest-VolumeImageDependencyTests-942168115 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1435848d-019d-4424-831a-f8b222a6c758_op04goth' failed. Not Retrying. {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 03 08:53:35 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ab7b6d4-37a8-440b-9788-39b903493380]: (4, 'raw') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:53:35 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-a81dacbb-4764-4cda-80ee-64ca831060c9 tempest-VolumeImageDependencyTests-942168115 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1435848d-019d-4424-831a-f8b222a6c758_xl4ke8w1devstack@QuobyteHD {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:53:36 devstack cinder-volume[88899]: INFO cinder.volume.flows.manager.create_volume [None req-a903a5d3-0963-4edb-a888-d2039dca399c tempest-CreateVolumesFromSnapshotTest-2011744404 None] Volume volume-94f2ac18-1b2a-43e7-a6ae-1f3c02b1396b (94f2ac18-1b2a-43e7-a6ae-1f3c02b1396b): created successfully Aug 03 08:53:36 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-a903a5d3-0963-4edb-a888-d2039dca399c tempest-CreateVolumesFromSnapshotTest-2011744404 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5daccb26-f567-479a-8a21-5dc1a868e51f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:53:36 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-a903a5d3-0963-4edb-a888-d2039dca399c tempest-CreateVolumesFromSnapshotTest-2011744404 None] Flow 'volume_create_manager' (b9f061ea-5a7e-4ef9-a987-0888b48d045d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:53:36 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-a903a5d3-0963-4edb-a888-d2039dca399c tempest-CreateVolumesFromSnapshotTest-2011744404 None] Created volume successfully. Aug 03 08:53:36 devstack sudo[112238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1435848d-019d-4424-831a-f8b222a6c758_xl4ke8w1devstack@QuobyteHD Aug 03 08:53:36 devstack sudo[112238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:53:36 devstack sudo[112238]: pam_unix(sudo:session): session closed for user root Aug 03 08:53:36 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-a81dacbb-4764-4cda-80ee-64ca831060c9 tempest-VolumeImageDependencyTests-942168115 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1435848d-019d-4424-831a-f8b222a6c758_xl4ke8w1devstack@QuobyteHD" returned: 0 in 0.347s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:53:36 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-a81dacbb-4764-4cda-80ee-64ca831060c9 tempest-VolumeImageDependencyTests-942168115 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1435848d-019d-4424-831a-f8b222a6c758_xl4ke8w1devstack@QuobyteHD {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:53:36 devstack sudo[112236]: pam_unix(sudo:session): session closed for user root Aug 03 08:53:36 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-d467aaf7-4ae7-4879-8f58-369e691350a0 tempest-CreateVolumesFromSnapshotTest-2011744404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-313508d2-c010-4c42-a7f4-3fd9c83503f9 1073741824" returned: 0 in 0.443s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:53:36 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-d467aaf7-4ae7-4879-8f58-369e691350a0 tempest-CreateVolumesFromSnapshotTest-2011744404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-313508d2-c010-4c42-a7f4-3fd9c83503f9 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:53:36 devstack sudo[112246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1435848d-019d-4424-831a-f8b222a6c758_xl4ke8w1devstack@QuobyteHD Aug 03 08:53:36 devstack sudo[112246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:53:36 devstack sudo[112247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-313508d2-c010-4c42-a7f4-3fd9c83503f9 Aug 03 08:53:36 devstack sudo[112247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:53:36 devstack sudo[112246]: pam_unix(sudo:session): session closed for user root Aug 03 08:53:36 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-a81dacbb-4764-4cda-80ee-64ca831060c9 tempest-VolumeImageDependencyTests-942168115 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1435848d-019d-4424-831a-f8b222a6c758_xl4ke8w1devstack@QuobyteHD" returned: 1 in 0.319s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:53:36 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-a81dacbb-4764-4cda-80ee-64ca831060c9 tempest-VolumeImageDependencyTests-942168115 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1435848d-019d-4424-831a-f8b222a6c758_xl4ke8w1devstack@QuobyteHD' failed. Not Retrying. {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 03 08:53:36 devstack cinder-volume[88899]: DEBUG cinder.image.image_utils [None req-a81dacbb-4764-4cda-80ee-64ca831060c9 tempest-VolumeImageDependencyTests-942168115 None] 1435848d-019d-4424-831a-f8b222a6c758 was raw, converting to qcow2 {{(pid=88899) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Aug 03 08:53:36 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-a81dacbb-4764-4cda-80ee-64ca831060c9 tempest-VolumeImageDependencyTests-942168115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_1435848d-019d-4424-831a-f8b222a6c758_xl4ke8w1devstack@QuobyteHD /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-d50f3846-58cd-476d-9c37-57aa92522f39 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:53:36 devstack sudo[112247]: pam_unix(sudo:session): session closed for user root Aug 03 08:53:36 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-d467aaf7-4ae7-4879-8f58-369e691350a0 tempest-CreateVolumesFromSnapshotTest-2011744404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-313508d2-c010-4c42-a7f4-3fd9c83503f9" returned: 0 in 0.248s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:53:36 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-d467aaf7-4ae7-4879-8f58-369e691350a0 tempest-CreateVolumesFromSnapshotTest-2011744404 None] <== create_volume: return (733ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'} {{(pid=88899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 08:53:36 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-d467aaf7-4ae7-4879-8f58-369e691350a0 tempest-CreateVolumesFromSnapshotTest-2011744404 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.736s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:53:36 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-4fc68b44-fb1a-4b15-933d-610e17d809ae tempest-ProjectMemberTests-1353074417 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.682s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:53:36 devstack sudo[112254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_1435848d-019d-4424-831a-f8b222a6c758_xl4ke8w1devstack@QuobyteHD /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-d50f3846-58cd-476d-9c37-57aa92522f39 Aug 03 08:53:36 devstack sudo[112254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:53:36 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-d467aaf7-4ae7-4879-8f58-369e691350a0 tempest-CreateVolumesFromSnapshotTest-2011744404 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9922c2e6-55df-4852-9645-b745ac86a566) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-313508d2-c010-4c42-a7f4-3fd9c83503f9', 'volume_size': 1}' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:53:36 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-d467aaf7-4ae7-4879-8f58-369e691350a0 tempest-CreateVolumesFromSnapshotTest-2011744404 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (91c13cbf-d27d-4e54-9607-9cd4b89318a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:53:36 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-4fc68b44-fb1a-4b15-933d-610e17d809ae tempest-ProjectMemberTests-1353074417 None] Creating offline snapshot 3d77ea10-1cc0-45a2-be3a-67ffa189471c of volume 428cac50-82ad-4eab-ae80-c9b5769f62ab {{(pid=88899) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 03 08:53:36 devstack cinder-volume[88899]: INFO cinder.volume.flows.manager.create_volume [None req-d467aaf7-4ae7-4879-8f58-369e691350a0 tempest-CreateVolumesFromSnapshotTest-2011744404 None] Volume volume-313508d2-c010-4c42-a7f4-3fd9c83503f9 (313508d2-c010-4c42-a7f4-3fd9c83503f9): created successfully Aug 03 08:53:36 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-d467aaf7-4ae7-4879-8f58-369e691350a0 tempest-CreateVolumesFromSnapshotTest-2011744404 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (91c13cbf-d27d-4e54-9607-9cd4b89318a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:53:36 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-d467aaf7-4ae7-4879-8f58-369e691350a0 tempest-CreateVolumesFromSnapshotTest-2011744404 None] Flow 'volume_create_manager' (93cd7023-a926-43f0-b4bf-d7e8e7450ced) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:53:36 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[6696133c-3c7f-4d72-8489-b89d51ce07f5]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:53:36 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-4fc68b44-fb1a-4b15-933d-610e17d809ae tempest-ProjectMemberTests-1353074417 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-428cac50-82ad-4eab-ae80-c9b5769f62ab {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:53:36 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-d467aaf7-4ae7-4879-8f58-369e691350a0 tempest-CreateVolumesFromSnapshotTest-2011744404 None] Created volume successfully. Aug 03 08:53:36 devstack sudo[112256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-428cac50-82ad-4eab-ae80-c9b5769f62ab Aug 03 08:53:36 devstack sudo[112256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:53:37 devstack sudo[112254]: pam_unix(sudo:session): session closed for user root Aug 03 08:53:37 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-a81dacbb-4764-4cda-80ee-64ca831060c9 tempest-VolumeImageDependencyTests-942168115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_1435848d-019d-4424-831a-f8b222a6c758_xl4ke8w1devstack@QuobyteHD /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-d50f3846-58cd-476d-9c37-57aa92522f39" returned: 0 in 0.448s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:53:37 devstack cinder-volume[88899]: DEBUG cinder.image.image_utils [None req-a81dacbb-4764-4cda-80ee-64ca831060c9 tempest-VolumeImageDependencyTests-942168115 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_1435848d-019d-4424-831a-f8b222a6c758_xl4ke8w1devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-d50f3846-58cd-476d-9c37-57aa92522f39 {{(pid=88899) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 03 08:53:37 devstack cinder-volume[88899]: INFO cinder.image.image_utils [None req-a81dacbb-4764-4cda-80ee-64ca831060c9 tempest-VolumeImageDependencyTests-942168115 None] Converted 0.00 MB image at 0.00 MB/s Aug 03 08:53:37 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-a81dacbb-4764-4cda-80ee-64ca831060c9 tempest-VolumeImageDependencyTests-942168115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-d50f3846-58cd-476d-9c37-57aa92522f39 1G {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:53:37 devstack sudo[112256]: pam_unix(sudo:session): session closed for user root Aug 03 08:53:37 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-4fc68b44-fb1a-4b15-933d-610e17d809ae tempest-ProjectMemberTests-1353074417 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-428cac50-82ad-4eab-ae80-c9b5769f62ab" returned: 0 in 0.394s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:53:37 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-4fc68b44-fb1a-4b15-933d-610e17d809ae tempest-ProjectMemberTests-1353074417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-428cac50-82ad-4eab-ae80-c9b5769f62ab,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-428cac50-82ad-4eab-ae80-c9b5769f62ab.3d77ea10-1cc0-45a2-be3a-67ffa189471c 1G {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:53:37 devstack sudo[112264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-d50f3846-58cd-476d-9c37-57aa92522f39 1G Aug 03 08:53:37 devstack sudo[112264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:53:37 devstack sudo[112265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-428cac50-82ad-4eab-ae80-c9b5769f62ab,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-428cac50-82ad-4eab-ae80-c9b5769f62ab.3d77ea10-1cc0-45a2-be3a-67ffa189471c 1G Aug 03 08:53:37 devstack sudo[112265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:53:37 devstack sudo[112264]: pam_unix(sudo:session): session closed for user root Aug 03 08:53:37 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-a81dacbb-4764-4cda-80ee-64ca831060c9 tempest-VolumeImageDependencyTests-942168115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-d50f3846-58cd-476d-9c37-57aa92522f39 1G" returned: 0 in 0.331s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:53:37 devstack cinder-volume[88899]: DEBUG cinder.volume.volume_utils [None req-a81dacbb-4764-4cda-80ee-64ca831060c9 tempest-VolumeImageDependencyTests-942168115 None] Downloaded image 1435848d-019d-4424-831a-f8b222a6c758 ((None, [{'url': 'file:///opt/stack/data/glance/images/1435848d-019d-4424-831a-f8b222a6c758', 'metadata': {}}])) to volume d50f3846-58cd-476d-9c37-57aa92522f39 successfully. {{(pid=88899) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Aug 03 08:53:37 devstack cinder-volume[88899]: DEBUG cinder.image.image_utils [None req-a81dacbb-4764-4cda-80ee-64ca831060c9 tempest-VolumeImageDependencyTests-942168115 None] Temporary image 1435848d-019d-4424-831a-f8b222a6c758 for user ec19afbca65f4a8185b3231a39404ec7 is deleted. {{(pid=88899) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Aug 03 08:53:37 devstack cinder-volume[88899]: DEBUG cinder.volume.volume_utils [None req-a81dacbb-4764-4cda-80ee-64ca831060c9 tempest-VolumeImageDependencyTests-942168115 None] Marking volume d50f3846-58cd-476d-9c37-57aa92522f39 as bootable. {{(pid=88899) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Aug 03 08:53:37 devstack cinder-volume[88899]: DEBUG cinder.volume.flows.manager.create_volume [None req-a81dacbb-4764-4cda-80ee-64ca831060c9 tempest-VolumeImageDependencyTests-942168115 None] Copying metadata from image 1435848d-019d-4424-831a-f8b222a6c758 to d50f3846-58cd-476d-9c37-57aa92522f39. {{(pid=88899) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Aug 03 08:53:37 devstack cinder-volume[88899]: DEBUG cinder.volume.flows.manager.create_volume [None req-a81dacbb-4764-4cda-80ee-64ca831060c9 tempest-VolumeImageDependencyTests-942168115 None] Creating volume glance metadata for volume d50f3846-58cd-476d-9c37-57aa92522f39 backed by image 1435848d-019d-4424-831a-f8b222a6c758 with: {'image_id': '1435848d-019d-4424-831a-f8b222a6c758', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '760a94e30d47b29c6af6873ce229b36e', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=88899) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Aug 03 08:53:37 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-9b4e47ab-2395-4f6a-9dc4-c83e34c303d8 tempest-CreateVolumesFromSnapshotTest-2011744404 None] Acquiring lock "cinder-313508d2-c010-4c42-a7f4-3fd9c83503f9-delete_volume" by "delete_volume" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:53:37 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-a81dacbb-4764-4cda-80ee-64ca831060c9 tempest-VolumeImageDependencyTests-942168115 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ba421e3-e322-4462-8be7-eac54ebbb9a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d50f3846-58cd-476d-9c37-57aa92522f39', 'volume_size': 1, 'image_id': '1435848d-019d-4424-831a-f8b222a6c758', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1435848d-019d-4424-831a-f8b222a6c758', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '760a94e30d47b29c6af6873ce229b36e', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'fb20ce3648d1497fb23ac775415e7a44', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '58057695f21c01b2828f619724c516ede91cf41bbb4e9d7dbb6550d2417348d86b863c799759ebf0bfaca6b4cffe95366e93156cc53a8d7da150a42d88963540', 'id': '1435848d-019d-4424-831a-f8b222a6c758', 'created_at': datetime.datetime(2026, 8, 3, 6, 53, 27, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 3, 6, 53, 28, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1435848d-019d-4424-831a-f8b222a6c758/file', 'properties': {}}, 'image_service': }' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:53:37 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-a81dacbb-4764-4cda-80ee-64ca831060c9 tempest-VolumeImageDependencyTests-942168115 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f35a0cac-eea1-4a37-9447-33d48f6a4823) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:53:37 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-9b4e47ab-2395-4f6a-9dc4-c83e34c303d8 tempest-CreateVolumesFromSnapshotTest-2011744404 None] Lock "cinder-313508d2-c010-4c42-a7f4-3fd9c83503f9-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:53:37 devstack cinder-volume[88899]: INFO cinder.volume.flows.manager.create_volume [None req-a81dacbb-4764-4cda-80ee-64ca831060c9 tempest-VolumeImageDependencyTests-942168115 None] Volume volume-d50f3846-58cd-476d-9c37-57aa92522f39 (d50f3846-58cd-476d-9c37-57aa92522f39): created successfully Aug 03 08:53:37 devstack sudo[112265]: pam_unix(sudo:session): session closed for user root Aug 03 08:53:37 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-a81dacbb-4764-4cda-80ee-64ca831060c9 tempest-VolumeImageDependencyTests-942168115 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f35a0cac-eea1-4a37-9447-33d48f6a4823) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:53:37 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-a81dacbb-4764-4cda-80ee-64ca831060c9 tempest-VolumeImageDependencyTests-942168115 None] Flow 'volume_create_manager' (65e682c0-4ba7-4015-8483-1f9224f313d0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:53:37 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-4fc68b44-fb1a-4b15-933d-610e17d809ae tempest-ProjectMemberTests-1353074417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-428cac50-82ad-4eab-ae80-c9b5769f62ab,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-428cac50-82ad-4eab-ae80-c9b5769f62ab.3d77ea10-1cc0-45a2-be3a-67ffa189471c 1G" returned: 0 in 0.475s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:53:37 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-4fc68b44-fb1a-4b15-933d-610e17d809ae tempest-ProjectMemberTests-1353074417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-428cac50-82ad-4eab-ae80-c9b5769f62ab -F qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-428cac50-82ad-4eab-ae80-c9b5769f62ab.3d77ea10-1cc0-45a2-be3a-67ffa189471c {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:53:37 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-a81dacbb-4764-4cda-80ee-64ca831060c9 tempest-VolumeImageDependencyTests-942168115 None] Created volume successfully. Aug 03 08:53:37 devstack sudo[112275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-428cac50-82ad-4eab-ae80-c9b5769f62ab -F qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-428cac50-82ad-4eab-ae80-c9b5769f62ab.3d77ea10-1cc0-45a2-be3a-67ffa189471c Aug 03 08:53:37 devstack sudo[112275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:53:37 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-9b4e47ab-2395-4f6a-9dc4-c83e34c303d8 tempest-CreateVolumesFromSnapshotTest-2011744404 None] Acquiring lock "cinder-quobyte-313508d2-c010-4c42-a7f4-3fd9c83503f9" by "delete_volume" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:53:37 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-9b4e47ab-2395-4f6a-9dc4-c83e34c303d8 tempest-CreateVolumesFromSnapshotTest-2011744404 None] Lock "cinder-quobyte-313508d2-c010-4c42-a7f4-3fd9c83503f9" acquired by "delete_volume" :: waited 0.016s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:53:37 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[097f6227-5e3d-4ec4-97be-555bf9c2f1ad]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:53:37 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-9b4e47ab-2395-4f6a-9dc4-c83e34c303d8 tempest-CreateVolumesFromSnapshotTest-2011744404 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-313508d2-c010-4c42-a7f4-3fd9c83503f9 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:53:37 devstack sudo[112277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-313508d2-c010-4c42-a7f4-3fd9c83503f9 Aug 03 08:53:37 devstack sudo[112277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:53:37 devstack sudo[112275]: pam_unix(sudo:session): session closed for user root Aug 03 08:53:37 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-4fc68b44-fb1a-4b15-933d-610e17d809ae tempest-ProjectMemberTests-1353074417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-428cac50-82ad-4eab-ae80-c9b5769f62ab -F qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-428cac50-82ad-4eab-ae80-c9b5769f62ab.3d77ea10-1cc0-45a2-be3a-67ffa189471c" returned: 0 in 0.285s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:53:37 devstack cinder-volume[88899]: WARNING cinder.volume.drivers.remotefs [None req-4fc68b44-fb1a-4b15-933d-610e17d809ae tempest-ProjectMemberTests-1353074417 None] /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-428cac50-82ad-4eab-ae80-c9b5769f62ab.3d77ea10-1cc0-45a2-be3a-67ffa189471c is being set with open permissions: ugo+rw Aug 03 08:53:37 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-4fc68b44-fb1a-4b15-933d-610e17d809ae tempest-ProjectMemberTests-1353074417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-428cac50-82ad-4eab-ae80-c9b5769f62ab.3d77ea10-1cc0-45a2-be3a-67ffa189471c {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:53:37 devstack sudo[112282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-428cac50-82ad-4eab-ae80-c9b5769f62ab.3d77ea10-1cc0-45a2-be3a-67ffa189471c Aug 03 08:53:37 devstack sudo[112282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:53:38 devstack sudo[112277]: pam_unix(sudo:session): session closed for user root Aug 03 08:53:38 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-9b4e47ab-2395-4f6a-9dc4-c83e34c303d8 tempest-CreateVolumesFromSnapshotTest-2011744404 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-313508d2-c010-4c42-a7f4-3fd9c83503f9" returned: 0 in 0.382s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:53:38 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-9b4e47ab-2395-4f6a-9dc4-c83e34c303d8 tempest-CreateVolumesFromSnapshotTest-2011744404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-313508d2-c010-4c42-a7f4-3fd9c83503f9 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:53:38 devstack sudo[112287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-313508d2-c010-4c42-a7f4-3fd9c83503f9 Aug 03 08:53:38 devstack sudo[112287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:53:38 devstack sudo[112282]: pam_unix(sudo:session): session closed for user root Aug 03 08:53:38 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-4fc68b44-fb1a-4b15-933d-610e17d809ae tempest-ProjectMemberTests-1353074417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-428cac50-82ad-4eab-ae80-c9b5769f62ab.3d77ea10-1cc0-45a2-be3a-67ffa189471c" returned: 0 in 0.253s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:53:38 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-4fc68b44-fb1a-4b15-933d-610e17d809ae tempest-ProjectMemberTests-1353074417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-428cac50-82ad-4eab-ae80-c9b5769f62ab.info {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:53:38 devstack sudo[112290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-428cac50-82ad-4eab-ae80-c9b5769f62ab.info Aug 03 08:53:38 devstack sudo[112290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:53:38 devstack sudo[112287]: pam_unix(sudo:session): session closed for user root Aug 03 08:53:38 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-9b4e47ab-2395-4f6a-9dc4-c83e34c303d8 tempest-CreateVolumesFromSnapshotTest-2011744404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-313508d2-c010-4c42-a7f4-3fd9c83503f9" returned: 0 in 0.256s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:53:38 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-9b4e47ab-2395-4f6a-9dc4-c83e34c303d8 tempest-CreateVolumesFromSnapshotTest-2011744404 None] Lock "cinder-quobyte-313508d2-c010-4c42-a7f4-3fd9c83503f9" released by "delete_volume" :: held 0.680s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:53:38 devstack cinder-volume[88899]: DEBUG cinder.quota [None req-9b4e47ab-2395-4f6a-9dc4-c83e34c303d8 tempest-CreateVolumesFromSnapshotTest-2011744404 None] Created reservations ['f9a0b178-f769-48a5-bc74-dc7c8d74cc0f', '2a50bba5-9743-4c8f-9bb8-6e79d62dba1d', '60ff2bac-eb1d-416e-bb52-1b3ffad11ab0', 'aae2e834-47e5-4b96-917d-a7f7aa062ae9'] {{(pid=88899) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 08:53:38 devstack sudo[112290]: pam_unix(sudo:session): session closed for user root Aug 03 08:53:38 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-4fc68b44-fb1a-4b15-933d-610e17d809ae tempest-ProjectMemberTests-1353074417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-428cac50-82ad-4eab-ae80-c9b5769f62ab.info" returned: 0 in 0.274s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:53:38 devstack cinder-volume[88899]: WARNING cinder.volume.drivers.remotefs [None req-4fc68b44-fb1a-4b15-933d-610e17d809ae tempest-ProjectMemberTests-1353074417 None] /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-428cac50-82ad-4eab-ae80-c9b5769f62ab.info is being set with open permissions: ugo+rw Aug 03 08:53:38 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-4fc68b44-fb1a-4b15-933d-610e17d809ae tempest-ProjectMemberTests-1353074417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-428cac50-82ad-4eab-ae80-c9b5769f62ab.info {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:53:38 devstack sudo[112294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-428cac50-82ad-4eab-ae80-c9b5769f62ab.info Aug 03 08:53:38 devstack sudo[112294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:53:38 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-9b4e47ab-2395-4f6a-9dc4-c83e34c303d8 tempest-CreateVolumesFromSnapshotTest-2011744404 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:53:38 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-9b4e47ab-2395-4f6a-9dc4-c83e34c303d8 tempest-CreateVolumesFromSnapshotTest-2011744404 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:53:38 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-9b4e47ab-2395-4f6a-9dc4-c83e34c303d8 tempest-CreateVolumesFromSnapshotTest-2011744404 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:53:38 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-9b4e47ab-2395-4f6a-9dc4-c83e34c303d8 tempest-CreateVolumesFromSnapshotTest-2011744404 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:53:38 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-9b4e47ab-2395-4f6a-9dc4-c83e34c303d8 tempest-CreateVolumesFromSnapshotTest-2011744404 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:53:38 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-9b4e47ab-2395-4f6a-9dc4-c83e34c303d8 tempest-CreateVolumesFromSnapshotTest-2011744404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:53:38 devstack sudo[112296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a Aug 03 08:53:38 devstack sudo[112296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:53:38 devstack sudo[112294]: pam_unix(sudo:session): session closed for user root Aug 03 08:53:38 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-4fc68b44-fb1a-4b15-933d-610e17d809ae tempest-ProjectMemberTests-1353074417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-428cac50-82ad-4eab-ae80-c9b5769f62ab.info" returned: 0 in 0.248s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:53:38 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-4fc68b44-fb1a-4b15-933d-610e17d809ae tempest-ProjectMemberTests-1353074417 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.045s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:53:38 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-c59605df-5b05-4f62-a436-7f0cb63b056f tempest-VolumeDependencyTests-1512358985 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 5.684s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:53:38 devstack cinder-volume[88899]: INFO cinder.volume.drivers.remotefs [None req-c59605df-5b05-4f62-a436-7f0cb63b056f tempest-VolumeDependencyTests-1512358985 None] Cloning volume 4b24bb72-96b2-432f-aa36-80783dfd40ca to volume ec448af7-0d13-45ba-9422-d77537c4249c Aug 03 08:53:38 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-0c637ea4-e0c4-4a5c-9e11-3c281d0eeb16 tempest-CreateVolumesFromSnapshotTest-2011744404 None] Acquiring lock "cinder-94f2ac18-1b2a-43e7-a6ae-1f3c02b1396b-delete_volume" by "delete_volume" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:53:38 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-0c637ea4-e0c4-4a5c-9e11-3c281d0eeb16 tempest-CreateVolumesFromSnapshotTest-2011744404 None] Lock "cinder-94f2ac18-1b2a-43e7-a6ae-1f3c02b1396b-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:53:38 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-4fc68b44-fb1a-4b15-933d-610e17d809ae tempest-ProjectMemberTests-1353074417 None] Create snapshot completed successfully Aug 03 08:53:38 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-d59bd26e-78ba-4a30-a9af-7980450e427e tempest-VolumeImageDependencyTests-942168115 None] Acquiring lock "cinder-d50f3846-58cd-476d-9c37-57aa92522f39-delete_volume" by "delete_volume" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:53:38 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-c59605df-5b05-4f62-a436-7f0cb63b056f tempest-VolumeDependencyTests-1512358985 None] Creating offline snapshot 0cb595ce-53b6-45b6-82f3-e5a412b65b11 of volume 4b24bb72-96b2-432f-aa36-80783dfd40ca {{(pid=88899) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 03 08:53:38 devstack sudo[112296]: pam_unix(sudo:session): session closed for user root Aug 03 08:53:38 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-9b4e47ab-2395-4f6a-9dc4-c83e34c303d8 tempest-CreateVolumesFromSnapshotTest-2011744404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a" returned: 0 in 0.338s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:53:38 devstack cinder-volume[88899]: DEBUG cinder.manager [None req-9b4e47ab-2395-4f6a-9dc4-c83e34c303d8 tempest-CreateVolumesFromSnapshotTest-2011744404 None] Notifying Schedulers of capabilities ... {{(pid=88899) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 08:53:38 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-d59bd26e-78ba-4a30-a9af-7980450e427e tempest-VolumeImageDependencyTests-942168115 None] Lock "cinder-d50f3846-58cd-476d-9c37-57aa92522f39-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:53:38 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-9b4e47ab-2395-4f6a-9dc4-c83e34c303d8 tempest-CreateVolumesFromSnapshotTest-2011744404 None] Deleted volume successfully. Aug 03 08:53:38 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3b40ad8-ad98-41d2-bd86-88c272f9a2cf]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:53:38 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-c59605df-5b05-4f62-a436-7f0cb63b056f tempest-VolumeDependencyTests-1512358985 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-4b24bb72-96b2-432f-aa36-80783dfd40ca {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:53:38 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-0c637ea4-e0c4-4a5c-9e11-3c281d0eeb16 tempest-CreateVolumesFromSnapshotTest-2011744404 None] Acquiring lock "cinder-quobyte-94f2ac18-1b2a-43e7-a6ae-1f3c02b1396b" by "delete_volume" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:53:38 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-9b4e47ab-2395-4f6a-9dc4-c83e34c303d8 tempest-CreateVolumesFromSnapshotTest-2011744404 None] Lock "cinder-313508d2-c010-4c42-a7f4-3fd9c83503f9-delete_volume" released by "delete_volume" :: held 1.316s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:53:38 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-0c637ea4-e0c4-4a5c-9e11-3c281d0eeb16 tempest-CreateVolumesFromSnapshotTest-2011744404 None] Lock "cinder-quobyte-94f2ac18-1b2a-43e7-a6ae-1f3c02b1396b" acquired by "delete_volume" :: waited 0.026s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:53:38 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-d59bd26e-78ba-4a30-a9af-7980450e427e tempest-VolumeImageDependencyTests-942168115 None] Acquiring lock "cinder-quobyte-d50f3846-58cd-476d-9c37-57aa92522f39" by "delete_volume" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:53:38 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[79457cfb-acef-4b19-a89e-1403d3004224]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:53:38 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-d59bd26e-78ba-4a30-a9af-7980450e427e tempest-VolumeImageDependencyTests-942168115 None] Lock "cinder-quobyte-d50f3846-58cd-476d-9c37-57aa92522f39" acquired by "delete_volume" :: waited 0.016s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:53:38 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-0c637ea4-e0c4-4a5c-9e11-3c281d0eeb16 tempest-CreateVolumesFromSnapshotTest-2011744404 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-94f2ac18-1b2a-43e7-a6ae-1f3c02b1396b {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:53:38 devstack sudo[112301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-4b24bb72-96b2-432f-aa36-80783dfd40ca Aug 03 08:53:38 devstack sudo[112301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:53:38 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5196008-1049-4dcd-a42c-e20df37f4daf]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:53:38 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-d59bd26e-78ba-4a30-a9af-7980450e427e tempest-VolumeImageDependencyTests-942168115 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-d50f3846-58cd-476d-9c37-57aa92522f39 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:53:39 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-b86e6d88-4aca-4a5c-b494-26cc05d431d8 tempest-ProjectMemberTests-1353074417 None] Acquiring lock "cinder-3d77ea10-1cc0-45a2-be3a-67ffa189471c-delete_snapshot" by "delete_snapshot" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:53:39 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-b86e6d88-4aca-4a5c-b494-26cc05d431d8 tempest-ProjectMemberTests-1353074417 None] Lock "cinder-3d77ea10-1cc0-45a2-be3a-67ffa189471c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:53:39 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-b86e6d88-4aca-4a5c-b494-26cc05d431d8 tempest-ProjectMemberTests-1353074417 None] Acquiring lock "cinder-quobyte-428cac50-82ad-4eab-ae80-c9b5769f62ab" by "delete_snapshot" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:53:39 devstack sudo[112302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-94f2ac18-1b2a-43e7-a6ae-1f3c02b1396b Aug 03 08:53:39 devstack sudo[112302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:53:39 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-b86e6d88-4aca-4a5c-b494-26cc05d431d8 tempest-ProjectMemberTests-1353074417 None] Lock "cinder-quobyte-428cac50-82ad-4eab-ae80-c9b5769f62ab" acquired by "delete_snapshot" :: waited 0.020s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:53:39 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-b86e6d88-4aca-4a5c-b494-26cc05d431d8 tempest-ProjectMemberTests-1353074417 None] Acquiring lock "cinder-quobyte-3d77ea10-1cc0-45a2-be3a-67ffa189471c" by "_delete_snapshot" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:53:39 devstack sudo[112304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-d50f3846-58cd-476d-9c37-57aa92522f39 Aug 03 08:53:39 devstack sudo[112304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:53:39 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-b86e6d88-4aca-4a5c-b494-26cc05d431d8 tempest-ProjectMemberTests-1353074417 None] Lock "cinder-quobyte-3d77ea10-1cc0-45a2-be3a-67ffa189471c" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:53:39 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-b86e6d88-4aca-4a5c-b494-26cc05d431d8 tempest-ProjectMemberTests-1353074417 None] Deleting offline snapshot 3d77ea10-1cc0-45a2-be3a-67ffa189471c of volume 428cac50-82ad-4eab-ae80-c9b5769f62ab {{(pid=88899) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 03 08:53:39 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-b86e6d88-4aca-4a5c-b494-26cc05d431d8 tempest-ProjectMemberTests-1353074417 None] snapshot_file for this snap is: volume-428cac50-82ad-4eab-ae80-c9b5769f62ab.3d77ea10-1cc0-45a2-be3a-67ffa189471c {{(pid=88899) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 03 08:53:39 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f3a3bd2-0783-405b-ad6e-2e3a0e21ebb5]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:53:39 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-b86e6d88-4aca-4a5c-b494-26cc05d431d8 tempest-ProjectMemberTests-1353074417 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-428cac50-82ad-4eab-ae80-c9b5769f62ab.3d77ea10-1cc0-45a2-be3a-67ffa189471c {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:53:39 devstack sudo[112307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-428cac50-82ad-4eab-ae80-c9b5769f62ab.3d77ea10-1cc0-45a2-be3a-67ffa189471c Aug 03 08:53:39 devstack sudo[112307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:53:39 devstack sudo[112301]: pam_unix(sudo:session): session closed for user root Aug 03 08:53:39 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-c59605df-5b05-4f62-a436-7f0cb63b056f tempest-VolumeDependencyTests-1512358985 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-4b24bb72-96b2-432f-aa36-80783dfd40ca" returned: 0 in 0.521s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:53:39 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-c59605df-5b05-4f62-a436-7f0cb63b056f tempest-VolumeDependencyTests-1512358985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-4b24bb72-96b2-432f-aa36-80783dfd40ca,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-4b24bb72-96b2-432f-aa36-80783dfd40ca.0cb595ce-53b6-45b6-82f3-e5a412b65b11 1G {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:53:39 devstack sudo[112314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-4b24bb72-96b2-432f-aa36-80783dfd40ca,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-4b24bb72-96b2-432f-aa36-80783dfd40ca.0cb595ce-53b6-45b6-82f3-e5a412b65b11 1G Aug 03 08:53:39 devstack sudo[112314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:53:39 devstack sudo[112304]: pam_unix(sudo:session): session closed for user root Aug 03 08:53:39 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-d59bd26e-78ba-4a30-a9af-7980450e427e tempest-VolumeImageDependencyTests-942168115 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-d50f3846-58cd-476d-9c37-57aa92522f39" returned: 0 in 0.473s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:53:39 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-d59bd26e-78ba-4a30-a9af-7980450e427e tempest-VolumeImageDependencyTests-942168115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-d50f3846-58cd-476d-9c37-57aa92522f39 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:53:39 devstack sudo[112321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-d50f3846-58cd-476d-9c37-57aa92522f39 Aug 03 08:53:39 devstack sudo[112321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:53:39 devstack sudo[112302]: pam_unix(sudo:session): session closed for user root Aug 03 08:53:39 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-0c637ea4-e0c4-4a5c-9e11-3c281d0eeb16 tempest-CreateVolumesFromSnapshotTest-2011744404 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-94f2ac18-1b2a-43e7-a6ae-1f3c02b1396b" returned: 0 in 0.542s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:53:39 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-0c637ea4-e0c4-4a5c-9e11-3c281d0eeb16 tempest-CreateVolumesFromSnapshotTest-2011744404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-94f2ac18-1b2a-43e7-a6ae-1f3c02b1396b {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:53:39 devstack sudo[112323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-94f2ac18-1b2a-43e7-a6ae-1f3c02b1396b Aug 03 08:53:39 devstack sudo[112323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:53:39 devstack sudo[112307]: pam_unix(sudo:session): session closed for user root Aug 03 08:53:39 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-b86e6d88-4aca-4a5c-b494-26cc05d431d8 tempest-ProjectMemberTests-1353074417 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-428cac50-82ad-4eab-ae80-c9b5769f62ab.3d77ea10-1cc0-45a2-be3a-67ffa189471c" returned: 0 in 0.452s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:53:39 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-b86e6d88-4aca-4a5c-b494-26cc05d431d8 tempest-ProjectMemberTests-1353074417 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-428cac50-82ad-4eab-ae80-c9b5769f62ab(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88899) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 03 08:53:39 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dd1899c-aabf-4e28-9611-d839ca97f8df]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:53:39 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-b86e6d88-4aca-4a5c-b494-26cc05d431d8 tempest-ProjectMemberTests-1353074417 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-428cac50-82ad-4eab-ae80-c9b5769f62ab {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:53:39 devstack sudo[112321]: pam_unix(sudo:session): session closed for user root Aug 03 08:53:39 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-d59bd26e-78ba-4a30-a9af-7980450e427e tempest-VolumeImageDependencyTests-942168115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-d50f3846-58cd-476d-9c37-57aa92522f39" returned: 0 in 0.271s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:53:39 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-d59bd26e-78ba-4a30-a9af-7980450e427e tempest-VolumeImageDependencyTests-942168115 None] Lock "cinder-quobyte-d50f3846-58cd-476d-9c37-57aa92522f39" released by "delete_volume" :: held 0.806s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:53:39 devstack sudo[112323]: pam_unix(sudo:session): session closed for user root Aug 03 08:53:39 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-0c637ea4-e0c4-4a5c-9e11-3c281d0eeb16 tempest-CreateVolumesFromSnapshotTest-2011744404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-94f2ac18-1b2a-43e7-a6ae-1f3c02b1396b" returned: 0 in 0.289s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:53:39 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-0c637ea4-e0c4-4a5c-9e11-3c281d0eeb16 tempest-CreateVolumesFromSnapshotTest-2011744404 None] Lock "cinder-quobyte-94f2ac18-1b2a-43e7-a6ae-1f3c02b1396b" released by "delete_volume" :: held 0.888s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:53:39 devstack sudo[112332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-428cac50-82ad-4eab-ae80-c9b5769f62ab Aug 03 08:53:39 devstack sudo[112332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:53:39 devstack cinder-volume[88899]: DEBUG cinder.quota [None req-d59bd26e-78ba-4a30-a9af-7980450e427e tempest-VolumeImageDependencyTests-942168115 None] Created reservations ['e1ce2a36-d0aa-4599-8796-02c074db3ec5', '541a1071-d6ac-4c1b-a08e-45e7287a0d88', '924b73f9-3167-4a8f-9b40-96055b302148', 'e2c1454b-158b-4f1a-9617-f095348bad8f'] {{(pid=88899) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 08:53:39 devstack sudo[112314]: pam_unix(sudo:session): session closed for user root Aug 03 08:53:39 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-c59605df-5b05-4f62-a436-7f0cb63b056f tempest-VolumeDependencyTests-1512358985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-4b24bb72-96b2-432f-aa36-80783dfd40ca,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-4b24bb72-96b2-432f-aa36-80783dfd40ca.0cb595ce-53b6-45b6-82f3-e5a412b65b11 1G" returned: 0 in 0.474s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:53:39 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-c59605df-5b05-4f62-a436-7f0cb63b056f tempest-VolumeDependencyTests-1512358985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4b24bb72-96b2-432f-aa36-80783dfd40ca -F qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-4b24bb72-96b2-432f-aa36-80783dfd40ca.0cb595ce-53b6-45b6-82f3-e5a412b65b11 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:53:39 devstack sudo[112337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4b24bb72-96b2-432f-aa36-80783dfd40ca -F qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-4b24bb72-96b2-432f-aa36-80783dfd40ca.0cb595ce-53b6-45b6-82f3-e5a412b65b11 Aug 03 08:53:39 devstack cinder-volume[88899]: DEBUG cinder.quota [None req-0c637ea4-e0c4-4a5c-9e11-3c281d0eeb16 tempest-CreateVolumesFromSnapshotTest-2011744404 None] Created reservations ['6093f7fd-ff8b-47d3-b431-04730163c054', '095cbe21-25b5-4cc9-bd90-3197e2fce3da', 'aa3ca38a-1114-4427-9f54-9320650cdf87', 'eaadd1c6-ec2d-4997-b7f1-eb7db55c5279'] {{(pid=88899) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 08:53:39 devstack sudo[112337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:53:39 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-d59bd26e-78ba-4a30-a9af-7980450e427e tempest-VolumeImageDependencyTests-942168115 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:53:39 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-d59bd26e-78ba-4a30-a9af-7980450e427e tempest-VolumeImageDependencyTests-942168115 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:53:39 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-d59bd26e-78ba-4a30-a9af-7980450e427e tempest-VolumeImageDependencyTests-942168115 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:53:39 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-d59bd26e-78ba-4a30-a9af-7980450e427e tempest-VolumeImageDependencyTests-942168115 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:53:39 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-d59bd26e-78ba-4a30-a9af-7980450e427e tempest-VolumeImageDependencyTests-942168115 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:53:39 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-d59bd26e-78ba-4a30-a9af-7980450e427e tempest-VolumeImageDependencyTests-942168115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:53:39 devstack sudo[112339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a Aug 03 08:53:40 devstack sudo[112339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:53:40 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-0c637ea4-e0c4-4a5c-9e11-3c281d0eeb16 tempest-CreateVolumesFromSnapshotTest-2011744404 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:53:40 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-0c637ea4-e0c4-4a5c-9e11-3c281d0eeb16 tempest-CreateVolumesFromSnapshotTest-2011744404 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:53:40 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-0c637ea4-e0c4-4a5c-9e11-3c281d0eeb16 tempest-CreateVolumesFromSnapshotTest-2011744404 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:53:40 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-0c637ea4-e0c4-4a5c-9e11-3c281d0eeb16 tempest-CreateVolumesFromSnapshotTest-2011744404 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:53:40 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-0c637ea4-e0c4-4a5c-9e11-3c281d0eeb16 tempest-CreateVolumesFromSnapshotTest-2011744404 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:53:40 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-0c637ea4-e0c4-4a5c-9e11-3c281d0eeb16 tempest-CreateVolumesFromSnapshotTest-2011744404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:53:40 devstack sudo[112341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a Aug 03 08:53:40 devstack sudo[112341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:53:40 devstack sudo[112337]: pam_unix(sudo:session): session closed for user root Aug 03 08:53:40 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-c59605df-5b05-4f62-a436-7f0cb63b056f tempest-VolumeDependencyTests-1512358985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4b24bb72-96b2-432f-aa36-80783dfd40ca -F qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-4b24bb72-96b2-432f-aa36-80783dfd40ca.0cb595ce-53b6-45b6-82f3-e5a412b65b11" returned: 0 in 0.424s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:53:40 devstack cinder-volume[88899]: WARNING cinder.volume.drivers.remotefs [None req-c59605df-5b05-4f62-a436-7f0cb63b056f tempest-VolumeDependencyTests-1512358985 None] /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-4b24bb72-96b2-432f-aa36-80783dfd40ca.0cb595ce-53b6-45b6-82f3-e5a412b65b11 is being set with open permissions: ugo+rw Aug 03 08:53:40 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-c59605df-5b05-4f62-a436-7f0cb63b056f tempest-VolumeDependencyTests-1512358985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-4b24bb72-96b2-432f-aa36-80783dfd40ca.0cb595ce-53b6-45b6-82f3-e5a412b65b11 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:53:40 devstack sudo[112332]: pam_unix(sudo:session): session closed for user root Aug 03 08:53:40 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-b86e6d88-4aca-4a5c-b494-26cc05d431d8 tempest-ProjectMemberTests-1353074417 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-428cac50-82ad-4eab-ae80-c9b5769f62ab" returned: 0 in 0.628s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:53:40 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-b86e6d88-4aca-4a5c-b494-26cc05d431d8 tempest-ProjectMemberTests-1353074417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-428cac50-82ad-4eab-ae80-c9b5769f62ab.3d77ea10-1cc0-45a2-be3a-67ffa189471c {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:53:40 devstack sudo[112351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-4b24bb72-96b2-432f-aa36-80783dfd40ca.0cb595ce-53b6-45b6-82f3-e5a412b65b11 Aug 03 08:53:40 devstack sudo[112351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:53:40 devstack sudo[112339]: pam_unix(sudo:session): session closed for user root Aug 03 08:53:40 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-d59bd26e-78ba-4a30-a9af-7980450e427e tempest-VolumeImageDependencyTests-942168115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a" returned: 0 in 0.382s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:53:40 devstack cinder-volume[88899]: DEBUG cinder.manager [None req-d59bd26e-78ba-4a30-a9af-7980450e427e tempest-VolumeImageDependencyTests-942168115 None] Notifying Schedulers of capabilities ... {{(pid=88899) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 08:53:40 devstack sudo[112352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-428cac50-82ad-4eab-ae80-c9b5769f62ab.3d77ea10-1cc0-45a2-be3a-67ffa189471c Aug 03 08:53:40 devstack sudo[112352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:53:40 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-d59bd26e-78ba-4a30-a9af-7980450e427e tempest-VolumeImageDependencyTests-942168115 None] Deleted volume successfully. Aug 03 08:53:40 devstack sudo[112341]: pam_unix(sudo:session): session closed for user root Aug 03 08:53:40 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-0c637ea4-e0c4-4a5c-9e11-3c281d0eeb16 tempest-CreateVolumesFromSnapshotTest-2011744404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a" returned: 0 in 0.356s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:53:40 devstack cinder-volume[88899]: DEBUG cinder.manager [None req-0c637ea4-e0c4-4a5c-9e11-3c281d0eeb16 tempest-CreateVolumesFromSnapshotTest-2011744404 None] Notifying Schedulers of capabilities ... {{(pid=88899) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 08:53:40 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-d59bd26e-78ba-4a30-a9af-7980450e427e tempest-VolumeImageDependencyTests-942168115 None] Lock "cinder-d50f3846-58cd-476d-9c37-57aa92522f39-delete_volume" released by "delete_volume" :: held 1.554s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:53:40 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-0c637ea4-e0c4-4a5c-9e11-3c281d0eeb16 tempest-CreateVolumesFromSnapshotTest-2011744404 None] Deleted volume successfully. Aug 03 08:53:40 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-0c637ea4-e0c4-4a5c-9e11-3c281d0eeb16 tempest-CreateVolumesFromSnapshotTest-2011744404 None] Lock "cinder-94f2ac18-1b2a-43e7-a6ae-1f3c02b1396b-delete_volume" released by "delete_volume" :: held 1.632s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:53:40 devstack sudo[112351]: pam_unix(sudo:session): session closed for user root Aug 03 08:53:40 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-c59605df-5b05-4f62-a436-7f0cb63b056f tempest-VolumeDependencyTests-1512358985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-4b24bb72-96b2-432f-aa36-80783dfd40ca.0cb595ce-53b6-45b6-82f3-e5a412b65b11" returned: 0 in 0.323s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:53:40 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-c59605df-5b05-4f62-a436-7f0cb63b056f tempest-VolumeDependencyTests-1512358985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-4b24bb72-96b2-432f-aa36-80783dfd40ca.info {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:53:40 devstack sudo[112361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-4b24bb72-96b2-432f-aa36-80783dfd40ca.info Aug 03 08:53:40 devstack sudo[112361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:53:40 devstack sudo[112352]: pam_unix(sudo:session): session closed for user root Aug 03 08:53:40 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-b86e6d88-4aca-4a5c-b494-26cc05d431d8 tempest-ProjectMemberTests-1353074417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-428cac50-82ad-4eab-ae80-c9b5769f62ab.3d77ea10-1cc0-45a2-be3a-67ffa189471c" returned: 0 in 0.373s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:53:40 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-b86e6d88-4aca-4a5c-b494-26cc05d431d8 tempest-ProjectMemberTests-1353074417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-428cac50-82ad-4eab-ae80-c9b5769f62ab.3d77ea10-1cc0-45a2-be3a-67ffa189471c {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:53:40 devstack sudo[112363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-428cac50-82ad-4eab-ae80-c9b5769f62ab.3d77ea10-1cc0-45a2-be3a-67ffa189471c Aug 03 08:53:40 devstack sudo[112363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:53:40 devstack sudo[112361]: pam_unix(sudo:session): session closed for user root Aug 03 08:53:40 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-c59605df-5b05-4f62-a436-7f0cb63b056f tempest-VolumeDependencyTests-1512358985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-4b24bb72-96b2-432f-aa36-80783dfd40ca.info" returned: 0 in 0.264s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:53:40 devstack cinder-volume[88899]: WARNING cinder.volume.drivers.remotefs [None req-c59605df-5b05-4f62-a436-7f0cb63b056f tempest-VolumeDependencyTests-1512358985 None] /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-4b24bb72-96b2-432f-aa36-80783dfd40ca.info is being set with open permissions: ugo+rw Aug 03 08:53:40 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-c59605df-5b05-4f62-a436-7f0cb63b056f tempest-VolumeDependencyTests-1512358985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-4b24bb72-96b2-432f-aa36-80783dfd40ca.info {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:53:40 devstack sudo[112367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-4b24bb72-96b2-432f-aa36-80783dfd40ca.info Aug 03 08:53:40 devstack sudo[112367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:53:40 devstack sudo[112363]: pam_unix(sudo:session): session closed for user root Aug 03 08:53:40 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-b86e6d88-4aca-4a5c-b494-26cc05d431d8 tempest-ProjectMemberTests-1353074417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-428cac50-82ad-4eab-ae80-c9b5769f62ab.3d77ea10-1cc0-45a2-be3a-67ffa189471c" returned: 0 in 0.252s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:53:41 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-b86e6d88-4aca-4a5c-b494-26cc05d431d8 tempest-ProjectMemberTests-1353074417 None] Lock "cinder-quobyte-3d77ea10-1cc0-45a2-be3a-67ffa189471c" released by "_delete_snapshot" :: held 1.847s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:53:41 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-b86e6d88-4aca-4a5c-b494-26cc05d431d8 tempest-ProjectMemberTests-1353074417 None] Lock "cinder-quobyte-428cac50-82ad-4eab-ae80-c9b5769f62ab" released by "delete_snapshot" :: held 1.884s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:53:41 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-25f6c897-0b2f-4170-b2ae-e49a056b5ee8 tempest-CreateVolumesFromSnapshotTest-2011744404 None] Acquiring lock "cinder-aa9dc0ab-aa99-48ed-9db0-3b2ea84bd0fe-delete_volume" by "delete_volume" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:53:41 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-25f6c897-0b2f-4170-b2ae-e49a056b5ee8 tempest-CreateVolumesFromSnapshotTest-2011744404 None] Lock "cinder-aa9dc0ab-aa99-48ed-9db0-3b2ea84bd0fe-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:53:41 devstack cinder-volume[88899]: DEBUG cinder.quota [None req-b86e6d88-4aca-4a5c-b494-26cc05d431d8 tempest-ProjectMemberTests-1353074417 None] Created reservations ['5df47fb3-1b60-4c68-86e3-1d5f1fb2ce40', 'c4244599-a209-463f-a4ec-6a294ea849dc', '5e9fbe49-9d82-4d1b-afe4-af9f19412f82', 'e43a1ad5-8711-4561-8ac6-cc4cb470906a'] {{(pid=88899) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 08:53:41 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-25f6c897-0b2f-4170-b2ae-e49a056b5ee8 tempest-CreateVolumesFromSnapshotTest-2011744404 None] Acquiring lock "cinder-quobyte-aa9dc0ab-aa99-48ed-9db0-3b2ea84bd0fe" by "delete_volume" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:53:41 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-25f6c897-0b2f-4170-b2ae-e49a056b5ee8 tempest-CreateVolumesFromSnapshotTest-2011744404 None] Lock "cinder-quobyte-aa9dc0ab-aa99-48ed-9db0-3b2ea84bd0fe" acquired by "delete_volume" :: waited 0.027s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:53:41 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc001d5b-b268-4659-bf7d-81dd60c68694]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:53:41 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-25f6c897-0b2f-4170-b2ae-e49a056b5ee8 tempest-CreateVolumesFromSnapshotTest-2011744404 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-aa9dc0ab-aa99-48ed-9db0-3b2ea84bd0fe {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:53:41 devstack sudo[112367]: pam_unix(sudo:session): session closed for user root Aug 03 08:53:41 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-c59605df-5b05-4f62-a436-7f0cb63b056f tempest-VolumeDependencyTests-1512358985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-4b24bb72-96b2-432f-aa36-80783dfd40ca.info" returned: 0 in 0.350s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:53:41 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-c59605df-5b05-4f62-a436-7f0cb63b056f tempest-VolumeDependencyTests-1512358985 None] Acquiring lock "cinder-quobyte-ec448af7-0d13-45ba-9422-d77537c4249c" by "_copy_volume_from_snapshot" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:53:41 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-b86e6d88-4aca-4a5c-b494-26cc05d431d8 tempest-ProjectMemberTests-1353074417 None] Delete snapshot completed successfully. Aug 03 08:53:41 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-c59605df-5b05-4f62-a436-7f0cb63b056f tempest-VolumeDependencyTests-1512358985 None] Lock "cinder-quobyte-ec448af7-0d13-45ba-9422-d77537c4249c" acquired by "_copy_volume_from_snapshot" :: waited 0.048s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:53:41 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-c59605df-5b05-4f62-a436-7f0cb63b056f tempest-VolumeDependencyTests-1512358985 None] snapshot: 0cb595ce-53b6-45b6-82f3-e5a412b65b11, volume: ec448af7-0d13-45ba-9422-d77537c4249c, {{(pid=88899) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Aug 03 08:53:41 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-c59605df-5b05-4f62-a436-7f0cb63b056f tempest-VolumeDependencyTests-1512358985 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:53:41 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-c59605df-5b05-4f62-a436-7f0cb63b056f tempest-VolumeDependencyTests-1512358985 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:53:41 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-c59605df-5b05-4f62-a436-7f0cb63b056f tempest-VolumeDependencyTests-1512358985 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:53:41 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-c59605df-5b05-4f62-a436-7f0cb63b056f tempest-VolumeDependencyTests-1512358985 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:53:41 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-c59605df-5b05-4f62-a436-7f0cb63b056f tempest-VolumeDependencyTests-1512358985 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:53:41 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-eef8f96f-84fb-4af1-a70f-c94184b88df6 tempest-ProjectMemberTests-1353074417 None] Acquiring lock "cinder-428cac50-82ad-4eab-ae80-c9b5769f62ab-delete_volume" by "delete_volume" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:53:41 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-b86e6d88-4aca-4a5c-b494-26cc05d431d8 tempest-ProjectMemberTests-1353074417 None] Lock "cinder-3d77ea10-1cc0-45a2-be3a-67ffa189471c-delete_snapshot" released by "delete_snapshot" :: held 2.289s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:53:41 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[0352998c-adbd-4a27-a44d-66a2f24f1271]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:53:41 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-c59605df-5b05-4f62-a436-7f0cb63b056f tempest-VolumeDependencyTests-1512358985 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-4b24bb72-96b2-432f-aa36-80783dfd40ca.0cb595ce-53b6-45b6-82f3-e5a412b65b11 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:53:41 devstack sudo[112370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-aa9dc0ab-aa99-48ed-9db0-3b2ea84bd0fe Aug 03 08:53:41 devstack sudo[112370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:53:41 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-eef8f96f-84fb-4af1-a70f-c94184b88df6 tempest-ProjectMemberTests-1353074417 None] Lock "cinder-428cac50-82ad-4eab-ae80-c9b5769f62ab-delete_volume" acquired by "delete_volume" :: waited 0.055s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:53:41 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-eef8f96f-84fb-4af1-a70f-c94184b88df6 tempest-ProjectMemberTests-1353074417 None] Acquiring lock "cinder-quobyte-428cac50-82ad-4eab-ae80-c9b5769f62ab" by "delete_volume" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:53:41 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-eef8f96f-84fb-4af1-a70f-c94184b88df6 tempest-ProjectMemberTests-1353074417 None] Lock "cinder-quobyte-428cac50-82ad-4eab-ae80-c9b5769f62ab" acquired by "delete_volume" :: waited 0.026s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:53:41 devstack sudo[112371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-4b24bb72-96b2-432f-aa36-80783dfd40ca.0cb595ce-53b6-45b6-82f3-e5a412b65b11 Aug 03 08:53:41 devstack sudo[112371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:53:41 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[83d28f12-1b0d-43cb-90b3-1f2dbe12148e]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:53:41 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-eef8f96f-84fb-4af1-a70f-c94184b88df6 tempest-ProjectMemberTests-1353074417 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-428cac50-82ad-4eab-ae80-c9b5769f62ab {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:53:41 devstack sudo[112374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-428cac50-82ad-4eab-ae80-c9b5769f62ab Aug 03 08:53:41 devstack sudo[112374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:53:41 devstack sudo[112370]: pam_unix(sudo:session): session closed for user root Aug 03 08:53:41 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-25f6c897-0b2f-4170-b2ae-e49a056b5ee8 tempest-CreateVolumesFromSnapshotTest-2011744404 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-aa9dc0ab-aa99-48ed-9db0-3b2ea84bd0fe" returned: 0 in 0.522s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:53:41 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-25f6c897-0b2f-4170-b2ae-e49a056b5ee8 tempest-CreateVolumesFromSnapshotTest-2011744404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-aa9dc0ab-aa99-48ed-9db0-3b2ea84bd0fe {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:53:41 devstack sudo[112385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-aa9dc0ab-aa99-48ed-9db0-3b2ea84bd0fe Aug 03 08:53:41 devstack sudo[112385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:53:41 devstack sudo[112371]: pam_unix(sudo:session): session closed for user root Aug 03 08:53:41 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-c59605df-5b05-4f62-a436-7f0cb63b056f tempest-VolumeDependencyTests-1512358985 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-4b24bb72-96b2-432f-aa36-80783dfd40ca.0cb595ce-53b6-45b6-82f3-e5a412b65b11" returned: 0 in 0.396s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:53:41 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-c59605df-5b05-4f62-a436-7f0cb63b056f tempest-VolumeDependencyTests-1512358985 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4b24bb72-96b2-432f-aa36-80783dfd40ca(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88899) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 03 08:53:41 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[07173574-ef74-4afb-b509-daa8238194e1]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:53:41 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-c59605df-5b05-4f62-a436-7f0cb63b056f tempest-VolumeDependencyTests-1512358985 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-4b24bb72-96b2-432f-aa36-80783dfd40ca {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:53:41 devstack sudo[112387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-4b24bb72-96b2-432f-aa36-80783dfd40ca Aug 03 08:53:41 devstack sudo[112387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:53:41 devstack sudo[112374]: pam_unix(sudo:session): session closed for user root Aug 03 08:53:41 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-eef8f96f-84fb-4af1-a70f-c94184b88df6 tempest-ProjectMemberTests-1353074417 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-428cac50-82ad-4eab-ae80-c9b5769f62ab" returned: 0 in 0.413s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:53:41 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-eef8f96f-84fb-4af1-a70f-c94184b88df6 tempest-ProjectMemberTests-1353074417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-428cac50-82ad-4eab-ae80-c9b5769f62ab {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:53:41 devstack sudo[112393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-428cac50-82ad-4eab-ae80-c9b5769f62ab Aug 03 08:53:41 devstack sudo[112393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:53:42 devstack sudo[112385]: pam_unix(sudo:session): session closed for user root Aug 03 08:53:42 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-25f6c897-0b2f-4170-b2ae-e49a056b5ee8 tempest-CreateVolumesFromSnapshotTest-2011744404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-aa9dc0ab-aa99-48ed-9db0-3b2ea84bd0fe" returned: 0 in 0.311s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:53:42 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-25f6c897-0b2f-4170-b2ae-e49a056b5ee8 tempest-CreateVolumesFromSnapshotTest-2011744404 None] Lock "cinder-quobyte-aa9dc0ab-aa99-48ed-9db0-3b2ea84bd0fe" released by "delete_volume" :: held 0.908s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:53:42 devstack cinder-volume[88899]: DEBUG cinder.quota [None req-25f6c897-0b2f-4170-b2ae-e49a056b5ee8 tempest-CreateVolumesFromSnapshotTest-2011744404 None] Created reservations ['6b9cd754-b1c2-4301-a055-5f0046eed6c1', '3a62e1ae-9a54-461e-a6ff-bf153d632eca', 'c28d1200-6108-4ffc-9f4f-1eea35f6de0a', 'bf8a58c8-b4e6-48c8-a80d-37cd89d0b92a'] {{(pid=88899) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 08:53:42 devstack sudo[112387]: pam_unix(sudo:session): session closed for user root Aug 03 08:53:42 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-c59605df-5b05-4f62-a436-7f0cb63b056f tempest-VolumeDependencyTests-1512358985 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-4b24bb72-96b2-432f-aa36-80783dfd40ca" returned: 0 in 0.411s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:53:42 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-c59605df-5b05-4f62-a436-7f0cb63b056f tempest-VolumeDependencyTests-1512358985 None] will copy from snapshot at /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-4b24bb72-96b2-432f-aa36-80783dfd40ca {{(pid=88899) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Aug 03 08:53:42 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-c59605df-5b05-4f62-a436-7f0cb63b056f tempest-VolumeDependencyTests-1512358985 None] Creating direct copy from snapshot {{(pid=88899) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Aug 03 08:53:42 devstack cinder-volume[88899]: DEBUG cinder.utils [None req-c59605df-5b05-4f62-a436-7f0cb63b056f tempest-VolumeDependencyTests-1512358985 None] Path /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-ec448af7-0d13-45ba-9422-d77537c4249c not found in is_blk_device check {{(pid=88899) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Aug 03 08:53:42 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-c59605df-5b05-4f62-a436-7f0cb63b056f tempest-VolumeDependencyTests-1512358985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-4b24bb72-96b2-432f-aa36-80783dfd40ca /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-ec448af7-0d13-45ba-9422-d77537c4249c {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:53:42 devstack sudo[112400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-4b24bb72-96b2-432f-aa36-80783dfd40ca /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-ec448af7-0d13-45ba-9422-d77537c4249c Aug 03 08:53:42 devstack sudo[112400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:53:42 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-25f6c897-0b2f-4170-b2ae-e49a056b5ee8 tempest-CreateVolumesFromSnapshotTest-2011744404 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:53:42 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-25f6c897-0b2f-4170-b2ae-e49a056b5ee8 tempest-CreateVolumesFromSnapshotTest-2011744404 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:53:42 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-25f6c897-0b2f-4170-b2ae-e49a056b5ee8 tempest-CreateVolumesFromSnapshotTest-2011744404 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:53:42 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-25f6c897-0b2f-4170-b2ae-e49a056b5ee8 tempest-CreateVolumesFromSnapshotTest-2011744404 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:53:42 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-25f6c897-0b2f-4170-b2ae-e49a056b5ee8 tempest-CreateVolumesFromSnapshotTest-2011744404 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:53:42 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-25f6c897-0b2f-4170-b2ae-e49a056b5ee8 tempest-CreateVolumesFromSnapshotTest-2011744404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:53:42 devstack sudo[112403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a Aug 03 08:53:42 devstack sudo[112403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:53:42 devstack sudo[112393]: pam_unix(sudo:session): session closed for user root Aug 03 08:53:42 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-eef8f96f-84fb-4af1-a70f-c94184b88df6 tempest-ProjectMemberTests-1353074417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-428cac50-82ad-4eab-ae80-c9b5769f62ab" returned: 0 in 0.364s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:53:42 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-eef8f96f-84fb-4af1-a70f-c94184b88df6 tempest-ProjectMemberTests-1353074417 None] Lock "cinder-quobyte-428cac50-82ad-4eab-ae80-c9b5769f62ab" released by "delete_volume" :: held 0.861s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:53:42 devstack cinder-volume[88899]: DEBUG cinder.quota [None req-eef8f96f-84fb-4af1-a70f-c94184b88df6 tempest-ProjectMemberTests-1353074417 None] Created reservations ['37678f62-31be-4615-aa1b-0c3ee37a29c1', '7e224bfb-d8e7-4968-af7d-b193ba37afbb', '561f4dbd-d124-4c0a-81a0-db49f834d61e', '3c87529f-fec1-4d6c-b8e6-20f3b2502e02'] {{(pid=88899) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 08:53:42 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-eef8f96f-84fb-4af1-a70f-c94184b88df6 tempest-ProjectMemberTests-1353074417 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:53:42 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-eef8f96f-84fb-4af1-a70f-c94184b88df6 tempest-ProjectMemberTests-1353074417 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:53:42 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-eef8f96f-84fb-4af1-a70f-c94184b88df6 tempest-ProjectMemberTests-1353074417 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:53:42 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-eef8f96f-84fb-4af1-a70f-c94184b88df6 tempest-ProjectMemberTests-1353074417 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:53:42 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-eef8f96f-84fb-4af1-a70f-c94184b88df6 tempest-ProjectMemberTests-1353074417 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:53:42 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-eef8f96f-84fb-4af1-a70f-c94184b88df6 tempest-ProjectMemberTests-1353074417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:53:42 devstack sudo[112406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a Aug 03 08:53:42 devstack sudo[112406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:53:42 devstack sudo[112403]: pam_unix(sudo:session): session closed for user root Aug 03 08:53:42 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-25f6c897-0b2f-4170-b2ae-e49a056b5ee8 tempest-CreateVolumesFromSnapshotTest-2011744404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a" returned: 0 in 0.319s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:53:42 devstack cinder-volume[88899]: DEBUG cinder.manager [None req-25f6c897-0b2f-4170-b2ae-e49a056b5ee8 tempest-CreateVolumesFromSnapshotTest-2011744404 None] Notifying Schedulers of capabilities ... {{(pid=88899) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 08:53:42 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-25f6c897-0b2f-4170-b2ae-e49a056b5ee8 tempest-CreateVolumesFromSnapshotTest-2011744404 None] Deleted volume successfully. Aug 03 08:53:42 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-25f6c897-0b2f-4170-b2ae-e49a056b5ee8 tempest-CreateVolumesFromSnapshotTest-2011744404 None] Lock "cinder-aa9dc0ab-aa99-48ed-9db0-3b2ea84bd0fe-delete_volume" released by "delete_volume" :: held 1.582s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:53:42 devstack sudo[112406]: pam_unix(sudo:session): session closed for user root Aug 03 08:53:42 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-eef8f96f-84fb-4af1-a70f-c94184b88df6 tempest-ProjectMemberTests-1353074417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a" returned: 0 in 0.319s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:53:42 devstack cinder-volume[88899]: DEBUG cinder.manager [None req-eef8f96f-84fb-4af1-a70f-c94184b88df6 tempest-ProjectMemberTests-1353074417 None] Notifying Schedulers of capabilities ... {{(pid=88899) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 08:53:42 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-eef8f96f-84fb-4af1-a70f-c94184b88df6 tempest-ProjectMemberTests-1353074417 None] Deleted volume successfully. Aug 03 08:53:42 devstack sudo[112400]: pam_unix(sudo:session): session closed for user root Aug 03 08:53:42 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-c59605df-5b05-4f62-a436-7f0cb63b056f tempest-VolumeDependencyTests-1512358985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-4b24bb72-96b2-432f-aa36-80783dfd40ca /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-ec448af7-0d13-45ba-9422-d77537c4249c" returned: 0 in 0.646s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:53:42 devstack cinder-volume[88899]: DEBUG cinder.image.image_utils [None req-c59605df-5b05-4f62-a436-7f0cb63b056f tempest-VolumeDependencyTests-1512358985 None] Image conversion details: src /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-4b24bb72-96b2-432f-aa36-80783dfd40ca, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-ec448af7-0d13-45ba-9422-d77537c4249c {{(pid=88899) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 03 08:53:42 devstack cinder-volume[88899]: INFO cinder.image.image_utils [None req-c59605df-5b05-4f62-a436-7f0cb63b056f tempest-VolumeDependencyTests-1512358985 None] Converted 1024.00 MB image at 1024.00 MB/s Aug 03 08:53:42 devstack cinder-volume[88899]: WARNING cinder.volume.drivers.remotefs [None req-c59605df-5b05-4f62-a436-7f0cb63b056f tempest-VolumeDependencyTests-1512358985 None] /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-ec448af7-0d13-45ba-9422-d77537c4249c is being set with open permissions: ugo+rw Aug 03 08:53:42 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-c59605df-5b05-4f62-a436-7f0cb63b056f tempest-VolumeDependencyTests-1512358985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-ec448af7-0d13-45ba-9422-d77537c4249c {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:53:42 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-eef8f96f-84fb-4af1-a70f-c94184b88df6 tempest-ProjectMemberTests-1353074417 None] Lock "cinder-428cac50-82ad-4eab-ae80-c9b5769f62ab-delete_volume" released by "delete_volume" :: held 1.456s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:53:42 devstack sudo[112413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-ec448af7-0d13-45ba-9422-d77537c4249c Aug 03 08:53:42 devstack sudo[112413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:53:43 devstack cinder-volume[88899]: DEBUG cinder.volume.flows.manager.create_volume [None req-69450607-f4e5-4223-8e57-603fd0164e82 tempest-ProjectMemberTests-1353074417 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88899) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 08:53:43 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-69450607-f4e5-4223-8e57-603fd0164e82 tempest-ProjectMemberTests-1353074417 None] Flow 'volume_create_manager' (7a1990d8-cfd8-4787-b854-5e43cee16b87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:53:43 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-69450607-f4e5-4223-8e57-603fd0164e82 tempest-ProjectMemberTests-1353074417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (20d83289-dbba-42f2-b821-732659ef88f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:53:43 devstack sudo[112413]: pam_unix(sudo:session): session closed for user root Aug 03 08:53:43 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-c59605df-5b05-4f62-a436-7f0cb63b056f tempest-VolumeDependencyTests-1512358985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-ec448af7-0d13-45ba-9422-d77537c4249c" returned: 0 in 0.287s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:53:43 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-69450607-f4e5-4223-8e57-603fd0164e82 tempest-ProjectMemberTests-1353074417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (20d83289-dbba-42f2-b821-732659ef88f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:53:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1370525162',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9143315a-67be-4bc8-b7b6-bb15371535ce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b723e915839a4036ad739740ec4db0cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:53:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:53:43Z,use_quota=True,user_id='d9152484679b4fb79b0d8896a2a67eb9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8bde7129-1dc4-42ab-b852-ab32c61b4921),volume_type_id=8bde7129-1dc4-42ab-b852-ab32c61b4921)' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:53:43 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-69450607-f4e5-4223-8e57-603fd0164e82 tempest-ProjectMemberTests-1353074417 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b196f6d-11fa-4f3e-b659-09bd7916f837) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:53:43 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-69450607-f4e5-4223-8e57-603fd0164e82 tempest-ProjectMemberTests-1353074417 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b196f6d-11fa-4f3e-b659-09bd7916f837) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:53:43 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-69450607-f4e5-4223-8e57-603fd0164e82 tempest-ProjectMemberTests-1353074417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef8dc0bb-216e-4f8b-99ce-a08009d3402a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:53:43 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-69450607-f4e5-4223-8e57-603fd0164e82 tempest-ProjectMemberTests-1353074417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef8dc0bb-216e-4f8b-99ce-a08009d3402a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9143315a-67be-4bc8-b7b6-bb15371535ce', 'volume_name': 'volume-9143315a-67be-4bc8-b7b6-bb15371535ce', 'volume_size': 1}' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:53:43 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-69450607-f4e5-4223-8e57-603fd0164e82 tempest-ProjectMemberTests-1353074417 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (91001d9b-7ef8-483f-81c5-9b2d6fcae9e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:53:43 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-69450607-f4e5-4223-8e57-603fd0164e82 tempest-ProjectMemberTests-1353074417 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (91001d9b-7ef8-483f-81c5-9b2d6fcae9e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:53:43 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-69450607-f4e5-4223-8e57-603fd0164e82 tempest-ProjectMemberTests-1353074417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df395fe5-cd2a-48ff-a7f1-43b16100c28b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:53:43 devstack cinder-volume[88899]: INFO cinder.volume.flows.manager.create_volume [None req-69450607-f4e5-4223-8e57-603fd0164e82 tempest-ProjectMemberTests-1353074417 None] Volume 9143315a-67be-4bc8-b7b6-bb15371535ce: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9143315a-67be-4bc8-b7b6-bb15371535ce', 'volume_size': 1} Aug 03 08:53:43 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-69450607-f4e5-4223-8e57-603fd0164e82 tempest-ProjectMemberTests-1353074417 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:53:43 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-c59605df-5b05-4f62-a436-7f0cb63b056f tempest-VolumeDependencyTests-1512358985 None] Lock "cinder-quobyte-ec448af7-0d13-45ba-9422-d77537c4249c" released by "_copy_volume_from_snapshot" :: held 1.895s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:53:43 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-c59605df-5b05-4f62-a436-7f0cb63b056f tempest-VolumeDependencyTests-1512358985 None] Acquiring lock "cinder-quobyte-0cb595ce-53b6-45b6-82f3-e5a412b65b11" by "_delete_snapshot" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:53:43 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-c59605df-5b05-4f62-a436-7f0cb63b056f tempest-VolumeDependencyTests-1512358985 None] Lock "cinder-quobyte-0cb595ce-53b6-45b6-82f3-e5a412b65b11" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:53:43 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-c59605df-5b05-4f62-a436-7f0cb63b056f tempest-VolumeDependencyTests-1512358985 None] Deleting offline snapshot 0cb595ce-53b6-45b6-82f3-e5a412b65b11 of volume 4b24bb72-96b2-432f-aa36-80783dfd40ca {{(pid=88899) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 03 08:53:43 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-c59605df-5b05-4f62-a436-7f0cb63b056f tempest-VolumeDependencyTests-1512358985 None] snapshot_file for this snap is: volume-4b24bb72-96b2-432f-aa36-80783dfd40ca.0cb595ce-53b6-45b6-82f3-e5a412b65b11 {{(pid=88899) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 03 08:53:43 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8fcf2fa-0bef-4c9f-bb32-b4970bdf0c95]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:53:43 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-c59605df-5b05-4f62-a436-7f0cb63b056f tempest-VolumeDependencyTests-1512358985 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-4b24bb72-96b2-432f-aa36-80783dfd40ca.0cb595ce-53b6-45b6-82f3-e5a412b65b11 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:53:43 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-97dec1dc-a29d-43c5-99ea-ed52763ae019 tempest-CreateVolumesFromSnapshotTest-2011744404 None] Acquiring lock "cinder-8212e20b-b962-484c-87c9-a005a5381f5e-delete_volume" by "delete_volume" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:53:43 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-97dec1dc-a29d-43c5-99ea-ed52763ae019 tempest-CreateVolumesFromSnapshotTest-2011744404 None] Lock "cinder-8212e20b-b962-484c-87c9-a005a5381f5e-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:53:43 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-97dec1dc-a29d-43c5-99ea-ed52763ae019 tempest-CreateVolumesFromSnapshotTest-2011744404 None] Acquiring lock "cinder-quobyte-8212e20b-b962-484c-87c9-a005a5381f5e" by "delete_volume" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:53:43 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-97dec1dc-a29d-43c5-99ea-ed52763ae019 tempest-CreateVolumesFromSnapshotTest-2011744404 None] Lock "cinder-quobyte-8212e20b-b962-484c-87c9-a005a5381f5e" acquired by "delete_volume" :: waited 0.021s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:53:43 devstack sudo[112416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-4b24bb72-96b2-432f-aa36-80783dfd40ca.0cb595ce-53b6-45b6-82f3-e5a412b65b11 Aug 03 08:53:43 devstack sudo[112416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:53:43 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c3c901a-48b6-4785-8170-7d5462796b64]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:53:43 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-97dec1dc-a29d-43c5-99ea-ed52763ae019 tempest-CreateVolumesFromSnapshotTest-2011744404 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-8212e20b-b962-484c-87c9-a005a5381f5e {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:53:43 devstack sudo[112418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-8212e20b-b962-484c-87c9-a005a5381f5e Aug 03 08:53:43 devstack sudo[112418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:53:43 devstack cinder-volume[88899]: DEBUG cinder.volume.flows.manager.create_volume [None req-bdcd5a81-447a-412d-84a1-e860a9897b66 tempest-VolumeImageDependencyTests-942168115 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88899) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 08:53:43 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-bdcd5a81-447a-412d-84a1-e860a9897b66 tempest-VolumeImageDependencyTests-942168115 None] Flow 'volume_create_manager' (9ab6233e-085e-435b-b1aa-c9a657099202) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:53:43 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-bdcd5a81-447a-412d-84a1-e860a9897b66 tempest-VolumeImageDependencyTests-942168115 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f4dc367-e09b-44f8-a826-679123f828c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:53:43 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-bdcd5a81-447a-412d-84a1-e860a9897b66 tempest-VolumeImageDependencyTests-942168115 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f4dc367-e09b-44f8-a826-679123f828c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:53:43Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test0e20bd6e-440f-41d8-9b5d-fc047ac00423',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a83eaa93-b6be-408e-9aaa-3d7c742db983,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fb20ce3648d1497fb23ac775415e7a44',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:53:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:53:44Z,use_quota=True,user_id='ec19afbca65f4a8185b3231a39404ec7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8bde7129-1dc4-42ab-b852-ab32c61b4921),volume_type_id=8bde7129-1dc4-42ab-b852-ab32c61b4921)' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:53:43 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-bdcd5a81-447a-412d-84a1-e860a9897b66 tempest-VolumeImageDependencyTests-942168115 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (417aacf1-12eb-42c6-8e20-8abaf18d701e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:53:43 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-bdcd5a81-447a-412d-84a1-e860a9897b66 tempest-VolumeImageDependencyTests-942168115 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (417aacf1-12eb-42c6-8e20-8abaf18d701e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:53:43 devstack sudo[112416]: pam_unix(sudo:session): session closed for user root Aug 03 08:53:43 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-bdcd5a81-447a-412d-84a1-e860a9897b66 tempest-VolumeImageDependencyTests-942168115 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d92df18-1cb9-4a8b-8b07-d49e98daa385) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:53:43 devstack cinder-volume[88899]: DEBUG cinder.image.glance [None req-bdcd5a81-447a-412d-84a1-e860a9897b66 tempest-VolumeImageDependencyTests-942168115 None] Creating Keystone auth plugin from conf {{(pid=88899) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Aug 03 08:53:43 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-c59605df-5b05-4f62-a436-7f0cb63b056f tempest-VolumeDependencyTests-1512358985 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-4b24bb72-96b2-432f-aa36-80783dfd40ca.0cb595ce-53b6-45b6-82f3-e5a412b65b11" returned: 0 in 0.424s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:53:43 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-c59605df-5b05-4f62-a436-7f0cb63b056f tempest-VolumeDependencyTests-1512358985 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4b24bb72-96b2-432f-aa36-80783dfd40ca(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88899) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 03 08:53:43 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e6406f8-6f1b-4769-97f6-3346bc530f9f]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:53:43 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-c59605df-5b05-4f62-a436-7f0cb63b056f tempest-VolumeDependencyTests-1512358985 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-4b24bb72-96b2-432f-aa36-80783dfd40ca {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:53:43 devstack sudo[112418]: pam_unix(sudo:session): session closed for user root Aug 03 08:53:43 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-97dec1dc-a29d-43c5-99ea-ed52763ae019 tempest-CreateVolumesFromSnapshotTest-2011744404 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-8212e20b-b962-484c-87c9-a005a5381f5e" returned: 0 in 0.400s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:53:43 devstack sudo[112423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-4b24bb72-96b2-432f-aa36-80783dfd40ca Aug 03 08:53:43 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-97dec1dc-a29d-43c5-99ea-ed52763ae019 tempest-CreateVolumesFromSnapshotTest-2011744404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-8212e20b-b962-484c-87c9-a005a5381f5e {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:53:43 devstack sudo[112423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:53:43 devstack sudo[112428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-8212e20b-b962-484c-87c9-a005a5381f5e Aug 03 08:53:43 devstack sudo[112428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:53:43 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-bdcd5a81-447a-412d-84a1-e860a9897b66 tempest-VolumeImageDependencyTests-942168115 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d92df18-1cb9-4a8b-8b07-d49e98daa385) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'a83eaa93-b6be-408e-9aaa-3d7c742db983', 'volume_name': 'volume-a83eaa93-b6be-408e-9aaa-3d7c742db983', 'volume_size': 1, 'image_id': '7ae30a3b-e3a4-40d9-8a51-9efe26db7ca8', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7ae30a3b-e3a4-40d9-8a51-9efe26db7ca8', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-0e20bd6e-440f-41d8-9b5d-fc047ac00423', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '9ed0e24b8165061776cc81533895c53c', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'fb20ce3648d1497fb23ac775415e7a44', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '3f50c0a09c2d7c7c8dac5de664d1ecc0ab864f33b017e5178f68c45bdebb4a0903075de05af0055959a0802d6d344688313c4317ab631c88d18c56452fa17a9d', 'id': '7ae30a3b-e3a4-40d9-8a51-9efe26db7ca8', 'created_at': datetime.datetime(2026, 8, 3, 6, 53, 41, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 3, 6, 53, 43, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7ae30a3b-e3a4-40d9-8a51-9efe26db7ca8/file', 'properties': {}}, 'image_service': }' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:53:43 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-bdcd5a81-447a-412d-84a1-e860a9897b66 tempest-VolumeImageDependencyTests-942168115 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b4c72b7-15c2-40bf-8216-9978711d38f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:53:43 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-bdcd5a81-447a-412d-84a1-e860a9897b66 tempest-VolumeImageDependencyTests-942168115 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b4c72b7-15c2-40bf-8216-9978711d38f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:53:43 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-bdcd5a81-447a-412d-84a1-e860a9897b66 tempest-VolumeImageDependencyTests-942168115 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ab96970-f6a1-45c1-b992-5b580590b244) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:53:43 devstack cinder-volume[88899]: INFO cinder.volume.flows.manager.create_volume [None req-bdcd5a81-447a-412d-84a1-e860a9897b66 tempest-VolumeImageDependencyTests-942168115 None] Volume a83eaa93-b6be-408e-9aaa-3d7c742db983: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-a83eaa93-b6be-408e-9aaa-3d7c742db983', 'volume_size': 1, 'image_id': '7ae30a3b-e3a4-40d9-8a51-9efe26db7ca8', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7ae30a3b-e3a4-40d9-8a51-9efe26db7ca8', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-0e20bd6e-440f-41d8-9b5d-fc047ac00423', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '9ed0e24b8165061776cc81533895c53c', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'fb20ce3648d1497fb23ac775415e7a44', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '3f50c0a09c2d7c7c8dac5de664d1ecc0ab864f33b017e5178f68c45bdebb4a0903075de05af0055959a0802d6d344688313c4317ab631c88d18c56452fa17a9d', 'id': '7ae30a3b-e3a4-40d9-8a51-9efe26db7ca8', 'created_at': datetime.datetime(2026, 8, 3, 6, 53, 41, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 3, 6, 53, 43, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7ae30a3b-e3a4-40d9-8a51-9efe26db7ca8/file', 'properties': {}}, 'image_service': } Aug 03 08:53:43 devstack cinder-volume[88899]: DEBUG cinder.volume.flows.manager.create_volume [None req-bdcd5a81-447a-412d-84a1-e860a9897b66 tempest-VolumeImageDependencyTests-942168115 None] Trying to clone a83eaa93-b6be-408e-9aaa-3d7c742db983 from image 7ae30a3b-e3a4-40d9-8a51-9efe26db7ca8 at location (None, [{'url': 'file:///opt/stack/data/glance/images/7ae30a3b-e3a4-40d9-8a51-9efe26db7ca8', 'metadata': {}}]). {{(pid=88899) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Aug 03 08:53:44 devstack cinder-volume[88899]: DEBUG cinder.image.image_utils [None req-bdcd5a81-447a-412d-84a1-e860a9897b66 tempest-VolumeImageDependencyTests-942168115 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_7ae30a3b-e3a4-40d9-8a51-9efe26db7ca8_qyi0gynqdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=88899) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Aug 03 08:53:44 devstack cinder-volume[88899]: INFO cinder.image.image_utils [None req-bdcd5a81-447a-412d-84a1-e860a9897b66 tempest-VolumeImageDependencyTests-942168115 None] Image download 0.00 MB at 0.00 MB/s Aug 03 08:53:44 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[237c74be-a1d0-40f3-87ca-a30461047970]: (4, 'raw') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:53:44 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-bdcd5a81-447a-412d-84a1-e860a9897b66 tempest-VolumeImageDependencyTests-942168115 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7ae30a3b-e3a4-40d9-8a51-9efe26db7ca8_qyi0gynqdevstack@QuobyteHD {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:53:44 devstack sudo[112423]: pam_unix(sudo:session): session closed for user root Aug 03 08:53:44 devstack sudo[112428]: pam_unix(sudo:session): session closed for user root Aug 03 08:53:44 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-c59605df-5b05-4f62-a436-7f0cb63b056f tempest-VolumeDependencyTests-1512358985 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-4b24bb72-96b2-432f-aa36-80783dfd40ca" returned: 0 in 0.395s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:53:44 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-c59605df-5b05-4f62-a436-7f0cb63b056f tempest-VolumeDependencyTests-1512358985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-4b24bb72-96b2-432f-aa36-80783dfd40ca.0cb595ce-53b6-45b6-82f3-e5a412b65b11 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:53:44 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-97dec1dc-a29d-43c5-99ea-ed52763ae019 tempest-CreateVolumesFromSnapshotTest-2011744404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-8212e20b-b962-484c-87c9-a005a5381f5e" returned: 0 in 0.284s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:53:44 devstack sudo[112435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-4b24bb72-96b2-432f-aa36-80783dfd40ca.0cb595ce-53b6-45b6-82f3-e5a412b65b11 Aug 03 08:53:44 devstack sudo[112435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:53:44 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-97dec1dc-a29d-43c5-99ea-ed52763ae019 tempest-CreateVolumesFromSnapshotTest-2011744404 None] Lock "cinder-quobyte-8212e20b-b962-484c-87c9-a005a5381f5e" released by "delete_volume" :: held 0.750s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:53:44 devstack sudo[112434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7ae30a3b-e3a4-40d9-8a51-9efe26db7ca8_qyi0gynqdevstack@QuobyteHD Aug 03 08:53:44 devstack sudo[112434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:53:44 devstack cinder-volume[88899]: DEBUG cinder.quota [None req-97dec1dc-a29d-43c5-99ea-ed52763ae019 tempest-CreateVolumesFromSnapshotTest-2011744404 None] Created reservations ['f77013a4-85d8-4a8a-bf9a-b538e9878866', '4eb09a6f-84b2-4708-8821-70862212cd0c', 'ed18a547-2567-4ad5-abbe-097a2816095d', 'e37bc737-ced6-4edf-88ef-4252c9b6c604'] {{(pid=88899) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 08:53:44 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-97dec1dc-a29d-43c5-99ea-ed52763ae019 tempest-CreateVolumesFromSnapshotTest-2011744404 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:53:44 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-97dec1dc-a29d-43c5-99ea-ed52763ae019 tempest-CreateVolumesFromSnapshotTest-2011744404 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:53:44 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-97dec1dc-a29d-43c5-99ea-ed52763ae019 tempest-CreateVolumesFromSnapshotTest-2011744404 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:53:44 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-97dec1dc-a29d-43c5-99ea-ed52763ae019 tempest-CreateVolumesFromSnapshotTest-2011744404 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:53:44 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-97dec1dc-a29d-43c5-99ea-ed52763ae019 tempest-CreateVolumesFromSnapshotTest-2011744404 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:53:44 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-97dec1dc-a29d-43c5-99ea-ed52763ae019 tempest-CreateVolumesFromSnapshotTest-2011744404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:53:44 devstack sudo[112438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a Aug 03 08:53:44 devstack sudo[112438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:53:44 devstack sudo[112434]: pam_unix(sudo:session): session closed for user root Aug 03 08:53:44 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-bdcd5a81-447a-412d-84a1-e860a9897b66 tempest-VolumeImageDependencyTests-942168115 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7ae30a3b-e3a4-40d9-8a51-9efe26db7ca8_qyi0gynqdevstack@QuobyteHD" returned: 0 in 0.356s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:53:44 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-bdcd5a81-447a-412d-84a1-e860a9897b66 tempest-VolumeImageDependencyTests-942168115 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7ae30a3b-e3a4-40d9-8a51-9efe26db7ca8_qyi0gynqdevstack@QuobyteHD {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:53:44 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-b1ec18db-c89e-4c2e-9cc9-cfc9eb4da1cf tempest-CreateVolumesFromSnapshotTest-2011744404 None] Acquiring lock "cinder-091ab459-ad7c-4a1e-9033-d1d690cf93cf-delete_volume" by "delete_volume" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:53:44 devstack sudo[112435]: pam_unix(sudo:session): session closed for user root Aug 03 08:53:44 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-c59605df-5b05-4f62-a436-7f0cb63b056f tempest-VolumeDependencyTests-1512358985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-4b24bb72-96b2-432f-aa36-80783dfd40ca.0cb595ce-53b6-45b6-82f3-e5a412b65b11" returned: 0 in 0.424s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:53:44 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-c59605df-5b05-4f62-a436-7f0cb63b056f tempest-VolumeDependencyTests-1512358985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-4b24bb72-96b2-432f-aa36-80783dfd40ca.0cb595ce-53b6-45b6-82f3-e5a412b65b11 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:53:44 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-b1ec18db-c89e-4c2e-9cc9-cfc9eb4da1cf tempest-CreateVolumesFromSnapshotTest-2011744404 None] Lock "cinder-091ab459-ad7c-4a1e-9033-d1d690cf93cf-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:53:44 devstack sudo[112447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-4b24bb72-96b2-432f-aa36-80783dfd40ca.0cb595ce-53b6-45b6-82f3-e5a412b65b11 Aug 03 08:53:44 devstack sudo[112447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:53:44 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-b1ec18db-c89e-4c2e-9cc9-cfc9eb4da1cf tempest-CreateVolumesFromSnapshotTest-2011744404 None] Acquiring lock "cinder-quobyte-091ab459-ad7c-4a1e-9033-d1d690cf93cf" by "delete_volume" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:53:44 devstack sudo[112438]: pam_unix(sudo:session): session closed for user root Aug 03 08:53:44 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-97dec1dc-a29d-43c5-99ea-ed52763ae019 tempest-CreateVolumesFromSnapshotTest-2011744404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a" returned: 0 in 0.340s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:53:44 devstack cinder-volume[88899]: DEBUG cinder.manager [None req-97dec1dc-a29d-43c5-99ea-ed52763ae019 tempest-CreateVolumesFromSnapshotTest-2011744404 None] Notifying Schedulers of capabilities ... {{(pid=88899) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 08:53:44 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-b1ec18db-c89e-4c2e-9cc9-cfc9eb4da1cf tempest-CreateVolumesFromSnapshotTest-2011744404 None] Lock "cinder-quobyte-091ab459-ad7c-4a1e-9033-d1d690cf93cf" acquired by "delete_volume" :: waited 0.020s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:53:44 devstack sudo[112445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7ae30a3b-e3a4-40d9-8a51-9efe26db7ca8_qyi0gynqdevstack@QuobyteHD Aug 03 08:53:44 devstack sudo[112445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:53:44 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-97dec1dc-a29d-43c5-99ea-ed52763ae019 tempest-CreateVolumesFromSnapshotTest-2011744404 None] Deleted volume successfully. Aug 03 08:53:44 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[38d208dc-afb9-4b50-a503-25dd324b0a5a]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:53:44 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-b1ec18db-c89e-4c2e-9cc9-cfc9eb4da1cf tempest-CreateVolumesFromSnapshotTest-2011744404 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-091ab459-ad7c-4a1e-9033-d1d690cf93cf {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:53:44 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-97dec1dc-a29d-43c5-99ea-ed52763ae019 tempest-CreateVolumesFromSnapshotTest-2011744404 None] Lock "cinder-8212e20b-b962-484c-87c9-a005a5381f5e-delete_volume" released by "delete_volume" :: held 1.346s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:53:44 devstack sudo[112450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-091ab459-ad7c-4a1e-9033-d1d690cf93cf Aug 03 08:53:44 devstack sudo[112450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:53:44 devstack sudo[112447]: pam_unix(sudo:session): session closed for user root Aug 03 08:53:44 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-c59605df-5b05-4f62-a436-7f0cb63b056f tempest-VolumeDependencyTests-1512358985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-4b24bb72-96b2-432f-aa36-80783dfd40ca.0cb595ce-53b6-45b6-82f3-e5a412b65b11" returned: 0 in 0.281s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:53:44 devstack sudo[112445]: pam_unix(sudo:session): session closed for user root Aug 03 08:53:44 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-c59605df-5b05-4f62-a436-7f0cb63b056f tempest-VolumeDependencyTests-1512358985 None] Lock "cinder-quobyte-0cb595ce-53b6-45b6-82f3-e5a412b65b11" released by "_delete_snapshot" :: held 1.624s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:53:44 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-bdcd5a81-447a-412d-84a1-e860a9897b66 tempest-VolumeImageDependencyTests-942168115 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7ae30a3b-e3a4-40d9-8a51-9efe26db7ca8_qyi0gynqdevstack@QuobyteHD" returned: 1 in 0.414s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:53:44 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-bdcd5a81-447a-412d-84a1-e860a9897b66 tempest-VolumeImageDependencyTests-942168115 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7ae30a3b-e3a4-40d9-8a51-9efe26db7ca8_qyi0gynqdevstack@QuobyteHD' failed. Not Retrying. {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 03 08:53:44 devstack cinder-volume[88899]: DEBUG cinder.image.image_utils [None req-bdcd5a81-447a-412d-84a1-e860a9897b66 tempest-VolumeImageDependencyTests-942168115 None] Temporary image 7ae30a3b-e3a4-40d9-8a51-9efe26db7ca8 is fetched for user ec19afbca65f4a8185b3231a39404ec7. {{(pid=88899) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Aug 03 08:53:44 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-c59605df-5b05-4f62-a436-7f0cb63b056f tempest-VolumeDependencyTests-1512358985 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 6.205s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:53:44 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-69450607-f4e5-4223-8e57-603fd0164e82 tempest-ProjectMemberTests-1353074417 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.736s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:53:44 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-69450607-f4e5-4223-8e57-603fd0164e82 tempest-ProjectMemberTests-1353074417 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:53:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1370525162',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9143315a-67be-4bc8-b7b6-bb15371535ce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b723e915839a4036ad739740ec4db0cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:53:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:53:43Z,use_quota=True,user_id='d9152484679b4fb79b0d8896a2a67eb9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8bde7129-1dc4-42ab-b852-ab32c61b4921),volume_type_id=8bde7129-1dc4-42ab-b852-ab32c61b4921)}" {{(pid=88899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 08:53:44 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-69450607-f4e5-4223-8e57-603fd0164e82 tempest-ProjectMemberTests-1353074417 None] Creating volume 9143315a-67be-4bc8-b7b6-bb15371535ce {{(pid=88899) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 08:53:44 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-69450607-f4e5-4223-8e57-603fd0164e82 tempest-ProjectMemberTests-1353074417 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:53:44 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-69450607-f4e5-4223-8e57-603fd0164e82 tempest-ProjectMemberTests-1353074417 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:53:44 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-69450607-f4e5-4223-8e57-603fd0164e82 tempest-ProjectMemberTests-1353074417 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:53:44 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-69450607-f4e5-4223-8e57-603fd0164e82 tempest-ProjectMemberTests-1353074417 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:53:44 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-69450607-f4e5-4223-8e57-603fd0164e82 tempest-ProjectMemberTests-1353074417 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:53:44 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-69450607-f4e5-4223-8e57-603fd0164e82 tempest-ProjectMemberTests-1353074417 None] Selected osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385 as target Quobyte volume. {{(pid=88899) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 08:53:44 devstack cinder-volume[88899]: INFO cinder.volume.drivers.remotefs [None req-69450607-f4e5-4223-8e57-603fd0164e82 tempest-ProjectMemberTests-1353074417 None] casted to osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385 Aug 03 08:53:44 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-69450607-f4e5-4223-8e57-603fd0164e82 tempest-ProjectMemberTests-1353074417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-9143315a-67be-4bc8-b7b6-bb15371535ce 1073741824 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:53:44 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-c59605df-5b05-4f62-a436-7f0cb63b056f tempest-VolumeDependencyTests-1512358985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f929be47-059b-4696-b8bb-a12647bebd2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ec448af7-0d13-45ba-9422-d77537c4249c', 'volume_size': 1, 'source_volid': '4b24bb72-96b2-432f-aa36-80783dfd40ca', 'source_volstatus': 'available'}' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:53:44 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-c59605df-5b05-4f62-a436-7f0cb63b056f tempest-VolumeDependencyTests-1512358985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2939880d-31a4-4f62-90e8-9e0f0f835337) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:53:44 devstack sudo[112456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-9143315a-67be-4bc8-b7b6-bb15371535ce 1073741824 Aug 03 08:53:44 devstack sudo[112456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:53:45 devstack cinder-volume[88899]: INFO cinder.volume.flows.manager.create_volume [None req-c59605df-5b05-4f62-a436-7f0cb63b056f tempest-VolumeDependencyTests-1512358985 None] Volume volume-ec448af7-0d13-45ba-9422-d77537c4249c (ec448af7-0d13-45ba-9422-d77537c4249c): created successfully Aug 03 08:53:45 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-c59605df-5b05-4f62-a436-7f0cb63b056f tempest-VolumeDependencyTests-1512358985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2939880d-31a4-4f62-90e8-9e0f0f835337) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:53:45 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-c59605df-5b05-4f62-a436-7f0cb63b056f tempest-VolumeDependencyTests-1512358985 None] Flow 'volume_create_manager' (eb19340a-001f-49f0-8d41-730ec382cf71) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:53:45 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[efc44fa6-96bc-4dde-87b7-bbe959150517]: (4, 'raw') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:53:45 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-bdcd5a81-447a-412d-84a1-e860a9897b66 tempest-VolumeImageDependencyTests-942168115 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7ae30a3b-e3a4-40d9-8a51-9efe26db7ca8_qyi0gynqdevstack@QuobyteHD {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:53:45 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-c59605df-5b05-4f62-a436-7f0cb63b056f tempest-VolumeDependencyTests-1512358985 None] Created volume successfully. Aug 03 08:53:45 devstack sudo[112450]: pam_unix(sudo:session): session closed for user root Aug 03 08:53:45 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-b1ec18db-c89e-4c2e-9cc9-cfc9eb4da1cf tempest-CreateVolumesFromSnapshotTest-2011744404 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-091ab459-ad7c-4a1e-9033-d1d690cf93cf" returned: 0 in 0.400s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:53:45 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-b1ec18db-c89e-4c2e-9cc9-cfc9eb4da1cf tempest-CreateVolumesFromSnapshotTest-2011744404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-091ab459-ad7c-4a1e-9033-d1d690cf93cf {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:53:45 devstack sudo[112462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-091ab459-ad7c-4a1e-9033-d1d690cf93cf Aug 03 08:53:45 devstack sudo[112462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:53:45 devstack sudo[112461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7ae30a3b-e3a4-40d9-8a51-9efe26db7ca8_qyi0gynqdevstack@QuobyteHD Aug 03 08:53:45 devstack sudo[112461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:53:45 devstack sudo[112462]: pam_unix(sudo:session): session closed for user root Aug 03 08:53:45 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-b1ec18db-c89e-4c2e-9cc9-cfc9eb4da1cf tempest-CreateVolumesFromSnapshotTest-2011744404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-091ab459-ad7c-4a1e-9033-d1d690cf93cf" returned: 0 in 0.293s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:53:45 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-b1ec18db-c89e-4c2e-9cc9-cfc9eb4da1cf tempest-CreateVolumesFromSnapshotTest-2011744404 None] Lock "cinder-quobyte-091ab459-ad7c-4a1e-9033-d1d690cf93cf" released by "delete_volume" :: held 0.752s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:53:45 devstack sudo[112461]: pam_unix(sudo:session): session closed for user root Aug 03 08:53:45 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-bdcd5a81-447a-412d-84a1-e860a9897b66 tempest-VolumeImageDependencyTests-942168115 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7ae30a3b-e3a4-40d9-8a51-9efe26db7ca8_qyi0gynqdevstack@QuobyteHD" returned: 0 in 0.383s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:53:45 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-bdcd5a81-447a-412d-84a1-e860a9897b66 tempest-VolumeImageDependencyTests-942168115 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7ae30a3b-e3a4-40d9-8a51-9efe26db7ca8_qyi0gynqdevstack@QuobyteHD {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:53:45 devstack sudo[112456]: pam_unix(sudo:session): session closed for user root Aug 03 08:53:45 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-69450607-f4e5-4223-8e57-603fd0164e82 tempest-ProjectMemberTests-1353074417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-9143315a-67be-4bc8-b7b6-bb15371535ce 1073741824" returned: 0 in 0.512s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:53:45 devstack cinder-volume[88899]: DEBUG cinder.quota [None req-b1ec18db-c89e-4c2e-9cc9-cfc9eb4da1cf tempest-CreateVolumesFromSnapshotTest-2011744404 None] Created reservations ['622bd7c0-bb66-45e1-9942-86ac038dabc6', '90c5e9c8-55ca-4021-bfc3-9684cb1f9aa2', '2038d8fc-bb52-4233-8ac5-ca0c2fd259ad', '49e2d77c-878c-41c7-aa67-861a3cfc8ef9'] {{(pid=88899) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 08:53:45 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-69450607-f4e5-4223-8e57-603fd0164e82 tempest-ProjectMemberTests-1353074417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-9143315a-67be-4bc8-b7b6-bb15371535ce {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:53:45 devstack sudo[112472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7ae30a3b-e3a4-40d9-8a51-9efe26db7ca8_qyi0gynqdevstack@QuobyteHD Aug 03 08:53:45 devstack sudo[112472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:53:45 devstack sudo[112473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-9143315a-67be-4bc8-b7b6-bb15371535ce Aug 03 08:53:45 devstack sudo[112473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:53:45 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-b1ec18db-c89e-4c2e-9cc9-cfc9eb4da1cf tempest-CreateVolumesFromSnapshotTest-2011744404 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:53:45 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-b1ec18db-c89e-4c2e-9cc9-cfc9eb4da1cf tempest-CreateVolumesFromSnapshotTest-2011744404 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:53:45 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-b1ec18db-c89e-4c2e-9cc9-cfc9eb4da1cf tempest-CreateVolumesFromSnapshotTest-2011744404 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:53:45 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-b1ec18db-c89e-4c2e-9cc9-cfc9eb4da1cf tempest-CreateVolumesFromSnapshotTest-2011744404 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:53:45 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-b1ec18db-c89e-4c2e-9cc9-cfc9eb4da1cf tempest-CreateVolumesFromSnapshotTest-2011744404 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:53:45 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-b1ec18db-c89e-4c2e-9cc9-cfc9eb4da1cf tempest-CreateVolumesFromSnapshotTest-2011744404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:53:45 devstack sudo[112476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a Aug 03 08:53:45 devstack sudo[112476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:53:45 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-c33c6507-b6e6-4f21-b858-55903646d916 tempest-VolumeDependencyTests-1512358985 None] Acquiring lock "cinder-7a40132f-52ed-4711-ba9b-088821b45487-delete_snapshot" by "delete_snapshot" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:53:45 devstack sudo[112472]: pam_unix(sudo:session): session closed for user root Aug 03 08:53:45 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-bdcd5a81-447a-412d-84a1-e860a9897b66 tempest-VolumeImageDependencyTests-942168115 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7ae30a3b-e3a4-40d9-8a51-9efe26db7ca8_qyi0gynqdevstack@QuobyteHD" returned: 1 in 0.364s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:53:45 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-bdcd5a81-447a-412d-84a1-e860a9897b66 tempest-VolumeImageDependencyTests-942168115 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7ae30a3b-e3a4-40d9-8a51-9efe26db7ca8_qyi0gynqdevstack@QuobyteHD' failed. Not Retrying. {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 03 08:53:45 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-bdcd5a81-447a-412d-84a1-e860a9897b66 tempest-VolumeImageDependencyTests-942168115 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:53:45 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-c33c6507-b6e6-4f21-b858-55903646d916 tempest-VolumeDependencyTests-1512358985 None] Lock "cinder-7a40132f-52ed-4711-ba9b-088821b45487-delete_snapshot" acquired by "delete_snapshot" :: waited 0.037s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:53:45 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-c33c6507-b6e6-4f21-b858-55903646d916 tempest-VolumeDependencyTests-1512358985 None] Acquiring lock "cinder-quobyte-7a8ead30-8de5-46a9-a84e-9425b673c7c3" by "delete_snapshot" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:53:45 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-dcc90c22-1650-464b-a46d-3dda5e2bf7ae tempest-CreateVolumesFromSnapshotTest-2011744404 None] Acquiring lock "cinder-37e9d66f-44cb-4ac6-a724-cc67c84b0a21-delete_snapshot" by "delete_snapshot" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:53:45 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-c33c6507-b6e6-4f21-b858-55903646d916 tempest-VolumeDependencyTests-1512358985 None] Lock "cinder-quobyte-7a8ead30-8de5-46a9-a84e-9425b673c7c3" acquired by "delete_snapshot" :: waited 0.022s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:53:45 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-c33c6507-b6e6-4f21-b858-55903646d916 tempest-VolumeDependencyTests-1512358985 None] Acquiring lock "cinder-quobyte-7a40132f-52ed-4711-ba9b-088821b45487" by "_delete_snapshot" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:53:45 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-c33c6507-b6e6-4f21-b858-55903646d916 tempest-VolumeDependencyTests-1512358985 None] Lock "cinder-quobyte-7a40132f-52ed-4711-ba9b-088821b45487" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:53:45 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-c33c6507-b6e6-4f21-b858-55903646d916 tempest-VolumeDependencyTests-1512358985 None] Deleting offline snapshot 7a40132f-52ed-4711-ba9b-088821b45487 of volume 7a8ead30-8de5-46a9-a84e-9425b673c7c3 {{(pid=88899) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 03 08:53:45 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-c33c6507-b6e6-4f21-b858-55903646d916 tempest-VolumeDependencyTests-1512358985 None] snapshot_file for this snap is: volume-7a8ead30-8de5-46a9-a84e-9425b673c7c3.7a40132f-52ed-4711-ba9b-088821b45487 {{(pid=88899) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 03 08:53:45 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-dcc90c22-1650-464b-a46d-3dda5e2bf7ae tempest-CreateVolumesFromSnapshotTest-2011744404 None] Lock "cinder-37e9d66f-44cb-4ac6-a724-cc67c84b0a21-delete_snapshot" acquired by "delete_snapshot" :: waited 0.059s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:53:45 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-dcc90c22-1650-464b-a46d-3dda5e2bf7ae tempest-CreateVolumesFromSnapshotTest-2011744404 None] Acquiring lock "cinder-quobyte-12cb2f26-c24e-4b7c-b6ac-768e61e7676e" by "delete_snapshot" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:53:45 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[242aace4-cc0e-4a98-9c29-7301eeeae784]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:53:45 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-c33c6507-b6e6-4f21-b858-55903646d916 tempest-VolumeDependencyTests-1512358985 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-7a8ead30-8de5-46a9-a84e-9425b673c7c3.7a40132f-52ed-4711-ba9b-088821b45487 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:53:45 devstack sudo[112473]: pam_unix(sudo:session): session closed for user root Aug 03 08:53:45 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-dcc90c22-1650-464b-a46d-3dda5e2bf7ae tempest-CreateVolumesFromSnapshotTest-2011744404 None] Lock "cinder-quobyte-12cb2f26-c24e-4b7c-b6ac-768e61e7676e" acquired by "delete_snapshot" :: waited 0.025s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:53:45 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-dcc90c22-1650-464b-a46d-3dda5e2bf7ae tempest-CreateVolumesFromSnapshotTest-2011744404 None] Acquiring lock "cinder-quobyte-37e9d66f-44cb-4ac6-a724-cc67c84b0a21" by "_delete_snapshot" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:53:45 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-69450607-f4e5-4223-8e57-603fd0164e82 tempest-ProjectMemberTests-1353074417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-9143315a-67be-4bc8-b7b6-bb15371535ce" returned: 0 in 0.375s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:53:45 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-69450607-f4e5-4223-8e57-603fd0164e82 tempest-ProjectMemberTests-1353074417 None] <== create_volume: return (944ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'} {{(pid=88899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 08:53:45 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-69450607-f4e5-4223-8e57-603fd0164e82 tempest-ProjectMemberTests-1353074417 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.947s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:53:45 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-bdcd5a81-447a-412d-84a1-e860a9897b66 tempest-VolumeImageDependencyTests-942168115 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.127s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:53:45 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-bdcd5a81-447a-412d-84a1-e860a9897b66 tempest-VolumeImageDependencyTests-942168115 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:53:43Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test0e20bd6e-440f-41d8-9b5d-fc047ac00423',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a83eaa93-b6be-408e-9aaa-3d7c742db983,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fb20ce3648d1497fb23ac775415e7a44',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:53:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:53:44Z,use_quota=True,user_id='ec19afbca65f4a8185b3231a39404ec7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8bde7129-1dc4-42ab-b852-ab32c61b4921),volume_type_id=8bde7129-1dc4-42ab-b852-ab32c61b4921)}" {{(pid=88899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 08:53:45 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-bdcd5a81-447a-412d-84a1-e860a9897b66 tempest-VolumeImageDependencyTests-942168115 None] Creating volume a83eaa93-b6be-408e-9aaa-3d7c742db983 {{(pid=88899) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 08:53:45 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-bdcd5a81-447a-412d-84a1-e860a9897b66 tempest-VolumeImageDependencyTests-942168115 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:53:45 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-bdcd5a81-447a-412d-84a1-e860a9897b66 tempest-VolumeImageDependencyTests-942168115 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:53:45 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-bdcd5a81-447a-412d-84a1-e860a9897b66 tempest-VolumeImageDependencyTests-942168115 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:53:45 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-bdcd5a81-447a-412d-84a1-e860a9897b66 tempest-VolumeImageDependencyTests-942168115 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:53:45 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-bdcd5a81-447a-412d-84a1-e860a9897b66 tempest-VolumeImageDependencyTests-942168115 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:53:45 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-bdcd5a81-447a-412d-84a1-e860a9897b66 tempest-VolumeImageDependencyTests-942168115 None] Selected osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385 as target Quobyte volume. {{(pid=88899) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 08:53:45 devstack cinder-volume[88899]: INFO cinder.volume.drivers.remotefs [None req-bdcd5a81-447a-412d-84a1-e860a9897b66 tempest-VolumeImageDependencyTests-942168115 None] casted to osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385 Aug 03 08:53:45 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-bdcd5a81-447a-412d-84a1-e860a9897b66 tempest-VolumeImageDependencyTests-942168115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-a83eaa93-b6be-408e-9aaa-3d7c742db983 1073741824 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:53:45 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-69450607-f4e5-4223-8e57-603fd0164e82 tempest-ProjectMemberTests-1353074417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df395fe5-cd2a-48ff-a7f1-43b16100c28b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9143315a-67be-4bc8-b7b6-bb15371535ce', 'volume_size': 1}' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:53:45 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-69450607-f4e5-4223-8e57-603fd0164e82 tempest-ProjectMemberTests-1353074417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b111ebd-be0b-4376-b012-ff3c2d43a603) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:53:45 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-dcc90c22-1650-464b-a46d-3dda5e2bf7ae tempest-CreateVolumesFromSnapshotTest-2011744404 None] Lock "cinder-quobyte-37e9d66f-44cb-4ac6-a724-cc67c84b0a21" acquired by "_delete_snapshot" :: waited 0.064s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:53:45 devstack sudo[112483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-a83eaa93-b6be-408e-9aaa-3d7c742db983 1073741824 Aug 03 08:53:45 devstack sudo[112483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:53:45 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-dcc90c22-1650-464b-a46d-3dda5e2bf7ae tempest-CreateVolumesFromSnapshotTest-2011744404 None] Deleting offline snapshot 37e9d66f-44cb-4ac6-a724-cc67c84b0a21 of volume 12cb2f26-c24e-4b7c-b6ac-768e61e7676e {{(pid=88899) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 03 08:53:45 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-dcc90c22-1650-464b-a46d-3dda5e2bf7ae tempest-CreateVolumesFromSnapshotTest-2011744404 None] snapshot_file for this snap is: volume-12cb2f26-c24e-4b7c-b6ac-768e61e7676e.37e9d66f-44cb-4ac6-a724-cc67c84b0a21 {{(pid=88899) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 03 08:53:45 devstack sudo[112476]: pam_unix(sudo:session): session closed for user root Aug 03 08:53:45 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-b1ec18db-c89e-4c2e-9cc9-cfc9eb4da1cf tempest-CreateVolumesFromSnapshotTest-2011744404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a" returned: 0 in 0.389s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:53:45 devstack cinder-volume[88899]: DEBUG cinder.manager [None req-b1ec18db-c89e-4c2e-9cc9-cfc9eb4da1cf tempest-CreateVolumesFromSnapshotTest-2011744404 None] Notifying Schedulers of capabilities ... {{(pid=88899) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 08:53:45 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-b1ec18db-c89e-4c2e-9cc9-cfc9eb4da1cf tempest-CreateVolumesFromSnapshotTest-2011744404 None] Deleted volume successfully. Aug 03 08:53:45 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[efdd32e9-83bb-4279-b847-b840f8a2a6dd]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:53:45 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-dcc90c22-1650-464b-a46d-3dda5e2bf7ae tempest-CreateVolumesFromSnapshotTest-2011744404 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-12cb2f26-c24e-4b7c-b6ac-768e61e7676e.37e9d66f-44cb-4ac6-a724-cc67c84b0a21 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:53:46 devstack sudo[112482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-7a8ead30-8de5-46a9-a84e-9425b673c7c3.7a40132f-52ed-4711-ba9b-088821b45487 Aug 03 08:53:46 devstack sudo[112482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:53:46 devstack cinder-volume[88899]: INFO cinder.volume.flows.manager.create_volume [None req-69450607-f4e5-4223-8e57-603fd0164e82 tempest-ProjectMemberTests-1353074417 None] Volume volume-9143315a-67be-4bc8-b7b6-bb15371535ce (9143315a-67be-4bc8-b7b6-bb15371535ce): created successfully Aug 03 08:53:46 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-69450607-f4e5-4223-8e57-603fd0164e82 tempest-ProjectMemberTests-1353074417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b111ebd-be0b-4376-b012-ff3c2d43a603) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:53:46 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-69450607-f4e5-4223-8e57-603fd0164e82 tempest-ProjectMemberTests-1353074417 None] Flow 'volume_create_manager' (7a1990d8-cfd8-4787-b854-5e43cee16b87) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:53:46 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-69450607-f4e5-4223-8e57-603fd0164e82 tempest-ProjectMemberTests-1353074417 None] Created volume successfully. Aug 03 08:53:46 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-b1ec18db-c89e-4c2e-9cc9-cfc9eb4da1cf tempest-CreateVolumesFromSnapshotTest-2011744404 None] Lock "cinder-091ab459-ad7c-4a1e-9033-d1d690cf93cf-delete_volume" released by "delete_volume" :: held 1.477s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:53:46 devstack sudo[112486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-12cb2f26-c24e-4b7c-b6ac-768e61e7676e.37e9d66f-44cb-4ac6-a724-cc67c84b0a21 Aug 03 08:53:46 devstack sudo[112486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:53:46 devstack sudo[112482]: pam_unix(sudo:session): session closed for user root Aug 03 08:53:46 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-c33c6507-b6e6-4f21-b858-55903646d916 tempest-VolumeDependencyTests-1512358985 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-7a8ead30-8de5-46a9-a84e-9425b673c7c3.7a40132f-52ed-4711-ba9b-088821b45487" returned: 0 in 0.447s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:53:46 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-c33c6507-b6e6-4f21-b858-55903646d916 tempest-VolumeDependencyTests-1512358985 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7a8ead30-8de5-46a9-a84e-9425b673c7c3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88899) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 03 08:53:46 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4d69ff7-bf1f-4357-9f57-918795ecc1fe]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:53:46 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-c33c6507-b6e6-4f21-b858-55903646d916 tempest-VolumeDependencyTests-1512358985 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-7a8ead30-8de5-46a9-a84e-9425b673c7c3 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:53:46 devstack sudo[112483]: pam_unix(sudo:session): session closed for user root Aug 03 08:53:46 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-bdcd5a81-447a-412d-84a1-e860a9897b66 tempest-VolumeImageDependencyTests-942168115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-a83eaa93-b6be-408e-9aaa-3d7c742db983 1073741824" returned: 0 in 0.532s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:53:46 devstack sudo[112486]: pam_unix(sudo:session): session closed for user root Aug 03 08:53:46 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-dcc90c22-1650-464b-a46d-3dda5e2bf7ae tempest-CreateVolumesFromSnapshotTest-2011744404 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-12cb2f26-c24e-4b7c-b6ac-768e61e7676e.37e9d66f-44cb-4ac6-a724-cc67c84b0a21" returned: 0 in 0.460s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:53:46 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-dcc90c22-1650-464b-a46d-3dda5e2bf7ae tempest-CreateVolumesFromSnapshotTest-2011744404 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-12cb2f26-c24e-4b7c-b6ac-768e61e7676e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88899) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 03 08:53:46 devstack sudo[112497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-7a8ead30-8de5-46a9-a84e-9425b673c7c3 Aug 03 08:53:46 devstack sudo[112497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:53:46 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[379c6ff5-383b-4c6e-af87-f6d8ecea1716]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:53:46 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-dcc90c22-1650-464b-a46d-3dda5e2bf7ae tempest-CreateVolumesFromSnapshotTest-2011744404 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-12cb2f26-c24e-4b7c-b6ac-768e61e7676e {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:53:46 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-f0b148ac-10ed-4b60-978a-09968f496ca5 tempest-ProjectMemberTests-1353074417 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:53:46 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-bdcd5a81-447a-412d-84a1-e860a9897b66 tempest-VolumeImageDependencyTests-942168115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-a83eaa93-b6be-408e-9aaa-3d7c742db983 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:53:46 devstack sudo[112503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-a83eaa93-b6be-408e-9aaa-3d7c742db983 Aug 03 08:53:46 devstack sudo[112503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:53:46 devstack sudo[112502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-12cb2f26-c24e-4b7c-b6ac-768e61e7676e Aug 03 08:53:46 devstack sudo[112502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:53:46 devstack sudo[112503]: pam_unix(sudo:session): session closed for user root Aug 03 08:53:46 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-bdcd5a81-447a-412d-84a1-e860a9897b66 tempest-VolumeImageDependencyTests-942168115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-a83eaa93-b6be-408e-9aaa-3d7c742db983" returned: 0 in 0.265s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:53:46 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-bdcd5a81-447a-412d-84a1-e860a9897b66 tempest-VolumeImageDependencyTests-942168115 None] <== create_volume: return (900ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'} {{(pid=88899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 08:53:46 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-bdcd5a81-447a-412d-84a1-e860a9897b66 tempest-VolumeImageDependencyTests-942168115 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.904s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:53:46 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-f0b148ac-10ed-4b60-978a-09968f496ca5 tempest-ProjectMemberTests-1353074417 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.280s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:53:46 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-f0b148ac-10ed-4b60-978a-09968f496ca5 tempest-ProjectMemberTests-1353074417 None] Creating offline snapshot 726a4226-b77e-461d-97b0-40173270cce1 of volume 9143315a-67be-4bc8-b7b6-bb15371535ce {{(pid=88899) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 03 08:53:46 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8f3b43f-3a7d-4414-a9fb-80842f4fea65]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:53:46 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-f0b148ac-10ed-4b60-978a-09968f496ca5 tempest-ProjectMemberTests-1353074417 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-9143315a-67be-4bc8-b7b6-bb15371535ce {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:53:46 devstack cinder-volume[88899]: DEBUG cinder.volume.volume_utils [None req-bdcd5a81-447a-412d-84a1-e860a9897b66 tempest-VolumeImageDependencyTests-942168115 None] Attempting download of 7ae30a3b-e3a4-40d9-8a51-9efe26db7ca8 ((None, [{'url': 'file:///opt/stack/data/glance/images/7ae30a3b-e3a4-40d9-8a51-9efe26db7ca8', 'metadata': {}}])) to volume a83eaa93-b6be-408e-9aaa-3d7c742db983. {{(pid=88899) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Aug 03 08:53:46 devstack sudo[112502]: pam_unix(sudo:session): session closed for user root Aug 03 08:53:46 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-dcc90c22-1650-464b-a46d-3dda5e2bf7ae tempest-CreateVolumesFromSnapshotTest-2011744404 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-12cb2f26-c24e-4b7c-b6ac-768e61e7676e" returned: 0 in 0.400s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:53:46 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-dcc90c22-1650-464b-a46d-3dda5e2bf7ae tempest-CreateVolumesFromSnapshotTest-2011744404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-12cb2f26-c24e-4b7c-b6ac-768e61e7676e.37e9d66f-44cb-4ac6-a724-cc67c84b0a21 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:53:46 devstack sudo[112514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-12cb2f26-c24e-4b7c-b6ac-768e61e7676e.37e9d66f-44cb-4ac6-a724-cc67c84b0a21 Aug 03 08:53:46 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bb227a1-861d-4d05-8907-44a0194bf03b]: (4, 'raw') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:53:46 devstack sudo[112514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:53:46 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-bdcd5a81-447a-412d-84a1-e860a9897b66 tempest-VolumeImageDependencyTests-942168115 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7ae30a3b-e3a4-40d9-8a51-9efe26db7ca8_v4vb0yi6 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:53:46 devstack sudo[112497]: pam_unix(sudo:session): session closed for user root Aug 03 08:53:46 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-c33c6507-b6e6-4f21-b858-55903646d916 tempest-VolumeDependencyTests-1512358985 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-7a8ead30-8de5-46a9-a84e-9425b673c7c3" returned: 0 in 0.616s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:53:46 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-c33c6507-b6e6-4f21-b858-55903646d916 tempest-VolumeDependencyTests-1512358985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-7a8ead30-8de5-46a9-a84e-9425b673c7c3.7a40132f-52ed-4711-ba9b-088821b45487 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:53:46 devstack sudo[112513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-9143315a-67be-4bc8-b7b6-bb15371535ce Aug 03 08:53:46 devstack sudo[112513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:53:46 devstack sudo[112518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-7a8ead30-8de5-46a9-a84e-9425b673c7c3.7a40132f-52ed-4711-ba9b-088821b45487 Aug 03 08:53:47 devstack sudo[112518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:53:47 devstack sudo[112517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7ae30a3b-e3a4-40d9-8a51-9efe26db7ca8_v4vb0yi6 Aug 03 08:53:47 devstack sudo[112517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:53:47 devstack sudo[112513]: pam_unix(sudo:session): session closed for user root Aug 03 08:53:47 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-f0b148ac-10ed-4b60-978a-09968f496ca5 tempest-ProjectMemberTests-1353074417 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-9143315a-67be-4bc8-b7b6-bb15371535ce" returned: 0 in 0.409s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:53:47 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-f0b148ac-10ed-4b60-978a-09968f496ca5 tempest-ProjectMemberTests-1353074417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-9143315a-67be-4bc8-b7b6-bb15371535ce,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-9143315a-67be-4bc8-b7b6-bb15371535ce.726a4226-b77e-461d-97b0-40173270cce1 1G {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:53:47 devstack sudo[112514]: pam_unix(sudo:session): session closed for user root Aug 03 08:53:47 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-dcc90c22-1650-464b-a46d-3dda5e2bf7ae tempest-CreateVolumesFromSnapshotTest-2011744404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-12cb2f26-c24e-4b7c-b6ac-768e61e7676e.37e9d66f-44cb-4ac6-a724-cc67c84b0a21" returned: 0 in 0.373s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:53:47 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-dcc90c22-1650-464b-a46d-3dda5e2bf7ae tempest-CreateVolumesFromSnapshotTest-2011744404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-12cb2f26-c24e-4b7c-b6ac-768e61e7676e.37e9d66f-44cb-4ac6-a724-cc67c84b0a21 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:53:47 devstack sudo[112532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-9143315a-67be-4bc8-b7b6-bb15371535ce,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-9143315a-67be-4bc8-b7b6-bb15371535ce.726a4226-b77e-461d-97b0-40173270cce1 1G Aug 03 08:53:47 devstack sudo[112532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:53:47 devstack sudo[112534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-12cb2f26-c24e-4b7c-b6ac-768e61e7676e.37e9d66f-44cb-4ac6-a724-cc67c84b0a21 Aug 03 08:53:47 devstack sudo[112534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:53:47 devstack sudo[112517]: pam_unix(sudo:session): session closed for user root Aug 03 08:53:47 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-bdcd5a81-447a-412d-84a1-e860a9897b66 tempest-VolumeImageDependencyTests-942168115 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7ae30a3b-e3a4-40d9-8a51-9efe26db7ca8_v4vb0yi6" returned: 0 in 0.386s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:53:47 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-bdcd5a81-447a-412d-84a1-e860a9897b66 tempest-VolumeImageDependencyTests-942168115 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7ae30a3b-e3a4-40d9-8a51-9efe26db7ca8_v4vb0yi6 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:53:47 devstack sudo[112518]: pam_unix(sudo:session): session closed for user root Aug 03 08:53:47 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-c33c6507-b6e6-4f21-b858-55903646d916 tempest-VolumeDependencyTests-1512358985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-7a8ead30-8de5-46a9-a84e-9425b673c7c3.7a40132f-52ed-4711-ba9b-088821b45487" returned: 0 in 0.393s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:53:47 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-c33c6507-b6e6-4f21-b858-55903646d916 tempest-VolumeDependencyTests-1512358985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-7a8ead30-8de5-46a9-a84e-9425b673c7c3.7a40132f-52ed-4711-ba9b-088821b45487 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:53:47 devstack sudo[112541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-7a8ead30-8de5-46a9-a84e-9425b673c7c3.7a40132f-52ed-4711-ba9b-088821b45487 Aug 03 08:53:47 devstack sudo[112541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:53:47 devstack sudo[112540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7ae30a3b-e3a4-40d9-8a51-9efe26db7ca8_v4vb0yi6 Aug 03 08:53:47 devstack sudo[112540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:53:47 devstack sudo[112534]: pam_unix(sudo:session): session closed for user root Aug 03 08:53:47 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-dcc90c22-1650-464b-a46d-3dda5e2bf7ae tempest-CreateVolumesFromSnapshotTest-2011744404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-12cb2f26-c24e-4b7c-b6ac-768e61e7676e.37e9d66f-44cb-4ac6-a724-cc67c84b0a21" returned: 0 in 0.282s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:53:47 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-dcc90c22-1650-464b-a46d-3dda5e2bf7ae tempest-CreateVolumesFromSnapshotTest-2011744404 None] Lock "cinder-quobyte-37e9d66f-44cb-4ac6-a724-cc67c84b0a21" released by "_delete_snapshot" :: held 1.645s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:53:47 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-dcc90c22-1650-464b-a46d-3dda5e2bf7ae tempest-CreateVolumesFromSnapshotTest-2011744404 None] Lock "cinder-quobyte-12cb2f26-c24e-4b7c-b6ac-768e61e7676e" released by "delete_snapshot" :: held 1.720s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:53:47 devstack sudo[112541]: pam_unix(sudo:session): session closed for user root Aug 03 08:53:47 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-c33c6507-b6e6-4f21-b858-55903646d916 tempest-VolumeDependencyTests-1512358985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-7a8ead30-8de5-46a9-a84e-9425b673c7c3.7a40132f-52ed-4711-ba9b-088821b45487" returned: 0 in 0.283s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:53:47 devstack sudo[112540]: pam_unix(sudo:session): session closed for user root Aug 03 08:53:47 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-bdcd5a81-447a-412d-84a1-e860a9897b66 tempest-VolumeImageDependencyTests-942168115 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7ae30a3b-e3a4-40d9-8a51-9efe26db7ca8_v4vb0yi6" returned: 1 in 0.371s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:53:47 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-bdcd5a81-447a-412d-84a1-e860a9897b66 tempest-VolumeImageDependencyTests-942168115 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7ae30a3b-e3a4-40d9-8a51-9efe26db7ca8_v4vb0yi6' failed. Not Retrying. {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 03 08:53:47 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-c33c6507-b6e6-4f21-b858-55903646d916 tempest-VolumeDependencyTests-1512358985 None] Lock "cinder-quobyte-7a40132f-52ed-4711-ba9b-088821b45487" released by "_delete_snapshot" :: held 1.865s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:53:47 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[303afa78-8221-4a13-b43c-4395cb6aeedd]: (4, 'raw') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:53:47 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-bdcd5a81-447a-412d-84a1-e860a9897b66 tempest-VolumeImageDependencyTests-942168115 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7ae30a3b-e3a4-40d9-8a51-9efe26db7ca8_qyi0gynqdevstack@QuobyteHD {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:53:47 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-c33c6507-b6e6-4f21-b858-55903646d916 tempest-VolumeDependencyTests-1512358985 None] Lock "cinder-quobyte-7a8ead30-8de5-46a9-a84e-9425b673c7c3" released by "delete_snapshot" :: held 1.907s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:53:47 devstack sudo[112532]: pam_unix(sudo:session): session closed for user root Aug 03 08:53:47 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-f0b148ac-10ed-4b60-978a-09968f496ca5 tempest-ProjectMemberTests-1353074417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-9143315a-67be-4bc8-b7b6-bb15371535ce,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-9143315a-67be-4bc8-b7b6-bb15371535ce.726a4226-b77e-461d-97b0-40173270cce1 1G" returned: 0 in 0.466s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:53:47 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-f0b148ac-10ed-4b60-978a-09968f496ca5 tempest-ProjectMemberTests-1353074417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9143315a-67be-4bc8-b7b6-bb15371535ce -F qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-9143315a-67be-4bc8-b7b6-bb15371535ce.726a4226-b77e-461d-97b0-40173270cce1 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:53:47 devstack cinder-volume[88899]: DEBUG cinder.quota [None req-dcc90c22-1650-464b-a46d-3dda5e2bf7ae tempest-CreateVolumesFromSnapshotTest-2011744404 None] Created reservations ['491562e3-e9a5-4cef-9285-fbd80c4255cc', 'd073949b-8a79-44e0-88db-b49bc25bf0e0', 'bb975f1a-5742-4954-8a92-74f777289c58', '3650e1e4-090a-4f99-b321-b1e15e52d682'] {{(pid=88899) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 08:53:47 devstack sudo[112553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9143315a-67be-4bc8-b7b6-bb15371535ce -F qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-9143315a-67be-4bc8-b7b6-bb15371535ce.726a4226-b77e-461d-97b0-40173270cce1 Aug 03 08:53:47 devstack sudo[112553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:53:47 devstack sudo[112552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7ae30a3b-e3a4-40d9-8a51-9efe26db7ca8_qyi0gynqdevstack@QuobyteHD Aug 03 08:53:47 devstack sudo[112552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:53:47 devstack cinder-volume[88899]: DEBUG cinder.quota [None req-c33c6507-b6e6-4f21-b858-55903646d916 tempest-VolumeDependencyTests-1512358985 None] Created reservations ['b5743578-ea4f-4b9a-97c2-8dffed48c696', 'c9348ceb-8d44-4165-be8b-0717b2420d24', '3b268cfc-41a5-41d2-94a4-5d6be3b91966', '7cbf473f-5367-4fc9-b92e-6f7d5fe2ee1b'] {{(pid=88899) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 08:53:47 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-dcc90c22-1650-464b-a46d-3dda5e2bf7ae tempest-CreateVolumesFromSnapshotTest-2011744404 None] Delete snapshot completed successfully. Aug 03 08:53:47 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-dcc90c22-1650-464b-a46d-3dda5e2bf7ae tempest-CreateVolumesFromSnapshotTest-2011744404 None] Lock "cinder-37e9d66f-44cb-4ac6-a724-cc67c84b0a21-delete_snapshot" released by "delete_snapshot" :: held 2.051s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:53:47 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-c33c6507-b6e6-4f21-b858-55903646d916 tempest-VolumeDependencyTests-1512358985 None] Delete snapshot completed successfully. Aug 03 08:53:47 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-c33c6507-b6e6-4f21-b858-55903646d916 tempest-VolumeDependencyTests-1512358985 None] Lock "cinder-7a40132f-52ed-4711-ba9b-088821b45487-delete_snapshot" released by "delete_snapshot" :: held 2.158s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:53:48 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-cb0a052c-0e10-4114-b4c8-2223ac58e7fc tempest-CreateVolumesFromSnapshotTest-2011744404 None] Acquiring lock "cinder-12cb2f26-c24e-4b7c-b6ac-768e61e7676e-delete_volume" by "delete_volume" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:53:48 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-cb0a052c-0e10-4114-b4c8-2223ac58e7fc tempest-CreateVolumesFromSnapshotTest-2011744404 None] Lock "cinder-12cb2f26-c24e-4b7c-b6ac-768e61e7676e-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:53:48 devstack sudo[112553]: pam_unix(sudo:session): session closed for user root Aug 03 08:53:48 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-f0b148ac-10ed-4b60-978a-09968f496ca5 tempest-ProjectMemberTests-1353074417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9143315a-67be-4bc8-b7b6-bb15371535ce -F qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-9143315a-67be-4bc8-b7b6-bb15371535ce.726a4226-b77e-461d-97b0-40173270cce1" returned: 0 in 0.344s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:53:48 devstack cinder-volume[88899]: WARNING cinder.volume.drivers.remotefs [None req-f0b148ac-10ed-4b60-978a-09968f496ca5 tempest-ProjectMemberTests-1353074417 None] /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-9143315a-67be-4bc8-b7b6-bb15371535ce.726a4226-b77e-461d-97b0-40173270cce1 is being set with open permissions: ugo+rw Aug 03 08:53:48 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-f0b148ac-10ed-4b60-978a-09968f496ca5 tempest-ProjectMemberTests-1353074417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-9143315a-67be-4bc8-b7b6-bb15371535ce.726a4226-b77e-461d-97b0-40173270cce1 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:53:48 devstack sudo[112552]: pam_unix(sudo:session): session closed for user root Aug 03 08:53:48 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-bdcd5a81-447a-412d-84a1-e860a9897b66 tempest-VolumeImageDependencyTests-942168115 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7ae30a3b-e3a4-40d9-8a51-9efe26db7ca8_qyi0gynqdevstack@QuobyteHD" returned: 0 in 0.386s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:53:48 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-bdcd5a81-447a-412d-84a1-e860a9897b66 tempest-VolumeImageDependencyTests-942168115 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7ae30a3b-e3a4-40d9-8a51-9efe26db7ca8_qyi0gynqdevstack@QuobyteHD {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:53:48 devstack sudo[112561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-9143315a-67be-4bc8-b7b6-bb15371535ce.726a4226-b77e-461d-97b0-40173270cce1 Aug 03 08:53:48 devstack sudo[112561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:53:48 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-cb0a052c-0e10-4114-b4c8-2223ac58e7fc tempest-CreateVolumesFromSnapshotTest-2011744404 None] Acquiring lock "cinder-quobyte-12cb2f26-c24e-4b7c-b6ac-768e61e7676e" by "delete_volume" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:53:48 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-cb0a052c-0e10-4114-b4c8-2223ac58e7fc tempest-CreateVolumesFromSnapshotTest-2011744404 None] Lock "cinder-quobyte-12cb2f26-c24e-4b7c-b6ac-768e61e7676e" acquired by "delete_volume" :: waited 0.020s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:53:48 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[db398a04-445e-43fa-8305-0345f6d2d779]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:53:48 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-cb0a052c-0e10-4114-b4c8-2223ac58e7fc tempest-CreateVolumesFromSnapshotTest-2011744404 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-12cb2f26-c24e-4b7c-b6ac-768e61e7676e {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:53:48 devstack sudo[112563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7ae30a3b-e3a4-40d9-8a51-9efe26db7ca8_qyi0gynqdevstack@QuobyteHD Aug 03 08:53:48 devstack sudo[112563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:53:48 devstack sudo[112564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-12cb2f26-c24e-4b7c-b6ac-768e61e7676e Aug 03 08:53:48 devstack sudo[112564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:53:48 devstack sudo[112561]: pam_unix(sudo:session): session closed for user root Aug 03 08:53:48 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-f0b148ac-10ed-4b60-978a-09968f496ca5 tempest-ProjectMemberTests-1353074417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-9143315a-67be-4bc8-b7b6-bb15371535ce.726a4226-b77e-461d-97b0-40173270cce1" returned: 0 in 0.249s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:53:48 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-f0b148ac-10ed-4b60-978a-09968f496ca5 tempest-ProjectMemberTests-1353074417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-9143315a-67be-4bc8-b7b6-bb15371535ce.info {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:53:48 devstack sudo[112568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-9143315a-67be-4bc8-b7b6-bb15371535ce.info Aug 03 08:53:48 devstack sudo[112568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:53:48 devstack sudo[112563]: pam_unix(sudo:session): session closed for user root Aug 03 08:53:48 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-bdcd5a81-447a-412d-84a1-e860a9897b66 tempest-VolumeImageDependencyTests-942168115 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7ae30a3b-e3a4-40d9-8a51-9efe26db7ca8_qyi0gynqdevstack@QuobyteHD" returned: 1 in 0.363s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:53:48 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-bdcd5a81-447a-412d-84a1-e860a9897b66 tempest-VolumeImageDependencyTests-942168115 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7ae30a3b-e3a4-40d9-8a51-9efe26db7ca8_qyi0gynqdevstack@QuobyteHD' failed. Not Retrying. {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 03 08:53:48 devstack cinder-volume[88899]: DEBUG cinder.image.image_utils [None req-bdcd5a81-447a-412d-84a1-e860a9897b66 tempest-VolumeImageDependencyTests-942168115 None] 7ae30a3b-e3a4-40d9-8a51-9efe26db7ca8 was raw, converting to qcow2 {{(pid=88899) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Aug 03 08:53:48 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-bdcd5a81-447a-412d-84a1-e860a9897b66 tempest-VolumeImageDependencyTests-942168115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_7ae30a3b-e3a4-40d9-8a51-9efe26db7ca8_qyi0gynqdevstack@QuobyteHD /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-a83eaa93-b6be-408e-9aaa-3d7c742db983 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:53:48 devstack sudo[112573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_7ae30a3b-e3a4-40d9-8a51-9efe26db7ca8_qyi0gynqdevstack@QuobyteHD /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-a83eaa93-b6be-408e-9aaa-3d7c742db983 Aug 03 08:53:48 devstack sudo[112573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:53:48 devstack sudo[112564]: pam_unix(sudo:session): session closed for user root Aug 03 08:53:48 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-cb0a052c-0e10-4114-b4c8-2223ac58e7fc tempest-CreateVolumesFromSnapshotTest-2011744404 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-12cb2f26-c24e-4b7c-b6ac-768e61e7676e" returned: 0 in 0.395s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:53:48 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-cb0a052c-0e10-4114-b4c8-2223ac58e7fc tempest-CreateVolumesFromSnapshotTest-2011744404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-12cb2f26-c24e-4b7c-b6ac-768e61e7676e {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:53:48 devstack sudo[112580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-12cb2f26-c24e-4b7c-b6ac-768e61e7676e Aug 03 08:53:48 devstack sudo[112580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:53:48 devstack sudo[112568]: pam_unix(sudo:session): session closed for user root Aug 03 08:53:48 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-f0b148ac-10ed-4b60-978a-09968f496ca5 tempest-ProjectMemberTests-1353074417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-9143315a-67be-4bc8-b7b6-bb15371535ce.info" returned: 0 in 0.264s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:53:48 devstack cinder-volume[88899]: WARNING cinder.volume.drivers.remotefs [None req-f0b148ac-10ed-4b60-978a-09968f496ca5 tempest-ProjectMemberTests-1353074417 None] /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-9143315a-67be-4bc8-b7b6-bb15371535ce.info is being set with open permissions: ugo+rw Aug 03 08:53:48 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-f0b148ac-10ed-4b60-978a-09968f496ca5 tempest-ProjectMemberTests-1353074417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-9143315a-67be-4bc8-b7b6-bb15371535ce.info {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:53:48 devstack sudo[112582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-9143315a-67be-4bc8-b7b6-bb15371535ce.info Aug 03 08:53:48 devstack sudo[112582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:53:48 devstack sudo[112580]: pam_unix(sudo:session): session closed for user root Aug 03 08:53:48 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-cb0a052c-0e10-4114-b4c8-2223ac58e7fc tempest-CreateVolumesFromSnapshotTest-2011744404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-12cb2f26-c24e-4b7c-b6ac-768e61e7676e" returned: 0 in 0.294s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:53:48 devstack sudo[112573]: pam_unix(sudo:session): session closed for user root Aug 03 08:53:48 devstack sudo[112582]: pam_unix(sudo:session): session closed for user root Aug 03 08:53:48 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-f0b148ac-10ed-4b60-978a-09968f496ca5 tempest-ProjectMemberTests-1353074417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-9143315a-67be-4bc8-b7b6-bb15371535ce.info" returned: 0 in 0.272s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:53:48 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-bdcd5a81-447a-412d-84a1-e860a9897b66 tempest-VolumeImageDependencyTests-942168115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_7ae30a3b-e3a4-40d9-8a51-9efe26db7ca8_qyi0gynqdevstack@QuobyteHD /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-a83eaa93-b6be-408e-9aaa-3d7c742db983" returned: 0 in 0.431s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:53:48 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-f0b148ac-10ed-4b60-978a-09968f496ca5 tempest-ProjectMemberTests-1353074417 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.101s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:53:48 devstack cinder-volume[88899]: DEBUG cinder.image.image_utils [None req-bdcd5a81-447a-412d-84a1-e860a9897b66 tempest-VolumeImageDependencyTests-942168115 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_7ae30a3b-e3a4-40d9-8a51-9efe26db7ca8_qyi0gynqdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-a83eaa93-b6be-408e-9aaa-3d7c742db983 {{(pid=88899) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 03 08:53:48 devstack cinder-volume[88899]: INFO cinder.image.image_utils [None req-bdcd5a81-447a-412d-84a1-e860a9897b66 tempest-VolumeImageDependencyTests-942168115 None] Converted 0.00 MB image at 0.00 MB/s Aug 03 08:53:48 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-bdcd5a81-447a-412d-84a1-e860a9897b66 tempest-VolumeImageDependencyTests-942168115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-a83eaa93-b6be-408e-9aaa-3d7c742db983 1G {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:53:48 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-cb0a052c-0e10-4114-b4c8-2223ac58e7fc tempest-CreateVolumesFromSnapshotTest-2011744404 None] Lock "cinder-quobyte-12cb2f26-c24e-4b7c-b6ac-768e61e7676e" released by "delete_volume" :: held 0.802s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:53:48 devstack sudo[112590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-a83eaa93-b6be-408e-9aaa-3d7c742db983 1G Aug 03 08:53:48 devstack sudo[112590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:53:48 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-f0b148ac-10ed-4b60-978a-09968f496ca5 tempest-ProjectMemberTests-1353074417 None] Create snapshot completed successfully Aug 03 08:53:48 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-d738e8ca-c717-44cd-9497-e5ceedfdc691 tempest-VolumeDependencyTests-1512358985 None] Acquiring lock "cinder-2020514f-ed33-440d-ac66-99bda5184fc5-delete_snapshot" by "delete_snapshot" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:53:49 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-d738e8ca-c717-44cd-9497-e5ceedfdc691 tempest-VolumeDependencyTests-1512358985 None] Lock "cinder-2020514f-ed33-440d-ac66-99bda5184fc5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:53:49 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-d738e8ca-c717-44cd-9497-e5ceedfdc691 tempest-VolumeDependencyTests-1512358985 None] Acquiring lock "cinder-quobyte-1b1ea719-0de3-48d6-ab8a-b62a8b3ce570" by "delete_snapshot" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:53:49 devstack cinder-volume[88899]: DEBUG cinder.quota [None req-cb0a052c-0e10-4114-b4c8-2223ac58e7fc tempest-CreateVolumesFromSnapshotTest-2011744404 None] Created reservations ['7c20774d-af25-4cc9-91ab-0917af15a9f2', 'c8906f96-12c1-47ec-a464-ea11357a8629', '292e8879-0284-48e7-81a7-47a350f9bf08', 'f87cd0cf-e63e-4276-9ca4-6ac42a3e0386'] {{(pid=88899) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 08:53:49 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-d738e8ca-c717-44cd-9497-e5ceedfdc691 tempest-VolumeDependencyTests-1512358985 None] Lock "cinder-quobyte-1b1ea719-0de3-48d6-ab8a-b62a8b3ce570" acquired by "delete_snapshot" :: waited 0.024s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:53:49 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-d738e8ca-c717-44cd-9497-e5ceedfdc691 tempest-VolumeDependencyTests-1512358985 None] Acquiring lock "cinder-quobyte-2020514f-ed33-440d-ac66-99bda5184fc5" by "_delete_snapshot" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:53:49 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-d738e8ca-c717-44cd-9497-e5ceedfdc691 tempest-VolumeDependencyTests-1512358985 None] Lock "cinder-quobyte-2020514f-ed33-440d-ac66-99bda5184fc5" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:53:49 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-d738e8ca-c717-44cd-9497-e5ceedfdc691 tempest-VolumeDependencyTests-1512358985 None] Deleting offline snapshot 2020514f-ed33-440d-ac66-99bda5184fc5 of volume 1b1ea719-0de3-48d6-ab8a-b62a8b3ce570 {{(pid=88899) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 03 08:53:49 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-d738e8ca-c717-44cd-9497-e5ceedfdc691 tempest-VolumeDependencyTests-1512358985 None] snapshot_file for this snap is: volume-1b1ea719-0de3-48d6-ab8a-b62a8b3ce570.2020514f-ed33-440d-ac66-99bda5184fc5 {{(pid=88899) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 03 08:53:49 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[72bcdf31-a9a6-48c0-a5c9-250bcc2fc69f]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:53:49 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-d738e8ca-c717-44cd-9497-e5ceedfdc691 tempest-VolumeDependencyTests-1512358985 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-1b1ea719-0de3-48d6-ab8a-b62a8b3ce570.2020514f-ed33-440d-ac66-99bda5184fc5 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:53:49 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-cb0a052c-0e10-4114-b4c8-2223ac58e7fc tempest-CreateVolumesFromSnapshotTest-2011744404 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:53:49 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-cb0a052c-0e10-4114-b4c8-2223ac58e7fc tempest-CreateVolumesFromSnapshotTest-2011744404 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:53:49 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-cb0a052c-0e10-4114-b4c8-2223ac58e7fc tempest-CreateVolumesFromSnapshotTest-2011744404 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:53:49 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-cb0a052c-0e10-4114-b4c8-2223ac58e7fc tempest-CreateVolumesFromSnapshotTest-2011744404 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:53:49 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-cb0a052c-0e10-4114-b4c8-2223ac58e7fc tempest-CreateVolumesFromSnapshotTest-2011744404 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:53:49 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-cb0a052c-0e10-4114-b4c8-2223ac58e7fc tempest-CreateVolumesFromSnapshotTest-2011744404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:53:49 devstack sudo[112593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a Aug 03 08:53:49 devstack sudo[112593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:53:49 devstack sudo[112592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-1b1ea719-0de3-48d6-ab8a-b62a8b3ce570.2020514f-ed33-440d-ac66-99bda5184fc5 Aug 03 08:53:49 devstack sudo[112592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:53:49 devstack sudo[112590]: pam_unix(sudo:session): session closed for user root Aug 03 08:53:49 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-bdcd5a81-447a-412d-84a1-e860a9897b66 tempest-VolumeImageDependencyTests-942168115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-a83eaa93-b6be-408e-9aaa-3d7c742db983 1G" returned: 0 in 0.401s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:53:49 devstack cinder-volume[88899]: DEBUG cinder.volume.volume_utils [None req-bdcd5a81-447a-412d-84a1-e860a9897b66 tempest-VolumeImageDependencyTests-942168115 None] Downloaded image 7ae30a3b-e3a4-40d9-8a51-9efe26db7ca8 ((None, [{'url': 'file:///opt/stack/data/glance/images/7ae30a3b-e3a4-40d9-8a51-9efe26db7ca8', 'metadata': {}}])) to volume a83eaa93-b6be-408e-9aaa-3d7c742db983 successfully. {{(pid=88899) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Aug 03 08:53:49 devstack cinder-volume[88899]: DEBUG cinder.image.image_utils [None req-bdcd5a81-447a-412d-84a1-e860a9897b66 tempest-VolumeImageDependencyTests-942168115 None] Temporary image 7ae30a3b-e3a4-40d9-8a51-9efe26db7ca8 for user ec19afbca65f4a8185b3231a39404ec7 is deleted. {{(pid=88899) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Aug 03 08:53:49 devstack cinder-volume[88899]: DEBUG cinder.volume.volume_utils [None req-bdcd5a81-447a-412d-84a1-e860a9897b66 tempest-VolumeImageDependencyTests-942168115 None] Marking volume a83eaa93-b6be-408e-9aaa-3d7c742db983 as bootable. {{(pid=88899) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Aug 03 08:53:49 devstack cinder-volume[88899]: DEBUG cinder.volume.flows.manager.create_volume [None req-bdcd5a81-447a-412d-84a1-e860a9897b66 tempest-VolumeImageDependencyTests-942168115 None] Copying metadata from image 7ae30a3b-e3a4-40d9-8a51-9efe26db7ca8 to a83eaa93-b6be-408e-9aaa-3d7c742db983. {{(pid=88899) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Aug 03 08:53:49 devstack cinder-volume[88899]: DEBUG cinder.volume.flows.manager.create_volume [None req-bdcd5a81-447a-412d-84a1-e860a9897b66 tempest-VolumeImageDependencyTests-942168115 None] Creating volume glance metadata for volume a83eaa93-b6be-408e-9aaa-3d7c742db983 backed by image 7ae30a3b-e3a4-40d9-8a51-9efe26db7ca8 with: {'image_id': '7ae30a3b-e3a4-40d9-8a51-9efe26db7ca8', 'image_name': 'image-for-test-0e20bd6e-440f-41d8-9b5d-fc047ac00423', 'checksum': '9ed0e24b8165061776cc81533895c53c', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=88899) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Aug 03 08:53:49 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-bdcd5a81-447a-412d-84a1-e860a9897b66 tempest-VolumeImageDependencyTests-942168115 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ab96970-f6a1-45c1-b992-5b580590b244) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a83eaa93-b6be-408e-9aaa-3d7c742db983', 'volume_size': 1, 'image_id': '7ae30a3b-e3a4-40d9-8a51-9efe26db7ca8', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7ae30a3b-e3a4-40d9-8a51-9efe26db7ca8', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-0e20bd6e-440f-41d8-9b5d-fc047ac00423', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '9ed0e24b8165061776cc81533895c53c', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'fb20ce3648d1497fb23ac775415e7a44', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '3f50c0a09c2d7c7c8dac5de664d1ecc0ab864f33b017e5178f68c45bdebb4a0903075de05af0055959a0802d6d344688313c4317ab631c88d18c56452fa17a9d', 'id': '7ae30a3b-e3a4-40d9-8a51-9efe26db7ca8', 'created_at': datetime.datetime(2026, 8, 3, 6, 53, 41, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 3, 6, 53, 43, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7ae30a3b-e3a4-40d9-8a51-9efe26db7ca8/file', 'properties': {}}, 'image_service': }' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:53:49 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-bdcd5a81-447a-412d-84a1-e860a9897b66 tempest-VolumeImageDependencyTests-942168115 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (028609f2-45f0-497b-9cda-f8a2c1b1d7e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:53:49 devstack cinder-volume[88899]: INFO cinder.volume.flows.manager.create_volume [None req-bdcd5a81-447a-412d-84a1-e860a9897b66 tempest-VolumeImageDependencyTests-942168115 None] Volume volume-a83eaa93-b6be-408e-9aaa-3d7c742db983 (a83eaa93-b6be-408e-9aaa-3d7c742db983): created successfully Aug 03 08:53:49 devstack sudo[112593]: pam_unix(sudo:session): session closed for user root Aug 03 08:53:49 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-bdcd5a81-447a-412d-84a1-e860a9897b66 tempest-VolumeImageDependencyTests-942168115 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (028609f2-45f0-497b-9cda-f8a2c1b1d7e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:53:49 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-bdcd5a81-447a-412d-84a1-e860a9897b66 tempest-VolumeImageDependencyTests-942168115 None] Flow 'volume_create_manager' (9ab6233e-085e-435b-b1aa-c9a657099202) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:53:49 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-cb0a052c-0e10-4114-b4c8-2223ac58e7fc tempest-CreateVolumesFromSnapshotTest-2011744404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a" returned: 0 in 0.305s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:53:49 devstack cinder-volume[88899]: DEBUG cinder.manager [None req-cb0a052c-0e10-4114-b4c8-2223ac58e7fc tempest-CreateVolumesFromSnapshotTest-2011744404 None] Notifying Schedulers of capabilities ... {{(pid=88899) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 08:53:49 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-cb0a052c-0e10-4114-b4c8-2223ac58e7fc tempest-CreateVolumesFromSnapshotTest-2011744404 None] Deleted volume successfully. Aug 03 08:53:49 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-bdcd5a81-447a-412d-84a1-e860a9897b66 tempest-VolumeImageDependencyTests-942168115 None] Created volume successfully. Aug 03 08:53:49 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-cb0a052c-0e10-4114-b4c8-2223ac58e7fc tempest-CreateVolumesFromSnapshotTest-2011744404 None] Lock "cinder-12cb2f26-c24e-4b7c-b6ac-768e61e7676e-delete_volume" released by "delete_volume" :: held 1.453s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:53:49 devstack sudo[112592]: pam_unix(sudo:session): session closed for user root Aug 03 08:53:49 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-d738e8ca-c717-44cd-9497-e5ceedfdc691 tempest-VolumeDependencyTests-1512358985 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-1b1ea719-0de3-48d6-ab8a-b62a8b3ce570.2020514f-ed33-440d-ac66-99bda5184fc5" returned: 0 in 0.450s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:53:49 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-d738e8ca-c717-44cd-9497-e5ceedfdc691 tempest-VolumeDependencyTests-1512358985 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1b1ea719-0de3-48d6-ab8a-b62a8b3ce570(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88899) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 03 08:53:49 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b177ff9-de93-48a2-9598-bb23e864730e]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:53:49 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-d738e8ca-c717-44cd-9497-e5ceedfdc691 tempest-VolumeDependencyTests-1512358985 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-1b1ea719-0de3-48d6-ab8a-b62a8b3ce570 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:53:49 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-d8a3b7a1-8bea-4289-8ddf-b4d0d448636f tempest-ProjectMemberTests-1353074417 None] Acquiring lock "cinder-726a4226-b77e-461d-97b0-40173270cce1-delete_snapshot" by "delete_snapshot" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:53:49 devstack sudo[112604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-1b1ea719-0de3-48d6-ab8a-b62a8b3ce570 Aug 03 08:53:49 devstack sudo[112604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:53:49 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-d8a3b7a1-8bea-4289-8ddf-b4d0d448636f tempest-ProjectMemberTests-1353074417 None] Lock "cinder-726a4226-b77e-461d-97b0-40173270cce1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:53:49 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-d8a3b7a1-8bea-4289-8ddf-b4d0d448636f tempest-ProjectMemberTests-1353074417 None] Acquiring lock "cinder-quobyte-9143315a-67be-4bc8-b7b6-bb15371535ce" by "delete_snapshot" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:53:49 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-d8a3b7a1-8bea-4289-8ddf-b4d0d448636f tempest-ProjectMemberTests-1353074417 None] Lock "cinder-quobyte-9143315a-67be-4bc8-b7b6-bb15371535ce" acquired by "delete_snapshot" :: waited 0.019s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:53:49 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-d8a3b7a1-8bea-4289-8ddf-b4d0d448636f tempest-ProjectMemberTests-1353074417 None] Acquiring lock "cinder-quobyte-726a4226-b77e-461d-97b0-40173270cce1" by "_delete_snapshot" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:53:49 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-d8a3b7a1-8bea-4289-8ddf-b4d0d448636f tempest-ProjectMemberTests-1353074417 None] Lock "cinder-quobyte-726a4226-b77e-461d-97b0-40173270cce1" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:53:49 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-d8a3b7a1-8bea-4289-8ddf-b4d0d448636f tempest-ProjectMemberTests-1353074417 None] Deleting offline snapshot 726a4226-b77e-461d-97b0-40173270cce1 of volume 9143315a-67be-4bc8-b7b6-bb15371535ce {{(pid=88899) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 03 08:53:49 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-d8a3b7a1-8bea-4289-8ddf-b4d0d448636f tempest-ProjectMemberTests-1353074417 None] snapshot_file for this snap is: volume-9143315a-67be-4bc8-b7b6-bb15371535ce.726a4226-b77e-461d-97b0-40173270cce1 {{(pid=88899) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 03 08:53:49 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fc2402a-b037-4621-ad68-62eb7a6d6a7f]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:53:49 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-d8a3b7a1-8bea-4289-8ddf-b4d0d448636f tempest-ProjectMemberTests-1353074417 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-9143315a-67be-4bc8-b7b6-bb15371535ce.726a4226-b77e-461d-97b0-40173270cce1 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:53:49 devstack sudo[112606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-9143315a-67be-4bc8-b7b6-bb15371535ce.726a4226-b77e-461d-97b0-40173270cce1 Aug 03 08:53:49 devstack sudo[112606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:53:50 devstack sudo[112604]: pam_unix(sudo:session): session closed for user root Aug 03 08:53:50 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-d738e8ca-c717-44cd-9497-e5ceedfdc691 tempest-VolumeDependencyTests-1512358985 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-1b1ea719-0de3-48d6-ab8a-b62a8b3ce570" returned: 0 in 0.474s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:53:50 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-d738e8ca-c717-44cd-9497-e5ceedfdc691 tempest-VolumeDependencyTests-1512358985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-1b1ea719-0de3-48d6-ab8a-b62a8b3ce570.2020514f-ed33-440d-ac66-99bda5184fc5 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:53:50 devstack sudo[112612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-1b1ea719-0de3-48d6-ab8a-b62a8b3ce570.2020514f-ed33-440d-ac66-99bda5184fc5 Aug 03 08:53:50 devstack sudo[112612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:53:50 devstack sudo[112606]: pam_unix(sudo:session): session closed for user root Aug 03 08:53:50 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-d8a3b7a1-8bea-4289-8ddf-b4d0d448636f tempest-ProjectMemberTests-1353074417 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-9143315a-67be-4bc8-b7b6-bb15371535ce.726a4226-b77e-461d-97b0-40173270cce1" returned: 0 in 0.513s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:53:50 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-d8a3b7a1-8bea-4289-8ddf-b4d0d448636f tempest-ProjectMemberTests-1353074417 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9143315a-67be-4bc8-b7b6-bb15371535ce(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88899) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 03 08:53:50 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2f5dc94-78c3-4b5b-acd5-0ad60d0625f9]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:53:50 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-d8a3b7a1-8bea-4289-8ddf-b4d0d448636f tempest-ProjectMemberTests-1353074417 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-9143315a-67be-4bc8-b7b6-bb15371535ce {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:53:50 devstack sudo[112612]: pam_unix(sudo:session): session closed for user root Aug 03 08:53:50 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-d738e8ca-c717-44cd-9497-e5ceedfdc691 tempest-VolumeDependencyTests-1512358985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-1b1ea719-0de3-48d6-ab8a-b62a8b3ce570.2020514f-ed33-440d-ac66-99bda5184fc5" returned: 0 in 0.403s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:53:50 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-d738e8ca-c717-44cd-9497-e5ceedfdc691 tempest-VolumeDependencyTests-1512358985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-1b1ea719-0de3-48d6-ab8a-b62a8b3ce570.2020514f-ed33-440d-ac66-99bda5184fc5 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:53:50 devstack sudo[112622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-9143315a-67be-4bc8-b7b6-bb15371535ce Aug 03 08:53:50 devstack sudo[112622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:53:50 devstack sudo[112623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-1b1ea719-0de3-48d6-ab8a-b62a8b3ce570.2020514f-ed33-440d-ac66-99bda5184fc5 Aug 03 08:53:50 devstack sudo[112623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:53:50 devstack sudo[112623]: pam_unix(sudo:session): session closed for user root Aug 03 08:53:50 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-d738e8ca-c717-44cd-9497-e5ceedfdc691 tempest-VolumeDependencyTests-1512358985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-1b1ea719-0de3-48d6-ab8a-b62a8b3ce570.2020514f-ed33-440d-ac66-99bda5184fc5" returned: 0 in 0.358s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:53:50 devstack sudo[112622]: pam_unix(sudo:session): session closed for user root Aug 03 08:53:50 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-d8a3b7a1-8bea-4289-8ddf-b4d0d448636f tempest-ProjectMemberTests-1353074417 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-9143315a-67be-4bc8-b7b6-bb15371535ce" returned: 0 in 0.518s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:53:50 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-d8a3b7a1-8bea-4289-8ddf-b4d0d448636f tempest-ProjectMemberTests-1353074417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-9143315a-67be-4bc8-b7b6-bb15371535ce.726a4226-b77e-461d-97b0-40173270cce1 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:53:50 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-d738e8ca-c717-44cd-9497-e5ceedfdc691 tempest-VolumeDependencyTests-1512358985 None] Lock "cinder-quobyte-2020514f-ed33-440d-ac66-99bda5184fc5" released by "_delete_snapshot" :: held 1.822s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:53:50 devstack cinder-volume[88899]: DEBUG cinder.volume.flows.manager.create_volume [None req-44d6938e-b35a-471b-974d-68efe4a2bcfb tempest-VolumeImageDependencyTests-942168115 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88899) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 08:53:50 devstack sudo[112630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-9143315a-67be-4bc8-b7b6-bb15371535ce.726a4226-b77e-461d-97b0-40173270cce1 Aug 03 08:53:50 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-d738e8ca-c717-44cd-9497-e5ceedfdc691 tempest-VolumeDependencyTests-1512358985 None] Lock "cinder-quobyte-1b1ea719-0de3-48d6-ab8a-b62a8b3ce570" released by "delete_snapshot" :: held 1.859s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:53:50 devstack sudo[112630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:53:50 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-44d6938e-b35a-471b-974d-68efe4a2bcfb tempest-VolumeImageDependencyTests-942168115 None] Flow 'volume_create_manager' (efd3da64-fb82-4e15-86f3-387546168bcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:53:50 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-44d6938e-b35a-471b-974d-68efe4a2bcfb tempest-VolumeImageDependencyTests-942168115 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00defcaf-6e7b-4ead-984f-565b108f6740) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:53:50 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-44d6938e-b35a-471b-974d-68efe4a2bcfb tempest-VolumeImageDependencyTests-942168115 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00defcaf-6e7b-4ead-984f-565b108f6740) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=True,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:53:50Z,deleted=False,deleted_at=None,display_description=None,display_name='volume2-for-test-0e20bd6e-440f-41d8-9b5d-fc047ac00423',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bcc51603-5d44-4976-8687-6838b41be60a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fb20ce3648d1497fb23ac775415e7a44',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:53:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=a83eaa93-b6be-408e-9aaa-3d7c742db983,status='creating',terminated_at=None,updated_at=2026-08-03T06:53:51Z,use_quota=True,user_id='ec19afbca65f4a8185b3231a39404ec7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8bde7129-1dc4-42ab-b852-ab32c61b4921),volume_type_id=8bde7129-1dc4-42ab-b852-ab32c61b4921)' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:53:50 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-44d6938e-b35a-471b-974d-68efe4a2bcfb tempest-VolumeImageDependencyTests-942168115 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (69a26722-3d2a-4cc8-80d1-70149536558f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:53:50 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-44d6938e-b35a-471b-974d-68efe4a2bcfb tempest-VolumeImageDependencyTests-942168115 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (69a26722-3d2a-4cc8-80d1-70149536558f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:53:50 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-44d6938e-b35a-471b-974d-68efe4a2bcfb tempest-VolumeImageDependencyTests-942168115 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa98aae4-d3db-4bed-a089-e1f005df1039) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:53:51 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-44d6938e-b35a-471b-974d-68efe4a2bcfb tempest-VolumeImageDependencyTests-942168115 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa98aae4-d3db-4bed-a089-e1f005df1039) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'bcc51603-5d44-4976-8687-6838b41be60a', 'volume_name': 'volume-bcc51603-5d44-4976-8687-6838b41be60a', 'volume_size': 1, 'source_volid': 'a83eaa93-b6be-408e-9aaa-3d7c742db983', 'source_volstatus': 'available'}' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:53:51 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-44d6938e-b35a-471b-974d-68efe4a2bcfb tempest-VolumeImageDependencyTests-942168115 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (439b522b-3ae6-40ce-b67b-819318c27524) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:53:51 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-44d6938e-b35a-471b-974d-68efe4a2bcfb tempest-VolumeImageDependencyTests-942168115 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (439b522b-3ae6-40ce-b67b-819318c27524) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:53:51 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-44d6938e-b35a-471b-974d-68efe4a2bcfb tempest-VolumeImageDependencyTests-942168115 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26579265-c7a9-4c4c-8cba-585fd93910b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:53:51 devstack cinder-volume[88899]: INFO cinder.volume.flows.manager.create_volume [None req-44d6938e-b35a-471b-974d-68efe4a2bcfb tempest-VolumeImageDependencyTests-942168115 None] Volume bcc51603-5d44-4976-8687-6838b41be60a: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-bcc51603-5d44-4976-8687-6838b41be60a', 'volume_size': 1, 'source_volid': 'a83eaa93-b6be-408e-9aaa-3d7c742db983', 'source_volstatus': 'available'} Aug 03 08:53:51 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-44d6938e-b35a-471b-974d-68efe4a2bcfb tempest-VolumeImageDependencyTests-942168115 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:53:51 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-44d6938e-b35a-471b-974d-68efe4a2bcfb tempest-VolumeImageDependencyTests-942168115 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:53:51 devstack cinder-volume[88899]: INFO cinder.volume.drivers.remotefs [None req-44d6938e-b35a-471b-974d-68efe4a2bcfb tempest-VolumeImageDependencyTests-942168115 None] Cloning volume a83eaa93-b6be-408e-9aaa-3d7c742db983 to volume bcc51603-5d44-4976-8687-6838b41be60a Aug 03 08:53:51 devstack cinder-volume[88899]: DEBUG cinder.quota [None req-d738e8ca-c717-44cd-9497-e5ceedfdc691 tempest-VolumeDependencyTests-1512358985 None] Created reservations ['048850e5-81ca-402e-beb7-0f099b14e059', '8c45419f-8e0d-48ac-b004-a84a0956f0ae', '7a57f393-c156-4c42-88c7-b44593bdb491', '621dc929-f7eb-4ae4-ad3c-09c4d82bbb47'] {{(pid=88899) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 08:53:51 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-44d6938e-b35a-471b-974d-68efe4a2bcfb tempest-VolumeImageDependencyTests-942168115 None] Creating offline snapshot 501f28a3-a34b-4561-8bee-4064088eac66 of volume a83eaa93-b6be-408e-9aaa-3d7c742db983 {{(pid=88899) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 03 08:53:51 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2a575e5-0b81-45a8-9fe9-f5f0032a4479]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:53:51 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-44d6938e-b35a-471b-974d-68efe4a2bcfb tempest-VolumeImageDependencyTests-942168115 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-a83eaa93-b6be-408e-9aaa-3d7c742db983 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:53:51 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-d738e8ca-c717-44cd-9497-e5ceedfdc691 tempest-VolumeDependencyTests-1512358985 None] Delete snapshot completed successfully. Aug 03 08:53:51 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-d738e8ca-c717-44cd-9497-e5ceedfdc691 tempest-VolumeDependencyTests-1512358985 None] Lock "cinder-2020514f-ed33-440d-ac66-99bda5184fc5-delete_snapshot" released by "delete_snapshot" :: held 2.175s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:53:51 devstack sudo[112632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-a83eaa93-b6be-408e-9aaa-3d7c742db983 Aug 03 08:53:51 devstack sudo[112632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:53:51 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-149cd435-150e-4c22-a652-d196f4b53ec2 tempest-VolumeDependencyTests-1512358985 None] Acquiring lock "cinder-4b24bb72-96b2-432f-aa36-80783dfd40ca-delete_volume" by "delete_volume" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:53:51 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-149cd435-150e-4c22-a652-d196f4b53ec2 tempest-VolumeDependencyTests-1512358985 None] Lock "cinder-4b24bb72-96b2-432f-aa36-80783dfd40ca-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:53:51 devstack sudo[112630]: pam_unix(sudo:session): session closed for user root Aug 03 08:53:51 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-d8a3b7a1-8bea-4289-8ddf-b4d0d448636f tempest-ProjectMemberTests-1353074417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-9143315a-67be-4bc8-b7b6-bb15371535ce.726a4226-b77e-461d-97b0-40173270cce1" returned: 0 in 0.491s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:53:51 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-d8a3b7a1-8bea-4289-8ddf-b4d0d448636f tempest-ProjectMemberTests-1353074417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-9143315a-67be-4bc8-b7b6-bb15371535ce.726a4226-b77e-461d-97b0-40173270cce1 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:53:51 devstack sudo[112637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-9143315a-67be-4bc8-b7b6-bb15371535ce.726a4226-b77e-461d-97b0-40173270cce1 Aug 03 08:53:51 devstack sudo[112637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:53:51 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-149cd435-150e-4c22-a652-d196f4b53ec2 tempest-VolumeDependencyTests-1512358985 None] Acquiring lock "cinder-quobyte-4b24bb72-96b2-432f-aa36-80783dfd40ca" by "delete_volume" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:53:51 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-149cd435-150e-4c22-a652-d196f4b53ec2 tempest-VolumeDependencyTests-1512358985 None] Lock "cinder-quobyte-4b24bb72-96b2-432f-aa36-80783dfd40ca" acquired by "delete_volume" :: waited 0.030s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:53:51 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7fd89a0-e99f-4e8f-b79c-deaba64152b0]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:53:51 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-149cd435-150e-4c22-a652-d196f4b53ec2 tempest-VolumeDependencyTests-1512358985 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-4b24bb72-96b2-432f-aa36-80783dfd40ca {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:53:51 devstack sudo[112632]: pam_unix(sudo:session): session closed for user root Aug 03 08:53:51 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-44d6938e-b35a-471b-974d-68efe4a2bcfb tempest-VolumeImageDependencyTests-942168115 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-a83eaa93-b6be-408e-9aaa-3d7c742db983" returned: 0 in 0.500s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:53:51 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-44d6938e-b35a-471b-974d-68efe4a2bcfb tempest-VolumeImageDependencyTests-942168115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-a83eaa93-b6be-408e-9aaa-3d7c742db983,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-a83eaa93-b6be-408e-9aaa-3d7c742db983.501f28a3-a34b-4561-8bee-4064088eac66 1G {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:53:51 devstack sudo[112639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-4b24bb72-96b2-432f-aa36-80783dfd40ca Aug 03 08:53:51 devstack sudo[112639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:53:51 devstack sudo[112646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-a83eaa93-b6be-408e-9aaa-3d7c742db983,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-a83eaa93-b6be-408e-9aaa-3d7c742db983.501f28a3-a34b-4561-8bee-4064088eac66 1G Aug 03 08:53:51 devstack sudo[112646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:53:51 devstack sudo[112637]: pam_unix(sudo:session): session closed for user root Aug 03 08:53:51 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-d8a3b7a1-8bea-4289-8ddf-b4d0d448636f tempest-ProjectMemberTests-1353074417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-9143315a-67be-4bc8-b7b6-bb15371535ce.726a4226-b77e-461d-97b0-40173270cce1" returned: 0 in 0.275s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:53:51 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-d8a3b7a1-8bea-4289-8ddf-b4d0d448636f tempest-ProjectMemberTests-1353074417 None] Lock "cinder-quobyte-726a4226-b77e-461d-97b0-40173270cce1" released by "_delete_snapshot" :: held 1.913s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:53:51 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-d8a3b7a1-8bea-4289-8ddf-b4d0d448636f tempest-ProjectMemberTests-1353074417 None] Lock "cinder-quobyte-9143315a-67be-4bc8-b7b6-bb15371535ce" released by "delete_snapshot" :: held 1.943s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:53:51 devstack cinder-volume[88899]: DEBUG cinder.quota [None req-d8a3b7a1-8bea-4289-8ddf-b4d0d448636f tempest-ProjectMemberTests-1353074417 None] Created reservations ['082268cc-fdfe-4aa5-9e2e-615ed7d8ff68', '8245380e-342f-42d2-9640-096d5b99f91e', 'b8af0ed9-d871-445e-a656-cdde8dd03506', 'ae66ba46-74aa-436b-9653-ca501ac74c95'] {{(pid=88899) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 08:53:51 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-d8a3b7a1-8bea-4289-8ddf-b4d0d448636f tempest-ProjectMemberTests-1353074417 None] Delete snapshot completed successfully. Aug 03 08:53:51 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-d8a3b7a1-8bea-4289-8ddf-b4d0d448636f tempest-ProjectMemberTests-1353074417 None] Lock "cinder-726a4226-b77e-461d-97b0-40173270cce1-delete_snapshot" released by "delete_snapshot" :: held 2.176s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:53:51 devstack cinder-volume[88899]: DEBUG oslo_service.periodic_task [None req-f948fb4a-c4d7-499f-b1bd-8d6be3de0b53 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88899) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 03 08:53:51 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-f948fb4a-c4d7-499f-b1bd-8d6be3de0b53 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:53:51 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-f948fb4a-c4d7-499f-b1bd-8d6be3de0b53 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:53:51 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-f948fb4a-c4d7-499f-b1bd-8d6be3de0b53 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:53:51 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-f948fb4a-c4d7-499f-b1bd-8d6be3de0b53 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:53:51 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-f948fb4a-c4d7-499f-b1bd-8d6be3de0b53 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:53:51 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-f948fb4a-c4d7-499f-b1bd-8d6be3de0b53 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:53:51 devstack sudo[112639]: pam_unix(sudo:session): session closed for user root Aug 03 08:53:51 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-149cd435-150e-4c22-a652-d196f4b53ec2 tempest-VolumeDependencyTests-1512358985 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-4b24bb72-96b2-432f-aa36-80783dfd40ca" returned: 0 in 0.480s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:53:51 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-149cd435-150e-4c22-a652-d196f4b53ec2 tempest-VolumeDependencyTests-1512358985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-4b24bb72-96b2-432f-aa36-80783dfd40ca {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:53:51 devstack sudo[112654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a Aug 03 08:53:51 devstack sudo[112654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:53:51 devstack sudo[112655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-4b24bb72-96b2-432f-aa36-80783dfd40ca Aug 03 08:53:51 devstack sudo[112655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:53:52 devstack sudo[112646]: pam_unix(sudo:session): session closed for user root Aug 03 08:53:52 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-44d6938e-b35a-471b-974d-68efe4a2bcfb tempest-VolumeImageDependencyTests-942168115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-a83eaa93-b6be-408e-9aaa-3d7c742db983,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-a83eaa93-b6be-408e-9aaa-3d7c742db983.501f28a3-a34b-4561-8bee-4064088eac66 1G" returned: 0 in 0.523s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:53:52 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-44d6938e-b35a-471b-974d-68efe4a2bcfb tempest-VolumeImageDependencyTests-942168115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a83eaa93-b6be-408e-9aaa-3d7c742db983 -F qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-a83eaa93-b6be-408e-9aaa-3d7c742db983.501f28a3-a34b-4561-8bee-4064088eac66 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:53:52 devstack sudo[112659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a83eaa93-b6be-408e-9aaa-3d7c742db983 -F qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-a83eaa93-b6be-408e-9aaa-3d7c742db983.501f28a3-a34b-4561-8bee-4064088eac66 Aug 03 08:53:52 devstack sudo[112659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:53:52 devstack sudo[112655]: pam_unix(sudo:session): session closed for user root Aug 03 08:53:52 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-149cd435-150e-4c22-a652-d196f4b53ec2 tempest-VolumeDependencyTests-1512358985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-4b24bb72-96b2-432f-aa36-80783dfd40ca" returned: 0 in 0.310s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:53:52 devstack sudo[112654]: pam_unix(sudo:session): session closed for user root Aug 03 08:53:52 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-f948fb4a-c4d7-499f-b1bd-8d6be3de0b53 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a" returned: 0 in 0.342s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:53:52 devstack cinder-volume[88899]: DEBUG cinder.manager [None req-f948fb4a-c4d7-499f-b1bd-8d6be3de0b53 None None] Notifying Schedulers of capabilities ... {{(pid=88899) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 08:53:52 devstack cinder-volume[88899]: DEBUG oslo_service.periodic_task [None req-f948fb4a-c4d7-499f-b1bd-8d6be3de0b53 None None] Running periodic task VolumeManager._thread_info {{(pid=88899) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 03 08:53:52 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-f948fb4a-c4d7-499f-b1bd-8d6be3de0b53 None None] thread count: 29 {{(pid=88899) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 03 08:53:52 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-f948fb4a-c4d7-499f-b1bd-8d6be3de0b53 None None] thread info: [<_MainThread(MainThread, started 132234320248960)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88899) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 03 08:53:52 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-149cd435-150e-4c22-a652-d196f4b53ec2 tempest-VolumeDependencyTests-1512358985 None] Lock "cinder-quobyte-4b24bb72-96b2-432f-aa36-80783dfd40ca" released by "delete_volume" :: held 0.871s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:53:52 devstack cinder-volume[88899]: DEBUG cinder.quota [None req-149cd435-150e-4c22-a652-d196f4b53ec2 tempest-VolumeDependencyTests-1512358985 None] Created reservations ['46bb86c2-5ef6-48d9-ad9f-8e8a02f347f5', 'cdf44229-df16-483b-9f7f-a02a1021d0ec', '1df0f531-2133-4eec-be98-b0b1b2705e51', '456a057b-bf97-46d8-90e1-b2181517e49e'] {{(pid=88899) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 08:53:52 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-149cd435-150e-4c22-a652-d196f4b53ec2 tempest-VolumeDependencyTests-1512358985 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:53:52 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-149cd435-150e-4c22-a652-d196f4b53ec2 tempest-VolumeDependencyTests-1512358985 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:53:52 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-149cd435-150e-4c22-a652-d196f4b53ec2 tempest-VolumeDependencyTests-1512358985 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:53:52 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-149cd435-150e-4c22-a652-d196f4b53ec2 tempest-VolumeDependencyTests-1512358985 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:53:52 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-149cd435-150e-4c22-a652-d196f4b53ec2 tempest-VolumeDependencyTests-1512358985 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:53:52 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-149cd435-150e-4c22-a652-d196f4b53ec2 tempest-VolumeDependencyTests-1512358985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:53:52 devstack sudo[112666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a Aug 03 08:53:52 devstack sudo[112666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:53:52 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-f55595c4-cdec-4d9c-8c0a-a9b024b28044 tempest-VolumeDependencyTests-1512358985 None] Acquiring lock "cinder-7a8ead30-8de5-46a9-a84e-9425b673c7c3-delete_volume" by "delete_volume" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:53:52 devstack sudo[112659]: pam_unix(sudo:session): session closed for user root Aug 03 08:53:52 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-44d6938e-b35a-471b-974d-68efe4a2bcfb tempest-VolumeImageDependencyTests-942168115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a83eaa93-b6be-408e-9aaa-3d7c742db983 -F qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-a83eaa93-b6be-408e-9aaa-3d7c742db983.501f28a3-a34b-4561-8bee-4064088eac66" returned: 0 in 0.370s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:53:52 devstack cinder-volume[88899]: WARNING cinder.volume.drivers.remotefs [None req-44d6938e-b35a-471b-974d-68efe4a2bcfb tempest-VolumeImageDependencyTests-942168115 None] /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-a83eaa93-b6be-408e-9aaa-3d7c742db983.501f28a3-a34b-4561-8bee-4064088eac66 is being set with open permissions: ugo+rw Aug 03 08:53:52 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-44d6938e-b35a-471b-974d-68efe4a2bcfb tempest-VolumeImageDependencyTests-942168115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-a83eaa93-b6be-408e-9aaa-3d7c742db983.501f28a3-a34b-4561-8bee-4064088eac66 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:53:52 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-f55595c4-cdec-4d9c-8c0a-a9b024b28044 tempest-VolumeDependencyTests-1512358985 None] Lock "cinder-7a8ead30-8de5-46a9-a84e-9425b673c7c3-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:53:52 devstack sudo[112668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-a83eaa93-b6be-408e-9aaa-3d7c742db983.501f28a3-a34b-4561-8bee-4064088eac66 Aug 03 08:53:52 devstack sudo[112668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:53:52 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-f55595c4-cdec-4d9c-8c0a-a9b024b28044 tempest-VolumeDependencyTests-1512358985 None] Acquiring lock "cinder-quobyte-7a8ead30-8de5-46a9-a84e-9425b673c7c3" by "delete_volume" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:53:52 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-f55595c4-cdec-4d9c-8c0a-a9b024b28044 tempest-VolumeDependencyTests-1512358985 None] Lock "cinder-quobyte-7a8ead30-8de5-46a9-a84e-9425b673c7c3" acquired by "delete_volume" :: waited 0.022s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:53:52 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd5f46c3-120d-4ed2-add8-4cc9f6edb5ba]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:53:52 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-f55595c4-cdec-4d9c-8c0a-a9b024b28044 tempest-VolumeDependencyTests-1512358985 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-7a8ead30-8de5-46a9-a84e-9425b673c7c3 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:53:52 devstack sudo[112666]: pam_unix(sudo:session): session closed for user root Aug 03 08:53:52 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-149cd435-150e-4c22-a652-d196f4b53ec2 tempest-VolumeDependencyTests-1512358985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a" returned: 0 in 0.325s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:53:52 devstack cinder-volume[88899]: DEBUG cinder.manager [None req-149cd435-150e-4c22-a652-d196f4b53ec2 tempest-VolumeDependencyTests-1512358985 None] Notifying Schedulers of capabilities ... {{(pid=88899) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 08:53:52 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-149cd435-150e-4c22-a652-d196f4b53ec2 tempest-VolumeDependencyTests-1512358985 None] Deleted volume successfully. Aug 03 08:53:52 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-149cd435-150e-4c22-a652-d196f4b53ec2 tempest-VolumeDependencyTests-1512358985 None] Lock "cinder-4b24bb72-96b2-432f-aa36-80783dfd40ca-delete_volume" released by "delete_volume" :: held 1.509s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:53:52 devstack sudo[112668]: pam_unix(sudo:session): session closed for user root Aug 03 08:53:52 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-44d6938e-b35a-471b-974d-68efe4a2bcfb tempest-VolumeImageDependencyTests-942168115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-a83eaa93-b6be-408e-9aaa-3d7c742db983.501f28a3-a34b-4561-8bee-4064088eac66" returned: 0 in 0.335s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:53:52 devstack sudo[112670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-7a8ead30-8de5-46a9-a84e-9425b673c7c3 Aug 03 08:53:52 devstack sudo[112670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:53:52 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-44d6938e-b35a-471b-974d-68efe4a2bcfb tempest-VolumeImageDependencyTests-942168115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-a83eaa93-b6be-408e-9aaa-3d7c742db983.info {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:53:52 devstack sudo[112674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-a83eaa93-b6be-408e-9aaa-3d7c742db983.info Aug 03 08:53:52 devstack sudo[112674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:53:52 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-6ae61ac0-5766-4624-9fb0-ed1891dc7266 tempest-ProjectMemberTests-1353074417 None] Acquiring lock "cinder-9143315a-67be-4bc8-b7b6-bb15371535ce-delete_volume" by "delete_volume" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:53:53 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-6ae61ac0-5766-4624-9fb0-ed1891dc7266 tempest-ProjectMemberTests-1353074417 None] Lock "cinder-9143315a-67be-4bc8-b7b6-bb15371535ce-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:53:53 devstack cinder-volume[88899]: DEBUG cinder.volume.flows.manager.create_volume [None req-925c6855-84d9-41a3-83b0-6c7bb37fec0f tempest-CreateVolumesFromSourceVolumeTest-1548484331 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88899) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 08:53:53 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-925c6855-84d9-41a3-83b0-6c7bb37fec0f tempest-CreateVolumesFromSourceVolumeTest-1548484331 None] Flow 'volume_create_manager' (b7a09b7d-11d6-469b-87da-abff81b953d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:53:53 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-925c6855-84d9-41a3-83b0-6c7bb37fec0f tempest-CreateVolumesFromSourceVolumeTest-1548484331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f88932a7-a0ac-4306-a4ad-f7312f7bf7a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:53:53 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-925c6855-84d9-41a3-83b0-6c7bb37fec0f tempest-CreateVolumesFromSourceVolumeTest-1548484331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f88932a7-a0ac-4306-a4ad-f7312f7bf7a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:53:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1755865023',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6801cbde-6fdb-4670-a538-6f836f9c0626,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e5cc9aa0f344c61b55a857dec203137',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:53:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:53:53Z,use_quota=True,user_id='d91b73c2485046e499477b446eb5f731',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8bde7129-1dc4-42ab-b852-ab32c61b4921),volume_type_id=8bde7129-1dc4-42ab-b852-ab32c61b4921)' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:53:53 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-925c6855-84d9-41a3-83b0-6c7bb37fec0f tempest-CreateVolumesFromSourceVolumeTest-1548484331 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (647245bb-5ec6-4d0b-85dc-158da95f9383) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:53:53 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-925c6855-84d9-41a3-83b0-6c7bb37fec0f tempest-CreateVolumesFromSourceVolumeTest-1548484331 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (647245bb-5ec6-4d0b-85dc-158da95f9383) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:53:53 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-925c6855-84d9-41a3-83b0-6c7bb37fec0f tempest-CreateVolumesFromSourceVolumeTest-1548484331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (accf1949-e214-4f33-aebb-c915554e58b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:53:53 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-925c6855-84d9-41a3-83b0-6c7bb37fec0f tempest-CreateVolumesFromSourceVolumeTest-1548484331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (accf1949-e214-4f33-aebb-c915554e58b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6801cbde-6fdb-4670-a538-6f836f9c0626', 'volume_name': 'volume-6801cbde-6fdb-4670-a538-6f836f9c0626', 'volume_size': 1}' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:53:53 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-925c6855-84d9-41a3-83b0-6c7bb37fec0f tempest-CreateVolumesFromSourceVolumeTest-1548484331 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9170894b-838f-458d-8763-f0e000a9aba8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:53:53 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-925c6855-84d9-41a3-83b0-6c7bb37fec0f tempest-CreateVolumesFromSourceVolumeTest-1548484331 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9170894b-838f-458d-8763-f0e000a9aba8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:53:53 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-925c6855-84d9-41a3-83b0-6c7bb37fec0f tempest-CreateVolumesFromSourceVolumeTest-1548484331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21bab6be-29e8-47ec-9e5d-a31bb82b5ffc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:53:53 devstack cinder-volume[88899]: INFO cinder.volume.flows.manager.create_volume [None req-925c6855-84d9-41a3-83b0-6c7bb37fec0f tempest-CreateVolumesFromSourceVolumeTest-1548484331 None] Volume 6801cbde-6fdb-4670-a538-6f836f9c0626: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6801cbde-6fdb-4670-a538-6f836f9c0626', 'volume_size': 1} Aug 03 08:53:53 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-925c6855-84d9-41a3-83b0-6c7bb37fec0f tempest-CreateVolumesFromSourceVolumeTest-1548484331 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:53:53 devstack sudo[112670]: pam_unix(sudo:session): session closed for user root Aug 03 08:53:53 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-f55595c4-cdec-4d9c-8c0a-a9b024b28044 tempest-VolumeDependencyTests-1512358985 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-7a8ead30-8de5-46a9-a84e-9425b673c7c3" returned: 0 in 0.497s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:53:53 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-6ae61ac0-5766-4624-9fb0-ed1891dc7266 tempest-ProjectMemberTests-1353074417 None] Acquiring lock "cinder-quobyte-9143315a-67be-4bc8-b7b6-bb15371535ce" by "delete_volume" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:53:53 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-f55595c4-cdec-4d9c-8c0a-a9b024b28044 tempest-VolumeDependencyTests-1512358985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-7a8ead30-8de5-46a9-a84e-9425b673c7c3 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:53:53 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-6ae61ac0-5766-4624-9fb0-ed1891dc7266 tempest-ProjectMemberTests-1353074417 None] Lock "cinder-quobyte-9143315a-67be-4bc8-b7b6-bb15371535ce" acquired by "delete_volume" :: waited 0.033s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:53:53 devstack sudo[112680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-7a8ead30-8de5-46a9-a84e-9425b673c7c3 Aug 03 08:53:53 devstack sudo[112680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:53:53 devstack sudo[112674]: pam_unix(sudo:session): session closed for user root Aug 03 08:53:53 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-44d6938e-b35a-471b-974d-68efe4a2bcfb tempest-VolumeImageDependencyTests-942168115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-a83eaa93-b6be-408e-9aaa-3d7c742db983.info" returned: 0 in 0.354s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:53:53 devstack cinder-volume[88899]: WARNING cinder.volume.drivers.remotefs [None req-44d6938e-b35a-471b-974d-68efe4a2bcfb tempest-VolumeImageDependencyTests-942168115 None] /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-a83eaa93-b6be-408e-9aaa-3d7c742db983.info is being set with open permissions: ugo+rw Aug 03 08:53:53 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-44d6938e-b35a-471b-974d-68efe4a2bcfb tempest-VolumeImageDependencyTests-942168115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-a83eaa93-b6be-408e-9aaa-3d7c742db983.info {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:53:53 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[47ca8675-7c89-47d4-a245-eace9cd8592a]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:53:53 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-6ae61ac0-5766-4624-9fb0-ed1891dc7266 tempest-ProjectMemberTests-1353074417 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-9143315a-67be-4bc8-b7b6-bb15371535ce {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:53:53 devstack sudo[112682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-a83eaa93-b6be-408e-9aaa-3d7c742db983.info Aug 03 08:53:53 devstack sudo[112682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:53:53 devstack sudo[112684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-9143315a-67be-4bc8-b7b6-bb15371535ce Aug 03 08:53:53 devstack sudo[112684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:53:53 devstack sudo[112680]: pam_unix(sudo:session): session closed for user root Aug 03 08:53:53 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-f55595c4-cdec-4d9c-8c0a-a9b024b28044 tempest-VolumeDependencyTests-1512358985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-7a8ead30-8de5-46a9-a84e-9425b673c7c3" returned: 0 in 0.288s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:53:53 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-f55595c4-cdec-4d9c-8c0a-a9b024b28044 tempest-VolumeDependencyTests-1512358985 None] Lock "cinder-quobyte-7a8ead30-8de5-46a9-a84e-9425b673c7c3" released by "delete_volume" :: held 0.864s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:53:53 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-44d6938e-b35a-471b-974d-68efe4a2bcfb tempest-VolumeImageDependencyTests-942168115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-a83eaa93-b6be-408e-9aaa-3d7c742db983.info" returned: 0 in 0.248s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:53:53 devstack sudo[112682]: pam_unix(sudo:session): session closed for user root Aug 03 08:53:53 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-44d6938e-b35a-471b-974d-68efe4a2bcfb tempest-VolumeImageDependencyTests-942168115 None] Acquiring lock "cinder-quobyte-bcc51603-5d44-4976-8687-6838b41be60a" by "_copy_volume_from_snapshot" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:53:53 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-44d6938e-b35a-471b-974d-68efe4a2bcfb tempest-VolumeImageDependencyTests-942168115 None] Lock "cinder-quobyte-bcc51603-5d44-4976-8687-6838b41be60a" acquired by "_copy_volume_from_snapshot" :: waited 0.022s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:53:53 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-44d6938e-b35a-471b-974d-68efe4a2bcfb tempest-VolumeImageDependencyTests-942168115 None] snapshot: 501f28a3-a34b-4561-8bee-4064088eac66, volume: bcc51603-5d44-4976-8687-6838b41be60a, {{(pid=88899) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Aug 03 08:53:53 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-44d6938e-b35a-471b-974d-68efe4a2bcfb tempest-VolumeImageDependencyTests-942168115 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:53:53 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-44d6938e-b35a-471b-974d-68efe4a2bcfb tempest-VolumeImageDependencyTests-942168115 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:53:53 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-44d6938e-b35a-471b-974d-68efe4a2bcfb tempest-VolumeImageDependencyTests-942168115 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:53:53 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-44d6938e-b35a-471b-974d-68efe4a2bcfb tempest-VolumeImageDependencyTests-942168115 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:53:53 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-44d6938e-b35a-471b-974d-68efe4a2bcfb tempest-VolumeImageDependencyTests-942168115 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:53:53 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2a3b11d-175e-4c22-8ca9-14d986bef383]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:53:53 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-44d6938e-b35a-471b-974d-68efe4a2bcfb tempest-VolumeImageDependencyTests-942168115 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-a83eaa93-b6be-408e-9aaa-3d7c742db983.501f28a3-a34b-4561-8bee-4064088eac66 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:53:53 devstack cinder-volume[88899]: DEBUG cinder.quota [None req-f55595c4-cdec-4d9c-8c0a-a9b024b28044 tempest-VolumeDependencyTests-1512358985 None] Created reservations ['f4b288bd-6ebc-4afd-af93-0a0f4bd30f8b', '6a4f4a77-fad7-4c96-a0af-287e6b3968cc', 'e165d991-c364-4bcf-a784-7b0d36a95eea', '78eb7a36-20f7-4900-be8c-5740e8050916'] {{(pid=88899) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 08:53:53 devstack sudo[112684]: pam_unix(sudo:session): session closed for user root Aug 03 08:53:53 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-6ae61ac0-5766-4624-9fb0-ed1891dc7266 tempest-ProjectMemberTests-1353074417 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-9143315a-67be-4bc8-b7b6-bb15371535ce" returned: 0 in 0.377s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:53:53 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-6ae61ac0-5766-4624-9fb0-ed1891dc7266 tempest-ProjectMemberTests-1353074417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-9143315a-67be-4bc8-b7b6-bb15371535ce {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:53:53 devstack sudo[112692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-9143315a-67be-4bc8-b7b6-bb15371535ce Aug 03 08:53:53 devstack sudo[112692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:53:53 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-f55595c4-cdec-4d9c-8c0a-a9b024b28044 tempest-VolumeDependencyTests-1512358985 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:53:53 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-f55595c4-cdec-4d9c-8c0a-a9b024b28044 tempest-VolumeDependencyTests-1512358985 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:53:53 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-f55595c4-cdec-4d9c-8c0a-a9b024b28044 tempest-VolumeDependencyTests-1512358985 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:53:53 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-f55595c4-cdec-4d9c-8c0a-a9b024b28044 tempest-VolumeDependencyTests-1512358985 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:53:53 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-f55595c4-cdec-4d9c-8c0a-a9b024b28044 tempest-VolumeDependencyTests-1512358985 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:53:53 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-f55595c4-cdec-4d9c-8c0a-a9b024b28044 tempest-VolumeDependencyTests-1512358985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:53:53 devstack sudo[112690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-a83eaa93-b6be-408e-9aaa-3d7c742db983.501f28a3-a34b-4561-8bee-4064088eac66 Aug 03 08:53:53 devstack sudo[112690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:53:53 devstack sudo[112694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a Aug 03 08:53:53 devstack sudo[112694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:53:53 devstack sudo[112692]: pam_unix(sudo:session): session closed for user root Aug 03 08:53:53 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-6ae61ac0-5766-4624-9fb0-ed1891dc7266 tempest-ProjectMemberTests-1353074417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-9143315a-67be-4bc8-b7b6-bb15371535ce" returned: 0 in 0.285s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:53:53 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-6ae61ac0-5766-4624-9fb0-ed1891dc7266 tempest-ProjectMemberTests-1353074417 None] Lock "cinder-quobyte-9143315a-67be-4bc8-b7b6-bb15371535ce" released by "delete_volume" :: held 0.742s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:53:53 devstack sudo[112694]: pam_unix(sudo:session): session closed for user root Aug 03 08:53:53 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-f55595c4-cdec-4d9c-8c0a-a9b024b28044 tempest-VolumeDependencyTests-1512358985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a" returned: 0 in 0.283s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:53:53 devstack cinder-volume[88899]: DEBUG cinder.manager [None req-f55595c4-cdec-4d9c-8c0a-a9b024b28044 tempest-VolumeDependencyTests-1512358985 None] Notifying Schedulers of capabilities ... {{(pid=88899) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 08:53:53 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-f55595c4-cdec-4d9c-8c0a-a9b024b28044 tempest-VolumeDependencyTests-1512358985 None] Deleted volume successfully. Aug 03 08:53:53 devstack sudo[112690]: pam_unix(sudo:session): session closed for user root Aug 03 08:53:53 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-44d6938e-b35a-471b-974d-68efe4a2bcfb tempest-VolumeImageDependencyTests-942168115 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-a83eaa93-b6be-408e-9aaa-3d7c742db983.501f28a3-a34b-4561-8bee-4064088eac66" returned: 0 in 0.427s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:53:53 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-44d6938e-b35a-471b-974d-68efe4a2bcfb tempest-VolumeImageDependencyTests-942168115 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a83eaa93-b6be-408e-9aaa-3d7c742db983(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88899) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 03 08:53:53 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[359f1a45-aca0-43e1-96c4-8a961bb5e2e2]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:53:54 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-44d6938e-b35a-471b-974d-68efe4a2bcfb tempest-VolumeImageDependencyTests-942168115 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-a83eaa93-b6be-408e-9aaa-3d7c742db983 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:53:54 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-f55595c4-cdec-4d9c-8c0a-a9b024b28044 tempest-VolumeDependencyTests-1512358985 None] Lock "cinder-7a8ead30-8de5-46a9-a84e-9425b673c7c3-delete_volume" released by "delete_volume" :: held 1.489s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:53:54 devstack cinder-volume[88899]: DEBUG cinder.quota [None req-6ae61ac0-5766-4624-9fb0-ed1891dc7266 tempest-ProjectMemberTests-1353074417 None] Created reservations ['c4e9850a-e538-41ef-9da7-f45e9f72bfd2', 'ca5a5fce-698d-48e2-8577-4f13e803d485', '2371defd-c0ff-481c-8396-522ce8c88247', 'd23a42fb-b2a4-4047-9e56-014cbaeb34ce'] {{(pid=88899) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 08:53:54 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-6ae61ac0-5766-4624-9fb0-ed1891dc7266 tempest-ProjectMemberTests-1353074417 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:53:54 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-6ae61ac0-5766-4624-9fb0-ed1891dc7266 tempest-ProjectMemberTests-1353074417 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:53:54 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-6ae61ac0-5766-4624-9fb0-ed1891dc7266 tempest-ProjectMemberTests-1353074417 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:53:54 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-6ae61ac0-5766-4624-9fb0-ed1891dc7266 tempest-ProjectMemberTests-1353074417 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:53:54 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-6ae61ac0-5766-4624-9fb0-ed1891dc7266 tempest-ProjectMemberTests-1353074417 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:53:54 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-6ae61ac0-5766-4624-9fb0-ed1891dc7266 tempest-ProjectMemberTests-1353074417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:53:54 devstack sudo[112703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-a83eaa93-b6be-408e-9aaa-3d7c742db983 Aug 03 08:53:54 devstack sudo[112703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:53:54 devstack sudo[112704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a Aug 03 08:53:54 devstack sudo[112704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:53:54 devstack sudo[112704]: pam_unix(sudo:session): session closed for user root Aug 03 08:53:54 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-6ae61ac0-5766-4624-9fb0-ed1891dc7266 tempest-ProjectMemberTests-1353074417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a" returned: 0 in 0.272s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:53:54 devstack cinder-volume[88899]: DEBUG cinder.manager [None req-6ae61ac0-5766-4624-9fb0-ed1891dc7266 tempest-ProjectMemberTests-1353074417 None] Notifying Schedulers of capabilities ... {{(pid=88899) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 08:53:54 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-6ae61ac0-5766-4624-9fb0-ed1891dc7266 tempest-ProjectMemberTests-1353074417 None] Deleted volume successfully. Aug 03 08:53:54 devstack sudo[112703]: pam_unix(sudo:session): session closed for user root Aug 03 08:53:54 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-44d6938e-b35a-471b-974d-68efe4a2bcfb tempest-VolumeImageDependencyTests-942168115 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-a83eaa93-b6be-408e-9aaa-3d7c742db983" returned: 0 in 0.396s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:53:54 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-44d6938e-b35a-471b-974d-68efe4a2bcfb tempest-VolumeImageDependencyTests-942168115 None] will copy from snapshot at /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-a83eaa93-b6be-408e-9aaa-3d7c742db983 {{(pid=88899) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Aug 03 08:53:54 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-44d6938e-b35a-471b-974d-68efe4a2bcfb tempest-VolumeImageDependencyTests-942168115 None] Creating direct copy from snapshot {{(pid=88899) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Aug 03 08:53:54 devstack cinder-volume[88899]: DEBUG cinder.utils [None req-44d6938e-b35a-471b-974d-68efe4a2bcfb tempest-VolumeImageDependencyTests-942168115 None] Path /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-bcc51603-5d44-4976-8687-6838b41be60a not found in is_blk_device check {{(pid=88899) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Aug 03 08:53:54 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-44d6938e-b35a-471b-974d-68efe4a2bcfb tempest-VolumeImageDependencyTests-942168115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-a83eaa93-b6be-408e-9aaa-3d7c742db983 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-bcc51603-5d44-4976-8687-6838b41be60a {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:53:54 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-6ae61ac0-5766-4624-9fb0-ed1891dc7266 tempest-ProjectMemberTests-1353074417 None] Lock "cinder-9143315a-67be-4bc8-b7b6-bb15371535ce-delete_volume" released by "delete_volume" :: held 1.390s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:53:54 devstack sudo[112711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-a83eaa93-b6be-408e-9aaa-3d7c742db983 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-bcc51603-5d44-4976-8687-6838b41be60a Aug 03 08:53:54 devstack sudo[112711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:53:54 devstack cinder-volume[88899]: DEBUG cinder.volume.flows.manager.create_volume [None req-4b7caf0a-9bb9-48fd-bd4c-ebfaf998fb66 tempest-ProjectMemberTests-1353074417 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88899) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 08:53:54 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-4b7caf0a-9bb9-48fd-bd4c-ebfaf998fb66 tempest-ProjectMemberTests-1353074417 None] Flow 'volume_create_manager' (3d8a8452-81e8-43af-aa8e-0ebc86f4b385) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:53:54 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-4b7caf0a-9bb9-48fd-bd4c-ebfaf998fb66 tempest-ProjectMemberTests-1353074417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f2efb35-cace-4d7b-8c6b-5c10000e1d12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:53:54 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-4b7caf0a-9bb9-48fd-bd4c-ebfaf998fb66 tempest-ProjectMemberTests-1353074417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f2efb35-cace-4d7b-8c6b-5c10000e1d12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:53:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1585427518',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8828443b-b670-4f29-9617-cf511c2be24f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b723e915839a4036ad739740ec4db0cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:53:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:53:55Z,use_quota=True,user_id='d9152484679b4fb79b0d8896a2a67eb9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8bde7129-1dc4-42ab-b852-ab32c61b4921),volume_type_id=8bde7129-1dc4-42ab-b852-ab32c61b4921)' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:53:54 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-4b7caf0a-9bb9-48fd-bd4c-ebfaf998fb66 tempest-ProjectMemberTests-1353074417 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c49e696a-6e27-4935-8826-3631e84557d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:53:54 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-4b7caf0a-9bb9-48fd-bd4c-ebfaf998fb66 tempest-ProjectMemberTests-1353074417 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c49e696a-6e27-4935-8826-3631e84557d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:53:54 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-4b7caf0a-9bb9-48fd-bd4c-ebfaf998fb66 tempest-ProjectMemberTests-1353074417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (99e5ecfa-6e7d-4fdf-b850-58495cac1f99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:53:54 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-4b7caf0a-9bb9-48fd-bd4c-ebfaf998fb66 tempest-ProjectMemberTests-1353074417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (99e5ecfa-6e7d-4fdf-b850-58495cac1f99) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8828443b-b670-4f29-9617-cf511c2be24f', 'volume_name': 'volume-8828443b-b670-4f29-9617-cf511c2be24f', 'volume_size': 1}' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:53:54 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-4b7caf0a-9bb9-48fd-bd4c-ebfaf998fb66 tempest-ProjectMemberTests-1353074417 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d72f2a49-b1b3-4bd0-9d21-cccf35bf58e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:53:54 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-4b7caf0a-9bb9-48fd-bd4c-ebfaf998fb66 tempest-ProjectMemberTests-1353074417 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d72f2a49-b1b3-4bd0-9d21-cccf35bf58e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:53:54 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-4b7caf0a-9bb9-48fd-bd4c-ebfaf998fb66 tempest-ProjectMemberTests-1353074417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (91c2a226-7abe-41d1-96e1-1777ae6d047a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:53:54 devstack cinder-volume[88899]: INFO cinder.volume.flows.manager.create_volume [None req-4b7caf0a-9bb9-48fd-bd4c-ebfaf998fb66 tempest-ProjectMemberTests-1353074417 None] Volume 8828443b-b670-4f29-9617-cf511c2be24f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8828443b-b670-4f29-9617-cf511c2be24f', 'volume_size': 1} Aug 03 08:53:54 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-4b7caf0a-9bb9-48fd-bd4c-ebfaf998fb66 tempest-ProjectMemberTests-1353074417 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:53:54 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-bf5d7514-7441-4ee0-87d8-a5da79dfda39 tempest-VolumeDependencyTests-1512358985 None] Acquiring lock "cinder-1b1ea719-0de3-48d6-ab8a-b62a8b3ce570-delete_volume" by "delete_volume" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:53:54 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-bf5d7514-7441-4ee0-87d8-a5da79dfda39 tempest-VolumeDependencyTests-1512358985 None] Lock "cinder-1b1ea719-0de3-48d6-ab8a-b62a8b3ce570-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:53:54 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-bf5d7514-7441-4ee0-87d8-a5da79dfda39 tempest-VolumeDependencyTests-1512358985 None] Acquiring lock "cinder-quobyte-1b1ea719-0de3-48d6-ab8a-b62a8b3ce570" by "delete_volume" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:53:54 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-bf5d7514-7441-4ee0-87d8-a5da79dfda39 tempest-VolumeDependencyTests-1512358985 None] Lock "cinder-quobyte-1b1ea719-0de3-48d6-ab8a-b62a8b3ce570" acquired by "delete_volume" :: waited 0.018s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:53:54 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[d40180f8-dda7-47c4-b0ba-e7f99ce7afab]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:53:54 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-bf5d7514-7441-4ee0-87d8-a5da79dfda39 tempest-VolumeDependencyTests-1512358985 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-1b1ea719-0de3-48d6-ab8a-b62a8b3ce570 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:53:54 devstack sudo[112717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-1b1ea719-0de3-48d6-ab8a-b62a8b3ce570 Aug 03 08:53:54 devstack sudo[112711]: pam_unix(sudo:session): session closed for user root Aug 03 08:53:54 devstack sudo[112717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:53:55 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-44d6938e-b35a-471b-974d-68efe4a2bcfb tempest-VolumeImageDependencyTests-942168115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-a83eaa93-b6be-408e-9aaa-3d7c742db983 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-bcc51603-5d44-4976-8687-6838b41be60a" returned: 0 in 0.595s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:53:55 devstack cinder-volume[88899]: DEBUG cinder.image.image_utils [None req-44d6938e-b35a-471b-974d-68efe4a2bcfb tempest-VolumeImageDependencyTests-942168115 None] Image conversion details: src /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-a83eaa93-b6be-408e-9aaa-3d7c742db983, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-bcc51603-5d44-4976-8687-6838b41be60a {{(pid=88899) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 03 08:53:55 devstack cinder-volume[88899]: INFO cinder.image.image_utils [None req-44d6938e-b35a-471b-974d-68efe4a2bcfb tempest-VolumeImageDependencyTests-942168115 None] Converted 1024.00 MB image at 1024.00 MB/s Aug 03 08:53:55 devstack cinder-volume[88899]: WARNING cinder.volume.drivers.remotefs [None req-44d6938e-b35a-471b-974d-68efe4a2bcfb tempest-VolumeImageDependencyTests-942168115 None] /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-bcc51603-5d44-4976-8687-6838b41be60a is being set with open permissions: ugo+rw Aug 03 08:53:55 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-44d6938e-b35a-471b-974d-68efe4a2bcfb tempest-VolumeImageDependencyTests-942168115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-bcc51603-5d44-4976-8687-6838b41be60a {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:53:55 devstack sudo[112719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-bcc51603-5d44-4976-8687-6838b41be60a Aug 03 08:53:55 devstack sudo[112719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:53:55 devstack sudo[112717]: pam_unix(sudo:session): session closed for user root Aug 03 08:53:55 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-bf5d7514-7441-4ee0-87d8-a5da79dfda39 tempest-VolumeDependencyTests-1512358985 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-1b1ea719-0de3-48d6-ab8a-b62a8b3ce570" returned: 0 in 0.377s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:53:55 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-bf5d7514-7441-4ee0-87d8-a5da79dfda39 tempest-VolumeDependencyTests-1512358985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-1b1ea719-0de3-48d6-ab8a-b62a8b3ce570 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:53:55 devstack sudo[112725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-1b1ea719-0de3-48d6-ab8a-b62a8b3ce570 Aug 03 08:53:55 devstack sudo[112725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:53:55 devstack sudo[112719]: pam_unix(sudo:session): session closed for user root Aug 03 08:53:55 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-44d6938e-b35a-471b-974d-68efe4a2bcfb tempest-VolumeImageDependencyTests-942168115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-bcc51603-5d44-4976-8687-6838b41be60a" returned: 0 in 0.266s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:53:55 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-44d6938e-b35a-471b-974d-68efe4a2bcfb tempest-VolumeImageDependencyTests-942168115 None] Lock "cinder-quobyte-bcc51603-5d44-4976-8687-6838b41be60a" released by "_copy_volume_from_snapshot" :: held 1.755s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:53:55 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-44d6938e-b35a-471b-974d-68efe4a2bcfb tempest-VolumeImageDependencyTests-942168115 None] Acquiring lock "cinder-quobyte-501f28a3-a34b-4561-8bee-4064088eac66" by "_delete_snapshot" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:53:55 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-44d6938e-b35a-471b-974d-68efe4a2bcfb tempest-VolumeImageDependencyTests-942168115 None] Lock "cinder-quobyte-501f28a3-a34b-4561-8bee-4064088eac66" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:53:55 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-44d6938e-b35a-471b-974d-68efe4a2bcfb tempest-VolumeImageDependencyTests-942168115 None] Deleting offline snapshot 501f28a3-a34b-4561-8bee-4064088eac66 of volume a83eaa93-b6be-408e-9aaa-3d7c742db983 {{(pid=88899) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 03 08:53:55 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-44d6938e-b35a-471b-974d-68efe4a2bcfb tempest-VolumeImageDependencyTests-942168115 None] snapshot_file for this snap is: volume-a83eaa93-b6be-408e-9aaa-3d7c742db983.501f28a3-a34b-4561-8bee-4064088eac66 {{(pid=88899) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 03 08:53:55 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[837fceff-ec7b-4e7a-9cf9-69d90fc85732]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:53:55 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-44d6938e-b35a-471b-974d-68efe4a2bcfb tempest-VolumeImageDependencyTests-942168115 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-a83eaa93-b6be-408e-9aaa-3d7c742db983.501f28a3-a34b-4561-8bee-4064088eac66 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:53:55 devstack sudo[112727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-a83eaa93-b6be-408e-9aaa-3d7c742db983.501f28a3-a34b-4561-8bee-4064088eac66 Aug 03 08:53:55 devstack sudo[112727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:53:55 devstack sudo[112725]: pam_unix(sudo:session): session closed for user root Aug 03 08:53:55 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-bf5d7514-7441-4ee0-87d8-a5da79dfda39 tempest-VolumeDependencyTests-1512358985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-1b1ea719-0de3-48d6-ab8a-b62a8b3ce570" returned: 0 in 0.244s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:53:55 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-bf5d7514-7441-4ee0-87d8-a5da79dfda39 tempest-VolumeDependencyTests-1512358985 None] Lock "cinder-quobyte-1b1ea719-0de3-48d6-ab8a-b62a8b3ce570" released by "delete_volume" :: held 0.676s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:53:55 devstack cinder-volume[88899]: DEBUG cinder.quota [None req-bf5d7514-7441-4ee0-87d8-a5da79dfda39 tempest-VolumeDependencyTests-1512358985 None] Created reservations ['60a01d13-fcac-4965-a009-11126b220a94', 'e72f2bd5-2d5d-4b6c-9c7b-ad6e5776b71a', '11774894-abd5-4341-839b-5b9e9771c315', '35a24ae4-28b1-440b-9a5e-169b5646333b'] {{(pid=88899) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 08:53:55 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-bf5d7514-7441-4ee0-87d8-a5da79dfda39 tempest-VolumeDependencyTests-1512358985 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:53:55 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-bf5d7514-7441-4ee0-87d8-a5da79dfda39 tempest-VolumeDependencyTests-1512358985 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:53:55 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-bf5d7514-7441-4ee0-87d8-a5da79dfda39 tempest-VolumeDependencyTests-1512358985 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:53:55 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-bf5d7514-7441-4ee0-87d8-a5da79dfda39 tempest-VolumeDependencyTests-1512358985 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:53:55 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-bf5d7514-7441-4ee0-87d8-a5da79dfda39 tempest-VolumeDependencyTests-1512358985 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:53:55 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-bf5d7514-7441-4ee0-87d8-a5da79dfda39 tempest-VolumeDependencyTests-1512358985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:53:55 devstack sudo[112732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a Aug 03 08:53:55 devstack sudo[112732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:53:55 devstack sudo[112727]: pam_unix(sudo:session): session closed for user root Aug 03 08:53:55 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-44d6938e-b35a-471b-974d-68efe4a2bcfb tempest-VolumeImageDependencyTests-942168115 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-a83eaa93-b6be-408e-9aaa-3d7c742db983.501f28a3-a34b-4561-8bee-4064088eac66" returned: 0 in 0.363s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:53:55 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-44d6938e-b35a-471b-974d-68efe4a2bcfb tempest-VolumeImageDependencyTests-942168115 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a83eaa93-b6be-408e-9aaa-3d7c742db983(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88899) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 03 08:53:55 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e1b39f3-0876-4832-92ef-aed49080ba10]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:53:55 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-44d6938e-b35a-471b-974d-68efe4a2bcfb tempest-VolumeImageDependencyTests-942168115 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-a83eaa93-b6be-408e-9aaa-3d7c742db983 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:53:55 devstack sudo[112735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-a83eaa93-b6be-408e-9aaa-3d7c742db983 Aug 03 08:53:55 devstack sudo[112735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:53:55 devstack sudo[112732]: pam_unix(sudo:session): session closed for user root Aug 03 08:53:55 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-bf5d7514-7441-4ee0-87d8-a5da79dfda39 tempest-VolumeDependencyTests-1512358985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a" returned: 0 in 0.253s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:53:55 devstack cinder-volume[88899]: DEBUG cinder.manager [None req-bf5d7514-7441-4ee0-87d8-a5da79dfda39 tempest-VolumeDependencyTests-1512358985 None] Notifying Schedulers of capabilities ... {{(pid=88899) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 08:53:55 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-bf5d7514-7441-4ee0-87d8-a5da79dfda39 tempest-VolumeDependencyTests-1512358985 None] Deleted volume successfully. Aug 03 08:53:55 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-bf5d7514-7441-4ee0-87d8-a5da79dfda39 tempest-VolumeDependencyTests-1512358985 None] Lock "cinder-1b1ea719-0de3-48d6-ab8a-b62a8b3ce570-delete_volume" released by "delete_volume" :: held 1.151s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:53:55 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-2188fb76-c590-4c57-9da8-6ea2ab59cfa4 tempest-VolumeDependencyTests-1512358985 None] Acquiring lock "cinder-ec448af7-0d13-45ba-9422-d77537c4249c-delete_volume" by "delete_volume" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:53:55 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-2188fb76-c590-4c57-9da8-6ea2ab59cfa4 tempest-VolumeDependencyTests-1512358985 None] Lock "cinder-ec448af7-0d13-45ba-9422-d77537c4249c-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:53:56 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-2188fb76-c590-4c57-9da8-6ea2ab59cfa4 tempest-VolumeDependencyTests-1512358985 None] Acquiring lock "cinder-quobyte-ec448af7-0d13-45ba-9422-d77537c4249c" by "delete_volume" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:53:56 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-2188fb76-c590-4c57-9da8-6ea2ab59cfa4 tempest-VolumeDependencyTests-1512358985 None] Lock "cinder-quobyte-ec448af7-0d13-45ba-9422-d77537c4249c" acquired by "delete_volume" :: waited 0.018s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:53:56 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[be7e82af-50cf-4edb-bb45-7fdd975d182e]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:53:56 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-2188fb76-c590-4c57-9da8-6ea2ab59cfa4 tempest-VolumeDependencyTests-1512358985 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-ec448af7-0d13-45ba-9422-d77537c4249c {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:53:56 devstack sudo[112735]: pam_unix(sudo:session): session closed for user root Aug 03 08:53:56 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-44d6938e-b35a-471b-974d-68efe4a2bcfb tempest-VolumeImageDependencyTests-942168115 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-a83eaa93-b6be-408e-9aaa-3d7c742db983" returned: 0 in 0.442s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:53:56 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-44d6938e-b35a-471b-974d-68efe4a2bcfb tempest-VolumeImageDependencyTests-942168115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-a83eaa93-b6be-408e-9aaa-3d7c742db983.501f28a3-a34b-4561-8bee-4064088eac66 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:53:56 devstack sudo[112740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-ec448af7-0d13-45ba-9422-d77537c4249c Aug 03 08:53:56 devstack sudo[112740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:53:56 devstack sudo[112743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-a83eaa93-b6be-408e-9aaa-3d7c742db983.501f28a3-a34b-4561-8bee-4064088eac66 Aug 03 08:53:56 devstack sudo[112743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:53:56 devstack sudo[112740]: pam_unix(sudo:session): session closed for user root Aug 03 08:53:56 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-2188fb76-c590-4c57-9da8-6ea2ab59cfa4 tempest-VolumeDependencyTests-1512358985 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-ec448af7-0d13-45ba-9422-d77537c4249c" returned: 0 in 0.402s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:53:56 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-2188fb76-c590-4c57-9da8-6ea2ab59cfa4 tempest-VolumeDependencyTests-1512358985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-ec448af7-0d13-45ba-9422-d77537c4249c {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:53:56 devstack sudo[112752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-ec448af7-0d13-45ba-9422-d77537c4249c Aug 03 08:53:56 devstack sudo[112752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:53:56 devstack sudo[112743]: pam_unix(sudo:session): session closed for user root Aug 03 08:53:56 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-44d6938e-b35a-471b-974d-68efe4a2bcfb tempest-VolumeImageDependencyTests-942168115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-a83eaa93-b6be-408e-9aaa-3d7c742db983.501f28a3-a34b-4561-8bee-4064088eac66" returned: 0 in 0.344s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:53:56 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-44d6938e-b35a-471b-974d-68efe4a2bcfb tempest-VolumeImageDependencyTests-942168115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-a83eaa93-b6be-408e-9aaa-3d7c742db983.501f28a3-a34b-4561-8bee-4064088eac66 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:53:56 devstack sudo[112754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-a83eaa93-b6be-408e-9aaa-3d7c742db983.501f28a3-a34b-4561-8bee-4064088eac66 Aug 03 08:53:56 devstack sudo[112754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:53:56 devstack sudo[112752]: pam_unix(sudo:session): session closed for user root Aug 03 08:53:56 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-2188fb76-c590-4c57-9da8-6ea2ab59cfa4 tempest-VolumeDependencyTests-1512358985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-ec448af7-0d13-45ba-9422-d77537c4249c" returned: 0 in 0.283s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:53:56 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-2188fb76-c590-4c57-9da8-6ea2ab59cfa4 tempest-VolumeDependencyTests-1512358985 None] Lock "cinder-quobyte-ec448af7-0d13-45ba-9422-d77537c4249c" released by "delete_volume" :: held 0.730s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:53:56 devstack sudo[112754]: pam_unix(sudo:session): session closed for user root Aug 03 08:53:56 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-44d6938e-b35a-471b-974d-68efe4a2bcfb tempest-VolumeImageDependencyTests-942168115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-a83eaa93-b6be-408e-9aaa-3d7c742db983.501f28a3-a34b-4561-8bee-4064088eac66" returned: 0 in 0.247s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:53:56 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-44d6938e-b35a-471b-974d-68efe4a2bcfb tempest-VolumeImageDependencyTests-942168115 None] Lock "cinder-quobyte-501f28a3-a34b-4561-8bee-4064088eac66" released by "_delete_snapshot" :: held 1.487s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:53:56 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-44d6938e-b35a-471b-974d-68efe4a2bcfb tempest-VolumeImageDependencyTests-942168115 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 5.795s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:53:56 devstack cinder-volume[88899]: DEBUG cinder.volume.volume_utils [None req-44d6938e-b35a-471b-974d-68efe4a2bcfb tempest-VolumeImageDependencyTests-942168115 None] Marking volume bcc51603-5d44-4976-8687-6838b41be60a as bootable. {{(pid=88899) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Aug 03 08:53:56 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-925c6855-84d9-41a3-83b0-6c7bb37fec0f tempest-CreateVolumesFromSourceVolumeTest-1548484331 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.702s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:53:56 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-925c6855-84d9-41a3-83b0-6c7bb37fec0f tempest-CreateVolumesFromSourceVolumeTest-1548484331 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:53:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1755865023',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6801cbde-6fdb-4670-a538-6f836f9c0626,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e5cc9aa0f344c61b55a857dec203137',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:53:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:53:53Z,use_quota=True,user_id='d91b73c2485046e499477b446eb5f731',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8bde7129-1dc4-42ab-b852-ab32c61b4921),volume_type_id=8bde7129-1dc4-42ab-b852-ab32c61b4921)}" {{(pid=88899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 08:53:56 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-925c6855-84d9-41a3-83b0-6c7bb37fec0f tempest-CreateVolumesFromSourceVolumeTest-1548484331 None] Creating volume 6801cbde-6fdb-4670-a538-6f836f9c0626 {{(pid=88899) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 08:53:56 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-925c6855-84d9-41a3-83b0-6c7bb37fec0f tempest-CreateVolumesFromSourceVolumeTest-1548484331 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:53:56 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-925c6855-84d9-41a3-83b0-6c7bb37fec0f tempest-CreateVolumesFromSourceVolumeTest-1548484331 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:53:56 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-925c6855-84d9-41a3-83b0-6c7bb37fec0f tempest-CreateVolumesFromSourceVolumeTest-1548484331 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:53:56 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-925c6855-84d9-41a3-83b0-6c7bb37fec0f tempest-CreateVolumesFromSourceVolumeTest-1548484331 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:53:56 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-925c6855-84d9-41a3-83b0-6c7bb37fec0f tempest-CreateVolumesFromSourceVolumeTest-1548484331 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:53:56 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-925c6855-84d9-41a3-83b0-6c7bb37fec0f tempest-CreateVolumesFromSourceVolumeTest-1548484331 None] Selected osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385 as target Quobyte volume. {{(pid=88899) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 08:53:56 devstack cinder-volume[88899]: INFO cinder.volume.drivers.remotefs [None req-925c6855-84d9-41a3-83b0-6c7bb37fec0f tempest-CreateVolumesFromSourceVolumeTest-1548484331 None] casted to osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385 Aug 03 08:53:56 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-925c6855-84d9-41a3-83b0-6c7bb37fec0f tempest-CreateVolumesFromSourceVolumeTest-1548484331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-6801cbde-6fdb-4670-a538-6f836f9c0626 1073741824 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:53:56 devstack cinder-volume[88899]: DEBUG cinder.quota [None req-2188fb76-c590-4c57-9da8-6ea2ab59cfa4 tempest-VolumeDependencyTests-1512358985 None] Created reservations ['449e68d9-3985-4475-9929-736e833ed380', 'af09cc52-d825-4f5a-bf66-4527dfa5b502', '8335ae31-8bc9-488a-92a3-a0b4bc3fe67b', 'a8cdbd5a-fcb0-4cfa-a41f-69608cae89ce'] {{(pid=88899) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 08:53:56 devstack sudo[112758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-6801cbde-6fdb-4670-a538-6f836f9c0626 1073741824 Aug 03 08:53:56 devstack sudo[112758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:53:56 devstack cinder-volume[88899]: DEBUG cinder.volume.flows.manager.create_volume [None req-44d6938e-b35a-471b-974d-68efe4a2bcfb tempest-VolumeImageDependencyTests-942168115 None] Copying metadata from source volume a83eaa93-b6be-408e-9aaa-3d7c742db983 to bcc51603-5d44-4976-8687-6838b41be60a. {{(pid=88899) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:438}} Aug 03 08:53:56 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-44d6938e-b35a-471b-974d-68efe4a2bcfb tempest-VolumeImageDependencyTests-942168115 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26579265-c7a9-4c4c-8cba-585fd93910b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bcc51603-5d44-4976-8687-6838b41be60a', 'volume_size': 1, 'source_volid': 'a83eaa93-b6be-408e-9aaa-3d7c742db983', 'source_volstatus': 'available'}' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:53:56 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-44d6938e-b35a-471b-974d-68efe4a2bcfb tempest-VolumeImageDependencyTests-942168115 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a8259dc-b4ab-4ac1-9d9c-0b6a0db54e32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:53:56 devstack cinder-volume[88899]: INFO cinder.volume.flows.manager.create_volume [None req-44d6938e-b35a-471b-974d-68efe4a2bcfb tempest-VolumeImageDependencyTests-942168115 None] Volume volume-bcc51603-5d44-4976-8687-6838b41be60a (bcc51603-5d44-4976-8687-6838b41be60a): created successfully Aug 03 08:53:56 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-44d6938e-b35a-471b-974d-68efe4a2bcfb tempest-VolumeImageDependencyTests-942168115 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a8259dc-b4ab-4ac1-9d9c-0b6a0db54e32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:53:56 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-44d6938e-b35a-471b-974d-68efe4a2bcfb tempest-VolumeImageDependencyTests-942168115 None] Flow 'volume_create_manager' (efd3da64-fb82-4e15-86f3-387546168bcf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:53:56 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-2188fb76-c590-4c57-9da8-6ea2ab59cfa4 tempest-VolumeDependencyTests-1512358985 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:53:56 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-2188fb76-c590-4c57-9da8-6ea2ab59cfa4 tempest-VolumeDependencyTests-1512358985 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:53:56 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-2188fb76-c590-4c57-9da8-6ea2ab59cfa4 tempest-VolumeDependencyTests-1512358985 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:53:56 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-2188fb76-c590-4c57-9da8-6ea2ab59cfa4 tempest-VolumeDependencyTests-1512358985 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:53:57 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-2188fb76-c590-4c57-9da8-6ea2ab59cfa4 tempest-VolumeDependencyTests-1512358985 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:53:57 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-2188fb76-c590-4c57-9da8-6ea2ab59cfa4 tempest-VolumeDependencyTests-1512358985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:53:57 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-44d6938e-b35a-471b-974d-68efe4a2bcfb tempest-VolumeImageDependencyTests-942168115 None] Created volume successfully. Aug 03 08:53:57 devstack sudo[112760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a Aug 03 08:53:57 devstack sudo[112760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:53:57 devstack sudo[112760]: pam_unix(sudo:session): session closed for user root Aug 03 08:53:57 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-2188fb76-c590-4c57-9da8-6ea2ab59cfa4 tempest-VolumeDependencyTests-1512358985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a" returned: 0 in 0.354s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:53:57 devstack cinder-volume[88899]: DEBUG cinder.manager [None req-2188fb76-c590-4c57-9da8-6ea2ab59cfa4 tempest-VolumeDependencyTests-1512358985 None] Notifying Schedulers of capabilities ... {{(pid=88899) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 08:53:57 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-2188fb76-c590-4c57-9da8-6ea2ab59cfa4 tempest-VolumeDependencyTests-1512358985 None] Deleted volume successfully. Aug 03 08:53:57 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-2188fb76-c590-4c57-9da8-6ea2ab59cfa4 tempest-VolumeDependencyTests-1512358985 None] Lock "cinder-ec448af7-0d13-45ba-9422-d77537c4249c-delete_volume" released by "delete_volume" :: held 1.452s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:53:57 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-2df717a9-0d99-4d34-95f5-c86e1d293d47 tempest-VolumeImageDependencyTests-942168115 None] Acquiring lock "cinder-a83eaa93-b6be-408e-9aaa-3d7c742db983-delete_volume" by "delete_volume" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:53:57 devstack sudo[112758]: pam_unix(sudo:session): session closed for user root Aug 03 08:53:57 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-925c6855-84d9-41a3-83b0-6c7bb37fec0f tempest-CreateVolumesFromSourceVolumeTest-1548484331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-6801cbde-6fdb-4670-a538-6f836f9c0626 1073741824" returned: 0 in 0.599s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:53:57 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-2df717a9-0d99-4d34-95f5-c86e1d293d47 tempest-VolumeImageDependencyTests-942168115 None] Lock "cinder-a83eaa93-b6be-408e-9aaa-3d7c742db983-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:53:57 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-925c6855-84d9-41a3-83b0-6c7bb37fec0f tempest-CreateVolumesFromSourceVolumeTest-1548484331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-6801cbde-6fdb-4670-a538-6f836f9c0626 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:53:57 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-2df717a9-0d99-4d34-95f5-c86e1d293d47 tempest-VolumeImageDependencyTests-942168115 None] Acquiring lock "cinder-quobyte-a83eaa93-b6be-408e-9aaa-3d7c742db983" by "delete_volume" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:53:57 devstack sudo[112767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-6801cbde-6fdb-4670-a538-6f836f9c0626 Aug 03 08:53:57 devstack sudo[112767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:53:57 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-2df717a9-0d99-4d34-95f5-c86e1d293d47 tempest-VolumeImageDependencyTests-942168115 None] Lock "cinder-quobyte-a83eaa93-b6be-408e-9aaa-3d7c742db983" acquired by "delete_volume" :: waited 0.021s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:53:57 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[89ad7f3c-07da-4aa6-a523-8fcfb7b03ada]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:53:57 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-2df717a9-0d99-4d34-95f5-c86e1d293d47 tempest-VolumeImageDependencyTests-942168115 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-a83eaa93-b6be-408e-9aaa-3d7c742db983 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:53:57 devstack sudo[112769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-a83eaa93-b6be-408e-9aaa-3d7c742db983 Aug 03 08:53:57 devstack sudo[112769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:53:57 devstack cinder-volume[88899]: DEBUG cinder.volume.flows.manager.create_volume [None req-3fce148f-55ae-4746-9610-dcbbbfe39172 tempest-VolumeDependencyTests-1512358985 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88899) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 08:53:57 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-3fce148f-55ae-4746-9610-dcbbbfe39172 tempest-VolumeDependencyTests-1512358985 None] Flow 'volume_create_manager' (1094049a-aac9-4838-a9a8-77179304122a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:53:57 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-3fce148f-55ae-4746-9610-dcbbbfe39172 tempest-VolumeDependencyTests-1512358985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa88d141-a6ed-486b-a6cb-ccc0d92dbfd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:53:57 devstack sudo[112767]: pam_unix(sudo:session): session closed for user root Aug 03 08:53:57 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-925c6855-84d9-41a3-83b0-6c7bb37fec0f tempest-CreateVolumesFromSourceVolumeTest-1548484331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-6801cbde-6fdb-4670-a538-6f836f9c0626" returned: 0 in 0.284s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:53:57 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-925c6855-84d9-41a3-83b0-6c7bb37fec0f tempest-CreateVolumesFromSourceVolumeTest-1548484331 None] <== create_volume: return (948ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'} {{(pid=88899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 08:53:57 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-925c6855-84d9-41a3-83b0-6c7bb37fec0f tempest-CreateVolumesFromSourceVolumeTest-1548484331 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.950s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:53:57 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-4b7caf0a-9bb9-48fd-bd4c-ebfaf998fb66 tempest-ProjectMemberTests-1353074417 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.052s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:53:57 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-4b7caf0a-9bb9-48fd-bd4c-ebfaf998fb66 tempest-ProjectMemberTests-1353074417 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:53:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1585427518',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8828443b-b670-4f29-9617-cf511c2be24f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b723e915839a4036ad739740ec4db0cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:53:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:53:55Z,use_quota=True,user_id='d9152484679b4fb79b0d8896a2a67eb9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8bde7129-1dc4-42ab-b852-ab32c61b4921),volume_type_id=8bde7129-1dc4-42ab-b852-ab32c61b4921)}" {{(pid=88899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 08:53:57 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-4b7caf0a-9bb9-48fd-bd4c-ebfaf998fb66 tempest-ProjectMemberTests-1353074417 None] Creating volume 8828443b-b670-4f29-9617-cf511c2be24f {{(pid=88899) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 08:53:57 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-4b7caf0a-9bb9-48fd-bd4c-ebfaf998fb66 tempest-ProjectMemberTests-1353074417 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:53:57 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-4b7caf0a-9bb9-48fd-bd4c-ebfaf998fb66 tempest-ProjectMemberTests-1353074417 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:53:57 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-4b7caf0a-9bb9-48fd-bd4c-ebfaf998fb66 tempest-ProjectMemberTests-1353074417 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:53:57 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-4b7caf0a-9bb9-48fd-bd4c-ebfaf998fb66 tempest-ProjectMemberTests-1353074417 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:53:57 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-4b7caf0a-9bb9-48fd-bd4c-ebfaf998fb66 tempest-ProjectMemberTests-1353074417 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:53:57 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-4b7caf0a-9bb9-48fd-bd4c-ebfaf998fb66 tempest-ProjectMemberTests-1353074417 None] Selected osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385 as target Quobyte volume. {{(pid=88899) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 08:53:57 devstack cinder-volume[88899]: INFO cinder.volume.drivers.remotefs [None req-4b7caf0a-9bb9-48fd-bd4c-ebfaf998fb66 tempest-ProjectMemberTests-1353074417 None] casted to osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385 Aug 03 08:53:57 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-4b7caf0a-9bb9-48fd-bd4c-ebfaf998fb66 tempest-ProjectMemberTests-1353074417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-8828443b-b670-4f29-9617-cf511c2be24f 1073741824 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:53:57 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-3fce148f-55ae-4746-9610-dcbbbfe39172 tempest-VolumeDependencyTests-1512358985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa88d141-a6ed-486b-a6cb-ccc0d92dbfd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:53:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1303728265',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e65a2b63-8524-45ea-92ab-d4db1c52b46c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d30b387eb9b94bb589dfe04f0d2eac6d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:53:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:53:58Z,use_quota=True,user_id='12ab9b4d5d894d608b06e312639537e8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8bde7129-1dc4-42ab-b852-ab32c61b4921),volume_type_id=8bde7129-1dc4-42ab-b852-ab32c61b4921)' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:53:57 devstack sudo[112772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-8828443b-b670-4f29-9617-cf511c2be24f 1073741824 Aug 03 08:53:57 devstack sudo[112772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:53:57 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-3fce148f-55ae-4746-9610-dcbbbfe39172 tempest-VolumeDependencyTests-1512358985 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10f6ee82-9c29-4d04-9d00-82ba6efc28e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:53:57 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-3fce148f-55ae-4746-9610-dcbbbfe39172 tempest-VolumeDependencyTests-1512358985 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10f6ee82-9c29-4d04-9d00-82ba6efc28e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:53:57 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-3fce148f-55ae-4746-9610-dcbbbfe39172 tempest-VolumeDependencyTests-1512358985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (357e13df-50e7-4b2e-9774-d2badcd94e43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:53:57 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-3fce148f-55ae-4746-9610-dcbbbfe39172 tempest-VolumeDependencyTests-1512358985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (357e13df-50e7-4b2e-9774-d2badcd94e43) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e65a2b63-8524-45ea-92ab-d4db1c52b46c', 'volume_name': 'volume-e65a2b63-8524-45ea-92ab-d4db1c52b46c', 'volume_size': 1}' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:53:57 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-3fce148f-55ae-4746-9610-dcbbbfe39172 tempest-VolumeDependencyTests-1512358985 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec4e4012-15b5-4409-a9b8-2c1f2ab95afd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:53:57 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-3fce148f-55ae-4746-9610-dcbbbfe39172 tempest-VolumeDependencyTests-1512358985 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec4e4012-15b5-4409-a9b8-2c1f2ab95afd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:53:57 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-3fce148f-55ae-4746-9610-dcbbbfe39172 tempest-VolumeDependencyTests-1512358985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8de8e3bf-8708-4ddc-b041-64728e5fe440) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:53:57 devstack cinder-volume[88899]: INFO cinder.volume.flows.manager.create_volume [None req-3fce148f-55ae-4746-9610-dcbbbfe39172 tempest-VolumeDependencyTests-1512358985 None] Volume e65a2b63-8524-45ea-92ab-d4db1c52b46c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e65a2b63-8524-45ea-92ab-d4db1c52b46c', 'volume_size': 1} Aug 03 08:53:57 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-3fce148f-55ae-4746-9610-dcbbbfe39172 tempest-VolumeDependencyTests-1512358985 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:53:57 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-925c6855-84d9-41a3-83b0-6c7bb37fec0f tempest-CreateVolumesFromSourceVolumeTest-1548484331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21bab6be-29e8-47ec-9e5d-a31bb82b5ffc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6801cbde-6fdb-4670-a538-6f836f9c0626', 'volume_size': 1}' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:53:57 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-925c6855-84d9-41a3-83b0-6c7bb37fec0f tempest-CreateVolumesFromSourceVolumeTest-1548484331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (98a14436-dc8e-403d-85ba-88c2f82dcab2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:53:57 devstack cinder-volume[88899]: INFO cinder.volume.flows.manager.create_volume [None req-925c6855-84d9-41a3-83b0-6c7bb37fec0f tempest-CreateVolumesFromSourceVolumeTest-1548484331 None] Volume volume-6801cbde-6fdb-4670-a538-6f836f9c0626 (6801cbde-6fdb-4670-a538-6f836f9c0626): created successfully Aug 03 08:53:57 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-925c6855-84d9-41a3-83b0-6c7bb37fec0f tempest-CreateVolumesFromSourceVolumeTest-1548484331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (98a14436-dc8e-403d-85ba-88c2f82dcab2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:53:57 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-925c6855-84d9-41a3-83b0-6c7bb37fec0f tempest-CreateVolumesFromSourceVolumeTest-1548484331 None] Flow 'volume_create_manager' (b7a09b7d-11d6-469b-87da-abff81b953d8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:53:57 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-925c6855-84d9-41a3-83b0-6c7bb37fec0f tempest-CreateVolumesFromSourceVolumeTest-1548484331 None] Created volume successfully. Aug 03 08:53:58 devstack sudo[112769]: pam_unix(sudo:session): session closed for user root Aug 03 08:53:58 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-2df717a9-0d99-4d34-95f5-c86e1d293d47 tempest-VolumeImageDependencyTests-942168115 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-a83eaa93-b6be-408e-9aaa-3d7c742db983" returned: 0 in 0.410s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:53:58 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-2df717a9-0d99-4d34-95f5-c86e1d293d47 tempest-VolumeImageDependencyTests-942168115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-a83eaa93-b6be-408e-9aaa-3d7c742db983 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:53:58 devstack sudo[112777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-a83eaa93-b6be-408e-9aaa-3d7c742db983 Aug 03 08:53:58 devstack sudo[112777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:53:58 devstack sudo[112777]: pam_unix(sudo:session): session closed for user root Aug 03 08:53:58 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-2df717a9-0d99-4d34-95f5-c86e1d293d47 tempest-VolumeImageDependencyTests-942168115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-a83eaa93-b6be-408e-9aaa-3d7c742db983" returned: 0 in 0.287s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:53:58 devstack sudo[112772]: pam_unix(sudo:session): session closed for user root Aug 03 08:53:58 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-2df717a9-0d99-4d34-95f5-c86e1d293d47 tempest-VolumeImageDependencyTests-942168115 None] Lock "cinder-quobyte-a83eaa93-b6be-408e-9aaa-3d7c742db983" released by "delete_volume" :: held 0.770s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:53:58 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-4b7caf0a-9bb9-48fd-bd4c-ebfaf998fb66 tempest-ProjectMemberTests-1353074417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-8828443b-b670-4f29-9617-cf511c2be24f 1073741824" returned: 0 in 0.505s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:53:58 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-4b7caf0a-9bb9-48fd-bd4c-ebfaf998fb66 tempest-ProjectMemberTests-1353074417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-8828443b-b670-4f29-9617-cf511c2be24f {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:53:58 devstack sudo[112783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-8828443b-b670-4f29-9617-cf511c2be24f Aug 03 08:53:58 devstack sudo[112783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:53:58 devstack cinder-volume[88899]: DEBUG cinder.quota [None req-2df717a9-0d99-4d34-95f5-c86e1d293d47 tempest-VolumeImageDependencyTests-942168115 None] Created reservations ['996aca7b-dee2-4354-8082-39a3da9c8aaa', 'da5ea51c-189c-4d59-9e28-6352bf097ad5', 'ac3164d8-fbf3-45f7-90a0-d513ed239655', 'f5f15af4-b71c-487b-ab65-d8393d52adf3'] {{(pid=88899) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 08:53:58 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-2df717a9-0d99-4d34-95f5-c86e1d293d47 tempest-VolumeImageDependencyTests-942168115 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:53:58 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-2df717a9-0d99-4d34-95f5-c86e1d293d47 tempest-VolumeImageDependencyTests-942168115 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:53:58 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-2df717a9-0d99-4d34-95f5-c86e1d293d47 tempest-VolumeImageDependencyTests-942168115 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:53:58 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-2df717a9-0d99-4d34-95f5-c86e1d293d47 tempest-VolumeImageDependencyTests-942168115 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:53:58 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-2df717a9-0d99-4d34-95f5-c86e1d293d47 tempest-VolumeImageDependencyTests-942168115 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:53:58 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-2df717a9-0d99-4d34-95f5-c86e1d293d47 tempest-VolumeImageDependencyTests-942168115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:53:58 devstack sudo[112786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a Aug 03 08:53:58 devstack sudo[112786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:53:58 devstack sudo[112783]: pam_unix(sudo:session): session closed for user root Aug 03 08:53:58 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-4b7caf0a-9bb9-48fd-bd4c-ebfaf998fb66 tempest-ProjectMemberTests-1353074417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-8828443b-b670-4f29-9617-cf511c2be24f" returned: 0 in 0.404s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:53:58 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-4b7caf0a-9bb9-48fd-bd4c-ebfaf998fb66 tempest-ProjectMemberTests-1353074417 None] <== create_volume: return (968ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'} {{(pid=88899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 08:53:58 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-4b7caf0a-9bb9-48fd-bd4c-ebfaf998fb66 tempest-ProjectMemberTests-1353074417 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.974s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:53:58 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-3fce148f-55ae-4746-9610-dcbbbfe39172 tempest-VolumeDependencyTests-1512358985 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.921s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:53:58 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-3fce148f-55ae-4746-9610-dcbbbfe39172 tempest-VolumeDependencyTests-1512358985 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:53:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1303728265',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e65a2b63-8524-45ea-92ab-d4db1c52b46c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d30b387eb9b94bb589dfe04f0d2eac6d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:53:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:53:58Z,use_quota=True,user_id='12ab9b4d5d894d608b06e312639537e8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8bde7129-1dc4-42ab-b852-ab32c61b4921),volume_type_id=8bde7129-1dc4-42ab-b852-ab32c61b4921)}" {{(pid=88899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 08:53:58 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-3fce148f-55ae-4746-9610-dcbbbfe39172 tempest-VolumeDependencyTests-1512358985 None] Creating volume e65a2b63-8524-45ea-92ab-d4db1c52b46c {{(pid=88899) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 08:53:58 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-3fce148f-55ae-4746-9610-dcbbbfe39172 tempest-VolumeDependencyTests-1512358985 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:53:58 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-3fce148f-55ae-4746-9610-dcbbbfe39172 tempest-VolumeDependencyTests-1512358985 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:53:58 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-3fce148f-55ae-4746-9610-dcbbbfe39172 tempest-VolumeDependencyTests-1512358985 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:53:58 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-3fce148f-55ae-4746-9610-dcbbbfe39172 tempest-VolumeDependencyTests-1512358985 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:53:58 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-3fce148f-55ae-4746-9610-dcbbbfe39172 tempest-VolumeDependencyTests-1512358985 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:53:58 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-3fce148f-55ae-4746-9610-dcbbbfe39172 tempest-VolumeDependencyTests-1512358985 None] Selected osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385 as target Quobyte volume. {{(pid=88899) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 08:53:58 devstack cinder-volume[88899]: INFO cinder.volume.drivers.remotefs [None req-3fce148f-55ae-4746-9610-dcbbbfe39172 tempest-VolumeDependencyTests-1512358985 None] casted to osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385 Aug 03 08:53:58 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-3fce148f-55ae-4746-9610-dcbbbfe39172 tempest-VolumeDependencyTests-1512358985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-e65a2b63-8524-45ea-92ab-d4db1c52b46c 1073741824 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:53:58 devstack sudo[112791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-e65a2b63-8524-45ea-92ab-d4db1c52b46c 1073741824 Aug 03 08:53:58 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-4b7caf0a-9bb9-48fd-bd4c-ebfaf998fb66 tempest-ProjectMemberTests-1353074417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (91c2a226-7abe-41d1-96e1-1777ae6d047a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8828443b-b670-4f29-9617-cf511c2be24f', 'volume_size': 1}' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:53:58 devstack sudo[112791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:53:58 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-4b7caf0a-9bb9-48fd-bd4c-ebfaf998fb66 tempest-ProjectMemberTests-1353074417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7dd454f-973f-4064-a8dd-9932c4faa597) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:53:58 devstack cinder-volume[88899]: INFO cinder.volume.flows.manager.create_volume [None req-4b7caf0a-9bb9-48fd-bd4c-ebfaf998fb66 tempest-ProjectMemberTests-1353074417 None] Volume volume-8828443b-b670-4f29-9617-cf511c2be24f (8828443b-b670-4f29-9617-cf511c2be24f): created successfully Aug 03 08:53:58 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-4b7caf0a-9bb9-48fd-bd4c-ebfaf998fb66 tempest-ProjectMemberTests-1353074417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7dd454f-973f-4064-a8dd-9932c4faa597) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:53:58 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-4b7caf0a-9bb9-48fd-bd4c-ebfaf998fb66 tempest-ProjectMemberTests-1353074417 None] Flow 'volume_create_manager' (3d8a8452-81e8-43af-aa8e-0ebc86f4b385) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:53:58 devstack sudo[112786]: pam_unix(sudo:session): session closed for user root Aug 03 08:53:58 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-2df717a9-0d99-4d34-95f5-c86e1d293d47 tempest-VolumeImageDependencyTests-942168115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a" returned: 0 in 0.470s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:53:58 devstack cinder-volume[88899]: DEBUG cinder.manager [None req-2df717a9-0d99-4d34-95f5-c86e1d293d47 tempest-VolumeImageDependencyTests-942168115 None] Notifying Schedulers of capabilities ... {{(pid=88899) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 08:53:58 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-4b7caf0a-9bb9-48fd-bd4c-ebfaf998fb66 tempest-ProjectMemberTests-1353074417 None] Created volume successfully. Aug 03 08:53:58 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-2df717a9-0d99-4d34-95f5-c86e1d293d47 tempest-VolumeImageDependencyTests-942168115 None] Deleted volume successfully. Aug 03 08:53:59 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-2df717a9-0d99-4d34-95f5-c86e1d293d47 tempest-VolumeImageDependencyTests-942168115 None] Lock "cinder-a83eaa93-b6be-408e-9aaa-3d7c742db983-delete_volume" released by "delete_volume" :: held 1.566s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:53:59 devstack cinder-volume[88899]: DEBUG cinder.volume.flows.manager.create_volume [None req-52f7c404-71da-4d95-9c59-88cce659556b tempest-CreateVolumesFromSourceVolumeTest-1548484331 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88899) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 08:53:59 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-52f7c404-71da-4d95-9c59-88cce659556b tempest-CreateVolumesFromSourceVolumeTest-1548484331 None] Flow 'volume_create_manager' (e0ac6c45-5c88-4add-bda9-55c64d1b1ae6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:53:59 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-52f7c404-71da-4d95-9c59-88cce659556b tempest-CreateVolumesFromSourceVolumeTest-1548484331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d9447435-2ae5-4460-94bc-8c2657ac4430) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:53:59 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-52f7c404-71da-4d95-9c59-88cce659556b tempest-CreateVolumesFromSourceVolumeTest-1548484331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d9447435-2ae5-4460-94bc-8c2657ac4430) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:53:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-428676578',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bedf4025-37c4-48e1-9263-68cdfa19f915,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e5cc9aa0f344c61b55a857dec203137',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:53:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:53:59Z,use_quota=True,user_id='d91b73c2485046e499477b446eb5f731',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8bde7129-1dc4-42ab-b852-ab32c61b4921),volume_type_id=8bde7129-1dc4-42ab-b852-ab32c61b4921)' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:53:59 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-52f7c404-71da-4d95-9c59-88cce659556b tempest-CreateVolumesFromSourceVolumeTest-1548484331 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3cf505e5-d414-4012-9391-32dea4c89f8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:53:59 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-52f7c404-71da-4d95-9c59-88cce659556b tempest-CreateVolumesFromSourceVolumeTest-1548484331 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3cf505e5-d414-4012-9391-32dea4c89f8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:53:59 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-52f7c404-71da-4d95-9c59-88cce659556b tempest-CreateVolumesFromSourceVolumeTest-1548484331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9fa2e71d-a4cf-4074-8775-186eab1c708f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:53:59 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-52f7c404-71da-4d95-9c59-88cce659556b tempest-CreateVolumesFromSourceVolumeTest-1548484331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9fa2e71d-a4cf-4074-8775-186eab1c708f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bedf4025-37c4-48e1-9263-68cdfa19f915', 'volume_name': 'volume-bedf4025-37c4-48e1-9263-68cdfa19f915', 'volume_size': 1}' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:53:59 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-52f7c404-71da-4d95-9c59-88cce659556b tempest-CreateVolumesFromSourceVolumeTest-1548484331 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df9bb50f-e306-4917-9d7d-935f3046e5a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:53:59 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-52f7c404-71da-4d95-9c59-88cce659556b tempest-CreateVolumesFromSourceVolumeTest-1548484331 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df9bb50f-e306-4917-9d7d-935f3046e5a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:53:59 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-52f7c404-71da-4d95-9c59-88cce659556b tempest-CreateVolumesFromSourceVolumeTest-1548484331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb72ce5f-f4e5-4cc1-8f4a-24d678245f69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:53:59 devstack cinder-volume[88899]: INFO cinder.volume.flows.manager.create_volume [None req-52f7c404-71da-4d95-9c59-88cce659556b tempest-CreateVolumesFromSourceVolumeTest-1548484331 None] Volume bedf4025-37c4-48e1-9263-68cdfa19f915: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bedf4025-37c4-48e1-9263-68cdfa19f915', 'volume_size': 1} Aug 03 08:53:59 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-52f7c404-71da-4d95-9c59-88cce659556b tempest-CreateVolumesFromSourceVolumeTest-1548484331 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:53:59 devstack sudo[112791]: pam_unix(sudo:session): session closed for user root Aug 03 08:53:59 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-3fce148f-55ae-4746-9610-dcbbbfe39172 tempest-VolumeDependencyTests-1512358985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-e65a2b63-8524-45ea-92ab-d4db1c52b46c 1073741824" returned: 0 in 0.692s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:53:59 devstack cinder-volume[88899]: DEBUG cinder.volume.flows.manager.create_volume [None req-9d1e6fb9-5121-4531-8e6c-bf46bb22cbb0 tempest-CreateVolumesFromSourceVolumeTest-1548484331 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88899) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 08:53:59 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-9d1e6fb9-5121-4531-8e6c-bf46bb22cbb0 tempest-CreateVolumesFromSourceVolumeTest-1548484331 None] Flow 'volume_create_manager' (057320f9-0bf0-4920-ad00-5f6e7b1766d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:53:59 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-9d1e6fb9-5121-4531-8e6c-bf46bb22cbb0 tempest-CreateVolumesFromSourceVolumeTest-1548484331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3546b0c-86d9-48a7-bb9d-10d0c72e0cf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:53:59 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-3fce148f-55ae-4746-9610-dcbbbfe39172 tempest-VolumeDependencyTests-1512358985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-e65a2b63-8524-45ea-92ab-d4db1c52b46c {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:53:59 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-9d1e6fb9-5121-4531-8e6c-bf46bb22cbb0 tempest-CreateVolumesFromSourceVolumeTest-1548484331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3546b0c-86d9-48a7-bb9d-10d0c72e0cf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:53:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-875861294',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=15d2e866-debf-430f-9423-331ff6e83fe8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e5cc9aa0f344c61b55a857dec203137',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:54:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:54:00Z,use_quota=True,user_id='d91b73c2485046e499477b446eb5f731',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8bde7129-1dc4-42ab-b852-ab32c61b4921),volume_type_id=8bde7129-1dc4-42ab-b852-ab32c61b4921)' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:53:59 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-9d1e6fb9-5121-4531-8e6c-bf46bb22cbb0 tempest-CreateVolumesFromSourceVolumeTest-1548484331 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43f2fd4f-c931-4498-99af-28c9b8020d1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:53:59 devstack sudo[112797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-e65a2b63-8524-45ea-92ab-d4db1c52b46c Aug 03 08:53:59 devstack sudo[112797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:53:59 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-9d1e6fb9-5121-4531-8e6c-bf46bb22cbb0 tempest-CreateVolumesFromSourceVolumeTest-1548484331 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43f2fd4f-c931-4498-99af-28c9b8020d1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:53:59 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-9d1e6fb9-5121-4531-8e6c-bf46bb22cbb0 tempest-CreateVolumesFromSourceVolumeTest-1548484331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d46e5967-6aa5-46d8-8244-6798ccc29da3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:53:59 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-9d1e6fb9-5121-4531-8e6c-bf46bb22cbb0 tempest-CreateVolumesFromSourceVolumeTest-1548484331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d46e5967-6aa5-46d8-8244-6798ccc29da3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '15d2e866-debf-430f-9423-331ff6e83fe8', 'volume_name': 'volume-15d2e866-debf-430f-9423-331ff6e83fe8', 'volume_size': 1}' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:53:59 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-9d1e6fb9-5121-4531-8e6c-bf46bb22cbb0 tempest-CreateVolumesFromSourceVolumeTest-1548484331 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce871a8d-b38b-4e3a-ae17-9cc003f54b1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:53:59 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-9d1e6fb9-5121-4531-8e6c-bf46bb22cbb0 tempest-CreateVolumesFromSourceVolumeTest-1548484331 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce871a8d-b38b-4e3a-ae17-9cc003f54b1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:53:59 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-9d1e6fb9-5121-4531-8e6c-bf46bb22cbb0 tempest-CreateVolumesFromSourceVolumeTest-1548484331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e1e0bdad-0274-4ea8-b253-cf919bf1254e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:53:59 devstack cinder-volume[88899]: INFO cinder.volume.flows.manager.create_volume [None req-9d1e6fb9-5121-4531-8e6c-bf46bb22cbb0 tempest-CreateVolumesFromSourceVolumeTest-1548484331 None] Volume 15d2e866-debf-430f-9423-331ff6e83fe8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-15d2e866-debf-430f-9423-331ff6e83fe8', 'volume_size': 1} Aug 03 08:53:59 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-9d1e6fb9-5121-4531-8e6c-bf46bb22cbb0 tempest-CreateVolumesFromSourceVolumeTest-1548484331 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:53:59 devstack sudo[112797]: pam_unix(sudo:session): session closed for user root Aug 03 08:53:59 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-3fce148f-55ae-4746-9610-dcbbbfe39172 tempest-VolumeDependencyTests-1512358985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-e65a2b63-8524-45ea-92ab-d4db1c52b46c" returned: 0 in 0.310s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:53:59 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-3fce148f-55ae-4746-9610-dcbbbfe39172 tempest-VolumeDependencyTests-1512358985 None] <== create_volume: return (1128ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'} {{(pid=88899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 08:53:59 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-3fce148f-55ae-4746-9610-dcbbbfe39172 tempest-VolumeDependencyTests-1512358985 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.131s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:53:59 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-52f7c404-71da-4d95-9c59-88cce659556b tempest-CreateVolumesFromSourceVolumeTest-1548484331 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.670s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:53:59 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-52f7c404-71da-4d95-9c59-88cce659556b tempest-CreateVolumesFromSourceVolumeTest-1548484331 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:53:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-428676578',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bedf4025-37c4-48e1-9263-68cdfa19f915,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e5cc9aa0f344c61b55a857dec203137',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:53:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:53:59Z,use_quota=True,user_id='d91b73c2485046e499477b446eb5f731',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8bde7129-1dc4-42ab-b852-ab32c61b4921),volume_type_id=8bde7129-1dc4-42ab-b852-ab32c61b4921)}" {{(pid=88899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 08:53:59 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-52f7c404-71da-4d95-9c59-88cce659556b tempest-CreateVolumesFromSourceVolumeTest-1548484331 None] Creating volume bedf4025-37c4-48e1-9263-68cdfa19f915 {{(pid=88899) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 08:53:59 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-52f7c404-71da-4d95-9c59-88cce659556b tempest-CreateVolumesFromSourceVolumeTest-1548484331 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:53:59 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-52f7c404-71da-4d95-9c59-88cce659556b tempest-CreateVolumesFromSourceVolumeTest-1548484331 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:53:59 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-52f7c404-71da-4d95-9c59-88cce659556b tempest-CreateVolumesFromSourceVolumeTest-1548484331 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:53:59 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-52f7c404-71da-4d95-9c59-88cce659556b tempest-CreateVolumesFromSourceVolumeTest-1548484331 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:53:59 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-52f7c404-71da-4d95-9c59-88cce659556b tempest-CreateVolumesFromSourceVolumeTest-1548484331 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:53:59 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-52f7c404-71da-4d95-9c59-88cce659556b tempest-CreateVolumesFromSourceVolumeTest-1548484331 None] Selected osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385 as target Quobyte volume. {{(pid=88899) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 08:53:59 devstack cinder-volume[88899]: INFO cinder.volume.drivers.remotefs [None req-52f7c404-71da-4d95-9c59-88cce659556b tempest-CreateVolumesFromSourceVolumeTest-1548484331 None] casted to osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385 Aug 03 08:53:59 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-52f7c404-71da-4d95-9c59-88cce659556b tempest-CreateVolumesFromSourceVolumeTest-1548484331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-bedf4025-37c4-48e1-9263-68cdfa19f915 1073741824 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:54:00 devstack sudo[112800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-bedf4025-37c4-48e1-9263-68cdfa19f915 1073741824 Aug 03 08:54:00 devstack sudo[112800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:54:00 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-3fce148f-55ae-4746-9610-dcbbbfe39172 tempest-VolumeDependencyTests-1512358985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8de8e3bf-8708-4ddc-b041-64728e5fe440) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e65a2b63-8524-45ea-92ab-d4db1c52b46c', 'volume_size': 1}' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:54:00 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-3fce148f-55ae-4746-9610-dcbbbfe39172 tempest-VolumeDependencyTests-1512358985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e42cb15-d34b-4eee-b060-37d97ffce500) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:54:00 devstack cinder-volume[88899]: INFO cinder.volume.flows.manager.create_volume [None req-3fce148f-55ae-4746-9610-dcbbbfe39172 tempest-VolumeDependencyTests-1512358985 None] Volume volume-e65a2b63-8524-45ea-92ab-d4db1c52b46c (e65a2b63-8524-45ea-92ab-d4db1c52b46c): created successfully Aug 03 08:54:00 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-3fce148f-55ae-4746-9610-dcbbbfe39172 tempest-VolumeDependencyTests-1512358985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e42cb15-d34b-4eee-b060-37d97ffce500) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:54:00 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-3fce148f-55ae-4746-9610-dcbbbfe39172 tempest-VolumeDependencyTests-1512358985 None] Flow 'volume_create_manager' (1094049a-aac9-4838-a9a8-77179304122a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:54:00 devstack cinder-volume[88899]: DEBUG cinder.volume.flows.manager.create_volume [None req-28ad1db4-6746-49b5-a868-8179edd804cf tempest-CreateVolumesFromSourceVolumeTest-1548484331 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88899) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 08:54:00 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-28ad1db4-6746-49b5-a868-8179edd804cf tempest-CreateVolumesFromSourceVolumeTest-1548484331 None] Flow 'volume_create_manager' (3909e17d-48d7-4dbd-9a97-0675a3e83c6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:54:00 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-28ad1db4-6746-49b5-a868-8179edd804cf tempest-CreateVolumesFromSourceVolumeTest-1548484331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66a53250-912c-45c1-84e9-4dc0586d8660) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:54:00 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-3fce148f-55ae-4746-9610-dcbbbfe39172 tempest-VolumeDependencyTests-1512358985 None] Created volume successfully. Aug 03 08:54:00 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-28ad1db4-6746-49b5-a868-8179edd804cf tempest-CreateVolumesFromSourceVolumeTest-1548484331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66a53250-912c-45c1-84e9-4dc0586d8660) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:54:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-43408535',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fd49bd23-026a-443c-8ddd-5862edc24f9b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e5cc9aa0f344c61b55a857dec203137',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:54:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:54:00Z,use_quota=True,user_id='d91b73c2485046e499477b446eb5f731',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8bde7129-1dc4-42ab-b852-ab32c61b4921),volume_type_id=8bde7129-1dc4-42ab-b852-ab32c61b4921)' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:54:00 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-28ad1db4-6746-49b5-a868-8179edd804cf tempest-CreateVolumesFromSourceVolumeTest-1548484331 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13025ce7-9cff-413a-80b6-95d6c3a90626) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:54:00 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-28ad1db4-6746-49b5-a868-8179edd804cf tempest-CreateVolumesFromSourceVolumeTest-1548484331 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13025ce7-9cff-413a-80b6-95d6c3a90626) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:54:00 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-28ad1db4-6746-49b5-a868-8179edd804cf tempest-CreateVolumesFromSourceVolumeTest-1548484331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1fc9c4f3-5171-485e-9bfd-1ee40a3f621d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:54:00 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-28ad1db4-6746-49b5-a868-8179edd804cf tempest-CreateVolumesFromSourceVolumeTest-1548484331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1fc9c4f3-5171-485e-9bfd-1ee40a3f621d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fd49bd23-026a-443c-8ddd-5862edc24f9b', 'volume_name': 'volume-fd49bd23-026a-443c-8ddd-5862edc24f9b', 'volume_size': 1}' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:54:00 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-28ad1db4-6746-49b5-a868-8179edd804cf tempest-CreateVolumesFromSourceVolumeTest-1548484331 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2bda27c-74fd-43af-b6cb-76cc4e876f83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:54:00 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-28ad1db4-6746-49b5-a868-8179edd804cf tempest-CreateVolumesFromSourceVolumeTest-1548484331 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2bda27c-74fd-43af-b6cb-76cc4e876f83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:54:00 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-28ad1db4-6746-49b5-a868-8179edd804cf tempest-CreateVolumesFromSourceVolumeTest-1548484331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fec4d448-b2e8-4ef6-85ff-7322f57dd4e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:54:00 devstack cinder-volume[88899]: INFO cinder.volume.flows.manager.create_volume [None req-28ad1db4-6746-49b5-a868-8179edd804cf tempest-CreateVolumesFromSourceVolumeTest-1548484331 None] Volume fd49bd23-026a-443c-8ddd-5862edc24f9b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fd49bd23-026a-443c-8ddd-5862edc24f9b', 'volume_size': 1} Aug 03 08:54:00 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-28ad1db4-6746-49b5-a868-8179edd804cf tempest-CreateVolumesFromSourceVolumeTest-1548484331 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:54:00 devstack cinder-volume[88899]: DEBUG dbcounter [-] [88899] Writing DB stats cinder:UPDATE=293,cinder:SELECT=242,cinder:INSERT=93,cinder:DELETE=27 {{(pid=88899) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 03 08:54:00 devstack cinder-volume[88899]: DEBUG cinder.volume.flows.manager.create_volume [None req-b8de01af-6efd-4011-bd2f-ebab9639d75b tempest-CreateVolumesFromSourceVolumeTest-1548484331 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88899) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 08:54:00 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-b8de01af-6efd-4011-bd2f-ebab9639d75b tempest-CreateVolumesFromSourceVolumeTest-1548484331 None] Flow 'volume_create_manager' (1d7de0eb-8c89-4fe0-94e8-8ef3eccbf1de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:54:00 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-b8de01af-6efd-4011-bd2f-ebab9639d75b tempest-CreateVolumesFromSourceVolumeTest-1548484331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (795c27aa-0090-4b15-8926-8df5a7318682) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:54:00 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-a5242fb4-d83c-4da2-aebc-5734acbce34d tempest-ProjectMemberTests-1353074417 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:54:00 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-b8de01af-6efd-4011-bd2f-ebab9639d75b tempest-CreateVolumesFromSourceVolumeTest-1548484331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (795c27aa-0090-4b15-8926-8df5a7318682) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:54:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-922197741',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7eac3fbe-80f8-4616-800d-4c7d85c16e48,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e5cc9aa0f344c61b55a857dec203137',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:54:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:54:01Z,use_quota=True,user_id='d91b73c2485046e499477b446eb5f731',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8bde7129-1dc4-42ab-b852-ab32c61b4921),volume_type_id=8bde7129-1dc4-42ab-b852-ab32c61b4921)' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:54:00 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-b8de01af-6efd-4011-bd2f-ebab9639d75b tempest-CreateVolumesFromSourceVolumeTest-1548484331 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1569e89-556b-4d3f-a4a6-fa80f80fa6cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:54:00 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-b8de01af-6efd-4011-bd2f-ebab9639d75b tempest-CreateVolumesFromSourceVolumeTest-1548484331 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1569e89-556b-4d3f-a4a6-fa80f80fa6cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:54:00 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-b8de01af-6efd-4011-bd2f-ebab9639d75b tempest-CreateVolumesFromSourceVolumeTest-1548484331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e99f14c-25ca-4bca-bb20-dec5f63b89fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:54:00 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-b8de01af-6efd-4011-bd2f-ebab9639d75b tempest-CreateVolumesFromSourceVolumeTest-1548484331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e99f14c-25ca-4bca-bb20-dec5f63b89fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7eac3fbe-80f8-4616-800d-4c7d85c16e48', 'volume_name': 'volume-7eac3fbe-80f8-4616-800d-4c7d85c16e48', 'volume_size': 1}' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:54:00 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-b8de01af-6efd-4011-bd2f-ebab9639d75b tempest-CreateVolumesFromSourceVolumeTest-1548484331 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a22c12c5-07f2-4eac-b314-a0cad382bc47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:54:00 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-b8de01af-6efd-4011-bd2f-ebab9639d75b tempest-CreateVolumesFromSourceVolumeTest-1548484331 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a22c12c5-07f2-4eac-b314-a0cad382bc47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:54:00 devstack sudo[112800]: pam_unix(sudo:session): session closed for user root Aug 03 08:54:00 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-b8de01af-6efd-4011-bd2f-ebab9639d75b tempest-CreateVolumesFromSourceVolumeTest-1548484331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8bd570c1-f666-44da-a4d6-8d13a17a76f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:54:00 devstack cinder-volume[88899]: INFO cinder.volume.flows.manager.create_volume [None req-b8de01af-6efd-4011-bd2f-ebab9639d75b tempest-CreateVolumesFromSourceVolumeTest-1548484331 None] Volume 7eac3fbe-80f8-4616-800d-4c7d85c16e48: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7eac3fbe-80f8-4616-800d-4c7d85c16e48', 'volume_size': 1} Aug 03 08:54:00 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-b8de01af-6efd-4011-bd2f-ebab9639d75b tempest-CreateVolumesFromSourceVolumeTest-1548484331 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:54:00 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-52f7c404-71da-4d95-9c59-88cce659556b tempest-CreateVolumesFromSourceVolumeTest-1548484331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-bedf4025-37c4-48e1-9263-68cdfa19f915 1073741824" returned: 0 in 0.775s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:54:00 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-52f7c404-71da-4d95-9c59-88cce659556b tempest-CreateVolumesFromSourceVolumeTest-1548484331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-bedf4025-37c4-48e1-9263-68cdfa19f915 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:54:00 devstack sudo[112806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-bedf4025-37c4-48e1-9263-68cdfa19f915 Aug 03 08:54:00 devstack sudo[112806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:54:00 devstack cinder-volume[88899]: DEBUG dbcounter [-] [88899] Writing DB stats cinder:SELECT=236,cinder:UPDATE=302,cinder:INSERT=88,cinder:DELETE=25 {{(pid=88899) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 03 08:54:00 devstack cinder-volume[88899]: DEBUG cinder.volume.flows.manager.create_volume [None req-9671f2dd-7537-4fae-bc22-4461929ae3d3 tempest-CreateVolumesFromSourceVolumeTest-1548484331 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88899) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 08:54:00 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-9671f2dd-7537-4fae-bc22-4461929ae3d3 tempest-CreateVolumesFromSourceVolumeTest-1548484331 None] Flow 'volume_create_manager' (a8774669-af12-4c06-ae38-6c7625f98cb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:54:00 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-9671f2dd-7537-4fae-bc22-4461929ae3d3 tempest-CreateVolumesFromSourceVolumeTest-1548484331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac181e34-84c5-4ea7-b96a-cc16dadbfd92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:54:00 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-9671f2dd-7537-4fae-bc22-4461929ae3d3 tempest-CreateVolumesFromSourceVolumeTest-1548484331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac181e34-84c5-4ea7-b96a-cc16dadbfd92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:54:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-538127831',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a90090fa-d5fc-445d-9eaa-26edf997184a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e5cc9aa0f344c61b55a857dec203137',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:54:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:54:01Z,use_quota=True,user_id='d91b73c2485046e499477b446eb5f731',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8bde7129-1dc4-42ab-b852-ab32c61b4921),volume_type_id=8bde7129-1dc4-42ab-b852-ab32c61b4921)' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:54:00 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-9671f2dd-7537-4fae-bc22-4461929ae3d3 tempest-CreateVolumesFromSourceVolumeTest-1548484331 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3b74aeb-53b0-47e4-a747-848bdc3acb4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:54:00 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-9671f2dd-7537-4fae-bc22-4461929ae3d3 tempest-CreateVolumesFromSourceVolumeTest-1548484331 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3b74aeb-53b0-47e4-a747-848bdc3acb4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:54:00 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-9671f2dd-7537-4fae-bc22-4461929ae3d3 tempest-CreateVolumesFromSourceVolumeTest-1548484331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1190e1ba-9727-4b7b-8d94-88b82878fc32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:54:00 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-9671f2dd-7537-4fae-bc22-4461929ae3d3 tempest-CreateVolumesFromSourceVolumeTest-1548484331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1190e1ba-9727-4b7b-8d94-88b82878fc32) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a90090fa-d5fc-445d-9eaa-26edf997184a', 'volume_name': 'volume-a90090fa-d5fc-445d-9eaa-26edf997184a', 'volume_size': 1}' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:54:00 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-9671f2dd-7537-4fae-bc22-4461929ae3d3 tempest-CreateVolumesFromSourceVolumeTest-1548484331 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c319eb5b-6e1c-47f3-916a-ffeae53704f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:54:00 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-9671f2dd-7537-4fae-bc22-4461929ae3d3 tempest-CreateVolumesFromSourceVolumeTest-1548484331 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c319eb5b-6e1c-47f3-916a-ffeae53704f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:54:00 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-9671f2dd-7537-4fae-bc22-4461929ae3d3 tempest-CreateVolumesFromSourceVolumeTest-1548484331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a2ef020-c73b-4b3c-a6b4-d0dfe6062bc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:54:00 devstack cinder-volume[88899]: INFO cinder.volume.flows.manager.create_volume [None req-9671f2dd-7537-4fae-bc22-4461929ae3d3 tempest-CreateVolumesFromSourceVolumeTest-1548484331 None] Volume a90090fa-d5fc-445d-9eaa-26edf997184a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a90090fa-d5fc-445d-9eaa-26edf997184a', 'volume_size': 1} Aug 03 08:54:00 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-9671f2dd-7537-4fae-bc22-4461929ae3d3 tempest-CreateVolumesFromSourceVolumeTest-1548484331 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:54:01 devstack sudo[112806]: pam_unix(sudo:session): session closed for user root Aug 03 08:54:01 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-52f7c404-71da-4d95-9c59-88cce659556b tempest-CreateVolumesFromSourceVolumeTest-1548484331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-bedf4025-37c4-48e1-9263-68cdfa19f915" returned: 0 in 0.269s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:54:01 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-52f7c404-71da-4d95-9c59-88cce659556b tempest-CreateVolumesFromSourceVolumeTest-1548484331 None] <== create_volume: return (1103ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'} {{(pid=88899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 08:54:01 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-52f7c404-71da-4d95-9c59-88cce659556b tempest-CreateVolumesFromSourceVolumeTest-1548484331 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.106s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:54:01 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-9d1e6fb9-5121-4531-8e6c-bf46bb22cbb0 tempest-CreateVolumesFromSourceVolumeTest-1548484331 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.355s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:54:01 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-9d1e6fb9-5121-4531-8e6c-bf46bb22cbb0 tempest-CreateVolumesFromSourceVolumeTest-1548484331 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:53:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-875861294',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=15d2e866-debf-430f-9423-331ff6e83fe8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e5cc9aa0f344c61b55a857dec203137',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:54:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:54:00Z,use_quota=True,user_id='d91b73c2485046e499477b446eb5f731',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8bde7129-1dc4-42ab-b852-ab32c61b4921),volume_type_id=8bde7129-1dc4-42ab-b852-ab32c61b4921)}" {{(pid=88899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 08:54:01 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-9d1e6fb9-5121-4531-8e6c-bf46bb22cbb0 tempest-CreateVolumesFromSourceVolumeTest-1548484331 None] Creating volume 15d2e866-debf-430f-9423-331ff6e83fe8 {{(pid=88899) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 08:54:01 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-9d1e6fb9-5121-4531-8e6c-bf46bb22cbb0 tempest-CreateVolumesFromSourceVolumeTest-1548484331 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:54:01 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-9d1e6fb9-5121-4531-8e6c-bf46bb22cbb0 tempest-CreateVolumesFromSourceVolumeTest-1548484331 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:54:01 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-9d1e6fb9-5121-4531-8e6c-bf46bb22cbb0 tempest-CreateVolumesFromSourceVolumeTest-1548484331 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:54:01 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-9d1e6fb9-5121-4531-8e6c-bf46bb22cbb0 tempest-CreateVolumesFromSourceVolumeTest-1548484331 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:54:01 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-9d1e6fb9-5121-4531-8e6c-bf46bb22cbb0 tempest-CreateVolumesFromSourceVolumeTest-1548484331 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:54:01 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-9d1e6fb9-5121-4531-8e6c-bf46bb22cbb0 tempest-CreateVolumesFromSourceVolumeTest-1548484331 None] Selected osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385 as target Quobyte volume. {{(pid=88899) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 08:54:01 devstack cinder-volume[88899]: INFO cinder.volume.drivers.remotefs [None req-9d1e6fb9-5121-4531-8e6c-bf46bb22cbb0 tempest-CreateVolumesFromSourceVolumeTest-1548484331 None] casted to osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385 Aug 03 08:54:01 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-9d1e6fb9-5121-4531-8e6c-bf46bb22cbb0 tempest-CreateVolumesFromSourceVolumeTest-1548484331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-15d2e866-debf-430f-9423-331ff6e83fe8 1073741824 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:54:01 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-52f7c404-71da-4d95-9c59-88cce659556b tempest-CreateVolumesFromSourceVolumeTest-1548484331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb72ce5f-f4e5-4cc1-8f4a-24d678245f69) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bedf4025-37c4-48e1-9263-68cdfa19f915', 'volume_size': 1}' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:54:01 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-52f7c404-71da-4d95-9c59-88cce659556b tempest-CreateVolumesFromSourceVolumeTest-1548484331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae1905ad-3fa4-44eb-a5cf-6ef0254fc987) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:54:01 devstack sudo[112809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-15d2e866-debf-430f-9423-331ff6e83fe8 1073741824 Aug 03 08:54:01 devstack sudo[112809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:54:01 devstack cinder-volume[88899]: INFO cinder.volume.flows.manager.create_volume [None req-52f7c404-71da-4d95-9c59-88cce659556b tempest-CreateVolumesFromSourceVolumeTest-1548484331 None] Volume volume-bedf4025-37c4-48e1-9263-68cdfa19f915 (bedf4025-37c4-48e1-9263-68cdfa19f915): created successfully Aug 03 08:54:01 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-52f7c404-71da-4d95-9c59-88cce659556b tempest-CreateVolumesFromSourceVolumeTest-1548484331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae1905ad-3fa4-44eb-a5cf-6ef0254fc987) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:54:01 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-52f7c404-71da-4d95-9c59-88cce659556b tempest-CreateVolumesFromSourceVolumeTest-1548484331 None] Flow 'volume_create_manager' (e0ac6c45-5c88-4add-bda9-55c64d1b1ae6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:54:01 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-52f7c404-71da-4d95-9c59-88cce659556b tempest-CreateVolumesFromSourceVolumeTest-1548484331 None] Created volume successfully. Aug 03 08:54:01 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-b0ce1327-ce06-4b66-8266-7924a4027440 tempest-VolumeDependencyTests-1512358985 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:54:01 devstack sudo[112809]: pam_unix(sudo:session): session closed for user root Aug 03 08:54:01 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-9d1e6fb9-5121-4531-8e6c-bf46bb22cbb0 tempest-CreateVolumesFromSourceVolumeTest-1548484331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-15d2e866-debf-430f-9423-331ff6e83fe8 1073741824" returned: 0 in 0.517s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:54:01 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-9d1e6fb9-5121-4531-8e6c-bf46bb22cbb0 tempest-CreateVolumesFromSourceVolumeTest-1548484331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-15d2e866-debf-430f-9423-331ff6e83fe8 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:54:01 devstack sudo[112815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-15d2e866-debf-430f-9423-331ff6e83fe8 Aug 03 08:54:01 devstack sudo[112815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:54:01 devstack sudo[112815]: pam_unix(sudo:session): session closed for user root Aug 03 08:54:01 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-9d1e6fb9-5121-4531-8e6c-bf46bb22cbb0 tempest-CreateVolumesFromSourceVolumeTest-1548484331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-15d2e866-debf-430f-9423-331ff6e83fe8" returned: 0 in 0.256s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:54:01 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-9d1e6fb9-5121-4531-8e6c-bf46bb22cbb0 tempest-CreateVolumesFromSourceVolumeTest-1548484331 None] <== create_volume: return (815ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'} {{(pid=88899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 08:54:01 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-9d1e6fb9-5121-4531-8e6c-bf46bb22cbb0 tempest-CreateVolumesFromSourceVolumeTest-1548484331 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.824s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:54:01 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-28ad1db4-6746-49b5-a868-8179edd804cf tempest-CreateVolumesFromSourceVolumeTest-1548484331 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.630s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:54:01 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-28ad1db4-6746-49b5-a868-8179edd804cf tempest-CreateVolumesFromSourceVolumeTest-1548484331 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:54:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-43408535',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fd49bd23-026a-443c-8ddd-5862edc24f9b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e5cc9aa0f344c61b55a857dec203137',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:54:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:54:00Z,use_quota=True,user_id='d91b73c2485046e499477b446eb5f731',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8bde7129-1dc4-42ab-b852-ab32c61b4921),volume_type_id=8bde7129-1dc4-42ab-b852-ab32c61b4921)}" {{(pid=88899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 08:54:01 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-28ad1db4-6746-49b5-a868-8179edd804cf tempest-CreateVolumesFromSourceVolumeTest-1548484331 None] Creating volume fd49bd23-026a-443c-8ddd-5862edc24f9b {{(pid=88899) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 08:54:01 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-28ad1db4-6746-49b5-a868-8179edd804cf tempest-CreateVolumesFromSourceVolumeTest-1548484331 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:54:01 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-28ad1db4-6746-49b5-a868-8179edd804cf tempest-CreateVolumesFromSourceVolumeTest-1548484331 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:54:01 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-28ad1db4-6746-49b5-a868-8179edd804cf tempest-CreateVolumesFromSourceVolumeTest-1548484331 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:54:01 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-28ad1db4-6746-49b5-a868-8179edd804cf tempest-CreateVolumesFromSourceVolumeTest-1548484331 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:54:01 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-28ad1db4-6746-49b5-a868-8179edd804cf tempest-CreateVolumesFromSourceVolumeTest-1548484331 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:54:01 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-28ad1db4-6746-49b5-a868-8179edd804cf tempest-CreateVolumesFromSourceVolumeTest-1548484331 None] Selected osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385 as target Quobyte volume. {{(pid=88899) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 08:54:01 devstack cinder-volume[88899]: INFO cinder.volume.drivers.remotefs [None req-28ad1db4-6746-49b5-a868-8179edd804cf tempest-CreateVolumesFromSourceVolumeTest-1548484331 None] casted to osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385 Aug 03 08:54:01 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-28ad1db4-6746-49b5-a868-8179edd804cf tempest-CreateVolumesFromSourceVolumeTest-1548484331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-fd49bd23-026a-443c-8ddd-5862edc24f9b 1073741824 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:54:01 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-9d1e6fb9-5121-4531-8e6c-bf46bb22cbb0 tempest-CreateVolumesFromSourceVolumeTest-1548484331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e1e0bdad-0274-4ea8-b253-cf919bf1254e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-15d2e866-debf-430f-9423-331ff6e83fe8', 'volume_size': 1}' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:54:01 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-9d1e6fb9-5121-4531-8e6c-bf46bb22cbb0 tempest-CreateVolumesFromSourceVolumeTest-1548484331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79280288-0362-4a62-b039-dd99a74989e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:54:01 devstack sudo[112818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-fd49bd23-026a-443c-8ddd-5862edc24f9b 1073741824 Aug 03 08:54:01 devstack sudo[112818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:54:01 devstack cinder-volume[88899]: INFO cinder.volume.flows.manager.create_volume [None req-9d1e6fb9-5121-4531-8e6c-bf46bb22cbb0 tempest-CreateVolumesFromSourceVolumeTest-1548484331 None] Volume volume-15d2e866-debf-430f-9423-331ff6e83fe8 (15d2e866-debf-430f-9423-331ff6e83fe8): created successfully Aug 03 08:54:01 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-9d1e6fb9-5121-4531-8e6c-bf46bb22cbb0 tempest-CreateVolumesFromSourceVolumeTest-1548484331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79280288-0362-4a62-b039-dd99a74989e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:54:01 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-9d1e6fb9-5121-4531-8e6c-bf46bb22cbb0 tempest-CreateVolumesFromSourceVolumeTest-1548484331 None] Flow 'volume_create_manager' (057320f9-0bf0-4920-ad00-5f6e7b1766d1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:54:01 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-9d1e6fb9-5121-4531-8e6c-bf46bb22cbb0 tempest-CreateVolumesFromSourceVolumeTest-1548484331 None] Created volume successfully. Aug 03 08:54:02 devstack cinder-volume[88899]: DEBUG cinder.volume.flows.manager.create_volume [None req-728b6264-972b-497b-bd7b-7771a0c1f449 tempest-VolumeImageDependencyTests-942168115 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88899) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 08:54:02 devstack sudo[112818]: pam_unix(sudo:session): session closed for user root Aug 03 08:54:02 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-728b6264-972b-497b-bd7b-7771a0c1f449 tempest-VolumeImageDependencyTests-942168115 None] Flow 'volume_create_manager' (6ca7523d-2ba8-47cd-bb22-636f1e9f5216) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:54:02 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-728b6264-972b-497b-bd7b-7771a0c1f449 tempest-VolumeImageDependencyTests-942168115 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2052279c-b86f-4bd1-b9d0-3d79ef87aa51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:54:02 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-28ad1db4-6746-49b5-a868-8179edd804cf tempest-CreateVolumesFromSourceVolumeTest-1548484331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-fd49bd23-026a-443c-8ddd-5862edc24f9b 1073741824" returned: 0 in 0.520s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:54:02 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-728b6264-972b-497b-bd7b-7771a0c1f449 tempest-VolumeImageDependencyTests-942168115 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2052279c-b86f-4bd1-b9d0-3d79ef87aa51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:54:02Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-teste6050452-06bd-4c7f-9912-45178c83e379',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e91f316-bba8-4ffc-83ee-4a736a9150d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fb20ce3648d1497fb23ac775415e7a44',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:54:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:54:02Z,use_quota=True,user_id='ec19afbca65f4a8185b3231a39404ec7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8bde7129-1dc4-42ab-b852-ab32c61b4921),volume_type_id=8bde7129-1dc4-42ab-b852-ab32c61b4921)' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:54:02 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-728b6264-972b-497b-bd7b-7771a0c1f449 tempest-VolumeImageDependencyTests-942168115 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ba2b419-1d34-4cc1-9d9f-199f44939716) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:54:02 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-728b6264-972b-497b-bd7b-7771a0c1f449 tempest-VolumeImageDependencyTests-942168115 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ba2b419-1d34-4cc1-9d9f-199f44939716) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:54:02 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-728b6264-972b-497b-bd7b-7771a0c1f449 tempest-VolumeImageDependencyTests-942168115 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2e43600-3bfe-437d-a0d6-c60487a25466) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:54:02 devstack cinder-volume[88899]: DEBUG cinder.image.glance [None req-728b6264-972b-497b-bd7b-7771a0c1f449 tempest-VolumeImageDependencyTests-942168115 None] Creating Keystone auth plugin from conf {{(pid=88899) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Aug 03 08:54:02 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-28ad1db4-6746-49b5-a868-8179edd804cf tempest-CreateVolumesFromSourceVolumeTest-1548484331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-fd49bd23-026a-443c-8ddd-5862edc24f9b {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:54:02 devstack sudo[112824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-fd49bd23-026a-443c-8ddd-5862edc24f9b Aug 03 08:54:02 devstack sudo[112824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:54:02 devstack sudo[112824]: pam_unix(sudo:session): session closed for user root Aug 03 08:54:02 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-28ad1db4-6746-49b5-a868-8179edd804cf tempest-CreateVolumesFromSourceVolumeTest-1548484331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-fd49bd23-026a-443c-8ddd-5862edc24f9b" returned: 0 in 0.240s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:54:02 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-28ad1db4-6746-49b5-a868-8179edd804cf tempest-CreateVolumesFromSourceVolumeTest-1548484331 None] <== create_volume: return (826ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'} {{(pid=88899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 08:54:02 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-28ad1db4-6746-49b5-a868-8179edd804cf tempest-CreateVolumesFromSourceVolumeTest-1548484331 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.831s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:54:02 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-a5242fb4-d83c-4da2-aebc-5734acbce34d tempest-ProjectMemberTests-1353074417 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.034s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:54:02 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-28ad1db4-6746-49b5-a868-8179edd804cf tempest-CreateVolumesFromSourceVolumeTest-1548484331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fec4d448-b2e8-4ef6-85ff-7322f57dd4e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fd49bd23-026a-443c-8ddd-5862edc24f9b', 'volume_size': 1}' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:54:02 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-28ad1db4-6746-49b5-a868-8179edd804cf tempest-CreateVolumesFromSourceVolumeTest-1548484331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (14047e7b-459b-4ed3-803e-18c60abea3cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:54:02 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-a5242fb4-d83c-4da2-aebc-5734acbce34d tempest-ProjectMemberTests-1353074417 None] Creating offline snapshot 313cc330-ccf4-4e11-9f1d-c92f480dfe48 of volume 8828443b-b670-4f29-9617-cf511c2be24f {{(pid=88899) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 03 08:54:02 devstack cinder-volume[88899]: INFO cinder.volume.flows.manager.create_volume [None req-28ad1db4-6746-49b5-a868-8179edd804cf tempest-CreateVolumesFromSourceVolumeTest-1548484331 None] Volume volume-fd49bd23-026a-443c-8ddd-5862edc24f9b (fd49bd23-026a-443c-8ddd-5862edc24f9b): created successfully Aug 03 08:54:02 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-28ad1db4-6746-49b5-a868-8179edd804cf tempest-CreateVolumesFromSourceVolumeTest-1548484331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (14047e7b-459b-4ed3-803e-18c60abea3cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:54:02 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-28ad1db4-6746-49b5-a868-8179edd804cf tempest-CreateVolumesFromSourceVolumeTest-1548484331 None] Flow 'volume_create_manager' (3909e17d-48d7-4dbd-9a97-0675a3e83c6c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:54:02 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-728b6264-972b-497b-bd7b-7771a0c1f449 tempest-VolumeImageDependencyTests-942168115 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2e43600-3bfe-437d-a0d6-c60487a25466) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '7e91f316-bba8-4ffc-83ee-4a736a9150d4', 'volume_name': 'volume-7e91f316-bba8-4ffc-83ee-4a736a9150d4', 'volume_size': 1, 'image_id': '4c4d5e27-8270-414b-a3ff-95e222431c09', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4c4d5e27-8270-414b-a3ff-95e222431c09', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-e6050452-06bd-4c7f-9912-45178c83e379', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'd831e5cfdb92a9cb5d0b8f0a554b1972', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'fb20ce3648d1497fb23ac775415e7a44', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'a498ffeeb51b915f557573a9ecfb77bf8e7e4284d6fed070535d7905defab475e8fada0510b1d47d8457cad07f293efa6133d910470e9cec796dd91eb9caf671', 'id': '4c4d5e27-8270-414b-a3ff-95e222431c09', 'created_at': datetime.datetime(2026, 8, 3, 6, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 3, 6, 54, 2, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4c4d5e27-8270-414b-a3ff-95e222431c09/file', 'properties': {}}, 'image_service': }' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:54:02 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-728b6264-972b-497b-bd7b-7771a0c1f449 tempest-VolumeImageDependencyTests-942168115 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c7060430-b65e-4780-b4ab-3c1abf2c5ef0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:54:02 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-728b6264-972b-497b-bd7b-7771a0c1f449 tempest-VolumeImageDependencyTests-942168115 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c7060430-b65e-4780-b4ab-3c1abf2c5ef0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:54:02 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-728b6264-972b-497b-bd7b-7771a0c1f449 tempest-VolumeImageDependencyTests-942168115 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd76db5a-f578-473a-9d0d-827d193cf99d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:54:02 devstack cinder-volume[88899]: INFO cinder.volume.flows.manager.create_volume [None req-728b6264-972b-497b-bd7b-7771a0c1f449 tempest-VolumeImageDependencyTests-942168115 None] Volume 7e91f316-bba8-4ffc-83ee-4a736a9150d4: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-7e91f316-bba8-4ffc-83ee-4a736a9150d4', 'volume_size': 1, 'image_id': '4c4d5e27-8270-414b-a3ff-95e222431c09', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4c4d5e27-8270-414b-a3ff-95e222431c09', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-e6050452-06bd-4c7f-9912-45178c83e379', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'd831e5cfdb92a9cb5d0b8f0a554b1972', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'fb20ce3648d1497fb23ac775415e7a44', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'a498ffeeb51b915f557573a9ecfb77bf8e7e4284d6fed070535d7905defab475e8fada0510b1d47d8457cad07f293efa6133d910470e9cec796dd91eb9caf671', 'id': '4c4d5e27-8270-414b-a3ff-95e222431c09', 'created_at': datetime.datetime(2026, 8, 3, 6, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 3, 6, 54, 2, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4c4d5e27-8270-414b-a3ff-95e222431c09/file', 'properties': {}}, 'image_service': } Aug 03 08:54:02 devstack cinder-volume[88899]: DEBUG cinder.volume.flows.manager.create_volume [None req-728b6264-972b-497b-bd7b-7771a0c1f449 tempest-VolumeImageDependencyTests-942168115 None] Trying to clone 7e91f316-bba8-4ffc-83ee-4a736a9150d4 from image 4c4d5e27-8270-414b-a3ff-95e222431c09 at location (None, [{'url': 'file:///opt/stack/data/glance/images/4c4d5e27-8270-414b-a3ff-95e222431c09', 'metadata': {}}]). {{(pid=88899) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Aug 03 08:54:02 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[63cbdd57-1d73-4bc7-816e-64bebaddf319]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:54:02 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-a5242fb4-d83c-4da2-aebc-5734acbce34d tempest-ProjectMemberTests-1353074417 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-8828443b-b670-4f29-9617-cf511c2be24f {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:54:02 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-28ad1db4-6746-49b5-a868-8179edd804cf tempest-CreateVolumesFromSourceVolumeTest-1548484331 None] Created volume successfully. Aug 03 08:54:02 devstack sudo[112827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-8828443b-b670-4f29-9617-cf511c2be24f Aug 03 08:54:02 devstack sudo[112827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:54:02 devstack cinder-volume[88899]: DEBUG cinder.image.image_utils [None req-728b6264-972b-497b-bd7b-7771a0c1f449 tempest-VolumeImageDependencyTests-942168115 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_4c4d5e27-8270-414b-a3ff-95e222431c09_5ejxal4gdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=88899) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Aug 03 08:54:02 devstack cinder-volume[88899]: INFO cinder.image.image_utils [None req-728b6264-972b-497b-bd7b-7771a0c1f449 tempest-VolumeImageDependencyTests-942168115 None] Image download 0.00 MB at 0.00 MB/s Aug 03 08:54:02 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb5b779f-2539-401f-bccd-0aaf58c83611]: (4, 'raw') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:54:02 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-728b6264-972b-497b-bd7b-7771a0c1f449 tempest-VolumeImageDependencyTests-942168115 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4c4d5e27-8270-414b-a3ff-95e222431c09_5ejxal4gdevstack@QuobyteHD {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:54:03 devstack sudo[112829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4c4d5e27-8270-414b-a3ff-95e222431c09_5ejxal4gdevstack@QuobyteHD Aug 03 08:54:03 devstack sudo[112829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:54:03 devstack sudo[112827]: pam_unix(sudo:session): session closed for user root Aug 03 08:54:03 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-a5242fb4-d83c-4da2-aebc-5734acbce34d tempest-ProjectMemberTests-1353074417 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-8828443b-b670-4f29-9617-cf511c2be24f" returned: 0 in 0.412s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:54:03 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-a5242fb4-d83c-4da2-aebc-5734acbce34d tempest-ProjectMemberTests-1353074417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-8828443b-b670-4f29-9617-cf511c2be24f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-8828443b-b670-4f29-9617-cf511c2be24f.313cc330-ccf4-4e11-9f1d-c92f480dfe48 1G {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:54:03 devstack sudo[112834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-8828443b-b670-4f29-9617-cf511c2be24f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-8828443b-b670-4f29-9617-cf511c2be24f.313cc330-ccf4-4e11-9f1d-c92f480dfe48 1G Aug 03 08:54:03 devstack sudo[112834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:54:03 devstack sudo[112829]: pam_unix(sudo:session): session closed for user root Aug 03 08:54:03 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-728b6264-972b-497b-bd7b-7771a0c1f449 tempest-VolumeImageDependencyTests-942168115 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4c4d5e27-8270-414b-a3ff-95e222431c09_5ejxal4gdevstack@QuobyteHD" returned: 0 in 0.373s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:54:03 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-728b6264-972b-497b-bd7b-7771a0c1f449 tempest-VolumeImageDependencyTests-942168115 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4c4d5e27-8270-414b-a3ff-95e222431c09_5ejxal4gdevstack@QuobyteHD {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:54:03 devstack sudo[112838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4c4d5e27-8270-414b-a3ff-95e222431c09_5ejxal4gdevstack@QuobyteHD Aug 03 08:54:03 devstack sudo[112838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:54:03 devstack sudo[112834]: pam_unix(sudo:session): session closed for user root Aug 03 08:54:03 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-a5242fb4-d83c-4da2-aebc-5734acbce34d tempest-ProjectMemberTests-1353074417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-8828443b-b670-4f29-9617-cf511c2be24f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-8828443b-b670-4f29-9617-cf511c2be24f.313cc330-ccf4-4e11-9f1d-c92f480dfe48 1G" returned: 0 in 0.380s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:54:03 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-a5242fb4-d83c-4da2-aebc-5734acbce34d tempest-ProjectMemberTests-1353074417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8828443b-b670-4f29-9617-cf511c2be24f -F qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-8828443b-b670-4f29-9617-cf511c2be24f.313cc330-ccf4-4e11-9f1d-c92f480dfe48 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:54:03 devstack sudo[112844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8828443b-b670-4f29-9617-cf511c2be24f -F qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-8828443b-b670-4f29-9617-cf511c2be24f.313cc330-ccf4-4e11-9f1d-c92f480dfe48 Aug 03 08:54:03 devstack sudo[112844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:54:03 devstack sudo[112838]: pam_unix(sudo:session): session closed for user root Aug 03 08:54:03 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-728b6264-972b-497b-bd7b-7771a0c1f449 tempest-VolumeImageDependencyTests-942168115 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4c4d5e27-8270-414b-a3ff-95e222431c09_5ejxal4gdevstack@QuobyteHD" returned: 1 in 0.338s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:54:03 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-728b6264-972b-497b-bd7b-7771a0c1f449 tempest-VolumeImageDependencyTests-942168115 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4c4d5e27-8270-414b-a3ff-95e222431c09_5ejxal4gdevstack@QuobyteHD' failed. Not Retrying. {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 03 08:54:03 devstack cinder-volume[88899]: DEBUG cinder.image.image_utils [None req-728b6264-972b-497b-bd7b-7771a0c1f449 tempest-VolumeImageDependencyTests-942168115 None] Temporary image 4c4d5e27-8270-414b-a3ff-95e222431c09 is fetched for user ec19afbca65f4a8185b3231a39404ec7. {{(pid=88899) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Aug 03 08:54:03 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe61fcca-218c-463a-94da-06bd9f072c89]: (4, 'raw') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:54:03 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-728b6264-972b-497b-bd7b-7771a0c1f449 tempest-VolumeImageDependencyTests-942168115 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4c4d5e27-8270-414b-a3ff-95e222431c09_5ejxal4gdevstack@QuobyteHD {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:54:03 devstack sudo[112849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4c4d5e27-8270-414b-a3ff-95e222431c09_5ejxal4gdevstack@QuobyteHD Aug 03 08:54:03 devstack sudo[112849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:54:03 devstack sudo[112844]: pam_unix(sudo:session): session closed for user root Aug 03 08:54:03 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-a5242fb4-d83c-4da2-aebc-5734acbce34d tempest-ProjectMemberTests-1353074417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8828443b-b670-4f29-9617-cf511c2be24f -F qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-8828443b-b670-4f29-9617-cf511c2be24f.313cc330-ccf4-4e11-9f1d-c92f480dfe48" returned: 0 in 0.287s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:54:03 devstack cinder-volume[88899]: WARNING cinder.volume.drivers.remotefs [None req-a5242fb4-d83c-4da2-aebc-5734acbce34d tempest-ProjectMemberTests-1353074417 None] /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-8828443b-b670-4f29-9617-cf511c2be24f.313cc330-ccf4-4e11-9f1d-c92f480dfe48 is being set with open permissions: ugo+rw Aug 03 08:54:03 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-a5242fb4-d83c-4da2-aebc-5734acbce34d tempest-ProjectMemberTests-1353074417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-8828443b-b670-4f29-9617-cf511c2be24f.313cc330-ccf4-4e11-9f1d-c92f480dfe48 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:54:03 devstack sudo[112854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-8828443b-b670-4f29-9617-cf511c2be24f.313cc330-ccf4-4e11-9f1d-c92f480dfe48 Aug 03 08:54:03 devstack sudo[112854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:54:04 devstack sudo[112849]: pam_unix(sudo:session): session closed for user root Aug 03 08:54:04 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-728b6264-972b-497b-bd7b-7771a0c1f449 tempest-VolumeImageDependencyTests-942168115 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4c4d5e27-8270-414b-a3ff-95e222431c09_5ejxal4gdevstack@QuobyteHD" returned: 0 in 0.326s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:54:04 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-728b6264-972b-497b-bd7b-7771a0c1f449 tempest-VolumeImageDependencyTests-942168115 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4c4d5e27-8270-414b-a3ff-95e222431c09_5ejxal4gdevstack@QuobyteHD {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:54:04 devstack sudo[112854]: pam_unix(sudo:session): session closed for user root Aug 03 08:54:04 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-a5242fb4-d83c-4da2-aebc-5734acbce34d tempest-ProjectMemberTests-1353074417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-8828443b-b670-4f29-9617-cf511c2be24f.313cc330-ccf4-4e11-9f1d-c92f480dfe48" returned: 0 in 0.248s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:54:04 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-a5242fb4-d83c-4da2-aebc-5734acbce34d tempest-ProjectMemberTests-1353074417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-8828443b-b670-4f29-9617-cf511c2be24f.info {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:54:04 devstack sudo[112860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-8828443b-b670-4f29-9617-cf511c2be24f.info Aug 03 08:54:04 devstack sudo[112860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:54:04 devstack sudo[112859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4c4d5e27-8270-414b-a3ff-95e222431c09_5ejxal4gdevstack@QuobyteHD Aug 03 08:54:04 devstack sudo[112859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:54:04 devstack sudo[112860]: pam_unix(sudo:session): session closed for user root Aug 03 08:54:04 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-a5242fb4-d83c-4da2-aebc-5734acbce34d tempest-ProjectMemberTests-1353074417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-8828443b-b670-4f29-9617-cf511c2be24f.info" returned: 0 in 0.263s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:54:04 devstack cinder-volume[88899]: WARNING cinder.volume.drivers.remotefs [None req-a5242fb4-d83c-4da2-aebc-5734acbce34d tempest-ProjectMemberTests-1353074417 None] /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-8828443b-b670-4f29-9617-cf511c2be24f.info is being set with open permissions: ugo+rw Aug 03 08:54:04 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-a5242fb4-d83c-4da2-aebc-5734acbce34d tempest-ProjectMemberTests-1353074417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-8828443b-b670-4f29-9617-cf511c2be24f.info {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:54:04 devstack sudo[112859]: pam_unix(sudo:session): session closed for user root Aug 03 08:54:04 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-728b6264-972b-497b-bd7b-7771a0c1f449 tempest-VolumeImageDependencyTests-942168115 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4c4d5e27-8270-414b-a3ff-95e222431c09_5ejxal4gdevstack@QuobyteHD" returned: 1 in 0.338s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:54:04 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-728b6264-972b-497b-bd7b-7771a0c1f449 tempest-VolumeImageDependencyTests-942168115 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4c4d5e27-8270-414b-a3ff-95e222431c09_5ejxal4gdevstack@QuobyteHD' failed. Not Retrying. {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 03 08:54:04 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-728b6264-972b-497b-bd7b-7771a0c1f449 tempest-VolumeImageDependencyTests-942168115 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:54:04 devstack sudo[112867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-8828443b-b670-4f29-9617-cf511c2be24f.info Aug 03 08:54:04 devstack sudo[112867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:54:04 devstack sudo[112867]: pam_unix(sudo:session): session closed for user root Aug 03 08:54:04 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-a5242fb4-d83c-4da2-aebc-5734acbce34d tempest-ProjectMemberTests-1353074417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-8828443b-b670-4f29-9617-cf511c2be24f.info" returned: 0 in 0.235s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:54:04 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-a5242fb4-d83c-4da2-aebc-5734acbce34d tempest-ProjectMemberTests-1353074417 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.965s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:54:04 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-b8de01af-6efd-4011-bd2f-ebab9639d75b tempest-CreateVolumesFromSourceVolumeTest-1548484331 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.946s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:54:04 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-b8de01af-6efd-4011-bd2f-ebab9639d75b tempest-CreateVolumesFromSourceVolumeTest-1548484331 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:54:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-922197741',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7eac3fbe-80f8-4616-800d-4c7d85c16e48,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e5cc9aa0f344c61b55a857dec203137',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:54:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:54:01Z,use_quota=True,user_id='d91b73c2485046e499477b446eb5f731',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8bde7129-1dc4-42ab-b852-ab32c61b4921),volume_type_id=8bde7129-1dc4-42ab-b852-ab32c61b4921)}" {{(pid=88899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 08:54:04 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-b8de01af-6efd-4011-bd2f-ebab9639d75b tempest-CreateVolumesFromSourceVolumeTest-1548484331 None] Creating volume 7eac3fbe-80f8-4616-800d-4c7d85c16e48 {{(pid=88899) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 08:54:04 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-b8de01af-6efd-4011-bd2f-ebab9639d75b tempest-CreateVolumesFromSourceVolumeTest-1548484331 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:54:04 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-b8de01af-6efd-4011-bd2f-ebab9639d75b tempest-CreateVolumesFromSourceVolumeTest-1548484331 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:54:04 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-b8de01af-6efd-4011-bd2f-ebab9639d75b tempest-CreateVolumesFromSourceVolumeTest-1548484331 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:54:04 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-b8de01af-6efd-4011-bd2f-ebab9639d75b tempest-CreateVolumesFromSourceVolumeTest-1548484331 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:54:04 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-b8de01af-6efd-4011-bd2f-ebab9639d75b tempest-CreateVolumesFromSourceVolumeTest-1548484331 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:54:04 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-b8de01af-6efd-4011-bd2f-ebab9639d75b tempest-CreateVolumesFromSourceVolumeTest-1548484331 None] Selected osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385 as target Quobyte volume. {{(pid=88899) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 08:54:04 devstack cinder-volume[88899]: INFO cinder.volume.drivers.remotefs [None req-b8de01af-6efd-4011-bd2f-ebab9639d75b tempest-CreateVolumesFromSourceVolumeTest-1548484331 None] casted to osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385 Aug 03 08:54:04 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-b8de01af-6efd-4011-bd2f-ebab9639d75b tempest-CreateVolumesFromSourceVolumeTest-1548484331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-7eac3fbe-80f8-4616-800d-4c7d85c16e48 1073741824 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:54:04 devstack sudo[112870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-7eac3fbe-80f8-4616-800d-4c7d85c16e48 1073741824 Aug 03 08:54:04 devstack sudo[112870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:54:04 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-a5242fb4-d83c-4da2-aebc-5734acbce34d tempest-ProjectMemberTests-1353074417 None] Create snapshot completed successfully Aug 03 08:54:05 devstack sudo[112870]: pam_unix(sudo:session): session closed for user root Aug 03 08:54:05 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-b8de01af-6efd-4011-bd2f-ebab9639d75b tempest-CreateVolumesFromSourceVolumeTest-1548484331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-7eac3fbe-80f8-4616-800d-4c7d85c16e48 1073741824" returned: 0 in 0.396s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:54:05 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-b8de01af-6efd-4011-bd2f-ebab9639d75b tempest-CreateVolumesFromSourceVolumeTest-1548484331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-7eac3fbe-80f8-4616-800d-4c7d85c16e48 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:54:05 devstack sudo[112875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-7eac3fbe-80f8-4616-800d-4c7d85c16e48 Aug 03 08:54:05 devstack sudo[112875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:54:05 devstack sudo[112875]: pam_unix(sudo:session): session closed for user root Aug 03 08:54:05 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-b8de01af-6efd-4011-bd2f-ebab9639d75b tempest-CreateVolumesFromSourceVolumeTest-1548484331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-7eac3fbe-80f8-4616-800d-4c7d85c16e48" returned: 0 in 0.234s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:54:05 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-b8de01af-6efd-4011-bd2f-ebab9639d75b tempest-CreateVolumesFromSourceVolumeTest-1548484331 None] <== create_volume: return (666ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'} {{(pid=88899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 08:54:05 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-b8de01af-6efd-4011-bd2f-ebab9639d75b tempest-CreateVolumesFromSourceVolumeTest-1548484331 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.670s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:54:05 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-9671f2dd-7537-4fae-bc22-4461929ae3d3 tempest-CreateVolumesFromSourceVolumeTest-1548484331 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.415s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:54:05 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-9671f2dd-7537-4fae-bc22-4461929ae3d3 tempest-CreateVolumesFromSourceVolumeTest-1548484331 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:54:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-538127831',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a90090fa-d5fc-445d-9eaa-26edf997184a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e5cc9aa0f344c61b55a857dec203137',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:54:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:54:01Z,use_quota=True,user_id='d91b73c2485046e499477b446eb5f731',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8bde7129-1dc4-42ab-b852-ab32c61b4921),volume_type_id=8bde7129-1dc4-42ab-b852-ab32c61b4921)}" {{(pid=88899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 08:54:05 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-9671f2dd-7537-4fae-bc22-4461929ae3d3 tempest-CreateVolumesFromSourceVolumeTest-1548484331 None] Creating volume a90090fa-d5fc-445d-9eaa-26edf997184a {{(pid=88899) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 08:54:05 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-9671f2dd-7537-4fae-bc22-4461929ae3d3 tempest-CreateVolumesFromSourceVolumeTest-1548484331 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:54:05 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-9671f2dd-7537-4fae-bc22-4461929ae3d3 tempest-CreateVolumesFromSourceVolumeTest-1548484331 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:54:05 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-9671f2dd-7537-4fae-bc22-4461929ae3d3 tempest-CreateVolumesFromSourceVolumeTest-1548484331 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:54:05 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-9671f2dd-7537-4fae-bc22-4461929ae3d3 tempest-CreateVolumesFromSourceVolumeTest-1548484331 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:54:05 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-9671f2dd-7537-4fae-bc22-4461929ae3d3 tempest-CreateVolumesFromSourceVolumeTest-1548484331 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:54:05 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-9671f2dd-7537-4fae-bc22-4461929ae3d3 tempest-CreateVolumesFromSourceVolumeTest-1548484331 None] Selected osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385 as target Quobyte volume. {{(pid=88899) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 08:54:05 devstack cinder-volume[88899]: INFO cinder.volume.drivers.remotefs [None req-9671f2dd-7537-4fae-bc22-4461929ae3d3 tempest-CreateVolumesFromSourceVolumeTest-1548484331 None] casted to osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385 Aug 03 08:54:05 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-9671f2dd-7537-4fae-bc22-4461929ae3d3 tempest-CreateVolumesFromSourceVolumeTest-1548484331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-a90090fa-d5fc-445d-9eaa-26edf997184a 1073741824 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:54:05 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-b8de01af-6efd-4011-bd2f-ebab9639d75b tempest-CreateVolumesFromSourceVolumeTest-1548484331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8bd570c1-f666-44da-a4d6-8d13a17a76f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7eac3fbe-80f8-4616-800d-4c7d85c16e48', 'volume_size': 1}' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:54:05 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-b8de01af-6efd-4011-bd2f-ebab9639d75b tempest-CreateVolumesFromSourceVolumeTest-1548484331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2eee57ae-8375-4a56-a6a6-00b11b4ddb01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:54:05 devstack sudo[112878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-a90090fa-d5fc-445d-9eaa-26edf997184a 1073741824 Aug 03 08:54:05 devstack sudo[112878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:54:05 devstack cinder-volume[88899]: INFO cinder.volume.flows.manager.create_volume [None req-b8de01af-6efd-4011-bd2f-ebab9639d75b tempest-CreateVolumesFromSourceVolumeTest-1548484331 None] Volume volume-7eac3fbe-80f8-4616-800d-4c7d85c16e48 (7eac3fbe-80f8-4616-800d-4c7d85c16e48): created successfully Aug 03 08:54:05 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-b8de01af-6efd-4011-bd2f-ebab9639d75b tempest-CreateVolumesFromSourceVolumeTest-1548484331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2eee57ae-8375-4a56-a6a6-00b11b4ddb01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:54:05 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-b8de01af-6efd-4011-bd2f-ebab9639d75b tempest-CreateVolumesFromSourceVolumeTest-1548484331 None] Flow 'volume_create_manager' (1d7de0eb-8c89-4fe0-94e8-8ef3eccbf1de) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:54:05 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-b8de01af-6efd-4011-bd2f-ebab9639d75b tempest-CreateVolumesFromSourceVolumeTest-1548484331 None] Created volume successfully. Aug 03 08:54:05 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-051c0041-f158-4296-b2eb-5e6cb5f0ad4d tempest-ProjectMemberTests-1353074417 None] Acquiring lock "cinder-313cc330-ccf4-4e11-9f1d-c92f480dfe48-delete_snapshot" by "delete_snapshot" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:54:05 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-051c0041-f158-4296-b2eb-5e6cb5f0ad4d tempest-ProjectMemberTests-1353074417 None] Lock "cinder-313cc330-ccf4-4e11-9f1d-c92f480dfe48-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:54:05 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-051c0041-f158-4296-b2eb-5e6cb5f0ad4d tempest-ProjectMemberTests-1353074417 None] Acquiring lock "cinder-quobyte-8828443b-b670-4f29-9617-cf511c2be24f" by "delete_snapshot" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:54:05 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-051c0041-f158-4296-b2eb-5e6cb5f0ad4d tempest-ProjectMemberTests-1353074417 None] Lock "cinder-quobyte-8828443b-b670-4f29-9617-cf511c2be24f" acquired by "delete_snapshot" :: waited 0.021s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:54:05 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-051c0041-f158-4296-b2eb-5e6cb5f0ad4d tempest-ProjectMemberTests-1353074417 None] Acquiring lock "cinder-quobyte-313cc330-ccf4-4e11-9f1d-c92f480dfe48" by "_delete_snapshot" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:54:05 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-051c0041-f158-4296-b2eb-5e6cb5f0ad4d tempest-ProjectMemberTests-1353074417 None] Lock "cinder-quobyte-313cc330-ccf4-4e11-9f1d-c92f480dfe48" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:54:05 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-051c0041-f158-4296-b2eb-5e6cb5f0ad4d tempest-ProjectMemberTests-1353074417 None] Deleting offline snapshot 313cc330-ccf4-4e11-9f1d-c92f480dfe48 of volume 8828443b-b670-4f29-9617-cf511c2be24f {{(pid=88899) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 03 08:54:05 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-051c0041-f158-4296-b2eb-5e6cb5f0ad4d tempest-ProjectMemberTests-1353074417 None] snapshot_file for this snap is: volume-8828443b-b670-4f29-9617-cf511c2be24f.313cc330-ccf4-4e11-9f1d-c92f480dfe48 {{(pid=88899) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 03 08:54:05 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[09b1fbd3-5721-40f8-ad89-b5623a19615f]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:54:05 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-051c0041-f158-4296-b2eb-5e6cb5f0ad4d tempest-ProjectMemberTests-1353074417 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-8828443b-b670-4f29-9617-cf511c2be24f.313cc330-ccf4-4e11-9f1d-c92f480dfe48 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:54:05 devstack sudo[112883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-8828443b-b670-4f29-9617-cf511c2be24f.313cc330-ccf4-4e11-9f1d-c92f480dfe48 Aug 03 08:54:05 devstack sudo[112883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:54:05 devstack sudo[112878]: pam_unix(sudo:session): session closed for user root Aug 03 08:54:05 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-9671f2dd-7537-4fae-bc22-4461929ae3d3 tempest-CreateVolumesFromSourceVolumeTest-1548484331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-a90090fa-d5fc-445d-9eaa-26edf997184a 1073741824" returned: 0 in 0.441s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:54:05 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-9671f2dd-7537-4fae-bc22-4461929ae3d3 tempest-CreateVolumesFromSourceVolumeTest-1548484331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-a90090fa-d5fc-445d-9eaa-26edf997184a {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:54:05 devstack sudo[112886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-a90090fa-d5fc-445d-9eaa-26edf997184a Aug 03 08:54:05 devstack sudo[112886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:54:06 devstack sudo[112883]: pam_unix(sudo:session): session closed for user root Aug 03 08:54:06 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-051c0041-f158-4296-b2eb-5e6cb5f0ad4d tempest-ProjectMemberTests-1353074417 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-8828443b-b670-4f29-9617-cf511c2be24f.313cc330-ccf4-4e11-9f1d-c92f480dfe48" returned: 0 in 0.361s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:54:06 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-051c0041-f158-4296-b2eb-5e6cb5f0ad4d tempest-ProjectMemberTests-1353074417 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8828443b-b670-4f29-9617-cf511c2be24f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88899) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 03 08:54:06 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[18ce9218-9ff6-4ab7-bf77-8f99abc92efb]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:54:06 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-051c0041-f158-4296-b2eb-5e6cb5f0ad4d tempest-ProjectMemberTests-1353074417 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-8828443b-b670-4f29-9617-cf511c2be24f {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:54:06 devstack sudo[112886]: pam_unix(sudo:session): session closed for user root Aug 03 08:54:06 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-9671f2dd-7537-4fae-bc22-4461929ae3d3 tempest-CreateVolumesFromSourceVolumeTest-1548484331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-a90090fa-d5fc-445d-9eaa-26edf997184a" returned: 0 in 0.257s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:54:06 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-9671f2dd-7537-4fae-bc22-4461929ae3d3 tempest-CreateVolumesFromSourceVolumeTest-1548484331 None] <== create_volume: return (740ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'} {{(pid=88899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 08:54:06 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-9671f2dd-7537-4fae-bc22-4461929ae3d3 tempest-CreateVolumesFromSourceVolumeTest-1548484331 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.744s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:54:06 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-b0ce1327-ce06-4b66-8266-7924a4027440 tempest-VolumeDependencyTests-1512358985 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 4.757s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:54:06 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-9671f2dd-7537-4fae-bc22-4461929ae3d3 tempest-CreateVolumesFromSourceVolumeTest-1548484331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a2ef020-c73b-4b3c-a6b4-d0dfe6062bc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a90090fa-d5fc-445d-9eaa-26edf997184a', 'volume_size': 1}' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:54:06 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-9671f2dd-7537-4fae-bc22-4461929ae3d3 tempest-CreateVolumesFromSourceVolumeTest-1548484331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d62494c7-1ee2-4dfc-9752-c2253a43bdd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:54:06 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-b0ce1327-ce06-4b66-8266-7924a4027440 tempest-VolumeDependencyTests-1512358985 None] Creating offline snapshot 2516a2a6-9817-4bf8-92c6-7997e16150cd of volume e65a2b63-8524-45ea-92ab-d4db1c52b46c {{(pid=88899) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 03 08:54:06 devstack cinder-volume[88899]: INFO cinder.volume.flows.manager.create_volume [None req-9671f2dd-7537-4fae-bc22-4461929ae3d3 tempest-CreateVolumesFromSourceVolumeTest-1548484331 None] Volume volume-a90090fa-d5fc-445d-9eaa-26edf997184a (a90090fa-d5fc-445d-9eaa-26edf997184a): created successfully Aug 03 08:54:06 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-9671f2dd-7537-4fae-bc22-4461929ae3d3 tempest-CreateVolumesFromSourceVolumeTest-1548484331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d62494c7-1ee2-4dfc-9752-c2253a43bdd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:54:06 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-9671f2dd-7537-4fae-bc22-4461929ae3d3 tempest-CreateVolumesFromSourceVolumeTest-1548484331 None] Flow 'volume_create_manager' (a8774669-af12-4c06-ae38-6c7625f98cb3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:54:06 devstack sudo[112892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-8828443b-b670-4f29-9617-cf511c2be24f Aug 03 08:54:06 devstack sudo[112892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:54:06 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[67d2d4c5-4170-4ec5-a175-63e7529cd0cd]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:54:06 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-b0ce1327-ce06-4b66-8266-7924a4027440 tempest-VolumeDependencyTests-1512358985 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-e65a2b63-8524-45ea-92ab-d4db1c52b46c {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:54:06 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-9671f2dd-7537-4fae-bc22-4461929ae3d3 tempest-CreateVolumesFromSourceVolumeTest-1548484331 None] Created volume successfully. Aug 03 08:54:06 devstack sudo[112894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-e65a2b63-8524-45ea-92ab-d4db1c52b46c Aug 03 08:54:06 devstack sudo[112894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:54:06 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-da3d25a6-3cbc-451a-8c22-9fe2ca20e95b tempest-CreateVolumesFromSourceVolumeTest-1548484331 None] Acquiring lock "cinder-a90090fa-d5fc-445d-9eaa-26edf997184a-delete_volume" by "delete_volume" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:54:06 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-da3d25a6-3cbc-451a-8c22-9fe2ca20e95b tempest-CreateVolumesFromSourceVolumeTest-1548484331 None] Lock "cinder-a90090fa-d5fc-445d-9eaa-26edf997184a-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:54:06 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-da3d25a6-3cbc-451a-8c22-9fe2ca20e95b tempest-CreateVolumesFromSourceVolumeTest-1548484331 None] Acquiring lock "cinder-quobyte-a90090fa-d5fc-445d-9eaa-26edf997184a" by "delete_volume" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:54:06 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-da3d25a6-3cbc-451a-8c22-9fe2ca20e95b tempest-CreateVolumesFromSourceVolumeTest-1548484331 None] Lock "cinder-quobyte-a90090fa-d5fc-445d-9eaa-26edf997184a" acquired by "delete_volume" :: waited 0.019s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:54:06 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5a03bcc-c64d-44e8-957e-1ce0a83e3b0e]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:54:06 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-da3d25a6-3cbc-451a-8c22-9fe2ca20e95b tempest-CreateVolumesFromSourceVolumeTest-1548484331 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-a90090fa-d5fc-445d-9eaa-26edf997184a {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:54:06 devstack sudo[112892]: pam_unix(sudo:session): session closed for user root Aug 03 08:54:06 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-051c0041-f158-4296-b2eb-5e6cb5f0ad4d tempest-ProjectMemberTests-1353074417 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-8828443b-b670-4f29-9617-cf511c2be24f" returned: 0 in 0.453s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:54:06 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-051c0041-f158-4296-b2eb-5e6cb5f0ad4d tempest-ProjectMemberTests-1353074417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-8828443b-b670-4f29-9617-cf511c2be24f.313cc330-ccf4-4e11-9f1d-c92f480dfe48 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:54:06 devstack sudo[112901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-8828443b-b670-4f29-9617-cf511c2be24f.313cc330-ccf4-4e11-9f1d-c92f480dfe48 Aug 03 08:54:06 devstack sudo[112901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:54:06 devstack sudo[112894]: pam_unix(sudo:session): session closed for user root Aug 03 08:54:06 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-b0ce1327-ce06-4b66-8266-7924a4027440 tempest-VolumeDependencyTests-1512358985 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-e65a2b63-8524-45ea-92ab-d4db1c52b46c" returned: 0 in 0.424s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:54:06 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-b0ce1327-ce06-4b66-8266-7924a4027440 tempest-VolumeDependencyTests-1512358985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-e65a2b63-8524-45ea-92ab-d4db1c52b46c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-e65a2b63-8524-45ea-92ab-d4db1c52b46c.2516a2a6-9817-4bf8-92c6-7997e16150cd 1G {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:54:06 devstack sudo[112899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-a90090fa-d5fc-445d-9eaa-26edf997184a Aug 03 08:54:06 devstack sudo[112899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:54:06 devstack sudo[112905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-e65a2b63-8524-45ea-92ab-d4db1c52b46c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-e65a2b63-8524-45ea-92ab-d4db1c52b46c.2516a2a6-9817-4bf8-92c6-7997e16150cd 1G Aug 03 08:54:06 devstack sudo[112905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:54:06 devstack sudo[112901]: pam_unix(sudo:session): session closed for user root Aug 03 08:54:06 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-051c0041-f158-4296-b2eb-5e6cb5f0ad4d tempest-ProjectMemberTests-1353074417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-8828443b-b670-4f29-9617-cf511c2be24f.313cc330-ccf4-4e11-9f1d-c92f480dfe48" returned: 0 in 0.345s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:54:06 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-051c0041-f158-4296-b2eb-5e6cb5f0ad4d tempest-ProjectMemberTests-1353074417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-8828443b-b670-4f29-9617-cf511c2be24f.313cc330-ccf4-4e11-9f1d-c92f480dfe48 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:54:06 devstack sudo[112899]: pam_unix(sudo:session): session closed for user root Aug 03 08:54:06 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-da3d25a6-3cbc-451a-8c22-9fe2ca20e95b tempest-CreateVolumesFromSourceVolumeTest-1548484331 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-a90090fa-d5fc-445d-9eaa-26edf997184a" returned: 0 in 0.383s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:54:06 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-da3d25a6-3cbc-451a-8c22-9fe2ca20e95b tempest-CreateVolumesFromSourceVolumeTest-1548484331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-a90090fa-d5fc-445d-9eaa-26edf997184a {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:54:06 devstack sudo[112917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-8828443b-b670-4f29-9617-cf511c2be24f.313cc330-ccf4-4e11-9f1d-c92f480dfe48 Aug 03 08:54:06 devstack sudo[112917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:54:06 devstack sudo[112918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-a90090fa-d5fc-445d-9eaa-26edf997184a Aug 03 08:54:06 devstack sudo[112918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:54:07 devstack sudo[112905]: pam_unix(sudo:session): session closed for user root Aug 03 08:54:07 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-b0ce1327-ce06-4b66-8266-7924a4027440 tempest-VolumeDependencyTests-1512358985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-e65a2b63-8524-45ea-92ab-d4db1c52b46c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-e65a2b63-8524-45ea-92ab-d4db1c52b46c.2516a2a6-9817-4bf8-92c6-7997e16150cd 1G" returned: 0 in 0.429s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:54:07 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-b0ce1327-ce06-4b66-8266-7924a4027440 tempest-VolumeDependencyTests-1512358985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e65a2b63-8524-45ea-92ab-d4db1c52b46c -F qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-e65a2b63-8524-45ea-92ab-d4db1c52b46c.2516a2a6-9817-4bf8-92c6-7997e16150cd {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:54:07 devstack sudo[112922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e65a2b63-8524-45ea-92ab-d4db1c52b46c -F qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-e65a2b63-8524-45ea-92ab-d4db1c52b46c.2516a2a6-9817-4bf8-92c6-7997e16150cd Aug 03 08:54:07 devstack sudo[112922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:54:07 devstack sudo[112917]: pam_unix(sudo:session): session closed for user root Aug 03 08:54:07 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-051c0041-f158-4296-b2eb-5e6cb5f0ad4d tempest-ProjectMemberTests-1353074417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-8828443b-b670-4f29-9617-cf511c2be24f.313cc330-ccf4-4e11-9f1d-c92f480dfe48" returned: 0 in 0.266s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:54:07 devstack sudo[112918]: pam_unix(sudo:session): session closed for user root Aug 03 08:54:07 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-da3d25a6-3cbc-451a-8c22-9fe2ca20e95b tempest-CreateVolumesFromSourceVolumeTest-1548484331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-a90090fa-d5fc-445d-9eaa-26edf997184a" returned: 0 in 0.284s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:54:07 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-051c0041-f158-4296-b2eb-5e6cb5f0ad4d tempest-ProjectMemberTests-1353074417 None] Lock "cinder-quobyte-313cc330-ccf4-4e11-9f1d-c92f480dfe48" released by "_delete_snapshot" :: held 1.533s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:54:07 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-da3d25a6-3cbc-451a-8c22-9fe2ca20e95b tempest-CreateVolumesFromSourceVolumeTest-1548484331 None] Lock "cinder-quobyte-a90090fa-d5fc-445d-9eaa-26edf997184a" released by "delete_volume" :: held 0.729s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:54:07 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-051c0041-f158-4296-b2eb-5e6cb5f0ad4d tempest-ProjectMemberTests-1353074417 None] Lock "cinder-quobyte-8828443b-b670-4f29-9617-cf511c2be24f" released by "delete_snapshot" :: held 1.568s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:54:07 devstack cinder-volume[88899]: DEBUG cinder.quota [None req-da3d25a6-3cbc-451a-8c22-9fe2ca20e95b tempest-CreateVolumesFromSourceVolumeTest-1548484331 None] Created reservations ['470bf5cb-2f4c-4988-9b1a-aee4c5018db6', 'e886ea7c-e19c-4ff9-8285-5a8151f0f71e', '88103821-3c34-4571-8318-a26f2d87a87c', '61bf2d7a-00a0-4d9d-a832-28778db6643e'] {{(pid=88899) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 08:54:07 devstack cinder-volume[88899]: DEBUG cinder.quota [None req-051c0041-f158-4296-b2eb-5e6cb5f0ad4d tempest-ProjectMemberTests-1353074417 None] Created reservations ['3d6a1fd2-96b6-4bda-bdf0-1cb74735d324', '733893e3-8d54-4fb3-ba1f-d07ca0078c86', '80231c40-b61e-44bd-946b-09d7e3993034', 'a95e2e77-13a0-43c8-9ea8-4a8eed0e7dd2'] {{(pid=88899) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 08:54:07 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-051c0041-f158-4296-b2eb-5e6cb5f0ad4d tempest-ProjectMemberTests-1353074417 None] Delete snapshot completed successfully. Aug 03 08:54:07 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-051c0041-f158-4296-b2eb-5e6cb5f0ad4d tempest-ProjectMemberTests-1353074417 None] Lock "cinder-313cc330-ccf4-4e11-9f1d-c92f480dfe48-delete_snapshot" released by "delete_snapshot" :: held 1.761s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:54:07 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-da3d25a6-3cbc-451a-8c22-9fe2ca20e95b tempest-CreateVolumesFromSourceVolumeTest-1548484331 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:54:07 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-da3d25a6-3cbc-451a-8c22-9fe2ca20e95b tempest-CreateVolumesFromSourceVolumeTest-1548484331 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:54:07 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-da3d25a6-3cbc-451a-8c22-9fe2ca20e95b tempest-CreateVolumesFromSourceVolumeTest-1548484331 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:54:07 devstack sudo[112922]: pam_unix(sudo:session): session closed for user root Aug 03 08:54:07 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-da3d25a6-3cbc-451a-8c22-9fe2ca20e95b tempest-CreateVolumesFromSourceVolumeTest-1548484331 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:54:07 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-da3d25a6-3cbc-451a-8c22-9fe2ca20e95b tempest-CreateVolumesFromSourceVolumeTest-1548484331 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:54:07 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-da3d25a6-3cbc-451a-8c22-9fe2ca20e95b tempest-CreateVolumesFromSourceVolumeTest-1548484331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:54:07 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-b0ce1327-ce06-4b66-8266-7924a4027440 tempest-VolumeDependencyTests-1512358985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e65a2b63-8524-45ea-92ab-d4db1c52b46c -F qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-e65a2b63-8524-45ea-92ab-d4db1c52b46c.2516a2a6-9817-4bf8-92c6-7997e16150cd" returned: 0 in 0.371s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:54:07 devstack cinder-volume[88899]: WARNING cinder.volume.drivers.remotefs [None req-b0ce1327-ce06-4b66-8266-7924a4027440 tempest-VolumeDependencyTests-1512358985 None] /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-e65a2b63-8524-45ea-92ab-d4db1c52b46c.2516a2a6-9817-4bf8-92c6-7997e16150cd is being set with open permissions: ugo+rw Aug 03 08:54:07 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-b0ce1327-ce06-4b66-8266-7924a4027440 tempest-VolumeDependencyTests-1512358985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-e65a2b63-8524-45ea-92ab-d4db1c52b46c.2516a2a6-9817-4bf8-92c6-7997e16150cd {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:54:07 devstack sudo[112963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a Aug 03 08:54:07 devstack sudo[112963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:54:07 devstack sudo[112964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-e65a2b63-8524-45ea-92ab-d4db1c52b46c.2516a2a6-9817-4bf8-92c6-7997e16150cd Aug 03 08:54:07 devstack sudo[112964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:54:07 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-f21e5669-fc7a-4ea3-94f0-80844b28dc61 tempest-CreateVolumesFromSourceVolumeTest-1548484331 None] Acquiring lock "cinder-7eac3fbe-80f8-4616-800d-4c7d85c16e48-delete_volume" by "delete_volume" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:54:07 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-f21e5669-fc7a-4ea3-94f0-80844b28dc61 tempest-CreateVolumesFromSourceVolumeTest-1548484331 None] Lock "cinder-7eac3fbe-80f8-4616-800d-4c7d85c16e48-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:54:07 devstack sudo[112963]: pam_unix(sudo:session): session closed for user root Aug 03 08:54:07 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-da3d25a6-3cbc-451a-8c22-9fe2ca20e95b tempest-CreateVolumesFromSourceVolumeTest-1548484331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a" returned: 0 in 0.291s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:54:07 devstack cinder-volume[88899]: DEBUG cinder.manager [None req-da3d25a6-3cbc-451a-8c22-9fe2ca20e95b tempest-CreateVolumesFromSourceVolumeTest-1548484331 None] Notifying Schedulers of capabilities ... {{(pid=88899) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 08:54:07 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-f21e5669-fc7a-4ea3-94f0-80844b28dc61 tempest-CreateVolumesFromSourceVolumeTest-1548484331 None] Acquiring lock "cinder-quobyte-7eac3fbe-80f8-4616-800d-4c7d85c16e48" by "delete_volume" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:54:07 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-da3d25a6-3cbc-451a-8c22-9fe2ca20e95b tempest-CreateVolumesFromSourceVolumeTest-1548484331 None] Deleted volume successfully. Aug 03 08:54:07 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-da3d25a6-3cbc-451a-8c22-9fe2ca20e95b tempest-CreateVolumesFromSourceVolumeTest-1548484331 None] Lock "cinder-a90090fa-d5fc-445d-9eaa-26edf997184a-delete_volume" released by "delete_volume" :: held 1.308s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:54:07 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-f21e5669-fc7a-4ea3-94f0-80844b28dc61 tempest-CreateVolumesFromSourceVolumeTest-1548484331 None] Lock "cinder-quobyte-7eac3fbe-80f8-4616-800d-4c7d85c16e48" acquired by "delete_volume" :: waited 0.025s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:54:07 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[787e680b-1baa-4b57-8689-19889cadb44c]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:54:07 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-f21e5669-fc7a-4ea3-94f0-80844b28dc61 tempest-CreateVolumesFromSourceVolumeTest-1548484331 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-7eac3fbe-80f8-4616-800d-4c7d85c16e48 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:54:07 devstack sudo[112964]: pam_unix(sudo:session): session closed for user root Aug 03 08:54:07 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-b0ce1327-ce06-4b66-8266-7924a4027440 tempest-VolumeDependencyTests-1512358985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-e65a2b63-8524-45ea-92ab-d4db1c52b46c.2516a2a6-9817-4bf8-92c6-7997e16150cd" returned: 0 in 0.346s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:54:07 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-71732341-a8c8-42c8-bb29-28f80de53a87 tempest-ProjectMemberTests-1353074417 None] Acquiring lock "cinder-8828443b-b670-4f29-9617-cf511c2be24f-delete_volume" by "delete_volume" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:54:07 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-b0ce1327-ce06-4b66-8266-7924a4027440 tempest-VolumeDependencyTests-1512358985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-e65a2b63-8524-45ea-92ab-d4db1c52b46c.info {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:54:07 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-71732341-a8c8-42c8-bb29-28f80de53a87 tempest-ProjectMemberTests-1353074417 None] Lock "cinder-8828443b-b670-4f29-9617-cf511c2be24f-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:54:07 devstack sudo[112972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-e65a2b63-8524-45ea-92ab-d4db1c52b46c.info Aug 03 08:54:07 devstack sudo[112972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:54:07 devstack sudo[112971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-7eac3fbe-80f8-4616-800d-4c7d85c16e48 Aug 03 08:54:07 devstack sudo[112971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:54:07 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-71732341-a8c8-42c8-bb29-28f80de53a87 tempest-ProjectMemberTests-1353074417 None] Acquiring lock "cinder-quobyte-8828443b-b670-4f29-9617-cf511c2be24f" by "delete_volume" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:54:07 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-71732341-a8c8-42c8-bb29-28f80de53a87 tempest-ProjectMemberTests-1353074417 None] Lock "cinder-quobyte-8828443b-b670-4f29-9617-cf511c2be24f" acquired by "delete_volume" :: waited 0.019s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:54:07 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[4aabf94f-d393-4250-be54-243605defbac]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:54:07 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-71732341-a8c8-42c8-bb29-28f80de53a87 tempest-ProjectMemberTests-1353074417 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-8828443b-b670-4f29-9617-cf511c2be24f {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:54:08 devstack sudo[112975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-8828443b-b670-4f29-9617-cf511c2be24f Aug 03 08:54:08 devstack sudo[112975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:54:08 devstack sudo[112972]: pam_unix(sudo:session): session closed for user root Aug 03 08:54:08 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-b0ce1327-ce06-4b66-8266-7924a4027440 tempest-VolumeDependencyTests-1512358985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-e65a2b63-8524-45ea-92ab-d4db1c52b46c.info" returned: 0 in 0.262s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:54:08 devstack cinder-volume[88899]: WARNING cinder.volume.drivers.remotefs [None req-b0ce1327-ce06-4b66-8266-7924a4027440 tempest-VolumeDependencyTests-1512358985 None] /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-e65a2b63-8524-45ea-92ab-d4db1c52b46c.info is being set with open permissions: ugo+rw Aug 03 08:54:08 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-b0ce1327-ce06-4b66-8266-7924a4027440 tempest-VolumeDependencyTests-1512358985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-e65a2b63-8524-45ea-92ab-d4db1c52b46c.info {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:54:08 devstack sudo[112980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-e65a2b63-8524-45ea-92ab-d4db1c52b46c.info Aug 03 08:54:08 devstack sudo[112980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:54:08 devstack sudo[112971]: pam_unix(sudo:session): session closed for user root Aug 03 08:54:08 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-f21e5669-fc7a-4ea3-94f0-80844b28dc61 tempest-CreateVolumesFromSourceVolumeTest-1548484331 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-7eac3fbe-80f8-4616-800d-4c7d85c16e48" returned: 0 in 0.391s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:54:08 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-f21e5669-fc7a-4ea3-94f0-80844b28dc61 tempest-CreateVolumesFromSourceVolumeTest-1548484331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-7eac3fbe-80f8-4616-800d-4c7d85c16e48 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:54:08 devstack sudo[112983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-7eac3fbe-80f8-4616-800d-4c7d85c16e48 Aug 03 08:54:08 devstack sudo[112983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:54:08 devstack sudo[112980]: pam_unix(sudo:session): session closed for user root Aug 03 08:54:08 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-b0ce1327-ce06-4b66-8266-7924a4027440 tempest-VolumeDependencyTests-1512358985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-e65a2b63-8524-45ea-92ab-d4db1c52b46c.info" returned: 0 in 0.247s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:54:08 devstack sudo[112975]: pam_unix(sudo:session): session closed for user root Aug 03 08:54:08 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-b0ce1327-ce06-4b66-8266-7924a4027440 tempest-VolumeDependencyTests-1512358985 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.215s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:54:08 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-728b6264-972b-497b-bd7b-7771a0c1f449 tempest-VolumeImageDependencyTests-942168115 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.877s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:54:08 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-728b6264-972b-497b-bd7b-7771a0c1f449 tempest-VolumeImageDependencyTests-942168115 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:54:02Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-teste6050452-06bd-4c7f-9912-45178c83e379',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e91f316-bba8-4ffc-83ee-4a736a9150d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fb20ce3648d1497fb23ac775415e7a44',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:54:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:54:02Z,use_quota=True,user_id='ec19afbca65f4a8185b3231a39404ec7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8bde7129-1dc4-42ab-b852-ab32c61b4921),volume_type_id=8bde7129-1dc4-42ab-b852-ab32c61b4921)}" {{(pid=88899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 08:54:08 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-728b6264-972b-497b-bd7b-7771a0c1f449 tempest-VolumeImageDependencyTests-942168115 None] Creating volume 7e91f316-bba8-4ffc-83ee-4a736a9150d4 {{(pid=88899) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 08:54:08 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-728b6264-972b-497b-bd7b-7771a0c1f449 tempest-VolumeImageDependencyTests-942168115 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:54:08 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-728b6264-972b-497b-bd7b-7771a0c1f449 tempest-VolumeImageDependencyTests-942168115 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:54:08 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-728b6264-972b-497b-bd7b-7771a0c1f449 tempest-VolumeImageDependencyTests-942168115 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:54:08 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-728b6264-972b-497b-bd7b-7771a0c1f449 tempest-VolumeImageDependencyTests-942168115 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:54:08 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-728b6264-972b-497b-bd7b-7771a0c1f449 tempest-VolumeImageDependencyTests-942168115 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:54:08 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-728b6264-972b-497b-bd7b-7771a0c1f449 tempest-VolumeImageDependencyTests-942168115 None] Selected osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385 as target Quobyte volume. {{(pid=88899) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 08:54:08 devstack cinder-volume[88899]: INFO cinder.volume.drivers.remotefs [None req-728b6264-972b-497b-bd7b-7771a0c1f449 tempest-VolumeImageDependencyTests-942168115 None] casted to osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385 Aug 03 08:54:08 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-728b6264-972b-497b-bd7b-7771a0c1f449 tempest-VolumeImageDependencyTests-942168115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-7e91f316-bba8-4ffc-83ee-4a736a9150d4 1073741824 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:54:08 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-71732341-a8c8-42c8-bb29-28f80de53a87 tempest-ProjectMemberTests-1353074417 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-8828443b-b670-4f29-9617-cf511c2be24f" returned: 0 in 0.429s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:54:08 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-71732341-a8c8-42c8-bb29-28f80de53a87 tempest-ProjectMemberTests-1353074417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-8828443b-b670-4f29-9617-cf511c2be24f {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:54:08 devstack sudo[112989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-7e91f316-bba8-4ffc-83ee-4a736a9150d4 1073741824 Aug 03 08:54:08 devstack sudo[112989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:54:08 devstack sudo[112991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-8828443b-b670-4f29-9617-cf511c2be24f Aug 03 08:54:08 devstack sudo[112991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:54:08 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-b0ce1327-ce06-4b66-8266-7924a4027440 tempest-VolumeDependencyTests-1512358985 None] Create snapshot completed successfully Aug 03 08:54:08 devstack sudo[112983]: pam_unix(sudo:session): session closed for user root Aug 03 08:54:08 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-f21e5669-fc7a-4ea3-94f0-80844b28dc61 tempest-CreateVolumesFromSourceVolumeTest-1548484331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-7eac3fbe-80f8-4616-800d-4c7d85c16e48" returned: 0 in 0.281s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:54:08 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-f21e5669-fc7a-4ea3-94f0-80844b28dc61 tempest-CreateVolumesFromSourceVolumeTest-1548484331 None] Lock "cinder-quobyte-7eac3fbe-80f8-4616-800d-4c7d85c16e48" released by "delete_volume" :: held 0.706s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:54:08 devstack cinder-volume[88899]: DEBUG cinder.quota [None req-f21e5669-fc7a-4ea3-94f0-80844b28dc61 tempest-CreateVolumesFromSourceVolumeTest-1548484331 None] Created reservations ['f791a15a-7533-4c2f-b589-f85364f1f7b7', '4b14e9d4-b736-4c44-bc0d-8e9789ca6228', 'b3af099f-aeea-4c81-963d-066714077c70', '5412433e-4de5-40f7-89e1-72b0f24ff459'] {{(pid=88899) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 08:54:08 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-f21e5669-fc7a-4ea3-94f0-80844b28dc61 tempest-CreateVolumesFromSourceVolumeTest-1548484331 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:54:08 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-f21e5669-fc7a-4ea3-94f0-80844b28dc61 tempest-CreateVolumesFromSourceVolumeTest-1548484331 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:54:08 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-f21e5669-fc7a-4ea3-94f0-80844b28dc61 tempest-CreateVolumesFromSourceVolumeTest-1548484331 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:54:08 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-f21e5669-fc7a-4ea3-94f0-80844b28dc61 tempest-CreateVolumesFromSourceVolumeTest-1548484331 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:54:08 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-f21e5669-fc7a-4ea3-94f0-80844b28dc61 tempest-CreateVolumesFromSourceVolumeTest-1548484331 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:54:08 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-f21e5669-fc7a-4ea3-94f0-80844b28dc61 tempest-CreateVolumesFromSourceVolumeTest-1548484331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:54:08 devstack sudo[112996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a Aug 03 08:54:08 devstack sudo[112996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:54:08 devstack sudo[112991]: pam_unix(sudo:session): session closed for user root Aug 03 08:54:08 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-71732341-a8c8-42c8-bb29-28f80de53a87 tempest-ProjectMemberTests-1353074417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-8828443b-b670-4f29-9617-cf511c2be24f" returned: 0 in 0.294s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:54:08 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-71732341-a8c8-42c8-bb29-28f80de53a87 tempest-ProjectMemberTests-1353074417 None] Lock "cinder-quobyte-8828443b-b670-4f29-9617-cf511c2be24f" released by "delete_volume" :: held 0.792s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:54:08 devstack cinder-volume[88899]: DEBUG cinder.quota [None req-71732341-a8c8-42c8-bb29-28f80de53a87 tempest-ProjectMemberTests-1353074417 None] Created reservations ['330ccdfe-9c27-44a6-b521-3b6917d97816', '70439ce1-0efc-49ef-a981-a6df3573dfd5', '7845065e-d154-420b-80d0-266e9f7eebee', '54cd37df-2a40-4aa3-955e-58d3f2d4c122'] {{(pid=88899) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 08:54:08 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-57c73316-6218-4122-a45f-0c356162dc02 tempest-CreateVolumesFromSourceVolumeTest-1548484331 None] Acquiring lock "cinder-fd49bd23-026a-443c-8ddd-5862edc24f9b-delete_volume" by "delete_volume" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:54:08 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-57c73316-6218-4122-a45f-0c356162dc02 tempest-CreateVolumesFromSourceVolumeTest-1548484331 None] Lock "cinder-fd49bd23-026a-443c-8ddd-5862edc24f9b-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:54:08 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-57c73316-6218-4122-a45f-0c356162dc02 tempest-CreateVolumesFromSourceVolumeTest-1548484331 None] Acquiring lock "cinder-quobyte-fd49bd23-026a-443c-8ddd-5862edc24f9b" by "delete_volume" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:54:08 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-71732341-a8c8-42c8-bb29-28f80de53a87 tempest-ProjectMemberTests-1353074417 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:54:08 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-71732341-a8c8-42c8-bb29-28f80de53a87 tempest-ProjectMemberTests-1353074417 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:54:08 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-71732341-a8c8-42c8-bb29-28f80de53a87 tempest-ProjectMemberTests-1353074417 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:54:08 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-71732341-a8c8-42c8-bb29-28f80de53a87 tempest-ProjectMemberTests-1353074417 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:54:08 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-71732341-a8c8-42c8-bb29-28f80de53a87 tempest-ProjectMemberTests-1353074417 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:54:08 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-71732341-a8c8-42c8-bb29-28f80de53a87 tempest-ProjectMemberTests-1353074417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:54:08 devstack sudo[112989]: pam_unix(sudo:session): session closed for user root Aug 03 08:54:08 devstack sudo[112996]: pam_unix(sudo:session): session closed for user root Aug 03 08:54:08 devstack sudo[113003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a Aug 03 08:54:08 devstack sudo[113003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:54:08 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-728b6264-972b-497b-bd7b-7771a0c1f449 tempest-VolumeImageDependencyTests-942168115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-7e91f316-bba8-4ffc-83ee-4a736a9150d4 1073741824" returned: 0 in 0.638s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:54:08 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-f21e5669-fc7a-4ea3-94f0-80844b28dc61 tempest-CreateVolumesFromSourceVolumeTest-1548484331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a" returned: 0 in 0.420s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:54:08 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-57c73316-6218-4122-a45f-0c356162dc02 tempest-CreateVolumesFromSourceVolumeTest-1548484331 None] Lock "cinder-quobyte-fd49bd23-026a-443c-8ddd-5862edc24f9b" acquired by "delete_volume" :: waited 0.081s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:54:08 devstack cinder-volume[88899]: DEBUG cinder.manager [None req-f21e5669-fc7a-4ea3-94f0-80844b28dc61 tempest-CreateVolumesFromSourceVolumeTest-1548484331 None] Notifying Schedulers of capabilities ... {{(pid=88899) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 08:54:09 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-f21e5669-fc7a-4ea3-94f0-80844b28dc61 tempest-CreateVolumesFromSourceVolumeTest-1548484331 None] Deleted volume successfully. Aug 03 08:54:09 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[63c02400-7adf-424f-990b-07495c160460]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:54:09 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-57c73316-6218-4122-a45f-0c356162dc02 tempest-CreateVolumesFromSourceVolumeTest-1548484331 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-fd49bd23-026a-443c-8ddd-5862edc24f9b {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:54:09 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-f21e5669-fc7a-4ea3-94f0-80844b28dc61 tempest-CreateVolumesFromSourceVolumeTest-1548484331 None] Lock "cinder-7eac3fbe-80f8-4616-800d-4c7d85c16e48-delete_volume" released by "delete_volume" :: held 1.474s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:54:09 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-728b6264-972b-497b-bd7b-7771a0c1f449 tempest-VolumeImageDependencyTests-942168115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-7e91f316-bba8-4ffc-83ee-4a736a9150d4 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:54:09 devstack sudo[113006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-7e91f316-bba8-4ffc-83ee-4a736a9150d4 Aug 03 08:54:09 devstack sudo[113006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:54:09 devstack sudo[113005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-fd49bd23-026a-443c-8ddd-5862edc24f9b Aug 03 08:54:09 devstack sudo[113005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:54:09 devstack sudo[113003]: pam_unix(sudo:session): session closed for user root Aug 03 08:54:09 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-71732341-a8c8-42c8-bb29-28f80de53a87 tempest-ProjectMemberTests-1353074417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a" returned: 0 in 0.348s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:54:09 devstack cinder-volume[88899]: DEBUG cinder.manager [None req-71732341-a8c8-42c8-bb29-28f80de53a87 tempest-ProjectMemberTests-1353074417 None] Notifying Schedulers of capabilities ... {{(pid=88899) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 08:54:09 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-71732341-a8c8-42c8-bb29-28f80de53a87 tempest-ProjectMemberTests-1353074417 None] Deleted volume successfully. Aug 03 08:54:09 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-71732341-a8c8-42c8-bb29-28f80de53a87 tempest-ProjectMemberTests-1353074417 None] Lock "cinder-8828443b-b670-4f29-9617-cf511c2be24f-delete_volume" released by "delete_volume" :: held 1.541s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:54:09 devstack cinder-volume[88899]: DEBUG cinder.volume.flows.manager.create_volume [None req-737a3e3e-fd0d-4d77-b392-cb646e0e659f tempest-VolumeDependencyTests-1512358985 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88899) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 08:54:09 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-737a3e3e-fd0d-4d77-b392-cb646e0e659f tempest-VolumeDependencyTests-1512358985 None] Flow 'volume_create_manager' (ac3fb4f5-ae98-471b-a432-bd87a5e5541b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:54:09 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-737a3e3e-fd0d-4d77-b392-cb646e0e659f tempest-VolumeDependencyTests-1512358985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (18b9c4db-f136-456d-a1d9-af94b1758648) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:54:09 devstack sudo[113005]: pam_unix(sudo:session): session closed for user root Aug 03 08:54:09 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-737a3e3e-fd0d-4d77-b392-cb646e0e659f tempest-VolumeDependencyTests-1512358985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (18b9c4db-f136-456d-a1d9-af94b1758648) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:54:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-631307653',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=815ad7f9-1a36-40cf-ad01-1e9d227a15de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d30b387eb9b94bb589dfe04f0d2eac6d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:54:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=2516a2a6-9817-4bf8-92c6-7997e16150cd,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:54:09Z,use_quota=True,user_id='12ab9b4d5d894d608b06e312639537e8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8bde7129-1dc4-42ab-b852-ab32c61b4921),volume_type_id=8bde7129-1dc4-42ab-b852-ab32c61b4921)' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:54:09 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-737a3e3e-fd0d-4d77-b392-cb646e0e659f tempest-VolumeDependencyTests-1512358985 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d5e8ed9-bdb5-4f48-aed2-5c4e6f3d4974) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:54:09 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-737a3e3e-fd0d-4d77-b392-cb646e0e659f tempest-VolumeDependencyTests-1512358985 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d5e8ed9-bdb5-4f48-aed2-5c4e6f3d4974) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:54:09 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-737a3e3e-fd0d-4d77-b392-cb646e0e659f tempest-VolumeDependencyTests-1512358985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (201b2aea-2d80-4c24-acfb-17473ce96c8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:54:09 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-737a3e3e-fd0d-4d77-b392-cb646e0e659f tempest-VolumeDependencyTests-1512358985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (201b2aea-2d80-4c24-acfb-17473ce96c8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '815ad7f9-1a36-40cf-ad01-1e9d227a15de', 'volume_name': 'volume-815ad7f9-1a36-40cf-ad01-1e9d227a15de', 'volume_size': 1, 'snapshot_id': '2516a2a6-9817-4bf8-92c6-7997e16150cd'}' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:54:09 devstack sudo[113006]: pam_unix(sudo:session): session closed for user root Aug 03 08:54:09 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-737a3e3e-fd0d-4d77-b392-cb646e0e659f tempest-VolumeDependencyTests-1512358985 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (940179f8-cd84-45e8-aa8f-4e249b365444) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:54:09 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-737a3e3e-fd0d-4d77-b392-cb646e0e659f tempest-VolumeDependencyTests-1512358985 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (940179f8-cd84-45e8-aa8f-4e249b365444) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:54:09 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-737a3e3e-fd0d-4d77-b392-cb646e0e659f tempest-VolumeDependencyTests-1512358985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2cb43820-3088-454a-a5a4-f8c4638e39c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:54:09 devstack cinder-volume[88899]: INFO cinder.volume.flows.manager.create_volume [None req-737a3e3e-fd0d-4d77-b392-cb646e0e659f tempest-VolumeDependencyTests-1512358985 None] Volume 815ad7f9-1a36-40cf-ad01-1e9d227a15de: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-815ad7f9-1a36-40cf-ad01-1e9d227a15de', 'volume_size': 1, 'snapshot_id': '2516a2a6-9817-4bf8-92c6-7997e16150cd'} Aug 03 08:54:09 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-728b6264-972b-497b-bd7b-7771a0c1f449 tempest-VolumeImageDependencyTests-942168115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-7e91f316-bba8-4ffc-83ee-4a736a9150d4" returned: 0 in 0.429s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:54:09 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-57c73316-6218-4122-a45f-0c356162dc02 tempest-CreateVolumesFromSourceVolumeTest-1548484331 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-fd49bd23-026a-443c-8ddd-5862edc24f9b" returned: 0 in 0.506s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:54:09 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-728b6264-972b-497b-bd7b-7771a0c1f449 tempest-VolumeImageDependencyTests-942168115 None] <== create_volume: return (1223ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'} {{(pid=88899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 08:54:09 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-728b6264-972b-497b-bd7b-7771a0c1f449 tempest-VolumeImageDependencyTests-942168115 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.227s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:54:09 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-57c73316-6218-4122-a45f-0c356162dc02 tempest-CreateVolumesFromSourceVolumeTest-1548484331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-fd49bd23-026a-443c-8ddd-5862edc24f9b {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:54:09 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-737a3e3e-fd0d-4d77-b392-cb646e0e659f tempest-VolumeDependencyTests-1512358985 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:54:09 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-737a3e3e-fd0d-4d77-b392-cb646e0e659f tempest-VolumeDependencyTests-1512358985 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:54:09 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-737a3e3e-fd0d-4d77-b392-cb646e0e659f tempest-VolumeDependencyTests-1512358985 None] Acquiring lock "cinder-quobyte-2516a2a6-9817-4bf8-92c6-7997e16150cd-815ad7f9-1a36-40cf-ad01-1e9d227a15de" by "_create_volume_from_snapshot" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:54:09 devstack sudo[113014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-fd49bd23-026a-443c-8ddd-5862edc24f9b Aug 03 08:54:09 devstack sudo[113014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:54:09 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-737a3e3e-fd0d-4d77-b392-cb646e0e659f tempest-VolumeDependencyTests-1512358985 None] Lock "cinder-quobyte-2516a2a6-9817-4bf8-92c6-7997e16150cd-815ad7f9-1a36-40cf-ad01-1e9d227a15de" acquired by "_create_volume_from_snapshot" :: waited 0.024s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:54:09 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-737a3e3e-fd0d-4d77-b392-cb646e0e659f tempest-VolumeDependencyTests-1512358985 None] Creating volume 815ad7f9-1a36-40cf-ad01-1e9d227a15de from snapshot 2516a2a6-9817-4bf8-92c6-7997e16150cd {{(pid=88899) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Aug 03 08:54:09 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-737a3e3e-fd0d-4d77-b392-cb646e0e659f tempest-VolumeDependencyTests-1512358985 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:54:09 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-737a3e3e-fd0d-4d77-b392-cb646e0e659f tempest-VolumeDependencyTests-1512358985 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:54:09 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-737a3e3e-fd0d-4d77-b392-cb646e0e659f tempest-VolumeDependencyTests-1512358985 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:54:09 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-737a3e3e-fd0d-4d77-b392-cb646e0e659f tempest-VolumeDependencyTests-1512358985 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:54:09 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-737a3e3e-fd0d-4d77-b392-cb646e0e659f tempest-VolumeDependencyTests-1512358985 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:54:09 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-737a3e3e-fd0d-4d77-b392-cb646e0e659f tempest-VolumeDependencyTests-1512358985 None] Selected osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385 as target Quobyte volume. {{(pid=88899) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 08:54:09 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-737a3e3e-fd0d-4d77-b392-cb646e0e659f tempest-VolumeDependencyTests-1512358985 None] Acquiring lock "cinder-quobyte-815ad7f9-1a36-40cf-ad01-1e9d227a15de" by "_copy_volume_from_snapshot" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:54:09 devstack cinder-volume[88899]: DEBUG cinder.volume.volume_utils [None req-728b6264-972b-497b-bd7b-7771a0c1f449 tempest-VolumeImageDependencyTests-942168115 None] Attempting download of 4c4d5e27-8270-414b-a3ff-95e222431c09 ((None, [{'url': 'file:///opt/stack/data/glance/images/4c4d5e27-8270-414b-a3ff-95e222431c09', 'metadata': {}}])) to volume 7e91f316-bba8-4ffc-83ee-4a736a9150d4. {{(pid=88899) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Aug 03 08:54:09 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-737a3e3e-fd0d-4d77-b392-cb646e0e659f tempest-VolumeDependencyTests-1512358985 None] Lock "cinder-quobyte-815ad7f9-1a36-40cf-ad01-1e9d227a15de" acquired by "_copy_volume_from_snapshot" :: waited 0.025s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:54:09 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-737a3e3e-fd0d-4d77-b392-cb646e0e659f tempest-VolumeDependencyTests-1512358985 None] snapshot: 2516a2a6-9817-4bf8-92c6-7997e16150cd, volume: 815ad7f9-1a36-40cf-ad01-1e9d227a15de, {{(pid=88899) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Aug 03 08:54:09 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-737a3e3e-fd0d-4d77-b392-cb646e0e659f tempest-VolumeDependencyTests-1512358985 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:54:09 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-737a3e3e-fd0d-4d77-b392-cb646e0e659f tempest-VolumeDependencyTests-1512358985 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:54:09 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-737a3e3e-fd0d-4d77-b392-cb646e0e659f tempest-VolumeDependencyTests-1512358985 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:54:09 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-737a3e3e-fd0d-4d77-b392-cb646e0e659f tempest-VolumeDependencyTests-1512358985 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:54:09 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-737a3e3e-fd0d-4d77-b392-cb646e0e659f tempest-VolumeDependencyTests-1512358985 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:54:09 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4b92bdc-df93-4d1c-b7cf-4a23c4030625]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:54:09 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-737a3e3e-fd0d-4d77-b392-cb646e0e659f tempest-VolumeDependencyTests-1512358985 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-e65a2b63-8524-45ea-92ab-d4db1c52b46c.2516a2a6-9817-4bf8-92c6-7997e16150cd {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:54:09 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f386a5e-877d-4902-b764-2a3c6f1c1997]: (4, 'raw') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:54:09 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-728b6264-972b-497b-bd7b-7771a0c1f449 tempest-VolumeImageDependencyTests-942168115 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4c4d5e27-8270-414b-a3ff-95e222431c09_9loiiscf {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:54:09 devstack cinder-volume[88899]: DEBUG cinder.volume.flows.manager.create_volume [None req-f4b2326f-d276-46cd-8ab6-9e3d8016598a tempest-ProjectMemberTests-1353074417 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88899) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 08:54:09 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-f4b2326f-d276-46cd-8ab6-9e3d8016598a tempest-ProjectMemberTests-1353074417 None] Flow 'volume_create_manager' (f5e13a9f-e122-4ee7-b17d-07d8d63f3923) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:54:09 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-f4b2326f-d276-46cd-8ab6-9e3d8016598a tempest-ProjectMemberTests-1353074417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a1a08f9-2263-423d-abb9-40cf593c4147) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:54:09 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-f4b2326f-d276-46cd-8ab6-9e3d8016598a tempest-ProjectMemberTests-1353074417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a1a08f9-2263-423d-abb9-40cf593c4147) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:54:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-626219515',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b212a917-a56b-4d65-b829-65305ef88db2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b723e915839a4036ad739740ec4db0cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:54:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:54:10Z,use_quota=True,user_id='d9152484679b4fb79b0d8896a2a67eb9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8bde7129-1dc4-42ab-b852-ab32c61b4921),volume_type_id=8bde7129-1dc4-42ab-b852-ab32c61b4921)' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:54:09 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-f4b2326f-d276-46cd-8ab6-9e3d8016598a tempest-ProjectMemberTests-1353074417 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1b92f5d-a60d-4d9f-8d12-0d72c8bcd61e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:54:09 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-f4b2326f-d276-46cd-8ab6-9e3d8016598a tempest-ProjectMemberTests-1353074417 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1b92f5d-a60d-4d9f-8d12-0d72c8bcd61e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:54:09 devstack sudo[113017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4c4d5e27-8270-414b-a3ff-95e222431c09_9loiiscf Aug 03 08:54:09 devstack sudo[113017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:54:09 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-f4b2326f-d276-46cd-8ab6-9e3d8016598a tempest-ProjectMemberTests-1353074417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0fde4ac1-10ff-4517-ba01-e2d853f94c2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:54:09 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-f4b2326f-d276-46cd-8ab6-9e3d8016598a tempest-ProjectMemberTests-1353074417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0fde4ac1-10ff-4517-ba01-e2d853f94c2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b212a917-a56b-4d65-b829-65305ef88db2', 'volume_name': 'volume-b212a917-a56b-4d65-b829-65305ef88db2', 'volume_size': 1}' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:54:09 devstack sudo[113016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-e65a2b63-8524-45ea-92ab-d4db1c52b46c.2516a2a6-9817-4bf8-92c6-7997e16150cd Aug 03 08:54:09 devstack sudo[113016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:54:09 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-f4b2326f-d276-46cd-8ab6-9e3d8016598a tempest-ProjectMemberTests-1353074417 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0829da5c-d844-41a5-88f3-8942ac7c9b1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:54:09 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-f4b2326f-d276-46cd-8ab6-9e3d8016598a tempest-ProjectMemberTests-1353074417 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0829da5c-d844-41a5-88f3-8942ac7c9b1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:54:09 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-f4b2326f-d276-46cd-8ab6-9e3d8016598a tempest-ProjectMemberTests-1353074417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8156c70f-9257-4520-9c4b-d7bdabd8342c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:54:09 devstack cinder-volume[88899]: INFO cinder.volume.flows.manager.create_volume [None req-f4b2326f-d276-46cd-8ab6-9e3d8016598a tempest-ProjectMemberTests-1353074417 None] Volume b212a917-a56b-4d65-b829-65305ef88db2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b212a917-a56b-4d65-b829-65305ef88db2', 'volume_size': 1} Aug 03 08:54:09 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-f4b2326f-d276-46cd-8ab6-9e3d8016598a tempest-ProjectMemberTests-1353074417 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:54:09 devstack sudo[113014]: pam_unix(sudo:session): session closed for user root Aug 03 08:54:09 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-57c73316-6218-4122-a45f-0c356162dc02 tempest-CreateVolumesFromSourceVolumeTest-1548484331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-fd49bd23-026a-443c-8ddd-5862edc24f9b" returned: 0 in 0.328s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:54:09 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-57c73316-6218-4122-a45f-0c356162dc02 tempest-CreateVolumesFromSourceVolumeTest-1548484331 None] Lock "cinder-quobyte-fd49bd23-026a-443c-8ddd-5862edc24f9b" released by "delete_volume" :: held 0.919s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:54:09 devstack cinder-volume[88899]: DEBUG cinder.quota [None req-57c73316-6218-4122-a45f-0c356162dc02 tempest-CreateVolumesFromSourceVolumeTest-1548484331 None] Created reservations ['e6fe54a9-b0ca-4c54-977a-44971e6ae7fd', 'b89fe99a-b62c-478d-8b8c-4b0120969947', '2467435e-96c5-4562-ac0f-05871ec759c2', '12c1583e-48e5-4a5a-babc-77d96f3a83ab'] {{(pid=88899) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 08:54:10 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-57c73316-6218-4122-a45f-0c356162dc02 tempest-CreateVolumesFromSourceVolumeTest-1548484331 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:54:10 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-57c73316-6218-4122-a45f-0c356162dc02 tempest-CreateVolumesFromSourceVolumeTest-1548484331 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:54:10 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-57c73316-6218-4122-a45f-0c356162dc02 tempest-CreateVolumesFromSourceVolumeTest-1548484331 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:54:10 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-57c73316-6218-4122-a45f-0c356162dc02 tempest-CreateVolumesFromSourceVolumeTest-1548484331 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:54:10 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-57c73316-6218-4122-a45f-0c356162dc02 tempest-CreateVolumesFromSourceVolumeTest-1548484331 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:54:10 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-57c73316-6218-4122-a45f-0c356162dc02 tempest-CreateVolumesFromSourceVolumeTest-1548484331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:54:10 devstack sudo[113023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a Aug 03 08:54:10 devstack sudo[113023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:54:10 devstack sudo[113017]: pam_unix(sudo:session): session closed for user root Aug 03 08:54:10 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-728b6264-972b-497b-bd7b-7771a0c1f449 tempest-VolumeImageDependencyTests-942168115 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4c4d5e27-8270-414b-a3ff-95e222431c09_9loiiscf" returned: 0 in 0.348s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:54:10 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-728b6264-972b-497b-bd7b-7771a0c1f449 tempest-VolumeImageDependencyTests-942168115 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4c4d5e27-8270-414b-a3ff-95e222431c09_9loiiscf {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:54:10 devstack sudo[113016]: pam_unix(sudo:session): session closed for user root Aug 03 08:54:10 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-737a3e3e-fd0d-4d77-b392-cb646e0e659f tempest-VolumeDependencyTests-1512358985 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-e65a2b63-8524-45ea-92ab-d4db1c52b46c.2516a2a6-9817-4bf8-92c6-7997e16150cd" returned: 0 in 0.437s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:54:10 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-737a3e3e-fd0d-4d77-b392-cb646e0e659f tempest-VolumeDependencyTests-1512358985 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e65a2b63-8524-45ea-92ab-d4db1c52b46c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88899) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 03 08:54:10 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4e46170-8b62-4f80-973c-99b70b4b2f18]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:54:10 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-737a3e3e-fd0d-4d77-b392-cb646e0e659f tempest-VolumeDependencyTests-1512358985 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-e65a2b63-8524-45ea-92ab-d4db1c52b46c {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:54:10 devstack sudo[113027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4c4d5e27-8270-414b-a3ff-95e222431c09_9loiiscf Aug 03 08:54:10 devstack sudo[113027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:54:10 devstack sudo[113029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-e65a2b63-8524-45ea-92ab-d4db1c52b46c Aug 03 08:54:10 devstack sudo[113029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:54:10 devstack sudo[113023]: pam_unix(sudo:session): session closed for user root Aug 03 08:54:10 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-57c73316-6218-4122-a45f-0c356162dc02 tempest-CreateVolumesFromSourceVolumeTest-1548484331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a" returned: 0 in 0.274s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:54:10 devstack cinder-volume[88899]: DEBUG cinder.manager [None req-57c73316-6218-4122-a45f-0c356162dc02 tempest-CreateVolumesFromSourceVolumeTest-1548484331 None] Notifying Schedulers of capabilities ... {{(pid=88899) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 08:54:10 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-57c73316-6218-4122-a45f-0c356162dc02 tempest-CreateVolumesFromSourceVolumeTest-1548484331 None] Deleted volume successfully. Aug 03 08:54:10 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-57c73316-6218-4122-a45f-0c356162dc02 tempest-CreateVolumesFromSourceVolumeTest-1548484331 None] Lock "cinder-fd49bd23-026a-443c-8ddd-5862edc24f9b-delete_volume" released by "delete_volume" :: held 1.516s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:54:10 devstack sudo[113027]: pam_unix(sudo:session): session closed for user root Aug 03 08:54:10 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-728b6264-972b-497b-bd7b-7771a0c1f449 tempest-VolumeImageDependencyTests-942168115 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4c4d5e27-8270-414b-a3ff-95e222431c09_9loiiscf" returned: 1 in 0.348s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:54:10 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-728b6264-972b-497b-bd7b-7771a0c1f449 tempest-VolumeImageDependencyTests-942168115 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4c4d5e27-8270-414b-a3ff-95e222431c09_9loiiscf' failed. Not Retrying. {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 03 08:54:10 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d5d9a9d-85f0-4f92-9510-871cb383fa3a]: (4, 'raw') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:54:10 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-728b6264-972b-497b-bd7b-7771a0c1f449 tempest-VolumeImageDependencyTests-942168115 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4c4d5e27-8270-414b-a3ff-95e222431c09_5ejxal4gdevstack@QuobyteHD {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:54:10 devstack sudo[113035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4c4d5e27-8270-414b-a3ff-95e222431c09_5ejxal4gdevstack@QuobyteHD Aug 03 08:54:10 devstack sudo[113035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:54:10 devstack sudo[113029]: pam_unix(sudo:session): session closed for user root Aug 03 08:54:10 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-737a3e3e-fd0d-4d77-b392-cb646e0e659f tempest-VolumeDependencyTests-1512358985 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-e65a2b63-8524-45ea-92ab-d4db1c52b46c" returned: 0 in 0.377s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:54:10 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-737a3e3e-fd0d-4d77-b392-cb646e0e659f tempest-VolumeDependencyTests-1512358985 None] will copy from snapshot at /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-e65a2b63-8524-45ea-92ab-d4db1c52b46c {{(pid=88899) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Aug 03 08:54:10 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-737a3e3e-fd0d-4d77-b392-cb646e0e659f tempest-VolumeDependencyTests-1512358985 None] Creating direct copy from snapshot {{(pid=88899) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Aug 03 08:54:10 devstack cinder-volume[88899]: DEBUG cinder.utils [None req-737a3e3e-fd0d-4d77-b392-cb646e0e659f tempest-VolumeDependencyTests-1512358985 None] Path /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-815ad7f9-1a36-40cf-ad01-1e9d227a15de not found in is_blk_device check {{(pid=88899) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Aug 03 08:54:10 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-737a3e3e-fd0d-4d77-b392-cb646e0e659f tempest-VolumeDependencyTests-1512358985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-e65a2b63-8524-45ea-92ab-d4db1c52b46c /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-815ad7f9-1a36-40cf-ad01-1e9d227a15de {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:54:10 devstack sudo[113040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-e65a2b63-8524-45ea-92ab-d4db1c52b46c /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-815ad7f9-1a36-40cf-ad01-1e9d227a15de Aug 03 08:54:10 devstack sudo[113040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:54:10 devstack sudo[113035]: pam_unix(sudo:session): session closed for user root Aug 03 08:54:10 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-728b6264-972b-497b-bd7b-7771a0c1f449 tempest-VolumeImageDependencyTests-942168115 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4c4d5e27-8270-414b-a3ff-95e222431c09_5ejxal4gdevstack@QuobyteHD" returned: 0 in 0.315s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:54:10 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-728b6264-972b-497b-bd7b-7771a0c1f449 tempest-VolumeImageDependencyTests-942168115 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4c4d5e27-8270-414b-a3ff-95e222431c09_5ejxal4gdevstack@QuobyteHD {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:54:10 devstack sudo[113045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4c4d5e27-8270-414b-a3ff-95e222431c09_5ejxal4gdevstack@QuobyteHD Aug 03 08:54:10 devstack sudo[113045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:54:11 devstack sudo[113045]: pam_unix(sudo:session): session closed for user root Aug 03 08:54:11 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-728b6264-972b-497b-bd7b-7771a0c1f449 tempest-VolumeImageDependencyTests-942168115 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4c4d5e27-8270-414b-a3ff-95e222431c09_5ejxal4gdevstack@QuobyteHD" returned: 1 in 0.462s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:54:11 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-728b6264-972b-497b-bd7b-7771a0c1f449 tempest-VolumeImageDependencyTests-942168115 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4c4d5e27-8270-414b-a3ff-95e222431c09_5ejxal4gdevstack@QuobyteHD' failed. Not Retrying. {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 03 08:54:11 devstack cinder-volume[88899]: DEBUG cinder.image.image_utils [None req-728b6264-972b-497b-bd7b-7771a0c1f449 tempest-VolumeImageDependencyTests-942168115 None] 4c4d5e27-8270-414b-a3ff-95e222431c09 was raw, converting to qcow2 {{(pid=88899) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Aug 03 08:54:11 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-728b6264-972b-497b-bd7b-7771a0c1f449 tempest-VolumeImageDependencyTests-942168115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_4c4d5e27-8270-414b-a3ff-95e222431c09_5ejxal4gdevstack@QuobyteHD /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-7e91f316-bba8-4ffc-83ee-4a736a9150d4 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:54:11 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-751788ad-ac59-4823-aa76-74ce981b0239 tempest-CreateVolumesFromSourceVolumeTest-1548484331 None] Acquiring lock "cinder-15d2e866-debf-430f-9423-331ff6e83fe8-delete_volume" by "delete_volume" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:54:11 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-751788ad-ac59-4823-aa76-74ce981b0239 tempest-CreateVolumesFromSourceVolumeTest-1548484331 None] Lock "cinder-15d2e866-debf-430f-9423-331ff6e83fe8-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:54:11 devstack sudo[113059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_4c4d5e27-8270-414b-a3ff-95e222431c09_5ejxal4gdevstack@QuobyteHD /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-7e91f316-bba8-4ffc-83ee-4a736a9150d4 Aug 03 08:54:11 devstack sudo[113059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:54:11 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-751788ad-ac59-4823-aa76-74ce981b0239 tempest-CreateVolumesFromSourceVolumeTest-1548484331 None] Acquiring lock "cinder-quobyte-15d2e866-debf-430f-9423-331ff6e83fe8" by "delete_volume" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:54:11 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-751788ad-ac59-4823-aa76-74ce981b0239 tempest-CreateVolumesFromSourceVolumeTest-1548484331 None] Lock "cinder-quobyte-15d2e866-debf-430f-9423-331ff6e83fe8" acquired by "delete_volume" :: waited 0.046s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:54:11 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dee262a-5cad-415b-b72f-dfd00ac698b5]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:54:11 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-751788ad-ac59-4823-aa76-74ce981b0239 tempest-CreateVolumesFromSourceVolumeTest-1548484331 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-15d2e866-debf-430f-9423-331ff6e83fe8 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:54:11 devstack sudo[113061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-15d2e866-debf-430f-9423-331ff6e83fe8 Aug 03 08:54:11 devstack sudo[113061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:54:12 devstack sudo[113061]: pam_unix(sudo:session): session closed for user root Aug 03 08:54:12 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-751788ad-ac59-4823-aa76-74ce981b0239 tempest-CreateVolumesFromSourceVolumeTest-1548484331 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-15d2e866-debf-430f-9423-331ff6e83fe8" returned: 0 in 0.868s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:54:12 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-751788ad-ac59-4823-aa76-74ce981b0239 tempest-CreateVolumesFromSourceVolumeTest-1548484331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-15d2e866-debf-430f-9423-331ff6e83fe8 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:54:12 devstack sudo[113076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-15d2e866-debf-430f-9423-331ff6e83fe8 Aug 03 08:54:12 devstack sudo[113076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:54:12 devstack sudo[113059]: pam_unix(sudo:session): session closed for user root Aug 03 08:54:12 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-728b6264-972b-497b-bd7b-7771a0c1f449 tempest-VolumeImageDependencyTests-942168115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_4c4d5e27-8270-414b-a3ff-95e222431c09_5ejxal4gdevstack@QuobyteHD /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-7e91f316-bba8-4ffc-83ee-4a736a9150d4" returned: 0 in 1.255s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:54:12 devstack cinder-volume[88899]: DEBUG cinder.image.image_utils [None req-728b6264-972b-497b-bd7b-7771a0c1f449 tempest-VolumeImageDependencyTests-942168115 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_4c4d5e27-8270-414b-a3ff-95e222431c09_5ejxal4gdevstack@QuobyteHD, size 0.00 MB, duration 1.26 sec, destination /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-7e91f316-bba8-4ffc-83ee-4a736a9150d4 {{(pid=88899) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 03 08:54:12 devstack cinder-volume[88899]: INFO cinder.image.image_utils [None req-728b6264-972b-497b-bd7b-7771a0c1f449 tempest-VolumeImageDependencyTests-942168115 None] Converted 0.00 MB image at 0.00 MB/s Aug 03 08:54:12 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-728b6264-972b-497b-bd7b-7771a0c1f449 tempest-VolumeImageDependencyTests-942168115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-7e91f316-bba8-4ffc-83ee-4a736a9150d4 1G {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:54:12 devstack sudo[113078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-7e91f316-bba8-4ffc-83ee-4a736a9150d4 1G Aug 03 08:54:12 devstack sudo[113078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:54:12 devstack sudo[113076]: pam_unix(sudo:session): session closed for user root Aug 03 08:54:12 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-751788ad-ac59-4823-aa76-74ce981b0239 tempest-CreateVolumesFromSourceVolumeTest-1548484331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-15d2e866-debf-430f-9423-331ff6e83fe8" returned: 0 in 0.591s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:54:13 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-751788ad-ac59-4823-aa76-74ce981b0239 tempest-CreateVolumesFromSourceVolumeTest-1548484331 None] Lock "cinder-quobyte-15d2e866-debf-430f-9423-331ff6e83fe8" released by "delete_volume" :: held 1.569s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:54:13 devstack cinder-volume[88899]: DEBUG cinder.quota [None req-751788ad-ac59-4823-aa76-74ce981b0239 tempest-CreateVolumesFromSourceVolumeTest-1548484331 None] Created reservations ['872f9d33-3cec-468f-bc5d-5f65e3dc0a4b', 'bedb9a52-c7a0-4ae4-b334-82f00ac53ea7', '32743e9a-326a-4df8-a62f-212bb6fda30b', '6f3f6612-04b8-4bff-839a-3e0edc29b508'] {{(pid=88899) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 08:54:13 devstack sudo[113078]: pam_unix(sudo:session): session closed for user root Aug 03 08:54:13 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-728b6264-972b-497b-bd7b-7771a0c1f449 tempest-VolumeImageDependencyTests-942168115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-7e91f316-bba8-4ffc-83ee-4a736a9150d4 1G" returned: 0 in 0.715s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:54:13 devstack cinder-volume[88899]: DEBUG cinder.volume.volume_utils [None req-728b6264-972b-497b-bd7b-7771a0c1f449 tempest-VolumeImageDependencyTests-942168115 None] Downloaded image 4c4d5e27-8270-414b-a3ff-95e222431c09 ((None, [{'url': 'file:///opt/stack/data/glance/images/4c4d5e27-8270-414b-a3ff-95e222431c09', 'metadata': {}}])) to volume 7e91f316-bba8-4ffc-83ee-4a736a9150d4 successfully. {{(pid=88899) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Aug 03 08:54:13 devstack cinder-volume[88899]: DEBUG cinder.image.image_utils [None req-728b6264-972b-497b-bd7b-7771a0c1f449 tempest-VolumeImageDependencyTests-942168115 None] Temporary image 4c4d5e27-8270-414b-a3ff-95e222431c09 for user ec19afbca65f4a8185b3231a39404ec7 is deleted. {{(pid=88899) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Aug 03 08:54:13 devstack cinder-volume[88899]: DEBUG cinder.volume.volume_utils [None req-728b6264-972b-497b-bd7b-7771a0c1f449 tempest-VolumeImageDependencyTests-942168115 None] Marking volume 7e91f316-bba8-4ffc-83ee-4a736a9150d4 as bootable. {{(pid=88899) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Aug 03 08:54:13 devstack cinder-volume[88899]: DEBUG cinder.volume.flows.manager.create_volume [None req-728b6264-972b-497b-bd7b-7771a0c1f449 tempest-VolumeImageDependencyTests-942168115 None] Copying metadata from image 4c4d5e27-8270-414b-a3ff-95e222431c09 to 7e91f316-bba8-4ffc-83ee-4a736a9150d4. {{(pid=88899) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Aug 03 08:54:13 devstack cinder-volume[88899]: DEBUG cinder.volume.flows.manager.create_volume [None req-728b6264-972b-497b-bd7b-7771a0c1f449 tempest-VolumeImageDependencyTests-942168115 None] Creating volume glance metadata for volume 7e91f316-bba8-4ffc-83ee-4a736a9150d4 backed by image 4c4d5e27-8270-414b-a3ff-95e222431c09 with: {'image_id': '4c4d5e27-8270-414b-a3ff-95e222431c09', 'image_name': 'image-for-test-e6050452-06bd-4c7f-9912-45178c83e379', 'checksum': 'd831e5cfdb92a9cb5d0b8f0a554b1972', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=88899) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Aug 03 08:54:13 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-751788ad-ac59-4823-aa76-74ce981b0239 tempest-CreateVolumesFromSourceVolumeTest-1548484331 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:54:13 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-751788ad-ac59-4823-aa76-74ce981b0239 tempest-CreateVolumesFromSourceVolumeTest-1548484331 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:54:13 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-751788ad-ac59-4823-aa76-74ce981b0239 tempest-CreateVolumesFromSourceVolumeTest-1548484331 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:54:13 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-751788ad-ac59-4823-aa76-74ce981b0239 tempest-CreateVolumesFromSourceVolumeTest-1548484331 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:54:13 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-751788ad-ac59-4823-aa76-74ce981b0239 tempest-CreateVolumesFromSourceVolumeTest-1548484331 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:54:13 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-751788ad-ac59-4823-aa76-74ce981b0239 tempest-CreateVolumesFromSourceVolumeTest-1548484331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:54:13 devstack sudo[113084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a Aug 03 08:54:13 devstack sudo[113084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:54:13 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-728b6264-972b-497b-bd7b-7771a0c1f449 tempest-VolumeImageDependencyTests-942168115 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd76db5a-f578-473a-9d0d-827d193cf99d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7e91f316-bba8-4ffc-83ee-4a736a9150d4', 'volume_size': 1, 'image_id': '4c4d5e27-8270-414b-a3ff-95e222431c09', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4c4d5e27-8270-414b-a3ff-95e222431c09', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-e6050452-06bd-4c7f-9912-45178c83e379', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'd831e5cfdb92a9cb5d0b8f0a554b1972', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'fb20ce3648d1497fb23ac775415e7a44', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'a498ffeeb51b915f557573a9ecfb77bf8e7e4284d6fed070535d7905defab475e8fada0510b1d47d8457cad07f293efa6133d910470e9cec796dd91eb9caf671', 'id': '4c4d5e27-8270-414b-a3ff-95e222431c09', 'created_at': datetime.datetime(2026, 8, 3, 6, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 3, 6, 54, 2, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4c4d5e27-8270-414b-a3ff-95e222431c09/file', 'properties': {}}, 'image_service': }' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:54:13 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-728b6264-972b-497b-bd7b-7771a0c1f449 tempest-VolumeImageDependencyTests-942168115 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9e19e92-d8d3-4ea7-b947-c32b9da6a40d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:54:13 devstack cinder-volume[88899]: INFO cinder.volume.flows.manager.create_volume [None req-728b6264-972b-497b-bd7b-7771a0c1f449 tempest-VolumeImageDependencyTests-942168115 None] Volume volume-7e91f316-bba8-4ffc-83ee-4a736a9150d4 (7e91f316-bba8-4ffc-83ee-4a736a9150d4): created successfully Aug 03 08:54:13 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-728b6264-972b-497b-bd7b-7771a0c1f449 tempest-VolumeImageDependencyTests-942168115 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9e19e92-d8d3-4ea7-b947-c32b9da6a40d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:54:13 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-728b6264-972b-497b-bd7b-7771a0c1f449 tempest-VolumeImageDependencyTests-942168115 None] Flow 'volume_create_manager' (6ca7523d-2ba8-47cd-bb22-636f1e9f5216) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:54:13 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-728b6264-972b-497b-bd7b-7771a0c1f449 tempest-VolumeImageDependencyTests-942168115 None] Created volume successfully. Aug 03 08:54:13 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-e0a37b5f-acbd-4d58-b22b-aca10f9e1f41 tempest-CreateVolumesFromSourceVolumeTest-1548484331 None] Acquiring lock "cinder-bedf4025-37c4-48e1-9263-68cdfa19f915-delete_volume" by "delete_volume" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:54:13 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-e0a37b5f-acbd-4d58-b22b-aca10f9e1f41 tempest-CreateVolumesFromSourceVolumeTest-1548484331 None] Lock "cinder-bedf4025-37c4-48e1-9263-68cdfa19f915-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:54:13 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-e0a37b5f-acbd-4d58-b22b-aca10f9e1f41 tempest-CreateVolumesFromSourceVolumeTest-1548484331 None] Acquiring lock "cinder-quobyte-bedf4025-37c4-48e1-9263-68cdfa19f915" by "delete_volume" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:54:13 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-e0a37b5f-acbd-4d58-b22b-aca10f9e1f41 tempest-CreateVolumesFromSourceVolumeTest-1548484331 None] Lock "cinder-quobyte-bedf4025-37c4-48e1-9263-68cdfa19f915" acquired by "delete_volume" :: waited 0.037s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:54:14 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b647003-b81b-4999-a6e6-f1d0112367fc]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:54:14 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-e0a37b5f-acbd-4d58-b22b-aca10f9e1f41 tempest-CreateVolumesFromSourceVolumeTest-1548484331 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-bedf4025-37c4-48e1-9263-68cdfa19f915 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:54:14 devstack sudo[113086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-bedf4025-37c4-48e1-9263-68cdfa19f915 Aug 03 08:54:14 devstack sudo[113086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:54:14 devstack sudo[113084]: pam_unix(sudo:session): session closed for user root Aug 03 08:54:14 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-751788ad-ac59-4823-aa76-74ce981b0239 tempest-CreateVolumesFromSourceVolumeTest-1548484331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a" returned: 0 in 0.968s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:54:14 devstack cinder-volume[88899]: DEBUG cinder.manager [None req-751788ad-ac59-4823-aa76-74ce981b0239 tempest-CreateVolumesFromSourceVolumeTest-1548484331 None] Notifying Schedulers of capabilities ... {{(pid=88899) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 08:54:14 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-751788ad-ac59-4823-aa76-74ce981b0239 tempest-CreateVolumesFromSourceVolumeTest-1548484331 None] Deleted volume successfully. Aug 03 08:54:14 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-751788ad-ac59-4823-aa76-74ce981b0239 tempest-CreateVolumesFromSourceVolumeTest-1548484331 None] Lock "cinder-15d2e866-debf-430f-9423-331ff6e83fe8-delete_volume" released by "delete_volume" :: held 3.250s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:54:14 devstack sudo[113086]: pam_unix(sudo:session): session closed for user root Aug 03 08:54:14 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-e0a37b5f-acbd-4d58-b22b-aca10f9e1f41 tempest-CreateVolumesFromSourceVolumeTest-1548484331 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-bedf4025-37c4-48e1-9263-68cdfa19f915" returned: 0 in 0.658s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:54:14 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-e0a37b5f-acbd-4d58-b22b-aca10f9e1f41 tempest-CreateVolumesFromSourceVolumeTest-1548484331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-bedf4025-37c4-48e1-9263-68cdfa19f915 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:54:14 devstack sudo[113092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-bedf4025-37c4-48e1-9263-68cdfa19f915 Aug 03 08:54:14 devstack sudo[113092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:54:15 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-3d5ba265-ebc4-4365-a55e-5bfe82471a16 tempest-VolumeImageDependencyTests-942168115 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:54:15 devstack sudo[113092]: pam_unix(sudo:session): session closed for user root Aug 03 08:54:15 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-e0a37b5f-acbd-4d58-b22b-aca10f9e1f41 tempest-CreateVolumesFromSourceVolumeTest-1548484331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-bedf4025-37c4-48e1-9263-68cdfa19f915" returned: 0 in 0.778s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:54:15 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-e0a37b5f-acbd-4d58-b22b-aca10f9e1f41 tempest-CreateVolumesFromSourceVolumeTest-1548484331 None] Lock "cinder-quobyte-bedf4025-37c4-48e1-9263-68cdfa19f915" released by "delete_volume" :: held 1.532s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:54:15 devstack cinder-volume[88899]: DEBUG cinder.quota [None req-e0a37b5f-acbd-4d58-b22b-aca10f9e1f41 tempest-CreateVolumesFromSourceVolumeTest-1548484331 None] Created reservations ['3de253cf-4ca7-4a7f-ab25-fa645a847cda', '5df02a6b-9d65-4c18-920f-d772a5b0dccb', 'fd6ea4b5-e364-491e-8001-d23b3741c37e', '0c634086-723c-4b5a-a5d7-f62cd999b77c'] {{(pid=88899) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 08:54:15 devstack sudo[113040]: pam_unix(sudo:session): session closed for user root Aug 03 08:54:15 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-737a3e3e-fd0d-4d77-b392-cb646e0e659f tempest-VolumeDependencyTests-1512358985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-e65a2b63-8524-45ea-92ab-d4db1c52b46c /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-815ad7f9-1a36-40cf-ad01-1e9d227a15de" returned: 0 in 5.103s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:54:15 devstack cinder-volume[88899]: DEBUG cinder.image.image_utils [None req-737a3e3e-fd0d-4d77-b392-cb646e0e659f tempest-VolumeDependencyTests-1512358985 None] Image conversion details: src /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-e65a2b63-8524-45ea-92ab-d4db1c52b46c, size 1024.00 MB, duration 5.10 sec, destination /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-815ad7f9-1a36-40cf-ad01-1e9d227a15de {{(pid=88899) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 03 08:54:15 devstack cinder-volume[88899]: INFO cinder.image.image_utils [None req-737a3e3e-fd0d-4d77-b392-cb646e0e659f tempest-VolumeDependencyTests-1512358985 None] Converted 1024.00 MB image at 200.62 MB/s Aug 03 08:54:15 devstack cinder-volume[88899]: WARNING cinder.volume.drivers.remotefs [None req-737a3e3e-fd0d-4d77-b392-cb646e0e659f tempest-VolumeDependencyTests-1512358985 None] /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-815ad7f9-1a36-40cf-ad01-1e9d227a15de is being set with open permissions: ugo+rw Aug 03 08:54:15 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-737a3e3e-fd0d-4d77-b392-cb646e0e659f tempest-VolumeDependencyTests-1512358985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-815ad7f9-1a36-40cf-ad01-1e9d227a15de {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:54:15 devstack sudo[113095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-815ad7f9-1a36-40cf-ad01-1e9d227a15de Aug 03 08:54:15 devstack sudo[113095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:54:15 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-e0a37b5f-acbd-4d58-b22b-aca10f9e1f41 tempest-CreateVolumesFromSourceVolumeTest-1548484331 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:54:15 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-e0a37b5f-acbd-4d58-b22b-aca10f9e1f41 tempest-CreateVolumesFromSourceVolumeTest-1548484331 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:54:15 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-e0a37b5f-acbd-4d58-b22b-aca10f9e1f41 tempest-CreateVolumesFromSourceVolumeTest-1548484331 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:54:15 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-e0a37b5f-acbd-4d58-b22b-aca10f9e1f41 tempest-CreateVolumesFromSourceVolumeTest-1548484331 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:54:15 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-e0a37b5f-acbd-4d58-b22b-aca10f9e1f41 tempest-CreateVolumesFromSourceVolumeTest-1548484331 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:54:15 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-e0a37b5f-acbd-4d58-b22b-aca10f9e1f41 tempest-CreateVolumesFromSourceVolumeTest-1548484331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:54:15 devstack sudo[113097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a Aug 03 08:54:15 devstack sudo[113097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:54:15 devstack sudo[113095]: pam_unix(sudo:session): session closed for user root Aug 03 08:54:15 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-737a3e3e-fd0d-4d77-b392-cb646e0e659f tempest-VolumeDependencyTests-1512358985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-815ad7f9-1a36-40cf-ad01-1e9d227a15de" returned: 0 in 0.238s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:54:15 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-737a3e3e-fd0d-4d77-b392-cb646e0e659f tempest-VolumeDependencyTests-1512358985 None] Lock "cinder-quobyte-815ad7f9-1a36-40cf-ad01-1e9d227a15de" released by "_copy_volume_from_snapshot" :: held 6.265s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:54:15 devstack sudo[113097]: pam_unix(sudo:session): session closed for user root Aug 03 08:54:15 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-737a3e3e-fd0d-4d77-b392-cb646e0e659f tempest-VolumeDependencyTests-1512358985 None] Lock "cinder-quobyte-2516a2a6-9817-4bf8-92c6-7997e16150cd-815ad7f9-1a36-40cf-ad01-1e9d227a15de" released by "_create_volume_from_snapshot" :: held 6.348s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:54:15 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-737a3e3e-fd0d-4d77-b392-cb646e0e659f tempest-VolumeDependencyTests-1512358985 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.373s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:54:15 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-f4b2326f-d276-46cd-8ab6-9e3d8016598a tempest-ProjectMemberTests-1353074417 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.076s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:54:15 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-f4b2326f-d276-46cd-8ab6-9e3d8016598a tempest-ProjectMemberTests-1353074417 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:54:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-626219515',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b212a917-a56b-4d65-b829-65305ef88db2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b723e915839a4036ad739740ec4db0cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:54:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:54:10Z,use_quota=True,user_id='d9152484679b4fb79b0d8896a2a67eb9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8bde7129-1dc4-42ab-b852-ab32c61b4921),volume_type_id=8bde7129-1dc4-42ab-b852-ab32c61b4921)}" {{(pid=88899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 08:54:15 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-f4b2326f-d276-46cd-8ab6-9e3d8016598a tempest-ProjectMemberTests-1353074417 None] Creating volume b212a917-a56b-4d65-b829-65305ef88db2 {{(pid=88899) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 08:54:15 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-f4b2326f-d276-46cd-8ab6-9e3d8016598a tempest-ProjectMemberTests-1353074417 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:54:15 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-f4b2326f-d276-46cd-8ab6-9e3d8016598a tempest-ProjectMemberTests-1353074417 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:54:15 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-f4b2326f-d276-46cd-8ab6-9e3d8016598a tempest-ProjectMemberTests-1353074417 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:54:15 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-f4b2326f-d276-46cd-8ab6-9e3d8016598a tempest-ProjectMemberTests-1353074417 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:54:15 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-f4b2326f-d276-46cd-8ab6-9e3d8016598a tempest-ProjectMemberTests-1353074417 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:54:15 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-f4b2326f-d276-46cd-8ab6-9e3d8016598a tempest-ProjectMemberTests-1353074417 None] Selected osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385 as target Quobyte volume. {{(pid=88899) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 08:54:15 devstack cinder-volume[88899]: INFO cinder.volume.drivers.remotefs [None req-f4b2326f-d276-46cd-8ab6-9e3d8016598a tempest-ProjectMemberTests-1353074417 None] casted to osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385 Aug 03 08:54:15 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-f4b2326f-d276-46cd-8ab6-9e3d8016598a tempest-ProjectMemberTests-1353074417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-b212a917-a56b-4d65-b829-65305ef88db2 1073741824 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:54:15 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-e0a37b5f-acbd-4d58-b22b-aca10f9e1f41 tempest-CreateVolumesFromSourceVolumeTest-1548484331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a" returned: 0 in 0.263s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:54:15 devstack cinder-volume[88899]: DEBUG cinder.manager [None req-e0a37b5f-acbd-4d58-b22b-aca10f9e1f41 tempest-CreateVolumesFromSourceVolumeTest-1548484331 None] Notifying Schedulers of capabilities ... {{(pid=88899) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 08:54:15 devstack sudo[113101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-b212a917-a56b-4d65-b829-65305ef88db2 1073741824 Aug 03 08:54:15 devstack sudo[113101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:54:15 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-e0a37b5f-acbd-4d58-b22b-aca10f9e1f41 tempest-CreateVolumesFromSourceVolumeTest-1548484331 None] Deleted volume successfully. Aug 03 08:54:15 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-737a3e3e-fd0d-4d77-b392-cb646e0e659f tempest-VolumeDependencyTests-1512358985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2cb43820-3088-454a-a5a4-f8c4638e39c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-815ad7f9-1a36-40cf-ad01-1e9d227a15de', 'volume_size': 1, 'snapshot_id': '2516a2a6-9817-4bf8-92c6-7997e16150cd'}' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:54:15 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-737a3e3e-fd0d-4d77-b392-cb646e0e659f tempest-VolumeDependencyTests-1512358985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1707dc2c-5374-4685-aab8-804b15f8eedf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:54:16 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-e0a37b5f-acbd-4d58-b22b-aca10f9e1f41 tempest-CreateVolumesFromSourceVolumeTest-1548484331 None] Lock "cinder-bedf4025-37c4-48e1-9263-68cdfa19f915-delete_volume" released by "delete_volume" :: held 2.165s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:54:16 devstack cinder-volume[88899]: INFO cinder.volume.flows.manager.create_volume [None req-737a3e3e-fd0d-4d77-b392-cb646e0e659f tempest-VolumeDependencyTests-1512358985 None] Volume volume-815ad7f9-1a36-40cf-ad01-1e9d227a15de (815ad7f9-1a36-40cf-ad01-1e9d227a15de): created successfully Aug 03 08:54:16 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-737a3e3e-fd0d-4d77-b392-cb646e0e659f tempest-VolumeDependencyTests-1512358985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1707dc2c-5374-4685-aab8-804b15f8eedf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:54:16 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-737a3e3e-fd0d-4d77-b392-cb646e0e659f tempest-VolumeDependencyTests-1512358985 None] Flow 'volume_create_manager' (ac3fb4f5-ae98-471b-a432-bd87a5e5541b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:54:16 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-737a3e3e-fd0d-4d77-b392-cb646e0e659f tempest-VolumeDependencyTests-1512358985 None] Created volume successfully. Aug 03 08:54:16 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-1ddc71fb-f12a-4548-b19a-d0ddfbe3e64d tempest-CreateVolumesFromSourceVolumeTest-1548484331 None] Acquiring lock "cinder-6801cbde-6fdb-4670-a538-6f836f9c0626-delete_volume" by "delete_volume" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:54:16 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-1ddc71fb-f12a-4548-b19a-d0ddfbe3e64d tempest-CreateVolumesFromSourceVolumeTest-1548484331 None] Lock "cinder-6801cbde-6fdb-4670-a538-6f836f9c0626-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:54:16 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-1ddc71fb-f12a-4548-b19a-d0ddfbe3e64d tempest-CreateVolumesFromSourceVolumeTest-1548484331 None] Acquiring lock "cinder-quobyte-6801cbde-6fdb-4670-a538-6f836f9c0626" by "delete_volume" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:54:16 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-1ddc71fb-f12a-4548-b19a-d0ddfbe3e64d tempest-CreateVolumesFromSourceVolumeTest-1548484331 None] Lock "cinder-quobyte-6801cbde-6fdb-4670-a538-6f836f9c0626" acquired by "delete_volume" :: waited 0.014s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:54:16 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8c33856-6370-47b6-a07a-c4d075b16830]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:54:16 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-1ddc71fb-f12a-4548-b19a-d0ddfbe3e64d tempest-CreateVolumesFromSourceVolumeTest-1548484331 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-6801cbde-6fdb-4670-a538-6f836f9c0626 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:54:16 devstack sudo[113106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-6801cbde-6fdb-4670-a538-6f836f9c0626 Aug 03 08:54:16 devstack sudo[113106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:54:16 devstack sudo[113101]: pam_unix(sudo:session): session closed for user root Aug 03 08:54:16 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-f4b2326f-d276-46cd-8ab6-9e3d8016598a tempest-ProjectMemberTests-1353074417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-b212a917-a56b-4d65-b829-65305ef88db2 1073741824" returned: 0 in 0.475s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:54:16 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-f4b2326f-d276-46cd-8ab6-9e3d8016598a tempest-ProjectMemberTests-1353074417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-b212a917-a56b-4d65-b829-65305ef88db2 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:54:16 devstack sudo[113109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-b212a917-a56b-4d65-b829-65305ef88db2 Aug 03 08:54:16 devstack sudo[113109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:54:16 devstack sudo[113106]: pam_unix(sudo:session): session closed for user root Aug 03 08:54:16 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-1ddc71fb-f12a-4548-b19a-d0ddfbe3e64d tempest-CreateVolumesFromSourceVolumeTest-1548484331 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-6801cbde-6fdb-4670-a538-6f836f9c0626" returned: 0 in 0.362s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:54:16 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-1ddc71fb-f12a-4548-b19a-d0ddfbe3e64d tempest-CreateVolumesFromSourceVolumeTest-1548484331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-6801cbde-6fdb-4670-a538-6f836f9c0626 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:54:16 devstack sudo[113114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-6801cbde-6fdb-4670-a538-6f836f9c0626 Aug 03 08:54:16 devstack sudo[113114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:54:16 devstack sudo[113109]: pam_unix(sudo:session): session closed for user root Aug 03 08:54:16 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-f4b2326f-d276-46cd-8ab6-9e3d8016598a tempest-ProjectMemberTests-1353074417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-b212a917-a56b-4d65-b829-65305ef88db2" returned: 0 in 0.245s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:54:16 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-f4b2326f-d276-46cd-8ab6-9e3d8016598a tempest-ProjectMemberTests-1353074417 None] <== create_volume: return (758ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'} {{(pid=88899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 08:54:16 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-f4b2326f-d276-46cd-8ab6-9e3d8016598a tempest-ProjectMemberTests-1353074417 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.761s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:54:16 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-3d5ba265-ebc4-4365-a55e-5bfe82471a16 tempest-VolumeImageDependencyTests-942168115 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.537s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:54:16 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-f4b2326f-d276-46cd-8ab6-9e3d8016598a tempest-ProjectMemberTests-1353074417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8156c70f-9257-4520-9c4b-d7bdabd8342c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b212a917-a56b-4d65-b829-65305ef88db2', 'volume_size': 1}' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:54:16 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-f4b2326f-d276-46cd-8ab6-9e3d8016598a tempest-ProjectMemberTests-1353074417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7da5013a-e8be-4642-a081-5ff47f44364e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:54:16 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-3d5ba265-ebc4-4365-a55e-5bfe82471a16 tempest-VolumeImageDependencyTests-942168115 None] Creating offline snapshot d9af9b72-e2ca-483a-890e-ba54c1e8b28a of volume 7e91f316-bba8-4ffc-83ee-4a736a9150d4 {{(pid=88899) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 03 08:54:16 devstack cinder-volume[88899]: INFO cinder.volume.flows.manager.create_volume [None req-f4b2326f-d276-46cd-8ab6-9e3d8016598a tempest-ProjectMemberTests-1353074417 None] Volume volume-b212a917-a56b-4d65-b829-65305ef88db2 (b212a917-a56b-4d65-b829-65305ef88db2): created successfully Aug 03 08:54:16 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-f4b2326f-d276-46cd-8ab6-9e3d8016598a tempest-ProjectMemberTests-1353074417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7da5013a-e8be-4642-a081-5ff47f44364e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:54:16 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-f4b2326f-d276-46cd-8ab6-9e3d8016598a tempest-ProjectMemberTests-1353074417 None] Flow 'volume_create_manager' (f5e13a9f-e122-4ee7-b17d-07d8d63f3923) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:54:16 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[695f0177-5236-46b0-be80-fee56ccf793d]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:54:16 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-3d5ba265-ebc4-4365-a55e-5bfe82471a16 tempest-VolumeImageDependencyTests-942168115 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-7e91f316-bba8-4ffc-83ee-4a736a9150d4 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:54:16 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-f4b2326f-d276-46cd-8ab6-9e3d8016598a tempest-ProjectMemberTests-1353074417 None] Created volume successfully. Aug 03 08:54:16 devstack sudo[113117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-7e91f316-bba8-4ffc-83ee-4a736a9150d4 Aug 03 08:54:16 devstack sudo[113117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:54:16 devstack sudo[113114]: pam_unix(sudo:session): session closed for user root Aug 03 08:54:16 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-1ddc71fb-f12a-4548-b19a-d0ddfbe3e64d tempest-CreateVolumesFromSourceVolumeTest-1548484331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-6801cbde-6fdb-4670-a538-6f836f9c0626" returned: 0 in 0.268s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:54:16 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-1ddc71fb-f12a-4548-b19a-d0ddfbe3e64d tempest-CreateVolumesFromSourceVolumeTest-1548484331 None] Lock "cinder-quobyte-6801cbde-6fdb-4670-a538-6f836f9c0626" released by "delete_volume" :: held 0.667s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:54:16 devstack cinder-volume[88899]: DEBUG cinder.quota [None req-1ddc71fb-f12a-4548-b19a-d0ddfbe3e64d tempest-CreateVolumesFromSourceVolumeTest-1548484331 None] Created reservations ['c67fa8c4-44d5-42bc-9f71-498b8366a126', 'bd1bf3c9-1f21-4a38-bc2d-1c59c1e8924b', '01de9524-6c6c-44b4-9354-64cb483ee098', '711c240c-d84d-411c-a761-e5629b089737'] {{(pid=88899) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 08:54:17 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-1ddc71fb-f12a-4548-b19a-d0ddfbe3e64d tempest-CreateVolumesFromSourceVolumeTest-1548484331 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:54:17 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-1ddc71fb-f12a-4548-b19a-d0ddfbe3e64d tempest-CreateVolumesFromSourceVolumeTest-1548484331 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:54:17 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-1ddc71fb-f12a-4548-b19a-d0ddfbe3e64d tempest-CreateVolumesFromSourceVolumeTest-1548484331 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:54:17 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-1ddc71fb-f12a-4548-b19a-d0ddfbe3e64d tempest-CreateVolumesFromSourceVolumeTest-1548484331 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:54:17 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-1ddc71fb-f12a-4548-b19a-d0ddfbe3e64d tempest-CreateVolumesFromSourceVolumeTest-1548484331 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:54:17 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-1ddc71fb-f12a-4548-b19a-d0ddfbe3e64d tempest-CreateVolumesFromSourceVolumeTest-1548484331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:54:17 devstack sudo[113120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a Aug 03 08:54:17 devstack sudo[113120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:54:17 devstack sudo[113117]: pam_unix(sudo:session): session closed for user root Aug 03 08:54:17 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-3d5ba265-ebc4-4365-a55e-5bfe82471a16 tempest-VolumeImageDependencyTests-942168115 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-7e91f316-bba8-4ffc-83ee-4a736a9150d4" returned: 0 in 0.416s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:54:17 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-3d5ba265-ebc4-4365-a55e-5bfe82471a16 tempest-VolumeImageDependencyTests-942168115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-7e91f316-bba8-4ffc-83ee-4a736a9150d4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-7e91f316-bba8-4ffc-83ee-4a736a9150d4.d9af9b72-e2ca-483a-890e-ba54c1e8b28a 1G {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:54:17 devstack sudo[113125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-7e91f316-bba8-4ffc-83ee-4a736a9150d4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-7e91f316-bba8-4ffc-83ee-4a736a9150d4.d9af9b72-e2ca-483a-890e-ba54c1e8b28a 1G Aug 03 08:54:17 devstack sudo[113125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:54:17 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-03cbedba-2ad5-416f-a296-58eb60580618 tempest-VolumeDependencyTests-1512358985 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:54:17 devstack sudo[113120]: pam_unix(sudo:session): session closed for user root Aug 03 08:54:17 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-1ddc71fb-f12a-4548-b19a-d0ddfbe3e64d tempest-CreateVolumesFromSourceVolumeTest-1548484331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a" returned: 0 in 0.305s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:54:17 devstack cinder-volume[88899]: DEBUG cinder.manager [None req-1ddc71fb-f12a-4548-b19a-d0ddfbe3e64d tempest-CreateVolumesFromSourceVolumeTest-1548484331 None] Notifying Schedulers of capabilities ... {{(pid=88899) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 08:54:17 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-1ddc71fb-f12a-4548-b19a-d0ddfbe3e64d tempest-CreateVolumesFromSourceVolumeTest-1548484331 None] Deleted volume successfully. Aug 03 08:54:17 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-1ddc71fb-f12a-4548-b19a-d0ddfbe3e64d tempest-CreateVolumesFromSourceVolumeTest-1548484331 None] Lock "cinder-6801cbde-6fdb-4670-a538-6f836f9c0626-delete_volume" released by "delete_volume" :: held 1.208s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:54:17 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-a4f44538-5efe-4261-b16c-9da97005d4f7 tempest-ProjectMemberTests-1353074417 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:54:17 devstack sudo[113125]: pam_unix(sudo:session): session closed for user root Aug 03 08:54:17 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-3d5ba265-ebc4-4365-a55e-5bfe82471a16 tempest-VolumeImageDependencyTests-942168115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-7e91f316-bba8-4ffc-83ee-4a736a9150d4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-7e91f316-bba8-4ffc-83ee-4a736a9150d4.d9af9b72-e2ca-483a-890e-ba54c1e8b28a 1G" returned: 0 in 0.546s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:54:17 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-3d5ba265-ebc4-4365-a55e-5bfe82471a16 tempest-VolumeImageDependencyTests-942168115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7e91f316-bba8-4ffc-83ee-4a736a9150d4 -F qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-7e91f316-bba8-4ffc-83ee-4a736a9150d4.d9af9b72-e2ca-483a-890e-ba54c1e8b28a {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:54:17 devstack sudo[113132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7e91f316-bba8-4ffc-83ee-4a736a9150d4 -F qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-7e91f316-bba8-4ffc-83ee-4a736a9150d4.d9af9b72-e2ca-483a-890e-ba54c1e8b28a Aug 03 08:54:17 devstack sudo[113132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:54:18 devstack sudo[113132]: pam_unix(sudo:session): session closed for user root Aug 03 08:54:18 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-3d5ba265-ebc4-4365-a55e-5bfe82471a16 tempest-VolumeImageDependencyTests-942168115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7e91f316-bba8-4ffc-83ee-4a736a9150d4 -F qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-7e91f316-bba8-4ffc-83ee-4a736a9150d4.d9af9b72-e2ca-483a-890e-ba54c1e8b28a" returned: 0 in 0.305s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:54:18 devstack cinder-volume[88899]: WARNING cinder.volume.drivers.remotefs [None req-3d5ba265-ebc4-4365-a55e-5bfe82471a16 tempest-VolumeImageDependencyTests-942168115 None] /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-7e91f316-bba8-4ffc-83ee-4a736a9150d4.d9af9b72-e2ca-483a-890e-ba54c1e8b28a is being set with open permissions: ugo+rw Aug 03 08:54:18 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-3d5ba265-ebc4-4365-a55e-5bfe82471a16 tempest-VolumeImageDependencyTests-942168115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-7e91f316-bba8-4ffc-83ee-4a736a9150d4.d9af9b72-e2ca-483a-890e-ba54c1e8b28a {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:54:18 devstack sudo[113137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-7e91f316-bba8-4ffc-83ee-4a736a9150d4.d9af9b72-e2ca-483a-890e-ba54c1e8b28a Aug 03 08:54:18 devstack sudo[113137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:54:18 devstack sudo[113137]: pam_unix(sudo:session): session closed for user root Aug 03 08:54:18 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-3d5ba265-ebc4-4365-a55e-5bfe82471a16 tempest-VolumeImageDependencyTests-942168115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-7e91f316-bba8-4ffc-83ee-4a736a9150d4.d9af9b72-e2ca-483a-890e-ba54c1e8b28a" returned: 0 in 0.307s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:54:18 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-3d5ba265-ebc4-4365-a55e-5bfe82471a16 tempest-VolumeImageDependencyTests-942168115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-7e91f316-bba8-4ffc-83ee-4a736a9150d4.info {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:54:18 devstack sudo[113141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-7e91f316-bba8-4ffc-83ee-4a736a9150d4.info Aug 03 08:54:18 devstack sudo[113141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:54:18 devstack sudo[113141]: pam_unix(sudo:session): session closed for user root Aug 03 08:54:18 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-3d5ba265-ebc4-4365-a55e-5bfe82471a16 tempest-VolumeImageDependencyTests-942168115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-7e91f316-bba8-4ffc-83ee-4a736a9150d4.info" returned: 0 in 0.268s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:54:18 devstack cinder-volume[88899]: WARNING cinder.volume.drivers.remotefs [None req-3d5ba265-ebc4-4365-a55e-5bfe82471a16 tempest-VolumeImageDependencyTests-942168115 None] /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-7e91f316-bba8-4ffc-83ee-4a736a9150d4.info is being set with open permissions: ugo+rw Aug 03 08:54:18 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-3d5ba265-ebc4-4365-a55e-5bfe82471a16 tempest-VolumeImageDependencyTests-942168115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-7e91f316-bba8-4ffc-83ee-4a736a9150d4.info {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:54:18 devstack sudo[113145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-7e91f316-bba8-4ffc-83ee-4a736a9150d4.info Aug 03 08:54:18 devstack sudo[113145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:54:18 devstack sudo[113145]: pam_unix(sudo:session): session closed for user root Aug 03 08:54:18 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-3d5ba265-ebc4-4365-a55e-5bfe82471a16 tempest-VolumeImageDependencyTests-942168115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-7e91f316-bba8-4ffc-83ee-4a736a9150d4.info" returned: 0 in 0.251s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:54:18 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-3d5ba265-ebc4-4365-a55e-5bfe82471a16 tempest-VolumeImageDependencyTests-942168115 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.240s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:54:18 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-03cbedba-2ad5-416f-a296-58eb60580618 tempest-VolumeDependencyTests-1512358985 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.666s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:54:18 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-03cbedba-2ad5-416f-a296-58eb60580618 tempest-VolumeDependencyTests-1512358985 None] Creating offline snapshot a666f4a5-6cda-48b1-b8ce-a900da8e4a05 of volume 815ad7f9-1a36-40cf-ad01-1e9d227a15de {{(pid=88899) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 03 08:54:18 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a9c0e16-af2e-4bd0-8ca0-b8349916ad75]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:54:18 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-03cbedba-2ad5-416f-a296-58eb60580618 tempest-VolumeDependencyTests-1512358985 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-815ad7f9-1a36-40cf-ad01-1e9d227a15de {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:54:19 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-3d5ba265-ebc4-4365-a55e-5bfe82471a16 tempest-VolumeImageDependencyTests-942168115 None] Create snapshot completed successfully Aug 03 08:54:19 devstack sudo[113148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-815ad7f9-1a36-40cf-ad01-1e9d227a15de Aug 03 08:54:19 devstack sudo[113148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:54:19 devstack sudo[113148]: pam_unix(sudo:session): session closed for user root Aug 03 08:54:19 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-03cbedba-2ad5-416f-a296-58eb60580618 tempest-VolumeDependencyTests-1512358985 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-815ad7f9-1a36-40cf-ad01-1e9d227a15de" returned: 0 in 0.426s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:54:19 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-03cbedba-2ad5-416f-a296-58eb60580618 tempest-VolumeDependencyTests-1512358985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-815ad7f9-1a36-40cf-ad01-1e9d227a15de,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-815ad7f9-1a36-40cf-ad01-1e9d227a15de.a666f4a5-6cda-48b1-b8ce-a900da8e4a05 1G {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:54:19 devstack sudo[113153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-815ad7f9-1a36-40cf-ad01-1e9d227a15de,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-815ad7f9-1a36-40cf-ad01-1e9d227a15de.a666f4a5-6cda-48b1-b8ce-a900da8e4a05 1G Aug 03 08:54:19 devstack sudo[113153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:54:19 devstack cinder-volume[88899]: DEBUG cinder.volume.flows.manager.create_volume [None req-3febb226-b62a-4bcc-a1e2-e6f844c68b9e tempest-VolumeImageDependencyTests-942168115 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88899) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 08:54:19 devstack sudo[113153]: pam_unix(sudo:session): session closed for user root Aug 03 08:54:19 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-3febb226-b62a-4bcc-a1e2-e6f844c68b9e tempest-VolumeImageDependencyTests-942168115 None] Flow 'volume_create_manager' (659842b2-0633-4850-93b3-fefef5490d8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:54:19 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-3febb226-b62a-4bcc-a1e2-e6f844c68b9e tempest-VolumeImageDependencyTests-942168115 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (35c1ff78-7fa9-42d8-8d7c-41c4483556fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:54:19 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-03cbedba-2ad5-416f-a296-58eb60580618 tempest-VolumeDependencyTests-1512358985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-815ad7f9-1a36-40cf-ad01-1e9d227a15de,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-815ad7f9-1a36-40cf-ad01-1e9d227a15de.a666f4a5-6cda-48b1-b8ce-a900da8e4a05 1G" returned: 0 in 0.527s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:54:19 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-03cbedba-2ad5-416f-a296-58eb60580618 tempest-VolumeDependencyTests-1512358985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-815ad7f9-1a36-40cf-ad01-1e9d227a15de -F qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-815ad7f9-1a36-40cf-ad01-1e9d227a15de.a666f4a5-6cda-48b1-b8ce-a900da8e4a05 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:54:19 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-3febb226-b62a-4bcc-a1e2-e6f844c68b9e tempest-VolumeImageDependencyTests-942168115 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (35c1ff78-7fa9-42d8-8d7c-41c4483556fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=True,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:54:20Z,deleted=False,deleted_at=None,display_description=None,display_name='volume2-for-test-e6050452-06bd-4c7f-9912-45178c83e379',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f79d4488-b6ea-4aed-864a-f7b3df306ab7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fb20ce3648d1497fb23ac775415e7a44',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:54:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=d9af9b72-e2ca-483a-890e-ba54c1e8b28a,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:54:20Z,use_quota=True,user_id='ec19afbca65f4a8185b3231a39404ec7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8bde7129-1dc4-42ab-b852-ab32c61b4921),volume_type_id=8bde7129-1dc4-42ab-b852-ab32c61b4921)' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:54:19 devstack sudo[113159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-815ad7f9-1a36-40cf-ad01-1e9d227a15de -F qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-815ad7f9-1a36-40cf-ad01-1e9d227a15de.a666f4a5-6cda-48b1-b8ce-a900da8e4a05 Aug 03 08:54:19 devstack sudo[113159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:54:19 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-3febb226-b62a-4bcc-a1e2-e6f844c68b9e tempest-VolumeImageDependencyTests-942168115 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76c0c850-e859-438b-9991-55422181b8ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:54:19 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-3febb226-b62a-4bcc-a1e2-e6f844c68b9e tempest-VolumeImageDependencyTests-942168115 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76c0c850-e859-438b-9991-55422181b8ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:54:19 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-3febb226-b62a-4bcc-a1e2-e6f844c68b9e tempest-VolumeImageDependencyTests-942168115 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (259d8ba2-b4da-4379-b368-827a189838f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:54:19 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-3febb226-b62a-4bcc-a1e2-e6f844c68b9e tempest-VolumeImageDependencyTests-942168115 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (259d8ba2-b4da-4379-b368-827a189838f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'f79d4488-b6ea-4aed-864a-f7b3df306ab7', 'volume_name': 'volume-f79d4488-b6ea-4aed-864a-f7b3df306ab7', 'volume_size': 1, 'snapshot_id': 'd9af9b72-e2ca-483a-890e-ba54c1e8b28a'}' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:54:20 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-3febb226-b62a-4bcc-a1e2-e6f844c68b9e tempest-VolumeImageDependencyTests-942168115 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f44e18c-e8c1-4d9d-8d82-1b1b7291688c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:54:20 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-3febb226-b62a-4bcc-a1e2-e6f844c68b9e tempest-VolumeImageDependencyTests-942168115 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f44e18c-e8c1-4d9d-8d82-1b1b7291688c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:54:20 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-3febb226-b62a-4bcc-a1e2-e6f844c68b9e tempest-VolumeImageDependencyTests-942168115 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41352ccc-50c7-479d-a91e-208fe9481754) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:54:20 devstack cinder-volume[88899]: INFO cinder.volume.flows.manager.create_volume [None req-3febb226-b62a-4bcc-a1e2-e6f844c68b9e tempest-VolumeImageDependencyTests-942168115 None] Volume f79d4488-b6ea-4aed-864a-f7b3df306ab7: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-f79d4488-b6ea-4aed-864a-f7b3df306ab7', 'volume_size': 1, 'snapshot_id': 'd9af9b72-e2ca-483a-890e-ba54c1e8b28a'} Aug 03 08:54:20 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-3febb226-b62a-4bcc-a1e2-e6f844c68b9e tempest-VolumeImageDependencyTests-942168115 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:54:20 devstack sudo[113159]: pam_unix(sudo:session): session closed for user root Aug 03 08:54:20 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-03cbedba-2ad5-416f-a296-58eb60580618 tempest-VolumeDependencyTests-1512358985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-815ad7f9-1a36-40cf-ad01-1e9d227a15de -F qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-815ad7f9-1a36-40cf-ad01-1e9d227a15de.a666f4a5-6cda-48b1-b8ce-a900da8e4a05" returned: 0 in 0.308s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:54:20 devstack cinder-volume[88899]: WARNING cinder.volume.drivers.remotefs [None req-03cbedba-2ad5-416f-a296-58eb60580618 tempest-VolumeDependencyTests-1512358985 None] /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-815ad7f9-1a36-40cf-ad01-1e9d227a15de.a666f4a5-6cda-48b1-b8ce-a900da8e4a05 is being set with open permissions: ugo+rw Aug 03 08:54:20 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-03cbedba-2ad5-416f-a296-58eb60580618 tempest-VolumeDependencyTests-1512358985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-815ad7f9-1a36-40cf-ad01-1e9d227a15de.a666f4a5-6cda-48b1-b8ce-a900da8e4a05 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:54:20 devstack sudo[113164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-815ad7f9-1a36-40cf-ad01-1e9d227a15de.a666f4a5-6cda-48b1-b8ce-a900da8e4a05 Aug 03 08:54:20 devstack sudo[113164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:54:20 devstack sudo[113164]: pam_unix(sudo:session): session closed for user root Aug 03 08:54:20 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-03cbedba-2ad5-416f-a296-58eb60580618 tempest-VolumeDependencyTests-1512358985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-815ad7f9-1a36-40cf-ad01-1e9d227a15de.a666f4a5-6cda-48b1-b8ce-a900da8e4a05" returned: 0 in 0.250s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:54:20 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-03cbedba-2ad5-416f-a296-58eb60580618 tempest-VolumeDependencyTests-1512358985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-815ad7f9-1a36-40cf-ad01-1e9d227a15de.info {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:54:20 devstack sudo[113167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-815ad7f9-1a36-40cf-ad01-1e9d227a15de.info Aug 03 08:54:20 devstack sudo[113167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:54:20 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-8b90fa61-6104-4191-992a-e45dbca62d29 tempest-ProjectAdminTests-1868740921 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.755386352539, 'free_capacity_gb': 1775.755386352539, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=88899) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Aug 03 08:54:20 devstack sudo[113167]: pam_unix(sudo:session): session closed for user root Aug 03 08:54:20 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-03cbedba-2ad5-416f-a296-58eb60580618 tempest-VolumeDependencyTests-1512358985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-815ad7f9-1a36-40cf-ad01-1e9d227a15de.info" returned: 0 in 0.253s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:54:20 devstack cinder-volume[88899]: WARNING cinder.volume.drivers.remotefs [None req-03cbedba-2ad5-416f-a296-58eb60580618 tempest-VolumeDependencyTests-1512358985 None] /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-815ad7f9-1a36-40cf-ad01-1e9d227a15de.info is being set with open permissions: ugo+rw Aug 03 08:54:20 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-03cbedba-2ad5-416f-a296-58eb60580618 tempest-VolumeDependencyTests-1512358985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-815ad7f9-1a36-40cf-ad01-1e9d227a15de.info {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:54:20 devstack sudo[113170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-815ad7f9-1a36-40cf-ad01-1e9d227a15de.info Aug 03 08:54:20 devstack sudo[113170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:54:21 devstack sudo[113170]: pam_unix(sudo:session): session closed for user root Aug 03 08:54:21 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-03cbedba-2ad5-416f-a296-58eb60580618 tempest-VolumeDependencyTests-1512358985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-815ad7f9-1a36-40cf-ad01-1e9d227a15de.info" returned: 0 in 0.266s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:54:21 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-03cbedba-2ad5-416f-a296-58eb60580618 tempest-VolumeDependencyTests-1512358985 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.123s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:54:21 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-a4f44538-5efe-4261-b16c-9da97005d4f7 tempest-ProjectMemberTests-1353074417 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.358s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:54:21 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-a4f44538-5efe-4261-b16c-9da97005d4f7 tempest-ProjectMemberTests-1353074417 None] Creating offline snapshot bc143c74-04ee-47a8-8454-f23f962e4315 of volume b212a917-a56b-4d65-b829-65305ef88db2 {{(pid=88899) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 03 08:54:21 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-03cbedba-2ad5-416f-a296-58eb60580618 tempest-VolumeDependencyTests-1512358985 None] Create snapshot completed successfully Aug 03 08:54:21 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[fccd8d5f-c1b8-4bef-a4f5-8e1691b7a570]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:54:21 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-a4f44538-5efe-4261-b16c-9da97005d4f7 tempest-ProjectMemberTests-1353074417 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-b212a917-a56b-4d65-b829-65305ef88db2 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:54:21 devstack sudo[113173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-b212a917-a56b-4d65-b829-65305ef88db2 Aug 03 08:54:21 devstack sudo[113173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:54:21 devstack sudo[113173]: pam_unix(sudo:session): session closed for user root Aug 03 08:54:21 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-a4f44538-5efe-4261-b16c-9da97005d4f7 tempest-ProjectMemberTests-1353074417 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-b212a917-a56b-4d65-b829-65305ef88db2" returned: 0 in 0.389s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:54:21 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-a4f44538-5efe-4261-b16c-9da97005d4f7 tempest-ProjectMemberTests-1353074417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-b212a917-a56b-4d65-b829-65305ef88db2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-b212a917-a56b-4d65-b829-65305ef88db2.bc143c74-04ee-47a8-8454-f23f962e4315 1G {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:54:21 devstack sudo[113178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-b212a917-a56b-4d65-b829-65305ef88db2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-b212a917-a56b-4d65-b829-65305ef88db2.bc143c74-04ee-47a8-8454-f23f962e4315 1G Aug 03 08:54:21 devstack sudo[113178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:54:22 devstack sudo[113178]: pam_unix(sudo:session): session closed for user root Aug 03 08:54:22 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-a4f44538-5efe-4261-b16c-9da97005d4f7 tempest-ProjectMemberTests-1353074417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-b212a917-a56b-4d65-b829-65305ef88db2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-b212a917-a56b-4d65-b829-65305ef88db2.bc143c74-04ee-47a8-8454-f23f962e4315 1G" returned: 0 in 0.539s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:54:22 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-a4f44538-5efe-4261-b16c-9da97005d4f7 tempest-ProjectMemberTests-1353074417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b212a917-a56b-4d65-b829-65305ef88db2 -F qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-b212a917-a56b-4d65-b829-65305ef88db2.bc143c74-04ee-47a8-8454-f23f962e4315 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:54:22 devstack sudo[113183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b212a917-a56b-4d65-b829-65305ef88db2 -F qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-b212a917-a56b-4d65-b829-65305ef88db2.bc143c74-04ee-47a8-8454-f23f962e4315 Aug 03 08:54:22 devstack sudo[113183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:54:22 devstack cinder-volume[88899]: DEBUG cinder.volume.flows.manager.create_volume [None req-c5ccbfbc-f6df-4576-a950-e7e57b309368 tempest-VolumeDependencyTests-1512358985 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88899) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 08:54:22 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-c5ccbfbc-f6df-4576-a950-e7e57b309368 tempest-VolumeDependencyTests-1512358985 None] Flow 'volume_create_manager' (ed32ce3e-d1f7-4929-a77f-6797607bd3b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:54:22 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-c5ccbfbc-f6df-4576-a950-e7e57b309368 tempest-VolumeDependencyTests-1512358985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed36cb80-234b-47ab-9c31-3b0aa6d1b690) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:54:22 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-c5ccbfbc-f6df-4576-a950-e7e57b309368 tempest-VolumeDependencyTests-1512358985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed36cb80-234b-47ab-9c31-3b0aa6d1b690) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:54:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-905551660',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa5f047c-0aea-4f87-a1c9-e7a655bdeef3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d30b387eb9b94bb589dfe04f0d2eac6d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:54:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=a666f4a5-6cda-48b1-b8ce-a900da8e4a05,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:54:22Z,use_quota=True,user_id='12ab9b4d5d894d608b06e312639537e8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8bde7129-1dc4-42ab-b852-ab32c61b4921),volume_type_id=8bde7129-1dc4-42ab-b852-ab32c61b4921)' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:54:22 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-c5ccbfbc-f6df-4576-a950-e7e57b309368 tempest-VolumeDependencyTests-1512358985 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2d1822f-2320-445e-92a9-9c22c2b90204) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:54:22 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-c5ccbfbc-f6df-4576-a950-e7e57b309368 tempest-VolumeDependencyTests-1512358985 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2d1822f-2320-445e-92a9-9c22c2b90204) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:54:22 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-c5ccbfbc-f6df-4576-a950-e7e57b309368 tempest-VolumeDependencyTests-1512358985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76737b52-9e54-4479-8c13-8d2584998782) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:54:22 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-c5ccbfbc-f6df-4576-a950-e7e57b309368 tempest-VolumeDependencyTests-1512358985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76737b52-9e54-4479-8c13-8d2584998782) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'fa5f047c-0aea-4f87-a1c9-e7a655bdeef3', 'volume_name': 'volume-fa5f047c-0aea-4f87-a1c9-e7a655bdeef3', 'volume_size': 1, 'snapshot_id': 'a666f4a5-6cda-48b1-b8ce-a900da8e4a05'}' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:54:22 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-c5ccbfbc-f6df-4576-a950-e7e57b309368 tempest-VolumeDependencyTests-1512358985 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aae39bfc-1c18-4242-b8e0-bf129a3c8e0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:54:22 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-c5ccbfbc-f6df-4576-a950-e7e57b309368 tempest-VolumeDependencyTests-1512358985 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aae39bfc-1c18-4242-b8e0-bf129a3c8e0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:54:22 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-c5ccbfbc-f6df-4576-a950-e7e57b309368 tempest-VolumeDependencyTests-1512358985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac1b67f5-70af-48b8-8013-873b80e5b981) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:54:22 devstack cinder-volume[88899]: INFO cinder.volume.flows.manager.create_volume [None req-c5ccbfbc-f6df-4576-a950-e7e57b309368 tempest-VolumeDependencyTests-1512358985 None] Volume fa5f047c-0aea-4f87-a1c9-e7a655bdeef3: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-fa5f047c-0aea-4f87-a1c9-e7a655bdeef3', 'volume_size': 1, 'snapshot_id': 'a666f4a5-6cda-48b1-b8ce-a900da8e4a05'} Aug 03 08:54:22 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-c5ccbfbc-f6df-4576-a950-e7e57b309368 tempest-VolumeDependencyTests-1512358985 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:54:22 devstack sudo[113183]: pam_unix(sudo:session): session closed for user root Aug 03 08:54:22 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-a4f44538-5efe-4261-b16c-9da97005d4f7 tempest-ProjectMemberTests-1353074417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b212a917-a56b-4d65-b829-65305ef88db2 -F qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-b212a917-a56b-4d65-b829-65305ef88db2.bc143c74-04ee-47a8-8454-f23f962e4315" returned: 0 in 0.319s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:54:22 devstack cinder-volume[88899]: WARNING cinder.volume.drivers.remotefs [None req-a4f44538-5efe-4261-b16c-9da97005d4f7 tempest-ProjectMemberTests-1353074417 None] /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-b212a917-a56b-4d65-b829-65305ef88db2.bc143c74-04ee-47a8-8454-f23f962e4315 is being set with open permissions: ugo+rw Aug 03 08:54:22 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-a4f44538-5efe-4261-b16c-9da97005d4f7 tempest-ProjectMemberTests-1353074417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-b212a917-a56b-4d65-b829-65305ef88db2.bc143c74-04ee-47a8-8454-f23f962e4315 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:54:22 devstack sudo[113188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-b212a917-a56b-4d65-b829-65305ef88db2.bc143c74-04ee-47a8-8454-f23f962e4315 Aug 03 08:54:22 devstack sudo[113188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:54:22 devstack sudo[113188]: pam_unix(sudo:session): session closed for user root Aug 03 08:54:22 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-a4f44538-5efe-4261-b16c-9da97005d4f7 tempest-ProjectMemberTests-1353074417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-b212a917-a56b-4d65-b829-65305ef88db2.bc143c74-04ee-47a8-8454-f23f962e4315" returned: 0 in 0.244s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:54:22 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-a4f44538-5efe-4261-b16c-9da97005d4f7 tempest-ProjectMemberTests-1353074417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-b212a917-a56b-4d65-b829-65305ef88db2.info {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:54:22 devstack sudo[113191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-b212a917-a56b-4d65-b829-65305ef88db2.info Aug 03 08:54:22 devstack sudo[113191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:54:22 devstack sudo[113191]: pam_unix(sudo:session): session closed for user root Aug 03 08:54:22 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-a4f44538-5efe-4261-b16c-9da97005d4f7 tempest-ProjectMemberTests-1353074417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-b212a917-a56b-4d65-b829-65305ef88db2.info" returned: 0 in 0.255s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:54:22 devstack cinder-volume[88899]: WARNING cinder.volume.drivers.remotefs [None req-a4f44538-5efe-4261-b16c-9da97005d4f7 tempest-ProjectMemberTests-1353074417 None] /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-b212a917-a56b-4d65-b829-65305ef88db2.info is being set with open permissions: ugo+rw Aug 03 08:54:22 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-a4f44538-5efe-4261-b16c-9da97005d4f7 tempest-ProjectMemberTests-1353074417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-b212a917-a56b-4d65-b829-65305ef88db2.info {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:54:22 devstack sudo[113194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-b212a917-a56b-4d65-b829-65305ef88db2.info Aug 03 08:54:22 devstack sudo[113194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:54:23 devstack sudo[113194]: pam_unix(sudo:session): session closed for user root Aug 03 08:54:23 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-a4f44538-5efe-4261-b16c-9da97005d4f7 tempest-ProjectMemberTests-1353074417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-b212a917-a56b-4d65-b829-65305ef88db2.info" returned: 0 in 0.278s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:54:23 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-a4f44538-5efe-4261-b16c-9da97005d4f7 tempest-ProjectMemberTests-1353074417 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.120s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:54:23 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-3febb226-b62a-4bcc-a1e2-e6f844c68b9e tempest-VolumeImageDependencyTests-942168115 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 3.181s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:54:23 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-3febb226-b62a-4bcc-a1e2-e6f844c68b9e tempest-VolumeImageDependencyTests-942168115 None] Acquiring lock "cinder-quobyte-d9af9b72-e2ca-483a-890e-ba54c1e8b28a-f79d4488-b6ea-4aed-864a-f7b3df306ab7" by "_create_volume_from_snapshot" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:54:23 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-3febb226-b62a-4bcc-a1e2-e6f844c68b9e tempest-VolumeImageDependencyTests-942168115 None] Lock "cinder-quobyte-d9af9b72-e2ca-483a-890e-ba54c1e8b28a-f79d4488-b6ea-4aed-864a-f7b3df306ab7" acquired by "_create_volume_from_snapshot" :: waited 0.031s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:54:23 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-3febb226-b62a-4bcc-a1e2-e6f844c68b9e tempest-VolumeImageDependencyTests-942168115 None] Creating volume f79d4488-b6ea-4aed-864a-f7b3df306ab7 from snapshot d9af9b72-e2ca-483a-890e-ba54c1e8b28a {{(pid=88899) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Aug 03 08:54:23 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-3febb226-b62a-4bcc-a1e2-e6f844c68b9e tempest-VolumeImageDependencyTests-942168115 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:54:23 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-3febb226-b62a-4bcc-a1e2-e6f844c68b9e tempest-VolumeImageDependencyTests-942168115 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:54:23 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-3febb226-b62a-4bcc-a1e2-e6f844c68b9e tempest-VolumeImageDependencyTests-942168115 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:54:23 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-3febb226-b62a-4bcc-a1e2-e6f844c68b9e tempest-VolumeImageDependencyTests-942168115 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:54:23 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-3febb226-b62a-4bcc-a1e2-e6f844c68b9e tempest-VolumeImageDependencyTests-942168115 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:54:23 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-3febb226-b62a-4bcc-a1e2-e6f844c68b9e tempest-VolumeImageDependencyTests-942168115 None] Selected osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385 as target Quobyte volume. {{(pid=88899) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 08:54:23 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-3febb226-b62a-4bcc-a1e2-e6f844c68b9e tempest-VolumeImageDependencyTests-942168115 None] Acquiring lock "cinder-quobyte-f79d4488-b6ea-4aed-864a-f7b3df306ab7" by "_copy_volume_from_snapshot" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:54:23 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-a4f44538-5efe-4261-b16c-9da97005d4f7 tempest-ProjectMemberTests-1353074417 None] Create snapshot completed successfully Aug 03 08:54:23 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-3febb226-b62a-4bcc-a1e2-e6f844c68b9e tempest-VolumeImageDependencyTests-942168115 None] Lock "cinder-quobyte-f79d4488-b6ea-4aed-864a-f7b3df306ab7" acquired by "_copy_volume_from_snapshot" :: waited 0.026s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:54:23 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-3febb226-b62a-4bcc-a1e2-e6f844c68b9e tempest-VolumeImageDependencyTests-942168115 None] snapshot: d9af9b72-e2ca-483a-890e-ba54c1e8b28a, volume: f79d4488-b6ea-4aed-864a-f7b3df306ab7, {{(pid=88899) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Aug 03 08:54:23 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-3febb226-b62a-4bcc-a1e2-e6f844c68b9e tempest-VolumeImageDependencyTests-942168115 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:54:23 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-3febb226-b62a-4bcc-a1e2-e6f844c68b9e tempest-VolumeImageDependencyTests-942168115 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:54:23 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-3febb226-b62a-4bcc-a1e2-e6f844c68b9e tempest-VolumeImageDependencyTests-942168115 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:54:23 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-3febb226-b62a-4bcc-a1e2-e6f844c68b9e tempest-VolumeImageDependencyTests-942168115 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:54:23 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-3febb226-b62a-4bcc-a1e2-e6f844c68b9e tempest-VolumeImageDependencyTests-942168115 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:54:23 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8cfdd0c-b5b8-4041-981a-8f2ad5ce06a7]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:54:23 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-3febb226-b62a-4bcc-a1e2-e6f844c68b9e tempest-VolumeImageDependencyTests-942168115 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-7e91f316-bba8-4ffc-83ee-4a736a9150d4.d9af9b72-e2ca-483a-890e-ba54c1e8b28a {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:54:23 devstack sudo[113197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-7e91f316-bba8-4ffc-83ee-4a736a9150d4.d9af9b72-e2ca-483a-890e-ba54c1e8b28a Aug 03 08:54:23 devstack sudo[113197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:54:23 devstack sudo[113197]: pam_unix(sudo:session): session closed for user root Aug 03 08:54:23 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-3febb226-b62a-4bcc-a1e2-e6f844c68b9e tempest-VolumeImageDependencyTests-942168115 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-7e91f316-bba8-4ffc-83ee-4a736a9150d4.d9af9b72-e2ca-483a-890e-ba54c1e8b28a" returned: 0 in 0.366s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:54:23 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-3febb226-b62a-4bcc-a1e2-e6f844c68b9e tempest-VolumeImageDependencyTests-942168115 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7e91f316-bba8-4ffc-83ee-4a736a9150d4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88899) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 03 08:54:23 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[5673aa66-3bb8-4671-b78b-67b9ebac04bb]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:54:23 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-3febb226-b62a-4bcc-a1e2-e6f844c68b9e tempest-VolumeImageDependencyTests-942168115 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-7e91f316-bba8-4ffc-83ee-4a736a9150d4 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:54:23 devstack sudo[113202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-7e91f316-bba8-4ffc-83ee-4a736a9150d4 Aug 03 08:54:23 devstack sudo[113202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:54:24 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-08c47350-65c3-4395-b355-0f8562a93a8b tempest-ProjectMemberTests-1353074417 None] Acquiring lock "cinder-bc143c74-04ee-47a8-8454-f23f962e4315-delete_snapshot" by "delete_snapshot" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:54:24 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-08c47350-65c3-4395-b355-0f8562a93a8b tempest-ProjectMemberTests-1353074417 None] Lock "cinder-bc143c74-04ee-47a8-8454-f23f962e4315-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:54:24 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-08c47350-65c3-4395-b355-0f8562a93a8b tempest-ProjectMemberTests-1353074417 None] Acquiring lock "cinder-quobyte-b212a917-a56b-4d65-b829-65305ef88db2" by "delete_snapshot" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:54:24 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-08c47350-65c3-4395-b355-0f8562a93a8b tempest-ProjectMemberTests-1353074417 None] Lock "cinder-quobyte-b212a917-a56b-4d65-b829-65305ef88db2" acquired by "delete_snapshot" :: waited 0.018s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:54:24 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-08c47350-65c3-4395-b355-0f8562a93a8b tempest-ProjectMemberTests-1353074417 None] Acquiring lock "cinder-quobyte-bc143c74-04ee-47a8-8454-f23f962e4315" by "_delete_snapshot" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:54:24 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-08c47350-65c3-4395-b355-0f8562a93a8b tempest-ProjectMemberTests-1353074417 None] Lock "cinder-quobyte-bc143c74-04ee-47a8-8454-f23f962e4315" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:54:24 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-08c47350-65c3-4395-b355-0f8562a93a8b tempest-ProjectMemberTests-1353074417 None] Deleting offline snapshot bc143c74-04ee-47a8-8454-f23f962e4315 of volume b212a917-a56b-4d65-b829-65305ef88db2 {{(pid=88899) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 03 08:54:24 devstack sudo[113202]: pam_unix(sudo:session): session closed for user root Aug 03 08:54:24 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-08c47350-65c3-4395-b355-0f8562a93a8b tempest-ProjectMemberTests-1353074417 None] snapshot_file for this snap is: volume-b212a917-a56b-4d65-b829-65305ef88db2.bc143c74-04ee-47a8-8454-f23f962e4315 {{(pid=88899) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 03 08:54:24 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-3febb226-b62a-4bcc-a1e2-e6f844c68b9e tempest-VolumeImageDependencyTests-942168115 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-7e91f316-bba8-4ffc-83ee-4a736a9150d4" returned: 0 in 0.414s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:54:24 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-3febb226-b62a-4bcc-a1e2-e6f844c68b9e tempest-VolumeImageDependencyTests-942168115 None] will copy from snapshot at /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-7e91f316-bba8-4ffc-83ee-4a736a9150d4 {{(pid=88899) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Aug 03 08:54:24 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-3febb226-b62a-4bcc-a1e2-e6f844c68b9e tempest-VolumeImageDependencyTests-942168115 None] Creating direct copy from snapshot {{(pid=88899) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Aug 03 08:54:24 devstack cinder-volume[88899]: DEBUG cinder.utils [None req-3febb226-b62a-4bcc-a1e2-e6f844c68b9e tempest-VolumeImageDependencyTests-942168115 None] Path /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-f79d4488-b6ea-4aed-864a-f7b3df306ab7 not found in is_blk_device check {{(pid=88899) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Aug 03 08:54:24 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-3febb226-b62a-4bcc-a1e2-e6f844c68b9e tempest-VolumeImageDependencyTests-942168115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-7e91f316-bba8-4ffc-83ee-4a736a9150d4 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-f79d4488-b6ea-4aed-864a-f7b3df306ab7 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:54:24 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[05af3d53-9350-4fb4-b60a-191bf7720d7b]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:54:24 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-08c47350-65c3-4395-b355-0f8562a93a8b tempest-ProjectMemberTests-1353074417 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-b212a917-a56b-4d65-b829-65305ef88db2.bc143c74-04ee-47a8-8454-f23f962e4315 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:54:24 devstack sudo[113207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-7e91f316-bba8-4ffc-83ee-4a736a9150d4 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-f79d4488-b6ea-4aed-864a-f7b3df306ab7 Aug 03 08:54:24 devstack sudo[113207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:54:24 devstack sudo[113208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-b212a917-a56b-4d65-b829-65305ef88db2.bc143c74-04ee-47a8-8454-f23f962e4315 Aug 03 08:54:24 devstack sudo[113208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:54:24 devstack sudo[113208]: pam_unix(sudo:session): session closed for user root Aug 03 08:54:24 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-08c47350-65c3-4395-b355-0f8562a93a8b tempest-ProjectMemberTests-1353074417 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-b212a917-a56b-4d65-b829-65305ef88db2.bc143c74-04ee-47a8-8454-f23f962e4315" returned: 0 in 0.397s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:54:24 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-08c47350-65c3-4395-b355-0f8562a93a8b tempest-ProjectMemberTests-1353074417 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b212a917-a56b-4d65-b829-65305ef88db2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88899) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 03 08:54:24 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[aadcbd9d-e66d-464a-8954-73504a87e698]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:54:24 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-08c47350-65c3-4395-b355-0f8562a93a8b tempest-ProjectMemberTests-1353074417 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-b212a917-a56b-4d65-b829-65305ef88db2 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:54:24 devstack sudo[113219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-b212a917-a56b-4d65-b829-65305ef88db2 Aug 03 08:54:24 devstack sudo[113219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:54:24 devstack sudo[113207]: pam_unix(sudo:session): session closed for user root Aug 03 08:54:24 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-3febb226-b62a-4bcc-a1e2-e6f844c68b9e tempest-VolumeImageDependencyTests-942168115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-7e91f316-bba8-4ffc-83ee-4a736a9150d4 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-f79d4488-b6ea-4aed-864a-f7b3df306ab7" returned: 0 in 0.586s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:54:24 devstack cinder-volume[88899]: DEBUG cinder.image.image_utils [None req-3febb226-b62a-4bcc-a1e2-e6f844c68b9e tempest-VolumeImageDependencyTests-942168115 None] Image conversion details: src /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-7e91f316-bba8-4ffc-83ee-4a736a9150d4, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-f79d4488-b6ea-4aed-864a-f7b3df306ab7 {{(pid=88899) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 03 08:54:24 devstack cinder-volume[88899]: INFO cinder.image.image_utils [None req-3febb226-b62a-4bcc-a1e2-e6f844c68b9e tempest-VolumeImageDependencyTests-942168115 None] Converted 1024.00 MB image at 1024.00 MB/s Aug 03 08:54:24 devstack cinder-volume[88899]: WARNING cinder.volume.drivers.remotefs [None req-3febb226-b62a-4bcc-a1e2-e6f844c68b9e tempest-VolumeImageDependencyTests-942168115 None] /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-f79d4488-b6ea-4aed-864a-f7b3df306ab7 is being set with open permissions: ugo+rw Aug 03 08:54:24 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-3febb226-b62a-4bcc-a1e2-e6f844c68b9e tempest-VolumeImageDependencyTests-942168115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-f79d4488-b6ea-4aed-864a-f7b3df306ab7 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:54:24 devstack sudo[113221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-f79d4488-b6ea-4aed-864a-f7b3df306ab7 Aug 03 08:54:24 devstack sudo[113221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:54:24 devstack sudo[113219]: pam_unix(sudo:session): session closed for user root Aug 03 08:54:24 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-08c47350-65c3-4395-b355-0f8562a93a8b tempest-ProjectMemberTests-1353074417 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-b212a917-a56b-4d65-b829-65305ef88db2" returned: 0 in 0.390s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:54:24 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-08c47350-65c3-4395-b355-0f8562a93a8b tempest-ProjectMemberTests-1353074417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-b212a917-a56b-4d65-b829-65305ef88db2.bc143c74-04ee-47a8-8454-f23f962e4315 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:54:24 devstack sudo[113227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-b212a917-a56b-4d65-b829-65305ef88db2.bc143c74-04ee-47a8-8454-f23f962e4315 Aug 03 08:54:24 devstack sudo[113227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:54:24 devstack sudo[113221]: pam_unix(sudo:session): session closed for user root Aug 03 08:54:25 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-3febb226-b62a-4bcc-a1e2-e6f844c68b9e tempest-VolumeImageDependencyTests-942168115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-f79d4488-b6ea-4aed-864a-f7b3df306ab7" returned: 0 in 0.274s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:54:25 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-3febb226-b62a-4bcc-a1e2-e6f844c68b9e tempest-VolumeImageDependencyTests-942168115 None] Lock "cinder-quobyte-f79d4488-b6ea-4aed-864a-f7b3df306ab7" released by "_copy_volume_from_snapshot" :: held 1.742s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:54:25 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-3febb226-b62a-4bcc-a1e2-e6f844c68b9e tempest-VolumeImageDependencyTests-942168115 None] Lock "cinder-quobyte-d9af9b72-e2ca-483a-890e-ba54c1e8b28a-f79d4488-b6ea-4aed-864a-f7b3df306ab7" released by "_create_volume_from_snapshot" :: held 1.829s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:54:25 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-3febb226-b62a-4bcc-a1e2-e6f844c68b9e tempest-VolumeImageDependencyTests-942168115 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 1.862s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:54:25 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-c5ccbfbc-f6df-4576-a950-e7e57b309368 tempest-VolumeDependencyTests-1512358985 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 2.874s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:54:25 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-c5ccbfbc-f6df-4576-a950-e7e57b309368 tempest-VolumeDependencyTests-1512358985 None] Acquiring lock "cinder-quobyte-a666f4a5-6cda-48b1-b8ce-a900da8e4a05-fa5f047c-0aea-4f87-a1c9-e7a655bdeef3" by "_create_volume_from_snapshot" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:54:25 devstack cinder-volume[88899]: DEBUG cinder.volume.volume_utils [None req-3febb226-b62a-4bcc-a1e2-e6f844c68b9e tempest-VolumeImageDependencyTests-942168115 None] Marking volume f79d4488-b6ea-4aed-864a-f7b3df306ab7 as bootable. {{(pid=88899) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Aug 03 08:54:25 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-c5ccbfbc-f6df-4576-a950-e7e57b309368 tempest-VolumeDependencyTests-1512358985 None] Lock "cinder-quobyte-a666f4a5-6cda-48b1-b8ce-a900da8e4a05-fa5f047c-0aea-4f87-a1c9-e7a655bdeef3" acquired by "_create_volume_from_snapshot" :: waited 0.040s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:54:25 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-c5ccbfbc-f6df-4576-a950-e7e57b309368 tempest-VolumeDependencyTests-1512358985 None] Creating volume fa5f047c-0aea-4f87-a1c9-e7a655bdeef3 from snapshot a666f4a5-6cda-48b1-b8ce-a900da8e4a05 {{(pid=88899) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Aug 03 08:54:25 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-c5ccbfbc-f6df-4576-a950-e7e57b309368 tempest-VolumeDependencyTests-1512358985 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:54:25 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-c5ccbfbc-f6df-4576-a950-e7e57b309368 tempest-VolumeDependencyTests-1512358985 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:54:25 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-c5ccbfbc-f6df-4576-a950-e7e57b309368 tempest-VolumeDependencyTests-1512358985 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:54:25 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-c5ccbfbc-f6df-4576-a950-e7e57b309368 tempest-VolumeDependencyTests-1512358985 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:54:25 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-c5ccbfbc-f6df-4576-a950-e7e57b309368 tempest-VolumeDependencyTests-1512358985 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:54:25 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-c5ccbfbc-f6df-4576-a950-e7e57b309368 tempest-VolumeDependencyTests-1512358985 None] Selected osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385 as target Quobyte volume. {{(pid=88899) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 08:54:25 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-c5ccbfbc-f6df-4576-a950-e7e57b309368 tempest-VolumeDependencyTests-1512358985 None] Acquiring lock "cinder-quobyte-fa5f047c-0aea-4f87-a1c9-e7a655bdeef3" by "_copy_volume_from_snapshot" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:54:25 devstack cinder-volume[88899]: DEBUG cinder.volume.flows.manager.create_volume [None req-3febb226-b62a-4bcc-a1e2-e6f844c68b9e tempest-VolumeImageDependencyTests-942168115 None] Copying metadata from snapshot d9af9b72-e2ca-483a-890e-ba54c1e8b28a to f79d4488-b6ea-4aed-864a-f7b3df306ab7. {{(pid=88899) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:429}} Aug 03 08:54:25 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-c5ccbfbc-f6df-4576-a950-e7e57b309368 tempest-VolumeDependencyTests-1512358985 None] Lock "cinder-quobyte-fa5f047c-0aea-4f87-a1c9-e7a655bdeef3" acquired by "_copy_volume_from_snapshot" :: waited 0.030s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:54:25 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-c5ccbfbc-f6df-4576-a950-e7e57b309368 tempest-VolumeDependencyTests-1512358985 None] snapshot: a666f4a5-6cda-48b1-b8ce-a900da8e4a05, volume: fa5f047c-0aea-4f87-a1c9-e7a655bdeef3, {{(pid=88899) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Aug 03 08:54:25 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-c5ccbfbc-f6df-4576-a950-e7e57b309368 tempest-VolumeDependencyTests-1512358985 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:54:25 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-c5ccbfbc-f6df-4576-a950-e7e57b309368 tempest-VolumeDependencyTests-1512358985 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:54:25 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-c5ccbfbc-f6df-4576-a950-e7e57b309368 tempest-VolumeDependencyTests-1512358985 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:54:25 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-c5ccbfbc-f6df-4576-a950-e7e57b309368 tempest-VolumeDependencyTests-1512358985 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:54:25 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-c5ccbfbc-f6df-4576-a950-e7e57b309368 tempest-VolumeDependencyTests-1512358985 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:54:25 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5a158ca-bcac-424c-bc98-af7a65577b4c]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:54:25 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-c5ccbfbc-f6df-4576-a950-e7e57b309368 tempest-VolumeDependencyTests-1512358985 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-815ad7f9-1a36-40cf-ad01-1e9d227a15de.a666f4a5-6cda-48b1-b8ce-a900da8e4a05 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:54:25 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-3febb226-b62a-4bcc-a1e2-e6f844c68b9e tempest-VolumeImageDependencyTests-942168115 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41352ccc-50c7-479d-a91e-208fe9481754) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f79d4488-b6ea-4aed-864a-f7b3df306ab7', 'volume_size': 1, 'snapshot_id': 'd9af9b72-e2ca-483a-890e-ba54c1e8b28a'}' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:54:25 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-3febb226-b62a-4bcc-a1e2-e6f844c68b9e tempest-VolumeImageDependencyTests-942168115 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b46c25e0-d00b-4ffc-9a3e-ff2a2243bf53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:54:25 devstack cinder-volume[88899]: INFO cinder.volume.flows.manager.create_volume [None req-3febb226-b62a-4bcc-a1e2-e6f844c68b9e tempest-VolumeImageDependencyTests-942168115 None] Volume volume-f79d4488-b6ea-4aed-864a-f7b3df306ab7 (f79d4488-b6ea-4aed-864a-f7b3df306ab7): created successfully Aug 03 08:54:25 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-3febb226-b62a-4bcc-a1e2-e6f844c68b9e tempest-VolumeImageDependencyTests-942168115 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b46c25e0-d00b-4ffc-9a3e-ff2a2243bf53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:54:25 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-3febb226-b62a-4bcc-a1e2-e6f844c68b9e tempest-VolumeImageDependencyTests-942168115 None] Flow 'volume_create_manager' (659842b2-0633-4850-93b3-fefef5490d8a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:54:25 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-3febb226-b62a-4bcc-a1e2-e6f844c68b9e tempest-VolumeImageDependencyTests-942168115 None] Created volume successfully. Aug 03 08:54:25 devstack sudo[113229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-815ad7f9-1a36-40cf-ad01-1e9d227a15de.a666f4a5-6cda-48b1-b8ce-a900da8e4a05 Aug 03 08:54:25 devstack sudo[113229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:54:25 devstack sudo[113227]: pam_unix(sudo:session): session closed for user root Aug 03 08:54:25 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-08c47350-65c3-4395-b355-0f8562a93a8b tempest-ProjectMemberTests-1353074417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-b212a917-a56b-4d65-b829-65305ef88db2.bc143c74-04ee-47a8-8454-f23f962e4315" returned: 0 in 0.463s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:54:25 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-08c47350-65c3-4395-b355-0f8562a93a8b tempest-ProjectMemberTests-1353074417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-b212a917-a56b-4d65-b829-65305ef88db2.bc143c74-04ee-47a8-8454-f23f962e4315 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:54:25 devstack sudo[113234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-b212a917-a56b-4d65-b829-65305ef88db2.bc143c74-04ee-47a8-8454-f23f962e4315 Aug 03 08:54:25 devstack sudo[113234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:54:25 devstack sudo[113229]: pam_unix(sudo:session): session closed for user root Aug 03 08:54:25 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-c5ccbfbc-f6df-4576-a950-e7e57b309368 tempest-VolumeDependencyTests-1512358985 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-815ad7f9-1a36-40cf-ad01-1e9d227a15de.a666f4a5-6cda-48b1-b8ce-a900da8e4a05" returned: 0 in 0.433s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:54:25 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-c5ccbfbc-f6df-4576-a950-e7e57b309368 tempest-VolumeDependencyTests-1512358985 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-815ad7f9-1a36-40cf-ad01-1e9d227a15de(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88899) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 03 08:54:25 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[8627b7e5-390b-461e-a9b0-2ccc03cfd236]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:54:25 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-c5ccbfbc-f6df-4576-a950-e7e57b309368 tempest-VolumeDependencyTests-1512358985 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-815ad7f9-1a36-40cf-ad01-1e9d227a15de {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:54:25 devstack sudo[113234]: pam_unix(sudo:session): session closed for user root Aug 03 08:54:25 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-08c47350-65c3-4395-b355-0f8562a93a8b tempest-ProjectMemberTests-1353074417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-b212a917-a56b-4d65-b829-65305ef88db2.bc143c74-04ee-47a8-8454-f23f962e4315" returned: 0 in 0.255s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:54:25 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-08c47350-65c3-4395-b355-0f8562a93a8b tempest-ProjectMemberTests-1353074417 None] Lock "cinder-quobyte-bc143c74-04ee-47a8-8454-f23f962e4315" released by "_delete_snapshot" :: held 1.634s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:54:25 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-08c47350-65c3-4395-b355-0f8562a93a8b tempest-ProjectMemberTests-1353074417 None] Lock "cinder-quobyte-b212a917-a56b-4d65-b829-65305ef88db2" released by "delete_snapshot" :: held 1.664s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:54:25 devstack sudo[113241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-815ad7f9-1a36-40cf-ad01-1e9d227a15de Aug 03 08:54:25 devstack sudo[113241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:54:25 devstack cinder-volume[88899]: DEBUG cinder.quota [None req-08c47350-65c3-4395-b355-0f8562a93a8b tempest-ProjectMemberTests-1353074417 None] Created reservations ['c623b361-f2e7-43cc-82da-6988199eb96f', '4829eedc-3052-4870-83af-c0874e8d13d9', '310a45e5-73c5-4962-9c97-366e0a5041ec', '5c179170-e76c-4a95-be2c-b4b24ce71f58'] {{(pid=88899) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 08:54:25 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-08c47350-65c3-4395-b355-0f8562a93a8b tempest-ProjectMemberTests-1353074417 None] Delete snapshot completed successfully. Aug 03 08:54:25 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-08c47350-65c3-4395-b355-0f8562a93a8b tempest-ProjectMemberTests-1353074417 None] Lock "cinder-bc143c74-04ee-47a8-8454-f23f962e4315-delete_snapshot" released by "delete_snapshot" :: held 1.828s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:54:26 devstack sudo[113241]: pam_unix(sudo:session): session closed for user root Aug 03 08:54:26 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-c5ccbfbc-f6df-4576-a950-e7e57b309368 tempest-VolumeDependencyTests-1512358985 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-815ad7f9-1a36-40cf-ad01-1e9d227a15de" returned: 0 in 0.404s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:54:26 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-c5ccbfbc-f6df-4576-a950-e7e57b309368 tempest-VolumeDependencyTests-1512358985 None] will copy from snapshot at /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-815ad7f9-1a36-40cf-ad01-1e9d227a15de {{(pid=88899) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Aug 03 08:54:26 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-c5ccbfbc-f6df-4576-a950-e7e57b309368 tempest-VolumeDependencyTests-1512358985 None] Creating direct copy from snapshot {{(pid=88899) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Aug 03 08:54:26 devstack cinder-volume[88899]: DEBUG cinder.utils [None req-c5ccbfbc-f6df-4576-a950-e7e57b309368 tempest-VolumeDependencyTests-1512358985 None] Path /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-fa5f047c-0aea-4f87-a1c9-e7a655bdeef3 not found in is_blk_device check {{(pid=88899) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Aug 03 08:54:26 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-c5ccbfbc-f6df-4576-a950-e7e57b309368 tempest-VolumeDependencyTests-1512358985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-815ad7f9-1a36-40cf-ad01-1e9d227a15de /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-fa5f047c-0aea-4f87-a1c9-e7a655bdeef3 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:54:26 devstack sudo[113246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-815ad7f9-1a36-40cf-ad01-1e9d227a15de /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-fa5f047c-0aea-4f87-a1c9-e7a655bdeef3 Aug 03 08:54:26 devstack sudo[113246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:54:26 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-d0bcb1bc-08bd-4884-b9a9-fe157210bbef tempest-VolumeImageDependencyTests-942168115 None] Acquiring lock "cinder-d9af9b72-e2ca-483a-890e-ba54c1e8b28a-delete_snapshot" by "delete_snapshot" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:54:26 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-1f14af34-8184-4b03-b094-47ec319e9e49 tempest-ProjectMemberTests-1353074417 None] Acquiring lock "cinder-b212a917-a56b-4d65-b829-65305ef88db2-delete_volume" by "delete_volume" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:54:26 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-d0bcb1bc-08bd-4884-b9a9-fe157210bbef tempest-VolumeImageDependencyTests-942168115 None] Lock "cinder-d9af9b72-e2ca-483a-890e-ba54c1e8b28a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:54:26 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-d0bcb1bc-08bd-4884-b9a9-fe157210bbef tempest-VolumeImageDependencyTests-942168115 None] Acquiring lock "cinder-quobyte-7e91f316-bba8-4ffc-83ee-4a736a9150d4" by "delete_snapshot" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:54:26 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-1f14af34-8184-4b03-b094-47ec319e9e49 tempest-ProjectMemberTests-1353074417 None] Lock "cinder-b212a917-a56b-4d65-b829-65305ef88db2-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:54:26 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-d0bcb1bc-08bd-4884-b9a9-fe157210bbef tempest-VolumeImageDependencyTests-942168115 None] Lock "cinder-quobyte-7e91f316-bba8-4ffc-83ee-4a736a9150d4" acquired by "delete_snapshot" :: waited 0.042s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:54:26 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-d0bcb1bc-08bd-4884-b9a9-fe157210bbef tempest-VolumeImageDependencyTests-942168115 None] Acquiring lock "cinder-quobyte-d9af9b72-e2ca-483a-890e-ba54c1e8b28a" by "_delete_snapshot" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:54:26 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-d0bcb1bc-08bd-4884-b9a9-fe157210bbef tempest-VolumeImageDependencyTests-942168115 None] Lock "cinder-quobyte-d9af9b72-e2ca-483a-890e-ba54c1e8b28a" acquired by "_delete_snapshot" :: waited 0.034s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:54:26 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-d0bcb1bc-08bd-4884-b9a9-fe157210bbef tempest-VolumeImageDependencyTests-942168115 None] Deleting offline snapshot d9af9b72-e2ca-483a-890e-ba54c1e8b28a of volume 7e91f316-bba8-4ffc-83ee-4a736a9150d4 {{(pid=88899) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 03 08:54:26 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-d0bcb1bc-08bd-4884-b9a9-fe157210bbef tempest-VolumeImageDependencyTests-942168115 None] snapshot_file for this snap is: volume-7e91f316-bba8-4ffc-83ee-4a736a9150d4.d9af9b72-e2ca-483a-890e-ba54c1e8b28a {{(pid=88899) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 03 08:54:26 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[1817243e-3b0e-4499-9895-217777dd634a]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:54:26 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-d0bcb1bc-08bd-4884-b9a9-fe157210bbef tempest-VolumeImageDependencyTests-942168115 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-7e91f316-bba8-4ffc-83ee-4a736a9150d4.d9af9b72-e2ca-483a-890e-ba54c1e8b28a {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:54:26 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-1f14af34-8184-4b03-b094-47ec319e9e49 tempest-ProjectMemberTests-1353074417 None] Acquiring lock "cinder-quobyte-b212a917-a56b-4d65-b829-65305ef88db2" by "delete_volume" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:54:26 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-1f14af34-8184-4b03-b094-47ec319e9e49 tempest-ProjectMemberTests-1353074417 None] Lock "cinder-quobyte-b212a917-a56b-4d65-b829-65305ef88db2" acquired by "delete_volume" :: waited 0.017s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:54:26 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cd27b8e-2467-40b7-8f40-daaf9e35456d]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:54:26 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-1f14af34-8184-4b03-b094-47ec319e9e49 tempest-ProjectMemberTests-1353074417 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-b212a917-a56b-4d65-b829-65305ef88db2 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:54:26 devstack sudo[113252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-7e91f316-bba8-4ffc-83ee-4a736a9150d4.d9af9b72-e2ca-483a-890e-ba54c1e8b28a Aug 03 08:54:26 devstack sudo[113252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:54:26 devstack sudo[113246]: pam_unix(sudo:session): session closed for user root Aug 03 08:54:26 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-c5ccbfbc-f6df-4576-a950-e7e57b309368 tempest-VolumeDependencyTests-1512358985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-815ad7f9-1a36-40cf-ad01-1e9d227a15de /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-fa5f047c-0aea-4f87-a1c9-e7a655bdeef3" returned: 0 in 0.603s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:54:26 devstack cinder-volume[88899]: DEBUG cinder.image.image_utils [None req-c5ccbfbc-f6df-4576-a950-e7e57b309368 tempest-VolumeDependencyTests-1512358985 None] Image conversion details: src /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-815ad7f9-1a36-40cf-ad01-1e9d227a15de, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-fa5f047c-0aea-4f87-a1c9-e7a655bdeef3 {{(pid=88899) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 03 08:54:26 devstack cinder-volume[88899]: INFO cinder.image.image_utils [None req-c5ccbfbc-f6df-4576-a950-e7e57b309368 tempest-VolumeDependencyTests-1512358985 None] Converted 1024.00 MB image at 1024.00 MB/s Aug 03 08:54:26 devstack cinder-volume[88899]: WARNING cinder.volume.drivers.remotefs [None req-c5ccbfbc-f6df-4576-a950-e7e57b309368 tempest-VolumeDependencyTests-1512358985 None] /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-fa5f047c-0aea-4f87-a1c9-e7a655bdeef3 is being set with open permissions: ugo+rw Aug 03 08:54:26 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-c5ccbfbc-f6df-4576-a950-e7e57b309368 tempest-VolumeDependencyTests-1512358985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-fa5f047c-0aea-4f87-a1c9-e7a655bdeef3 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:54:26 devstack sudo[113253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-b212a917-a56b-4d65-b829-65305ef88db2 Aug 03 08:54:26 devstack sudo[113253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:54:26 devstack sudo[113255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-fa5f047c-0aea-4f87-a1c9-e7a655bdeef3 Aug 03 08:54:26 devstack sudo[113255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:54:26 devstack sudo[113252]: pam_unix(sudo:session): session closed for user root Aug 03 08:54:26 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-d0bcb1bc-08bd-4884-b9a9-fe157210bbef tempest-VolumeImageDependencyTests-942168115 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-7e91f316-bba8-4ffc-83ee-4a736a9150d4.d9af9b72-e2ca-483a-890e-ba54c1e8b28a" returned: 0 in 0.459s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:54:26 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-d0bcb1bc-08bd-4884-b9a9-fe157210bbef tempest-VolumeImageDependencyTests-942168115 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7e91f316-bba8-4ffc-83ee-4a736a9150d4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88899) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 03 08:54:27 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[45a7a928-4de9-45a6-8fc7-2f43004890d4]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:54:27 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-d0bcb1bc-08bd-4884-b9a9-fe157210bbef tempest-VolumeImageDependencyTests-942168115 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-7e91f316-bba8-4ffc-83ee-4a736a9150d4 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:54:27 devstack sudo[113255]: pam_unix(sudo:session): session closed for user root Aug 03 08:54:27 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-c5ccbfbc-f6df-4576-a950-e7e57b309368 tempest-VolumeDependencyTests-1512358985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-fa5f047c-0aea-4f87-a1c9-e7a655bdeef3" returned: 0 in 0.334s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:54:27 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-c5ccbfbc-f6df-4576-a950-e7e57b309368 tempest-VolumeDependencyTests-1512358985 None] Lock "cinder-quobyte-fa5f047c-0aea-4f87-a1c9-e7a655bdeef3" released by "_copy_volume_from_snapshot" :: held 1.885s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:54:27 devstack sudo[113253]: pam_unix(sudo:session): session closed for user root Aug 03 08:54:27 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-1f14af34-8184-4b03-b094-47ec319e9e49 tempest-ProjectMemberTests-1353074417 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-b212a917-a56b-4d65-b829-65305ef88db2" returned: 0 in 0.457s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:54:27 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-1f14af34-8184-4b03-b094-47ec319e9e49 tempest-ProjectMemberTests-1353074417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-b212a917-a56b-4d65-b829-65305ef88db2 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:54:27 devstack sudo[113266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-b212a917-a56b-4d65-b829-65305ef88db2 Aug 03 08:54:27 devstack sudo[113266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:54:27 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-c5ccbfbc-f6df-4576-a950-e7e57b309368 tempest-VolumeDependencyTests-1512358985 None] Lock "cinder-quobyte-a666f4a5-6cda-48b1-b8ce-a900da8e4a05-fa5f047c-0aea-4f87-a1c9-e7a655bdeef3" released by "_create_volume_from_snapshot" :: held 2.008s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:54:27 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-c5ccbfbc-f6df-4576-a950-e7e57b309368 tempest-VolumeDependencyTests-1512358985 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 2.050s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:54:27 devstack sudo[113265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-7e91f316-bba8-4ffc-83ee-4a736a9150d4 Aug 03 08:54:27 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-c5ccbfbc-f6df-4576-a950-e7e57b309368 tempest-VolumeDependencyTests-1512358985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac1b67f5-70af-48b8-8013-873b80e5b981) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fa5f047c-0aea-4f87-a1c9-e7a655bdeef3', 'volume_size': 1, 'snapshot_id': 'a666f4a5-6cda-48b1-b8ce-a900da8e4a05'}' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:54:27 devstack sudo[113265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:54:27 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-c5ccbfbc-f6df-4576-a950-e7e57b309368 tempest-VolumeDependencyTests-1512358985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (30ff3abd-acac-4457-ac3e-86d1ca48066c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:54:27 devstack cinder-volume[88899]: INFO cinder.volume.flows.manager.create_volume [None req-c5ccbfbc-f6df-4576-a950-e7e57b309368 tempest-VolumeDependencyTests-1512358985 None] Volume volume-fa5f047c-0aea-4f87-a1c9-e7a655bdeef3 (fa5f047c-0aea-4f87-a1c9-e7a655bdeef3): created successfully Aug 03 08:54:27 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-c5ccbfbc-f6df-4576-a950-e7e57b309368 tempest-VolumeDependencyTests-1512358985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (30ff3abd-acac-4457-ac3e-86d1ca48066c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:54:27 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-c5ccbfbc-f6df-4576-a950-e7e57b309368 tempest-VolumeDependencyTests-1512358985 None] Flow 'volume_create_manager' (ed32ce3e-d1f7-4929-a77f-6797607bd3b3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:54:27 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-c5ccbfbc-f6df-4576-a950-e7e57b309368 tempest-VolumeDependencyTests-1512358985 None] Created volume successfully. Aug 03 08:54:27 devstack sudo[113266]: pam_unix(sudo:session): session closed for user root Aug 03 08:54:27 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-1f14af34-8184-4b03-b094-47ec319e9e49 tempest-ProjectMemberTests-1353074417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-b212a917-a56b-4d65-b829-65305ef88db2" returned: 0 in 0.346s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:54:27 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-1f14af34-8184-4b03-b094-47ec319e9e49 tempest-ProjectMemberTests-1353074417 None] Lock "cinder-quobyte-b212a917-a56b-4d65-b829-65305ef88db2" released by "delete_volume" :: held 0.869s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:54:27 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-05f35e3c-bd70-4587-af4e-a3bd57a35e86 tempest-VolumeDependencyTests-1512358985 None] Acquiring lock "cinder-2516a2a6-9817-4bf8-92c6-7997e16150cd-delete_snapshot" by "delete_snapshot" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:54:27 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-05f35e3c-bd70-4587-af4e-a3bd57a35e86 tempest-VolumeDependencyTests-1512358985 None] Lock "cinder-2516a2a6-9817-4bf8-92c6-7997e16150cd-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:54:27 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-05f35e3c-bd70-4587-af4e-a3bd57a35e86 tempest-VolumeDependencyTests-1512358985 None] Acquiring lock "cinder-quobyte-e65a2b63-8524-45ea-92ab-d4db1c52b46c" by "delete_snapshot" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:54:27 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-05f35e3c-bd70-4587-af4e-a3bd57a35e86 tempest-VolumeDependencyTests-1512358985 None] Lock "cinder-quobyte-e65a2b63-8524-45ea-92ab-d4db1c52b46c" acquired by "delete_snapshot" :: waited 0.018s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:54:27 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-05f35e3c-bd70-4587-af4e-a3bd57a35e86 tempest-VolumeDependencyTests-1512358985 None] Acquiring lock "cinder-quobyte-2516a2a6-9817-4bf8-92c6-7997e16150cd" by "_delete_snapshot" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:54:27 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-05f35e3c-bd70-4587-af4e-a3bd57a35e86 tempest-VolumeDependencyTests-1512358985 None] Lock "cinder-quobyte-2516a2a6-9817-4bf8-92c6-7997e16150cd" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:54:27 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-05f35e3c-bd70-4587-af4e-a3bd57a35e86 tempest-VolumeDependencyTests-1512358985 None] Deleting offline snapshot 2516a2a6-9817-4bf8-92c6-7997e16150cd of volume e65a2b63-8524-45ea-92ab-d4db1c52b46c {{(pid=88899) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 03 08:54:27 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-05f35e3c-bd70-4587-af4e-a3bd57a35e86 tempest-VolumeDependencyTests-1512358985 None] snapshot_file for this snap is: volume-e65a2b63-8524-45ea-92ab-d4db1c52b46c.2516a2a6-9817-4bf8-92c6-7997e16150cd {{(pid=88899) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 03 08:54:27 devstack cinder-volume[88899]: DEBUG cinder.quota [None req-1f14af34-8184-4b03-b094-47ec319e9e49 tempest-ProjectMemberTests-1353074417 None] Created reservations ['b2d716d7-509b-41cf-b25b-6a56d5f30067', '7ca6b7a6-f934-43cc-adae-48bb1603f7e1', '09e332ac-3180-4f6e-bf05-1950500477ba', 'bb33f2bf-a01e-4c5a-8b23-cb45f73bc3f1'] {{(pid=88899) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 08:54:27 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[600200bc-08f1-4a34-b4f4-8c7937938a4a]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:54:27 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-05f35e3c-bd70-4587-af4e-a3bd57a35e86 tempest-VolumeDependencyTests-1512358985 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-e65a2b63-8524-45ea-92ab-d4db1c52b46c.2516a2a6-9817-4bf8-92c6-7997e16150cd {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:54:27 devstack sudo[113265]: pam_unix(sudo:session): session closed for user root Aug 03 08:54:27 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-d0bcb1bc-08bd-4884-b9a9-fe157210bbef tempest-VolumeImageDependencyTests-942168115 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-7e91f316-bba8-4ffc-83ee-4a736a9150d4" returned: 0 in 0.572s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:54:27 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-d0bcb1bc-08bd-4884-b9a9-fe157210bbef tempest-VolumeImageDependencyTests-942168115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-7e91f316-bba8-4ffc-83ee-4a736a9150d4.d9af9b72-e2ca-483a-890e-ba54c1e8b28a {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:54:27 devstack sudo[113274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-7e91f316-bba8-4ffc-83ee-4a736a9150d4.d9af9b72-e2ca-483a-890e-ba54c1e8b28a Aug 03 08:54:27 devstack sudo[113274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:54:27 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-1f14af34-8184-4b03-b094-47ec319e9e49 tempest-ProjectMemberTests-1353074417 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:54:27 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-1f14af34-8184-4b03-b094-47ec319e9e49 tempest-ProjectMemberTests-1353074417 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:54:27 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-1f14af34-8184-4b03-b094-47ec319e9e49 tempest-ProjectMemberTests-1353074417 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:54:27 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-1f14af34-8184-4b03-b094-47ec319e9e49 tempest-ProjectMemberTests-1353074417 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:54:27 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-1f14af34-8184-4b03-b094-47ec319e9e49 tempest-ProjectMemberTests-1353074417 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:54:27 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-1f14af34-8184-4b03-b094-47ec319e9e49 tempest-ProjectMemberTests-1353074417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:54:27 devstack sudo[113273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-e65a2b63-8524-45ea-92ab-d4db1c52b46c.2516a2a6-9817-4bf8-92c6-7997e16150cd Aug 03 08:54:27 devstack sudo[113273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:54:27 devstack sudo[113276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a Aug 03 08:54:27 devstack sudo[113276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:54:27 devstack sudo[113276]: pam_unix(sudo:session): session closed for user root Aug 03 08:54:27 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-1f14af34-8184-4b03-b094-47ec319e9e49 tempest-ProjectMemberTests-1353074417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a" returned: 0 in 0.274s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:54:27 devstack cinder-volume[88899]: DEBUG cinder.manager [None req-1f14af34-8184-4b03-b094-47ec319e9e49 tempest-ProjectMemberTests-1353074417 None] Notifying Schedulers of capabilities ... {{(pid=88899) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 08:54:27 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-1f14af34-8184-4b03-b094-47ec319e9e49 tempest-ProjectMemberTests-1353074417 None] Deleted volume successfully. Aug 03 08:54:27 devstack sudo[113273]: pam_unix(sudo:session): session closed for user root Aug 03 08:54:27 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-05f35e3c-bd70-4587-af4e-a3bd57a35e86 tempest-VolumeDependencyTests-1512358985 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-e65a2b63-8524-45ea-92ab-d4db1c52b46c.2516a2a6-9817-4bf8-92c6-7997e16150cd" returned: 0 in 0.434s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:54:27 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-05f35e3c-bd70-4587-af4e-a3bd57a35e86 tempest-VolumeDependencyTests-1512358985 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e65a2b63-8524-45ea-92ab-d4db1c52b46c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88899) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 03 08:54:27 devstack sudo[113274]: pam_unix(sudo:session): session closed for user root Aug 03 08:54:27 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-1f14af34-8184-4b03-b094-47ec319e9e49 tempest-ProjectMemberTests-1353074417 None] Lock "cinder-b212a917-a56b-4d65-b829-65305ef88db2-delete_volume" released by "delete_volume" :: held 1.571s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:54:27 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-d0bcb1bc-08bd-4884-b9a9-fe157210bbef tempest-VolumeImageDependencyTests-942168115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-7e91f316-bba8-4ffc-83ee-4a736a9150d4.d9af9b72-e2ca-483a-890e-ba54c1e8b28a" returned: 0 in 0.413s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:54:27 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-d0bcb1bc-08bd-4884-b9a9-fe157210bbef tempest-VolumeImageDependencyTests-942168115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-7e91f316-bba8-4ffc-83ee-4a736a9150d4.d9af9b72-e2ca-483a-890e-ba54c1e8b28a {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:54:28 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8139427-31b1-488d-a029-fcb36218fe67]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:54:28 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-05f35e3c-bd70-4587-af4e-a3bd57a35e86 tempest-VolumeDependencyTests-1512358985 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-e65a2b63-8524-45ea-92ab-d4db1c52b46c {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:54:28 devstack sudo[113288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-7e91f316-bba8-4ffc-83ee-4a736a9150d4.d9af9b72-e2ca-483a-890e-ba54c1e8b28a Aug 03 08:54:28 devstack sudo[113288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:54:28 devstack sudo[113289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-e65a2b63-8524-45ea-92ab-d4db1c52b46c Aug 03 08:54:28 devstack sudo[113289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:54:28 devstack sudo[113288]: pam_unix(sudo:session): session closed for user root Aug 03 08:54:28 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-d0bcb1bc-08bd-4884-b9a9-fe157210bbef tempest-VolumeImageDependencyTests-942168115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-7e91f316-bba8-4ffc-83ee-4a736a9150d4.d9af9b72-e2ca-483a-890e-ba54c1e8b28a" returned: 0 in 0.273s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:54:28 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-d0bcb1bc-08bd-4884-b9a9-fe157210bbef tempest-VolumeImageDependencyTests-942168115 None] Lock "cinder-quobyte-d9af9b72-e2ca-483a-890e-ba54c1e8b28a" released by "_delete_snapshot" :: held 1.869s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:54:28 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-d0bcb1bc-08bd-4884-b9a9-fe157210bbef tempest-VolumeImageDependencyTests-942168115 None] Lock "cinder-quobyte-7e91f316-bba8-4ffc-83ee-4a736a9150d4" released by "delete_snapshot" :: held 1.920s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:54:28 devstack cinder-volume[88899]: DEBUG cinder.quota [None req-d0bcb1bc-08bd-4884-b9a9-fe157210bbef tempest-VolumeImageDependencyTests-942168115 None] Created reservations ['eee332f8-8419-4a3b-adb5-3b6909e9e12f', '0c96b15c-c1cf-42ee-ae3e-59c98dbe768b', '65ee843e-3cea-4e77-bc4d-82bdede2866b', '19d80fe9-2221-40d0-b84d-2a64bce34fdb'] {{(pid=88899) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 08:54:28 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-d0bcb1bc-08bd-4884-b9a9-fe157210bbef tempest-VolumeImageDependencyTests-942168115 None] Delete snapshot completed successfully. Aug 03 08:54:28 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-d0bcb1bc-08bd-4884-b9a9-fe157210bbef tempest-VolumeImageDependencyTests-942168115 None] Lock "cinder-d9af9b72-e2ca-483a-890e-ba54c1e8b28a-delete_snapshot" released by "delete_snapshot" :: held 2.159s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:54:28 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-a1f02b5a-59af-44b0-bf82-c3b6f770ea38 tempest-VolumeImageDependencyTests-942168115 None] Acquiring lock "cinder-f79d4488-b6ea-4aed-864a-f7b3df306ab7-delete_volume" by "delete_volume" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:54:28 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-a1f02b5a-59af-44b0-bf82-c3b6f770ea38 tempest-VolumeImageDependencyTests-942168115 None] Lock "cinder-f79d4488-b6ea-4aed-864a-f7b3df306ab7-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:54:28 devstack sudo[113289]: pam_unix(sudo:session): session closed for user root Aug 03 08:54:28 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-05f35e3c-bd70-4587-af4e-a3bd57a35e86 tempest-VolumeDependencyTests-1512358985 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-e65a2b63-8524-45ea-92ab-d4db1c52b46c" returned: 0 in 0.663s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:54:28 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-05f35e3c-bd70-4587-af4e-a3bd57a35e86 tempest-VolumeDependencyTests-1512358985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-e65a2b63-8524-45ea-92ab-d4db1c52b46c.2516a2a6-9817-4bf8-92c6-7997e16150cd {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:54:28 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-a1f02b5a-59af-44b0-bf82-c3b6f770ea38 tempest-VolumeImageDependencyTests-942168115 None] Acquiring lock "cinder-quobyte-f79d4488-b6ea-4aed-864a-f7b3df306ab7" by "delete_volume" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:54:28 devstack sudo[113297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-e65a2b63-8524-45ea-92ab-d4db1c52b46c.2516a2a6-9817-4bf8-92c6-7997e16150cd Aug 03 08:54:28 devstack sudo[113297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:54:28 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-a1f02b5a-59af-44b0-bf82-c3b6f770ea38 tempest-VolumeImageDependencyTests-942168115 None] Lock "cinder-quobyte-f79d4488-b6ea-4aed-864a-f7b3df306ab7" acquired by "delete_volume" :: waited 0.021s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:54:28 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[35a17d0d-0e05-4c91-a959-f40142760b23]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:54:28 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-a1f02b5a-59af-44b0-bf82-c3b6f770ea38 tempest-VolumeImageDependencyTests-942168115 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-f79d4488-b6ea-4aed-864a-f7b3df306ab7 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:54:28 devstack sudo[113299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-f79d4488-b6ea-4aed-864a-f7b3df306ab7 Aug 03 08:54:28 devstack sudo[113299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:54:29 devstack sudo[113297]: pam_unix(sudo:session): session closed for user root Aug 03 08:54:29 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-05f35e3c-bd70-4587-af4e-a3bd57a35e86 tempest-VolumeDependencyTests-1512358985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-e65a2b63-8524-45ea-92ab-d4db1c52b46c.2516a2a6-9817-4bf8-92c6-7997e16150cd" returned: 0 in 0.405s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:54:29 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-05f35e3c-bd70-4587-af4e-a3bd57a35e86 tempest-VolumeDependencyTests-1512358985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-e65a2b63-8524-45ea-92ab-d4db1c52b46c.2516a2a6-9817-4bf8-92c6-7997e16150cd {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:54:29 devstack sudo[113306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-e65a2b63-8524-45ea-92ab-d4db1c52b46c.2516a2a6-9817-4bf8-92c6-7997e16150cd Aug 03 08:54:29 devstack sudo[113306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:54:29 devstack sudo[113299]: pam_unix(sudo:session): session closed for user root Aug 03 08:54:29 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-a1f02b5a-59af-44b0-bf82-c3b6f770ea38 tempest-VolumeImageDependencyTests-942168115 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-f79d4488-b6ea-4aed-864a-f7b3df306ab7" returned: 0 in 0.488s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:54:29 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-a1f02b5a-59af-44b0-bf82-c3b6f770ea38 tempest-VolumeImageDependencyTests-942168115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-f79d4488-b6ea-4aed-864a-f7b3df306ab7 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:54:29 devstack sudo[113312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-f79d4488-b6ea-4aed-864a-f7b3df306ab7 Aug 03 08:54:29 devstack sudo[113312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:54:29 devstack cinder-volume[88899]: DEBUG cinder.volume.flows.manager.create_volume [None req-4ceb2b08-3ce9-4ef7-bcd3-411434cb521b tempest-ProjectMemberTests-1353074417 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88899) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 08:54:29 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-4ceb2b08-3ce9-4ef7-bcd3-411434cb521b tempest-ProjectMemberTests-1353074417 None] Flow 'volume_create_manager' (37f30164-1534-4251-931e-1a63d21b613b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:54:29 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-4ceb2b08-3ce9-4ef7-bcd3-411434cb521b tempest-ProjectMemberTests-1353074417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d80cec3-998f-4f59-92a4-57585997a3e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:54:29 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-4ceb2b08-3ce9-4ef7-bcd3-411434cb521b tempest-ProjectMemberTests-1353074417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d80cec3-998f-4f59-92a4-57585997a3e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:54:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-790154264',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=681d54f7-7e31-45cf-8ca2-09d4706c6090,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b723e915839a4036ad739740ec4db0cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:54:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:54:29Z,use_quota=True,user_id='d9152484679b4fb79b0d8896a2a67eb9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8bde7129-1dc4-42ab-b852-ab32c61b4921),volume_type_id=8bde7129-1dc4-42ab-b852-ab32c61b4921)' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:54:29 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-4ceb2b08-3ce9-4ef7-bcd3-411434cb521b tempest-ProjectMemberTests-1353074417 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f9c9af4-57fd-4b21-b8d3-20ba6e9a4eb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:54:29 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-4ceb2b08-3ce9-4ef7-bcd3-411434cb521b tempest-ProjectMemberTests-1353074417 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f9c9af4-57fd-4b21-b8d3-20ba6e9a4eb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:54:29 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-4ceb2b08-3ce9-4ef7-bcd3-411434cb521b tempest-ProjectMemberTests-1353074417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (12d39cf9-0982-498b-abeb-0c000aabeb35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:54:29 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-4ceb2b08-3ce9-4ef7-bcd3-411434cb521b tempest-ProjectMemberTests-1353074417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (12d39cf9-0982-498b-abeb-0c000aabeb35) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '681d54f7-7e31-45cf-8ca2-09d4706c6090', 'volume_name': 'volume-681d54f7-7e31-45cf-8ca2-09d4706c6090', 'volume_size': 1}' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:54:29 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-4ceb2b08-3ce9-4ef7-bcd3-411434cb521b tempest-ProjectMemberTests-1353074417 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a6ba1d9f-bede-4e9a-a1ef-23129cf776c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:54:29 devstack sudo[113306]: pam_unix(sudo:session): session closed for user root Aug 03 08:54:29 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-4ceb2b08-3ce9-4ef7-bcd3-411434cb521b tempest-ProjectMemberTests-1353074417 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a6ba1d9f-bede-4e9a-a1ef-23129cf776c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:54:29 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-4ceb2b08-3ce9-4ef7-bcd3-411434cb521b tempest-ProjectMemberTests-1353074417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ef36521-243a-4496-b03a-173770e0ec37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:54:29 devstack cinder-volume[88899]: INFO cinder.volume.flows.manager.create_volume [None req-4ceb2b08-3ce9-4ef7-bcd3-411434cb521b tempest-ProjectMemberTests-1353074417 None] Volume 681d54f7-7e31-45cf-8ca2-09d4706c6090: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-681d54f7-7e31-45cf-8ca2-09d4706c6090', 'volume_size': 1} Aug 03 08:54:29 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-4ceb2b08-3ce9-4ef7-bcd3-411434cb521b tempest-ProjectMemberTests-1353074417 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:54:29 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-4ceb2b08-3ce9-4ef7-bcd3-411434cb521b tempest-ProjectMemberTests-1353074417 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:54:29 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-4ceb2b08-3ce9-4ef7-bcd3-411434cb521b tempest-ProjectMemberTests-1353074417 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:54:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-790154264',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=681d54f7-7e31-45cf-8ca2-09d4706c6090,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b723e915839a4036ad739740ec4db0cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:54:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:54:29Z,use_quota=True,user_id='d9152484679b4fb79b0d8896a2a67eb9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8bde7129-1dc4-42ab-b852-ab32c61b4921),volume_type_id=8bde7129-1dc4-42ab-b852-ab32c61b4921)}" {{(pid=88899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 08:54:29 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-4ceb2b08-3ce9-4ef7-bcd3-411434cb521b tempest-ProjectMemberTests-1353074417 None] Creating volume 681d54f7-7e31-45cf-8ca2-09d4706c6090 {{(pid=88899) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 08:54:29 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-4ceb2b08-3ce9-4ef7-bcd3-411434cb521b tempest-ProjectMemberTests-1353074417 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:54:29 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-4ceb2b08-3ce9-4ef7-bcd3-411434cb521b tempest-ProjectMemberTests-1353074417 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:54:29 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-4ceb2b08-3ce9-4ef7-bcd3-411434cb521b tempest-ProjectMemberTests-1353074417 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:54:29 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-4ceb2b08-3ce9-4ef7-bcd3-411434cb521b tempest-ProjectMemberTests-1353074417 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:54:29 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-4ceb2b08-3ce9-4ef7-bcd3-411434cb521b tempest-ProjectMemberTests-1353074417 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:54:29 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-4ceb2b08-3ce9-4ef7-bcd3-411434cb521b tempest-ProjectMemberTests-1353074417 None] Selected osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385 as target Quobyte volume. {{(pid=88899) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 08:54:29 devstack cinder-volume[88899]: INFO cinder.volume.drivers.remotefs [None req-4ceb2b08-3ce9-4ef7-bcd3-411434cb521b tempest-ProjectMemberTests-1353074417 None] casted to osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385 Aug 03 08:54:29 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-4ceb2b08-3ce9-4ef7-bcd3-411434cb521b tempest-ProjectMemberTests-1353074417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-681d54f7-7e31-45cf-8ca2-09d4706c6090 1073741824 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:54:29 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-05f35e3c-bd70-4587-af4e-a3bd57a35e86 tempest-VolumeDependencyTests-1512358985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-e65a2b63-8524-45ea-92ab-d4db1c52b46c.2516a2a6-9817-4bf8-92c6-7997e16150cd" returned: 0 in 0.389s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:54:29 devstack sudo[113315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-681d54f7-7e31-45cf-8ca2-09d4706c6090 1073741824 Aug 03 08:54:29 devstack sudo[113315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:54:29 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-05f35e3c-bd70-4587-af4e-a3bd57a35e86 tempest-VolumeDependencyTests-1512358985 None] Lock "cinder-quobyte-2516a2a6-9817-4bf8-92c6-7997e16150cd" released by "_delete_snapshot" :: held 2.039s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:54:29 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-05f35e3c-bd70-4587-af4e-a3bd57a35e86 tempest-VolumeDependencyTests-1512358985 None] Lock "cinder-quobyte-e65a2b63-8524-45ea-92ab-d4db1c52b46c" released by "delete_snapshot" :: held 2.079s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:54:29 devstack sudo[113312]: pam_unix(sudo:session): session closed for user root Aug 03 08:54:29 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-a1f02b5a-59af-44b0-bf82-c3b6f770ea38 tempest-VolumeImageDependencyTests-942168115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-f79d4488-b6ea-4aed-864a-f7b3df306ab7" returned: 0 in 0.374s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:54:29 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-a1f02b5a-59af-44b0-bf82-c3b6f770ea38 tempest-VolumeImageDependencyTests-942168115 None] Lock "cinder-quobyte-f79d4488-b6ea-4aed-864a-f7b3df306ab7" released by "delete_volume" :: held 0.921s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:54:29 devstack cinder-volume[88899]: DEBUG cinder.quota [None req-05f35e3c-bd70-4587-af4e-a3bd57a35e86 tempest-VolumeDependencyTests-1512358985 None] Created reservations ['beabd7cc-9f2e-44d1-93cb-232645f622bf', '37c95325-01ea-4b38-805f-182049d7c056', '38546a96-aa14-4997-84b2-f6ccc76d4e93', 'ef9bf6d8-95b4-484d-b68e-f89fd566c1c1'] {{(pid=88899) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 08:54:29 devstack cinder-volume[88899]: DEBUG cinder.quota [None req-a1f02b5a-59af-44b0-bf82-c3b6f770ea38 tempest-VolumeImageDependencyTests-942168115 None] Created reservations ['42180112-7985-48b5-a757-770d5f9bb361', '851521ca-14ae-4181-a52d-3fcf5e04cbfc', '1c6ba95f-4f23-4e6c-9fc9-18f45d814896', '1a020c83-76f9-4617-8d2d-b306a2d7078c'] {{(pid=88899) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 08:54:29 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-05f35e3c-bd70-4587-af4e-a3bd57a35e86 tempest-VolumeDependencyTests-1512358985 None] Delete snapshot completed successfully. Aug 03 08:54:29 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-05f35e3c-bd70-4587-af4e-a3bd57a35e86 tempest-VolumeDependencyTests-1512358985 None] Lock "cinder-2516a2a6-9817-4bf8-92c6-7997e16150cd-delete_snapshot" released by "delete_snapshot" :: held 2.308s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:54:29 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-a1f02b5a-59af-44b0-bf82-c3b6f770ea38 tempest-VolumeImageDependencyTests-942168115 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:54:29 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-a1f02b5a-59af-44b0-bf82-c3b6f770ea38 tempest-VolumeImageDependencyTests-942168115 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:54:29 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-a1f02b5a-59af-44b0-bf82-c3b6f770ea38 tempest-VolumeImageDependencyTests-942168115 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:54:29 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-a1f02b5a-59af-44b0-bf82-c3b6f770ea38 tempest-VolumeImageDependencyTests-942168115 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:54:29 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-a1f02b5a-59af-44b0-bf82-c3b6f770ea38 tempest-VolumeImageDependencyTests-942168115 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:54:29 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-a1f02b5a-59af-44b0-bf82-c3b6f770ea38 tempest-VolumeImageDependencyTests-942168115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:54:29 devstack sudo[113321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a Aug 03 08:54:29 devstack sudo[113321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:54:30 devstack sudo[113315]: pam_unix(sudo:session): session closed for user root Aug 03 08:54:30 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-4ceb2b08-3ce9-4ef7-bcd3-411434cb521b tempest-ProjectMemberTests-1353074417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-681d54f7-7e31-45cf-8ca2-09d4706c6090 1073741824" returned: 0 in 0.545s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:54:30 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-4ceb2b08-3ce9-4ef7-bcd3-411434cb521b tempest-ProjectMemberTests-1353074417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-681d54f7-7e31-45cf-8ca2-09d4706c6090 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:54:30 devstack sudo[113321]: pam_unix(sudo:session): session closed for user root Aug 03 08:54:30 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-a1f02b5a-59af-44b0-bf82-c3b6f770ea38 tempest-VolumeImageDependencyTests-942168115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a" returned: 0 in 0.266s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:54:30 devstack sudo[113325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-681d54f7-7e31-45cf-8ca2-09d4706c6090 Aug 03 08:54:30 devstack sudo[113325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:54:30 devstack cinder-volume[88899]: DEBUG cinder.manager [None req-a1f02b5a-59af-44b0-bf82-c3b6f770ea38 tempest-VolumeImageDependencyTests-942168115 None] Notifying Schedulers of capabilities ... {{(pid=88899) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 08:54:30 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-a1f02b5a-59af-44b0-bf82-c3b6f770ea38 tempest-VolumeImageDependencyTests-942168115 None] Deleted volume successfully. Aug 03 08:54:30 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-a1f02b5a-59af-44b0-bf82-c3b6f770ea38 tempest-VolumeImageDependencyTests-942168115 None] Lock "cinder-f79d4488-b6ea-4aed-864a-f7b3df306ab7-delete_volume" released by "delete_volume" :: held 1.474s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:54:30 devstack sudo[113325]: pam_unix(sudo:session): session closed for user root Aug 03 08:54:30 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-4ceb2b08-3ce9-4ef7-bcd3-411434cb521b tempest-ProjectMemberTests-1353074417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-681d54f7-7e31-45cf-8ca2-09d4706c6090" returned: 0 in 0.274s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:54:30 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-4ceb2b08-3ce9-4ef7-bcd3-411434cb521b tempest-ProjectMemberTests-1353074417 None] <== create_volume: return (866ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'} {{(pid=88899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 08:54:30 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-4ceb2b08-3ce9-4ef7-bcd3-411434cb521b tempest-ProjectMemberTests-1353074417 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.869s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:54:30 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-4ceb2b08-3ce9-4ef7-bcd3-411434cb521b tempest-ProjectMemberTests-1353074417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ef36521-243a-4496-b03a-173770e0ec37) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-681d54f7-7e31-45cf-8ca2-09d4706c6090', 'volume_size': 1}' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:54:30 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-4ceb2b08-3ce9-4ef7-bcd3-411434cb521b tempest-ProjectMemberTests-1353074417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (993ea865-ff11-4961-9783-1105d29dcf8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:54:30 devstack cinder-volume[88899]: INFO cinder.volume.flows.manager.create_volume [None req-4ceb2b08-3ce9-4ef7-bcd3-411434cb521b tempest-ProjectMemberTests-1353074417 None] Volume volume-681d54f7-7e31-45cf-8ca2-09d4706c6090 (681d54f7-7e31-45cf-8ca2-09d4706c6090): created successfully Aug 03 08:54:30 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-4ceb2b08-3ce9-4ef7-bcd3-411434cb521b tempest-ProjectMemberTests-1353074417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (993ea865-ff11-4961-9783-1105d29dcf8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:54:30 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-4ceb2b08-3ce9-4ef7-bcd3-411434cb521b tempest-ProjectMemberTests-1353074417 None] Flow 'volume_create_manager' (37f30164-1534-4251-931e-1a63d21b613b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:54:30 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-4ceb2b08-3ce9-4ef7-bcd3-411434cb521b tempest-ProjectMemberTests-1353074417 None] Created volume successfully. Aug 03 08:54:30 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-b6e69e51-7239-45a6-aafd-de69d8e8748f tempest-VolumeDependencyTests-1512358985 None] Acquiring lock "cinder-a666f4a5-6cda-48b1-b8ce-a900da8e4a05-delete_snapshot" by "delete_snapshot" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:54:30 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-b6e69e51-7239-45a6-aafd-de69d8e8748f tempest-VolumeDependencyTests-1512358985 None] Lock "cinder-a666f4a5-6cda-48b1-b8ce-a900da8e4a05-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:54:30 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-b6e69e51-7239-45a6-aafd-de69d8e8748f tempest-VolumeDependencyTests-1512358985 None] Acquiring lock "cinder-quobyte-815ad7f9-1a36-40cf-ad01-1e9d227a15de" by "delete_snapshot" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:54:30 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-b6e69e51-7239-45a6-aafd-de69d8e8748f tempest-VolumeDependencyTests-1512358985 None] Lock "cinder-quobyte-815ad7f9-1a36-40cf-ad01-1e9d227a15de" acquired by "delete_snapshot" :: waited 0.020s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:54:30 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-b6e69e51-7239-45a6-aafd-de69d8e8748f tempest-VolumeDependencyTests-1512358985 None] Acquiring lock "cinder-quobyte-a666f4a5-6cda-48b1-b8ce-a900da8e4a05" by "_delete_snapshot" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:54:30 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-b6e69e51-7239-45a6-aafd-de69d8e8748f tempest-VolumeDependencyTests-1512358985 None] Lock "cinder-quobyte-a666f4a5-6cda-48b1-b8ce-a900da8e4a05" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:54:30 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-b6e69e51-7239-45a6-aafd-de69d8e8748f tempest-VolumeDependencyTests-1512358985 None] Deleting offline snapshot a666f4a5-6cda-48b1-b8ce-a900da8e4a05 of volume 815ad7f9-1a36-40cf-ad01-1e9d227a15de {{(pid=88899) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 03 08:54:30 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-b6e69e51-7239-45a6-aafd-de69d8e8748f tempest-VolumeDependencyTests-1512358985 None] snapshot_file for this snap is: volume-815ad7f9-1a36-40cf-ad01-1e9d227a15de.a666f4a5-6cda-48b1-b8ce-a900da8e4a05 {{(pid=88899) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 03 08:54:30 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[8db2d6f4-35f4-49aa-a37f-91675ceeddb3]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:54:30 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-b6e69e51-7239-45a6-aafd-de69d8e8748f tempest-VolumeDependencyTests-1512358985 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-815ad7f9-1a36-40cf-ad01-1e9d227a15de.a666f4a5-6cda-48b1-b8ce-a900da8e4a05 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:54:30 devstack sudo[113329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-815ad7f9-1a36-40cf-ad01-1e9d227a15de.a666f4a5-6cda-48b1-b8ce-a900da8e4a05 Aug 03 08:54:30 devstack sudo[113329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:54:31 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-96605c42-7721-4dc8-a2a4-4aaa2139681c tempest-VolumeImageDependencyTests-942168115 None] Acquiring lock "cinder-7e91f316-bba8-4ffc-83ee-4a736a9150d4-delete_volume" by "delete_volume" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:54:31 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-96605c42-7721-4dc8-a2a4-4aaa2139681c tempest-VolumeImageDependencyTests-942168115 None] Lock "cinder-7e91f316-bba8-4ffc-83ee-4a736a9150d4-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:54:31 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-96605c42-7721-4dc8-a2a4-4aaa2139681c tempest-VolumeImageDependencyTests-942168115 None] Acquiring lock "cinder-quobyte-7e91f316-bba8-4ffc-83ee-4a736a9150d4" by "delete_volume" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:54:31 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-96605c42-7721-4dc8-a2a4-4aaa2139681c tempest-VolumeImageDependencyTests-942168115 None] Lock "cinder-quobyte-7e91f316-bba8-4ffc-83ee-4a736a9150d4" acquired by "delete_volume" :: waited 0.018s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:54:31 devstack sudo[113329]: pam_unix(sudo:session): session closed for user root Aug 03 08:54:31 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-b6e69e51-7239-45a6-aafd-de69d8e8748f tempest-VolumeDependencyTests-1512358985 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-815ad7f9-1a36-40cf-ad01-1e9d227a15de.a666f4a5-6cda-48b1-b8ce-a900da8e4a05" returned: 0 in 0.435s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:54:31 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-b6e69e51-7239-45a6-aafd-de69d8e8748f tempest-VolumeDependencyTests-1512358985 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-815ad7f9-1a36-40cf-ad01-1e9d227a15de(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88899) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 03 08:54:31 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bb45da4-e7be-4a8c-90ad-69b153de5c1e]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:54:31 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-96605c42-7721-4dc8-a2a4-4aaa2139681c tempest-VolumeImageDependencyTests-942168115 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-7e91f316-bba8-4ffc-83ee-4a736a9150d4 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:54:31 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fead15c-9122-4c00-aa45-c0f8c819f98d]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:54:31 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-b6e69e51-7239-45a6-aafd-de69d8e8748f tempest-VolumeDependencyTests-1512358985 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-815ad7f9-1a36-40cf-ad01-1e9d227a15de {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:54:31 devstack sudo[113335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-7e91f316-bba8-4ffc-83ee-4a736a9150d4 Aug 03 08:54:31 devstack sudo[113335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:54:31 devstack sudo[113336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-815ad7f9-1a36-40cf-ad01-1e9d227a15de Aug 03 08:54:31 devstack sudo[113336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:54:31 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-4ef7cabe-e657-4ed6-b330-cef7aae2fb5d tempest-ProjectMemberTests-1353074417 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:54:31 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-4ef7cabe-e657-4ed6-b330-cef7aae2fb5d tempest-ProjectMemberTests-1353074417 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:54:31 devstack sudo[113336]: pam_unix(sudo:session): session closed for user root Aug 03 08:54:31 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-b6e69e51-7239-45a6-aafd-de69d8e8748f tempest-VolumeDependencyTests-1512358985 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-815ad7f9-1a36-40cf-ad01-1e9d227a15de" returned: 0 in 0.442s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:54:31 devstack sudo[113335]: pam_unix(sudo:session): session closed for user root Aug 03 08:54:31 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-b6e69e51-7239-45a6-aafd-de69d8e8748f tempest-VolumeDependencyTests-1512358985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-815ad7f9-1a36-40cf-ad01-1e9d227a15de.a666f4a5-6cda-48b1-b8ce-a900da8e4a05 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:54:31 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-4ef7cabe-e657-4ed6-b330-cef7aae2fb5d tempest-ProjectMemberTests-1353074417 None] Creating offline snapshot d1b24583-1111-4d86-982b-9cd937f5be40 of volume 681d54f7-7e31-45cf-8ca2-09d4706c6090 {{(pid=88899) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 03 08:54:31 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-96605c42-7721-4dc8-a2a4-4aaa2139681c tempest-VolumeImageDependencyTests-942168115 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-7e91f316-bba8-4ffc-83ee-4a736a9150d4" returned: 0 in 0.490s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:54:31 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-96605c42-7721-4dc8-a2a4-4aaa2139681c tempest-VolumeImageDependencyTests-942168115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-7e91f316-bba8-4ffc-83ee-4a736a9150d4 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:54:31 devstack sudo[113345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-815ad7f9-1a36-40cf-ad01-1e9d227a15de.a666f4a5-6cda-48b1-b8ce-a900da8e4a05 Aug 03 08:54:31 devstack sudo[113345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:54:31 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[32c2459b-9f63-4514-b326-914831f99dca]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:54:31 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-4ef7cabe-e657-4ed6-b330-cef7aae2fb5d tempest-ProjectMemberTests-1353074417 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-681d54f7-7e31-45cf-8ca2-09d4706c6090 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:54:31 devstack sudo[113347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-7e91f316-bba8-4ffc-83ee-4a736a9150d4 Aug 03 08:54:31 devstack sudo[113347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:54:31 devstack sudo[113348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-681d54f7-7e31-45cf-8ca2-09d4706c6090 Aug 03 08:54:31 devstack sudo[113348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:54:31 devstack sudo[113347]: pam_unix(sudo:session): session closed for user root Aug 03 08:54:31 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-96605c42-7721-4dc8-a2a4-4aaa2139681c tempest-VolumeImageDependencyTests-942168115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-7e91f316-bba8-4ffc-83ee-4a736a9150d4" returned: 0 in 0.319s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:54:32 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-96605c42-7721-4dc8-a2a4-4aaa2139681c tempest-VolumeImageDependencyTests-942168115 None] Lock "cinder-quobyte-7e91f316-bba8-4ffc-83ee-4a736a9150d4" released by "delete_volume" :: held 0.889s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:54:32 devstack sudo[113345]: pam_unix(sudo:session): session closed for user root Aug 03 08:54:32 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-b6e69e51-7239-45a6-aafd-de69d8e8748f tempest-VolumeDependencyTests-1512358985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-815ad7f9-1a36-40cf-ad01-1e9d227a15de.a666f4a5-6cda-48b1-b8ce-a900da8e4a05" returned: 0 in 0.428s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:54:32 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-b6e69e51-7239-45a6-aafd-de69d8e8748f tempest-VolumeDependencyTests-1512358985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-815ad7f9-1a36-40cf-ad01-1e9d227a15de.a666f4a5-6cda-48b1-b8ce-a900da8e4a05 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:54:32 devstack sudo[113359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-815ad7f9-1a36-40cf-ad01-1e9d227a15de.a666f4a5-6cda-48b1-b8ce-a900da8e4a05 Aug 03 08:54:32 devstack sudo[113359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:54:32 devstack cinder-volume[88899]: DEBUG cinder.quota [None req-96605c42-7721-4dc8-a2a4-4aaa2139681c tempest-VolumeImageDependencyTests-942168115 None] Created reservations ['6c714f78-ff09-41ac-9837-ee01903fbba5', '92164bba-7681-4529-a94e-a55cb5fec714', '07821bd2-ee0d-40fb-8182-0b34b4216fca', 'ca50d65a-246a-4e58-8fef-e06392a942f8'] {{(pid=88899) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 08:54:32 devstack sudo[113348]: pam_unix(sudo:session): session closed for user root Aug 03 08:54:32 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-4ef7cabe-e657-4ed6-b330-cef7aae2fb5d tempest-ProjectMemberTests-1353074417 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-681d54f7-7e31-45cf-8ca2-09d4706c6090" returned: 0 in 0.451s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:54:32 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-4ef7cabe-e657-4ed6-b330-cef7aae2fb5d tempest-ProjectMemberTests-1353074417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-681d54f7-7e31-45cf-8ca2-09d4706c6090,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-681d54f7-7e31-45cf-8ca2-09d4706c6090.d1b24583-1111-4d86-982b-9cd937f5be40 1G {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:54:32 devstack sudo[113361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-681d54f7-7e31-45cf-8ca2-09d4706c6090,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-681d54f7-7e31-45cf-8ca2-09d4706c6090.d1b24583-1111-4d86-982b-9cd937f5be40 1G Aug 03 08:54:32 devstack sudo[113361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:54:32 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-96605c42-7721-4dc8-a2a4-4aaa2139681c tempest-VolumeImageDependencyTests-942168115 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:54:32 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-96605c42-7721-4dc8-a2a4-4aaa2139681c tempest-VolumeImageDependencyTests-942168115 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:54:32 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-96605c42-7721-4dc8-a2a4-4aaa2139681c tempest-VolumeImageDependencyTests-942168115 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:54:32 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-96605c42-7721-4dc8-a2a4-4aaa2139681c tempest-VolumeImageDependencyTests-942168115 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:54:32 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-96605c42-7721-4dc8-a2a4-4aaa2139681c tempest-VolumeImageDependencyTests-942168115 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:54:32 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-96605c42-7721-4dc8-a2a4-4aaa2139681c tempest-VolumeImageDependencyTests-942168115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:54:32 devstack sudo[113363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a Aug 03 08:54:32 devstack sudo[113363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:54:32 devstack sudo[113359]: pam_unix(sudo:session): session closed for user root Aug 03 08:54:32 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-b6e69e51-7239-45a6-aafd-de69d8e8748f tempest-VolumeDependencyTests-1512358985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-815ad7f9-1a36-40cf-ad01-1e9d227a15de.a666f4a5-6cda-48b1-b8ce-a900da8e4a05" returned: 0 in 0.333s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:54:32 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-b6e69e51-7239-45a6-aafd-de69d8e8748f tempest-VolumeDependencyTests-1512358985 None] Lock "cinder-quobyte-a666f4a5-6cda-48b1-b8ce-a900da8e4a05" released by "_delete_snapshot" :: held 1.771s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:54:32 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-b6e69e51-7239-45a6-aafd-de69d8e8748f tempest-VolumeDependencyTests-1512358985 None] Lock "cinder-quobyte-815ad7f9-1a36-40cf-ad01-1e9d227a15de" released by "delete_snapshot" :: held 1.796s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:54:32 devstack cinder-volume[88899]: DEBUG cinder.quota [None req-b6e69e51-7239-45a6-aafd-de69d8e8748f tempest-VolumeDependencyTests-1512358985 None] Created reservations ['fcb951de-d13f-4c08-9e78-6d43638fffff', 'f2441310-057e-4d52-bd53-09ac660c8eb6', 'a87de864-6955-412c-852f-46cb9a55661f', 'd111d7b5-d5d1-4708-87c8-5027c40a8ce7'] {{(pid=88899) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 08:54:32 devstack sudo[113363]: pam_unix(sudo:session): session closed for user root Aug 03 08:54:32 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-96605c42-7721-4dc8-a2a4-4aaa2139681c tempest-VolumeImageDependencyTests-942168115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a" returned: 0 in 0.306s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:54:32 devstack cinder-volume[88899]: DEBUG cinder.manager [None req-96605c42-7721-4dc8-a2a4-4aaa2139681c tempest-VolumeImageDependencyTests-942168115 None] Notifying Schedulers of capabilities ... {{(pid=88899) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 08:54:32 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-96605c42-7721-4dc8-a2a4-4aaa2139681c tempest-VolumeImageDependencyTests-942168115 None] Deleted volume successfully. Aug 03 08:54:32 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-b6e69e51-7239-45a6-aafd-de69d8e8748f tempest-VolumeDependencyTests-1512358985 None] Delete snapshot completed successfully. Aug 03 08:54:32 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-96605c42-7721-4dc8-a2a4-4aaa2139681c tempest-VolumeImageDependencyTests-942168115 None] Lock "cinder-7e91f316-bba8-4ffc-83ee-4a736a9150d4-delete_volume" released by "delete_volume" :: held 1.564s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:54:32 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-b6e69e51-7239-45a6-aafd-de69d8e8748f tempest-VolumeDependencyTests-1512358985 None] Lock "cinder-a666f4a5-6cda-48b1-b8ce-a900da8e4a05-delete_snapshot" released by "delete_snapshot" :: held 1.984s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:54:32 devstack sudo[113361]: pam_unix(sudo:session): session closed for user root Aug 03 08:54:32 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-4ef7cabe-e657-4ed6-b330-cef7aae2fb5d tempest-ProjectMemberTests-1353074417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-681d54f7-7e31-45cf-8ca2-09d4706c6090,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-681d54f7-7e31-45cf-8ca2-09d4706c6090.d1b24583-1111-4d86-982b-9cd937f5be40 1G" returned: 0 in 0.624s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:54:32 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-4ef7cabe-e657-4ed6-b330-cef7aae2fb5d tempest-ProjectMemberTests-1353074417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-681d54f7-7e31-45cf-8ca2-09d4706c6090 -F qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-681d54f7-7e31-45cf-8ca2-09d4706c6090.d1b24583-1111-4d86-982b-9cd937f5be40 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:54:32 devstack sudo[113373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-681d54f7-7e31-45cf-8ca2-09d4706c6090 -F qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-681d54f7-7e31-45cf-8ca2-09d4706c6090.d1b24583-1111-4d86-982b-9cd937f5be40 Aug 03 08:54:32 devstack sudo[113373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:54:32 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-35e8435e-6efe-43cc-802b-b416aaf5753e tempest-VolumeDependencyTests-1512358985 None] Acquiring lock "cinder-e65a2b63-8524-45ea-92ab-d4db1c52b46c-delete_volume" by "delete_volume" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:54:32 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-35e8435e-6efe-43cc-802b-b416aaf5753e tempest-VolumeDependencyTests-1512358985 None] Lock "cinder-e65a2b63-8524-45ea-92ab-d4db1c52b46c-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:54:32 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-35e8435e-6efe-43cc-802b-b416aaf5753e tempest-VolumeDependencyTests-1512358985 None] Acquiring lock "cinder-quobyte-e65a2b63-8524-45ea-92ab-d4db1c52b46c" by "delete_volume" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:54:32 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-35e8435e-6efe-43cc-802b-b416aaf5753e tempest-VolumeDependencyTests-1512358985 None] Lock "cinder-quobyte-e65a2b63-8524-45ea-92ab-d4db1c52b46c" acquired by "delete_volume" :: waited 0.014s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:54:32 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[a856e6f0-9e9b-4256-bc62-ca55eeaa731b]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:54:32 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-35e8435e-6efe-43cc-802b-b416aaf5753e tempest-VolumeDependencyTests-1512358985 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-e65a2b63-8524-45ea-92ab-d4db1c52b46c {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:54:33 devstack sudo[113375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-e65a2b63-8524-45ea-92ab-d4db1c52b46c Aug 03 08:54:33 devstack sudo[113375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:54:33 devstack sudo[113373]: pam_unix(sudo:session): session closed for user root Aug 03 08:54:33 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-4ef7cabe-e657-4ed6-b330-cef7aae2fb5d tempest-ProjectMemberTests-1353074417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-681d54f7-7e31-45cf-8ca2-09d4706c6090 -F qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-681d54f7-7e31-45cf-8ca2-09d4706c6090.d1b24583-1111-4d86-982b-9cd937f5be40" returned: 0 in 0.327s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:54:33 devstack cinder-volume[88899]: WARNING cinder.volume.drivers.remotefs [None req-4ef7cabe-e657-4ed6-b330-cef7aae2fb5d tempest-ProjectMemberTests-1353074417 None] /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-681d54f7-7e31-45cf-8ca2-09d4706c6090.d1b24583-1111-4d86-982b-9cd937f5be40 is being set with open permissions: ugo+rw Aug 03 08:54:33 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-4ef7cabe-e657-4ed6-b330-cef7aae2fb5d tempest-ProjectMemberTests-1353074417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-681d54f7-7e31-45cf-8ca2-09d4706c6090.d1b24583-1111-4d86-982b-9cd937f5be40 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:54:33 devstack sudo[113380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-681d54f7-7e31-45cf-8ca2-09d4706c6090.d1b24583-1111-4d86-982b-9cd937f5be40 Aug 03 08:54:33 devstack sudo[113380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:54:33 devstack sudo[113375]: pam_unix(sudo:session): session closed for user root Aug 03 08:54:33 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-35e8435e-6efe-43cc-802b-b416aaf5753e tempest-VolumeDependencyTests-1512358985 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-e65a2b63-8524-45ea-92ab-d4db1c52b46c" returned: 0 in 0.441s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:54:33 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-35e8435e-6efe-43cc-802b-b416aaf5753e tempest-VolumeDependencyTests-1512358985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-e65a2b63-8524-45ea-92ab-d4db1c52b46c {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:54:33 devstack sudo[113380]: pam_unix(sudo:session): session closed for user root Aug 03 08:54:33 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-4ef7cabe-e657-4ed6-b330-cef7aae2fb5d tempest-ProjectMemberTests-1353074417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-681d54f7-7e31-45cf-8ca2-09d4706c6090.d1b24583-1111-4d86-982b-9cd937f5be40" returned: 0 in 0.331s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:54:33 devstack sudo[113386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-e65a2b63-8524-45ea-92ab-d4db1c52b46c Aug 03 08:54:33 devstack sudo[113386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:54:33 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-4ef7cabe-e657-4ed6-b330-cef7aae2fb5d tempest-ProjectMemberTests-1353074417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-681d54f7-7e31-45cf-8ca2-09d4706c6090.info {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:54:33 devstack sudo[113388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-681d54f7-7e31-45cf-8ca2-09d4706c6090.info Aug 03 08:54:33 devstack sudo[113388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:54:33 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-7de55fc4-0fb8-425f-a8eb-a936c8567777 tempest-VolumeImageDependencyTests-942168115 None] Acquiring lock "cinder-bcc51603-5d44-4976-8687-6838b41be60a-delete_volume" by "delete_volume" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:54:33 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-7de55fc4-0fb8-425f-a8eb-a936c8567777 tempest-VolumeImageDependencyTests-942168115 None] Lock "cinder-bcc51603-5d44-4976-8687-6838b41be60a-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:54:33 devstack sudo[113386]: pam_unix(sudo:session): session closed for user root Aug 03 08:54:33 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-35e8435e-6efe-43cc-802b-b416aaf5753e tempest-VolumeDependencyTests-1512358985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-e65a2b63-8524-45ea-92ab-d4db1c52b46c" returned: 0 in 0.316s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:54:33 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-7de55fc4-0fb8-425f-a8eb-a936c8567777 tempest-VolumeImageDependencyTests-942168115 None] Acquiring lock "cinder-quobyte-bcc51603-5d44-4976-8687-6838b41be60a" by "delete_volume" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:54:33 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-35e8435e-6efe-43cc-802b-b416aaf5753e tempest-VolumeDependencyTests-1512358985 None] Lock "cinder-quobyte-e65a2b63-8524-45ea-92ab-d4db1c52b46c" released by "delete_volume" :: held 0.824s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:54:33 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-7de55fc4-0fb8-425f-a8eb-a936c8567777 tempest-VolumeImageDependencyTests-942168115 None] Lock "cinder-quobyte-bcc51603-5d44-4976-8687-6838b41be60a" acquired by "delete_volume" :: waited 0.040s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:54:33 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2a669c5-4291-4fc3-afb5-9871f5800b28]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:54:33 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-7de55fc4-0fb8-425f-a8eb-a936c8567777 tempest-VolumeImageDependencyTests-942168115 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-bcc51603-5d44-4976-8687-6838b41be60a {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:54:33 devstack sudo[113388]: pam_unix(sudo:session): session closed for user root Aug 03 08:54:33 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-4ef7cabe-e657-4ed6-b330-cef7aae2fb5d tempest-ProjectMemberTests-1353074417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-681d54f7-7e31-45cf-8ca2-09d4706c6090.info" returned: 0 in 0.341s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:54:33 devstack cinder-volume[88899]: WARNING cinder.volume.drivers.remotefs [None req-4ef7cabe-e657-4ed6-b330-cef7aae2fb5d tempest-ProjectMemberTests-1353074417 None] /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-681d54f7-7e31-45cf-8ca2-09d4706c6090.info is being set with open permissions: ugo+rw Aug 03 08:54:33 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-4ef7cabe-e657-4ed6-b330-cef7aae2fb5d tempest-ProjectMemberTests-1353074417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-681d54f7-7e31-45cf-8ca2-09d4706c6090.info {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:54:33 devstack sudo[113393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-681d54f7-7e31-45cf-8ca2-09d4706c6090.info Aug 03 08:54:33 devstack sudo[113393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:54:33 devstack cinder-volume[88899]: DEBUG cinder.quota [None req-35e8435e-6efe-43cc-802b-b416aaf5753e tempest-VolumeDependencyTests-1512358985 None] Created reservations ['fceca117-8fb0-48c0-8e7c-f08e8d7e412c', '6d56077f-a450-448f-8c00-9ccc2876093e', '3bd2353a-e7c6-4b72-a697-ac13c4986b42', '27423867-40d8-4dff-9f6d-442d9cfbb48c'] {{(pid=88899) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 08:54:33 devstack sudo[113392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-bcc51603-5d44-4976-8687-6838b41be60a Aug 03 08:54:33 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-35e8435e-6efe-43cc-802b-b416aaf5753e tempest-VolumeDependencyTests-1512358985 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:54:33 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-35e8435e-6efe-43cc-802b-b416aaf5753e tempest-VolumeDependencyTests-1512358985 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:54:33 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-35e8435e-6efe-43cc-802b-b416aaf5753e tempest-VolumeDependencyTests-1512358985 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:54:33 devstack sudo[113392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:54:33 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-35e8435e-6efe-43cc-802b-b416aaf5753e tempest-VolumeDependencyTests-1512358985 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:54:33 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-35e8435e-6efe-43cc-802b-b416aaf5753e tempest-VolumeDependencyTests-1512358985 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:54:33 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-35e8435e-6efe-43cc-802b-b416aaf5753e tempest-VolumeDependencyTests-1512358985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:54:33 devstack sudo[113396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a Aug 03 08:54:33 devstack sudo[113396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:54:34 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-c8b44eed-b9bc-4357-95dc-b15a66bba605 tempest-VolumeDependencyTests-1512358985 None] Acquiring lock "cinder-815ad7f9-1a36-40cf-ad01-1e9d227a15de-delete_volume" by "delete_volume" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:54:34 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-c8b44eed-b9bc-4357-95dc-b15a66bba605 tempest-VolumeDependencyTests-1512358985 None] Lock "cinder-815ad7f9-1a36-40cf-ad01-1e9d227a15de-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:54:34 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-c8b44eed-b9bc-4357-95dc-b15a66bba605 tempest-VolumeDependencyTests-1512358985 None] Acquiring lock "cinder-quobyte-815ad7f9-1a36-40cf-ad01-1e9d227a15de" by "delete_volume" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:54:34 devstack sudo[113393]: pam_unix(sudo:session): session closed for user root Aug 03 08:54:34 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-4ef7cabe-e657-4ed6-b330-cef7aae2fb5d tempest-ProjectMemberTests-1353074417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-681d54f7-7e31-45cf-8ca2-09d4706c6090.info" returned: 0 in 0.395s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:54:34 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-4ef7cabe-e657-4ed6-b330-cef7aae2fb5d tempest-ProjectMemberTests-1353074417 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.601s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:54:34 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-c8b44eed-b9bc-4357-95dc-b15a66bba605 tempest-VolumeDependencyTests-1512358985 None] Lock "cinder-quobyte-815ad7f9-1a36-40cf-ad01-1e9d227a15de" acquired by "delete_volume" :: waited 0.054s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:54:34 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[da42731f-dd3c-478c-994f-d5e8811caece]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:54:34 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-c8b44eed-b9bc-4357-95dc-b15a66bba605 tempest-VolumeDependencyTests-1512358985 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-815ad7f9-1a36-40cf-ad01-1e9d227a15de {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:54:34 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-4ef7cabe-e657-4ed6-b330-cef7aae2fb5d tempest-ProjectMemberTests-1353074417 None] Create snapshot completed successfully Aug 03 08:54:34 devstack sudo[113396]: pam_unix(sudo:session): session closed for user root Aug 03 08:54:34 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-35e8435e-6efe-43cc-802b-b416aaf5753e tempest-VolumeDependencyTests-1512358985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a" returned: 0 in 0.406s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:54:34 devstack cinder-volume[88899]: DEBUG cinder.manager [None req-35e8435e-6efe-43cc-802b-b416aaf5753e tempest-VolumeDependencyTests-1512358985 None] Notifying Schedulers of capabilities ... {{(pid=88899) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 08:54:34 devstack sudo[113392]: pam_unix(sudo:session): session closed for user root Aug 03 08:54:34 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-7de55fc4-0fb8-425f-a8eb-a936c8567777 tempest-VolumeImageDependencyTests-942168115 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-bcc51603-5d44-4976-8687-6838b41be60a" returned: 0 in 0.572s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:54:34 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-7de55fc4-0fb8-425f-a8eb-a936c8567777 tempest-VolumeImageDependencyTests-942168115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-bcc51603-5d44-4976-8687-6838b41be60a {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:54:34 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-35e8435e-6efe-43cc-802b-b416aaf5753e tempest-VolumeDependencyTests-1512358985 None] Deleted volume successfully. Aug 03 08:54:34 devstack sudo[113404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-bcc51603-5d44-4976-8687-6838b41be60a Aug 03 08:54:34 devstack sudo[113404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:54:34 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-35e8435e-6efe-43cc-802b-b416aaf5753e tempest-VolumeDependencyTests-1512358985 None] Lock "cinder-e65a2b63-8524-45ea-92ab-d4db1c52b46c-delete_volume" released by "delete_volume" :: held 1.544s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:54:34 devstack sudo[113403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-815ad7f9-1a36-40cf-ad01-1e9d227a15de Aug 03 08:54:34 devstack sudo[113403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:54:34 devstack sudo[113404]: pam_unix(sudo:session): session closed for user root Aug 03 08:54:34 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-7de55fc4-0fb8-425f-a8eb-a936c8567777 tempest-VolumeImageDependencyTests-942168115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-bcc51603-5d44-4976-8687-6838b41be60a" returned: 0 in 0.273s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:54:34 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-7de55fc4-0fb8-425f-a8eb-a936c8567777 tempest-VolumeImageDependencyTests-942168115 None] Lock "cinder-quobyte-bcc51603-5d44-4976-8687-6838b41be60a" released by "delete_volume" :: held 0.894s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:54:34 devstack cinder-volume[88899]: DEBUG cinder.quota [None req-7de55fc4-0fb8-425f-a8eb-a936c8567777 tempest-VolumeImageDependencyTests-942168115 None] Created reservations ['4ee2258c-399e-4165-8b0c-a81aabc8b48c', 'a3387d41-d32c-4934-9134-981169012646', 'c67510f2-5d14-4685-82b0-6a95a380a9ad', 'b01ea703-12ac-4de8-8398-b1bf53964da9'] {{(pid=88899) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 08:54:34 devstack sudo[113403]: pam_unix(sudo:session): session closed for user root Aug 03 08:54:34 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-c8b44eed-b9bc-4357-95dc-b15a66bba605 tempest-VolumeDependencyTests-1512358985 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-815ad7f9-1a36-40cf-ad01-1e9d227a15de" returned: 0 in 0.413s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:54:34 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-c8b44eed-b9bc-4357-95dc-b15a66bba605 tempest-VolumeDependencyTests-1512358985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-815ad7f9-1a36-40cf-ad01-1e9d227a15de {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:54:34 devstack sudo[113411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-815ad7f9-1a36-40cf-ad01-1e9d227a15de Aug 03 08:54:34 devstack sudo[113411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:54:34 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-7de55fc4-0fb8-425f-a8eb-a936c8567777 tempest-VolumeImageDependencyTests-942168115 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:54:34 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-7de55fc4-0fb8-425f-a8eb-a936c8567777 tempest-VolumeImageDependencyTests-942168115 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:54:34 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-7de55fc4-0fb8-425f-a8eb-a936c8567777 tempest-VolumeImageDependencyTests-942168115 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:54:34 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-7de55fc4-0fb8-425f-a8eb-a936c8567777 tempest-VolumeImageDependencyTests-942168115 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:54:34 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-7de55fc4-0fb8-425f-a8eb-a936c8567777 tempest-VolumeImageDependencyTests-942168115 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:54:34 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-7de55fc4-0fb8-425f-a8eb-a936c8567777 tempest-VolumeImageDependencyTests-942168115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:54:34 devstack sudo[113413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a Aug 03 08:54:34 devstack sudo[113413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:54:34 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-123339b1-149e-4a8b-bb30-706e8ae37a0d tempest-ProjectMemberTests-1353074417 None] Acquiring lock "cinder-d1b24583-1111-4d86-982b-9cd937f5be40-delete_snapshot" by "delete_snapshot" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:54:34 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-123339b1-149e-4a8b-bb30-706e8ae37a0d tempest-ProjectMemberTests-1353074417 None] Lock "cinder-d1b24583-1111-4d86-982b-9cd937f5be40-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:54:34 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-123339b1-149e-4a8b-bb30-706e8ae37a0d tempest-ProjectMemberTests-1353074417 None] Acquiring lock "cinder-quobyte-681d54f7-7e31-45cf-8ca2-09d4706c6090" by "delete_snapshot" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:54:35 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-123339b1-149e-4a8b-bb30-706e8ae37a0d tempest-ProjectMemberTests-1353074417 None] Lock "cinder-quobyte-681d54f7-7e31-45cf-8ca2-09d4706c6090" acquired by "delete_snapshot" :: waited 0.019s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:54:35 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-123339b1-149e-4a8b-bb30-706e8ae37a0d tempest-ProjectMemberTests-1353074417 None] Acquiring lock "cinder-quobyte-d1b24583-1111-4d86-982b-9cd937f5be40" by "_delete_snapshot" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:54:35 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-123339b1-149e-4a8b-bb30-706e8ae37a0d tempest-ProjectMemberTests-1353074417 None] Lock "cinder-quobyte-d1b24583-1111-4d86-982b-9cd937f5be40" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:54:35 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-123339b1-149e-4a8b-bb30-706e8ae37a0d tempest-ProjectMemberTests-1353074417 None] Deleting offline snapshot d1b24583-1111-4d86-982b-9cd937f5be40 of volume 681d54f7-7e31-45cf-8ca2-09d4706c6090 {{(pid=88899) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 03 08:54:35 devstack sudo[113411]: pam_unix(sudo:session): session closed for user root Aug 03 08:54:35 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-123339b1-149e-4a8b-bb30-706e8ae37a0d tempest-ProjectMemberTests-1353074417 None] snapshot_file for this snap is: volume-681d54f7-7e31-45cf-8ca2-09d4706c6090.d1b24583-1111-4d86-982b-9cd937f5be40 {{(pid=88899) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 03 08:54:35 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-c8b44eed-b9bc-4357-95dc-b15a66bba605 tempest-VolumeDependencyTests-1512358985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-815ad7f9-1a36-40cf-ad01-1e9d227a15de" returned: 0 in 0.364s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:54:35 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[498e4dde-46d5-43c2-8343-6a80ca6e3cbe]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:54:35 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-123339b1-149e-4a8b-bb30-706e8ae37a0d tempest-ProjectMemberTests-1353074417 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-681d54f7-7e31-45cf-8ca2-09d4706c6090.d1b24583-1111-4d86-982b-9cd937f5be40 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:54:35 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-c8b44eed-b9bc-4357-95dc-b15a66bba605 tempest-VolumeDependencyTests-1512358985 None] Lock "cinder-quobyte-815ad7f9-1a36-40cf-ad01-1e9d227a15de" released by "delete_volume" :: held 0.887s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:54:35 devstack sudo[113413]: pam_unix(sudo:session): session closed for user root Aug 03 08:54:35 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-7de55fc4-0fb8-425f-a8eb-a936c8567777 tempest-VolumeImageDependencyTests-942168115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a" returned: 0 in 0.369s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:54:35 devstack cinder-volume[88899]: DEBUG cinder.manager [None req-7de55fc4-0fb8-425f-a8eb-a936c8567777 tempest-VolumeImageDependencyTests-942168115 None] Notifying Schedulers of capabilities ... {{(pid=88899) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 08:54:35 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-7de55fc4-0fb8-425f-a8eb-a936c8567777 tempest-VolumeImageDependencyTests-942168115 None] Deleted volume successfully. Aug 03 08:54:35 devstack cinder-volume[88899]: DEBUG cinder.quota [None req-c8b44eed-b9bc-4357-95dc-b15a66bba605 tempest-VolumeDependencyTests-1512358985 None] Created reservations ['4406b758-616c-4504-8db8-a71f1a7514c4', '84bff240-b54b-41d3-aef4-a5f13623f0d0', 'f389d016-41db-4168-9a03-c8d81a116923', 'f742fc2e-495e-40e9-9b36-e9b0557504e8'] {{(pid=88899) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 08:54:35 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-7de55fc4-0fb8-425f-a8eb-a936c8567777 tempest-VolumeImageDependencyTests-942168115 None] Lock "cinder-bcc51603-5d44-4976-8687-6838b41be60a-delete_volume" released by "delete_volume" :: held 1.610s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:54:35 devstack sudo[113416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-681d54f7-7e31-45cf-8ca2-09d4706c6090.d1b24583-1111-4d86-982b-9cd937f5be40 Aug 03 08:54:35 devstack sudo[113416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:54:35 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-c8b44eed-b9bc-4357-95dc-b15a66bba605 tempest-VolumeDependencyTests-1512358985 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:54:35 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-c8b44eed-b9bc-4357-95dc-b15a66bba605 tempest-VolumeDependencyTests-1512358985 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:54:35 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-c8b44eed-b9bc-4357-95dc-b15a66bba605 tempest-VolumeDependencyTests-1512358985 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:54:35 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-c8b44eed-b9bc-4357-95dc-b15a66bba605 tempest-VolumeDependencyTests-1512358985 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:54:35 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-c8b44eed-b9bc-4357-95dc-b15a66bba605 tempest-VolumeDependencyTests-1512358985 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:54:35 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-c8b44eed-b9bc-4357-95dc-b15a66bba605 tempest-VolumeDependencyTests-1512358985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:54:35 devstack sudo[113419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a Aug 03 08:54:35 devstack sudo[113419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:54:35 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-8561c524-4693-4d79-8136-7eb3a57689e4 tempest-VolumeDependencyTests-1512358985 None] Acquiring lock "cinder-fa5f047c-0aea-4f87-a1c9-e7a655bdeef3-delete_volume" by "delete_volume" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:54:35 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-8561c524-4693-4d79-8136-7eb3a57689e4 tempest-VolumeDependencyTests-1512358985 None] Lock "cinder-fa5f047c-0aea-4f87-a1c9-e7a655bdeef3-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:54:35 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-8561c524-4693-4d79-8136-7eb3a57689e4 tempest-VolumeDependencyTests-1512358985 None] Acquiring lock "cinder-quobyte-fa5f047c-0aea-4f87-a1c9-e7a655bdeef3" by "delete_volume" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:54:35 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-8561c524-4693-4d79-8136-7eb3a57689e4 tempest-VolumeDependencyTests-1512358985 None] Lock "cinder-quobyte-fa5f047c-0aea-4f87-a1c9-e7a655bdeef3" acquired by "delete_volume" :: waited 0.017s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:54:35 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a2bffb9-398c-43f0-8ca1-02e6b19e6acf]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:54:35 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-8561c524-4693-4d79-8136-7eb3a57689e4 tempest-VolumeDependencyTests-1512358985 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-fa5f047c-0aea-4f87-a1c9-e7a655bdeef3 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:54:35 devstack sudo[113416]: pam_unix(sudo:session): session closed for user root Aug 03 08:54:35 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-123339b1-149e-4a8b-bb30-706e8ae37a0d tempest-ProjectMemberTests-1353074417 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-681d54f7-7e31-45cf-8ca2-09d4706c6090.d1b24583-1111-4d86-982b-9cd937f5be40" returned: 0 in 0.565s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:54:35 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-123339b1-149e-4a8b-bb30-706e8ae37a0d tempest-ProjectMemberTests-1353074417 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-681d54f7-7e31-45cf-8ca2-09d4706c6090(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88899) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 03 08:54:35 devstack sudo[113419]: pam_unix(sudo:session): session closed for user root Aug 03 08:54:35 devstack sudo[113423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-fa5f047c-0aea-4f87-a1c9-e7a655bdeef3 Aug 03 08:54:35 devstack sudo[113423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:54:35 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-c8b44eed-b9bc-4357-95dc-b15a66bba605 tempest-VolumeDependencyTests-1512358985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a" returned: 0 in 0.365s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:54:35 devstack cinder-volume[88899]: DEBUG cinder.manager [None req-c8b44eed-b9bc-4357-95dc-b15a66bba605 tempest-VolumeDependencyTests-1512358985 None] Notifying Schedulers of capabilities ... {{(pid=88899) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 08:54:35 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-c8b44eed-b9bc-4357-95dc-b15a66bba605 tempest-VolumeDependencyTests-1512358985 None] Deleted volume successfully. Aug 03 08:54:35 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bce2328-0894-4055-8e50-ba847b777b9d]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:54:35 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-123339b1-149e-4a8b-bb30-706e8ae37a0d tempest-ProjectMemberTests-1353074417 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-681d54f7-7e31-45cf-8ca2-09d4706c6090 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:54:35 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-c8b44eed-b9bc-4357-95dc-b15a66bba605 tempest-VolumeDependencyTests-1512358985 None] Lock "cinder-815ad7f9-1a36-40cf-ad01-1e9d227a15de-delete_volume" released by "delete_volume" :: held 1.638s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:54:35 devstack sudo[113427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-681d54f7-7e31-45cf-8ca2-09d4706c6090 Aug 03 08:54:35 devstack sudo[113427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:54:36 devstack sudo[113423]: pam_unix(sudo:session): session closed for user root Aug 03 08:54:36 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-8561c524-4693-4d79-8136-7eb3a57689e4 tempest-VolumeDependencyTests-1512358985 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-fa5f047c-0aea-4f87-a1c9-e7a655bdeef3" returned: 0 in 0.500s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:54:36 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-8561c524-4693-4d79-8136-7eb3a57689e4 tempest-VolumeDependencyTests-1512358985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-fa5f047c-0aea-4f87-a1c9-e7a655bdeef3 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:54:36 devstack sudo[113434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-fa5f047c-0aea-4f87-a1c9-e7a655bdeef3 Aug 03 08:54:36 devstack sudo[113434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:54:36 devstack cinder-volume[88899]: DEBUG cinder.volume.flows.manager.create_volume [None req-2246841a-2037-4a79-89b8-6ba6b8dede1e tempest-ProjectReaderTests-397971060 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88899) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 08:54:36 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-2246841a-2037-4a79-89b8-6ba6b8dede1e tempest-ProjectReaderTests-397971060 None] Flow 'volume_create_manager' (0dfcf885-cb5d-45dd-b66a-3f83ccdce0d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:54:36 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-2246841a-2037-4a79-89b8-6ba6b8dede1e tempest-ProjectReaderTests-397971060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c749e69-e55d-4a2e-b934-3ed3a12f7339) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:54:36 devstack sudo[113427]: pam_unix(sudo:session): session closed for user root Aug 03 08:54:36 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-123339b1-149e-4a8b-bb30-706e8ae37a0d tempest-ProjectMemberTests-1353074417 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-681d54f7-7e31-45cf-8ca2-09d4706c6090" returned: 0 in 0.568s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:54:36 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-123339b1-149e-4a8b-bb30-706e8ae37a0d tempest-ProjectMemberTests-1353074417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-681d54f7-7e31-45cf-8ca2-09d4706c6090.d1b24583-1111-4d86-982b-9cd937f5be40 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:54:36 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-2246841a-2037-4a79-89b8-6ba6b8dede1e tempest-ProjectReaderTests-397971060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c749e69-e55d-4a2e-b934-3ed3a12f7339) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:54:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-261744869',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=82bfe2e1-93bd-4fda-8716-5554326a35ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a95fee59b384e1eb793d0850380c011',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:54:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:54:36Z,use_quota=True,user_id='d3e77fcfb478424d98b0b26e873c68b3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8bde7129-1dc4-42ab-b852-ab32c61b4921),volume_type_id=8bde7129-1dc4-42ab-b852-ab32c61b4921)' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:54:36 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-2246841a-2037-4a79-89b8-6ba6b8dede1e tempest-ProjectReaderTests-397971060 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f4c9274-9b58-4b5a-bec0-ca40e912b886) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:54:36 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-2246841a-2037-4a79-89b8-6ba6b8dede1e tempest-ProjectReaderTests-397971060 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f4c9274-9b58-4b5a-bec0-ca40e912b886) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:54:36 devstack sudo[113439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-681d54f7-7e31-45cf-8ca2-09d4706c6090.d1b24583-1111-4d86-982b-9cd937f5be40 Aug 03 08:54:36 devstack sudo[113439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:54:36 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-2246841a-2037-4a79-89b8-6ba6b8dede1e tempest-ProjectReaderTests-397971060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69a15efe-34c2-4f99-8a49-c610fe88ad47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:54:36 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-2246841a-2037-4a79-89b8-6ba6b8dede1e tempest-ProjectReaderTests-397971060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69a15efe-34c2-4f99-8a49-c610fe88ad47) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '82bfe2e1-93bd-4fda-8716-5554326a35ea', 'volume_name': 'volume-82bfe2e1-93bd-4fda-8716-5554326a35ea', 'volume_size': 1}' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:54:36 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-2246841a-2037-4a79-89b8-6ba6b8dede1e tempest-ProjectReaderTests-397971060 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51909776-3432-4e81-9a4b-11c3ff2fdaef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:54:36 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-2246841a-2037-4a79-89b8-6ba6b8dede1e tempest-ProjectReaderTests-397971060 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51909776-3432-4e81-9a4b-11c3ff2fdaef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:54:36 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-2246841a-2037-4a79-89b8-6ba6b8dede1e tempest-ProjectReaderTests-397971060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9212fd38-f892-4562-842b-a7cda87b391f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:54:36 devstack cinder-volume[88899]: INFO cinder.volume.flows.manager.create_volume [None req-2246841a-2037-4a79-89b8-6ba6b8dede1e tempest-ProjectReaderTests-397971060 None] Volume 82bfe2e1-93bd-4fda-8716-5554326a35ea: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-82bfe2e1-93bd-4fda-8716-5554326a35ea', 'volume_size': 1} Aug 03 08:54:36 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-2246841a-2037-4a79-89b8-6ba6b8dede1e tempest-ProjectReaderTests-397971060 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:54:36 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-2246841a-2037-4a79-89b8-6ba6b8dede1e tempest-ProjectReaderTests-397971060 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:54:36 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-2246841a-2037-4a79-89b8-6ba6b8dede1e tempest-ProjectReaderTests-397971060 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:54:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-261744869',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=82bfe2e1-93bd-4fda-8716-5554326a35ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a95fee59b384e1eb793d0850380c011',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:54:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:54:36Z,use_quota=True,user_id='d3e77fcfb478424d98b0b26e873c68b3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8bde7129-1dc4-42ab-b852-ab32c61b4921),volume_type_id=8bde7129-1dc4-42ab-b852-ab32c61b4921)}" {{(pid=88899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 08:54:36 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-2246841a-2037-4a79-89b8-6ba6b8dede1e tempest-ProjectReaderTests-397971060 None] Creating volume 82bfe2e1-93bd-4fda-8716-5554326a35ea {{(pid=88899) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 08:54:36 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-2246841a-2037-4a79-89b8-6ba6b8dede1e tempest-ProjectReaderTests-397971060 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:54:36 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-2246841a-2037-4a79-89b8-6ba6b8dede1e tempest-ProjectReaderTests-397971060 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:54:36 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-2246841a-2037-4a79-89b8-6ba6b8dede1e tempest-ProjectReaderTests-397971060 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:54:36 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-2246841a-2037-4a79-89b8-6ba6b8dede1e tempest-ProjectReaderTests-397971060 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:54:36 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-2246841a-2037-4a79-89b8-6ba6b8dede1e tempest-ProjectReaderTests-397971060 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:54:36 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-2246841a-2037-4a79-89b8-6ba6b8dede1e tempest-ProjectReaderTests-397971060 None] Selected osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385 as target Quobyte volume. {{(pid=88899) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 08:54:36 devstack cinder-volume[88899]: INFO cinder.volume.drivers.remotefs [None req-2246841a-2037-4a79-89b8-6ba6b8dede1e tempest-ProjectReaderTests-397971060 None] casted to osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385 Aug 03 08:54:36 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-2246841a-2037-4a79-89b8-6ba6b8dede1e tempest-ProjectReaderTests-397971060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-82bfe2e1-93bd-4fda-8716-5554326a35ea 1073741824 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:54:36 devstack sudo[113442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-82bfe2e1-93bd-4fda-8716-5554326a35ea 1073741824 Aug 03 08:54:36 devstack sudo[113442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:54:36 devstack sudo[113434]: pam_unix(sudo:session): session closed for user root Aug 03 08:54:36 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-8561c524-4693-4d79-8136-7eb3a57689e4 tempest-VolumeDependencyTests-1512358985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-fa5f047c-0aea-4f87-a1c9-e7a655bdeef3" returned: 0 in 0.370s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:54:36 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-8561c524-4693-4d79-8136-7eb3a57689e4 tempest-VolumeDependencyTests-1512358985 None] Lock "cinder-quobyte-fa5f047c-0aea-4f87-a1c9-e7a655bdeef3" released by "delete_volume" :: held 0.936s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:54:36 devstack cinder-volume[88899]: DEBUG cinder.quota [None req-8561c524-4693-4d79-8136-7eb3a57689e4 tempest-VolumeDependencyTests-1512358985 None] Created reservations ['70c7d296-cff6-481b-a3c1-a570a1d56f9c', 'd585a618-520b-4435-8567-921b96a9618d', '972953bc-cdfa-485b-b667-33b6e92a259f', '5bebad19-d003-4f57-bbe9-f2e1b9d38891'] {{(pid=88899) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 08:54:36 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-8561c524-4693-4d79-8136-7eb3a57689e4 tempest-VolumeDependencyTests-1512358985 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:54:36 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-8561c524-4693-4d79-8136-7eb3a57689e4 tempest-VolumeDependencyTests-1512358985 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:54:36 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-8561c524-4693-4d79-8136-7eb3a57689e4 tempest-VolumeDependencyTests-1512358985 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:54:36 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-8561c524-4693-4d79-8136-7eb3a57689e4 tempest-VolumeDependencyTests-1512358985 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:54:36 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-8561c524-4693-4d79-8136-7eb3a57689e4 tempest-VolumeDependencyTests-1512358985 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:54:36 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-8561c524-4693-4d79-8136-7eb3a57689e4 tempest-VolumeDependencyTests-1512358985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:54:36 devstack sudo[113447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a Aug 03 08:54:36 devstack sudo[113447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:54:36 devstack sudo[113439]: pam_unix(sudo:session): session closed for user root Aug 03 08:54:36 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-123339b1-149e-4a8b-bb30-706e8ae37a0d tempest-ProjectMemberTests-1353074417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-681d54f7-7e31-45cf-8ca2-09d4706c6090.d1b24583-1111-4d86-982b-9cd937f5be40" returned: 0 in 0.396s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:54:36 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-123339b1-149e-4a8b-bb30-706e8ae37a0d tempest-ProjectMemberTests-1353074417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-681d54f7-7e31-45cf-8ca2-09d4706c6090.d1b24583-1111-4d86-982b-9cd937f5be40 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:54:36 devstack sudo[113452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-681d54f7-7e31-45cf-8ca2-09d4706c6090.d1b24583-1111-4d86-982b-9cd937f5be40 Aug 03 08:54:36 devstack sudo[113452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:54:36 devstack sudo[113447]: pam_unix(sudo:session): session closed for user root Aug 03 08:54:36 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-8561c524-4693-4d79-8136-7eb3a57689e4 tempest-VolumeDependencyTests-1512358985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a" returned: 0 in 0.278s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:54:36 devstack cinder-volume[88899]: DEBUG cinder.manager [None req-8561c524-4693-4d79-8136-7eb3a57689e4 tempest-VolumeDependencyTests-1512358985 None] Notifying Schedulers of capabilities ... {{(pid=88899) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 08:54:36 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-8561c524-4693-4d79-8136-7eb3a57689e4 tempest-VolumeDependencyTests-1512358985 None] Deleted volume successfully. Aug 03 08:54:36 devstack sudo[113442]: pam_unix(sudo:session): session closed for user root Aug 03 08:54:36 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-2246841a-2037-4a79-89b8-6ba6b8dede1e tempest-ProjectReaderTests-397971060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-82bfe2e1-93bd-4fda-8716-5554326a35ea 1073741824" returned: 0 in 0.550s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:54:36 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-8561c524-4693-4d79-8136-7eb3a57689e4 tempest-VolumeDependencyTests-1512358985 None] Lock "cinder-fa5f047c-0aea-4f87-a1c9-e7a655bdeef3-delete_volume" released by "delete_volume" :: held 1.504s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:54:36 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-2246841a-2037-4a79-89b8-6ba6b8dede1e tempest-ProjectReaderTests-397971060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-82bfe2e1-93bd-4fda-8716-5554326a35ea {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:54:36 devstack sudo[113457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-82bfe2e1-93bd-4fda-8716-5554326a35ea Aug 03 08:54:36 devstack sudo[113457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:54:36 devstack sudo[113452]: pam_unix(sudo:session): session closed for user root Aug 03 08:54:36 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-123339b1-149e-4a8b-bb30-706e8ae37a0d tempest-ProjectMemberTests-1353074417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-681d54f7-7e31-45cf-8ca2-09d4706c6090.d1b24583-1111-4d86-982b-9cd937f5be40" returned: 0 in 0.320s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:54:37 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-123339b1-149e-4a8b-bb30-706e8ae37a0d tempest-ProjectMemberTests-1353074417 None] Lock "cinder-quobyte-d1b24583-1111-4d86-982b-9cd937f5be40" released by "_delete_snapshot" :: held 2.003s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:54:37 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-123339b1-149e-4a8b-bb30-706e8ae37a0d tempest-ProjectMemberTests-1353074417 None] Lock "cinder-quobyte-681d54f7-7e31-45cf-8ca2-09d4706c6090" released by "delete_snapshot" :: held 2.027s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:54:37 devstack cinder-volume[88899]: DEBUG cinder.quota [None req-123339b1-149e-4a8b-bb30-706e8ae37a0d tempest-ProjectMemberTests-1353074417 None] Created reservations ['f4ebd010-ad2a-4175-be46-2f295d487cb4', '29b4e735-0dda-4985-b028-12c1054e9072', '1e6aadff-7058-4def-874b-7c662388f599', '21918d08-5e52-48b9-8cda-c8f1a9ebd97a'] {{(pid=88899) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 08:54:37 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-123339b1-149e-4a8b-bb30-706e8ae37a0d tempest-ProjectMemberTests-1353074417 None] Delete snapshot completed successfully. Aug 03 08:54:37 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-123339b1-149e-4a8b-bb30-706e8ae37a0d tempest-ProjectMemberTests-1353074417 None] Lock "cinder-d1b24583-1111-4d86-982b-9cd937f5be40-delete_snapshot" released by "delete_snapshot" :: held 2.225s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:54:37 devstack sudo[113457]: pam_unix(sudo:session): session closed for user root Aug 03 08:54:37 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-2246841a-2037-4a79-89b8-6ba6b8dede1e tempest-ProjectReaderTests-397971060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-82bfe2e1-93bd-4fda-8716-5554326a35ea" returned: 0 in 0.290s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:54:37 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-2246841a-2037-4a79-89b8-6ba6b8dede1e tempest-ProjectReaderTests-397971060 None] <== create_volume: return (912ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'} {{(pid=88899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 08:54:37 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-2246841a-2037-4a79-89b8-6ba6b8dede1e tempest-ProjectReaderTests-397971060 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.915s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:54:37 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-2246841a-2037-4a79-89b8-6ba6b8dede1e tempest-ProjectReaderTests-397971060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9212fd38-f892-4562-842b-a7cda87b391f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-82bfe2e1-93bd-4fda-8716-5554326a35ea', 'volume_size': 1}' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:54:37 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-2246841a-2037-4a79-89b8-6ba6b8dede1e tempest-ProjectReaderTests-397971060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (35566e48-e104-4453-bf32-4eee57a2be28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:54:37 devstack cinder-volume[88899]: INFO cinder.volume.flows.manager.create_volume [None req-2246841a-2037-4a79-89b8-6ba6b8dede1e tempest-ProjectReaderTests-397971060 None] Volume volume-82bfe2e1-93bd-4fda-8716-5554326a35ea (82bfe2e1-93bd-4fda-8716-5554326a35ea): created successfully Aug 03 08:54:37 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-2246841a-2037-4a79-89b8-6ba6b8dede1e tempest-ProjectReaderTests-397971060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (35566e48-e104-4453-bf32-4eee57a2be28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:54:37 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-2246841a-2037-4a79-89b8-6ba6b8dede1e tempest-ProjectReaderTests-397971060 None] Flow 'volume_create_manager' (0dfcf885-cb5d-45dd-b66a-3f83ccdce0d1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:54:37 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-2246841a-2037-4a79-89b8-6ba6b8dede1e tempest-ProjectReaderTests-397971060 None] Created volume successfully. Aug 03 08:54:38 devstack cinder-volume[88899]: DEBUG cinder.volume.flows.manager.create_volume [None req-ecc718eb-99a0-4e69-947c-438cfa1c918a tempest-VolumeDependencyTests-1512358985 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88899) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 08:54:38 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-ecc718eb-99a0-4e69-947c-438cfa1c918a tempest-VolumeDependencyTests-1512358985 None] Flow 'volume_create_manager' (a58d9b39-3712-4dd8-8665-b5c1326db134) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:54:38 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-ecc718eb-99a0-4e69-947c-438cfa1c918a tempest-VolumeDependencyTests-1512358985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4027dcf6-c191-40f0-8f4a-5902dcd9b673) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:54:38 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-ecc718eb-99a0-4e69-947c-438cfa1c918a tempest-VolumeDependencyTests-1512358985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4027dcf6-c191-40f0-8f4a-5902dcd9b673) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:54:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-665668666',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4af9be76-27b6-4f10-99d7-6e37186be5c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d30b387eb9b94bb589dfe04f0d2eac6d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:54:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:54:38Z,use_quota=True,user_id='12ab9b4d5d894d608b06e312639537e8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8bde7129-1dc4-42ab-b852-ab32c61b4921),volume_type_id=8bde7129-1dc4-42ab-b852-ab32c61b4921)' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:54:38 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-ecc718eb-99a0-4e69-947c-438cfa1c918a tempest-VolumeDependencyTests-1512358985 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ff9da37-50c9-4837-9960-29ef65d139cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:54:38 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-ecc718eb-99a0-4e69-947c-438cfa1c918a tempest-VolumeDependencyTests-1512358985 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ff9da37-50c9-4837-9960-29ef65d139cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:54:38 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-ecc718eb-99a0-4e69-947c-438cfa1c918a tempest-VolumeDependencyTests-1512358985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce05a3d3-2f85-4775-a35a-759e70db0264) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:54:38 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-ecc718eb-99a0-4e69-947c-438cfa1c918a tempest-VolumeDependencyTests-1512358985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce05a3d3-2f85-4775-a35a-759e70db0264) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4af9be76-27b6-4f10-99d7-6e37186be5c3', 'volume_name': 'volume-4af9be76-27b6-4f10-99d7-6e37186be5c3', 'volume_size': 1}' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:54:38 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-ecc718eb-99a0-4e69-947c-438cfa1c918a tempest-VolumeDependencyTests-1512358985 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18ca78dc-6fb8-4b0f-89c6-a598ca3c3e52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:54:38 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-ecc718eb-99a0-4e69-947c-438cfa1c918a tempest-VolumeDependencyTests-1512358985 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18ca78dc-6fb8-4b0f-89c6-a598ca3c3e52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:54:38 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-ecc718eb-99a0-4e69-947c-438cfa1c918a tempest-VolumeDependencyTests-1512358985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd980d1c-8462-44cb-9541-9f129d33cd80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:54:38 devstack cinder-volume[88899]: INFO cinder.volume.flows.manager.create_volume [None req-ecc718eb-99a0-4e69-947c-438cfa1c918a tempest-VolumeDependencyTests-1512358985 None] Volume 4af9be76-27b6-4f10-99d7-6e37186be5c3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4af9be76-27b6-4f10-99d7-6e37186be5c3', 'volume_size': 1} Aug 03 08:54:38 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-ecc718eb-99a0-4e69-947c-438cfa1c918a tempest-VolumeDependencyTests-1512358985 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:54:38 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-ecc718eb-99a0-4e69-947c-438cfa1c918a tempest-VolumeDependencyTests-1512358985 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:54:38 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-ecc718eb-99a0-4e69-947c-438cfa1c918a tempest-VolumeDependencyTests-1512358985 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:54:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-665668666',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4af9be76-27b6-4f10-99d7-6e37186be5c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d30b387eb9b94bb589dfe04f0d2eac6d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:54:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:54:38Z,use_quota=True,user_id='12ab9b4d5d894d608b06e312639537e8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8bde7129-1dc4-42ab-b852-ab32c61b4921),volume_type_id=8bde7129-1dc4-42ab-b852-ab32c61b4921)}" {{(pid=88899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 08:54:38 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-ecc718eb-99a0-4e69-947c-438cfa1c918a tempest-VolumeDependencyTests-1512358985 None] Creating volume 4af9be76-27b6-4f10-99d7-6e37186be5c3 {{(pid=88899) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 08:54:38 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-ecc718eb-99a0-4e69-947c-438cfa1c918a tempest-VolumeDependencyTests-1512358985 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:54:38 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-ecc718eb-99a0-4e69-947c-438cfa1c918a tempest-VolumeDependencyTests-1512358985 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:54:38 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-ecc718eb-99a0-4e69-947c-438cfa1c918a tempest-VolumeDependencyTests-1512358985 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:54:38 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-ecc718eb-99a0-4e69-947c-438cfa1c918a tempest-VolumeDependencyTests-1512358985 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:54:38 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-ecc718eb-99a0-4e69-947c-438cfa1c918a tempest-VolumeDependencyTests-1512358985 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:54:38 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-ecc718eb-99a0-4e69-947c-438cfa1c918a tempest-VolumeDependencyTests-1512358985 None] Selected osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385 as target Quobyte volume. {{(pid=88899) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 08:54:38 devstack cinder-volume[88899]: INFO cinder.volume.drivers.remotefs [None req-ecc718eb-99a0-4e69-947c-438cfa1c918a tempest-VolumeDependencyTests-1512358985 None] casted to osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385 Aug 03 08:54:38 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-ecc718eb-99a0-4e69-947c-438cfa1c918a tempest-VolumeDependencyTests-1512358985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-4af9be76-27b6-4f10-99d7-6e37186be5c3 1073741824 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:54:38 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-f832cbf3-8901-4811-8e41-a5351eee1f1d tempest-ProjectMemberTests-1353074417 None] Acquiring lock "cinder-681d54f7-7e31-45cf-8ca2-09d4706c6090-delete_volume" by "delete_volume" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:54:38 devstack sudo[113460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-4af9be76-27b6-4f10-99d7-6e37186be5c3 1073741824 Aug 03 08:54:38 devstack sudo[113460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:54:38 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-f832cbf3-8901-4811-8e41-a5351eee1f1d tempest-ProjectMemberTests-1353074417 None] Lock "cinder-681d54f7-7e31-45cf-8ca2-09d4706c6090-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:54:38 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-f832cbf3-8901-4811-8e41-a5351eee1f1d tempest-ProjectMemberTests-1353074417 None] Acquiring lock "cinder-quobyte-681d54f7-7e31-45cf-8ca2-09d4706c6090" by "delete_volume" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:54:38 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-f832cbf3-8901-4811-8e41-a5351eee1f1d tempest-ProjectMemberTests-1353074417 None] Lock "cinder-quobyte-681d54f7-7e31-45cf-8ca2-09d4706c6090" acquired by "delete_volume" :: waited 0.023s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:54:38 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[e45b1203-c318-403e-99a6-436020a58c41]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:54:38 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-f832cbf3-8901-4811-8e41-a5351eee1f1d tempest-ProjectMemberTests-1353074417 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-681d54f7-7e31-45cf-8ca2-09d4706c6090 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:54:38 devstack sudo[113462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-681d54f7-7e31-45cf-8ca2-09d4706c6090 Aug 03 08:54:38 devstack sudo[113462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:54:38 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-d73d1761-5d9d-4d61-ba2e-04a1d657141b tempest-ProjectReaderTests-397971060 None] Acquiring lock "cinder-82bfe2e1-93bd-4fda-8716-5554326a35ea-delete_volume" by "delete_volume" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:54:38 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-d73d1761-5d9d-4d61-ba2e-04a1d657141b tempest-ProjectReaderTests-397971060 None] Lock "cinder-82bfe2e1-93bd-4fda-8716-5554326a35ea-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:54:38 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-d73d1761-5d9d-4d61-ba2e-04a1d657141b tempest-ProjectReaderTests-397971060 None] Acquiring lock "cinder-quobyte-82bfe2e1-93bd-4fda-8716-5554326a35ea" by "delete_volume" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:54:38 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-d73d1761-5d9d-4d61-ba2e-04a1d657141b tempest-ProjectReaderTests-397971060 None] Lock "cinder-quobyte-82bfe2e1-93bd-4fda-8716-5554326a35ea" acquired by "delete_volume" :: waited 0.023s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:54:38 devstack sudo[113460]: pam_unix(sudo:session): session closed for user root Aug 03 08:54:38 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae8159c4-29ca-4cbf-bb58-50ff58d6d3e2]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:54:38 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-d73d1761-5d9d-4d61-ba2e-04a1d657141b tempest-ProjectReaderTests-397971060 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-82bfe2e1-93bd-4fda-8716-5554326a35ea {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:54:38 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-ecc718eb-99a0-4e69-947c-438cfa1c918a tempest-VolumeDependencyTests-1512358985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-4af9be76-27b6-4f10-99d7-6e37186be5c3 1073741824" returned: 0 in 0.625s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:54:38 devstack cinder-volume[88899]: DEBUG cinder.volume.flows.manager.create_volume [None req-7ad38816-8087-4e89-b096-3cbd28f31524 tempest-CinderUnicodeTest-253937196 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88899) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 08:54:38 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-7ad38816-8087-4e89-b096-3cbd28f31524 tempest-CinderUnicodeTest-253937196 None] Flow 'volume_create_manager' (4b837516-c732-476f-b732-e5c6385d724b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:54:38 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-7ad38816-8087-4e89-b096-3cbd28f31524 tempest-CinderUnicodeTest-253937196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90cd2934-4cbd-4db0-9ee7-2e176b1ef66c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:54:38 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-7ad38816-8087-4e89-b096-3cbd28f31524 tempest-CinderUnicodeTest-253937196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90cd2934-4cbd-4db0-9ee7-2e176b1ef66c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:54:38Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ebdc5dc-ea07-40b7-9fd6-bf7f599848ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed0996028f404752bd1cfe8322d2a1e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:54:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:54:39Z,use_quota=True,user_id='615271f1f9644f7f8f35b521e978f320',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8bde7129-1dc4-42ab-b852-ab32c61b4921),volume_type_id=8bde7129-1dc4-42ab-b852-ab32c61b4921)' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:54:38 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-7ad38816-8087-4e89-b096-3cbd28f31524 tempest-CinderUnicodeTest-253937196 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7061eae1-404b-4985-bc06-490b5af23d70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:54:38 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-7ad38816-8087-4e89-b096-3cbd28f31524 tempest-CinderUnicodeTest-253937196 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7061eae1-404b-4985-bc06-490b5af23d70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:54:38 devstack sudo[113462]: pam_unix(sudo:session): session closed for user root Aug 03 08:54:38 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-7ad38816-8087-4e89-b096-3cbd28f31524 tempest-CinderUnicodeTest-253937196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c73ec88-4327-402c-9860-96b9644a07ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:54:38 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-7ad38816-8087-4e89-b096-3cbd28f31524 tempest-CinderUnicodeTest-253937196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c73ec88-4327-402c-9860-96b9644a07ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3ebdc5dc-ea07-40b7-9fd6-bf7f599848ac', 'volume_name': 'volume-3ebdc5dc-ea07-40b7-9fd6-bf7f599848ac', 'volume_size': 1}' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:54:38 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-7ad38816-8087-4e89-b096-3cbd28f31524 tempest-CinderUnicodeTest-253937196 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79ef34d5-a71d-4867-90da-54b8f2163e57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:54:38 devstack sudo[113469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-82bfe2e1-93bd-4fda-8716-5554326a35ea Aug 03 08:54:38 devstack sudo[113469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:54:38 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-7ad38816-8087-4e89-b096-3cbd28f31524 tempest-CinderUnicodeTest-253937196 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79ef34d5-a71d-4867-90da-54b8f2163e57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:54:38 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-7ad38816-8087-4e89-b096-3cbd28f31524 tempest-CinderUnicodeTest-253937196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (400c8353-cd06-480d-b70f-af47a1c8e0e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:54:38 devstack cinder-volume[88899]: INFO cinder.volume.flows.manager.create_volume [None req-7ad38816-8087-4e89-b096-3cbd28f31524 tempest-CinderUnicodeTest-253937196 None] Volume 3ebdc5dc-ea07-40b7-9fd6-bf7f599848ac: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3ebdc5dc-ea07-40b7-9fd6-bf7f599848ac', 'volume_size': 1} Aug 03 08:54:38 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-7ad38816-8087-4e89-b096-3cbd28f31524 tempest-CinderUnicodeTest-253937196 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:54:38 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-f832cbf3-8901-4811-8e41-a5351eee1f1d tempest-ProjectMemberTests-1353074417 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-681d54f7-7e31-45cf-8ca2-09d4706c6090" returned: 0 in 0.563s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:54:38 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-f832cbf3-8901-4811-8e41-a5351eee1f1d tempest-ProjectMemberTests-1353074417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-681d54f7-7e31-45cf-8ca2-09d4706c6090 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:54:38 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-ecc718eb-99a0-4e69-947c-438cfa1c918a tempest-VolumeDependencyTests-1512358985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-4af9be76-27b6-4f10-99d7-6e37186be5c3 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:54:38 devstack sudo[113474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-681d54f7-7e31-45cf-8ca2-09d4706c6090 Aug 03 08:54:38 devstack sudo[113474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:54:38 devstack sudo[113475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-4af9be76-27b6-4f10-99d7-6e37186be5c3 Aug 03 08:54:38 devstack sudo[113475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:54:39 devstack sudo[113469]: pam_unix(sudo:session): session closed for user root Aug 03 08:54:39 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-d73d1761-5d9d-4d61-ba2e-04a1d657141b tempest-ProjectReaderTests-397971060 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-82bfe2e1-93bd-4fda-8716-5554326a35ea" returned: 0 in 0.383s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:54:39 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-d73d1761-5d9d-4d61-ba2e-04a1d657141b tempest-ProjectReaderTests-397971060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-82bfe2e1-93bd-4fda-8716-5554326a35ea {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:54:39 devstack sudo[113474]: pam_unix(sudo:session): session closed for user root Aug 03 08:54:39 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-f832cbf3-8901-4811-8e41-a5351eee1f1d tempest-ProjectMemberTests-1353074417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-681d54f7-7e31-45cf-8ca2-09d4706c6090" returned: 0 in 0.274s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:54:39 devstack sudo[113475]: pam_unix(sudo:session): session closed for user root Aug 03 08:54:39 devstack sudo[113483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-82bfe2e1-93bd-4fda-8716-5554326a35ea Aug 03 08:54:39 devstack sudo[113483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:54:39 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-ecc718eb-99a0-4e69-947c-438cfa1c918a tempest-VolumeDependencyTests-1512358985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-4af9be76-27b6-4f10-99d7-6e37186be5c3" returned: 0 in 0.269s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:54:39 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-ecc718eb-99a0-4e69-947c-438cfa1c918a tempest-VolumeDependencyTests-1512358985 None] <== create_volume: return (1034ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'} {{(pid=88899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 08:54:39 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-ecc718eb-99a0-4e69-947c-438cfa1c918a tempest-VolumeDependencyTests-1512358985 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.040s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:54:39 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-f832cbf3-8901-4811-8e41-a5351eee1f1d tempest-ProjectMemberTests-1353074417 None] Lock "cinder-quobyte-681d54f7-7e31-45cf-8ca2-09d4706c6090" released by "delete_volume" :: held 0.920s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:54:39 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-7ad38816-8087-4e89-b096-3cbd28f31524 tempest-CinderUnicodeTest-253937196 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.314s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:54:39 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-7ad38816-8087-4e89-b096-3cbd28f31524 tempest-CinderUnicodeTest-253937196 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:54:38Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ebdc5dc-ea07-40b7-9fd6-bf7f599848ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed0996028f404752bd1cfe8322d2a1e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:54:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:54:39Z,use_quota=True,user_id='615271f1f9644f7f8f35b521e978f320',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8bde7129-1dc4-42ab-b852-ab32c61b4921),volume_type_id=8bde7129-1dc4-42ab-b852-ab32c61b4921)}" {{(pid=88899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 08:54:39 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-7ad38816-8087-4e89-b096-3cbd28f31524 tempest-CinderUnicodeTest-253937196 None] Creating volume 3ebdc5dc-ea07-40b7-9fd6-bf7f599848ac {{(pid=88899) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 08:54:39 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-7ad38816-8087-4e89-b096-3cbd28f31524 tempest-CinderUnicodeTest-253937196 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:54:39 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-7ad38816-8087-4e89-b096-3cbd28f31524 tempest-CinderUnicodeTest-253937196 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:54:39 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-7ad38816-8087-4e89-b096-3cbd28f31524 tempest-CinderUnicodeTest-253937196 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:54:39 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-7ad38816-8087-4e89-b096-3cbd28f31524 tempest-CinderUnicodeTest-253937196 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:54:39 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-7ad38816-8087-4e89-b096-3cbd28f31524 tempest-CinderUnicodeTest-253937196 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:54:39 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-7ad38816-8087-4e89-b096-3cbd28f31524 tempest-CinderUnicodeTest-253937196 None] Selected osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385 as target Quobyte volume. {{(pid=88899) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 08:54:39 devstack cinder-volume[88899]: INFO cinder.volume.drivers.remotefs [None req-7ad38816-8087-4e89-b096-3cbd28f31524 tempest-CinderUnicodeTest-253937196 None] casted to osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385 Aug 03 08:54:39 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-7ad38816-8087-4e89-b096-3cbd28f31524 tempest-CinderUnicodeTest-253937196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-3ebdc5dc-ea07-40b7-9fd6-bf7f599848ac 1073741824 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:54:39 devstack sudo[113485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-3ebdc5dc-ea07-40b7-9fd6-bf7f599848ac 1073741824 Aug 03 08:54:39 devstack sudo[113485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:54:39 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-ecc718eb-99a0-4e69-947c-438cfa1c918a tempest-VolumeDependencyTests-1512358985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd980d1c-8462-44cb-9541-9f129d33cd80) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4af9be76-27b6-4f10-99d7-6e37186be5c3', 'volume_size': 1}' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:54:39 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-ecc718eb-99a0-4e69-947c-438cfa1c918a tempest-VolumeDependencyTests-1512358985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0c7a2bd-4c31-48f5-85c0-9d61b0a75446) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:54:39 devstack cinder-volume[88899]: INFO cinder.volume.flows.manager.create_volume [None req-ecc718eb-99a0-4e69-947c-438cfa1c918a tempest-VolumeDependencyTests-1512358985 None] Volume volume-4af9be76-27b6-4f10-99d7-6e37186be5c3 (4af9be76-27b6-4f10-99d7-6e37186be5c3): created successfully Aug 03 08:54:39 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-ecc718eb-99a0-4e69-947c-438cfa1c918a tempest-VolumeDependencyTests-1512358985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0c7a2bd-4c31-48f5-85c0-9d61b0a75446) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:54:39 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-ecc718eb-99a0-4e69-947c-438cfa1c918a tempest-VolumeDependencyTests-1512358985 None] Flow 'volume_create_manager' (a58d9b39-3712-4dd8-8665-b5c1326db134) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:54:39 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-ecc718eb-99a0-4e69-947c-438cfa1c918a tempest-VolumeDependencyTests-1512358985 None] Created volume successfully. Aug 03 08:54:39 devstack cinder-volume[88899]: DEBUG cinder.quota [None req-f832cbf3-8901-4811-8e41-a5351eee1f1d tempest-ProjectMemberTests-1353074417 None] Created reservations ['11a1ba95-43c7-4809-9893-372cca0441c4', 'c5d35d83-f845-46e2-84bd-19c50ed54bc9', 'dde49532-c148-455b-b63c-aa446c4ef554', '0650f5d5-2a34-402c-a2ad-01027af117e7'] {{(pid=88899) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 08:54:39 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-f832cbf3-8901-4811-8e41-a5351eee1f1d tempest-ProjectMemberTests-1353074417 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:54:39 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-f832cbf3-8901-4811-8e41-a5351eee1f1d tempest-ProjectMemberTests-1353074417 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:54:39 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-f832cbf3-8901-4811-8e41-a5351eee1f1d tempest-ProjectMemberTests-1353074417 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:54:39 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-f832cbf3-8901-4811-8e41-a5351eee1f1d tempest-ProjectMemberTests-1353074417 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:54:39 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-f832cbf3-8901-4811-8e41-a5351eee1f1d tempest-ProjectMemberTests-1353074417 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:54:39 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-f832cbf3-8901-4811-8e41-a5351eee1f1d tempest-ProjectMemberTests-1353074417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:54:39 devstack sudo[113488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a Aug 03 08:54:39 devstack sudo[113488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:54:39 devstack sudo[113483]: pam_unix(sudo:session): session closed for user root Aug 03 08:54:39 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-d73d1761-5d9d-4d61-ba2e-04a1d657141b tempest-ProjectReaderTests-397971060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-82bfe2e1-93bd-4fda-8716-5554326a35ea" returned: 0 in 0.276s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:54:39 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-d73d1761-5d9d-4d61-ba2e-04a1d657141b tempest-ProjectReaderTests-397971060 None] Lock "cinder-quobyte-82bfe2e1-93bd-4fda-8716-5554326a35ea" released by "delete_volume" :: held 0.716s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:54:39 devstack cinder-volume[88899]: DEBUG cinder.quota [None req-d73d1761-5d9d-4d61-ba2e-04a1d657141b tempest-ProjectReaderTests-397971060 None] Created reservations ['6471a526-acfe-4822-b87f-8d130505c231', '81c5ab97-aa13-4a41-8ca8-54f684135625', '2b53352f-9f5b-4f4b-917d-fed847f69ca0', 'd65b479e-41d1-4eae-83dc-8f455a2df9cd'] {{(pid=88899) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 08:54:39 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-d73d1761-5d9d-4d61-ba2e-04a1d657141b tempest-ProjectReaderTests-397971060 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:54:39 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-d73d1761-5d9d-4d61-ba2e-04a1d657141b tempest-ProjectReaderTests-397971060 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:54:39 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-d73d1761-5d9d-4d61-ba2e-04a1d657141b tempest-ProjectReaderTests-397971060 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:54:39 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-d73d1761-5d9d-4d61-ba2e-04a1d657141b tempest-ProjectReaderTests-397971060 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:54:39 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-d73d1761-5d9d-4d61-ba2e-04a1d657141b tempest-ProjectReaderTests-397971060 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:54:39 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-d73d1761-5d9d-4d61-ba2e-04a1d657141b tempest-ProjectReaderTests-397971060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:54:39 devstack sudo[113493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a Aug 03 08:54:39 devstack sudo[113493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:54:39 devstack sudo[113488]: pam_unix(sudo:session): session closed for user root Aug 03 08:54:39 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-f832cbf3-8901-4811-8e41-a5351eee1f1d tempest-ProjectMemberTests-1353074417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a" returned: 0 in 0.356s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:54:39 devstack cinder-volume[88899]: DEBUG cinder.manager [None req-f832cbf3-8901-4811-8e41-a5351eee1f1d tempest-ProjectMemberTests-1353074417 None] Notifying Schedulers of capabilities ... {{(pid=88899) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 08:54:39 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-f832cbf3-8901-4811-8e41-a5351eee1f1d tempest-ProjectMemberTests-1353074417 None] Deleted volume successfully. Aug 03 08:54:39 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-f832cbf3-8901-4811-8e41-a5351eee1f1d tempest-ProjectMemberTests-1353074417 None] Lock "cinder-681d54f7-7e31-45cf-8ca2-09d4706c6090-delete_volume" released by "delete_volume" :: held 1.605s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:54:39 devstack sudo[113485]: pam_unix(sudo:session): session closed for user root Aug 03 08:54:39 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-7ad38816-8087-4e89-b096-3cbd28f31524 tempest-CinderUnicodeTest-253937196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-3ebdc5dc-ea07-40b7-9fd6-bf7f599848ac 1073741824" returned: 0 in 0.601s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:54:39 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-7ad38816-8087-4e89-b096-3cbd28f31524 tempest-CinderUnicodeTest-253937196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-3ebdc5dc-ea07-40b7-9fd6-bf7f599848ac {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:54:39 devstack sudo[113496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-3ebdc5dc-ea07-40b7-9fd6-bf7f599848ac Aug 03 08:54:39 devstack sudo[113496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:54:40 devstack sudo[113493]: pam_unix(sudo:session): session closed for user root Aug 03 08:54:40 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-d73d1761-5d9d-4d61-ba2e-04a1d657141b tempest-ProjectReaderTests-397971060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a" returned: 0 in 0.392s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:54:40 devstack cinder-volume[88899]: DEBUG cinder.manager [None req-d73d1761-5d9d-4d61-ba2e-04a1d657141b tempest-ProjectReaderTests-397971060 None] Notifying Schedulers of capabilities ... {{(pid=88899) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 08:54:40 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-d73d1761-5d9d-4d61-ba2e-04a1d657141b tempest-ProjectReaderTests-397971060 None] Deleted volume successfully. Aug 03 08:54:40 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-d73d1761-5d9d-4d61-ba2e-04a1d657141b tempest-ProjectReaderTests-397971060 None] Lock "cinder-82bfe2e1-93bd-4fda-8716-5554326a35ea-delete_volume" released by "delete_volume" :: held 1.376s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:54:40 devstack cinder-volume[88899]: DEBUG cinder.volume.flows.manager.create_volume [None req-0e4dcf94-b0b9-4aed-bd66-1276400819dc tempest-ProjectMemberTests-1353074417 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88899) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 08:54:40 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-0e4dcf94-b0b9-4aed-bd66-1276400819dc tempest-ProjectMemberTests-1353074417 None] Flow 'volume_create_manager' (10045439-f9eb-4107-a172-9112648c6797) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:54:40 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-0e4dcf94-b0b9-4aed-bd66-1276400819dc tempest-ProjectMemberTests-1353074417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4307a94-5f8a-446e-95e6-a46f48ebb9d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:54:40 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-0e4dcf94-b0b9-4aed-bd66-1276400819dc tempest-ProjectMemberTests-1353074417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4307a94-5f8a-446e-95e6-a46f48ebb9d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:54:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-228245805',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd4c6044-4c1f-4581-9f61-fb2305d4e290,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b723e915839a4036ad739740ec4db0cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:54:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:54:40Z,use_quota=True,user_id='d9152484679b4fb79b0d8896a2a67eb9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8bde7129-1dc4-42ab-b852-ab32c61b4921),volume_type_id=8bde7129-1dc4-42ab-b852-ab32c61b4921)' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:54:40 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-0e4dcf94-b0b9-4aed-bd66-1276400819dc tempest-ProjectMemberTests-1353074417 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9db31b32-42b8-4f13-a9b3-b266ee4f75cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:54:40 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-0e4dcf94-b0b9-4aed-bd66-1276400819dc tempest-ProjectMemberTests-1353074417 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9db31b32-42b8-4f13-a9b3-b266ee4f75cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:54:40 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-0e4dcf94-b0b9-4aed-bd66-1276400819dc tempest-ProjectMemberTests-1353074417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d0b5b9d-e61b-430d-96a2-2cde28fc7548) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:54:40 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-0e4dcf94-b0b9-4aed-bd66-1276400819dc tempest-ProjectMemberTests-1353074417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d0b5b9d-e61b-430d-96a2-2cde28fc7548) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bd4c6044-4c1f-4581-9f61-fb2305d4e290', 'volume_name': 'volume-bd4c6044-4c1f-4581-9f61-fb2305d4e290', 'volume_size': 1}' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:54:40 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-0e4dcf94-b0b9-4aed-bd66-1276400819dc tempest-ProjectMemberTests-1353074417 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (35f7a52c-7252-4404-8272-81a122eef3f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:54:40 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-0e4dcf94-b0b9-4aed-bd66-1276400819dc tempest-ProjectMemberTests-1353074417 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (35f7a52c-7252-4404-8272-81a122eef3f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:54:40 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-0e4dcf94-b0b9-4aed-bd66-1276400819dc tempest-ProjectMemberTests-1353074417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15e638a6-ad19-4668-8ddc-bc814ad4c7d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:54:40 devstack cinder-volume[88899]: INFO cinder.volume.flows.manager.create_volume [None req-0e4dcf94-b0b9-4aed-bd66-1276400819dc tempest-ProjectMemberTests-1353074417 None] Volume bd4c6044-4c1f-4581-9f61-fb2305d4e290: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bd4c6044-4c1f-4581-9f61-fb2305d4e290', 'volume_size': 1} Aug 03 08:54:40 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-0e4dcf94-b0b9-4aed-bd66-1276400819dc tempest-ProjectMemberTests-1353074417 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:54:40 devstack sudo[113496]: pam_unix(sudo:session): session closed for user root Aug 03 08:54:40 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-7ad38816-8087-4e89-b096-3cbd28f31524 tempest-CinderUnicodeTest-253937196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-3ebdc5dc-ea07-40b7-9fd6-bf7f599848ac" returned: 0 in 0.393s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:54:40 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-7ad38816-8087-4e89-b096-3cbd28f31524 tempest-CinderUnicodeTest-253937196 None] <== create_volume: return (1066ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'} {{(pid=88899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 08:54:40 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-7ad38816-8087-4e89-b096-3cbd28f31524 tempest-CinderUnicodeTest-253937196 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.072s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:54:40 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-0e4dcf94-b0b9-4aed-bd66-1276400819dc tempest-ProjectMemberTests-1353074417 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.047s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:54:40 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-0e4dcf94-b0b9-4aed-bd66-1276400819dc tempest-ProjectMemberTests-1353074417 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:54:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-228245805',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd4c6044-4c1f-4581-9f61-fb2305d4e290,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b723e915839a4036ad739740ec4db0cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:54:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:54:40Z,use_quota=True,user_id='d9152484679b4fb79b0d8896a2a67eb9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8bde7129-1dc4-42ab-b852-ab32c61b4921),volume_type_id=8bde7129-1dc4-42ab-b852-ab32c61b4921)}" {{(pid=88899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 08:54:40 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-0e4dcf94-b0b9-4aed-bd66-1276400819dc tempest-ProjectMemberTests-1353074417 None] Creating volume bd4c6044-4c1f-4581-9f61-fb2305d4e290 {{(pid=88899) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 08:54:40 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-0e4dcf94-b0b9-4aed-bd66-1276400819dc tempest-ProjectMemberTests-1353074417 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:54:40 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-0e4dcf94-b0b9-4aed-bd66-1276400819dc tempest-ProjectMemberTests-1353074417 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:54:40 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-0e4dcf94-b0b9-4aed-bd66-1276400819dc tempest-ProjectMemberTests-1353074417 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:54:40 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-0e4dcf94-b0b9-4aed-bd66-1276400819dc tempest-ProjectMemberTests-1353074417 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:54:40 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-0e4dcf94-b0b9-4aed-bd66-1276400819dc tempest-ProjectMemberTests-1353074417 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:54:40 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-0e4dcf94-b0b9-4aed-bd66-1276400819dc tempest-ProjectMemberTests-1353074417 None] Selected osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385 as target Quobyte volume. {{(pid=88899) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 08:54:40 devstack cinder-volume[88899]: INFO cinder.volume.drivers.remotefs [None req-0e4dcf94-b0b9-4aed-bd66-1276400819dc tempest-ProjectMemberTests-1353074417 None] casted to osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385 Aug 03 08:54:40 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-0e4dcf94-b0b9-4aed-bd66-1276400819dc tempest-ProjectMemberTests-1353074417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-bd4c6044-4c1f-4581-9f61-fb2305d4e290 1073741824 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:54:40 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-7ad38816-8087-4e89-b096-3cbd28f31524 tempest-CinderUnicodeTest-253937196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (400c8353-cd06-480d-b70f-af47a1c8e0e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3ebdc5dc-ea07-40b7-9fd6-bf7f599848ac', 'volume_size': 1}' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:54:40 devstack sudo[113500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-bd4c6044-4c1f-4581-9f61-fb2305d4e290 1073741824 Aug 03 08:54:40 devstack sudo[113500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:54:40 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-7ad38816-8087-4e89-b096-3cbd28f31524 tempest-CinderUnicodeTest-253937196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (043983d3-4141-453d-8c04-ec34a51364f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:54:40 devstack cinder-volume[88899]: INFO cinder.volume.flows.manager.create_volume [None req-7ad38816-8087-4e89-b096-3cbd28f31524 tempest-CinderUnicodeTest-253937196 None] Volume volume-3ebdc5dc-ea07-40b7-9fd6-bf7f599848ac (3ebdc5dc-ea07-40b7-9fd6-bf7f599848ac): created successfully Aug 03 08:54:40 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-7ad38816-8087-4e89-b096-3cbd28f31524 tempest-CinderUnicodeTest-253937196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (043983d3-4141-453d-8c04-ec34a51364f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:54:40 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-7ad38816-8087-4e89-b096-3cbd28f31524 tempest-CinderUnicodeTest-253937196 None] Flow 'volume_create_manager' (4b837516-c732-476f-b732-e5c6385d724b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:54:40 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-7ad38816-8087-4e89-b096-3cbd28f31524 tempest-CinderUnicodeTest-253937196 None] Created volume successfully. Aug 03 08:54:40 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-ef1d68fe-de00-4890-b980-3993420cb965 tempest-VolumeDependencyTests-1512358985 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:54:40 devstack cinder-volume[88899]: DEBUG cinder.volume.flows.manager.create_volume [None req-b59f9800-4035-464c-92f3-97956a98f5dc tempest-ProjectReaderTests-397971060 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88899) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 08:54:40 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-b59f9800-4035-464c-92f3-97956a98f5dc tempest-ProjectReaderTests-397971060 None] Flow 'volume_create_manager' (d15b2a13-c457-4122-b955-e0c95545ecb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:54:40 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-b59f9800-4035-464c-92f3-97956a98f5dc tempest-ProjectReaderTests-397971060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6626e15b-d558-42b5-943c-aa0f766748bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:54:40 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-b59f9800-4035-464c-92f3-97956a98f5dc tempest-ProjectReaderTests-397971060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6626e15b-d558-42b5-943c-aa0f766748bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:54:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1721866208',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f3a2b733-a771-4c7d-af91-3010a3a1150a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a95fee59b384e1eb793d0850380c011',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:54:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:54:41Z,use_quota=True,user_id='d3e77fcfb478424d98b0b26e873c68b3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8bde7129-1dc4-42ab-b852-ab32c61b4921),volume_type_id=8bde7129-1dc4-42ab-b852-ab32c61b4921)' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:54:40 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-b59f9800-4035-464c-92f3-97956a98f5dc tempest-ProjectReaderTests-397971060 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4ce0762-f1f6-473d-b847-00125e61d3af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:54:40 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-b59f9800-4035-464c-92f3-97956a98f5dc tempest-ProjectReaderTests-397971060 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4ce0762-f1f6-473d-b847-00125e61d3af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:54:40 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-b59f9800-4035-464c-92f3-97956a98f5dc tempest-ProjectReaderTests-397971060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e98a2730-1719-4376-a6f1-34141eecfd8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:54:40 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-b59f9800-4035-464c-92f3-97956a98f5dc tempest-ProjectReaderTests-397971060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e98a2730-1719-4376-a6f1-34141eecfd8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f3a2b733-a771-4c7d-af91-3010a3a1150a', 'volume_name': 'volume-f3a2b733-a771-4c7d-af91-3010a3a1150a', 'volume_size': 1}' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:54:40 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-b59f9800-4035-464c-92f3-97956a98f5dc tempest-ProjectReaderTests-397971060 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ff3c5bb-81c7-41ad-97b1-e574feb1d11c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:54:40 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-b59f9800-4035-464c-92f3-97956a98f5dc tempest-ProjectReaderTests-397971060 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ff3c5bb-81c7-41ad-97b1-e574feb1d11c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:54:40 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-b59f9800-4035-464c-92f3-97956a98f5dc tempest-ProjectReaderTests-397971060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2706e503-c1b6-4bc1-ad70-33a9947932bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:54:40 devstack cinder-volume[88899]: INFO cinder.volume.flows.manager.create_volume [None req-b59f9800-4035-464c-92f3-97956a98f5dc tempest-ProjectReaderTests-397971060 None] Volume f3a2b733-a771-4c7d-af91-3010a3a1150a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f3a2b733-a771-4c7d-af91-3010a3a1150a', 'volume_size': 1} Aug 03 08:54:40 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-b59f9800-4035-464c-92f3-97956a98f5dc tempest-ProjectReaderTests-397971060 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:54:40 devstack sudo[113500]: pam_unix(sudo:session): session closed for user root Aug 03 08:54:40 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-0e4dcf94-b0b9-4aed-bd66-1276400819dc tempest-ProjectMemberTests-1353074417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-bd4c6044-4c1f-4581-9f61-fb2305d4e290 1073741824" returned: 0 in 0.435s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:54:40 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-0e4dcf94-b0b9-4aed-bd66-1276400819dc tempest-ProjectMemberTests-1353074417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-bd4c6044-4c1f-4581-9f61-fb2305d4e290 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:54:40 devstack sudo[113506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-bd4c6044-4c1f-4581-9f61-fb2305d4e290 Aug 03 08:54:40 devstack sudo[113506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:54:41 devstack sudo[113506]: pam_unix(sudo:session): session closed for user root Aug 03 08:54:41 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-0e4dcf94-b0b9-4aed-bd66-1276400819dc tempest-ProjectMemberTests-1353074417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-bd4c6044-4c1f-4581-9f61-fb2305d4e290" returned: 0 in 0.240s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:54:41 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-0e4dcf94-b0b9-4aed-bd66-1276400819dc tempest-ProjectMemberTests-1353074417 None] <== create_volume: return (726ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'} {{(pid=88899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 08:54:41 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-0e4dcf94-b0b9-4aed-bd66-1276400819dc tempest-ProjectMemberTests-1353074417 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.729s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:54:41 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-ef1d68fe-de00-4890-b980-3993420cb965 tempest-VolumeDependencyTests-1512358985 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.474s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:54:41 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-0e4dcf94-b0b9-4aed-bd66-1276400819dc tempest-ProjectMemberTests-1353074417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15e638a6-ad19-4668-8ddc-bc814ad4c7d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bd4c6044-4c1f-4581-9f61-fb2305d4e290', 'volume_size': 1}' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:54:41 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-0e4dcf94-b0b9-4aed-bd66-1276400819dc tempest-ProjectMemberTests-1353074417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ef8dc30-72eb-43da-a17c-551d9202461e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:54:41 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-ef1d68fe-de00-4890-b980-3993420cb965 tempest-VolumeDependencyTests-1512358985 None] Creating offline snapshot aef7c728-4aa2-4fec-9acb-e319191de38e of volume 4af9be76-27b6-4f10-99d7-6e37186be5c3 {{(pid=88899) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 03 08:54:41 devstack cinder-volume[88899]: INFO cinder.volume.flows.manager.create_volume [None req-0e4dcf94-b0b9-4aed-bd66-1276400819dc tempest-ProjectMemberTests-1353074417 None] Volume volume-bd4c6044-4c1f-4581-9f61-fb2305d4e290 (bd4c6044-4c1f-4581-9f61-fb2305d4e290): created successfully Aug 03 08:54:41 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-0e4dcf94-b0b9-4aed-bd66-1276400819dc tempest-ProjectMemberTests-1353074417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ef8dc30-72eb-43da-a17c-551d9202461e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:54:41 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-0e4dcf94-b0b9-4aed-bd66-1276400819dc tempest-ProjectMemberTests-1353074417 None] Flow 'volume_create_manager' (10045439-f9eb-4107-a172-9112648c6797) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:54:41 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4ad797d-7a0a-486f-b9e2-49834b67121d]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:54:41 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-ef1d68fe-de00-4890-b980-3993420cb965 tempest-VolumeDependencyTests-1512358985 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-4af9be76-27b6-4f10-99d7-6e37186be5c3 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:54:41 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-0e4dcf94-b0b9-4aed-bd66-1276400819dc tempest-ProjectMemberTests-1353074417 None] Created volume successfully. Aug 03 08:54:41 devstack sudo[113509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-4af9be76-27b6-4f10-99d7-6e37186be5c3 Aug 03 08:54:41 devstack sudo[113509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:54:41 devstack cinder-volume[88899]: DEBUG cinder.volume.flows.manager.create_volume [None req-41371e37-6192-46b1-b550-cb31dc9f6fc9 tempest-CinderUnicodeTest-253937196 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88899) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 08:54:41 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-41371e37-6192-46b1-b550-cb31dc9f6fc9 tempest-CinderUnicodeTest-253937196 None] Flow 'volume_create_manager' (66609153-370e-4eb3-9f7f-e68e0e36d197) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:54:41 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-41371e37-6192-46b1-b550-cb31dc9f6fc9 tempest-CinderUnicodeTest-253937196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e1e0676-4516-4a48-8aaa-6180e792158b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:54:41 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-41371e37-6192-46b1-b550-cb31dc9f6fc9 tempest-CinderUnicodeTest-253937196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e1e0676-4516-4a48-8aaa-6180e792158b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:54:41Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1535685475',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d034785c-09c7-4b5e-ba3f-4af699887f61,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed0996028f404752bd1cfe8322d2a1e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:54:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:54:41Z,use_quota=True,user_id='615271f1f9644f7f8f35b521e978f320',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8bde7129-1dc4-42ab-b852-ab32c61b4921),volume_type_id=8bde7129-1dc4-42ab-b852-ab32c61b4921)' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:54:41 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-41371e37-6192-46b1-b550-cb31dc9f6fc9 tempest-CinderUnicodeTest-253937196 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd0ea754-b7b7-4dc6-a171-f71d79d74c86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:54:41 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-41371e37-6192-46b1-b550-cb31dc9f6fc9 tempest-CinderUnicodeTest-253937196 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd0ea754-b7b7-4dc6-a171-f71d79d74c86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:54:41 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-41371e37-6192-46b1-b550-cb31dc9f6fc9 tempest-CinderUnicodeTest-253937196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (16a17631-8746-4707-bda5-e8a1f60049e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:54:41 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-41371e37-6192-46b1-b550-cb31dc9f6fc9 tempest-CinderUnicodeTest-253937196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (16a17631-8746-4707-bda5-e8a1f60049e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd034785c-09c7-4b5e-ba3f-4af699887f61', 'volume_name': 'volume-d034785c-09c7-4b5e-ba3f-4af699887f61', 'volume_size': 1}' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:54:41 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-41371e37-6192-46b1-b550-cb31dc9f6fc9 tempest-CinderUnicodeTest-253937196 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e90ea46b-1303-41b6-aa11-14eeae0e01f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:54:41 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-41371e37-6192-46b1-b550-cb31dc9f6fc9 tempest-CinderUnicodeTest-253937196 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e90ea46b-1303-41b6-aa11-14eeae0e01f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:54:41 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-41371e37-6192-46b1-b550-cb31dc9f6fc9 tempest-CinderUnicodeTest-253937196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e7e604a9-7690-462e-8628-71da27ccfae6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:54:41 devstack cinder-volume[88899]: INFO cinder.volume.flows.manager.create_volume [None req-41371e37-6192-46b1-b550-cb31dc9f6fc9 tempest-CinderUnicodeTest-253937196 None] Volume d034785c-09c7-4b5e-ba3f-4af699887f61: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d034785c-09c7-4b5e-ba3f-4af699887f61', 'volume_size': 1} Aug 03 08:54:41 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-41371e37-6192-46b1-b550-cb31dc9f6fc9 tempest-CinderUnicodeTest-253937196 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:54:41 devstack sudo[113509]: pam_unix(sudo:session): session closed for user root Aug 03 08:54:41 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-ef1d68fe-de00-4890-b980-3993420cb965 tempest-VolumeDependencyTests-1512358985 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-4af9be76-27b6-4f10-99d7-6e37186be5c3" returned: 0 in 0.382s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:54:41 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-ef1d68fe-de00-4890-b980-3993420cb965 tempest-VolumeDependencyTests-1512358985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-4af9be76-27b6-4f10-99d7-6e37186be5c3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-4af9be76-27b6-4f10-99d7-6e37186be5c3.aef7c728-4aa2-4fec-9acb-e319191de38e 1G {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:54:41 devstack sudo[113514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-4af9be76-27b6-4f10-99d7-6e37186be5c3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-4af9be76-27b6-4f10-99d7-6e37186be5c3.aef7c728-4aa2-4fec-9acb-e319191de38e 1G Aug 03 08:54:41 devstack sudo[113514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:54:41 devstack sudo[113514]: pam_unix(sudo:session): session closed for user root Aug 03 08:54:41 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-ef1d68fe-de00-4890-b980-3993420cb965 tempest-VolumeDependencyTests-1512358985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-4af9be76-27b6-4f10-99d7-6e37186be5c3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-4af9be76-27b6-4f10-99d7-6e37186be5c3.aef7c728-4aa2-4fec-9acb-e319191de38e 1G" returned: 0 in 0.371s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:54:41 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-ef1d68fe-de00-4890-b980-3993420cb965 tempest-VolumeDependencyTests-1512358985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4af9be76-27b6-4f10-99d7-6e37186be5c3 -F qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-4af9be76-27b6-4f10-99d7-6e37186be5c3.aef7c728-4aa2-4fec-9acb-e319191de38e {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:54:41 devstack sudo[113519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4af9be76-27b6-4f10-99d7-6e37186be5c3 -F qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-4af9be76-27b6-4f10-99d7-6e37186be5c3.aef7c728-4aa2-4fec-9acb-e319191de38e Aug 03 08:54:41 devstack sudo[113519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:54:42 devstack sudo[113519]: pam_unix(sudo:session): session closed for user root Aug 03 08:54:42 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-ef1d68fe-de00-4890-b980-3993420cb965 tempest-VolumeDependencyTests-1512358985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4af9be76-27b6-4f10-99d7-6e37186be5c3 -F qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-4af9be76-27b6-4f10-99d7-6e37186be5c3.aef7c728-4aa2-4fec-9acb-e319191de38e" returned: 0 in 0.281s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:54:42 devstack cinder-volume[88899]: WARNING cinder.volume.drivers.remotefs [None req-ef1d68fe-de00-4890-b980-3993420cb965 tempest-VolumeDependencyTests-1512358985 None] /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-4af9be76-27b6-4f10-99d7-6e37186be5c3.aef7c728-4aa2-4fec-9acb-e319191de38e is being set with open permissions: ugo+rw Aug 03 08:54:42 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-ef1d68fe-de00-4890-b980-3993420cb965 tempest-VolumeDependencyTests-1512358985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-4af9be76-27b6-4f10-99d7-6e37186be5c3.aef7c728-4aa2-4fec-9acb-e319191de38e {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:54:42 devstack sudo[113524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-4af9be76-27b6-4f10-99d7-6e37186be5c3.aef7c728-4aa2-4fec-9acb-e319191de38e Aug 03 08:54:42 devstack sudo[113524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:54:42 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-ddd0addd-61af-4a4c-995b-92cb69bf096f tempest-ProjectMemberTests-1353074417 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:54:42 devstack sudo[113524]: pam_unix(sudo:session): session closed for user root Aug 03 08:54:42 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-ef1d68fe-de00-4890-b980-3993420cb965 tempest-VolumeDependencyTests-1512358985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-4af9be76-27b6-4f10-99d7-6e37186be5c3.aef7c728-4aa2-4fec-9acb-e319191de38e" returned: 0 in 0.249s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:54:42 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-ef1d68fe-de00-4890-b980-3993420cb965 tempest-VolumeDependencyTests-1512358985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-4af9be76-27b6-4f10-99d7-6e37186be5c3.info {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:54:42 devstack sudo[113527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-4af9be76-27b6-4f10-99d7-6e37186be5c3.info Aug 03 08:54:42 devstack sudo[113527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:54:42 devstack sudo[113527]: pam_unix(sudo:session): session closed for user root Aug 03 08:54:42 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-ef1d68fe-de00-4890-b980-3993420cb965 tempest-VolumeDependencyTests-1512358985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-4af9be76-27b6-4f10-99d7-6e37186be5c3.info" returned: 0 in 0.234s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:54:42 devstack cinder-volume[88899]: WARNING cinder.volume.drivers.remotefs [None req-ef1d68fe-de00-4890-b980-3993420cb965 tempest-VolumeDependencyTests-1512358985 None] /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-4af9be76-27b6-4f10-99d7-6e37186be5c3.info is being set with open permissions: ugo+rw Aug 03 08:54:42 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-ef1d68fe-de00-4890-b980-3993420cb965 tempest-VolumeDependencyTests-1512358985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-4af9be76-27b6-4f10-99d7-6e37186be5c3.info {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:54:42 devstack sudo[113530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-4af9be76-27b6-4f10-99d7-6e37186be5c3.info Aug 03 08:54:42 devstack sudo[113530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:54:42 devstack sudo[113530]: pam_unix(sudo:session): session closed for user root Aug 03 08:54:42 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-ef1d68fe-de00-4890-b980-3993420cb965 tempest-VolumeDependencyTests-1512358985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-4af9be76-27b6-4f10-99d7-6e37186be5c3.info" returned: 0 in 0.226s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:54:42 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-ef1d68fe-de00-4890-b980-3993420cb965 tempest-VolumeDependencyTests-1512358985 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.860s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:54:42 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-b59f9800-4035-464c-92f3-97956a98f5dc tempest-ProjectReaderTests-397971060 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.225s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:54:42 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-b59f9800-4035-464c-92f3-97956a98f5dc tempest-ProjectReaderTests-397971060 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:54:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1721866208',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f3a2b733-a771-4c7d-af91-3010a3a1150a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a95fee59b384e1eb793d0850380c011',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:54:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:54:41Z,use_quota=True,user_id='d3e77fcfb478424d98b0b26e873c68b3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8bde7129-1dc4-42ab-b852-ab32c61b4921),volume_type_id=8bde7129-1dc4-42ab-b852-ab32c61b4921)}" {{(pid=88899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 08:54:42 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-b59f9800-4035-464c-92f3-97956a98f5dc tempest-ProjectReaderTests-397971060 None] Creating volume f3a2b733-a771-4c7d-af91-3010a3a1150a {{(pid=88899) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 08:54:42 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-b59f9800-4035-464c-92f3-97956a98f5dc tempest-ProjectReaderTests-397971060 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:54:42 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-b59f9800-4035-464c-92f3-97956a98f5dc tempest-ProjectReaderTests-397971060 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:54:42 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-b59f9800-4035-464c-92f3-97956a98f5dc tempest-ProjectReaderTests-397971060 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:54:42 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-b59f9800-4035-464c-92f3-97956a98f5dc tempest-ProjectReaderTests-397971060 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:54:42 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-b59f9800-4035-464c-92f3-97956a98f5dc tempest-ProjectReaderTests-397971060 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:54:42 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-b59f9800-4035-464c-92f3-97956a98f5dc tempest-ProjectReaderTests-397971060 None] Selected osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385 as target Quobyte volume. {{(pid=88899) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 08:54:42 devstack cinder-volume[88899]: INFO cinder.volume.drivers.remotefs [None req-b59f9800-4035-464c-92f3-97956a98f5dc tempest-ProjectReaderTests-397971060 None] casted to osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385 Aug 03 08:54:42 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-b59f9800-4035-464c-92f3-97956a98f5dc tempest-ProjectReaderTests-397971060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-f3a2b733-a771-4c7d-af91-3010a3a1150a 1073741824 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:54:42 devstack sudo[113533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-f3a2b733-a771-4c7d-af91-3010a3a1150a 1073741824 Aug 03 08:54:42 devstack sudo[113533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:54:42 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-ef1d68fe-de00-4890-b980-3993420cb965 tempest-VolumeDependencyTests-1512358985 None] Create snapshot completed successfully Aug 03 08:54:43 devstack sudo[113533]: pam_unix(sudo:session): session closed for user root Aug 03 08:54:43 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-b59f9800-4035-464c-92f3-97956a98f5dc tempest-ProjectReaderTests-397971060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-f3a2b733-a771-4c7d-af91-3010a3a1150a 1073741824" returned: 0 in 0.402s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:54:43 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-b59f9800-4035-464c-92f3-97956a98f5dc tempest-ProjectReaderTests-397971060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-f3a2b733-a771-4c7d-af91-3010a3a1150a {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:54:43 devstack sudo[113539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-f3a2b733-a771-4c7d-af91-3010a3a1150a Aug 03 08:54:43 devstack sudo[113539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:54:43 devstack sudo[113539]: pam_unix(sudo:session): session closed for user root Aug 03 08:54:43 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-b59f9800-4035-464c-92f3-97956a98f5dc tempest-ProjectReaderTests-397971060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-f3a2b733-a771-4c7d-af91-3010a3a1150a" returned: 0 in 0.273s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:54:43 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-b59f9800-4035-464c-92f3-97956a98f5dc tempest-ProjectReaderTests-397971060 None] <== create_volume: return (723ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'} {{(pid=88899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 08:54:43 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-b59f9800-4035-464c-92f3-97956a98f5dc tempest-ProjectReaderTests-397971060 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.726s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:54:43 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-41371e37-6192-46b1-b550-cb31dc9f6fc9 tempest-CinderUnicodeTest-253937196 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.163s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:54:43 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-41371e37-6192-46b1-b550-cb31dc9f6fc9 tempest-CinderUnicodeTest-253937196 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:54:41Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1535685475',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d034785c-09c7-4b5e-ba3f-4af699887f61,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed0996028f404752bd1cfe8322d2a1e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:54:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:54:41Z,use_quota=True,user_id='615271f1f9644f7f8f35b521e978f320',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8bde7129-1dc4-42ab-b852-ab32c61b4921),volume_type_id=8bde7129-1dc4-42ab-b852-ab32c61b4921)}" {{(pid=88899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 08:54:43 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-41371e37-6192-46b1-b550-cb31dc9f6fc9 tempest-CinderUnicodeTest-253937196 None] Creating volume d034785c-09c7-4b5e-ba3f-4af699887f61 {{(pid=88899) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 08:54:43 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-41371e37-6192-46b1-b550-cb31dc9f6fc9 tempest-CinderUnicodeTest-253937196 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:54:43 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-41371e37-6192-46b1-b550-cb31dc9f6fc9 tempest-CinderUnicodeTest-253937196 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:54:43 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-41371e37-6192-46b1-b550-cb31dc9f6fc9 tempest-CinderUnicodeTest-253937196 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:54:43 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-41371e37-6192-46b1-b550-cb31dc9f6fc9 tempest-CinderUnicodeTest-253937196 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:54:43 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-41371e37-6192-46b1-b550-cb31dc9f6fc9 tempest-CinderUnicodeTest-253937196 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:54:43 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-41371e37-6192-46b1-b550-cb31dc9f6fc9 tempest-CinderUnicodeTest-253937196 None] Selected osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385 as target Quobyte volume. {{(pid=88899) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 08:54:43 devstack cinder-volume[88899]: INFO cinder.volume.drivers.remotefs [None req-41371e37-6192-46b1-b550-cb31dc9f6fc9 tempest-CinderUnicodeTest-253937196 None] casted to osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385 Aug 03 08:54:43 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-41371e37-6192-46b1-b550-cb31dc9f6fc9 tempest-CinderUnicodeTest-253937196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-d034785c-09c7-4b5e-ba3f-4af699887f61 1073741824 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:54:43 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-b59f9800-4035-464c-92f3-97956a98f5dc tempest-ProjectReaderTests-397971060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2706e503-c1b6-4bc1-ad70-33a9947932bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f3a2b733-a771-4c7d-af91-3010a3a1150a', 'volume_size': 1}' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:54:43 devstack sudo[113542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-d034785c-09c7-4b5e-ba3f-4af699887f61 1073741824 Aug 03 08:54:43 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-b59f9800-4035-464c-92f3-97956a98f5dc tempest-ProjectReaderTests-397971060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ffeb6b01-f98a-4250-a770-b8c47e97e415) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:54:43 devstack sudo[113542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:54:43 devstack cinder-volume[88899]: INFO cinder.volume.flows.manager.create_volume [None req-b59f9800-4035-464c-92f3-97956a98f5dc tempest-ProjectReaderTests-397971060 None] Volume volume-f3a2b733-a771-4c7d-af91-3010a3a1150a (f3a2b733-a771-4c7d-af91-3010a3a1150a): created successfully Aug 03 08:54:43 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-b59f9800-4035-464c-92f3-97956a98f5dc tempest-ProjectReaderTests-397971060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ffeb6b01-f98a-4250-a770-b8c47e97e415) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:54:43 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-b59f9800-4035-464c-92f3-97956a98f5dc tempest-ProjectReaderTests-397971060 None] Flow 'volume_create_manager' (d15b2a13-c457-4122-b955-e0c95545ecb1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:54:43 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-b59f9800-4035-464c-92f3-97956a98f5dc tempest-ProjectReaderTests-397971060 None] Created volume successfully. Aug 03 08:54:44 devstack cinder-volume[88899]: DEBUG cinder.volume.flows.manager.create_volume [None req-56c6c756-d519-401c-875f-de71d183fc19 tempest-VolumeDependencyTests-1512358985 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88899) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 08:54:44 devstack sudo[113542]: pam_unix(sudo:session): session closed for user root Aug 03 08:54:44 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-41371e37-6192-46b1-b550-cb31dc9f6fc9 tempest-CinderUnicodeTest-253937196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-d034785c-09c7-4b5e-ba3f-4af699887f61 1073741824" returned: 0 in 0.481s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:54:44 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-56c6c756-d519-401c-875f-de71d183fc19 tempest-VolumeDependencyTests-1512358985 None] Flow 'volume_create_manager' (9ad37bfe-5166-4c5f-9613-d6537e606497) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:54:44 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-56c6c756-d519-401c-875f-de71d183fc19 tempest-VolumeDependencyTests-1512358985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5fc4910a-96e5-4cea-af0d-732e2c2759d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:54:44 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-56c6c756-d519-401c-875f-de71d183fc19 tempest-VolumeDependencyTests-1512358985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5fc4910a-96e5-4cea-af0d-732e2c2759d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:54:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1189928513',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f93f444e-8df8-4e1a-97ad-a3ec6f9183e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d30b387eb9b94bb589dfe04f0d2eac6d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:54:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=aef7c728-4aa2-4fec-9acb-e319191de38e,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:54:44Z,use_quota=True,user_id='12ab9b4d5d894d608b06e312639537e8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8bde7129-1dc4-42ab-b852-ab32c61b4921),volume_type_id=8bde7129-1dc4-42ab-b852-ab32c61b4921)' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:54:44 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-56c6c756-d519-401c-875f-de71d183fc19 tempest-VolumeDependencyTests-1512358985 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c7b41cc-133e-4c96-b8a6-f9c19fe93b5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:54:44 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-56c6c756-d519-401c-875f-de71d183fc19 tempest-VolumeDependencyTests-1512358985 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c7b41cc-133e-4c96-b8a6-f9c19fe93b5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:54:44 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-56c6c756-d519-401c-875f-de71d183fc19 tempest-VolumeDependencyTests-1512358985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e0c7943-b7db-4f0d-ad31-260b6a60440c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:54:44 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-56c6c756-d519-401c-875f-de71d183fc19 tempest-VolumeDependencyTests-1512358985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e0c7943-b7db-4f0d-ad31-260b6a60440c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'f93f444e-8df8-4e1a-97ad-a3ec6f9183e5', 'volume_name': 'volume-f93f444e-8df8-4e1a-97ad-a3ec6f9183e5', 'volume_size': 1, 'snapshot_id': 'aef7c728-4aa2-4fec-9acb-e319191de38e'}' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:54:44 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-56c6c756-d519-401c-875f-de71d183fc19 tempest-VolumeDependencyTests-1512358985 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec7cf9a2-56c8-400c-8b7d-da8904002dce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:54:44 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-56c6c756-d519-401c-875f-de71d183fc19 tempest-VolumeDependencyTests-1512358985 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec7cf9a2-56c8-400c-8b7d-da8904002dce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:54:44 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-56c6c756-d519-401c-875f-de71d183fc19 tempest-VolumeDependencyTests-1512358985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e64d2e0e-4c30-4ee3-a64e-8780494af5cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:54:44 devstack cinder-volume[88899]: INFO cinder.volume.flows.manager.create_volume [None req-56c6c756-d519-401c-875f-de71d183fc19 tempest-VolumeDependencyTests-1512358985 None] Volume f93f444e-8df8-4e1a-97ad-a3ec6f9183e5: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-f93f444e-8df8-4e1a-97ad-a3ec6f9183e5', 'volume_size': 1, 'snapshot_id': 'aef7c728-4aa2-4fec-9acb-e319191de38e'} Aug 03 08:54:44 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-56c6c756-d519-401c-875f-de71d183fc19 tempest-VolumeDependencyTests-1512358985 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:54:44 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-41371e37-6192-46b1-b550-cb31dc9f6fc9 tempest-CinderUnicodeTest-253937196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-d034785c-09c7-4b5e-ba3f-4af699887f61 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:54:44 devstack sudo[113548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-d034785c-09c7-4b5e-ba3f-4af699887f61 Aug 03 08:54:44 devstack sudo[113548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:54:44 devstack sudo[113548]: pam_unix(sudo:session): session closed for user root Aug 03 08:54:44 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-41371e37-6192-46b1-b550-cb31dc9f6fc9 tempest-CinderUnicodeTest-253937196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-d034785c-09c7-4b5e-ba3f-4af699887f61" returned: 0 in 0.261s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:54:44 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-41371e37-6192-46b1-b550-cb31dc9f6fc9 tempest-CinderUnicodeTest-253937196 None] <== create_volume: return (864ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'} {{(pid=88899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 08:54:44 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-41371e37-6192-46b1-b550-cb31dc9f6fc9 tempest-CinderUnicodeTest-253937196 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.867s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:54:44 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-ddd0addd-61af-4a4c-995b-92cb69bf096f tempest-ProjectMemberTests-1353074417 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.173s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:54:44 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-41371e37-6192-46b1-b550-cb31dc9f6fc9 tempest-CinderUnicodeTest-253937196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e7e604a9-7690-462e-8628-71da27ccfae6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d034785c-09c7-4b5e-ba3f-4af699887f61', 'volume_size': 1}' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:54:44 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-41371e37-6192-46b1-b550-cb31dc9f6fc9 tempest-CinderUnicodeTest-253937196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c10c34ee-fde8-401e-a8b9-17b66e83cc64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:54:44 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-ddd0addd-61af-4a4c-995b-92cb69bf096f tempest-ProjectMemberTests-1353074417 None] Creating offline snapshot d04702d8-e0e3-475a-a96b-07cf8d70ea48 of volume bd4c6044-4c1f-4581-9f61-fb2305d4e290 {{(pid=88899) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 03 08:54:44 devstack cinder-volume[88899]: INFO cinder.volume.flows.manager.create_volume [None req-41371e37-6192-46b1-b550-cb31dc9f6fc9 tempest-CinderUnicodeTest-253937196 None] Volume volume-d034785c-09c7-4b5e-ba3f-4af699887f61 (d034785c-09c7-4b5e-ba3f-4af699887f61): created successfully Aug 03 08:54:44 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-41371e37-6192-46b1-b550-cb31dc9f6fc9 tempest-CinderUnicodeTest-253937196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c10c34ee-fde8-401e-a8b9-17b66e83cc64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:54:44 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-41371e37-6192-46b1-b550-cb31dc9f6fc9 tempest-CinderUnicodeTest-253937196 None] Flow 'volume_create_manager' (66609153-370e-4eb3-9f7f-e68e0e36d197) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:54:44 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b011cdc-0a2e-480d-9b52-a3ef2adb868e]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:54:44 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-ddd0addd-61af-4a4c-995b-92cb69bf096f tempest-ProjectMemberTests-1353074417 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-bd4c6044-4c1f-4581-9f61-fb2305d4e290 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:54:44 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-41371e37-6192-46b1-b550-cb31dc9f6fc9 tempest-CinderUnicodeTest-253937196 None] Created volume successfully. Aug 03 08:54:44 devstack sudo[113551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-bd4c6044-4c1f-4581-9f61-fb2305d4e290 Aug 03 08:54:44 devstack sudo[113551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:54:44 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-8dc08a2b-d835-4b4c-b83e-49e2cbc2e587 tempest-ProjectReaderTests-397971060 None] Acquiring lock "cinder-f3a2b733-a771-4c7d-af91-3010a3a1150a-delete_volume" by "delete_volume" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:54:44 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-8dc08a2b-d835-4b4c-b83e-49e2cbc2e587 tempest-ProjectReaderTests-397971060 None] Lock "cinder-f3a2b733-a771-4c7d-af91-3010a3a1150a-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:54:44 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-8dc08a2b-d835-4b4c-b83e-49e2cbc2e587 tempest-ProjectReaderTests-397971060 None] Acquiring lock "cinder-quobyte-f3a2b733-a771-4c7d-af91-3010a3a1150a" by "delete_volume" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:54:44 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-8dc08a2b-d835-4b4c-b83e-49e2cbc2e587 tempest-ProjectReaderTests-397971060 None] Lock "cinder-quobyte-f3a2b733-a771-4c7d-af91-3010a3a1150a" acquired by "delete_volume" :: waited 0.021s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:54:44 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[43df5d76-0b2b-45cc-a53b-bbc1a67b1818]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:54:44 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-8dc08a2b-d835-4b4c-b83e-49e2cbc2e587 tempest-ProjectReaderTests-397971060 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-f3a2b733-a771-4c7d-af91-3010a3a1150a {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:54:44 devstack sudo[113553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-f3a2b733-a771-4c7d-af91-3010a3a1150a Aug 03 08:54:44 devstack sudo[113553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:54:44 devstack sudo[113551]: pam_unix(sudo:session): session closed for user root Aug 03 08:54:44 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-ddd0addd-61af-4a4c-995b-92cb69bf096f tempest-ProjectMemberTests-1353074417 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-bd4c6044-4c1f-4581-9f61-fb2305d4e290" returned: 0 in 0.377s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:54:44 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-ddd0addd-61af-4a4c-995b-92cb69bf096f tempest-ProjectMemberTests-1353074417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-bd4c6044-4c1f-4581-9f61-fb2305d4e290,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-bd4c6044-4c1f-4581-9f61-fb2305d4e290.d04702d8-e0e3-475a-a96b-07cf8d70ea48 1G {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:54:44 devstack sudo[113558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-bd4c6044-4c1f-4581-9f61-fb2305d4e290,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-bd4c6044-4c1f-4581-9f61-fb2305d4e290.d04702d8-e0e3-475a-a96b-07cf8d70ea48 1G Aug 03 08:54:44 devstack sudo[113558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:54:45 devstack sudo[113553]: pam_unix(sudo:session): session closed for user root Aug 03 08:54:45 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-8dc08a2b-d835-4b4c-b83e-49e2cbc2e587 tempest-ProjectReaderTests-397971060 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-f3a2b733-a771-4c7d-af91-3010a3a1150a" returned: 0 in 0.373s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:54:45 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-8dc08a2b-d835-4b4c-b83e-49e2cbc2e587 tempest-ProjectReaderTests-397971060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-f3a2b733-a771-4c7d-af91-3010a3a1150a {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:54:45 devstack sudo[113563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-f3a2b733-a771-4c7d-af91-3010a3a1150a Aug 03 08:54:45 devstack sudo[113563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:54:45 devstack sudo[113558]: pam_unix(sudo:session): session closed for user root Aug 03 08:54:45 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-ddd0addd-61af-4a4c-995b-92cb69bf096f tempest-ProjectMemberTests-1353074417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-bd4c6044-4c1f-4581-9f61-fb2305d4e290,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-bd4c6044-4c1f-4581-9f61-fb2305d4e290.d04702d8-e0e3-475a-a96b-07cf8d70ea48 1G" returned: 0 in 0.421s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:54:45 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-ddd0addd-61af-4a4c-995b-92cb69bf096f tempest-ProjectMemberTests-1353074417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bd4c6044-4c1f-4581-9f61-fb2305d4e290 -F qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-bd4c6044-4c1f-4581-9f61-fb2305d4e290.d04702d8-e0e3-475a-a96b-07cf8d70ea48 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:54:45 devstack sudo[113568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bd4c6044-4c1f-4581-9f61-fb2305d4e290 -F qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-bd4c6044-4c1f-4581-9f61-fb2305d4e290.d04702d8-e0e3-475a-a96b-07cf8d70ea48 Aug 03 08:54:45 devstack sudo[113568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:54:45 devstack sudo[113563]: pam_unix(sudo:session): session closed for user root Aug 03 08:54:45 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-8dc08a2b-d835-4b4c-b83e-49e2cbc2e587 tempest-ProjectReaderTests-397971060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-f3a2b733-a771-4c7d-af91-3010a3a1150a" returned: 0 in 0.256s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:54:45 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-8dc08a2b-d835-4b4c-b83e-49e2cbc2e587 tempest-ProjectReaderTests-397971060 None] Lock "cinder-quobyte-f3a2b733-a771-4c7d-af91-3010a3a1150a" released by "delete_volume" :: held 0.674s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:54:45 devstack cinder-volume[88899]: DEBUG cinder.quota [None req-8dc08a2b-d835-4b4c-b83e-49e2cbc2e587 tempest-ProjectReaderTests-397971060 None] Created reservations ['f52133c2-54ad-4734-97f5-2970b4faaa20', '9535f7ce-bdff-4289-b3ef-4346bcbc418c', '80378a84-69e3-42b8-b534-2bff5f01dcce', 'f03bc71e-696c-4ae6-b60a-aa5c24bf2be3'] {{(pid=88899) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 08:54:45 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-8dc08a2b-d835-4b4c-b83e-49e2cbc2e587 tempest-ProjectReaderTests-397971060 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:54:45 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-8dc08a2b-d835-4b4c-b83e-49e2cbc2e587 tempest-ProjectReaderTests-397971060 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:54:45 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-8dc08a2b-d835-4b4c-b83e-49e2cbc2e587 tempest-ProjectReaderTests-397971060 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:54:45 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-8dc08a2b-d835-4b4c-b83e-49e2cbc2e587 tempest-ProjectReaderTests-397971060 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:54:45 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-8dc08a2b-d835-4b4c-b83e-49e2cbc2e587 tempest-ProjectReaderTests-397971060 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:54:45 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-8dc08a2b-d835-4b4c-b83e-49e2cbc2e587 tempest-ProjectReaderTests-397971060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:54:45 devstack sudo[113571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a Aug 03 08:54:45 devstack sudo[113571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:54:45 devstack sudo[113568]: pam_unix(sudo:session): session closed for user root Aug 03 08:54:45 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-ddd0addd-61af-4a4c-995b-92cb69bf096f tempest-ProjectMemberTests-1353074417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bd4c6044-4c1f-4581-9f61-fb2305d4e290 -F qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-bd4c6044-4c1f-4581-9f61-fb2305d4e290.d04702d8-e0e3-475a-a96b-07cf8d70ea48" returned: 0 in 0.310s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:54:45 devstack cinder-volume[88899]: WARNING cinder.volume.drivers.remotefs [None req-ddd0addd-61af-4a4c-995b-92cb69bf096f tempest-ProjectMemberTests-1353074417 None] /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-bd4c6044-4c1f-4581-9f61-fb2305d4e290.d04702d8-e0e3-475a-a96b-07cf8d70ea48 is being set with open permissions: ugo+rw Aug 03 08:54:45 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-ddd0addd-61af-4a4c-995b-92cb69bf096f tempest-ProjectMemberTests-1353074417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-bd4c6044-4c1f-4581-9f61-fb2305d4e290.d04702d8-e0e3-475a-a96b-07cf8d70ea48 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:54:45 devstack sudo[113576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-bd4c6044-4c1f-4581-9f61-fb2305d4e290.d04702d8-e0e3-475a-a96b-07cf8d70ea48 Aug 03 08:54:45 devstack sudo[113576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:54:45 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-c71fed10-7380-4c39-92ce-032ded037a1c tempest-CinderUnicodeTest-253937196 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:54:45 devstack sudo[113571]: pam_unix(sudo:session): session closed for user root Aug 03 08:54:45 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-8dc08a2b-d835-4b4c-b83e-49e2cbc2e587 tempest-ProjectReaderTests-397971060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a" returned: 0 in 0.283s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:54:45 devstack cinder-volume[88899]: DEBUG cinder.manager [None req-8dc08a2b-d835-4b4c-b83e-49e2cbc2e587 tempest-ProjectReaderTests-397971060 None] Notifying Schedulers of capabilities ... {{(pid=88899) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 08:54:45 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-8dc08a2b-d835-4b4c-b83e-49e2cbc2e587 tempest-ProjectReaderTests-397971060 None] Deleted volume successfully. Aug 03 08:54:45 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-8dc08a2b-d835-4b4c-b83e-49e2cbc2e587 tempest-ProjectReaderTests-397971060 None] Lock "cinder-f3a2b733-a771-4c7d-af91-3010a3a1150a-delete_volume" released by "delete_volume" :: held 1.173s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:54:45 devstack sudo[113576]: pam_unix(sudo:session): session closed for user root Aug 03 08:54:45 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-ddd0addd-61af-4a4c-995b-92cb69bf096f tempest-ProjectMemberTests-1353074417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-bd4c6044-4c1f-4581-9f61-fb2305d4e290.d04702d8-e0e3-475a-a96b-07cf8d70ea48" returned: 0 in 0.283s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:54:45 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-ddd0addd-61af-4a4c-995b-92cb69bf096f tempest-ProjectMemberTests-1353074417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-bd4c6044-4c1f-4581-9f61-fb2305d4e290.info {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:54:46 devstack sudo[113580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-bd4c6044-4c1f-4581-9f61-fb2305d4e290.info Aug 03 08:54:46 devstack sudo[113580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:54:46 devstack sudo[113580]: pam_unix(sudo:session): session closed for user root Aug 03 08:54:46 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-ddd0addd-61af-4a4c-995b-92cb69bf096f tempest-ProjectMemberTests-1353074417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-bd4c6044-4c1f-4581-9f61-fb2305d4e290.info" returned: 0 in 0.261s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:54:46 devstack cinder-volume[88899]: WARNING cinder.volume.drivers.remotefs [None req-ddd0addd-61af-4a4c-995b-92cb69bf096f tempest-ProjectMemberTests-1353074417 None] /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-bd4c6044-4c1f-4581-9f61-fb2305d4e290.info is being set with open permissions: ugo+rw Aug 03 08:54:46 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-ddd0addd-61af-4a4c-995b-92cb69bf096f tempest-ProjectMemberTests-1353074417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-bd4c6044-4c1f-4581-9f61-fb2305d4e290.info {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:54:46 devstack sudo[113583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-bd4c6044-4c1f-4581-9f61-fb2305d4e290.info Aug 03 08:54:46 devstack sudo[113583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:54:46 devstack cinder-volume[88899]: DEBUG cinder.volume.flows.manager.create_volume [None req-9a9a898a-0841-4d60-a1d6-00cb82d8ab9c tempest-ProjectReaderTests-397971060 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88899) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 08:54:46 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-9a9a898a-0841-4d60-a1d6-00cb82d8ab9c tempest-ProjectReaderTests-397971060 None] Flow 'volume_create_manager' (6914704f-324a-49f3-a243-3eb651e33703) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:54:46 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-9a9a898a-0841-4d60-a1d6-00cb82d8ab9c tempest-ProjectReaderTests-397971060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07b23dc3-8a4a-4d7f-9655-c3d9f4760959) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:54:46 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-9a9a898a-0841-4d60-a1d6-00cb82d8ab9c tempest-ProjectReaderTests-397971060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07b23dc3-8a4a-4d7f-9655-c3d9f4760959) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:54:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-536354677',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4709f653-6777-424e-8cdc-edd8464db519,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a95fee59b384e1eb793d0850380c011',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:54:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:54:46Z,use_quota=True,user_id='d3e77fcfb478424d98b0b26e873c68b3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8bde7129-1dc4-42ab-b852-ab32c61b4921),volume_type_id=8bde7129-1dc4-42ab-b852-ab32c61b4921)' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:54:46 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-9a9a898a-0841-4d60-a1d6-00cb82d8ab9c tempest-ProjectReaderTests-397971060 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a9ea254-bb44-432b-b53e-dd21a7c51abf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:54:46 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-9a9a898a-0841-4d60-a1d6-00cb82d8ab9c tempest-ProjectReaderTests-397971060 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a9ea254-bb44-432b-b53e-dd21a7c51abf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:54:46 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-9a9a898a-0841-4d60-a1d6-00cb82d8ab9c tempest-ProjectReaderTests-397971060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed126429-197f-4332-a16a-3284c74814fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:54:46 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-9a9a898a-0841-4d60-a1d6-00cb82d8ab9c tempest-ProjectReaderTests-397971060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed126429-197f-4332-a16a-3284c74814fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4709f653-6777-424e-8cdc-edd8464db519', 'volume_name': 'volume-4709f653-6777-424e-8cdc-edd8464db519', 'volume_size': 1}' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:54:46 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-9a9a898a-0841-4d60-a1d6-00cb82d8ab9c tempest-ProjectReaderTests-397971060 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7cc1d2a4-a136-40a3-929d-7bc02f58e534) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:54:46 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-9a9a898a-0841-4d60-a1d6-00cb82d8ab9c tempest-ProjectReaderTests-397971060 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7cc1d2a4-a136-40a3-929d-7bc02f58e534) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:54:46 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-9a9a898a-0841-4d60-a1d6-00cb82d8ab9c tempest-ProjectReaderTests-397971060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (057a770a-7617-454b-b20d-67df7eceed0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:54:46 devstack cinder-volume[88899]: INFO cinder.volume.flows.manager.create_volume [None req-9a9a898a-0841-4d60-a1d6-00cb82d8ab9c tempest-ProjectReaderTests-397971060 None] Volume 4709f653-6777-424e-8cdc-edd8464db519: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4709f653-6777-424e-8cdc-edd8464db519', 'volume_size': 1} Aug 03 08:54:46 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-9a9a898a-0841-4d60-a1d6-00cb82d8ab9c tempest-ProjectReaderTests-397971060 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:54:46 devstack sudo[113583]: pam_unix(sudo:session): session closed for user root Aug 03 08:54:46 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-ddd0addd-61af-4a4c-995b-92cb69bf096f tempest-ProjectMemberTests-1353074417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-bd4c6044-4c1f-4581-9f61-fb2305d4e290.info" returned: 0 in 0.244s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:54:46 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-ddd0addd-61af-4a4c-995b-92cb69bf096f tempest-ProjectMemberTests-1353074417 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.005s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:54:46 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-56c6c756-d519-401c-875f-de71d183fc19 tempest-VolumeDependencyTests-1512358985 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 2.285s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:54:46 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-56c6c756-d519-401c-875f-de71d183fc19 tempest-VolumeDependencyTests-1512358985 None] Acquiring lock "cinder-quobyte-aef7c728-4aa2-4fec-9acb-e319191de38e-f93f444e-8df8-4e1a-97ad-a3ec6f9183e5" by "_create_volume_from_snapshot" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:54:46 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-56c6c756-d519-401c-875f-de71d183fc19 tempest-VolumeDependencyTests-1512358985 None] Lock "cinder-quobyte-aef7c728-4aa2-4fec-9acb-e319191de38e-f93f444e-8df8-4e1a-97ad-a3ec6f9183e5" acquired by "_create_volume_from_snapshot" :: waited 0.019s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:54:46 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-56c6c756-d519-401c-875f-de71d183fc19 tempest-VolumeDependencyTests-1512358985 None] Creating volume f93f444e-8df8-4e1a-97ad-a3ec6f9183e5 from snapshot aef7c728-4aa2-4fec-9acb-e319191de38e {{(pid=88899) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Aug 03 08:54:46 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-56c6c756-d519-401c-875f-de71d183fc19 tempest-VolumeDependencyTests-1512358985 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:54:46 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-56c6c756-d519-401c-875f-de71d183fc19 tempest-VolumeDependencyTests-1512358985 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:54:46 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-56c6c756-d519-401c-875f-de71d183fc19 tempest-VolumeDependencyTests-1512358985 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:54:46 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-56c6c756-d519-401c-875f-de71d183fc19 tempest-VolumeDependencyTests-1512358985 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:54:46 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-56c6c756-d519-401c-875f-de71d183fc19 tempest-VolumeDependencyTests-1512358985 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:54:46 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-56c6c756-d519-401c-875f-de71d183fc19 tempest-VolumeDependencyTests-1512358985 None] Selected osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385 as target Quobyte volume. {{(pid=88899) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 08:54:46 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-56c6c756-d519-401c-875f-de71d183fc19 tempest-VolumeDependencyTests-1512358985 None] Acquiring lock "cinder-quobyte-f93f444e-8df8-4e1a-97ad-a3ec6f9183e5" by "_copy_volume_from_snapshot" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:54:46 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-ddd0addd-61af-4a4c-995b-92cb69bf096f tempest-ProjectMemberTests-1353074417 None] Create snapshot completed successfully Aug 03 08:54:46 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-56c6c756-d519-401c-875f-de71d183fc19 tempest-VolumeDependencyTests-1512358985 None] Lock "cinder-quobyte-f93f444e-8df8-4e1a-97ad-a3ec6f9183e5" acquired by "_copy_volume_from_snapshot" :: waited 0.016s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:54:46 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-56c6c756-d519-401c-875f-de71d183fc19 tempest-VolumeDependencyTests-1512358985 None] snapshot: aef7c728-4aa2-4fec-9acb-e319191de38e, volume: f93f444e-8df8-4e1a-97ad-a3ec6f9183e5, {{(pid=88899) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Aug 03 08:54:46 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-56c6c756-d519-401c-875f-de71d183fc19 tempest-VolumeDependencyTests-1512358985 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:54:46 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-56c6c756-d519-401c-875f-de71d183fc19 tempest-VolumeDependencyTests-1512358985 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:54:46 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-56c6c756-d519-401c-875f-de71d183fc19 tempest-VolumeDependencyTests-1512358985 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:54:46 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-56c6c756-d519-401c-875f-de71d183fc19 tempest-VolumeDependencyTests-1512358985 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:54:46 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-56c6c756-d519-401c-875f-de71d183fc19 tempest-VolumeDependencyTests-1512358985 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:54:46 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[4acc00ae-b94b-4b97-9155-16207a34acbc]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:54:46 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-56c6c756-d519-401c-875f-de71d183fc19 tempest-VolumeDependencyTests-1512358985 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-4af9be76-27b6-4f10-99d7-6e37186be5c3.aef7c728-4aa2-4fec-9acb-e319191de38e {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:54:46 devstack sudo[113586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-4af9be76-27b6-4f10-99d7-6e37186be5c3.aef7c728-4aa2-4fec-9acb-e319191de38e Aug 03 08:54:46 devstack sudo[113586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:54:46 devstack sudo[113586]: pam_unix(sudo:session): session closed for user root Aug 03 08:54:46 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-56c6c756-d519-401c-875f-de71d183fc19 tempest-VolumeDependencyTests-1512358985 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-4af9be76-27b6-4f10-99d7-6e37186be5c3.aef7c728-4aa2-4fec-9acb-e319191de38e" returned: 0 in 0.349s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:54:46 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-56c6c756-d519-401c-875f-de71d183fc19 tempest-VolumeDependencyTests-1512358985 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4af9be76-27b6-4f10-99d7-6e37186be5c3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88899) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 03 08:54:46 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[507e4e27-1c35-4a4f-992b-5d4bee6fcaf4]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:54:46 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-56c6c756-d519-401c-875f-de71d183fc19 tempest-VolumeDependencyTests-1512358985 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-4af9be76-27b6-4f10-99d7-6e37186be5c3 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:54:47 devstack sudo[113591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-4af9be76-27b6-4f10-99d7-6e37186be5c3 Aug 03 08:54:47 devstack sudo[113591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:54:47 devstack sudo[113591]: pam_unix(sudo:session): session closed for user root Aug 03 08:54:47 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-56c6c756-d519-401c-875f-de71d183fc19 tempest-VolumeDependencyTests-1512358985 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-4af9be76-27b6-4f10-99d7-6e37186be5c3" returned: 0 in 0.364s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:54:47 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-56c6c756-d519-401c-875f-de71d183fc19 tempest-VolumeDependencyTests-1512358985 None] will copy from snapshot at /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-4af9be76-27b6-4f10-99d7-6e37186be5c3 {{(pid=88899) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Aug 03 08:54:47 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-56c6c756-d519-401c-875f-de71d183fc19 tempest-VolumeDependencyTests-1512358985 None] Creating direct copy from snapshot {{(pid=88899) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Aug 03 08:54:47 devstack cinder-volume[88899]: DEBUG cinder.utils [None req-56c6c756-d519-401c-875f-de71d183fc19 tempest-VolumeDependencyTests-1512358985 None] Path /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-f93f444e-8df8-4e1a-97ad-a3ec6f9183e5 not found in is_blk_device check {{(pid=88899) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Aug 03 08:54:47 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-56c6c756-d519-401c-875f-de71d183fc19 tempest-VolumeDependencyTests-1512358985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-4af9be76-27b6-4f10-99d7-6e37186be5c3 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-f93f444e-8df8-4e1a-97ad-a3ec6f9183e5 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:54:47 devstack sudo[113596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-4af9be76-27b6-4f10-99d7-6e37186be5c3 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-f93f444e-8df8-4e1a-97ad-a3ec6f9183e5 Aug 03 08:54:47 devstack sudo[113596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:54:47 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-e1efdb1e-aea1-43db-8e37-1fb484e1b643 tempest-ProjectMemberTests-1353074417 None] Acquiring lock "cinder-d04702d8-e0e3-475a-a96b-07cf8d70ea48-delete_snapshot" by "delete_snapshot" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:54:47 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-e1efdb1e-aea1-43db-8e37-1fb484e1b643 tempest-ProjectMemberTests-1353074417 None] Lock "cinder-d04702d8-e0e3-475a-a96b-07cf8d70ea48-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:54:47 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-e1efdb1e-aea1-43db-8e37-1fb484e1b643 tempest-ProjectMemberTests-1353074417 None] Acquiring lock "cinder-quobyte-bd4c6044-4c1f-4581-9f61-fb2305d4e290" by "delete_snapshot" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:54:47 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-e1efdb1e-aea1-43db-8e37-1fb484e1b643 tempest-ProjectMemberTests-1353074417 None] Lock "cinder-quobyte-bd4c6044-4c1f-4581-9f61-fb2305d4e290" acquired by "delete_snapshot" :: waited 0.015s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:54:47 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-e1efdb1e-aea1-43db-8e37-1fb484e1b643 tempest-ProjectMemberTests-1353074417 None] Acquiring lock "cinder-quobyte-d04702d8-e0e3-475a-a96b-07cf8d70ea48" by "_delete_snapshot" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:54:47 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-e1efdb1e-aea1-43db-8e37-1fb484e1b643 tempest-ProjectMemberTests-1353074417 None] Lock "cinder-quobyte-d04702d8-e0e3-475a-a96b-07cf8d70ea48" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:54:47 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-e1efdb1e-aea1-43db-8e37-1fb484e1b643 tempest-ProjectMemberTests-1353074417 None] Deleting offline snapshot d04702d8-e0e3-475a-a96b-07cf8d70ea48 of volume bd4c6044-4c1f-4581-9f61-fb2305d4e290 {{(pid=88899) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 03 08:54:47 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-e1efdb1e-aea1-43db-8e37-1fb484e1b643 tempest-ProjectMemberTests-1353074417 None] snapshot_file for this snap is: volume-bd4c6044-4c1f-4581-9f61-fb2305d4e290.d04702d8-e0e3-475a-a96b-07cf8d70ea48 {{(pid=88899) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 03 08:54:47 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb9a64e6-867e-4a75-8313-12b899a83537]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:54:47 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-e1efdb1e-aea1-43db-8e37-1fb484e1b643 tempest-ProjectMemberTests-1353074417 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-bd4c6044-4c1f-4581-9f61-fb2305d4e290.d04702d8-e0e3-475a-a96b-07cf8d70ea48 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:54:47 devstack sudo[113602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-bd4c6044-4c1f-4581-9f61-fb2305d4e290.d04702d8-e0e3-475a-a96b-07cf8d70ea48 Aug 03 08:54:47 devstack sudo[113602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:54:48 devstack sudo[113602]: pam_unix(sudo:session): session closed for user root Aug 03 08:54:48 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-e1efdb1e-aea1-43db-8e37-1fb484e1b643 tempest-ProjectMemberTests-1353074417 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-bd4c6044-4c1f-4581-9f61-fb2305d4e290.d04702d8-e0e3-475a-a96b-07cf8d70ea48" returned: 0 in 0.646s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:54:48 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-e1efdb1e-aea1-43db-8e37-1fb484e1b643 tempest-ProjectMemberTests-1353074417 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bd4c6044-4c1f-4581-9f61-fb2305d4e290(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88899) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 03 08:54:48 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[32dfff84-58bf-4d82-a9f7-358e4bc824b7]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:54:48 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-e1efdb1e-aea1-43db-8e37-1fb484e1b643 tempest-ProjectMemberTests-1353074417 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-bd4c6044-4c1f-4581-9f61-fb2305d4e290 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:54:48 devstack sudo[113616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-bd4c6044-4c1f-4581-9f61-fb2305d4e290 Aug 03 08:54:48 devstack sudo[113616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:54:48 devstack sudo[113616]: pam_unix(sudo:session): session closed for user root Aug 03 08:54:48 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-e1efdb1e-aea1-43db-8e37-1fb484e1b643 tempest-ProjectMemberTests-1353074417 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-bd4c6044-4c1f-4581-9f61-fb2305d4e290" returned: 0 in 0.563s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:54:48 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-e1efdb1e-aea1-43db-8e37-1fb484e1b643 tempest-ProjectMemberTests-1353074417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-bd4c6044-4c1f-4581-9f61-fb2305d4e290.d04702d8-e0e3-475a-a96b-07cf8d70ea48 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:54:49 devstack sudo[113622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-bd4c6044-4c1f-4581-9f61-fb2305d4e290.d04702d8-e0e3-475a-a96b-07cf8d70ea48 Aug 03 08:54:49 devstack sudo[113622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:54:49 devstack sudo[113622]: pam_unix(sudo:session): session closed for user root Aug 03 08:54:49 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-e1efdb1e-aea1-43db-8e37-1fb484e1b643 tempest-ProjectMemberTests-1353074417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-bd4c6044-4c1f-4581-9f61-fb2305d4e290.d04702d8-e0e3-475a-a96b-07cf8d70ea48" returned: 0 in 0.569s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:54:49 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-e1efdb1e-aea1-43db-8e37-1fb484e1b643 tempest-ProjectMemberTests-1353074417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-bd4c6044-4c1f-4581-9f61-fb2305d4e290.d04702d8-e0e3-475a-a96b-07cf8d70ea48 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:54:49 devstack sudo[113627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-bd4c6044-4c1f-4581-9f61-fb2305d4e290.d04702d8-e0e3-475a-a96b-07cf8d70ea48 Aug 03 08:54:49 devstack sudo[113627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:54:49 devstack sudo[113627]: pam_unix(sudo:session): session closed for user root Aug 03 08:54:49 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-e1efdb1e-aea1-43db-8e37-1fb484e1b643 tempest-ProjectMemberTests-1353074417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-bd4c6044-4c1f-4581-9f61-fb2305d4e290.d04702d8-e0e3-475a-a96b-07cf8d70ea48" returned: 0 in 0.419s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:54:49 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-e1efdb1e-aea1-43db-8e37-1fb484e1b643 tempest-ProjectMemberTests-1353074417 None] Lock "cinder-quobyte-d04702d8-e0e3-475a-a96b-07cf8d70ea48" released by "_delete_snapshot" :: held 2.369s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:54:50 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-e1efdb1e-aea1-43db-8e37-1fb484e1b643 tempest-ProjectMemberTests-1353074417 None] Lock "cinder-quobyte-bd4c6044-4c1f-4581-9f61-fb2305d4e290" released by "delete_snapshot" :: held 2.404s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:54:50 devstack cinder-volume[88899]: DEBUG cinder.quota [None req-e1efdb1e-aea1-43db-8e37-1fb484e1b643 tempest-ProjectMemberTests-1353074417 None] Created reservations ['348d4231-edca-47da-a5e6-04e495a2e3cb', 'c89b1bc3-19e2-492f-b3dc-ce9c51c9afaa', '11812ec1-c7a0-4a9a-985f-58f703fca0ed', '4eb562d3-aa5c-4000-ab9c-2b9adef091ba'] {{(pid=88899) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 08:54:50 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-e1efdb1e-aea1-43db-8e37-1fb484e1b643 tempest-ProjectMemberTests-1353074417 None] Delete snapshot completed successfully. Aug 03 08:54:50 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-e1efdb1e-aea1-43db-8e37-1fb484e1b643 tempest-ProjectMemberTests-1353074417 None] Lock "cinder-d04702d8-e0e3-475a-a96b-07cf8d70ea48-delete_snapshot" released by "delete_snapshot" :: held 2.921s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:54:50 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-756b4d52-800e-4083-ba71-19374abc1c9f tempest-ProjectMemberTests-1353074417 None] Acquiring lock "cinder-bd4c6044-4c1f-4581-9f61-fb2305d4e290-delete_volume" by "delete_volume" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:54:50 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-756b4d52-800e-4083-ba71-19374abc1c9f tempest-ProjectMemberTests-1353074417 None] Lock "cinder-bd4c6044-4c1f-4581-9f61-fb2305d4e290-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:54:51 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-756b4d52-800e-4083-ba71-19374abc1c9f tempest-ProjectMemberTests-1353074417 None] Acquiring lock "cinder-quobyte-bd4c6044-4c1f-4581-9f61-fb2305d4e290" by "delete_volume" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:54:51 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-756b4d52-800e-4083-ba71-19374abc1c9f tempest-ProjectMemberTests-1353074417 None] Lock "cinder-quobyte-bd4c6044-4c1f-4581-9f61-fb2305d4e290" acquired by "delete_volume" :: waited 0.028s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:54:51 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[85de6107-dc33-4e4a-9ae9-ab55efa06fc7]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:54:51 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-756b4d52-800e-4083-ba71-19374abc1c9f tempest-ProjectMemberTests-1353074417 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-bd4c6044-4c1f-4581-9f61-fb2305d4e290 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:54:51 devstack sudo[113630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-bd4c6044-4c1f-4581-9f61-fb2305d4e290 Aug 03 08:54:51 devstack sudo[113630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:54:51 devstack sudo[113630]: pam_unix(sudo:session): session closed for user root Aug 03 08:54:51 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-756b4d52-800e-4083-ba71-19374abc1c9f tempest-ProjectMemberTests-1353074417 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-bd4c6044-4c1f-4581-9f61-fb2305d4e290" returned: 0 in 0.557s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:54:51 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-756b4d52-800e-4083-ba71-19374abc1c9f tempest-ProjectMemberTests-1353074417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-bd4c6044-4c1f-4581-9f61-fb2305d4e290 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:54:51 devstack sudo[113596]: pam_unix(sudo:session): session closed for user root Aug 03 08:54:51 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-56c6c756-d519-401c-875f-de71d183fc19 tempest-VolumeDependencyTests-1512358985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-4af9be76-27b6-4f10-99d7-6e37186be5c3 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-f93f444e-8df8-4e1a-97ad-a3ec6f9183e5" returned: 0 in 4.417s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:54:51 devstack cinder-volume[88899]: DEBUG cinder.image.image_utils [None req-56c6c756-d519-401c-875f-de71d183fc19 tempest-VolumeDependencyTests-1512358985 None] Image conversion details: src /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-4af9be76-27b6-4f10-99d7-6e37186be5c3, size 1024.00 MB, duration 4.42 sec, destination /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-f93f444e-8df8-4e1a-97ad-a3ec6f9183e5 {{(pid=88899) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 03 08:54:51 devstack cinder-volume[88899]: INFO cinder.image.image_utils [None req-56c6c756-d519-401c-875f-de71d183fc19 tempest-VolumeDependencyTests-1512358985 None] Converted 1024.00 MB image at 231.71 MB/s Aug 03 08:54:51 devstack cinder-volume[88899]: WARNING cinder.volume.drivers.remotefs [None req-56c6c756-d519-401c-875f-de71d183fc19 tempest-VolumeDependencyTests-1512358985 None] /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-f93f444e-8df8-4e1a-97ad-a3ec6f9183e5 is being set with open permissions: ugo+rw Aug 03 08:54:51 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-56c6c756-d519-401c-875f-de71d183fc19 tempest-VolumeDependencyTests-1512358985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-f93f444e-8df8-4e1a-97ad-a3ec6f9183e5 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:54:51 devstack sudo[113635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-bd4c6044-4c1f-4581-9f61-fb2305d4e290 Aug 03 08:54:51 devstack sudo[113635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:54:51 devstack sudo[113636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-f93f444e-8df8-4e1a-97ad-a3ec6f9183e5 Aug 03 08:54:51 devstack sudo[113636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:54:51 devstack cinder-volume[88899]: DEBUG oslo_service.periodic_task [None req-f948fb4a-c4d7-499f-b1bd-8d6be3de0b53 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88899) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 03 08:54:51 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-f948fb4a-c4d7-499f-b1bd-8d6be3de0b53 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:54:51 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-f948fb4a-c4d7-499f-b1bd-8d6be3de0b53 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:54:51 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-f948fb4a-c4d7-499f-b1bd-8d6be3de0b53 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:54:51 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-f948fb4a-c4d7-499f-b1bd-8d6be3de0b53 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:54:51 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-f948fb4a-c4d7-499f-b1bd-8d6be3de0b53 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:54:51 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-f948fb4a-c4d7-499f-b1bd-8d6be3de0b53 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:54:51 devstack sudo[113639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a Aug 03 08:54:51 devstack sudo[113639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:54:51 devstack sudo[113636]: pam_unix(sudo:session): session closed for user root Aug 03 08:54:51 devstack sudo[113635]: pam_unix(sudo:session): session closed for user root Aug 03 08:54:52 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-56c6c756-d519-401c-875f-de71d183fc19 tempest-VolumeDependencyTests-1512358985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-f93f444e-8df8-4e1a-97ad-a3ec6f9183e5" returned: 0 in 0.243s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:54:52 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-756b4d52-800e-4083-ba71-19374abc1c9f tempest-ProjectMemberTests-1353074417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-bd4c6044-4c1f-4581-9f61-fb2305d4e290" returned: 0 in 0.263s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:54:52 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-756b4d52-800e-4083-ba71-19374abc1c9f tempest-ProjectMemberTests-1353074417 None] Lock "cinder-quobyte-bd4c6044-4c1f-4581-9f61-fb2305d4e290" released by "delete_volume" :: held 0.938s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:54:52 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-56c6c756-d519-401c-875f-de71d183fc19 tempest-VolumeDependencyTests-1512358985 None] Lock "cinder-quobyte-f93f444e-8df8-4e1a-97ad-a3ec6f9183e5" released by "_copy_volume_from_snapshot" :: held 5.461s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:54:52 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-56c6c756-d519-401c-875f-de71d183fc19 tempest-VolumeDependencyTests-1512358985 None] Lock "cinder-quobyte-aef7c728-4aa2-4fec-9acb-e319191de38e-f93f444e-8df8-4e1a-97ad-a3ec6f9183e5" released by "_create_volume_from_snapshot" :: held 5.581s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:54:52 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-56c6c756-d519-401c-875f-de71d183fc19 tempest-VolumeDependencyTests-1512358985 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.602s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:54:52 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-c71fed10-7380-4c39-92ce-032ded037a1c tempest-CinderUnicodeTest-253937196 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 6.273s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:54:52 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-c71fed10-7380-4c39-92ce-032ded037a1c tempest-CinderUnicodeTest-253937196 None] Creating offline snapshot f46fe5da-4862-465f-abfe-74bc5c78ced3 of volume d034785c-09c7-4b5e-ba3f-4af699887f61 {{(pid=88899) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 03 08:54:52 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-56c6c756-d519-401c-875f-de71d183fc19 tempest-VolumeDependencyTests-1512358985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e64d2e0e-4c30-4ee3-a64e-8780494af5cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f93f444e-8df8-4e1a-97ad-a3ec6f9183e5', 'volume_size': 1, 'snapshot_id': 'aef7c728-4aa2-4fec-9acb-e319191de38e'}' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:54:52 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-56c6c756-d519-401c-875f-de71d183fc19 tempest-VolumeDependencyTests-1512358985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (271072d9-13d2-443c-ab88-93b80ed062dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:54:52 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec35c031-c3ca-447e-bb88-375f59c56bda]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:54:52 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-c71fed10-7380-4c39-92ce-032ded037a1c tempest-CinderUnicodeTest-253937196 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-d034785c-09c7-4b5e-ba3f-4af699887f61 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:54:52 devstack cinder-volume[88899]: DEBUG cinder.quota [None req-756b4d52-800e-4083-ba71-19374abc1c9f tempest-ProjectMemberTests-1353074417 None] Created reservations ['a6956ccd-d5d1-4a96-9f0c-750aae8513c3', 'b32cb1a7-9353-4654-ae86-fd4c7f2bca54', '1efdbc90-148e-44e1-abcc-a9e5b101fa91', 'db4007db-78e4-484b-81a9-8ba731450673'] {{(pid=88899) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 08:54:52 devstack sudo[113639]: pam_unix(sudo:session): session closed for user root Aug 03 08:54:52 devstack cinder-volume[88899]: INFO cinder.volume.flows.manager.create_volume [None req-56c6c756-d519-401c-875f-de71d183fc19 tempest-VolumeDependencyTests-1512358985 None] Volume volume-f93f444e-8df8-4e1a-97ad-a3ec6f9183e5 (f93f444e-8df8-4e1a-97ad-a3ec6f9183e5): created successfully Aug 03 08:54:52 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-56c6c756-d519-401c-875f-de71d183fc19 tempest-VolumeDependencyTests-1512358985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (271072d9-13d2-443c-ab88-93b80ed062dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:54:52 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-56c6c756-d519-401c-875f-de71d183fc19 tempest-VolumeDependencyTests-1512358985 None] Flow 'volume_create_manager' (9ad37bfe-5166-4c5f-9613-d6537e606497) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:54:52 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-f948fb4a-c4d7-499f-b1bd-8d6be3de0b53 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a" returned: 0 in 0.284s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:54:52 devstack cinder-volume[88899]: DEBUG cinder.manager [None req-f948fb4a-c4d7-499f-b1bd-8d6be3de0b53 None None] Notifying Schedulers of capabilities ... {{(pid=88899) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 08:54:52 devstack cinder-volume[88899]: DEBUG oslo_service.periodic_task [None req-f948fb4a-c4d7-499f-b1bd-8d6be3de0b53 None None] Running periodic task VolumeManager._thread_info {{(pid=88899) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 03 08:54:52 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-f948fb4a-c4d7-499f-b1bd-8d6be3de0b53 None None] thread count: 29 {{(pid=88899) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 03 08:54:52 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-f948fb4a-c4d7-499f-b1bd-8d6be3de0b53 None None] thread info: [<_MainThread(MainThread, started 132234320248960)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88899) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 03 08:54:52 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-56c6c756-d519-401c-875f-de71d183fc19 tempest-VolumeDependencyTests-1512358985 None] Created volume successfully. Aug 03 08:54:52 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-756b4d52-800e-4083-ba71-19374abc1c9f tempest-ProjectMemberTests-1353074417 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:54:52 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-756b4d52-800e-4083-ba71-19374abc1c9f tempest-ProjectMemberTests-1353074417 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:54:52 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-756b4d52-800e-4083-ba71-19374abc1c9f tempest-ProjectMemberTests-1353074417 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:54:52 devstack sudo[113644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-d034785c-09c7-4b5e-ba3f-4af699887f61 Aug 03 08:54:52 devstack sudo[113644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:54:52 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-756b4d52-800e-4083-ba71-19374abc1c9f tempest-ProjectMemberTests-1353074417 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:54:52 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-756b4d52-800e-4083-ba71-19374abc1c9f tempest-ProjectMemberTests-1353074417 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:54:52 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-756b4d52-800e-4083-ba71-19374abc1c9f tempest-ProjectMemberTests-1353074417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:54:52 devstack sudo[113646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a Aug 03 08:54:52 devstack sudo[113646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:54:52 devstack sudo[113644]: pam_unix(sudo:session): session closed for user root Aug 03 08:54:52 devstack sudo[113646]: pam_unix(sudo:session): session closed for user root Aug 03 08:54:52 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-c71fed10-7380-4c39-92ce-032ded037a1c tempest-CinderUnicodeTest-253937196 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-d034785c-09c7-4b5e-ba3f-4af699887f61" returned: 0 in 0.365s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:54:52 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-c71fed10-7380-4c39-92ce-032ded037a1c tempest-CinderUnicodeTest-253937196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-d034785c-09c7-4b5e-ba3f-4af699887f61,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-d034785c-09c7-4b5e-ba3f-4af699887f61.f46fe5da-4862-465f-abfe-74bc5c78ced3 1G {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:54:52 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-756b4d52-800e-4083-ba71-19374abc1c9f tempest-ProjectMemberTests-1353074417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a" returned: 0 in 0.251s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:54:52 devstack cinder-volume[88899]: DEBUG cinder.manager [None req-756b4d52-800e-4083-ba71-19374abc1c9f tempest-ProjectMemberTests-1353074417 None] Notifying Schedulers of capabilities ... {{(pid=88899) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 08:54:52 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-756b4d52-800e-4083-ba71-19374abc1c9f tempest-ProjectMemberTests-1353074417 None] Deleted volume successfully. Aug 03 08:54:52 devstack sudo[113652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-d034785c-09c7-4b5e-ba3f-4af699887f61,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-d034785c-09c7-4b5e-ba3f-4af699887f61.f46fe5da-4862-465f-abfe-74bc5c78ced3 1G Aug 03 08:54:52 devstack sudo[113652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:54:52 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-756b4d52-800e-4083-ba71-19374abc1c9f tempest-ProjectMemberTests-1353074417 None] Lock "cinder-bd4c6044-4c1f-4581-9f61-fb2305d4e290-delete_volume" released by "delete_volume" :: held 1.628s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:54:52 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-23b6e92b-9186-427a-9cd2-3d74557b36b9 tempest-VolumeDependencyTests-1512358985 None] Acquiring lock "cinder-aef7c728-4aa2-4fec-9acb-e319191de38e-delete_snapshot" by "delete_snapshot" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:54:52 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-23b6e92b-9186-427a-9cd2-3d74557b36b9 tempest-VolumeDependencyTests-1512358985 None] Lock "cinder-aef7c728-4aa2-4fec-9acb-e319191de38e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:54:52 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-23b6e92b-9186-427a-9cd2-3d74557b36b9 tempest-VolumeDependencyTests-1512358985 None] Acquiring lock "cinder-quobyte-4af9be76-27b6-4f10-99d7-6e37186be5c3" by "delete_snapshot" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:54:52 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-23b6e92b-9186-427a-9cd2-3d74557b36b9 tempest-VolumeDependencyTests-1512358985 None] Lock "cinder-quobyte-4af9be76-27b6-4f10-99d7-6e37186be5c3" acquired by "delete_snapshot" :: waited 0.018s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:54:52 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-23b6e92b-9186-427a-9cd2-3d74557b36b9 tempest-VolumeDependencyTests-1512358985 None] Acquiring lock "cinder-quobyte-aef7c728-4aa2-4fec-9acb-e319191de38e" by "_delete_snapshot" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:54:52 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-23b6e92b-9186-427a-9cd2-3d74557b36b9 tempest-VolumeDependencyTests-1512358985 None] Lock "cinder-quobyte-aef7c728-4aa2-4fec-9acb-e319191de38e" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:54:52 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-23b6e92b-9186-427a-9cd2-3d74557b36b9 tempest-VolumeDependencyTests-1512358985 None] Deleting offline snapshot aef7c728-4aa2-4fec-9acb-e319191de38e of volume 4af9be76-27b6-4f10-99d7-6e37186be5c3 {{(pid=88899) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 03 08:54:52 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-23b6e92b-9186-427a-9cd2-3d74557b36b9 tempest-VolumeDependencyTests-1512358985 None] snapshot_file for this snap is: volume-4af9be76-27b6-4f10-99d7-6e37186be5c3.aef7c728-4aa2-4fec-9acb-e319191de38e {{(pid=88899) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 03 08:54:52 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[87f62503-3d59-48d8-8663-4a4cff281dad]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:54:52 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-23b6e92b-9186-427a-9cd2-3d74557b36b9 tempest-VolumeDependencyTests-1512358985 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-4af9be76-27b6-4f10-99d7-6e37186be5c3.aef7c728-4aa2-4fec-9acb-e319191de38e {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:54:52 devstack sudo[113652]: pam_unix(sudo:session): session closed for user root Aug 03 08:54:52 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-c71fed10-7380-4c39-92ce-032ded037a1c tempest-CinderUnicodeTest-253937196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-d034785c-09c7-4b5e-ba3f-4af699887f61,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-d034785c-09c7-4b5e-ba3f-4af699887f61.f46fe5da-4862-465f-abfe-74bc5c78ced3 1G" returned: 0 in 0.423s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:54:52 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-c71fed10-7380-4c39-92ce-032ded037a1c tempest-CinderUnicodeTest-253937196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d034785c-09c7-4b5e-ba3f-4af699887f61 -F qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-d034785c-09c7-4b5e-ba3f-4af699887f61.f46fe5da-4862-465f-abfe-74bc5c78ced3 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:54:52 devstack sudo[113659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d034785c-09c7-4b5e-ba3f-4af699887f61 -F qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-d034785c-09c7-4b5e-ba3f-4af699887f61.f46fe5da-4862-465f-abfe-74bc5c78ced3 Aug 03 08:54:52 devstack sudo[113659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:54:53 devstack sudo[113658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-4af9be76-27b6-4f10-99d7-6e37186be5c3.aef7c728-4aa2-4fec-9acb-e319191de38e Aug 03 08:54:53 devstack sudo[113658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:54:53 devstack sudo[113659]: pam_unix(sudo:session): session closed for user root Aug 03 08:54:53 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-c71fed10-7380-4c39-92ce-032ded037a1c tempest-CinderUnicodeTest-253937196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d034785c-09c7-4b5e-ba3f-4af699887f61 -F qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-d034785c-09c7-4b5e-ba3f-4af699887f61.f46fe5da-4862-465f-abfe-74bc5c78ced3" returned: 0 in 0.307s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:54:53 devstack cinder-volume[88899]: WARNING cinder.volume.drivers.remotefs [None req-c71fed10-7380-4c39-92ce-032ded037a1c tempest-CinderUnicodeTest-253937196 None] /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-d034785c-09c7-4b5e-ba3f-4af699887f61.f46fe5da-4862-465f-abfe-74bc5c78ced3 is being set with open permissions: ugo+rw Aug 03 08:54:53 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-c71fed10-7380-4c39-92ce-032ded037a1c tempest-CinderUnicodeTest-253937196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-d034785c-09c7-4b5e-ba3f-4af699887f61.f46fe5da-4862-465f-abfe-74bc5c78ced3 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:54:53 devstack sudo[113658]: pam_unix(sudo:session): session closed for user root Aug 03 08:54:53 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-23b6e92b-9186-427a-9cd2-3d74557b36b9 tempest-VolumeDependencyTests-1512358985 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-4af9be76-27b6-4f10-99d7-6e37186be5c3.aef7c728-4aa2-4fec-9acb-e319191de38e" returned: 0 in 0.387s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:54:53 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-23b6e92b-9186-427a-9cd2-3d74557b36b9 tempest-VolumeDependencyTests-1512358985 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4af9be76-27b6-4f10-99d7-6e37186be5c3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88899) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 03 08:54:53 devstack sudo[113668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-d034785c-09c7-4b5e-ba3f-4af699887f61.f46fe5da-4862-465f-abfe-74bc5c78ced3 Aug 03 08:54:53 devstack sudo[113668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:54:53 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[b48f94ff-5f43-483d-9a15-8ae210be22ed]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:54:53 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-23b6e92b-9186-427a-9cd2-3d74557b36b9 tempest-VolumeDependencyTests-1512358985 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-4af9be76-27b6-4f10-99d7-6e37186be5c3 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:54:53 devstack sudo[113670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-4af9be76-27b6-4f10-99d7-6e37186be5c3 Aug 03 08:54:53 devstack sudo[113670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:54:53 devstack sudo[113668]: pam_unix(sudo:session): session closed for user root Aug 03 08:54:53 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-c71fed10-7380-4c39-92ce-032ded037a1c tempest-CinderUnicodeTest-253937196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-d034785c-09c7-4b5e-ba3f-4af699887f61.f46fe5da-4862-465f-abfe-74bc5c78ced3" returned: 0 in 0.245s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:54:53 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-c71fed10-7380-4c39-92ce-032ded037a1c tempest-CinderUnicodeTest-253937196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-d034785c-09c7-4b5e-ba3f-4af699887f61.info {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:54:53 devstack sudo[113673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-d034785c-09c7-4b5e-ba3f-4af699887f61.info Aug 03 08:54:53 devstack sudo[113673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:54:53 devstack cinder-volume[88899]: DEBUG cinder.volume.flows.manager.create_volume [None req-aa528a2d-d76f-418f-8117-d4c1a5647da5 tempest-ProjectMemberTests-1353074417 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88899) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 08:54:53 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-aa528a2d-d76f-418f-8117-d4c1a5647da5 tempest-ProjectMemberTests-1353074417 None] Flow 'volume_create_manager' (a19210d5-195f-4201-a5d8-e0b672572aa2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:54:53 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-aa528a2d-d76f-418f-8117-d4c1a5647da5 tempest-ProjectMemberTests-1353074417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ff8cc26-17ad-4426-8977-4465648abf84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:54:53 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-aa528a2d-d76f-418f-8117-d4c1a5647da5 tempest-ProjectMemberTests-1353074417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ff8cc26-17ad-4426-8977-4465648abf84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:54:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-249367503',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=06743e1d-b45c-45e2-b01a-98e4d4c5b03d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b723e915839a4036ad739740ec4db0cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:54:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:54:54Z,use_quota=True,user_id='d9152484679b4fb79b0d8896a2a67eb9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8bde7129-1dc4-42ab-b852-ab32c61b4921),volume_type_id=8bde7129-1dc4-42ab-b852-ab32c61b4921)' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:54:53 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-aa528a2d-d76f-418f-8117-d4c1a5647da5 tempest-ProjectMemberTests-1353074417 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85170aca-2420-4b98-a454-b828aeeb79f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:54:53 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-aa528a2d-d76f-418f-8117-d4c1a5647da5 tempest-ProjectMemberTests-1353074417 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85170aca-2420-4b98-a454-b828aeeb79f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:54:53 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-aa528a2d-d76f-418f-8117-d4c1a5647da5 tempest-ProjectMemberTests-1353074417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6fc7d8d9-18e4-4c86-ad84-596a5422e2f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:54:53 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-aa528a2d-d76f-418f-8117-d4c1a5647da5 tempest-ProjectMemberTests-1353074417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6fc7d8d9-18e4-4c86-ad84-596a5422e2f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '06743e1d-b45c-45e2-b01a-98e4d4c5b03d', 'volume_name': 'volume-06743e1d-b45c-45e2-b01a-98e4d4c5b03d', 'volume_size': 1}' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:54:53 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-aa528a2d-d76f-418f-8117-d4c1a5647da5 tempest-ProjectMemberTests-1353074417 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9d6c74f-886d-47b9-9e63-ac9ee06c25a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:54:53 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-aa528a2d-d76f-418f-8117-d4c1a5647da5 tempest-ProjectMemberTests-1353074417 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9d6c74f-886d-47b9-9e63-ac9ee06c25a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:54:53 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-aa528a2d-d76f-418f-8117-d4c1a5647da5 tempest-ProjectMemberTests-1353074417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57d4817e-5390-4066-a1ae-d10cfff529a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:54:53 devstack cinder-volume[88899]: INFO cinder.volume.flows.manager.create_volume [None req-aa528a2d-d76f-418f-8117-d4c1a5647da5 tempest-ProjectMemberTests-1353074417 None] Volume 06743e1d-b45c-45e2-b01a-98e4d4c5b03d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-06743e1d-b45c-45e2-b01a-98e4d4c5b03d', 'volume_size': 1} Aug 03 08:54:53 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-aa528a2d-d76f-418f-8117-d4c1a5647da5 tempest-ProjectMemberTests-1353074417 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:54:53 devstack sudo[113673]: pam_unix(sudo:session): session closed for user root Aug 03 08:54:53 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-c71fed10-7380-4c39-92ce-032ded037a1c tempest-CinderUnicodeTest-253937196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-d034785c-09c7-4b5e-ba3f-4af699887f61.info" returned: 0 in 0.265s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:54:53 devstack cinder-volume[88899]: WARNING cinder.volume.drivers.remotefs [None req-c71fed10-7380-4c39-92ce-032ded037a1c tempest-CinderUnicodeTest-253937196 None] /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-d034785c-09c7-4b5e-ba3f-4af699887f61.info is being set with open permissions: ugo+rw Aug 03 08:54:53 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-c71fed10-7380-4c39-92ce-032ded037a1c tempest-CinderUnicodeTest-253937196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-d034785c-09c7-4b5e-ba3f-4af699887f61.info {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:54:53 devstack sudo[113670]: pam_unix(sudo:session): session closed for user root Aug 03 08:54:53 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-23b6e92b-9186-427a-9cd2-3d74557b36b9 tempest-VolumeDependencyTests-1512358985 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-4af9be76-27b6-4f10-99d7-6e37186be5c3" returned: 0 in 0.530s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:54:53 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-23b6e92b-9186-427a-9cd2-3d74557b36b9 tempest-VolumeDependencyTests-1512358985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-4af9be76-27b6-4f10-99d7-6e37186be5c3.aef7c728-4aa2-4fec-9acb-e319191de38e {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:54:53 devstack sudo[113679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-d034785c-09c7-4b5e-ba3f-4af699887f61.info Aug 03 08:54:53 devstack sudo[113679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:54:53 devstack sudo[113681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-4af9be76-27b6-4f10-99d7-6e37186be5c3.aef7c728-4aa2-4fec-9acb-e319191de38e Aug 03 08:54:53 devstack sudo[113681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:54:54 devstack sudo[113679]: pam_unix(sudo:session): session closed for user root Aug 03 08:54:54 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-c71fed10-7380-4c39-92ce-032ded037a1c tempest-CinderUnicodeTest-253937196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-d034785c-09c7-4b5e-ba3f-4af699887f61.info" returned: 0 in 0.249s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:54:54 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-c71fed10-7380-4c39-92ce-032ded037a1c tempest-CinderUnicodeTest-253937196 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.981s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:54:54 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-9a9a898a-0841-4d60-a1d6-00cb82d8ab9c tempest-ProjectReaderTests-397971060 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.659s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:54:54 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-9a9a898a-0841-4d60-a1d6-00cb82d8ab9c tempest-ProjectReaderTests-397971060 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:54:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-536354677',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4709f653-6777-424e-8cdc-edd8464db519,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a95fee59b384e1eb793d0850380c011',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:54:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:54:46Z,use_quota=True,user_id='d3e77fcfb478424d98b0b26e873c68b3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8bde7129-1dc4-42ab-b852-ab32c61b4921),volume_type_id=8bde7129-1dc4-42ab-b852-ab32c61b4921)}" {{(pid=88899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 08:54:54 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-9a9a898a-0841-4d60-a1d6-00cb82d8ab9c tempest-ProjectReaderTests-397971060 None] Creating volume 4709f653-6777-424e-8cdc-edd8464db519 {{(pid=88899) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 08:54:54 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-9a9a898a-0841-4d60-a1d6-00cb82d8ab9c tempest-ProjectReaderTests-397971060 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:54:54 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-9a9a898a-0841-4d60-a1d6-00cb82d8ab9c tempest-ProjectReaderTests-397971060 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:54:54 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-9a9a898a-0841-4d60-a1d6-00cb82d8ab9c tempest-ProjectReaderTests-397971060 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:54:54 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-9a9a898a-0841-4d60-a1d6-00cb82d8ab9c tempest-ProjectReaderTests-397971060 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:54:54 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-9a9a898a-0841-4d60-a1d6-00cb82d8ab9c tempest-ProjectReaderTests-397971060 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:54:54 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-9a9a898a-0841-4d60-a1d6-00cb82d8ab9c tempest-ProjectReaderTests-397971060 None] Selected osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385 as target Quobyte volume. {{(pid=88899) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 08:54:54 devstack cinder-volume[88899]: INFO cinder.volume.drivers.remotefs [None req-9a9a898a-0841-4d60-a1d6-00cb82d8ab9c tempest-ProjectReaderTests-397971060 None] casted to osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385 Aug 03 08:54:54 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-9a9a898a-0841-4d60-a1d6-00cb82d8ab9c tempest-ProjectReaderTests-397971060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-4709f653-6777-424e-8cdc-edd8464db519 1073741824 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:54:54 devstack sudo[113688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-4709f653-6777-424e-8cdc-edd8464db519 1073741824 Aug 03 08:54:54 devstack sudo[113688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:54:54 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-c71fed10-7380-4c39-92ce-032ded037a1c tempest-CinderUnicodeTest-253937196 None] Create snapshot completed successfully Aug 03 08:54:54 devstack sudo[113681]: pam_unix(sudo:session): session closed for user root Aug 03 08:54:54 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-23b6e92b-9186-427a-9cd2-3d74557b36b9 tempest-VolumeDependencyTests-1512358985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-4af9be76-27b6-4f10-99d7-6e37186be5c3.aef7c728-4aa2-4fec-9acb-e319191de38e" returned: 0 in 0.348s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:54:54 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-23b6e92b-9186-427a-9cd2-3d74557b36b9 tempest-VolumeDependencyTests-1512358985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-4af9be76-27b6-4f10-99d7-6e37186be5c3.aef7c728-4aa2-4fec-9acb-e319191de38e {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:54:54 devstack sudo[113690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-4af9be76-27b6-4f10-99d7-6e37186be5c3.aef7c728-4aa2-4fec-9acb-e319191de38e Aug 03 08:54:54 devstack sudo[113690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:54:54 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-d9af607a-6ee8-4ccc-9283-e77c6dfd8edf tempest-CinderUnicodeTest-253937196 None] Acquiring lock "cinder-f46fe5da-4862-465f-abfe-74bc5c78ced3-delete_snapshot" by "delete_snapshot" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:54:54 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-d9af607a-6ee8-4ccc-9283-e77c6dfd8edf tempest-CinderUnicodeTest-253937196 None] Lock "cinder-f46fe5da-4862-465f-abfe-74bc5c78ced3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:54:54 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-d9af607a-6ee8-4ccc-9283-e77c6dfd8edf tempest-CinderUnicodeTest-253937196 None] Acquiring lock "cinder-quobyte-d034785c-09c7-4b5e-ba3f-4af699887f61" by "delete_snapshot" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:54:54 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-d9af607a-6ee8-4ccc-9283-e77c6dfd8edf tempest-CinderUnicodeTest-253937196 None] Lock "cinder-quobyte-d034785c-09c7-4b5e-ba3f-4af699887f61" acquired by "delete_snapshot" :: waited 0.018s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:54:54 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-d9af607a-6ee8-4ccc-9283-e77c6dfd8edf tempest-CinderUnicodeTest-253937196 None] Acquiring lock "cinder-quobyte-f46fe5da-4862-465f-abfe-74bc5c78ced3" by "_delete_snapshot" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:54:54 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-d9af607a-6ee8-4ccc-9283-e77c6dfd8edf tempest-CinderUnicodeTest-253937196 None] Lock "cinder-quobyte-f46fe5da-4862-465f-abfe-74bc5c78ced3" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:54:54 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-d9af607a-6ee8-4ccc-9283-e77c6dfd8edf tempest-CinderUnicodeTest-253937196 None] Deleting offline snapshot f46fe5da-4862-465f-abfe-74bc5c78ced3 of volume d034785c-09c7-4b5e-ba3f-4af699887f61 {{(pid=88899) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 03 08:54:54 devstack sudo[113690]: pam_unix(sudo:session): session closed for user root Aug 03 08:54:54 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-d9af607a-6ee8-4ccc-9283-e77c6dfd8edf tempest-CinderUnicodeTest-253937196 None] snapshot_file for this snap is: volume-d034785c-09c7-4b5e-ba3f-4af699887f61.f46fe5da-4862-465f-abfe-74bc5c78ced3 {{(pid=88899) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 03 08:54:54 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-23b6e92b-9186-427a-9cd2-3d74557b36b9 tempest-VolumeDependencyTests-1512358985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-4af9be76-27b6-4f10-99d7-6e37186be5c3.aef7c728-4aa2-4fec-9acb-e319191de38e" returned: 0 in 0.267s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:54:54 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[6da87da2-7add-43a3-8f94-cc5991b8caaa]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:54:54 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-d9af607a-6ee8-4ccc-9283-e77c6dfd8edf tempest-CinderUnicodeTest-253937196 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-d034785c-09c7-4b5e-ba3f-4af699887f61.f46fe5da-4862-465f-abfe-74bc5c78ced3 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:54:54 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-23b6e92b-9186-427a-9cd2-3d74557b36b9 tempest-VolumeDependencyTests-1512358985 None] Lock "cinder-quobyte-aef7c728-4aa2-4fec-9acb-e319191de38e" released by "_delete_snapshot" :: held 1.645s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:54:54 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-23b6e92b-9186-427a-9cd2-3d74557b36b9 tempest-VolumeDependencyTests-1512358985 None] Lock "cinder-quobyte-4af9be76-27b6-4f10-99d7-6e37186be5c3" released by "delete_snapshot" :: held 1.671s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:54:54 devstack cinder-volume[88899]: DEBUG cinder.quota [None req-23b6e92b-9186-427a-9cd2-3d74557b36b9 tempest-VolumeDependencyTests-1512358985 None] Created reservations ['4b46fcf8-c878-4279-8c70-0f85da5e5048', '29fcec60-202a-48c8-9f99-4ce5449809de', '9c2fe5bf-86d6-44e7-9c80-4e764e348791', '38b441cd-9e5e-47c6-a689-6922698aafa5'] {{(pid=88899) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 08:54:54 devstack sudo[113688]: pam_unix(sudo:session): session closed for user root Aug 03 08:54:54 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-9a9a898a-0841-4d60-a1d6-00cb82d8ab9c tempest-ProjectReaderTests-397971060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-4709f653-6777-424e-8cdc-edd8464db519 1073741824" returned: 0 in 0.483s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:54:54 devstack sudo[113697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-d034785c-09c7-4b5e-ba3f-4af699887f61.f46fe5da-4862-465f-abfe-74bc5c78ced3 Aug 03 08:54:54 devstack sudo[113697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:54:54 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-9a9a898a-0841-4d60-a1d6-00cb82d8ab9c tempest-ProjectReaderTests-397971060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-4709f653-6777-424e-8cdc-edd8464db519 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:54:54 devstack sudo[113699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-4709f653-6777-424e-8cdc-edd8464db519 Aug 03 08:54:54 devstack sudo[113699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:54:54 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-23b6e92b-9186-427a-9cd2-3d74557b36b9 tempest-VolumeDependencyTests-1512358985 None] Delete snapshot completed successfully. Aug 03 08:54:54 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-23b6e92b-9186-427a-9cd2-3d74557b36b9 tempest-VolumeDependencyTests-1512358985 None] Lock "cinder-aef7c728-4aa2-4fec-9acb-e319191de38e-delete_snapshot" released by "delete_snapshot" :: held 1.863s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:54:54 devstack sudo[113697]: pam_unix(sudo:session): session closed for user root Aug 03 08:54:54 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-d9af607a-6ee8-4ccc-9283-e77c6dfd8edf tempest-CinderUnicodeTest-253937196 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-d034785c-09c7-4b5e-ba3f-4af699887f61.f46fe5da-4862-465f-abfe-74bc5c78ced3" returned: 0 in 0.381s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:54:54 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-d9af607a-6ee8-4ccc-9283-e77c6dfd8edf tempest-CinderUnicodeTest-253937196 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d034785c-09c7-4b5e-ba3f-4af699887f61(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88899) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 03 08:54:54 devstack sudo[113699]: pam_unix(sudo:session): session closed for user root Aug 03 08:54:54 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-9a9a898a-0841-4d60-a1d6-00cb82d8ab9c tempest-ProjectReaderTests-397971060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-4709f653-6777-424e-8cdc-edd8464db519" returned: 0 in 0.275s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:54:54 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-9a9a898a-0841-4d60-a1d6-00cb82d8ab9c tempest-ProjectReaderTests-397971060 None] <== create_volume: return (809ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'} {{(pid=88899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 08:54:54 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-9a9a898a-0841-4d60-a1d6-00cb82d8ab9c tempest-ProjectReaderTests-397971060 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.812s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:54:54 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-aa528a2d-d76f-418f-8117-d4c1a5647da5 tempest-ProjectMemberTests-1353074417 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.112s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:54:54 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-aa528a2d-d76f-418f-8117-d4c1a5647da5 tempest-ProjectMemberTests-1353074417 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:54:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-249367503',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=06743e1d-b45c-45e2-b01a-98e4d4c5b03d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b723e915839a4036ad739740ec4db0cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:54:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:54:54Z,use_quota=True,user_id='d9152484679b4fb79b0d8896a2a67eb9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8bde7129-1dc4-42ab-b852-ab32c61b4921),volume_type_id=8bde7129-1dc4-42ab-b852-ab32c61b4921)}" {{(pid=88899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 08:54:54 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-aa528a2d-d76f-418f-8117-d4c1a5647da5 tempest-ProjectMemberTests-1353074417 None] Creating volume 06743e1d-b45c-45e2-b01a-98e4d4c5b03d {{(pid=88899) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 08:54:54 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-aa528a2d-d76f-418f-8117-d4c1a5647da5 tempest-ProjectMemberTests-1353074417 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:54:54 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-aa528a2d-d76f-418f-8117-d4c1a5647da5 tempest-ProjectMemberTests-1353074417 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:54:54 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-aa528a2d-d76f-418f-8117-d4c1a5647da5 tempest-ProjectMemberTests-1353074417 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:54:54 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-aa528a2d-d76f-418f-8117-d4c1a5647da5 tempest-ProjectMemberTests-1353074417 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:54:54 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-aa528a2d-d76f-418f-8117-d4c1a5647da5 tempest-ProjectMemberTests-1353074417 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:54:54 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-aa528a2d-d76f-418f-8117-d4c1a5647da5 tempest-ProjectMemberTests-1353074417 None] Selected osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385 as target Quobyte volume. {{(pid=88899) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 08:54:54 devstack cinder-volume[88899]: INFO cinder.volume.drivers.remotefs [None req-aa528a2d-d76f-418f-8117-d4c1a5647da5 tempest-ProjectMemberTests-1353074417 None] casted to osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385 Aug 03 08:54:54 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-aa528a2d-d76f-418f-8117-d4c1a5647da5 tempest-ProjectMemberTests-1353074417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-06743e1d-b45c-45e2-b01a-98e4d4c5b03d 1073741824 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:54:54 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[25cb2b12-199c-47d1-91fd-1b09e27ff517]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:54:54 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-d9af607a-6ee8-4ccc-9283-e77c6dfd8edf tempest-CinderUnicodeTest-253937196 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-d034785c-09c7-4b5e-ba3f-4af699887f61 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:54:54 devstack sudo[113705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-06743e1d-b45c-45e2-b01a-98e4d4c5b03d 1073741824 Aug 03 08:54:54 devstack sudo[113705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:54:54 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-9a9a898a-0841-4d60-a1d6-00cb82d8ab9c tempest-ProjectReaderTests-397971060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (057a770a-7617-454b-b20d-67df7eceed0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4709f653-6777-424e-8cdc-edd8464db519', 'volume_size': 1}' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:54:55 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-9a9a898a-0841-4d60-a1d6-00cb82d8ab9c tempest-ProjectReaderTests-397971060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25852c2a-9834-466b-a0be-f59bf2564fbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:54:55 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-82570031-355c-43fd-9a84-f7ec1f10e45a tempest-VolumeDependencyTests-1512358985 None] Acquiring lock "cinder-4af9be76-27b6-4f10-99d7-6e37186be5c3-delete_volume" by "delete_volume" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:54:55 devstack cinder-volume[88899]: INFO cinder.volume.flows.manager.create_volume [None req-9a9a898a-0841-4d60-a1d6-00cb82d8ab9c tempest-ProjectReaderTests-397971060 None] Volume volume-4709f653-6777-424e-8cdc-edd8464db519 (4709f653-6777-424e-8cdc-edd8464db519): created successfully Aug 03 08:54:55 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-9a9a898a-0841-4d60-a1d6-00cb82d8ab9c tempest-ProjectReaderTests-397971060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25852c2a-9834-466b-a0be-f59bf2564fbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:54:55 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-9a9a898a-0841-4d60-a1d6-00cb82d8ab9c tempest-ProjectReaderTests-397971060 None] Flow 'volume_create_manager' (6914704f-324a-49f3-a243-3eb651e33703) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:54:55 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-9a9a898a-0841-4d60-a1d6-00cb82d8ab9c tempest-ProjectReaderTests-397971060 None] Created volume successfully. Aug 03 08:54:55 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-82570031-355c-43fd-9a84-f7ec1f10e45a tempest-VolumeDependencyTests-1512358985 None] Lock "cinder-4af9be76-27b6-4f10-99d7-6e37186be5c3-delete_volume" acquired by "delete_volume" :: waited 0.064s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:54:55 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-82570031-355c-43fd-9a84-f7ec1f10e45a tempest-VolumeDependencyTests-1512358985 None] Acquiring lock "cinder-quobyte-4af9be76-27b6-4f10-99d7-6e37186be5c3" by "delete_volume" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:54:55 devstack sudo[113706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-d034785c-09c7-4b5e-ba3f-4af699887f61 Aug 03 08:54:55 devstack sudo[113706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:54:55 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-82570031-355c-43fd-9a84-f7ec1f10e45a tempest-VolumeDependencyTests-1512358985 None] Lock "cinder-quobyte-4af9be76-27b6-4f10-99d7-6e37186be5c3" acquired by "delete_volume" :: waited 0.021s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:54:55 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[b79fb496-c6e4-4e1e-a68b-f8be4c84b01c]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:54:55 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-82570031-355c-43fd-9a84-f7ec1f10e45a tempest-VolumeDependencyTests-1512358985 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-4af9be76-27b6-4f10-99d7-6e37186be5c3 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:54:55 devstack sudo[113709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-4af9be76-27b6-4f10-99d7-6e37186be5c3 Aug 03 08:54:55 devstack sudo[113709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:54:55 devstack sudo[113706]: pam_unix(sudo:session): session closed for user root Aug 03 08:54:55 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-d9af607a-6ee8-4ccc-9283-e77c6dfd8edf tempest-CinderUnicodeTest-253937196 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-d034785c-09c7-4b5e-ba3f-4af699887f61" returned: 0 in 0.457s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:54:55 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-d9af607a-6ee8-4ccc-9283-e77c6dfd8edf tempest-CinderUnicodeTest-253937196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-d034785c-09c7-4b5e-ba3f-4af699887f61.f46fe5da-4862-465f-abfe-74bc5c78ced3 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:54:55 devstack sudo[113718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-d034785c-09c7-4b5e-ba3f-4af699887f61.f46fe5da-4862-465f-abfe-74bc5c78ced3 Aug 03 08:54:55 devstack sudo[113718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:54:55 devstack sudo[113705]: pam_unix(sudo:session): session closed for user root Aug 03 08:54:55 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-aa528a2d-d76f-418f-8117-d4c1a5647da5 tempest-ProjectMemberTests-1353074417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-06743e1d-b45c-45e2-b01a-98e4d4c5b03d 1073741824" returned: 0 in 0.525s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:54:55 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-aa528a2d-d76f-418f-8117-d4c1a5647da5 tempest-ProjectMemberTests-1353074417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-06743e1d-b45c-45e2-b01a-98e4d4c5b03d {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:54:55 devstack sudo[113721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-06743e1d-b45c-45e2-b01a-98e4d4c5b03d Aug 03 08:54:55 devstack sudo[113721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:54:55 devstack sudo[113709]: pam_unix(sudo:session): session closed for user root Aug 03 08:54:55 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-82570031-355c-43fd-9a84-f7ec1f10e45a tempest-VolumeDependencyTests-1512358985 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-4af9be76-27b6-4f10-99d7-6e37186be5c3" returned: 0 in 0.409s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:54:55 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-82570031-355c-43fd-9a84-f7ec1f10e45a tempest-VolumeDependencyTests-1512358985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-4af9be76-27b6-4f10-99d7-6e37186be5c3 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:54:55 devstack sudo[113725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-4af9be76-27b6-4f10-99d7-6e37186be5c3 Aug 03 08:54:55 devstack sudo[113725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:54:55 devstack sudo[113721]: pam_unix(sudo:session): session closed for user root Aug 03 08:54:55 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-aa528a2d-d76f-418f-8117-d4c1a5647da5 tempest-ProjectMemberTests-1353074417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-06743e1d-b45c-45e2-b01a-98e4d4c5b03d" returned: 0 in 0.269s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:54:55 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-aa528a2d-d76f-418f-8117-d4c1a5647da5 tempest-ProjectMemberTests-1353074417 None] <== create_volume: return (838ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'} {{(pid=88899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 08:54:55 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-aa528a2d-d76f-418f-8117-d4c1a5647da5 tempest-ProjectMemberTests-1353074417 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.843s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:54:55 devstack sudo[113718]: pam_unix(sudo:session): session closed for user root Aug 03 08:54:55 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-d9af607a-6ee8-4ccc-9283-e77c6dfd8edf tempest-CinderUnicodeTest-253937196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-d034785c-09c7-4b5e-ba3f-4af699887f61.f46fe5da-4862-465f-abfe-74bc5c78ced3" returned: 0 in 0.389s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:54:55 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-d9af607a-6ee8-4ccc-9283-e77c6dfd8edf tempest-CinderUnicodeTest-253937196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-d034785c-09c7-4b5e-ba3f-4af699887f61.f46fe5da-4862-465f-abfe-74bc5c78ced3 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:54:55 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-aa528a2d-d76f-418f-8117-d4c1a5647da5 tempest-ProjectMemberTests-1353074417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57d4817e-5390-4066-a1ae-d10cfff529a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-06743e1d-b45c-45e2-b01a-98e4d4c5b03d', 'volume_size': 1}' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:54:55 devstack sudo[113731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-d034785c-09c7-4b5e-ba3f-4af699887f61.f46fe5da-4862-465f-abfe-74bc5c78ced3 Aug 03 08:54:55 devstack sudo[113731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:54:55 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-aa528a2d-d76f-418f-8117-d4c1a5647da5 tempest-ProjectMemberTests-1353074417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be55641d-36ff-43ba-9fc1-df6b5cba0bc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:54:55 devstack sudo[113725]: pam_unix(sudo:session): session closed for user root Aug 03 08:54:55 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-82570031-355c-43fd-9a84-f7ec1f10e45a tempest-VolumeDependencyTests-1512358985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-4af9be76-27b6-4f10-99d7-6e37186be5c3" returned: 0 in 0.280s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:54:55 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-82570031-355c-43fd-9a84-f7ec1f10e45a tempest-VolumeDependencyTests-1512358985 None] Lock "cinder-quobyte-4af9be76-27b6-4f10-99d7-6e37186be5c3" released by "delete_volume" :: held 0.751s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:54:55 devstack cinder-volume[88899]: INFO cinder.volume.flows.manager.create_volume [None req-aa528a2d-d76f-418f-8117-d4c1a5647da5 tempest-ProjectMemberTests-1353074417 None] Volume volume-06743e1d-b45c-45e2-b01a-98e4d4c5b03d (06743e1d-b45c-45e2-b01a-98e4d4c5b03d): created successfully Aug 03 08:54:55 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-aa528a2d-d76f-418f-8117-d4c1a5647da5 tempest-ProjectMemberTests-1353074417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be55641d-36ff-43ba-9fc1-df6b5cba0bc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:54:55 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-aa528a2d-d76f-418f-8117-d4c1a5647da5 tempest-ProjectMemberTests-1353074417 None] Flow 'volume_create_manager' (a19210d5-195f-4201-a5d8-e0b672572aa2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:54:55 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-aa528a2d-d76f-418f-8117-d4c1a5647da5 tempest-ProjectMemberTests-1353074417 None] Created volume successfully. Aug 03 08:54:56 devstack cinder-volume[88899]: DEBUG cinder.quota [None req-82570031-355c-43fd-9a84-f7ec1f10e45a tempest-VolumeDependencyTests-1512358985 None] Created reservations ['d51548e5-fc67-4e54-b992-b821562cee2a', 'b8807f31-ee8f-4a77-9836-a6fccee92ae9', '47a523ea-db3b-4680-bcc4-a7a3e0810cb1', '1dd371bc-24e9-441d-a8bd-d53effa77992'] {{(pid=88899) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 08:54:56 devstack sudo[113731]: pam_unix(sudo:session): session closed for user root Aug 03 08:54:56 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-d9af607a-6ee8-4ccc-9283-e77c6dfd8edf tempest-CinderUnicodeTest-253937196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-d034785c-09c7-4b5e-ba3f-4af699887f61.f46fe5da-4862-465f-abfe-74bc5c78ced3" returned: 0 in 0.277s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:54:56 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-d9af607a-6ee8-4ccc-9283-e77c6dfd8edf tempest-CinderUnicodeTest-253937196 None] Lock "cinder-quobyte-f46fe5da-4862-465f-abfe-74bc5c78ced3" released by "_delete_snapshot" :: held 1.679s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:54:56 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-d9af607a-6ee8-4ccc-9283-e77c6dfd8edf tempest-CinderUnicodeTest-253937196 None] Lock "cinder-quobyte-d034785c-09c7-4b5e-ba3f-4af699887f61" released by "delete_snapshot" :: held 1.704s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:54:56 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-82570031-355c-43fd-9a84-f7ec1f10e45a tempest-VolumeDependencyTests-1512358985 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:54:56 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-82570031-355c-43fd-9a84-f7ec1f10e45a tempest-VolumeDependencyTests-1512358985 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:54:56 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-82570031-355c-43fd-9a84-f7ec1f10e45a tempest-VolumeDependencyTests-1512358985 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:54:56 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-82570031-355c-43fd-9a84-f7ec1f10e45a tempest-VolumeDependencyTests-1512358985 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:54:56 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-82570031-355c-43fd-9a84-f7ec1f10e45a tempest-VolumeDependencyTests-1512358985 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:54:56 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-82570031-355c-43fd-9a84-f7ec1f10e45a tempest-VolumeDependencyTests-1512358985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:54:56 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-cf6a76a1-7f9c-4590-8b1e-07e4882cdeb0 tempest-ProjectReaderTests-397971060 None] Acquiring lock "cinder-4709f653-6777-424e-8cdc-edd8464db519-delete_volume" by "delete_volume" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:54:56 devstack cinder-volume[88899]: DEBUG cinder.quota [None req-d9af607a-6ee8-4ccc-9283-e77c6dfd8edf tempest-CinderUnicodeTest-253937196 None] Created reservations ['92ad7752-d61d-4e36-8a7d-9a651d47cb1d', '70d9a06d-ec06-434c-bca1-3a4243b49850', 'e83f8301-8a3e-435e-87ba-3f2dd6fd2f8e', '807b05d2-88df-4626-86b7-e94aa21899e8'] {{(pid=88899) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 08:54:56 devstack sudo[113735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a Aug 03 08:54:56 devstack sudo[113735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:54:56 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-cf6a76a1-7f9c-4590-8b1e-07e4882cdeb0 tempest-ProjectReaderTests-397971060 None] Lock "cinder-4709f653-6777-424e-8cdc-edd8464db519-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:54:56 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-cf6a76a1-7f9c-4590-8b1e-07e4882cdeb0 tempest-ProjectReaderTests-397971060 None] Acquiring lock "cinder-quobyte-4709f653-6777-424e-8cdc-edd8464db519" by "delete_volume" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:54:56 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-cf6a76a1-7f9c-4590-8b1e-07e4882cdeb0 tempest-ProjectReaderTests-397971060 None] Lock "cinder-quobyte-4709f653-6777-424e-8cdc-edd8464db519" acquired by "delete_volume" :: waited 0.019s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:54:56 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[07ade3f5-06ce-43bc-b3d1-f20d0550e596]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:54:56 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-cf6a76a1-7f9c-4590-8b1e-07e4882cdeb0 tempest-ProjectReaderTests-397971060 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-4709f653-6777-424e-8cdc-edd8464db519 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:54:56 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-d9af607a-6ee8-4ccc-9283-e77c6dfd8edf tempest-CinderUnicodeTest-253937196 None] Delete snapshot completed successfully. Aug 03 08:54:56 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-d9af607a-6ee8-4ccc-9283-e77c6dfd8edf tempest-CinderUnicodeTest-253937196 None] Lock "cinder-f46fe5da-4862-465f-abfe-74bc5c78ced3-delete_snapshot" released by "delete_snapshot" :: held 1.991s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:54:56 devstack sudo[113737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-4709f653-6777-424e-8cdc-edd8464db519 Aug 03 08:54:56 devstack sudo[113737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:54:56 devstack sudo[113735]: pam_unix(sudo:session): session closed for user root Aug 03 08:54:56 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-82570031-355c-43fd-9a84-f7ec1f10e45a tempest-VolumeDependencyTests-1512358985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a" returned: 0 in 0.278s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:54:56 devstack cinder-volume[88899]: DEBUG cinder.manager [None req-82570031-355c-43fd-9a84-f7ec1f10e45a tempest-VolumeDependencyTests-1512358985 None] Notifying Schedulers of capabilities ... {{(pid=88899) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 08:54:56 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-82570031-355c-43fd-9a84-f7ec1f10e45a tempest-VolumeDependencyTests-1512358985 None] Deleted volume successfully. Aug 03 08:54:56 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-82570031-355c-43fd-9a84-f7ec1f10e45a tempest-VolumeDependencyTests-1512358985 None] Lock "cinder-4af9be76-27b6-4f10-99d7-6e37186be5c3-delete_volume" released by "delete_volume" :: held 1.463s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:54:56 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-fe6e91a8-97bb-4222-8330-a18afa75ddbf tempest-CinderUnicodeTest-253937196 None] Acquiring lock "cinder-d034785c-09c7-4b5e-ba3f-4af699887f61-delete_volume" by "delete_volume" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:54:56 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-fe6e91a8-97bb-4222-8330-a18afa75ddbf tempest-CinderUnicodeTest-253937196 None] Lock "cinder-d034785c-09c7-4b5e-ba3f-4af699887f61-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:54:56 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-fe6e91a8-97bb-4222-8330-a18afa75ddbf tempest-CinderUnicodeTest-253937196 None] Acquiring lock "cinder-quobyte-d034785c-09c7-4b5e-ba3f-4af699887f61" by "delete_volume" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:54:56 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-fe6e91a8-97bb-4222-8330-a18afa75ddbf tempest-CinderUnicodeTest-253937196 None] Lock "cinder-quobyte-d034785c-09c7-4b5e-ba3f-4af699887f61" acquired by "delete_volume" :: waited 0.014s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:54:56 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[5020e53b-23c7-47d3-b262-e39652880775]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:54:56 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-fe6e91a8-97bb-4222-8330-a18afa75ddbf tempest-CinderUnicodeTest-253937196 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-d034785c-09c7-4b5e-ba3f-4af699887f61 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:54:56 devstack sudo[113737]: pam_unix(sudo:session): session closed for user root Aug 03 08:54:56 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-cf6a76a1-7f9c-4590-8b1e-07e4882cdeb0 tempest-ProjectReaderTests-397971060 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-4709f653-6777-424e-8cdc-edd8464db519" returned: 0 in 0.394s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:54:56 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-cf6a76a1-7f9c-4590-8b1e-07e4882cdeb0 tempest-ProjectReaderTests-397971060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-4709f653-6777-424e-8cdc-edd8464db519 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:54:56 devstack sudo[113740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-d034785c-09c7-4b5e-ba3f-4af699887f61 Aug 03 08:54:56 devstack sudo[113740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:54:56 devstack sudo[113744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-4709f653-6777-424e-8cdc-edd8464db519 Aug 03 08:54:56 devstack sudo[113744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:54:57 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-914e97db-49c1-4478-9fda-4792905eada5 tempest-ProjectMemberTests-1353074417 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:54:57 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-914e97db-49c1-4478-9fda-4792905eada5 tempest-ProjectMemberTests-1353074417 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:54:57 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-914e97db-49c1-4478-9fda-4792905eada5 tempest-ProjectMemberTests-1353074417 None] Creating offline snapshot 1971de13-308d-4a5c-ac6f-3e3d13755dca of volume 06743e1d-b45c-45e2-b01a-98e4d4c5b03d {{(pid=88899) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 03 08:54:57 devstack sudo[113744]: pam_unix(sudo:session): session closed for user root Aug 03 08:54:57 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-cf6a76a1-7f9c-4590-8b1e-07e4882cdeb0 tempest-ProjectReaderTests-397971060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-4709f653-6777-424e-8cdc-edd8464db519" returned: 0 in 0.289s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:54:57 devstack sudo[113740]: pam_unix(sudo:session): session closed for user root Aug 03 08:54:57 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-fe6e91a8-97bb-4222-8330-a18afa75ddbf tempest-CinderUnicodeTest-253937196 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-d034785c-09c7-4b5e-ba3f-4af699887f61" returned: 0 in 0.404s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:54:57 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-fe6e91a8-97bb-4222-8330-a18afa75ddbf tempest-CinderUnicodeTest-253937196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-d034785c-09c7-4b5e-ba3f-4af699887f61 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:54:57 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-cf6a76a1-7f9c-4590-8b1e-07e4882cdeb0 tempest-ProjectReaderTests-397971060 None] Lock "cinder-quobyte-4709f653-6777-424e-8cdc-edd8464db519" released by "delete_volume" :: held 0.738s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:54:57 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc560633-448f-46a7-9391-a62b5dedfa3c]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:54:57 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-914e97db-49c1-4478-9fda-4792905eada5 tempest-ProjectMemberTests-1353074417 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-06743e1d-b45c-45e2-b01a-98e4d4c5b03d {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:54:57 devstack sudo[113752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-d034785c-09c7-4b5e-ba3f-4af699887f61 Aug 03 08:54:57 devstack sudo[113752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:54:57 devstack cinder-volume[88899]: DEBUG cinder.quota [None req-cf6a76a1-7f9c-4590-8b1e-07e4882cdeb0 tempest-ProjectReaderTests-397971060 None] Created reservations ['71f7a523-8298-48c9-a4a7-2e006eb48252', 'efa27431-774a-4bdd-bd61-1b67aa7a9085', 'dfe1f5ff-cd85-4719-a225-4c4b7066e7f2', 'f4bd7da0-ec77-4aa4-b6e7-94736927ee81'] {{(pid=88899) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 08:54:57 devstack sudo[113754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-06743e1d-b45c-45e2-b01a-98e4d4c5b03d Aug 03 08:54:57 devstack sudo[113754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:54:57 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-cf6a76a1-7f9c-4590-8b1e-07e4882cdeb0 tempest-ProjectReaderTests-397971060 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:54:57 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-cf6a76a1-7f9c-4590-8b1e-07e4882cdeb0 tempest-ProjectReaderTests-397971060 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:54:57 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-cf6a76a1-7f9c-4590-8b1e-07e4882cdeb0 tempest-ProjectReaderTests-397971060 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:54:57 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-cf6a76a1-7f9c-4590-8b1e-07e4882cdeb0 tempest-ProjectReaderTests-397971060 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:54:57 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-cf6a76a1-7f9c-4590-8b1e-07e4882cdeb0 tempest-ProjectReaderTests-397971060 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:54:57 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-cf6a76a1-7f9c-4590-8b1e-07e4882cdeb0 tempest-ProjectReaderTests-397971060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:54:57 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-83c48f23-772b-4ee8-8946-762e2befed75 tempest-VolumeDependencyTests-1512358985 None] Acquiring lock "cinder-f93f444e-8df8-4e1a-97ad-a3ec6f9183e5-delete_volume" by "delete_volume" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:54:57 devstack sudo[113756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a Aug 03 08:54:57 devstack sudo[113756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:54:57 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-83c48f23-772b-4ee8-8946-762e2befed75 tempest-VolumeDependencyTests-1512358985 None] Lock "cinder-f93f444e-8df8-4e1a-97ad-a3ec6f9183e5-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:54:57 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-83c48f23-772b-4ee8-8946-762e2befed75 tempest-VolumeDependencyTests-1512358985 None] Acquiring lock "cinder-quobyte-f93f444e-8df8-4e1a-97ad-a3ec6f9183e5" by "delete_volume" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:54:57 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-83c48f23-772b-4ee8-8946-762e2befed75 tempest-VolumeDependencyTests-1512358985 None] Lock "cinder-quobyte-f93f444e-8df8-4e1a-97ad-a3ec6f9183e5" acquired by "delete_volume" :: waited 0.025s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:54:57 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[c352f918-2c2f-4305-912c-53087b02ffdc]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:54:57 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-83c48f23-772b-4ee8-8946-762e2befed75 tempest-VolumeDependencyTests-1512358985 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-f93f444e-8df8-4e1a-97ad-a3ec6f9183e5 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:54:57 devstack sudo[113752]: pam_unix(sudo:session): session closed for user root Aug 03 08:54:57 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-fe6e91a8-97bb-4222-8330-a18afa75ddbf tempest-CinderUnicodeTest-253937196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-d034785c-09c7-4b5e-ba3f-4af699887f61" returned: 0 in 0.394s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:54:57 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-fe6e91a8-97bb-4222-8330-a18afa75ddbf tempest-CinderUnicodeTest-253937196 None] Lock "cinder-quobyte-d034785c-09c7-4b5e-ba3f-4af699887f61" released by "delete_volume" :: held 0.862s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:54:57 devstack sudo[113759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-f93f444e-8df8-4e1a-97ad-a3ec6f9183e5 Aug 03 08:54:57 devstack sudo[113759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:54:57 devstack cinder-volume[88899]: DEBUG cinder.quota [None req-fe6e91a8-97bb-4222-8330-a18afa75ddbf tempest-CinderUnicodeTest-253937196 None] Created reservations ['e47ba3bb-e260-4780-8587-b0caaed87f2b', 'ab5ec4c7-b9be-454b-b152-3c48289fa55d', '5bf979bd-4f68-4cab-9ac2-d3ef8f2a0fef', 'e7723b47-2b0f-4064-a16b-ffc44708e691'] {{(pid=88899) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 08:54:57 devstack sudo[113754]: pam_unix(sudo:session): session closed for user root Aug 03 08:54:57 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-914e97db-49c1-4478-9fda-4792905eada5 tempest-ProjectMemberTests-1353074417 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-06743e1d-b45c-45e2-b01a-98e4d4c5b03d" returned: 0 in 0.561s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:54:57 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-914e97db-49c1-4478-9fda-4792905eada5 tempest-ProjectMemberTests-1353074417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-06743e1d-b45c-45e2-b01a-98e4d4c5b03d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-06743e1d-b45c-45e2-b01a-98e4d4c5b03d.1971de13-308d-4a5c-ac6f-3e3d13755dca 1G {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:54:57 devstack sudo[113765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-06743e1d-b45c-45e2-b01a-98e4d4c5b03d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-06743e1d-b45c-45e2-b01a-98e4d4c5b03d.1971de13-308d-4a5c-ac6f-3e3d13755dca 1G Aug 03 08:54:57 devstack sudo[113765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:54:57 devstack sudo[113756]: pam_unix(sudo:session): session closed for user root Aug 03 08:54:57 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-cf6a76a1-7f9c-4590-8b1e-07e4882cdeb0 tempest-ProjectReaderTests-397971060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a" returned: 0 in 0.485s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:54:57 devstack cinder-volume[88899]: DEBUG cinder.manager [None req-cf6a76a1-7f9c-4590-8b1e-07e4882cdeb0 tempest-ProjectReaderTests-397971060 None] Notifying Schedulers of capabilities ... {{(pid=88899) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 08:54:57 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-cf6a76a1-7f9c-4590-8b1e-07e4882cdeb0 tempest-ProjectReaderTests-397971060 None] Deleted volume successfully. Aug 03 08:54:57 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-cf6a76a1-7f9c-4590-8b1e-07e4882cdeb0 tempest-ProjectReaderTests-397971060 None] Lock "cinder-4709f653-6777-424e-8cdc-edd8464db519-delete_volume" released by "delete_volume" :: held 1.540s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:54:57 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-fe6e91a8-97bb-4222-8330-a18afa75ddbf tempest-CinderUnicodeTest-253937196 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:54:57 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-fe6e91a8-97bb-4222-8330-a18afa75ddbf tempest-CinderUnicodeTest-253937196 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:54:57 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-fe6e91a8-97bb-4222-8330-a18afa75ddbf tempest-CinderUnicodeTest-253937196 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:54:57 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-fe6e91a8-97bb-4222-8330-a18afa75ddbf tempest-CinderUnicodeTest-253937196 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:54:57 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-fe6e91a8-97bb-4222-8330-a18afa75ddbf tempest-CinderUnicodeTest-253937196 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:54:57 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-fe6e91a8-97bb-4222-8330-a18afa75ddbf tempest-CinderUnicodeTest-253937196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:54:57 devstack sudo[113767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a Aug 03 08:54:57 devstack sudo[113767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:54:57 devstack sudo[113759]: pam_unix(sudo:session): session closed for user root Aug 03 08:54:57 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-83c48f23-772b-4ee8-8946-762e2befed75 tempest-VolumeDependencyTests-1512358985 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-f93f444e-8df8-4e1a-97ad-a3ec6f9183e5" returned: 0 in 0.537s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:54:57 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-83c48f23-772b-4ee8-8946-762e2befed75 tempest-VolumeDependencyTests-1512358985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-f93f444e-8df8-4e1a-97ad-a3ec6f9183e5 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:54:58 devstack sudo[113774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-f93f444e-8df8-4e1a-97ad-a3ec6f9183e5 Aug 03 08:54:58 devstack sudo[113774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:54:58 devstack cinder-volume[88899]: DEBUG cinder.volume.flows.manager.create_volume [None req-fbae305f-ad66-46ca-818a-0d0aed0626a6 tempest-ProjectReaderTests-397971060 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88899) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 08:54:58 devstack sudo[113767]: pam_unix(sudo:session): session closed for user root Aug 03 08:54:58 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-fbae305f-ad66-46ca-818a-0d0aed0626a6 tempest-ProjectReaderTests-397971060 None] Flow 'volume_create_manager' (bfdaa03d-2eb7-4825-9cc8-a7ec32654a02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:54:58 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-fbae305f-ad66-46ca-818a-0d0aed0626a6 tempest-ProjectReaderTests-397971060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17681c6f-56ca-4906-9de9-86dffaafb67c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:54:58 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-fe6e91a8-97bb-4222-8330-a18afa75ddbf tempest-CinderUnicodeTest-253937196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a" returned: 0 in 0.316s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:54:58 devstack cinder-volume[88899]: DEBUG cinder.manager [None req-fe6e91a8-97bb-4222-8330-a18afa75ddbf tempest-CinderUnicodeTest-253937196 None] Notifying Schedulers of capabilities ... {{(pid=88899) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 08:54:58 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-fe6e91a8-97bb-4222-8330-a18afa75ddbf tempest-CinderUnicodeTest-253937196 None] Deleted volume successfully. Aug 03 08:54:58 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-fbae305f-ad66-46ca-818a-0d0aed0626a6 tempest-ProjectReaderTests-397971060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17681c6f-56ca-4906-9de9-86dffaafb67c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:54:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-228560877',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8fd482bb-ab45-477b-b06d-335a2daa9b8e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a95fee59b384e1eb793d0850380c011',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:54:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:54:58Z,use_quota=True,user_id='d3e77fcfb478424d98b0b26e873c68b3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8bde7129-1dc4-42ab-b852-ab32c61b4921),volume_type_id=8bde7129-1dc4-42ab-b852-ab32c61b4921)' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:54:58 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-fbae305f-ad66-46ca-818a-0d0aed0626a6 tempest-ProjectReaderTests-397971060 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (70978c1b-0582-489c-ae32-243cf86f0f79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:54:58 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-fbae305f-ad66-46ca-818a-0d0aed0626a6 tempest-ProjectReaderTests-397971060 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (70978c1b-0582-489c-ae32-243cf86f0f79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:54:58 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-fbae305f-ad66-46ca-818a-0d0aed0626a6 tempest-ProjectReaderTests-397971060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (861c6105-5653-4d5d-a784-a25622f37ba8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:54:58 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-fbae305f-ad66-46ca-818a-0d0aed0626a6 tempest-ProjectReaderTests-397971060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (861c6105-5653-4d5d-a784-a25622f37ba8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8fd482bb-ab45-477b-b06d-335a2daa9b8e', 'volume_name': 'volume-8fd482bb-ab45-477b-b06d-335a2daa9b8e', 'volume_size': 1}' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:54:58 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-fbae305f-ad66-46ca-818a-0d0aed0626a6 tempest-ProjectReaderTests-397971060 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (580b25e9-9b0a-420c-b3e0-242d52308d6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:54:58 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-fbae305f-ad66-46ca-818a-0d0aed0626a6 tempest-ProjectReaderTests-397971060 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (580b25e9-9b0a-420c-b3e0-242d52308d6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:54:58 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-fbae305f-ad66-46ca-818a-0d0aed0626a6 tempest-ProjectReaderTests-397971060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (16518e83-fd23-4ad4-bb03-68dd703728cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:54:58 devstack cinder-volume[88899]: INFO cinder.volume.flows.manager.create_volume [None req-fbae305f-ad66-46ca-818a-0d0aed0626a6 tempest-ProjectReaderTests-397971060 None] Volume 8fd482bb-ab45-477b-b06d-335a2daa9b8e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8fd482bb-ab45-477b-b06d-335a2daa9b8e', 'volume_size': 1} Aug 03 08:54:58 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-fbae305f-ad66-46ca-818a-0d0aed0626a6 tempest-ProjectReaderTests-397971060 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:54:58 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-fe6e91a8-97bb-4222-8330-a18afa75ddbf tempest-CinderUnicodeTest-253937196 None] Lock "cinder-d034785c-09c7-4b5e-ba3f-4af699887f61-delete_volume" released by "delete_volume" :: held 1.656s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:54:58 devstack sudo[113765]: pam_unix(sudo:session): session closed for user root Aug 03 08:54:58 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-914e97db-49c1-4478-9fda-4792905eada5 tempest-ProjectMemberTests-1353074417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-06743e1d-b45c-45e2-b01a-98e4d4c5b03d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-06743e1d-b45c-45e2-b01a-98e4d4c5b03d.1971de13-308d-4a5c-ac6f-3e3d13755dca 1G" returned: 0 in 0.597s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:54:58 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-914e97db-49c1-4478-9fda-4792905eada5 tempest-ProjectMemberTests-1353074417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-06743e1d-b45c-45e2-b01a-98e4d4c5b03d -F qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-06743e1d-b45c-45e2-b01a-98e4d4c5b03d.1971de13-308d-4a5c-ac6f-3e3d13755dca {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:54:58 devstack sudo[113780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-06743e1d-b45c-45e2-b01a-98e4d4c5b03d -F qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-06743e1d-b45c-45e2-b01a-98e4d4c5b03d.1971de13-308d-4a5c-ac6f-3e3d13755dca Aug 03 08:54:58 devstack sudo[113780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:54:58 devstack sudo[113774]: pam_unix(sudo:session): session closed for user root Aug 03 08:54:58 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-83c48f23-772b-4ee8-8946-762e2befed75 tempest-VolumeDependencyTests-1512358985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-f93f444e-8df8-4e1a-97ad-a3ec6f9183e5" returned: 0 in 0.314s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:54:58 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-83c48f23-772b-4ee8-8946-762e2befed75 tempest-VolumeDependencyTests-1512358985 None] Lock "cinder-quobyte-f93f444e-8df8-4e1a-97ad-a3ec6f9183e5" released by "delete_volume" :: held 0.908s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:54:58 devstack cinder-volume[88899]: DEBUG cinder.quota [None req-83c48f23-772b-4ee8-8946-762e2befed75 tempest-VolumeDependencyTests-1512358985 None] Created reservations ['c55d9af4-2ba0-4356-94c4-22f7ffcf8572', '48b7ad66-20a8-42a6-923e-c50eca3a9684', '3f0221bd-1ab8-4507-ad84-d8e180dc2833', '0353d82e-06cb-4d32-9a4c-65ce045211c3'] {{(pid=88899) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 08:54:58 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-83c48f23-772b-4ee8-8946-762e2befed75 tempest-VolumeDependencyTests-1512358985 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:54:58 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-83c48f23-772b-4ee8-8946-762e2befed75 tempest-VolumeDependencyTests-1512358985 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:54:58 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-83c48f23-772b-4ee8-8946-762e2befed75 tempest-VolumeDependencyTests-1512358985 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:54:58 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-83c48f23-772b-4ee8-8946-762e2befed75 tempest-VolumeDependencyTests-1512358985 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:54:58 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-83c48f23-772b-4ee8-8946-762e2befed75 tempest-VolumeDependencyTests-1512358985 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:54:58 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-83c48f23-772b-4ee8-8946-762e2befed75 tempest-VolumeDependencyTests-1512358985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:54:58 devstack sudo[113783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a Aug 03 08:54:58 devstack sudo[113783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:54:58 devstack sudo[113780]: pam_unix(sudo:session): session closed for user root Aug 03 08:54:58 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-914e97db-49c1-4478-9fda-4792905eada5 tempest-ProjectMemberTests-1353074417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-06743e1d-b45c-45e2-b01a-98e4d4c5b03d -F qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-06743e1d-b45c-45e2-b01a-98e4d4c5b03d.1971de13-308d-4a5c-ac6f-3e3d13755dca" returned: 0 in 0.377s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:54:58 devstack cinder-volume[88899]: WARNING cinder.volume.drivers.remotefs [None req-914e97db-49c1-4478-9fda-4792905eada5 tempest-ProjectMemberTests-1353074417 None] /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-06743e1d-b45c-45e2-b01a-98e4d4c5b03d.1971de13-308d-4a5c-ac6f-3e3d13755dca is being set with open permissions: ugo+rw Aug 03 08:54:58 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-914e97db-49c1-4478-9fda-4792905eada5 tempest-ProjectMemberTests-1353074417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-06743e1d-b45c-45e2-b01a-98e4d4c5b03d.1971de13-308d-4a5c-ac6f-3e3d13755dca {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:54:58 devstack sudo[113788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-06743e1d-b45c-45e2-b01a-98e4d4c5b03d.1971de13-308d-4a5c-ac6f-3e3d13755dca Aug 03 08:54:58 devstack sudo[113788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:54:58 devstack sudo[113783]: pam_unix(sudo:session): session closed for user root Aug 03 08:54:58 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-83c48f23-772b-4ee8-8946-762e2befed75 tempest-VolumeDependencyTests-1512358985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a" returned: 0 in 0.295s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:54:58 devstack cinder-volume[88899]: DEBUG cinder.manager [None req-83c48f23-772b-4ee8-8946-762e2befed75 tempest-VolumeDependencyTests-1512358985 None] Notifying Schedulers of capabilities ... {{(pid=88899) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 08:54:58 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-83c48f23-772b-4ee8-8946-762e2befed75 tempest-VolumeDependencyTests-1512358985 None] Deleted volume successfully. Aug 03 08:54:58 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-83c48f23-772b-4ee8-8946-762e2befed75 tempest-VolumeDependencyTests-1512358985 None] Lock "cinder-f93f444e-8df8-4e1a-97ad-a3ec6f9183e5-delete_volume" released by "delete_volume" :: held 1.487s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:54:58 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-68a36b88-6bf1-4b10-8493-06b277d0dff2 tempest-CinderUnicodeTest-253937196 None] Acquiring lock "cinder-3ebdc5dc-ea07-40b7-9fd6-bf7f599848ac-delete_volume" by "delete_volume" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:54:58 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-68a36b88-6bf1-4b10-8493-06b277d0dff2 tempest-CinderUnicodeTest-253937196 None] Lock "cinder-3ebdc5dc-ea07-40b7-9fd6-bf7f599848ac-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:54:58 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-68a36b88-6bf1-4b10-8493-06b277d0dff2 tempest-CinderUnicodeTest-253937196 None] Acquiring lock "cinder-quobyte-3ebdc5dc-ea07-40b7-9fd6-bf7f599848ac" by "delete_volume" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:54:58 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-68a36b88-6bf1-4b10-8493-06b277d0dff2 tempest-CinderUnicodeTest-253937196 None] Lock "cinder-quobyte-3ebdc5dc-ea07-40b7-9fd6-bf7f599848ac" acquired by "delete_volume" :: waited 0.023s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:54:58 devstack sudo[113788]: pam_unix(sudo:session): session closed for user root Aug 03 08:54:58 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-914e97db-49c1-4478-9fda-4792905eada5 tempest-ProjectMemberTests-1353074417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-06743e1d-b45c-45e2-b01a-98e4d4c5b03d.1971de13-308d-4a5c-ac6f-3e3d13755dca" returned: 0 in 0.352s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:54:59 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[97dc5538-73d6-4b5e-b395-b49618ec56e3]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:54:59 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-68a36b88-6bf1-4b10-8493-06b277d0dff2 tempest-CinderUnicodeTest-253937196 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-3ebdc5dc-ea07-40b7-9fd6-bf7f599848ac {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:54:59 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-914e97db-49c1-4478-9fda-4792905eada5 tempest-ProjectMemberTests-1353074417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-06743e1d-b45c-45e2-b01a-98e4d4c5b03d.info {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:54:59 devstack sudo[113794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-06743e1d-b45c-45e2-b01a-98e4d4c5b03d.info Aug 03 08:54:59 devstack sudo[113794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:54:59 devstack sudo[113793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-3ebdc5dc-ea07-40b7-9fd6-bf7f599848ac Aug 03 08:54:59 devstack sudo[113793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:54:59 devstack sudo[113794]: pam_unix(sudo:session): session closed for user root Aug 03 08:54:59 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-914e97db-49c1-4478-9fda-4792905eada5 tempest-ProjectMemberTests-1353074417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-06743e1d-b45c-45e2-b01a-98e4d4c5b03d.info" returned: 0 in 0.294s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:54:59 devstack cinder-volume[88899]: WARNING cinder.volume.drivers.remotefs [None req-914e97db-49c1-4478-9fda-4792905eada5 tempest-ProjectMemberTests-1353074417 None] /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-06743e1d-b45c-45e2-b01a-98e4d4c5b03d.info is being set with open permissions: ugo+rw Aug 03 08:54:59 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-914e97db-49c1-4478-9fda-4792905eada5 tempest-ProjectMemberTests-1353074417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-06743e1d-b45c-45e2-b01a-98e4d4c5b03d.info {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:54:59 devstack sudo[113799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-06743e1d-b45c-45e2-b01a-98e4d4c5b03d.info Aug 03 08:54:59 devstack sudo[113799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:54:59 devstack sudo[113793]: pam_unix(sudo:session): session closed for user root Aug 03 08:54:59 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-68a36b88-6bf1-4b10-8493-06b277d0dff2 tempest-CinderUnicodeTest-253937196 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-3ebdc5dc-ea07-40b7-9fd6-bf7f599848ac" returned: 0 in 0.411s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:54:59 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-68a36b88-6bf1-4b10-8493-06b277d0dff2 tempest-CinderUnicodeTest-253937196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-3ebdc5dc-ea07-40b7-9fd6-bf7f599848ac {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:54:59 devstack sudo[113804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-3ebdc5dc-ea07-40b7-9fd6-bf7f599848ac Aug 03 08:54:59 devstack sudo[113804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:54:59 devstack sudo[113799]: pam_unix(sudo:session): session closed for user root Aug 03 08:54:59 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-914e97db-49c1-4478-9fda-4792905eada5 tempest-ProjectMemberTests-1353074417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-06743e1d-b45c-45e2-b01a-98e4d4c5b03d.info" returned: 0 in 0.262s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:54:59 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-914e97db-49c1-4478-9fda-4792905eada5 tempest-ProjectMemberTests-1353074417 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.576s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:54:59 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-fbae305f-ad66-46ca-818a-0d0aed0626a6 tempest-ProjectReaderTests-397971060 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.388s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:54:59 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-fbae305f-ad66-46ca-818a-0d0aed0626a6 tempest-ProjectReaderTests-397971060 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:54:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-228560877',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8fd482bb-ab45-477b-b06d-335a2daa9b8e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a95fee59b384e1eb793d0850380c011',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:54:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:54:58Z,use_quota=True,user_id='d3e77fcfb478424d98b0b26e873c68b3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8bde7129-1dc4-42ab-b852-ab32c61b4921),volume_type_id=8bde7129-1dc4-42ab-b852-ab32c61b4921)}" {{(pid=88899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 08:54:59 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-fbae305f-ad66-46ca-818a-0d0aed0626a6 tempest-ProjectReaderTests-397971060 None] Creating volume 8fd482bb-ab45-477b-b06d-335a2daa9b8e {{(pid=88899) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 08:54:59 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-fbae305f-ad66-46ca-818a-0d0aed0626a6 tempest-ProjectReaderTests-397971060 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:54:59 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-fbae305f-ad66-46ca-818a-0d0aed0626a6 tempest-ProjectReaderTests-397971060 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:54:59 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-fbae305f-ad66-46ca-818a-0d0aed0626a6 tempest-ProjectReaderTests-397971060 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:54:59 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-fbae305f-ad66-46ca-818a-0d0aed0626a6 tempest-ProjectReaderTests-397971060 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:54:59 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-fbae305f-ad66-46ca-818a-0d0aed0626a6 tempest-ProjectReaderTests-397971060 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:54:59 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-fbae305f-ad66-46ca-818a-0d0aed0626a6 tempest-ProjectReaderTests-397971060 None] Selected osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385 as target Quobyte volume. {{(pid=88899) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 08:54:59 devstack cinder-volume[88899]: INFO cinder.volume.drivers.remotefs [None req-fbae305f-ad66-46ca-818a-0d0aed0626a6 tempest-ProjectReaderTests-397971060 None] casted to osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385 Aug 03 08:54:59 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-fbae305f-ad66-46ca-818a-0d0aed0626a6 tempest-ProjectReaderTests-397971060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-8fd482bb-ab45-477b-b06d-335a2daa9b8e 1073741824 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:54:59 devstack sudo[113807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-8fd482bb-ab45-477b-b06d-335a2daa9b8e 1073741824 Aug 03 08:54:59 devstack sudo[113807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:54:59 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-914e97db-49c1-4478-9fda-4792905eada5 tempest-ProjectMemberTests-1353074417 None] Create snapshot completed successfully Aug 03 08:54:59 devstack sudo[113804]: pam_unix(sudo:session): session closed for user root Aug 03 08:54:59 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-68a36b88-6bf1-4b10-8493-06b277d0dff2 tempest-CinderUnicodeTest-253937196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-3ebdc5dc-ea07-40b7-9fd6-bf7f599848ac" returned: 0 in 0.268s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:54:59 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-68a36b88-6bf1-4b10-8493-06b277d0dff2 tempest-CinderUnicodeTest-253937196 None] Lock "cinder-quobyte-3ebdc5dc-ea07-40b7-9fd6-bf7f599848ac" released by "delete_volume" :: held 0.738s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:54:59 devstack cinder-volume[88899]: DEBUG cinder.quota [None req-68a36b88-6bf1-4b10-8493-06b277d0dff2 tempest-CinderUnicodeTest-253937196 None] Created reservations ['7cadc25a-73b7-4765-8865-01dd6e17217e', '2fd9ad69-98f3-4303-84c8-a41dc7a4ee81', 'ba3fc134-52dd-41cc-8f3c-a005d6a5c877', '42d69756-92cd-4502-9461-486eba307c4a'] {{(pid=88899) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 08:54:59 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-68a36b88-6bf1-4b10-8493-06b277d0dff2 tempest-CinderUnicodeTest-253937196 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:54:59 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-68a36b88-6bf1-4b10-8493-06b277d0dff2 tempest-CinderUnicodeTest-253937196 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:54:59 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-68a36b88-6bf1-4b10-8493-06b277d0dff2 tempest-CinderUnicodeTest-253937196 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:54:59 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-68a36b88-6bf1-4b10-8493-06b277d0dff2 tempest-CinderUnicodeTest-253937196 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:54:59 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-68a36b88-6bf1-4b10-8493-06b277d0dff2 tempest-CinderUnicodeTest-253937196 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:54:59 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-68a36b88-6bf1-4b10-8493-06b277d0dff2 tempest-CinderUnicodeTest-253937196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:54:59 devstack sudo[113810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a Aug 03 08:54:59 devstack sudo[113810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:55:00 devstack sudo[113810]: pam_unix(sudo:session): session closed for user root Aug 03 08:55:00 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-68a36b88-6bf1-4b10-8493-06b277d0dff2 tempest-CinderUnicodeTest-253937196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a" returned: 0 in 0.341s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:55:00 devstack cinder-volume[88899]: DEBUG cinder.manager [None req-68a36b88-6bf1-4b10-8493-06b277d0dff2 tempest-CinderUnicodeTest-253937196 None] Notifying Schedulers of capabilities ... {{(pid=88899) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 08:55:00 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-68a36b88-6bf1-4b10-8493-06b277d0dff2 tempest-CinderUnicodeTest-253937196 None] Deleted volume successfully. Aug 03 08:55:00 devstack sudo[113807]: pam_unix(sudo:session): session closed for user root Aug 03 08:55:00 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-fbae305f-ad66-46ca-818a-0d0aed0626a6 tempest-ProjectReaderTests-397971060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-8fd482bb-ab45-477b-b06d-335a2daa9b8e 1073741824" returned: 0 in 0.609s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:55:00 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-68a36b88-6bf1-4b10-8493-06b277d0dff2 tempest-CinderUnicodeTest-253937196 None] Lock "cinder-3ebdc5dc-ea07-40b7-9fd6-bf7f599848ac-delete_volume" released by "delete_volume" :: held 1.367s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:55:00 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-fbae305f-ad66-46ca-818a-0d0aed0626a6 tempest-ProjectReaderTests-397971060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-8fd482bb-ab45-477b-b06d-335a2daa9b8e {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:55:00 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-8e338c03-8998-4914-b11b-367e760dc169 tempest-ProjectMemberTests-1353074417 None] Acquiring lock "cinder-1971de13-308d-4a5c-ac6f-3e3d13755dca-delete_snapshot" by "delete_snapshot" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:55:00 devstack sudo[113816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-8fd482bb-ab45-477b-b06d-335a2daa9b8e Aug 03 08:55:00 devstack sudo[113816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:55:00 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-8e338c03-8998-4914-b11b-367e760dc169 tempest-ProjectMemberTests-1353074417 None] Lock "cinder-1971de13-308d-4a5c-ac6f-3e3d13755dca-delete_snapshot" acquired by "delete_snapshot" :: waited 0.041s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:55:00 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-8e338c03-8998-4914-b11b-367e760dc169 tempest-ProjectMemberTests-1353074417 None] Acquiring lock "cinder-quobyte-06743e1d-b45c-45e2-b01a-98e4d4c5b03d" by "delete_snapshot" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:55:00 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-8e338c03-8998-4914-b11b-367e760dc169 tempest-ProjectMemberTests-1353074417 None] Lock "cinder-quobyte-06743e1d-b45c-45e2-b01a-98e4d4c5b03d" acquired by "delete_snapshot" :: waited 0.020s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:55:00 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-8e338c03-8998-4914-b11b-367e760dc169 tempest-ProjectMemberTests-1353074417 None] Acquiring lock "cinder-quobyte-1971de13-308d-4a5c-ac6f-3e3d13755dca" by "_delete_snapshot" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:55:00 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-8e338c03-8998-4914-b11b-367e760dc169 tempest-ProjectMemberTests-1353074417 None] Lock "cinder-quobyte-1971de13-308d-4a5c-ac6f-3e3d13755dca" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:55:00 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-8e338c03-8998-4914-b11b-367e760dc169 tempest-ProjectMemberTests-1353074417 None] Deleting offline snapshot 1971de13-308d-4a5c-ac6f-3e3d13755dca of volume 06743e1d-b45c-45e2-b01a-98e4d4c5b03d {{(pid=88899) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 03 08:55:00 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-8e338c03-8998-4914-b11b-367e760dc169 tempest-ProjectMemberTests-1353074417 None] snapshot_file for this snap is: volume-06743e1d-b45c-45e2-b01a-98e4d4c5b03d.1971de13-308d-4a5c-ac6f-3e3d13755dca {{(pid=88899) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 03 08:55:00 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd40cb10-27c1-4aea-b257-f60cf4feb5f7]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:55:00 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-8e338c03-8998-4914-b11b-367e760dc169 tempest-ProjectMemberTests-1353074417 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-06743e1d-b45c-45e2-b01a-98e4d4c5b03d.1971de13-308d-4a5c-ac6f-3e3d13755dca {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:55:00 devstack sudo[113818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-06743e1d-b45c-45e2-b01a-98e4d4c5b03d.1971de13-308d-4a5c-ac6f-3e3d13755dca Aug 03 08:55:00 devstack sudo[113818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:55:00 devstack sudo[113816]: pam_unix(sudo:session): session closed for user root Aug 03 08:55:00 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-fbae305f-ad66-46ca-818a-0d0aed0626a6 tempest-ProjectReaderTests-397971060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-8fd482bb-ab45-477b-b06d-335a2daa9b8e" returned: 0 in 0.376s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:55:00 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-fbae305f-ad66-46ca-818a-0d0aed0626a6 tempest-ProjectReaderTests-397971060 None] <== create_volume: return (1086ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'} {{(pid=88899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 08:55:00 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-fbae305f-ad66-46ca-818a-0d0aed0626a6 tempest-ProjectReaderTests-397971060 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.090s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:55:00 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-fbae305f-ad66-46ca-818a-0d0aed0626a6 tempest-ProjectReaderTests-397971060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (16518e83-fd23-4ad4-bb03-68dd703728cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8fd482bb-ab45-477b-b06d-335a2daa9b8e', 'volume_size': 1}' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:55:00 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-fbae305f-ad66-46ca-818a-0d0aed0626a6 tempest-ProjectReaderTests-397971060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (359c0218-43ea-4953-8780-34abe892b331) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:55:00 devstack cinder-volume[88899]: INFO cinder.volume.flows.manager.create_volume [None req-fbae305f-ad66-46ca-818a-0d0aed0626a6 tempest-ProjectReaderTests-397971060 None] Volume volume-8fd482bb-ab45-477b-b06d-335a2daa9b8e (8fd482bb-ab45-477b-b06d-335a2daa9b8e): created successfully Aug 03 08:55:00 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-fbae305f-ad66-46ca-818a-0d0aed0626a6 tempest-ProjectReaderTests-397971060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (359c0218-43ea-4953-8780-34abe892b331) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:55:00 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-fbae305f-ad66-46ca-818a-0d0aed0626a6 tempest-ProjectReaderTests-397971060 None] Flow 'volume_create_manager' (bfdaa03d-2eb7-4825-9cc8-a7ec32654a02) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:55:00 devstack cinder-volume[88899]: DEBUG dbcounter [-] [88899] Writing DB stats cinder:SELECT=254,cinder:DELETE=27,cinder:UPDATE=308,cinder:INSERT=94 {{(pid=88899) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 03 08:55:00 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-fbae305f-ad66-46ca-818a-0d0aed0626a6 tempest-ProjectReaderTests-397971060 None] Created volume successfully. Aug 03 08:55:00 devstack sudo[113818]: pam_unix(sudo:session): session closed for user root Aug 03 08:55:00 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-8e338c03-8998-4914-b11b-367e760dc169 tempest-ProjectMemberTests-1353074417 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-06743e1d-b45c-45e2-b01a-98e4d4c5b03d.1971de13-308d-4a5c-ac6f-3e3d13755dca" returned: 0 in 0.445s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:55:00 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-8e338c03-8998-4914-b11b-367e760dc169 tempest-ProjectMemberTests-1353074417 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-06743e1d-b45c-45e2-b01a-98e4d4c5b03d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88899) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 03 08:55:00 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6175010-0078-4f2a-94ff-8d602baeb527]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:55:00 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-8e338c03-8998-4914-b11b-367e760dc169 tempest-ProjectMemberTests-1353074417 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-06743e1d-b45c-45e2-b01a-98e4d4c5b03d {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:55:01 devstack sudo[113825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-06743e1d-b45c-45e2-b01a-98e4d4c5b03d Aug 03 08:55:01 devstack sudo[113825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:55:01 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-728a97a6-f722-45f5-a0af-dc20789781f1 tempest-ProjectReaderTests-397971060 None] Acquiring lock "cinder-8fd482bb-ab45-477b-b06d-335a2daa9b8e-delete_volume" by "delete_volume" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:55:01 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-728a97a6-f722-45f5-a0af-dc20789781f1 tempest-ProjectReaderTests-397971060 None] Lock "cinder-8fd482bb-ab45-477b-b06d-335a2daa9b8e-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:55:01 devstack cinder-volume[88899]: DEBUG dbcounter [-] [88899] Writing DB stats cinder:UPDATE=312,cinder:SELECT=229,cinder:DELETE=27,cinder:INSERT=91 {{(pid=88899) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 03 08:55:01 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-728a97a6-f722-45f5-a0af-dc20789781f1 tempest-ProjectReaderTests-397971060 None] Acquiring lock "cinder-quobyte-8fd482bb-ab45-477b-b06d-335a2daa9b8e" by "delete_volume" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:55:01 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-728a97a6-f722-45f5-a0af-dc20789781f1 tempest-ProjectReaderTests-397971060 None] Lock "cinder-quobyte-8fd482bb-ab45-477b-b06d-335a2daa9b8e" acquired by "delete_volume" :: waited 0.025s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:55:01 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e0506f1-6d49-41e6-b0a8-deb7b7b93f02]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:55:01 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-728a97a6-f722-45f5-a0af-dc20789781f1 tempest-ProjectReaderTests-397971060 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-8fd482bb-ab45-477b-b06d-335a2daa9b8e {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:55:01 devstack sudo[113825]: pam_unix(sudo:session): session closed for user root Aug 03 08:55:01 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-8e338c03-8998-4914-b11b-367e760dc169 tempest-ProjectMemberTests-1353074417 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-06743e1d-b45c-45e2-b01a-98e4d4c5b03d" returned: 0 in 0.512s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:55:01 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-8e338c03-8998-4914-b11b-367e760dc169 tempest-ProjectMemberTests-1353074417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-06743e1d-b45c-45e2-b01a-98e4d4c5b03d.1971de13-308d-4a5c-ac6f-3e3d13755dca {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:55:01 devstack sudo[113831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-06743e1d-b45c-45e2-b01a-98e4d4c5b03d.1971de13-308d-4a5c-ac6f-3e3d13755dca Aug 03 08:55:01 devstack sudo[113831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:55:01 devstack sudo[113830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-8fd482bb-ab45-477b-b06d-335a2daa9b8e Aug 03 08:55:01 devstack sudo[113830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:55:01 devstack sudo[113831]: pam_unix(sudo:session): session closed for user root Aug 03 08:55:01 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-8e338c03-8998-4914-b11b-367e760dc169 tempest-ProjectMemberTests-1353074417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-06743e1d-b45c-45e2-b01a-98e4d4c5b03d.1971de13-308d-4a5c-ac6f-3e3d13755dca" returned: 0 in 0.442s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:55:01 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-8e338c03-8998-4914-b11b-367e760dc169 tempest-ProjectMemberTests-1353074417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-06743e1d-b45c-45e2-b01a-98e4d4c5b03d.1971de13-308d-4a5c-ac6f-3e3d13755dca {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:55:01 devstack sudo[113830]: pam_unix(sudo:session): session closed for user root Aug 03 08:55:01 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-728a97a6-f722-45f5-a0af-dc20789781f1 tempest-ProjectReaderTests-397971060 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-8fd482bb-ab45-477b-b06d-335a2daa9b8e" returned: 0 in 0.471s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:55:01 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-728a97a6-f722-45f5-a0af-dc20789781f1 tempest-ProjectReaderTests-397971060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-8fd482bb-ab45-477b-b06d-335a2daa9b8e {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:55:01 devstack sudo[113844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-06743e1d-b45c-45e2-b01a-98e4d4c5b03d.1971de13-308d-4a5c-ac6f-3e3d13755dca Aug 03 08:55:01 devstack sudo[113844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:55:01 devstack sudo[113845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-8fd482bb-ab45-477b-b06d-335a2daa9b8e Aug 03 08:55:01 devstack sudo[113845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:55:02 devstack sudo[113844]: pam_unix(sudo:session): session closed for user root Aug 03 08:55:02 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-8e338c03-8998-4914-b11b-367e760dc169 tempest-ProjectMemberTests-1353074417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-06743e1d-b45c-45e2-b01a-98e4d4c5b03d.1971de13-308d-4a5c-ac6f-3e3d13755dca" returned: 0 in 0.297s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:55:02 devstack sudo[113845]: pam_unix(sudo:session): session closed for user root Aug 03 08:55:02 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-728a97a6-f722-45f5-a0af-dc20789781f1 tempest-ProjectReaderTests-397971060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-8fd482bb-ab45-477b-b06d-335a2daa9b8e" returned: 0 in 0.322s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:55:02 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-8e338c03-8998-4914-b11b-367e760dc169 tempest-ProjectMemberTests-1353074417 None] Lock "cinder-quobyte-1971de13-308d-4a5c-ac6f-3e3d13755dca" released by "_delete_snapshot" :: held 1.857s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:55:02 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-8e338c03-8998-4914-b11b-367e760dc169 tempest-ProjectMemberTests-1353074417 None] Lock "cinder-quobyte-06743e1d-b45c-45e2-b01a-98e4d4c5b03d" released by "delete_snapshot" :: held 1.887s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:55:02 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-728a97a6-f722-45f5-a0af-dc20789781f1 tempest-ProjectReaderTests-397971060 None] Lock "cinder-quobyte-8fd482bb-ab45-477b-b06d-335a2daa9b8e" released by "delete_volume" :: held 0.863s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:55:02 devstack cinder-volume[88899]: DEBUG cinder.quota [None req-728a97a6-f722-45f5-a0af-dc20789781f1 tempest-ProjectReaderTests-397971060 None] Created reservations ['7a1efec4-4a60-48f6-ab6e-4b62b1a3b360', '423fea57-365a-4396-88d7-da03bbc4066c', 'cbeca37d-0b1e-41e2-a999-c600671146c7', 'd804dace-d820-4e41-bd12-24f1cce47b39'] {{(pid=88899) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 08:55:02 devstack cinder-volume[88899]: DEBUG cinder.quota [None req-8e338c03-8998-4914-b11b-367e760dc169 tempest-ProjectMemberTests-1353074417 None] Created reservations ['66f26f63-05b2-43bf-ae77-0d4ad24ff714', '46a4e98b-b405-43b0-95a1-dd4c7f7a04ab', 'e490dea7-e88b-466c-a9e0-74b4ae07b39d', 'b829d47c-a2c6-47e4-adea-7fb1df445137'] {{(pid=88899) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 08:55:02 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-728a97a6-f722-45f5-a0af-dc20789781f1 tempest-ProjectReaderTests-397971060 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:55:02 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-728a97a6-f722-45f5-a0af-dc20789781f1 tempest-ProjectReaderTests-397971060 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:55:02 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-728a97a6-f722-45f5-a0af-dc20789781f1 tempest-ProjectReaderTests-397971060 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:55:02 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-728a97a6-f722-45f5-a0af-dc20789781f1 tempest-ProjectReaderTests-397971060 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:55:02 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-728a97a6-f722-45f5-a0af-dc20789781f1 tempest-ProjectReaderTests-397971060 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:55:02 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-728a97a6-f722-45f5-a0af-dc20789781f1 tempest-ProjectReaderTests-397971060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:55:02 devstack sudo[113850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a Aug 03 08:55:02 devstack sudo[113850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:55:02 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-8e338c03-8998-4914-b11b-367e760dc169 tempest-ProjectMemberTests-1353074417 None] Delete snapshot completed successfully. Aug 03 08:55:02 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-8e338c03-8998-4914-b11b-367e760dc169 tempest-ProjectMemberTests-1353074417 None] Lock "cinder-1971de13-308d-4a5c-ac6f-3e3d13755dca-delete_snapshot" released by "delete_snapshot" :: held 2.183s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:55:02 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-15b1823d-cc45-4d22-ae8e-a705fb4f1bff tempest-ProjectMemberTests-1353074417 None] Acquiring lock "cinder-06743e1d-b45c-45e2-b01a-98e4d4c5b03d-delete_volume" by "delete_volume" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:55:02 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-15b1823d-cc45-4d22-ae8e-a705fb4f1bff tempest-ProjectMemberTests-1353074417 None] Lock "cinder-06743e1d-b45c-45e2-b01a-98e4d4c5b03d-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:55:02 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-15b1823d-cc45-4d22-ae8e-a705fb4f1bff tempest-ProjectMemberTests-1353074417 None] Acquiring lock "cinder-quobyte-06743e1d-b45c-45e2-b01a-98e4d4c5b03d" by "delete_volume" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:55:02 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-15b1823d-cc45-4d22-ae8e-a705fb4f1bff tempest-ProjectMemberTests-1353074417 None] Lock "cinder-quobyte-06743e1d-b45c-45e2-b01a-98e4d4c5b03d" acquired by "delete_volume" :: waited 0.023s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:55:02 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[8988310d-5f37-4b9b-86b8-74b48046f5d9]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:55:02 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-15b1823d-cc45-4d22-ae8e-a705fb4f1bff tempest-ProjectMemberTests-1353074417 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-06743e1d-b45c-45e2-b01a-98e4d4c5b03d {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:55:02 devstack sudo[113850]: pam_unix(sudo:session): session closed for user root Aug 03 08:55:02 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-728a97a6-f722-45f5-a0af-dc20789781f1 tempest-ProjectReaderTests-397971060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a" returned: 0 in 0.311s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:55:02 devstack cinder-volume[88899]: DEBUG cinder.manager [None req-728a97a6-f722-45f5-a0af-dc20789781f1 tempest-ProjectReaderTests-397971060 None] Notifying Schedulers of capabilities ... {{(pid=88899) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 08:55:02 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-728a97a6-f722-45f5-a0af-dc20789781f1 tempest-ProjectReaderTests-397971060 None] Deleted volume successfully. Aug 03 08:55:02 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-728a97a6-f722-45f5-a0af-dc20789781f1 tempest-ProjectReaderTests-397971060 None] Lock "cinder-8fd482bb-ab45-477b-b06d-335a2daa9b8e-delete_volume" released by "delete_volume" :: held 1.477s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:55:02 devstack sudo[113853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-06743e1d-b45c-45e2-b01a-98e4d4c5b03d Aug 03 08:55:02 devstack sudo[113853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:55:03 devstack sudo[113853]: pam_unix(sudo:session): session closed for user root Aug 03 08:55:03 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-15b1823d-cc45-4d22-ae8e-a705fb4f1bff tempest-ProjectMemberTests-1353074417 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-06743e1d-b45c-45e2-b01a-98e4d4c5b03d" returned: 0 in 0.414s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:55:03 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-15b1823d-cc45-4d22-ae8e-a705fb4f1bff tempest-ProjectMemberTests-1353074417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-06743e1d-b45c-45e2-b01a-98e4d4c5b03d {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:55:03 devstack sudo[113858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-06743e1d-b45c-45e2-b01a-98e4d4c5b03d Aug 03 08:55:03 devstack sudo[113858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:55:03 devstack sudo[113858]: pam_unix(sudo:session): session closed for user root Aug 03 08:55:03 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-15b1823d-cc45-4d22-ae8e-a705fb4f1bff tempest-ProjectMemberTests-1353074417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-06743e1d-b45c-45e2-b01a-98e4d4c5b03d" returned: 0 in 0.315s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:55:03 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-15b1823d-cc45-4d22-ae8e-a705fb4f1bff tempest-ProjectMemberTests-1353074417 None] Lock "cinder-quobyte-06743e1d-b45c-45e2-b01a-98e4d4c5b03d" released by "delete_volume" :: held 0.815s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:55:03 devstack cinder-volume[88899]: DEBUG cinder.quota [None req-15b1823d-cc45-4d22-ae8e-a705fb4f1bff tempest-ProjectMemberTests-1353074417 None] Created reservations ['5443e69b-e685-4c2d-affc-d4808c095697', '116d04b5-643d-4848-9754-a3180038df81', 'b2bb5737-a2cc-4c23-9d28-28e443444a60', 'bc74eaaf-1410-4218-a609-f5c0fd3af2ef'] {{(pid=88899) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 08:55:03 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-15b1823d-cc45-4d22-ae8e-a705fb4f1bff tempest-ProjectMemberTests-1353074417 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:55:03 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-15b1823d-cc45-4d22-ae8e-a705fb4f1bff tempest-ProjectMemberTests-1353074417 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:55:03 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-15b1823d-cc45-4d22-ae8e-a705fb4f1bff tempest-ProjectMemberTests-1353074417 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:55:03 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-15b1823d-cc45-4d22-ae8e-a705fb4f1bff tempest-ProjectMemberTests-1353074417 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:55:03 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-15b1823d-cc45-4d22-ae8e-a705fb4f1bff tempest-ProjectMemberTests-1353074417 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:55:03 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-15b1823d-cc45-4d22-ae8e-a705fb4f1bff tempest-ProjectMemberTests-1353074417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:55:03 devstack sudo[114015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a Aug 03 08:55:03 devstack sudo[114015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:55:04 devstack sudo[114015]: pam_unix(sudo:session): session closed for user root Aug 03 08:55:04 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-15b1823d-cc45-4d22-ae8e-a705fb4f1bff tempest-ProjectMemberTests-1353074417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a" returned: 0 in 0.441s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:55:04 devstack cinder-volume[88899]: DEBUG cinder.manager [None req-15b1823d-cc45-4d22-ae8e-a705fb4f1bff tempest-ProjectMemberTests-1353074417 None] Notifying Schedulers of capabilities ... {{(pid=88899) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 08:55:04 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-15b1823d-cc45-4d22-ae8e-a705fb4f1bff tempest-ProjectMemberTests-1353074417 None] Deleted volume successfully. Aug 03 08:55:04 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-15b1823d-cc45-4d22-ae8e-a705fb4f1bff tempest-ProjectMemberTests-1353074417 None] Lock "cinder-06743e1d-b45c-45e2-b01a-98e4d4c5b03d-delete_volume" released by "delete_volume" :: held 1.571s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:55:04 devstack cinder-volume[88899]: DEBUG cinder.volume.flows.manager.create_volume [None req-b545348a-41d8-4659-b6e1-118b35fee7ec tempest-ProjectMemberTests-1353074417 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88899) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 08:55:04 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-b545348a-41d8-4659-b6e1-118b35fee7ec tempest-ProjectMemberTests-1353074417 None] Flow 'volume_create_manager' (548bc0bf-d8c7-4880-960e-22b7f9a89045) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:55:04 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-b545348a-41d8-4659-b6e1-118b35fee7ec tempest-ProjectMemberTests-1353074417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ccfa0835-5eb3-43ec-b05b-06271e97af26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:55:04 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-b545348a-41d8-4659-b6e1-118b35fee7ec tempest-ProjectMemberTests-1353074417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ccfa0835-5eb3-43ec-b05b-06271e97af26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:55:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-557638728',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=087020ea-6077-4881-bce7-64fa89384eb1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b723e915839a4036ad739740ec4db0cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:55:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:55:05Z,use_quota=True,user_id='d9152484679b4fb79b0d8896a2a67eb9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8bde7129-1dc4-42ab-b852-ab32c61b4921),volume_type_id=8bde7129-1dc4-42ab-b852-ab32c61b4921)' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:55:04 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-b545348a-41d8-4659-b6e1-118b35fee7ec tempest-ProjectMemberTests-1353074417 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4d77e34-66c6-4944-a225-12aa768900ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:55:04 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-b545348a-41d8-4659-b6e1-118b35fee7ec tempest-ProjectMemberTests-1353074417 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4d77e34-66c6-4944-a225-12aa768900ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:55:04 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-b545348a-41d8-4659-b6e1-118b35fee7ec tempest-ProjectMemberTests-1353074417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dbd0266e-15db-4093-81dc-481d4a789303) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:55:04 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-b545348a-41d8-4659-b6e1-118b35fee7ec tempest-ProjectMemberTests-1353074417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dbd0266e-15db-4093-81dc-481d4a789303) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '087020ea-6077-4881-bce7-64fa89384eb1', 'volume_name': 'volume-087020ea-6077-4881-bce7-64fa89384eb1', 'volume_size': 1}' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:55:04 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-b545348a-41d8-4659-b6e1-118b35fee7ec tempest-ProjectMemberTests-1353074417 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1177db10-c627-4264-aad1-ba8638047c74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:55:04 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-b545348a-41d8-4659-b6e1-118b35fee7ec tempest-ProjectMemberTests-1353074417 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1177db10-c627-4264-aad1-ba8638047c74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:55:04 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-b545348a-41d8-4659-b6e1-118b35fee7ec tempest-ProjectMemberTests-1353074417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (455cacb2-fcae-4c73-8581-9a41f62197af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:55:04 devstack cinder-volume[88899]: INFO cinder.volume.flows.manager.create_volume [None req-b545348a-41d8-4659-b6e1-118b35fee7ec tempest-ProjectMemberTests-1353074417 None] Volume 087020ea-6077-4881-bce7-64fa89384eb1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-087020ea-6077-4881-bce7-64fa89384eb1', 'volume_size': 1} Aug 03 08:55:04 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-b545348a-41d8-4659-b6e1-118b35fee7ec tempest-ProjectMemberTests-1353074417 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:55:04 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-b545348a-41d8-4659-b6e1-118b35fee7ec tempest-ProjectMemberTests-1353074417 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:55:04 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-b545348a-41d8-4659-b6e1-118b35fee7ec tempest-ProjectMemberTests-1353074417 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:55:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-557638728',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=087020ea-6077-4881-bce7-64fa89384eb1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b723e915839a4036ad739740ec4db0cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:55:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:55:05Z,use_quota=True,user_id='d9152484679b4fb79b0d8896a2a67eb9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8bde7129-1dc4-42ab-b852-ab32c61b4921),volume_type_id=8bde7129-1dc4-42ab-b852-ab32c61b4921)}" {{(pid=88899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 08:55:04 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-b545348a-41d8-4659-b6e1-118b35fee7ec tempest-ProjectMemberTests-1353074417 None] Creating volume 087020ea-6077-4881-bce7-64fa89384eb1 {{(pid=88899) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 08:55:04 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-b545348a-41d8-4659-b6e1-118b35fee7ec tempest-ProjectMemberTests-1353074417 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:55:04 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-b545348a-41d8-4659-b6e1-118b35fee7ec tempest-ProjectMemberTests-1353074417 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:55:04 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-b545348a-41d8-4659-b6e1-118b35fee7ec tempest-ProjectMemberTests-1353074417 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:55:04 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-b545348a-41d8-4659-b6e1-118b35fee7ec tempest-ProjectMemberTests-1353074417 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:55:04 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-b545348a-41d8-4659-b6e1-118b35fee7ec tempest-ProjectMemberTests-1353074417 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:55:04 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-b545348a-41d8-4659-b6e1-118b35fee7ec tempest-ProjectMemberTests-1353074417 None] Selected osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385 as target Quobyte volume. {{(pid=88899) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 08:55:04 devstack cinder-volume[88899]: INFO cinder.volume.drivers.remotefs [None req-b545348a-41d8-4659-b6e1-118b35fee7ec tempest-ProjectMemberTests-1353074417 None] casted to osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385 Aug 03 08:55:04 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-b545348a-41d8-4659-b6e1-118b35fee7ec tempest-ProjectMemberTests-1353074417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-087020ea-6077-4881-bce7-64fa89384eb1 1073741824 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:55:04 devstack sudo[114193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-087020ea-6077-4881-bce7-64fa89384eb1 1073741824 Aug 03 08:55:04 devstack sudo[114193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:55:05 devstack cinder-volume[88899]: DEBUG cinder.volume.flows.manager.create_volume [None req-d7523341-b3fc-4484-9092-e87d19fb4b0e tempest-ProjectReaderTests-1134321651 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88899) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 08:55:05 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-d7523341-b3fc-4484-9092-e87d19fb4b0e tempest-ProjectReaderTests-1134321651 None] Flow 'volume_create_manager' (ff5379f9-b62f-442b-be04-895d19d699af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:55:05 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-d7523341-b3fc-4484-9092-e87d19fb4b0e tempest-ProjectReaderTests-1134321651 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b7613ce-4f6e-4e63-8cf9-a44d61660f57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:55:05 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-d7523341-b3fc-4484-9092-e87d19fb4b0e tempest-ProjectReaderTests-1134321651 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b7613ce-4f6e-4e63-8cf9-a44d61660f57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:55:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-378823712',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=58996833-a814-4849-a032-20d3659d147b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d1960effcf84b1d80da45b8e57d70f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:55:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:55:05Z,use_quota=True,user_id='552bc37e3b5740afaa307554a5a6c75f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8bde7129-1dc4-42ab-b852-ab32c61b4921),volume_type_id=8bde7129-1dc4-42ab-b852-ab32c61b4921)' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:55:05 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-d7523341-b3fc-4484-9092-e87d19fb4b0e tempest-ProjectReaderTests-1134321651 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9942464e-4ee6-4ca7-ad9e-084902d543fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:55:05 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-d7523341-b3fc-4484-9092-e87d19fb4b0e tempest-ProjectReaderTests-1134321651 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9942464e-4ee6-4ca7-ad9e-084902d543fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:55:05 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-d7523341-b3fc-4484-9092-e87d19fb4b0e tempest-ProjectReaderTests-1134321651 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (79ac827c-1a5b-440a-aff9-5f78af7c30e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:55:05 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-d7523341-b3fc-4484-9092-e87d19fb4b0e tempest-ProjectReaderTests-1134321651 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (79ac827c-1a5b-440a-aff9-5f78af7c30e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '58996833-a814-4849-a032-20d3659d147b', 'volume_name': 'volume-58996833-a814-4849-a032-20d3659d147b', 'volume_size': 1}' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:55:05 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-d7523341-b3fc-4484-9092-e87d19fb4b0e tempest-ProjectReaderTests-1134321651 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b5d08eb9-5de8-4bdd-a100-80556de2cb6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:55:05 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-d7523341-b3fc-4484-9092-e87d19fb4b0e tempest-ProjectReaderTests-1134321651 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b5d08eb9-5de8-4bdd-a100-80556de2cb6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:55:05 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-d7523341-b3fc-4484-9092-e87d19fb4b0e tempest-ProjectReaderTests-1134321651 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (17de3882-da48-46db-aef2-d16c35a062a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:55:05 devstack cinder-volume[88899]: INFO cinder.volume.flows.manager.create_volume [None req-d7523341-b3fc-4484-9092-e87d19fb4b0e tempest-ProjectReaderTests-1134321651 None] Volume 58996833-a814-4849-a032-20d3659d147b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-58996833-a814-4849-a032-20d3659d147b', 'volume_size': 1} Aug 03 08:55:05 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-d7523341-b3fc-4484-9092-e87d19fb4b0e tempest-ProjectReaderTests-1134321651 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:55:05 devstack sudo[114193]: pam_unix(sudo:session): session closed for user root Aug 03 08:55:05 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-b545348a-41d8-4659-b6e1-118b35fee7ec tempest-ProjectMemberTests-1353074417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-087020ea-6077-4881-bce7-64fa89384eb1 1073741824" returned: 0 in 0.594s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:55:05 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-b545348a-41d8-4659-b6e1-118b35fee7ec tempest-ProjectMemberTests-1353074417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-087020ea-6077-4881-bce7-64fa89384eb1 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:55:05 devstack sudo[114199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-087020ea-6077-4881-bce7-64fa89384eb1 Aug 03 08:55:05 devstack sudo[114199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:55:05 devstack sudo[114199]: pam_unix(sudo:session): session closed for user root Aug 03 08:55:05 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-b545348a-41d8-4659-b6e1-118b35fee7ec tempest-ProjectMemberTests-1353074417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-087020ea-6077-4881-bce7-64fa89384eb1" returned: 0 in 0.295s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:55:05 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-b545348a-41d8-4659-b6e1-118b35fee7ec tempest-ProjectMemberTests-1353074417 None] <== create_volume: return (955ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'} {{(pid=88899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 08:55:05 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-b545348a-41d8-4659-b6e1-118b35fee7ec tempest-ProjectMemberTests-1353074417 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.959s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:55:05 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-d7523341-b3fc-4484-9092-e87d19fb4b0e tempest-ProjectReaderTests-1134321651 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.698s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:55:05 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-d7523341-b3fc-4484-9092-e87d19fb4b0e tempest-ProjectReaderTests-1134321651 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:55:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-378823712',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=58996833-a814-4849-a032-20d3659d147b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d1960effcf84b1d80da45b8e57d70f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:55:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:55:05Z,use_quota=True,user_id='552bc37e3b5740afaa307554a5a6c75f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8bde7129-1dc4-42ab-b852-ab32c61b4921),volume_type_id=8bde7129-1dc4-42ab-b852-ab32c61b4921)}" {{(pid=88899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 08:55:05 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-d7523341-b3fc-4484-9092-e87d19fb4b0e tempest-ProjectReaderTests-1134321651 None] Creating volume 58996833-a814-4849-a032-20d3659d147b {{(pid=88899) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 08:55:05 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-d7523341-b3fc-4484-9092-e87d19fb4b0e tempest-ProjectReaderTests-1134321651 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:55:05 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-d7523341-b3fc-4484-9092-e87d19fb4b0e tempest-ProjectReaderTests-1134321651 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:55:05 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-d7523341-b3fc-4484-9092-e87d19fb4b0e tempest-ProjectReaderTests-1134321651 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:55:05 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-d7523341-b3fc-4484-9092-e87d19fb4b0e tempest-ProjectReaderTests-1134321651 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:55:05 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-d7523341-b3fc-4484-9092-e87d19fb4b0e tempest-ProjectReaderTests-1134321651 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:55:05 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-d7523341-b3fc-4484-9092-e87d19fb4b0e tempest-ProjectReaderTests-1134321651 None] Selected osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385 as target Quobyte volume. {{(pid=88899) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 08:55:05 devstack cinder-volume[88899]: INFO cinder.volume.drivers.remotefs [None req-d7523341-b3fc-4484-9092-e87d19fb4b0e tempest-ProjectReaderTests-1134321651 None] casted to osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385 Aug 03 08:55:05 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-d7523341-b3fc-4484-9092-e87d19fb4b0e tempest-ProjectReaderTests-1134321651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-58996833-a814-4849-a032-20d3659d147b 1073741824 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:55:05 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-b545348a-41d8-4659-b6e1-118b35fee7ec tempest-ProjectMemberTests-1353074417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (455cacb2-fcae-4c73-8581-9a41f62197af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-087020ea-6077-4881-bce7-64fa89384eb1', 'volume_size': 1}' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:55:05 devstack sudo[114202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-58996833-a814-4849-a032-20d3659d147b 1073741824 Aug 03 08:55:05 devstack sudo[114202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:55:05 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-b545348a-41d8-4659-b6e1-118b35fee7ec tempest-ProjectMemberTests-1353074417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (187863ae-abeb-4806-a0c0-573adc9bd0b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:55:05 devstack cinder-volume[88899]: INFO cinder.volume.flows.manager.create_volume [None req-b545348a-41d8-4659-b6e1-118b35fee7ec tempest-ProjectMemberTests-1353074417 None] Volume volume-087020ea-6077-4881-bce7-64fa89384eb1 (087020ea-6077-4881-bce7-64fa89384eb1): created successfully Aug 03 08:55:05 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-b545348a-41d8-4659-b6e1-118b35fee7ec tempest-ProjectMemberTests-1353074417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (187863ae-abeb-4806-a0c0-573adc9bd0b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:55:05 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-b545348a-41d8-4659-b6e1-118b35fee7ec tempest-ProjectMemberTests-1353074417 None] Flow 'volume_create_manager' (548bc0bf-d8c7-4880-960e-22b7f9a89045) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:55:05 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-b545348a-41d8-4659-b6e1-118b35fee7ec tempest-ProjectMemberTests-1353074417 None] Created volume successfully. Aug 03 08:55:06 devstack sudo[114202]: pam_unix(sudo:session): session closed for user root Aug 03 08:55:06 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-d7523341-b3fc-4484-9092-e87d19fb4b0e tempest-ProjectReaderTests-1134321651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-58996833-a814-4849-a032-20d3659d147b 1073741824" returned: 0 in 0.514s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:55:06 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-d7523341-b3fc-4484-9092-e87d19fb4b0e tempest-ProjectReaderTests-1134321651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-58996833-a814-4849-a032-20d3659d147b {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:55:06 devstack sudo[114207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-58996833-a814-4849-a032-20d3659d147b Aug 03 08:55:06 devstack sudo[114207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:55:06 devstack sudo[114207]: pam_unix(sudo:session): session closed for user root Aug 03 08:55:06 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-d7523341-b3fc-4484-9092-e87d19fb4b0e tempest-ProjectReaderTests-1134321651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-58996833-a814-4849-a032-20d3659d147b" returned: 0 in 0.324s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:55:06 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-d7523341-b3fc-4484-9092-e87d19fb4b0e tempest-ProjectReaderTests-1134321651 None] <== create_volume: return (888ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'} {{(pid=88899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 08:55:06 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-d7523341-b3fc-4484-9092-e87d19fb4b0e tempest-ProjectReaderTests-1134321651 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.891s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:55:06 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-d7523341-b3fc-4484-9092-e87d19fb4b0e tempest-ProjectReaderTests-1134321651 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (17de3882-da48-46db-aef2-d16c35a062a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-58996833-a814-4849-a032-20d3659d147b', 'volume_size': 1}' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:55:06 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-d7523341-b3fc-4484-9092-e87d19fb4b0e tempest-ProjectReaderTests-1134321651 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a731725-c3a5-4671-bab5-a73f590b11df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:55:06 devstack cinder-volume[88899]: INFO cinder.volume.flows.manager.create_volume [None req-d7523341-b3fc-4484-9092-e87d19fb4b0e tempest-ProjectReaderTests-1134321651 None] Volume volume-58996833-a814-4849-a032-20d3659d147b (58996833-a814-4849-a032-20d3659d147b): created successfully Aug 03 08:55:06 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-d7523341-b3fc-4484-9092-e87d19fb4b0e tempest-ProjectReaderTests-1134321651 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a731725-c3a5-4671-bab5-a73f590b11df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:55:06 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-d7523341-b3fc-4484-9092-e87d19fb4b0e tempest-ProjectReaderTests-1134321651 None] Flow 'volume_create_manager' (ff5379f9-b62f-442b-be04-895d19d699af) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:55:06 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-d7523341-b3fc-4484-9092-e87d19fb4b0e tempest-ProjectReaderTests-1134321651 None] Created volume successfully. Aug 03 08:55:07 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-6317c6b3-bce8-4479-8ab7-0f32758fb965 tempest-ProjectMemberTests-1353074417 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:55:07 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-6317c6b3-bce8-4479-8ab7-0f32758fb965 tempest-ProjectMemberTests-1353074417 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:55:07 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-6317c6b3-bce8-4479-8ab7-0f32758fb965 tempest-ProjectMemberTests-1353074417 None] Creating offline snapshot f3c54a69-2434-48d6-a385-367fce046df4 of volume 087020ea-6077-4881-bce7-64fa89384eb1 {{(pid=88899) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 03 08:55:07 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[f98659b7-41cd-4fc7-bc13-cec0325cf3db]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:55:07 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-6317c6b3-bce8-4479-8ab7-0f32758fb965 tempest-ProjectMemberTests-1353074417 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-087020ea-6077-4881-bce7-64fa89384eb1 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:55:07 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-38c5b9d2-e11c-4a0a-899f-d88b7972d9dc tempest-ProjectReaderTests-1134321651 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:55:07 devstack sudo[114210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-087020ea-6077-4881-bce7-64fa89384eb1 Aug 03 08:55:07 devstack sudo[114210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:55:07 devstack sudo[114210]: pam_unix(sudo:session): session closed for user root Aug 03 08:55:07 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-6317c6b3-bce8-4479-8ab7-0f32758fb965 tempest-ProjectMemberTests-1353074417 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-087020ea-6077-4881-bce7-64fa89384eb1" returned: 0 in 0.504s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:55:07 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-6317c6b3-bce8-4479-8ab7-0f32758fb965 tempest-ProjectMemberTests-1353074417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-087020ea-6077-4881-bce7-64fa89384eb1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-087020ea-6077-4881-bce7-64fa89384eb1.f3c54a69-2434-48d6-a385-367fce046df4 1G {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:55:07 devstack sudo[114215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-087020ea-6077-4881-bce7-64fa89384eb1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-087020ea-6077-4881-bce7-64fa89384eb1.f3c54a69-2434-48d6-a385-367fce046df4 1G Aug 03 08:55:07 devstack sudo[114215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:55:08 devstack sudo[114215]: pam_unix(sudo:session): session closed for user root Aug 03 08:55:08 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-6317c6b3-bce8-4479-8ab7-0f32758fb965 tempest-ProjectMemberTests-1353074417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-087020ea-6077-4881-bce7-64fa89384eb1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-087020ea-6077-4881-bce7-64fa89384eb1.f3c54a69-2434-48d6-a385-367fce046df4 1G" returned: 0 in 0.514s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:55:08 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-6317c6b3-bce8-4479-8ab7-0f32758fb965 tempest-ProjectMemberTests-1353074417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-087020ea-6077-4881-bce7-64fa89384eb1 -F qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-087020ea-6077-4881-bce7-64fa89384eb1.f3c54a69-2434-48d6-a385-367fce046df4 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:55:08 devstack sudo[114254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-087020ea-6077-4881-bce7-64fa89384eb1 -F qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-087020ea-6077-4881-bce7-64fa89384eb1.f3c54a69-2434-48d6-a385-367fce046df4 Aug 03 08:55:08 devstack sudo[114254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:55:08 devstack sudo[114254]: pam_unix(sudo:session): session closed for user root Aug 03 08:55:08 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-6317c6b3-bce8-4479-8ab7-0f32758fb965 tempest-ProjectMemberTests-1353074417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-087020ea-6077-4881-bce7-64fa89384eb1 -F qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-087020ea-6077-4881-bce7-64fa89384eb1.f3c54a69-2434-48d6-a385-367fce046df4" returned: 0 in 0.406s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:55:08 devstack cinder-volume[88899]: WARNING cinder.volume.drivers.remotefs [None req-6317c6b3-bce8-4479-8ab7-0f32758fb965 tempest-ProjectMemberTests-1353074417 None] /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-087020ea-6077-4881-bce7-64fa89384eb1.f3c54a69-2434-48d6-a385-367fce046df4 is being set with open permissions: ugo+rw Aug 03 08:55:08 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-6317c6b3-bce8-4479-8ab7-0f32758fb965 tempest-ProjectMemberTests-1353074417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-087020ea-6077-4881-bce7-64fa89384eb1.f3c54a69-2434-48d6-a385-367fce046df4 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:55:08 devstack sudo[114262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-087020ea-6077-4881-bce7-64fa89384eb1.f3c54a69-2434-48d6-a385-367fce046df4 Aug 03 08:55:08 devstack sudo[114262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:55:08 devstack sudo[114262]: pam_unix(sudo:session): session closed for user root Aug 03 08:55:08 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-6317c6b3-bce8-4479-8ab7-0f32758fb965 tempest-ProjectMemberTests-1353074417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-087020ea-6077-4881-bce7-64fa89384eb1.f3c54a69-2434-48d6-a385-367fce046df4" returned: 0 in 0.268s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:55:08 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-6317c6b3-bce8-4479-8ab7-0f32758fb965 tempest-ProjectMemberTests-1353074417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-087020ea-6077-4881-bce7-64fa89384eb1.info {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:55:08 devstack sudo[114266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-087020ea-6077-4881-bce7-64fa89384eb1.info Aug 03 08:55:08 devstack sudo[114266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:55:09 devstack sudo[114266]: pam_unix(sudo:session): session closed for user root Aug 03 08:55:09 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-6317c6b3-bce8-4479-8ab7-0f32758fb965 tempest-ProjectMemberTests-1353074417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-087020ea-6077-4881-bce7-64fa89384eb1.info" returned: 0 in 0.331s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:55:09 devstack cinder-volume[88899]: WARNING cinder.volume.drivers.remotefs [None req-6317c6b3-bce8-4479-8ab7-0f32758fb965 tempest-ProjectMemberTests-1353074417 None] /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-087020ea-6077-4881-bce7-64fa89384eb1.info is being set with open permissions: ugo+rw Aug 03 08:55:09 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-6317c6b3-bce8-4479-8ab7-0f32758fb965 tempest-ProjectMemberTests-1353074417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-087020ea-6077-4881-bce7-64fa89384eb1.info {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:55:09 devstack sudo[114269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-087020ea-6077-4881-bce7-64fa89384eb1.info Aug 03 08:55:09 devstack sudo[114269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:55:09 devstack sudo[114269]: pam_unix(sudo:session): session closed for user root Aug 03 08:55:09 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-6317c6b3-bce8-4479-8ab7-0f32758fb965 tempest-ProjectMemberTests-1353074417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-087020ea-6077-4881-bce7-64fa89384eb1.info" returned: 0 in 0.293s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:55:09 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-6317c6b3-bce8-4479-8ab7-0f32758fb965 tempest-ProjectMemberTests-1353074417 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.412s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:55:09 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-38c5b9d2-e11c-4a0a-899f-d88b7972d9dc tempest-ProjectReaderTests-1134321651 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.236s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:55:09 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-38c5b9d2-e11c-4a0a-899f-d88b7972d9dc tempest-ProjectReaderTests-1134321651 None] Creating offline snapshot e258f50d-1c05-435f-95d8-5b8c945ff667 of volume 58996833-a814-4849-a032-20d3659d147b {{(pid=88899) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 03 08:55:09 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-6317c6b3-bce8-4479-8ab7-0f32758fb965 tempest-ProjectMemberTests-1353074417 None] Create snapshot completed successfully Aug 03 08:55:09 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[39266860-1482-4f7a-93ff-995b28af9df4]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:55:09 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-38c5b9d2-e11c-4a0a-899f-d88b7972d9dc tempest-ProjectReaderTests-1134321651 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-58996833-a814-4849-a032-20d3659d147b {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:55:09 devstack sudo[114272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-58996833-a814-4849-a032-20d3659d147b Aug 03 08:55:09 devstack sudo[114272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:55:09 devstack sudo[114272]: pam_unix(sudo:session): session closed for user root Aug 03 08:55:09 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-38c5b9d2-e11c-4a0a-899f-d88b7972d9dc tempest-ProjectReaderTests-1134321651 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-58996833-a814-4849-a032-20d3659d147b" returned: 0 in 0.405s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:55:09 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-38c5b9d2-e11c-4a0a-899f-d88b7972d9dc tempest-ProjectReaderTests-1134321651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-58996833-a814-4849-a032-20d3659d147b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-58996833-a814-4849-a032-20d3659d147b.e258f50d-1c05-435f-95d8-5b8c945ff667 1G {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:55:09 devstack sudo[114277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-58996833-a814-4849-a032-20d3659d147b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-58996833-a814-4849-a032-20d3659d147b.e258f50d-1c05-435f-95d8-5b8c945ff667 1G Aug 03 08:55:09 devstack sudo[114277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:55:10 devstack sudo[114277]: pam_unix(sudo:session): session closed for user root Aug 03 08:55:10 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-38c5b9d2-e11c-4a0a-899f-d88b7972d9dc tempest-ProjectReaderTests-1134321651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-58996833-a814-4849-a032-20d3659d147b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-58996833-a814-4849-a032-20d3659d147b.e258f50d-1c05-435f-95d8-5b8c945ff667 1G" returned: 0 in 0.605s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:55:10 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-38c5b9d2-e11c-4a0a-899f-d88b7972d9dc tempest-ProjectReaderTests-1134321651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-58996833-a814-4849-a032-20d3659d147b -F qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-58996833-a814-4849-a032-20d3659d147b.e258f50d-1c05-435f-95d8-5b8c945ff667 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:55:10 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-8f0f378e-21ca-4d18-ae75-af7b9bf5d715 tempest-ProjectMemberTests-1353074417 None] Acquiring lock "cinder-f3c54a69-2434-48d6-a385-367fce046df4-delete_snapshot" by "delete_snapshot" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:55:10 devstack sudo[114282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-58996833-a814-4849-a032-20d3659d147b -F qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-58996833-a814-4849-a032-20d3659d147b.e258f50d-1c05-435f-95d8-5b8c945ff667 Aug 03 08:55:10 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-8f0f378e-21ca-4d18-ae75-af7b9bf5d715 tempest-ProjectMemberTests-1353074417 None] Lock "cinder-f3c54a69-2434-48d6-a385-367fce046df4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:55:10 devstack sudo[114282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:55:10 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-8f0f378e-21ca-4d18-ae75-af7b9bf5d715 tempest-ProjectMemberTests-1353074417 None] Acquiring lock "cinder-quobyte-087020ea-6077-4881-bce7-64fa89384eb1" by "delete_snapshot" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:55:10 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-8f0f378e-21ca-4d18-ae75-af7b9bf5d715 tempest-ProjectMemberTests-1353074417 None] Lock "cinder-quobyte-087020ea-6077-4881-bce7-64fa89384eb1" acquired by "delete_snapshot" :: waited 0.029s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:55:10 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-8f0f378e-21ca-4d18-ae75-af7b9bf5d715 tempest-ProjectMemberTests-1353074417 None] Acquiring lock "cinder-quobyte-f3c54a69-2434-48d6-a385-367fce046df4" by "_delete_snapshot" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:55:10 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-8f0f378e-21ca-4d18-ae75-af7b9bf5d715 tempest-ProjectMemberTests-1353074417 None] Lock "cinder-quobyte-f3c54a69-2434-48d6-a385-367fce046df4" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:55:10 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-8f0f378e-21ca-4d18-ae75-af7b9bf5d715 tempest-ProjectMemberTests-1353074417 None] Deleting offline snapshot f3c54a69-2434-48d6-a385-367fce046df4 of volume 087020ea-6077-4881-bce7-64fa89384eb1 {{(pid=88899) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 03 08:55:10 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-8f0f378e-21ca-4d18-ae75-af7b9bf5d715 tempest-ProjectMemberTests-1353074417 None] snapshot_file for this snap is: volume-087020ea-6077-4881-bce7-64fa89384eb1.f3c54a69-2434-48d6-a385-367fce046df4 {{(pid=88899) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 03 08:55:10 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[36df6ecf-2eda-4534-98b9-2f230cbb2691]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:55:10 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-8f0f378e-21ca-4d18-ae75-af7b9bf5d715 tempest-ProjectMemberTests-1353074417 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-087020ea-6077-4881-bce7-64fa89384eb1.f3c54a69-2434-48d6-a385-367fce046df4 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:55:10 devstack sudo[114284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-087020ea-6077-4881-bce7-64fa89384eb1.f3c54a69-2434-48d6-a385-367fce046df4 Aug 03 08:55:10 devstack sudo[114284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:55:10 devstack sudo[114282]: pam_unix(sudo:session): session closed for user root Aug 03 08:55:10 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-38c5b9d2-e11c-4a0a-899f-d88b7972d9dc tempest-ProjectReaderTests-1134321651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-58996833-a814-4849-a032-20d3659d147b -F qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-58996833-a814-4849-a032-20d3659d147b.e258f50d-1c05-435f-95d8-5b8c945ff667" returned: 0 in 0.432s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:55:10 devstack cinder-volume[88899]: WARNING cinder.volume.drivers.remotefs [None req-38c5b9d2-e11c-4a0a-899f-d88b7972d9dc tempest-ProjectReaderTests-1134321651 None] /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-58996833-a814-4849-a032-20d3659d147b.e258f50d-1c05-435f-95d8-5b8c945ff667 is being set with open permissions: ugo+rw Aug 03 08:55:10 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-38c5b9d2-e11c-4a0a-899f-d88b7972d9dc tempest-ProjectReaderTests-1134321651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-58996833-a814-4849-a032-20d3659d147b.e258f50d-1c05-435f-95d8-5b8c945ff667 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:55:11 devstack sudo[114290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-58996833-a814-4849-a032-20d3659d147b.e258f50d-1c05-435f-95d8-5b8c945ff667 Aug 03 08:55:11 devstack sudo[114290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:55:11 devstack sudo[114284]: pam_unix(sudo:session): session closed for user root Aug 03 08:55:11 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-8f0f378e-21ca-4d18-ae75-af7b9bf5d715 tempest-ProjectMemberTests-1353074417 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-087020ea-6077-4881-bce7-64fa89384eb1.f3c54a69-2434-48d6-a385-367fce046df4" returned: 0 in 0.411s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:55:11 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-8f0f378e-21ca-4d18-ae75-af7b9bf5d715 tempest-ProjectMemberTests-1353074417 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-087020ea-6077-4881-bce7-64fa89384eb1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88899) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 03 08:55:11 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7f98137-7c50-40ae-8cb2-44df552683c1]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:55:11 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-8f0f378e-21ca-4d18-ae75-af7b9bf5d715 tempest-ProjectMemberTests-1353074417 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-087020ea-6077-4881-bce7-64fa89384eb1 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:55:11 devstack sudo[114290]: pam_unix(sudo:session): session closed for user root Aug 03 08:55:11 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-38c5b9d2-e11c-4a0a-899f-d88b7972d9dc tempest-ProjectReaderTests-1134321651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-58996833-a814-4849-a032-20d3659d147b.e258f50d-1c05-435f-95d8-5b8c945ff667" returned: 0 in 0.240s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:55:11 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-38c5b9d2-e11c-4a0a-899f-d88b7972d9dc tempest-ProjectReaderTests-1134321651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-58996833-a814-4849-a032-20d3659d147b.info {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:55:11 devstack sudo[114297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-58996833-a814-4849-a032-20d3659d147b.info Aug 03 08:55:11 devstack sudo[114297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:55:11 devstack sudo[114296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-087020ea-6077-4881-bce7-64fa89384eb1 Aug 03 08:55:11 devstack sudo[114296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:55:11 devstack sudo[114297]: pam_unix(sudo:session): session closed for user root Aug 03 08:55:11 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-38c5b9d2-e11c-4a0a-899f-d88b7972d9dc tempest-ProjectReaderTests-1134321651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-58996833-a814-4849-a032-20d3659d147b.info" returned: 0 in 0.281s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:55:11 devstack cinder-volume[88899]: WARNING cinder.volume.drivers.remotefs [None req-38c5b9d2-e11c-4a0a-899f-d88b7972d9dc tempest-ProjectReaderTests-1134321651 None] /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-58996833-a814-4849-a032-20d3659d147b.info is being set with open permissions: ugo+rw Aug 03 08:55:11 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-38c5b9d2-e11c-4a0a-899f-d88b7972d9dc tempest-ProjectReaderTests-1134321651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-58996833-a814-4849-a032-20d3659d147b.info {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:55:11 devstack sudo[114296]: pam_unix(sudo:session): session closed for user root Aug 03 08:55:11 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-8f0f378e-21ca-4d18-ae75-af7b9bf5d715 tempest-ProjectMemberTests-1353074417 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-087020ea-6077-4881-bce7-64fa89384eb1" returned: 0 in 0.388s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:55:11 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-8f0f378e-21ca-4d18-ae75-af7b9bf5d715 tempest-ProjectMemberTests-1353074417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-087020ea-6077-4881-bce7-64fa89384eb1.f3c54a69-2434-48d6-a385-367fce046df4 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:55:11 devstack sudo[114304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-58996833-a814-4849-a032-20d3659d147b.info Aug 03 08:55:11 devstack sudo[114304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:55:11 devstack sudo[114306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-087020ea-6077-4881-bce7-64fa89384eb1.f3c54a69-2434-48d6-a385-367fce046df4 Aug 03 08:55:11 devstack sudo[114306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:55:11 devstack sudo[114304]: pam_unix(sudo:session): session closed for user root Aug 03 08:55:11 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-38c5b9d2-e11c-4a0a-899f-d88b7972d9dc tempest-ProjectReaderTests-1134321651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-58996833-a814-4849-a032-20d3659d147b.info" returned: 0 in 0.358s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:55:11 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-38c5b9d2-e11c-4a0a-899f-d88b7972d9dc tempest-ProjectReaderTests-1134321651 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.454s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:55:11 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-38c5b9d2-e11c-4a0a-899f-d88b7972d9dc tempest-ProjectReaderTests-1134321651 None] Create snapshot completed successfully Aug 03 08:55:12 devstack sudo[114306]: pam_unix(sudo:session): session closed for user root Aug 03 08:55:12 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-8f0f378e-21ca-4d18-ae75-af7b9bf5d715 tempest-ProjectMemberTests-1353074417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-087020ea-6077-4881-bce7-64fa89384eb1.f3c54a69-2434-48d6-a385-367fce046df4" returned: 0 in 0.515s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:55:12 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-8f0f378e-21ca-4d18-ae75-af7b9bf5d715 tempest-ProjectMemberTests-1353074417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-087020ea-6077-4881-bce7-64fa89384eb1.f3c54a69-2434-48d6-a385-367fce046df4 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:55:12 devstack sudo[114313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-087020ea-6077-4881-bce7-64fa89384eb1.f3c54a69-2434-48d6-a385-367fce046df4 Aug 03 08:55:12 devstack sudo[114313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:55:12 devstack sudo[114313]: pam_unix(sudo:session): session closed for user root Aug 03 08:55:12 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-8f0f378e-21ca-4d18-ae75-af7b9bf5d715 tempest-ProjectMemberTests-1353074417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-087020ea-6077-4881-bce7-64fa89384eb1.f3c54a69-2434-48d6-a385-367fce046df4" returned: 0 in 0.289s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:55:12 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-8f0f378e-21ca-4d18-ae75-af7b9bf5d715 tempest-ProjectMemberTests-1353074417 None] Lock "cinder-quobyte-f3c54a69-2434-48d6-a385-367fce046df4" released by "_delete_snapshot" :: held 1.723s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:55:12 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-8f0f378e-21ca-4d18-ae75-af7b9bf5d715 tempest-ProjectMemberTests-1353074417 None] Lock "cinder-quobyte-087020ea-6077-4881-bce7-64fa89384eb1" released by "delete_snapshot" :: held 1.761s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:55:12 devstack cinder-volume[88899]: DEBUG cinder.quota [None req-8f0f378e-21ca-4d18-ae75-af7b9bf5d715 tempest-ProjectMemberTests-1353074417 None] Created reservations ['6696a008-8366-414b-ab94-3979a4d7738b', '05b2376a-416b-4560-9801-306f5aae7f74', '09d5dbf5-d0d1-449f-8163-990090950583', '48af85e5-23ab-4023-a722-5decfa1d435c'] {{(pid=88899) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 08:55:12 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-8f0f378e-21ca-4d18-ae75-af7b9bf5d715 tempest-ProjectMemberTests-1353074417 None] Delete snapshot completed successfully. Aug 03 08:55:12 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-8f0f378e-21ca-4d18-ae75-af7b9bf5d715 tempest-ProjectMemberTests-1353074417 None] Lock "cinder-f3c54a69-2434-48d6-a385-367fce046df4-delete_snapshot" released by "delete_snapshot" :: held 2.072s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:55:12 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-0d0c1a6d-17b2-4350-a4c9-71f5a1647180 tempest-ProjectReaderTests-1134321651 None] Acquiring lock "cinder-e258f50d-1c05-435f-95d8-5b8c945ff667-delete_snapshot" by "delete_snapshot" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:55:12 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-0d0c1a6d-17b2-4350-a4c9-71f5a1647180 tempest-ProjectReaderTests-1134321651 None] Lock "cinder-e258f50d-1c05-435f-95d8-5b8c945ff667-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:55:12 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-0d0c1a6d-17b2-4350-a4c9-71f5a1647180 tempest-ProjectReaderTests-1134321651 None] Acquiring lock "cinder-quobyte-58996833-a814-4849-a032-20d3659d147b" by "delete_snapshot" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:55:13 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-0d0c1a6d-17b2-4350-a4c9-71f5a1647180 tempest-ProjectReaderTests-1134321651 None] Lock "cinder-quobyte-58996833-a814-4849-a032-20d3659d147b" acquired by "delete_snapshot" :: waited 0.030s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:55:13 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-0d0c1a6d-17b2-4350-a4c9-71f5a1647180 tempest-ProjectReaderTests-1134321651 None] Acquiring lock "cinder-quobyte-e258f50d-1c05-435f-95d8-5b8c945ff667" by "_delete_snapshot" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:55:13 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-0d0c1a6d-17b2-4350-a4c9-71f5a1647180 tempest-ProjectReaderTests-1134321651 None] Lock "cinder-quobyte-e258f50d-1c05-435f-95d8-5b8c945ff667" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:55:13 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-0d0c1a6d-17b2-4350-a4c9-71f5a1647180 tempest-ProjectReaderTests-1134321651 None] Deleting offline snapshot e258f50d-1c05-435f-95d8-5b8c945ff667 of volume 58996833-a814-4849-a032-20d3659d147b {{(pid=88899) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 03 08:55:13 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-0d0c1a6d-17b2-4350-a4c9-71f5a1647180 tempest-ProjectReaderTests-1134321651 None] snapshot_file for this snap is: volume-58996833-a814-4849-a032-20d3659d147b.e258f50d-1c05-435f-95d8-5b8c945ff667 {{(pid=88899) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 03 08:55:13 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-f0f15300-085c-42d2-8cc1-2b489998a6cc tempest-ProjectMemberTests-1353074417 None] Acquiring lock "cinder-087020ea-6077-4881-bce7-64fa89384eb1-delete_volume" by "delete_volume" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:55:13 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[c20406e6-7a94-4183-b36c-dc714153de34]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:55:13 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-0d0c1a6d-17b2-4350-a4c9-71f5a1647180 tempest-ProjectReaderTests-1134321651 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-58996833-a814-4849-a032-20d3659d147b.e258f50d-1c05-435f-95d8-5b8c945ff667 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:55:13 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-f0f15300-085c-42d2-8cc1-2b489998a6cc tempest-ProjectMemberTests-1353074417 None] Lock "cinder-087020ea-6077-4881-bce7-64fa89384eb1-delete_volume" acquired by "delete_volume" :: waited 0.080s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:55:13 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-f0f15300-085c-42d2-8cc1-2b489998a6cc tempest-ProjectMemberTests-1353074417 None] Acquiring lock "cinder-quobyte-087020ea-6077-4881-bce7-64fa89384eb1" by "delete_volume" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:55:13 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-f0f15300-085c-42d2-8cc1-2b489998a6cc tempest-ProjectMemberTests-1353074417 None] Lock "cinder-quobyte-087020ea-6077-4881-bce7-64fa89384eb1" acquired by "delete_volume" :: waited 0.030s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:55:13 devstack sudo[114322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-58996833-a814-4849-a032-20d3659d147b.e258f50d-1c05-435f-95d8-5b8c945ff667 Aug 03 08:55:13 devstack sudo[114322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:55:13 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[568a0e08-21f7-4973-8560-60876eae9e68]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:55:13 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-f0f15300-085c-42d2-8cc1-2b489998a6cc tempest-ProjectMemberTests-1353074417 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-087020ea-6077-4881-bce7-64fa89384eb1 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:55:13 devstack sudo[114324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-087020ea-6077-4881-bce7-64fa89384eb1 Aug 03 08:55:13 devstack sudo[114324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:55:13 devstack sudo[114322]: pam_unix(sudo:session): session closed for user root Aug 03 08:55:13 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-0d0c1a6d-17b2-4350-a4c9-71f5a1647180 tempest-ProjectReaderTests-1134321651 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-58996833-a814-4849-a032-20d3659d147b.e258f50d-1c05-435f-95d8-5b8c945ff667" returned: 0 in 0.539s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:55:13 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-0d0c1a6d-17b2-4350-a4c9-71f5a1647180 tempest-ProjectReaderTests-1134321651 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-58996833-a814-4849-a032-20d3659d147b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88899) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 03 08:55:13 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb6945f3-364d-4d56-9407-97ebf15849c9]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:55:13 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-0d0c1a6d-17b2-4350-a4c9-71f5a1647180 tempest-ProjectReaderTests-1134321651 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-58996833-a814-4849-a032-20d3659d147b {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:55:13 devstack sudo[114329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-58996833-a814-4849-a032-20d3659d147b Aug 03 08:55:13 devstack sudo[114329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:55:13 devstack sudo[114324]: pam_unix(sudo:session): session closed for user root Aug 03 08:55:13 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-f0f15300-085c-42d2-8cc1-2b489998a6cc tempest-ProjectMemberTests-1353074417 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-087020ea-6077-4881-bce7-64fa89384eb1" returned: 0 in 0.498s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:55:13 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-f0f15300-085c-42d2-8cc1-2b489998a6cc tempest-ProjectMemberTests-1353074417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-087020ea-6077-4881-bce7-64fa89384eb1 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:55:13 devstack sudo[114334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-087020ea-6077-4881-bce7-64fa89384eb1 Aug 03 08:55:13 devstack sudo[114334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:55:14 devstack sudo[114334]: pam_unix(sudo:session): session closed for user root Aug 03 08:55:14 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-f0f15300-085c-42d2-8cc1-2b489998a6cc tempest-ProjectMemberTests-1353074417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-087020ea-6077-4881-bce7-64fa89384eb1" returned: 0 in 0.419s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:55:14 devstack sudo[114329]: pam_unix(sudo:session): session closed for user root Aug 03 08:55:14 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-0d0c1a6d-17b2-4350-a4c9-71f5a1647180 tempest-ProjectReaderTests-1134321651 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-58996833-a814-4849-a032-20d3659d147b" returned: 0 in 0.614s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:55:14 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-0d0c1a6d-17b2-4350-a4c9-71f5a1647180 tempest-ProjectReaderTests-1134321651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-58996833-a814-4849-a032-20d3659d147b.e258f50d-1c05-435f-95d8-5b8c945ff667 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:55:14 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-f0f15300-085c-42d2-8cc1-2b489998a6cc tempest-ProjectMemberTests-1353074417 None] Lock "cinder-quobyte-087020ea-6077-4881-bce7-64fa89384eb1" released by "delete_volume" :: held 1.054s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:55:14 devstack sudo[114340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-58996833-a814-4849-a032-20d3659d147b.e258f50d-1c05-435f-95d8-5b8c945ff667 Aug 03 08:55:14 devstack sudo[114340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:55:14 devstack cinder-volume[88899]: DEBUG cinder.quota [None req-f0f15300-085c-42d2-8cc1-2b489998a6cc tempest-ProjectMemberTests-1353074417 None] Created reservations ['5462b51b-507d-45b7-860a-1f1272d267fe', '35578a4f-e369-4506-a837-17abfebf57df', '5b998d59-5fa4-4a01-bfb0-697d9972d401', '2120ba74-e721-4c5b-8fc0-ddfd9dd9fb7f'] {{(pid=88899) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 08:55:14 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-f0f15300-085c-42d2-8cc1-2b489998a6cc tempest-ProjectMemberTests-1353074417 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:55:14 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-f0f15300-085c-42d2-8cc1-2b489998a6cc tempest-ProjectMemberTests-1353074417 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:55:14 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-f0f15300-085c-42d2-8cc1-2b489998a6cc tempest-ProjectMemberTests-1353074417 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:55:14 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-f0f15300-085c-42d2-8cc1-2b489998a6cc tempest-ProjectMemberTests-1353074417 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:55:14 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-f0f15300-085c-42d2-8cc1-2b489998a6cc tempest-ProjectMemberTests-1353074417 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:55:14 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-f0f15300-085c-42d2-8cc1-2b489998a6cc tempest-ProjectMemberTests-1353074417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:55:14 devstack sudo[114342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a Aug 03 08:55:14 devstack sudo[114342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:55:14 devstack sudo[114340]: pam_unix(sudo:session): session closed for user root Aug 03 08:55:14 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-0d0c1a6d-17b2-4350-a4c9-71f5a1647180 tempest-ProjectReaderTests-1134321651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-58996833-a814-4849-a032-20d3659d147b.e258f50d-1c05-435f-95d8-5b8c945ff667" returned: 0 in 0.588s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:55:14 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-0d0c1a6d-17b2-4350-a4c9-71f5a1647180 tempest-ProjectReaderTests-1134321651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-58996833-a814-4849-a032-20d3659d147b.e258f50d-1c05-435f-95d8-5b8c945ff667 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:55:14 devstack sudo[114349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-58996833-a814-4849-a032-20d3659d147b.e258f50d-1c05-435f-95d8-5b8c945ff667 Aug 03 08:55:14 devstack sudo[114349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:55:15 devstack sudo[114342]: pam_unix(sudo:session): session closed for user root Aug 03 08:55:15 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-f0f15300-085c-42d2-8cc1-2b489998a6cc tempest-ProjectMemberTests-1353074417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a" returned: 0 in 0.447s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:55:15 devstack cinder-volume[88899]: DEBUG cinder.manager [None req-f0f15300-085c-42d2-8cc1-2b489998a6cc tempest-ProjectMemberTests-1353074417 None] Notifying Schedulers of capabilities ... {{(pid=88899) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 08:55:15 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-f0f15300-085c-42d2-8cc1-2b489998a6cc tempest-ProjectMemberTests-1353074417 None] Deleted volume successfully. Aug 03 08:55:15 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-f0f15300-085c-42d2-8cc1-2b489998a6cc tempest-ProjectMemberTests-1353074417 None] Lock "cinder-087020ea-6077-4881-bce7-64fa89384eb1-delete_volume" released by "delete_volume" :: held 1.855s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:55:15 devstack sudo[114349]: pam_unix(sudo:session): session closed for user root Aug 03 08:55:15 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-0d0c1a6d-17b2-4350-a4c9-71f5a1647180 tempest-ProjectReaderTests-1134321651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-58996833-a814-4849-a032-20d3659d147b.e258f50d-1c05-435f-95d8-5b8c945ff667" returned: 0 in 0.333s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:55:15 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-0d0c1a6d-17b2-4350-a4c9-71f5a1647180 tempest-ProjectReaderTests-1134321651 None] Lock "cinder-quobyte-e258f50d-1c05-435f-95d8-5b8c945ff667" released by "_delete_snapshot" :: held 2.259s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:55:15 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-0d0c1a6d-17b2-4350-a4c9-71f5a1647180 tempest-ProjectReaderTests-1134321651 None] Lock "cinder-quobyte-58996833-a814-4849-a032-20d3659d147b" released by "delete_snapshot" :: held 2.302s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:55:15 devstack cinder-volume[88899]: DEBUG cinder.quota [None req-0d0c1a6d-17b2-4350-a4c9-71f5a1647180 tempest-ProjectReaderTests-1134321651 None] Created reservations ['83ead4b3-9c94-4a97-b4ad-fbc911eb8276', '4f4d8bd1-1c6a-4d1a-a7cf-04592c36c246', '42abaf7a-3d32-460f-b026-8ec3c6a3b84b', 'bf19d96e-d6b7-4b21-ab9a-914d1df3ffac'] {{(pid=88899) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 08:55:15 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-0d0c1a6d-17b2-4350-a4c9-71f5a1647180 tempest-ProjectReaderTests-1134321651 None] Delete snapshot completed successfully. Aug 03 08:55:15 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-0d0c1a6d-17b2-4350-a4c9-71f5a1647180 tempest-ProjectReaderTests-1134321651 None] Lock "cinder-e258f50d-1c05-435f-95d8-5b8c945ff667-delete_snapshot" released by "delete_snapshot" :: held 2.531s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:55:16 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-60e68655-a4c5-4ea4-b853-a28c9ffd4848 tempest-ProjectReaderTests-1134321651 None] Acquiring lock "cinder-58996833-a814-4849-a032-20d3659d147b-delete_volume" by "delete_volume" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:55:16 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-60e68655-a4c5-4ea4-b853-a28c9ffd4848 tempest-ProjectReaderTests-1134321651 None] Lock "cinder-58996833-a814-4849-a032-20d3659d147b-delete_volume" acquired by "delete_volume" :: waited 0.062s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:55:16 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-60e68655-a4c5-4ea4-b853-a28c9ffd4848 tempest-ProjectReaderTests-1134321651 None] Acquiring lock "cinder-quobyte-58996833-a814-4849-a032-20d3659d147b" by "delete_volume" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:55:16 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-60e68655-a4c5-4ea4-b853-a28c9ffd4848 tempest-ProjectReaderTests-1134321651 None] Lock "cinder-quobyte-58996833-a814-4849-a032-20d3659d147b" acquired by "delete_volume" :: waited 0.017s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:55:16 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ca99685-9a18-4151-91de-b8a94dfa3342]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:55:16 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-60e68655-a4c5-4ea4-b853-a28c9ffd4848 tempest-ProjectReaderTests-1134321651 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-58996833-a814-4849-a032-20d3659d147b {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:55:16 devstack sudo[114352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-58996833-a814-4849-a032-20d3659d147b Aug 03 08:55:16 devstack sudo[114352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:55:17 devstack sudo[114352]: pam_unix(sudo:session): session closed for user root Aug 03 08:55:17 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-60e68655-a4c5-4ea4-b853-a28c9ffd4848 tempest-ProjectReaderTests-1134321651 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-58996833-a814-4849-a032-20d3659d147b" returned: 0 in 0.563s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:55:17 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-60e68655-a4c5-4ea4-b853-a28c9ffd4848 tempest-ProjectReaderTests-1134321651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-58996833-a814-4849-a032-20d3659d147b {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:55:17 devstack sudo[114357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-58996833-a814-4849-a032-20d3659d147b Aug 03 08:55:17 devstack sudo[114357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:55:17 devstack sudo[114357]: pam_unix(sudo:session): session closed for user root Aug 03 08:55:17 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-60e68655-a4c5-4ea4-b853-a28c9ffd4848 tempest-ProjectReaderTests-1134321651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-58996833-a814-4849-a032-20d3659d147b" returned: 0 in 0.333s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:55:17 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-60e68655-a4c5-4ea4-b853-a28c9ffd4848 tempest-ProjectReaderTests-1134321651 None] Lock "cinder-quobyte-58996833-a814-4849-a032-20d3659d147b" released by "delete_volume" :: held 1.017s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:55:17 devstack cinder-volume[88899]: DEBUG cinder.quota [None req-60e68655-a4c5-4ea4-b853-a28c9ffd4848 tempest-ProjectReaderTests-1134321651 None] Created reservations ['f6245228-8661-4be6-8817-df9716bbca02', 'a1e040e5-3956-49c4-a2bc-7d13b3178e51', '56443c4d-dae8-4853-a9f9-645c30d3f71f', '23e85b1d-ff6e-45f8-b99b-387eb4ba93c2'] {{(pid=88899) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 08:55:17 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-60e68655-a4c5-4ea4-b853-a28c9ffd4848 tempest-ProjectReaderTests-1134321651 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:55:17 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-60e68655-a4c5-4ea4-b853-a28c9ffd4848 tempest-ProjectReaderTests-1134321651 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:55:17 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-60e68655-a4c5-4ea4-b853-a28c9ffd4848 tempest-ProjectReaderTests-1134321651 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:55:17 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-60e68655-a4c5-4ea4-b853-a28c9ffd4848 tempest-ProjectReaderTests-1134321651 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:55:17 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-60e68655-a4c5-4ea4-b853-a28c9ffd4848 tempest-ProjectReaderTests-1134321651 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:55:17 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-60e68655-a4c5-4ea4-b853-a28c9ffd4848 tempest-ProjectReaderTests-1134321651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:55:17 devstack sudo[114360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a Aug 03 08:55:17 devstack sudo[114360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:55:18 devstack sudo[114360]: pam_unix(sudo:session): session closed for user root Aug 03 08:55:18 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-60e68655-a4c5-4ea4-b853-a28c9ffd4848 tempest-ProjectReaderTests-1134321651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a" returned: 0 in 0.323s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:55:18 devstack cinder-volume[88899]: DEBUG cinder.manager [None req-60e68655-a4c5-4ea4-b853-a28c9ffd4848 tempest-ProjectReaderTests-1134321651 None] Notifying Schedulers of capabilities ... {{(pid=88899) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 08:55:18 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-60e68655-a4c5-4ea4-b853-a28c9ffd4848 tempest-ProjectReaderTests-1134321651 None] Deleted volume successfully. Aug 03 08:55:18 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-60e68655-a4c5-4ea4-b853-a28c9ffd4848 tempest-ProjectReaderTests-1134321651 None] Lock "cinder-58996833-a814-4849-a032-20d3659d147b-delete_volume" released by "delete_volume" :: held 1.710s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:55:19 devstack cinder-volume[88899]: DEBUG cinder.volume.flows.manager.create_volume [None req-eebed5af-4ae8-4104-95a3-137362d7de9c tempest-ProjectReaderTests-1134321651 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88899) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 08:55:19 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-eebed5af-4ae8-4104-95a3-137362d7de9c tempest-ProjectReaderTests-1134321651 None] Flow 'volume_create_manager' (bffd5083-dd3e-4ac6-b1a3-66a46a62d7b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:55:19 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-eebed5af-4ae8-4104-95a3-137362d7de9c tempest-ProjectReaderTests-1134321651 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8cd583ec-a341-41ae-ab79-5d128c77d98a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:55:19 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-eebed5af-4ae8-4104-95a3-137362d7de9c tempest-ProjectReaderTests-1134321651 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8cd583ec-a341-41ae-ab79-5d128c77d98a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:55:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1437875897',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ca2c321a-d5e2-43c9-803c-79200df23368,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d1960effcf84b1d80da45b8e57d70f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:55:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:55:19Z,use_quota=True,user_id='552bc37e3b5740afaa307554a5a6c75f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8bde7129-1dc4-42ab-b852-ab32c61b4921),volume_type_id=8bde7129-1dc4-42ab-b852-ab32c61b4921)' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:55:19 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-eebed5af-4ae8-4104-95a3-137362d7de9c tempest-ProjectReaderTests-1134321651 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (302e9d87-4c19-41a5-9491-cc3bc36f87b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:55:19 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-eebed5af-4ae8-4104-95a3-137362d7de9c tempest-ProjectReaderTests-1134321651 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (302e9d87-4c19-41a5-9491-cc3bc36f87b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:55:19 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-eebed5af-4ae8-4104-95a3-137362d7de9c tempest-ProjectReaderTests-1134321651 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df450d3b-cacd-47d9-bd36-55f1d5d45497) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:55:19 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-eebed5af-4ae8-4104-95a3-137362d7de9c tempest-ProjectReaderTests-1134321651 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df450d3b-cacd-47d9-bd36-55f1d5d45497) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ca2c321a-d5e2-43c9-803c-79200df23368', 'volume_name': 'volume-ca2c321a-d5e2-43c9-803c-79200df23368', 'volume_size': 1}' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:55:19 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-eebed5af-4ae8-4104-95a3-137362d7de9c tempest-ProjectReaderTests-1134321651 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41a70992-2b9b-483f-a825-a4390df984f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:55:19 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-eebed5af-4ae8-4104-95a3-137362d7de9c tempest-ProjectReaderTests-1134321651 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41a70992-2b9b-483f-a825-a4390df984f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:55:19 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-eebed5af-4ae8-4104-95a3-137362d7de9c tempest-ProjectReaderTests-1134321651 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (add372e4-0e66-49ff-a848-64bcd3419ff4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:55:19 devstack cinder-volume[88899]: INFO cinder.volume.flows.manager.create_volume [None req-eebed5af-4ae8-4104-95a3-137362d7de9c tempest-ProjectReaderTests-1134321651 None] Volume ca2c321a-d5e2-43c9-803c-79200df23368: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ca2c321a-d5e2-43c9-803c-79200df23368', 'volume_size': 1} Aug 03 08:55:19 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-eebed5af-4ae8-4104-95a3-137362d7de9c tempest-ProjectReaderTests-1134321651 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:55:19 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-eebed5af-4ae8-4104-95a3-137362d7de9c tempest-ProjectReaderTests-1134321651 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:55:19 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-eebed5af-4ae8-4104-95a3-137362d7de9c tempest-ProjectReaderTests-1134321651 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:55:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1437875897',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ca2c321a-d5e2-43c9-803c-79200df23368,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d1960effcf84b1d80da45b8e57d70f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:55:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:55:19Z,use_quota=True,user_id='552bc37e3b5740afaa307554a5a6c75f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8bde7129-1dc4-42ab-b852-ab32c61b4921),volume_type_id=8bde7129-1dc4-42ab-b852-ab32c61b4921)}" {{(pid=88899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 08:55:19 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-eebed5af-4ae8-4104-95a3-137362d7de9c tempest-ProjectReaderTests-1134321651 None] Creating volume ca2c321a-d5e2-43c9-803c-79200df23368 {{(pid=88899) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 08:55:19 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-eebed5af-4ae8-4104-95a3-137362d7de9c tempest-ProjectReaderTests-1134321651 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:55:19 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-eebed5af-4ae8-4104-95a3-137362d7de9c tempest-ProjectReaderTests-1134321651 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:55:19 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-eebed5af-4ae8-4104-95a3-137362d7de9c tempest-ProjectReaderTests-1134321651 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:55:19 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-eebed5af-4ae8-4104-95a3-137362d7de9c tempest-ProjectReaderTests-1134321651 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:55:19 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-eebed5af-4ae8-4104-95a3-137362d7de9c tempest-ProjectReaderTests-1134321651 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:55:19 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-eebed5af-4ae8-4104-95a3-137362d7de9c tempest-ProjectReaderTests-1134321651 None] Selected osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385 as target Quobyte volume. {{(pid=88899) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 08:55:19 devstack cinder-volume[88899]: INFO cinder.volume.drivers.remotefs [None req-eebed5af-4ae8-4104-95a3-137362d7de9c tempest-ProjectReaderTests-1134321651 None] casted to osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385 Aug 03 08:55:19 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-eebed5af-4ae8-4104-95a3-137362d7de9c tempest-ProjectReaderTests-1134321651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-ca2c321a-d5e2-43c9-803c-79200df23368 1073741824 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:55:19 devstack sudo[114365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-ca2c321a-d5e2-43c9-803c-79200df23368 1073741824 Aug 03 08:55:19 devstack sudo[114365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:55:20 devstack sudo[114365]: pam_unix(sudo:session): session closed for user root Aug 03 08:55:20 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-eebed5af-4ae8-4104-95a3-137362d7de9c tempest-ProjectReaderTests-1134321651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-ca2c321a-d5e2-43c9-803c-79200df23368 1073741824" returned: 0 in 0.662s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:55:20 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-eebed5af-4ae8-4104-95a3-137362d7de9c tempest-ProjectReaderTests-1134321651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-ca2c321a-d5e2-43c9-803c-79200df23368 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:55:20 devstack sudo[114370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-ca2c321a-d5e2-43c9-803c-79200df23368 Aug 03 08:55:20 devstack sudo[114370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:55:20 devstack sudo[114370]: pam_unix(sudo:session): session closed for user root Aug 03 08:55:20 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-eebed5af-4ae8-4104-95a3-137362d7de9c tempest-ProjectReaderTests-1134321651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-ca2c321a-d5e2-43c9-803c-79200df23368" returned: 0 in 0.366s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:55:20 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-eebed5af-4ae8-4104-95a3-137362d7de9c tempest-ProjectReaderTests-1134321651 None] <== create_volume: return (1123ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'} {{(pid=88899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 08:55:20 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-eebed5af-4ae8-4104-95a3-137362d7de9c tempest-ProjectReaderTests-1134321651 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.126s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:55:20 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-eebed5af-4ae8-4104-95a3-137362d7de9c tempest-ProjectReaderTests-1134321651 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (add372e4-0e66-49ff-a848-64bcd3419ff4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ca2c321a-d5e2-43c9-803c-79200df23368', 'volume_size': 1}' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:55:20 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-eebed5af-4ae8-4104-95a3-137362d7de9c tempest-ProjectReaderTests-1134321651 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eccaaddd-c35c-4b85-93d6-82c1fab32b1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:55:20 devstack cinder-volume[88899]: INFO cinder.volume.flows.manager.create_volume [None req-eebed5af-4ae8-4104-95a3-137362d7de9c tempest-ProjectReaderTests-1134321651 None] Volume volume-ca2c321a-d5e2-43c9-803c-79200df23368 (ca2c321a-d5e2-43c9-803c-79200df23368): created successfully Aug 03 08:55:20 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-eebed5af-4ae8-4104-95a3-137362d7de9c tempest-ProjectReaderTests-1134321651 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eccaaddd-c35c-4b85-93d6-82c1fab32b1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:55:20 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-eebed5af-4ae8-4104-95a3-137362d7de9c tempest-ProjectReaderTests-1134321651 None] Flow 'volume_create_manager' (bffd5083-dd3e-4ac6-b1a3-66a46a62d7b1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:55:20 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-eebed5af-4ae8-4104-95a3-137362d7de9c tempest-ProjectReaderTests-1134321651 None] Created volume successfully. Aug 03 08:55:21 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-5bd78648-8981-45ff-b169-ad89358c4e1e tempest-ProjectReaderTests-1134321651 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:55:21 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-5bd78648-8981-45ff-b169-ad89358c4e1e tempest-ProjectReaderTests-1134321651 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:55:21 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-5bd78648-8981-45ff-b169-ad89358c4e1e tempest-ProjectReaderTests-1134321651 None] Creating offline snapshot 576740ba-faaa-4b24-897e-295323936788 of volume ca2c321a-d5e2-43c9-803c-79200df23368 {{(pid=88899) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 03 08:55:21 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[db812245-f3cf-4639-a937-e7fad332b22c]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:55:21 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-5bd78648-8981-45ff-b169-ad89358c4e1e tempest-ProjectReaderTests-1134321651 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-ca2c321a-d5e2-43c9-803c-79200df23368 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:55:21 devstack sudo[114374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-ca2c321a-d5e2-43c9-803c-79200df23368 Aug 03 08:55:21 devstack sudo[114374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:55:22 devstack sudo[114374]: pam_unix(sudo:session): session closed for user root Aug 03 08:55:22 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-5bd78648-8981-45ff-b169-ad89358c4e1e tempest-ProjectReaderTests-1134321651 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-ca2c321a-d5e2-43c9-803c-79200df23368" returned: 0 in 0.458s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:55:22 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-5bd78648-8981-45ff-b169-ad89358c4e1e tempest-ProjectReaderTests-1134321651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-ca2c321a-d5e2-43c9-803c-79200df23368,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-ca2c321a-d5e2-43c9-803c-79200df23368.576740ba-faaa-4b24-897e-295323936788 1G {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:55:22 devstack sudo[114380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-ca2c321a-d5e2-43c9-803c-79200df23368,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-ca2c321a-d5e2-43c9-803c-79200df23368.576740ba-faaa-4b24-897e-295323936788 1G Aug 03 08:55:22 devstack sudo[114380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:55:22 devstack sudo[114380]: pam_unix(sudo:session): session closed for user root Aug 03 08:55:22 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-5bd78648-8981-45ff-b169-ad89358c4e1e tempest-ProjectReaderTests-1134321651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-ca2c321a-d5e2-43c9-803c-79200df23368,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-ca2c321a-d5e2-43c9-803c-79200df23368.576740ba-faaa-4b24-897e-295323936788 1G" returned: 0 in 0.628s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:55:22 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-5bd78648-8981-45ff-b169-ad89358c4e1e tempest-ProjectReaderTests-1134321651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ca2c321a-d5e2-43c9-803c-79200df23368 -F qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-ca2c321a-d5e2-43c9-803c-79200df23368.576740ba-faaa-4b24-897e-295323936788 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:55:22 devstack sudo[114385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ca2c321a-d5e2-43c9-803c-79200df23368 -F qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-ca2c321a-d5e2-43c9-803c-79200df23368.576740ba-faaa-4b24-897e-295323936788 Aug 03 08:55:22 devstack sudo[114385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:55:23 devstack sudo[114385]: pam_unix(sudo:session): session closed for user root Aug 03 08:55:23 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-5bd78648-8981-45ff-b169-ad89358c4e1e tempest-ProjectReaderTests-1134321651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ca2c321a-d5e2-43c9-803c-79200df23368 -F qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-ca2c321a-d5e2-43c9-803c-79200df23368.576740ba-faaa-4b24-897e-295323936788" returned: 0 in 0.354s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:55:23 devstack cinder-volume[88899]: WARNING cinder.volume.drivers.remotefs [None req-5bd78648-8981-45ff-b169-ad89358c4e1e tempest-ProjectReaderTests-1134321651 None] /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-ca2c321a-d5e2-43c9-803c-79200df23368.576740ba-faaa-4b24-897e-295323936788 is being set with open permissions: ugo+rw Aug 03 08:55:23 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-5bd78648-8981-45ff-b169-ad89358c4e1e tempest-ProjectReaderTests-1134321651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-ca2c321a-d5e2-43c9-803c-79200df23368.576740ba-faaa-4b24-897e-295323936788 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:55:23 devstack sudo[114390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-ca2c321a-d5e2-43c9-803c-79200df23368.576740ba-faaa-4b24-897e-295323936788 Aug 03 08:55:23 devstack sudo[114390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:55:23 devstack sudo[114390]: pam_unix(sudo:session): session closed for user root Aug 03 08:55:23 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-5bd78648-8981-45ff-b169-ad89358c4e1e tempest-ProjectReaderTests-1134321651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-ca2c321a-d5e2-43c9-803c-79200df23368.576740ba-faaa-4b24-897e-295323936788" returned: 0 in 0.275s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:55:23 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-5bd78648-8981-45ff-b169-ad89358c4e1e tempest-ProjectReaderTests-1134321651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-ca2c321a-d5e2-43c9-803c-79200df23368.info {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:55:23 devstack sudo[114445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-ca2c321a-d5e2-43c9-803c-79200df23368.info Aug 03 08:55:23 devstack sudo[114445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:55:23 devstack sudo[114445]: pam_unix(sudo:session): session closed for user root Aug 03 08:55:23 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-5bd78648-8981-45ff-b169-ad89358c4e1e tempest-ProjectReaderTests-1134321651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-ca2c321a-d5e2-43c9-803c-79200df23368.info" returned: 0 in 0.285s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:55:23 devstack cinder-volume[88899]: WARNING cinder.volume.drivers.remotefs [None req-5bd78648-8981-45ff-b169-ad89358c4e1e tempest-ProjectReaderTests-1134321651 None] /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-ca2c321a-d5e2-43c9-803c-79200df23368.info is being set with open permissions: ugo+rw Aug 03 08:55:23 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-5bd78648-8981-45ff-b169-ad89358c4e1e tempest-ProjectReaderTests-1134321651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-ca2c321a-d5e2-43c9-803c-79200df23368.info {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:55:23 devstack sudo[114482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-ca2c321a-d5e2-43c9-803c-79200df23368.info Aug 03 08:55:23 devstack sudo[114482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:55:24 devstack sudo[114482]: pam_unix(sudo:session): session closed for user root Aug 03 08:55:24 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-5bd78648-8981-45ff-b169-ad89358c4e1e tempest-ProjectReaderTests-1134321651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-ca2c321a-d5e2-43c9-803c-79200df23368.info" returned: 0 in 0.403s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:55:24 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-5bd78648-8981-45ff-b169-ad89358c4e1e tempest-ProjectReaderTests-1134321651 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.525s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:55:24 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-5bd78648-8981-45ff-b169-ad89358c4e1e tempest-ProjectReaderTests-1134321651 None] Create snapshot completed successfully Aug 03 08:55:25 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-d75c46a7-667d-4cd6-9381-20840d1e937e tempest-ProjectReaderTests-1134321651 None] Acquiring lock "cinder-576740ba-faaa-4b24-897e-295323936788-delete_snapshot" by "delete_snapshot" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:55:25 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-d75c46a7-667d-4cd6-9381-20840d1e937e tempest-ProjectReaderTests-1134321651 None] Lock "cinder-576740ba-faaa-4b24-897e-295323936788-delete_snapshot" acquired by "delete_snapshot" :: waited 0.044s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:55:25 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-d75c46a7-667d-4cd6-9381-20840d1e937e tempest-ProjectReaderTests-1134321651 None] Acquiring lock "cinder-quobyte-ca2c321a-d5e2-43c9-803c-79200df23368" by "delete_snapshot" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:55:25 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-d75c46a7-667d-4cd6-9381-20840d1e937e tempest-ProjectReaderTests-1134321651 None] Lock "cinder-quobyte-ca2c321a-d5e2-43c9-803c-79200df23368" acquired by "delete_snapshot" :: waited 0.034s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:55:25 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-d75c46a7-667d-4cd6-9381-20840d1e937e tempest-ProjectReaderTests-1134321651 None] Acquiring lock "cinder-quobyte-576740ba-faaa-4b24-897e-295323936788" by "_delete_snapshot" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:55:25 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-d75c46a7-667d-4cd6-9381-20840d1e937e tempest-ProjectReaderTests-1134321651 None] Lock "cinder-quobyte-576740ba-faaa-4b24-897e-295323936788" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:55:25 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-d75c46a7-667d-4cd6-9381-20840d1e937e tempest-ProjectReaderTests-1134321651 None] Deleting offline snapshot 576740ba-faaa-4b24-897e-295323936788 of volume ca2c321a-d5e2-43c9-803c-79200df23368 {{(pid=88899) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 03 08:55:25 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-d75c46a7-667d-4cd6-9381-20840d1e937e tempest-ProjectReaderTests-1134321651 None] snapshot_file for this snap is: volume-ca2c321a-d5e2-43c9-803c-79200df23368.576740ba-faaa-4b24-897e-295323936788 {{(pid=88899) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 03 08:55:25 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[4378a47f-3c17-41af-8db9-9cdc8a12058f]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:55:25 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-d75c46a7-667d-4cd6-9381-20840d1e937e tempest-ProjectReaderTests-1134321651 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-ca2c321a-d5e2-43c9-803c-79200df23368.576740ba-faaa-4b24-897e-295323936788 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:55:25 devstack sudo[114485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-ca2c321a-d5e2-43c9-803c-79200df23368.576740ba-faaa-4b24-897e-295323936788 Aug 03 08:55:25 devstack sudo[114485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:55:25 devstack sudo[114485]: pam_unix(sudo:session): session closed for user root Aug 03 08:55:25 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-d75c46a7-667d-4cd6-9381-20840d1e937e tempest-ProjectReaderTests-1134321651 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-ca2c321a-d5e2-43c9-803c-79200df23368.576740ba-faaa-4b24-897e-295323936788" returned: 0 in 0.430s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:55:25 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-d75c46a7-667d-4cd6-9381-20840d1e937e tempest-ProjectReaderTests-1134321651 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ca2c321a-d5e2-43c9-803c-79200df23368(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88899) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 03 08:55:25 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f901ace-3135-4d6e-a277-f77f57301b8c]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:55:25 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-d75c46a7-667d-4cd6-9381-20840d1e937e tempest-ProjectReaderTests-1134321651 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-ca2c321a-d5e2-43c9-803c-79200df23368 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:55:25 devstack sudo[114490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-ca2c321a-d5e2-43c9-803c-79200df23368 Aug 03 08:55:25 devstack sudo[114490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:55:26 devstack sudo[114490]: pam_unix(sudo:session): session closed for user root Aug 03 08:55:26 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-d75c46a7-667d-4cd6-9381-20840d1e937e tempest-ProjectReaderTests-1134321651 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-ca2c321a-d5e2-43c9-803c-79200df23368" returned: 0 in 0.536s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:55:26 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-d75c46a7-667d-4cd6-9381-20840d1e937e tempest-ProjectReaderTests-1134321651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-ca2c321a-d5e2-43c9-803c-79200df23368.576740ba-faaa-4b24-897e-295323936788 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:55:26 devstack sudo[114495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-ca2c321a-d5e2-43c9-803c-79200df23368.576740ba-faaa-4b24-897e-295323936788 Aug 03 08:55:26 devstack sudo[114495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:55:26 devstack sudo[114495]: pam_unix(sudo:session): session closed for user root Aug 03 08:55:26 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-d75c46a7-667d-4cd6-9381-20840d1e937e tempest-ProjectReaderTests-1134321651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-ca2c321a-d5e2-43c9-803c-79200df23368.576740ba-faaa-4b24-897e-295323936788" returned: 0 in 0.593s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:55:26 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-d75c46a7-667d-4cd6-9381-20840d1e937e tempest-ProjectReaderTests-1134321651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-ca2c321a-d5e2-43c9-803c-79200df23368.576740ba-faaa-4b24-897e-295323936788 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:55:26 devstack sudo[114500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-ca2c321a-d5e2-43c9-803c-79200df23368.576740ba-faaa-4b24-897e-295323936788 Aug 03 08:55:26 devstack sudo[114500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:55:27 devstack sudo[114500]: pam_unix(sudo:session): session closed for user root Aug 03 08:55:27 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-d75c46a7-667d-4cd6-9381-20840d1e937e tempest-ProjectReaderTests-1134321651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-ca2c321a-d5e2-43c9-803c-79200df23368.576740ba-faaa-4b24-897e-295323936788" returned: 0 in 0.460s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:55:27 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-d75c46a7-667d-4cd6-9381-20840d1e937e tempest-ProjectReaderTests-1134321651 None] Lock "cinder-quobyte-576740ba-faaa-4b24-897e-295323936788" released by "_delete_snapshot" :: held 2.209s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:55:27 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-d75c46a7-667d-4cd6-9381-20840d1e937e tempest-ProjectReaderTests-1134321651 None] Lock "cinder-quobyte-ca2c321a-d5e2-43c9-803c-79200df23368" released by "delete_snapshot" :: held 2.248s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:55:27 devstack cinder-volume[88899]: DEBUG cinder.quota [None req-d75c46a7-667d-4cd6-9381-20840d1e937e tempest-ProjectReaderTests-1134321651 None] Created reservations ['48684564-62e9-4c89-a181-09081c4646d5', '37b1d22a-767d-4ebf-85dc-bff03d7116b3', '5641e123-b5a0-4054-b4d8-3f0ef26ae6ec', '1edae55d-609b-4f18-ae62-b3988e338a75'] {{(pid=88899) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 08:55:27 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-d75c46a7-667d-4cd6-9381-20840d1e937e tempest-ProjectReaderTests-1134321651 None] Delete snapshot completed successfully. Aug 03 08:55:27 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-d75c46a7-667d-4cd6-9381-20840d1e937e tempest-ProjectReaderTests-1134321651 None] Lock "cinder-576740ba-faaa-4b24-897e-295323936788-delete_snapshot" released by "delete_snapshot" :: held 2.460s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:55:28 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-5863c1b7-0aad-463a-a01f-9d051fe3266c tempest-ProjectReaderTests-1134321651 None] Acquiring lock "cinder-ca2c321a-d5e2-43c9-803c-79200df23368-delete_volume" by "delete_volume" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:55:28 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-5863c1b7-0aad-463a-a01f-9d051fe3266c tempest-ProjectReaderTests-1134321651 None] Lock "cinder-ca2c321a-d5e2-43c9-803c-79200df23368-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:55:28 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-5863c1b7-0aad-463a-a01f-9d051fe3266c tempest-ProjectReaderTests-1134321651 None] Acquiring lock "cinder-quobyte-ca2c321a-d5e2-43c9-803c-79200df23368" by "delete_volume" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:55:28 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-5863c1b7-0aad-463a-a01f-9d051fe3266c tempest-ProjectReaderTests-1134321651 None] Lock "cinder-quobyte-ca2c321a-d5e2-43c9-803c-79200df23368" acquired by "delete_volume" :: waited 0.030s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:55:28 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d7cd3c3-ccc1-4502-a591-d16f3e904923]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:55:28 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-5863c1b7-0aad-463a-a01f-9d051fe3266c tempest-ProjectReaderTests-1134321651 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-ca2c321a-d5e2-43c9-803c-79200df23368 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:55:28 devstack sudo[114503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-ca2c321a-d5e2-43c9-803c-79200df23368 Aug 03 08:55:28 devstack sudo[114503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:55:29 devstack sudo[114503]: pam_unix(sudo:session): session closed for user root Aug 03 08:55:29 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-5863c1b7-0aad-463a-a01f-9d051fe3266c tempest-ProjectReaderTests-1134321651 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-ca2c321a-d5e2-43c9-803c-79200df23368" returned: 0 in 0.462s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:55:29 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-5863c1b7-0aad-463a-a01f-9d051fe3266c tempest-ProjectReaderTests-1134321651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-ca2c321a-d5e2-43c9-803c-79200df23368 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:55:29 devstack sudo[114509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-ca2c321a-d5e2-43c9-803c-79200df23368 Aug 03 08:55:29 devstack sudo[114509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:55:29 devstack sudo[114509]: pam_unix(sudo:session): session closed for user root Aug 03 08:55:29 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-5863c1b7-0aad-463a-a01f-9d051fe3266c tempest-ProjectReaderTests-1134321651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-ca2c321a-d5e2-43c9-803c-79200df23368" returned: 0 in 0.424s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:55:29 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-5863c1b7-0aad-463a-a01f-9d051fe3266c tempest-ProjectReaderTests-1134321651 None] Lock "cinder-quobyte-ca2c321a-d5e2-43c9-803c-79200df23368" released by "delete_volume" :: held 0.981s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:55:29 devstack cinder-volume[88899]: DEBUG cinder.quota [None req-5863c1b7-0aad-463a-a01f-9d051fe3266c tempest-ProjectReaderTests-1134321651 None] Created reservations ['f8f215b9-5c1a-4fb4-8741-e7071e8b55a6', '4eed59f2-7638-450d-b787-601143be95cf', '1c9e58f3-5a2f-49d1-808d-69ac783774c1', 'b51f5066-31bc-4dea-a644-72b17e849c73'] {{(pid=88899) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 08:55:29 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-5863c1b7-0aad-463a-a01f-9d051fe3266c tempest-ProjectReaderTests-1134321651 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:55:29 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-5863c1b7-0aad-463a-a01f-9d051fe3266c tempest-ProjectReaderTests-1134321651 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:55:29 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-5863c1b7-0aad-463a-a01f-9d051fe3266c tempest-ProjectReaderTests-1134321651 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:55:29 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-5863c1b7-0aad-463a-a01f-9d051fe3266c tempest-ProjectReaderTests-1134321651 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:55:29 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-5863c1b7-0aad-463a-a01f-9d051fe3266c tempest-ProjectReaderTests-1134321651 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:55:29 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-5863c1b7-0aad-463a-a01f-9d051fe3266c tempest-ProjectReaderTests-1134321651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:55:29 devstack sudo[114512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a Aug 03 08:55:29 devstack sudo[114512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:55:30 devstack sudo[114512]: pam_unix(sudo:session): session closed for user root Aug 03 08:55:30 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-5863c1b7-0aad-463a-a01f-9d051fe3266c tempest-ProjectReaderTests-1134321651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a" returned: 0 in 0.295s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:55:30 devstack cinder-volume[88899]: DEBUG cinder.manager [None req-5863c1b7-0aad-463a-a01f-9d051fe3266c tempest-ProjectReaderTests-1134321651 None] Notifying Schedulers of capabilities ... {{(pid=88899) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 08:55:30 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-5863c1b7-0aad-463a-a01f-9d051fe3266c tempest-ProjectReaderTests-1134321651 None] Deleted volume successfully. Aug 03 08:55:30 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-5863c1b7-0aad-463a-a01f-9d051fe3266c tempest-ProjectReaderTests-1134321651 None] Lock "cinder-ca2c321a-d5e2-43c9-803c-79200df23368-delete_volume" released by "delete_volume" :: held 1.616s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:55:31 devstack cinder-volume[88899]: DEBUG cinder.volume.flows.manager.create_volume [None req-9b949d11-8969-4c97-b569-c170021d535c tempest-SnapshotDependencyTests-1696022310 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88899) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 08:55:31 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-9b949d11-8969-4c97-b569-c170021d535c tempest-SnapshotDependencyTests-1696022310 None] Flow 'volume_create_manager' (39a6038e-4c4d-4204-83f4-72285a949755) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:55:31 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-9b949d11-8969-4c97-b569-c170021d535c tempest-SnapshotDependencyTests-1696022310 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17f43720-208f-4691-80d5-3e6a20a00087) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:55:31 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-9b949d11-8969-4c97-b569-c170021d535c tempest-SnapshotDependencyTests-1696022310 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17f43720-208f-4691-80d5-3e6a20a00087) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:55:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1429447404',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=21c02779-4855-4574-9f0e-8c462065668f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f7ac40c7e309498ca4806de0ce2c354a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:55:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:55:31Z,use_quota=True,user_id='b7403ab998f24276a33f1147fee7f751',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8bde7129-1dc4-42ab-b852-ab32c61b4921),volume_type_id=8bde7129-1dc4-42ab-b852-ab32c61b4921)' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:55:31 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-9b949d11-8969-4c97-b569-c170021d535c tempest-SnapshotDependencyTests-1696022310 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd5a0e5f-bb8e-4a98-83c6-bbd0cf8b2996) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:55:31 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-9b949d11-8969-4c97-b569-c170021d535c tempest-SnapshotDependencyTests-1696022310 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd5a0e5f-bb8e-4a98-83c6-bbd0cf8b2996) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:55:31 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-9b949d11-8969-4c97-b569-c170021d535c tempest-SnapshotDependencyTests-1696022310 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5ea61b4-fbdc-4df2-a01e-ddc8636afc51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:55:31 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-9b949d11-8969-4c97-b569-c170021d535c tempest-SnapshotDependencyTests-1696022310 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5ea61b4-fbdc-4df2-a01e-ddc8636afc51) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '21c02779-4855-4574-9f0e-8c462065668f', 'volume_name': 'volume-21c02779-4855-4574-9f0e-8c462065668f', 'volume_size': 1}' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:55:31 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-9b949d11-8969-4c97-b569-c170021d535c tempest-SnapshotDependencyTests-1696022310 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39b5dc6f-3b80-4909-8447-f1c68c85a36e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:55:31 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-9b949d11-8969-4c97-b569-c170021d535c tempest-SnapshotDependencyTests-1696022310 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39b5dc6f-3b80-4909-8447-f1c68c85a36e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:55:31 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-9b949d11-8969-4c97-b569-c170021d535c tempest-SnapshotDependencyTests-1696022310 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (22a07d70-31eb-451a-8fcc-43f83fc15bbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:55:31 devstack cinder-volume[88899]: INFO cinder.volume.flows.manager.create_volume [None req-9b949d11-8969-4c97-b569-c170021d535c tempest-SnapshotDependencyTests-1696022310 None] Volume 21c02779-4855-4574-9f0e-8c462065668f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-21c02779-4855-4574-9f0e-8c462065668f', 'volume_size': 1} Aug 03 08:55:31 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-9b949d11-8969-4c97-b569-c170021d535c tempest-SnapshotDependencyTests-1696022310 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:55:31 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-9b949d11-8969-4c97-b569-c170021d535c tempest-SnapshotDependencyTests-1696022310 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:55:31 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-9b949d11-8969-4c97-b569-c170021d535c tempest-SnapshotDependencyTests-1696022310 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:55:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1429447404',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=21c02779-4855-4574-9f0e-8c462065668f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f7ac40c7e309498ca4806de0ce2c354a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:55:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:55:31Z,use_quota=True,user_id='b7403ab998f24276a33f1147fee7f751',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8bde7129-1dc4-42ab-b852-ab32c61b4921),volume_type_id=8bde7129-1dc4-42ab-b852-ab32c61b4921)}" {{(pid=88899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 08:55:31 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-9b949d11-8969-4c97-b569-c170021d535c tempest-SnapshotDependencyTests-1696022310 None] Creating volume 21c02779-4855-4574-9f0e-8c462065668f {{(pid=88899) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 08:55:31 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-9b949d11-8969-4c97-b569-c170021d535c tempest-SnapshotDependencyTests-1696022310 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:55:31 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-9b949d11-8969-4c97-b569-c170021d535c tempest-SnapshotDependencyTests-1696022310 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:55:31 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-9b949d11-8969-4c97-b569-c170021d535c tempest-SnapshotDependencyTests-1696022310 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:55:31 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-9b949d11-8969-4c97-b569-c170021d535c tempest-SnapshotDependencyTests-1696022310 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:55:31 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-9b949d11-8969-4c97-b569-c170021d535c tempest-SnapshotDependencyTests-1696022310 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:55:31 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-9b949d11-8969-4c97-b569-c170021d535c tempest-SnapshotDependencyTests-1696022310 None] Selected osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385 as target Quobyte volume. {{(pid=88899) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 08:55:31 devstack cinder-volume[88899]: INFO cinder.volume.drivers.remotefs [None req-9b949d11-8969-4c97-b569-c170021d535c tempest-SnapshotDependencyTests-1696022310 None] casted to osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385 Aug 03 08:55:31 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-9b949d11-8969-4c97-b569-c170021d535c tempest-SnapshotDependencyTests-1696022310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-21c02779-4855-4574-9f0e-8c462065668f 1073741824 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:55:31 devstack sudo[114516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-21c02779-4855-4574-9f0e-8c462065668f 1073741824 Aug 03 08:55:31 devstack sudo[114516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:55:31 devstack cinder-volume[88899]: DEBUG cinder.volume.flows.manager.create_volume [None req-540cd88b-7adf-4bba-8abc-fed0c1c22bb1 tempest-ProjectReaderTests-1134321651 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88899) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 08:55:31 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-540cd88b-7adf-4bba-8abc-fed0c1c22bb1 tempest-ProjectReaderTests-1134321651 None] Flow 'volume_create_manager' (7f1cabf9-6086-4747-9b96-6fba6bd7d07d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:55:31 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-540cd88b-7adf-4bba-8abc-fed0c1c22bb1 tempest-ProjectReaderTests-1134321651 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1bc9da9d-cef5-45b7-af83-8f835b4fa7dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:55:31 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-540cd88b-7adf-4bba-8abc-fed0c1c22bb1 tempest-ProjectReaderTests-1134321651 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1bc9da9d-cef5-45b7-af83-8f835b4fa7dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:55:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1475788055',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e4ba846e-c728-4d43-b736-220e611afb05,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d1960effcf84b1d80da45b8e57d70f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:55:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:55:31Z,use_quota=True,user_id='552bc37e3b5740afaa307554a5a6c75f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8bde7129-1dc4-42ab-b852-ab32c61b4921),volume_type_id=8bde7129-1dc4-42ab-b852-ab32c61b4921)' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:55:31 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-540cd88b-7adf-4bba-8abc-fed0c1c22bb1 tempest-ProjectReaderTests-1134321651 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66149744-7521-4188-946a-fb68e9765728) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:55:31 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-540cd88b-7adf-4bba-8abc-fed0c1c22bb1 tempest-ProjectReaderTests-1134321651 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66149744-7521-4188-946a-fb68e9765728) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:55:31 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-540cd88b-7adf-4bba-8abc-fed0c1c22bb1 tempest-ProjectReaderTests-1134321651 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f24c61d-ca0d-4906-b96a-95cbcd5351df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:55:31 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-540cd88b-7adf-4bba-8abc-fed0c1c22bb1 tempest-ProjectReaderTests-1134321651 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f24c61d-ca0d-4906-b96a-95cbcd5351df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e4ba846e-c728-4d43-b736-220e611afb05', 'volume_name': 'volume-e4ba846e-c728-4d43-b736-220e611afb05', 'volume_size': 1}' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:55:31 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-540cd88b-7adf-4bba-8abc-fed0c1c22bb1 tempest-ProjectReaderTests-1134321651 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f0d5793-4237-45d6-a4f5-1161f5061d57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:55:31 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-540cd88b-7adf-4bba-8abc-fed0c1c22bb1 tempest-ProjectReaderTests-1134321651 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f0d5793-4237-45d6-a4f5-1161f5061d57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:55:31 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-540cd88b-7adf-4bba-8abc-fed0c1c22bb1 tempest-ProjectReaderTests-1134321651 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (64178c76-0bd7-4f57-b781-1da4e17dc37f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:55:31 devstack cinder-volume[88899]: INFO cinder.volume.flows.manager.create_volume [None req-540cd88b-7adf-4bba-8abc-fed0c1c22bb1 tempest-ProjectReaderTests-1134321651 None] Volume e4ba846e-c728-4d43-b736-220e611afb05: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e4ba846e-c728-4d43-b736-220e611afb05', 'volume_size': 1} Aug 03 08:55:31 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-540cd88b-7adf-4bba-8abc-fed0c1c22bb1 tempest-ProjectReaderTests-1134321651 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:55:31 devstack sudo[114516]: pam_unix(sudo:session): session closed for user root Aug 03 08:55:31 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-9b949d11-8969-4c97-b569-c170021d535c tempest-SnapshotDependencyTests-1696022310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-21c02779-4855-4574-9f0e-8c462065668f 1073741824" returned: 0 in 0.528s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:55:31 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-9b949d11-8969-4c97-b569-c170021d535c tempest-SnapshotDependencyTests-1696022310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-21c02779-4855-4574-9f0e-8c462065668f {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:55:31 devstack sudo[114522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-21c02779-4855-4574-9f0e-8c462065668f Aug 03 08:55:31 devstack sudo[114522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:55:32 devstack sudo[114522]: pam_unix(sudo:session): session closed for user root Aug 03 08:55:32 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-9b949d11-8969-4c97-b569-c170021d535c tempest-SnapshotDependencyTests-1696022310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-21c02779-4855-4574-9f0e-8c462065668f" returned: 0 in 0.299s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:55:32 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-9b949d11-8969-4c97-b569-c170021d535c tempest-SnapshotDependencyTests-1696022310 None] <== create_volume: return (881ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'} {{(pid=88899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 08:55:32 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-9b949d11-8969-4c97-b569-c170021d535c tempest-SnapshotDependencyTests-1696022310 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.885s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:55:32 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-540cd88b-7adf-4bba-8abc-fed0c1c22bb1 tempest-ProjectReaderTests-1134321651 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.591s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:55:32 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-540cd88b-7adf-4bba-8abc-fed0c1c22bb1 tempest-ProjectReaderTests-1134321651 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:55:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1475788055',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e4ba846e-c728-4d43-b736-220e611afb05,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d1960effcf84b1d80da45b8e57d70f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:55:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:55:31Z,use_quota=True,user_id='552bc37e3b5740afaa307554a5a6c75f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8bde7129-1dc4-42ab-b852-ab32c61b4921),volume_type_id=8bde7129-1dc4-42ab-b852-ab32c61b4921)}" {{(pid=88899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 08:55:32 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-540cd88b-7adf-4bba-8abc-fed0c1c22bb1 tempest-ProjectReaderTests-1134321651 None] Creating volume e4ba846e-c728-4d43-b736-220e611afb05 {{(pid=88899) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 08:55:32 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-540cd88b-7adf-4bba-8abc-fed0c1c22bb1 tempest-ProjectReaderTests-1134321651 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:55:32 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-540cd88b-7adf-4bba-8abc-fed0c1c22bb1 tempest-ProjectReaderTests-1134321651 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:55:32 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-540cd88b-7adf-4bba-8abc-fed0c1c22bb1 tempest-ProjectReaderTests-1134321651 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:55:32 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-540cd88b-7adf-4bba-8abc-fed0c1c22bb1 tempest-ProjectReaderTests-1134321651 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:55:32 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-540cd88b-7adf-4bba-8abc-fed0c1c22bb1 tempest-ProjectReaderTests-1134321651 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:55:32 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-540cd88b-7adf-4bba-8abc-fed0c1c22bb1 tempest-ProjectReaderTests-1134321651 None] Selected osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385 as target Quobyte volume. {{(pid=88899) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 08:55:32 devstack cinder-volume[88899]: INFO cinder.volume.drivers.remotefs [None req-540cd88b-7adf-4bba-8abc-fed0c1c22bb1 tempest-ProjectReaderTests-1134321651 None] casted to osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385 Aug 03 08:55:32 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-540cd88b-7adf-4bba-8abc-fed0c1c22bb1 tempest-ProjectReaderTests-1134321651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-e4ba846e-c728-4d43-b736-220e611afb05 1073741824 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:55:32 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-9b949d11-8969-4c97-b569-c170021d535c tempest-SnapshotDependencyTests-1696022310 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (22a07d70-31eb-451a-8fcc-43f83fc15bbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-21c02779-4855-4574-9f0e-8c462065668f', 'volume_size': 1}' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:55:32 devstack sudo[114525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-e4ba846e-c728-4d43-b736-220e611afb05 1073741824 Aug 03 08:55:32 devstack sudo[114525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:55:32 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-9b949d11-8969-4c97-b569-c170021d535c tempest-SnapshotDependencyTests-1696022310 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc8137a9-b3d7-4ef6-aaf1-843491633b2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:55:32 devstack cinder-volume[88899]: INFO cinder.volume.flows.manager.create_volume [None req-9b949d11-8969-4c97-b569-c170021d535c tempest-SnapshotDependencyTests-1696022310 None] Volume volume-21c02779-4855-4574-9f0e-8c462065668f (21c02779-4855-4574-9f0e-8c462065668f): created successfully Aug 03 08:55:32 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-9b949d11-8969-4c97-b569-c170021d535c tempest-SnapshotDependencyTests-1696022310 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc8137a9-b3d7-4ef6-aaf1-843491633b2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:55:32 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-9b949d11-8969-4c97-b569-c170021d535c tempest-SnapshotDependencyTests-1696022310 None] Flow 'volume_create_manager' (39a6038e-4c4d-4204-83f4-72285a949755) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:55:32 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-9b949d11-8969-4c97-b569-c170021d535c tempest-SnapshotDependencyTests-1696022310 None] Created volume successfully. Aug 03 08:55:32 devstack sudo[114525]: pam_unix(sudo:session): session closed for user root Aug 03 08:55:32 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-540cd88b-7adf-4bba-8abc-fed0c1c22bb1 tempest-ProjectReaderTests-1134321651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-e4ba846e-c728-4d43-b736-220e611afb05 1073741824" returned: 0 in 0.594s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:55:32 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-540cd88b-7adf-4bba-8abc-fed0c1c22bb1 tempest-ProjectReaderTests-1134321651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-e4ba846e-c728-4d43-b736-220e611afb05 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:55:32 devstack cinder-volume[88899]: DEBUG cinder.volume.flows.manager.create_volume [None req-72951925-8f02-47e3-9dd1-efe8fc9a1b7a tempest-ProjectReaderTests-1353959271 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88899) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 08:55:32 devstack sudo[114533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-e4ba846e-c728-4d43-b736-220e611afb05 Aug 03 08:55:32 devstack sudo[114533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:55:32 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-72951925-8f02-47e3-9dd1-efe8fc9a1b7a tempest-ProjectReaderTests-1353959271 None] Flow 'volume_create_manager' (e2f86118-2280-4045-b53d-a21bb6e58d9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:55:32 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-72951925-8f02-47e3-9dd1-efe8fc9a1b7a tempest-ProjectReaderTests-1353959271 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (18335bcc-ce22-484c-9c0a-379587374992) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:55:32 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-72951925-8f02-47e3-9dd1-efe8fc9a1b7a tempest-ProjectReaderTests-1353959271 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (18335bcc-ce22-484c-9c0a-379587374992) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:55:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-83479383',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dba72a1e-01d5-4b00-a3d3-80b49986da7b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1de8a20793441b1a76775dea64e3d54',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:55:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:55:33Z,use_quota=True,user_id='b1063f9d56ce4710a40ae88274bca0ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8bde7129-1dc4-42ab-b852-ab32c61b4921),volume_type_id=8bde7129-1dc4-42ab-b852-ab32c61b4921)' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:55:32 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-72951925-8f02-47e3-9dd1-efe8fc9a1b7a tempest-ProjectReaderTests-1353959271 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc6589b8-fc94-4c22-b6f1-c3909fa49cbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:55:32 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-72951925-8f02-47e3-9dd1-efe8fc9a1b7a tempest-ProjectReaderTests-1353959271 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc6589b8-fc94-4c22-b6f1-c3909fa49cbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:55:32 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-72951925-8f02-47e3-9dd1-efe8fc9a1b7a tempest-ProjectReaderTests-1353959271 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b1bed87-0290-4873-8e99-3ca08871a773) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:55:32 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-72951925-8f02-47e3-9dd1-efe8fc9a1b7a tempest-ProjectReaderTests-1353959271 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b1bed87-0290-4873-8e99-3ca08871a773) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dba72a1e-01d5-4b00-a3d3-80b49986da7b', 'volume_name': 'volume-dba72a1e-01d5-4b00-a3d3-80b49986da7b', 'volume_size': 1}' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:55:32 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-72951925-8f02-47e3-9dd1-efe8fc9a1b7a tempest-ProjectReaderTests-1353959271 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60fe08de-cb07-474f-9fa8-a7b047b3dc54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:55:32 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-72951925-8f02-47e3-9dd1-efe8fc9a1b7a tempest-ProjectReaderTests-1353959271 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60fe08de-cb07-474f-9fa8-a7b047b3dc54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:55:32 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-72951925-8f02-47e3-9dd1-efe8fc9a1b7a tempest-ProjectReaderTests-1353959271 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5226eb3-68a2-49b7-932c-52037dca9a98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:55:32 devstack cinder-volume[88899]: INFO cinder.volume.flows.manager.create_volume [None req-72951925-8f02-47e3-9dd1-efe8fc9a1b7a tempest-ProjectReaderTests-1353959271 None] Volume dba72a1e-01d5-4b00-a3d3-80b49986da7b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dba72a1e-01d5-4b00-a3d3-80b49986da7b', 'volume_size': 1} Aug 03 08:55:32 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-72951925-8f02-47e3-9dd1-efe8fc9a1b7a tempest-ProjectReaderTests-1353959271 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:55:33 devstack sudo[114533]: pam_unix(sudo:session): session closed for user root Aug 03 08:55:33 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-540cd88b-7adf-4bba-8abc-fed0c1c22bb1 tempest-ProjectReaderTests-1134321651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-e4ba846e-c728-4d43-b736-220e611afb05" returned: 0 in 0.291s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:55:33 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-540cd88b-7adf-4bba-8abc-fed0c1c22bb1 tempest-ProjectReaderTests-1134321651 None] <== create_volume: return (950ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'} {{(pid=88899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 08:55:33 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-540cd88b-7adf-4bba-8abc-fed0c1c22bb1 tempest-ProjectReaderTests-1134321651 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.954s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:55:33 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-72951925-8f02-47e3-9dd1-efe8fc9a1b7a tempest-ProjectReaderTests-1353959271 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.187s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:55:33 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-72951925-8f02-47e3-9dd1-efe8fc9a1b7a tempest-ProjectReaderTests-1353959271 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:55:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-83479383',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dba72a1e-01d5-4b00-a3d3-80b49986da7b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1de8a20793441b1a76775dea64e3d54',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:55:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:55:33Z,use_quota=True,user_id='b1063f9d56ce4710a40ae88274bca0ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8bde7129-1dc4-42ab-b852-ab32c61b4921),volume_type_id=8bde7129-1dc4-42ab-b852-ab32c61b4921)}" {{(pid=88899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 08:55:33 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-72951925-8f02-47e3-9dd1-efe8fc9a1b7a tempest-ProjectReaderTests-1353959271 None] Creating volume dba72a1e-01d5-4b00-a3d3-80b49986da7b {{(pid=88899) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 08:55:33 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-72951925-8f02-47e3-9dd1-efe8fc9a1b7a tempest-ProjectReaderTests-1353959271 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:55:33 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-72951925-8f02-47e3-9dd1-efe8fc9a1b7a tempest-ProjectReaderTests-1353959271 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:55:33 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-72951925-8f02-47e3-9dd1-efe8fc9a1b7a tempest-ProjectReaderTests-1353959271 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:55:33 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-72951925-8f02-47e3-9dd1-efe8fc9a1b7a tempest-ProjectReaderTests-1353959271 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:55:33 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-72951925-8f02-47e3-9dd1-efe8fc9a1b7a tempest-ProjectReaderTests-1353959271 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:55:33 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-72951925-8f02-47e3-9dd1-efe8fc9a1b7a tempest-ProjectReaderTests-1353959271 None] Selected osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385 as target Quobyte volume. {{(pid=88899) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 08:55:33 devstack cinder-volume[88899]: INFO cinder.volume.drivers.remotefs [None req-72951925-8f02-47e3-9dd1-efe8fc9a1b7a tempest-ProjectReaderTests-1353959271 None] casted to osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385 Aug 03 08:55:33 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-72951925-8f02-47e3-9dd1-efe8fc9a1b7a tempest-ProjectReaderTests-1353959271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-dba72a1e-01d5-4b00-a3d3-80b49986da7b 1073741824 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:55:33 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-540cd88b-7adf-4bba-8abc-fed0c1c22bb1 tempest-ProjectReaderTests-1134321651 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (64178c76-0bd7-4f57-b781-1da4e17dc37f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e4ba846e-c728-4d43-b736-220e611afb05', 'volume_size': 1}' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:55:33 devstack sudo[114536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-dba72a1e-01d5-4b00-a3d3-80b49986da7b 1073741824 Aug 03 08:55:33 devstack sudo[114536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:55:33 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-540cd88b-7adf-4bba-8abc-fed0c1c22bb1 tempest-ProjectReaderTests-1134321651 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5835ceee-eff6-43c6-a9ce-08168e5eb8c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:55:33 devstack cinder-volume[88899]: INFO cinder.volume.flows.manager.create_volume [None req-540cd88b-7adf-4bba-8abc-fed0c1c22bb1 tempest-ProjectReaderTests-1134321651 None] Volume volume-e4ba846e-c728-4d43-b736-220e611afb05 (e4ba846e-c728-4d43-b736-220e611afb05): created successfully Aug 03 08:55:33 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-540cd88b-7adf-4bba-8abc-fed0c1c22bb1 tempest-ProjectReaderTests-1134321651 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5835ceee-eff6-43c6-a9ce-08168e5eb8c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:55:33 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-540cd88b-7adf-4bba-8abc-fed0c1c22bb1 tempest-ProjectReaderTests-1134321651 None] Flow 'volume_create_manager' (7f1cabf9-6086-4747-9b96-6fba6bd7d07d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:55:33 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-540cd88b-7adf-4bba-8abc-fed0c1c22bb1 tempest-ProjectReaderTests-1134321651 None] Created volume successfully. Aug 03 08:55:33 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-060ad9a1-d6a8-4c0f-bfc4-a170348ea395 tempest-SnapshotDependencyTests-1696022310 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:55:33 devstack sudo[114536]: pam_unix(sudo:session): session closed for user root Aug 03 08:55:33 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-72951925-8f02-47e3-9dd1-efe8fc9a1b7a tempest-ProjectReaderTests-1353959271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-dba72a1e-01d5-4b00-a3d3-80b49986da7b 1073741824" returned: 0 in 0.659s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:55:33 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-0eedcaa6-51f1-4f35-bfe2-82932c83acb1 tempest-ProjectReaderTests-1134321651 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:55:33 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-72951925-8f02-47e3-9dd1-efe8fc9a1b7a tempest-ProjectReaderTests-1353959271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-dba72a1e-01d5-4b00-a3d3-80b49986da7b {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:55:33 devstack sudo[114543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-dba72a1e-01d5-4b00-a3d3-80b49986da7b Aug 03 08:55:33 devstack sudo[114543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:55:34 devstack sudo[114543]: pam_unix(sudo:session): session closed for user root Aug 03 08:55:34 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-72951925-8f02-47e3-9dd1-efe8fc9a1b7a tempest-ProjectReaderTests-1353959271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-dba72a1e-01d5-4b00-a3d3-80b49986da7b" returned: 0 in 0.269s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:55:34 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-72951925-8f02-47e3-9dd1-efe8fc9a1b7a tempest-ProjectReaderTests-1353959271 None] <== create_volume: return (1015ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'} {{(pid=88899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 08:55:34 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-72951925-8f02-47e3-9dd1-efe8fc9a1b7a tempest-ProjectReaderTests-1353959271 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.018s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:55:34 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-060ad9a1-d6a8-4c0f-bfc4-a170348ea395 tempest-SnapshotDependencyTests-1696022310 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.470s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:55:34 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-72951925-8f02-47e3-9dd1-efe8fc9a1b7a tempest-ProjectReaderTests-1353959271 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5226eb3-68a2-49b7-932c-52037dca9a98) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dba72a1e-01d5-4b00-a3d3-80b49986da7b', 'volume_size': 1}' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:55:34 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-72951925-8f02-47e3-9dd1-efe8fc9a1b7a tempest-ProjectReaderTests-1353959271 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a214789d-77fd-4879-82cb-90ab816be8b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:55:34 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-060ad9a1-d6a8-4c0f-bfc4-a170348ea395 tempest-SnapshotDependencyTests-1696022310 None] Creating offline snapshot 9c09939e-ef10-4351-9202-b64aa588e558 of volume 21c02779-4855-4574-9f0e-8c462065668f {{(pid=88899) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 03 08:55:34 devstack cinder-volume[88899]: INFO cinder.volume.flows.manager.create_volume [None req-72951925-8f02-47e3-9dd1-efe8fc9a1b7a tempest-ProjectReaderTests-1353959271 None] Volume volume-dba72a1e-01d5-4b00-a3d3-80b49986da7b (dba72a1e-01d5-4b00-a3d3-80b49986da7b): created successfully Aug 03 08:55:34 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-72951925-8f02-47e3-9dd1-efe8fc9a1b7a tempest-ProjectReaderTests-1353959271 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a214789d-77fd-4879-82cb-90ab816be8b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:55:34 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-72951925-8f02-47e3-9dd1-efe8fc9a1b7a tempest-ProjectReaderTests-1353959271 None] Flow 'volume_create_manager' (e2f86118-2280-4045-b53d-a21bb6e58d9f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:55:34 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[01383871-99a9-45ed-afd0-9c0a71bbebfc]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:55:34 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-060ad9a1-d6a8-4c0f-bfc4-a170348ea395 tempest-SnapshotDependencyTests-1696022310 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-21c02779-4855-4574-9f0e-8c462065668f {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:55:34 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-72951925-8f02-47e3-9dd1-efe8fc9a1b7a tempest-ProjectReaderTests-1353959271 None] Created volume successfully. Aug 03 08:55:34 devstack sudo[114546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-21c02779-4855-4574-9f0e-8c462065668f Aug 03 08:55:34 devstack sudo[114546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:55:34 devstack sudo[114546]: pam_unix(sudo:session): session closed for user root Aug 03 08:55:34 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-060ad9a1-d6a8-4c0f-bfc4-a170348ea395 tempest-SnapshotDependencyTests-1696022310 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-21c02779-4855-4574-9f0e-8c462065668f" returned: 0 in 0.399s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:55:34 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-060ad9a1-d6a8-4c0f-bfc4-a170348ea395 tempest-SnapshotDependencyTests-1696022310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-21c02779-4855-4574-9f0e-8c462065668f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-21c02779-4855-4574-9f0e-8c462065668f.9c09939e-ef10-4351-9202-b64aa588e558 1G {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:55:34 devstack sudo[114551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-21c02779-4855-4574-9f0e-8c462065668f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-21c02779-4855-4574-9f0e-8c462065668f.9c09939e-ef10-4351-9202-b64aa588e558 1G Aug 03 08:55:34 devstack sudo[114551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:55:35 devstack sudo[114551]: pam_unix(sudo:session): session closed for user root Aug 03 08:55:35 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-060ad9a1-d6a8-4c0f-bfc4-a170348ea395 tempest-SnapshotDependencyTests-1696022310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-21c02779-4855-4574-9f0e-8c462065668f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-21c02779-4855-4574-9f0e-8c462065668f.9c09939e-ef10-4351-9202-b64aa588e558 1G" returned: 0 in 0.500s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:55:35 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-060ad9a1-d6a8-4c0f-bfc4-a170348ea395 tempest-SnapshotDependencyTests-1696022310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-21c02779-4855-4574-9f0e-8c462065668f -F qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-21c02779-4855-4574-9f0e-8c462065668f.9c09939e-ef10-4351-9202-b64aa588e558 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:55:35 devstack sudo[114556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-21c02779-4855-4574-9f0e-8c462065668f -F qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-21c02779-4855-4574-9f0e-8c462065668f.9c09939e-ef10-4351-9202-b64aa588e558 Aug 03 08:55:35 devstack sudo[114556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:55:35 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-81f9954a-3920-4c32-8300-4440308e02af tempest-ProjectReaderTests-1353959271 None] Acquiring lock "cinder-dba72a1e-01d5-4b00-a3d3-80b49986da7b-delete_volume" by "delete_volume" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:55:35 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-81f9954a-3920-4c32-8300-4440308e02af tempest-ProjectReaderTests-1353959271 None] Lock "cinder-dba72a1e-01d5-4b00-a3d3-80b49986da7b-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:55:35 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-81f9954a-3920-4c32-8300-4440308e02af tempest-ProjectReaderTests-1353959271 None] Acquiring lock "cinder-quobyte-dba72a1e-01d5-4b00-a3d3-80b49986da7b" by "delete_volume" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:55:35 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-81f9954a-3920-4c32-8300-4440308e02af tempest-ProjectReaderTests-1353959271 None] Lock "cinder-quobyte-dba72a1e-01d5-4b00-a3d3-80b49986da7b" acquired by "delete_volume" :: waited 0.026s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:55:35 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[21b18701-ca99-4ef2-9d10-9333a75996ce]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:55:35 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-81f9954a-3920-4c32-8300-4440308e02af tempest-ProjectReaderTests-1353959271 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-dba72a1e-01d5-4b00-a3d3-80b49986da7b {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:55:35 devstack sudo[114556]: pam_unix(sudo:session): session closed for user root Aug 03 08:55:35 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-060ad9a1-d6a8-4c0f-bfc4-a170348ea395 tempest-SnapshotDependencyTests-1696022310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-21c02779-4855-4574-9f0e-8c462065668f -F qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-21c02779-4855-4574-9f0e-8c462065668f.9c09939e-ef10-4351-9202-b64aa588e558" returned: 0 in 0.344s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:55:35 devstack cinder-volume[88899]: WARNING cinder.volume.drivers.remotefs [None req-060ad9a1-d6a8-4c0f-bfc4-a170348ea395 tempest-SnapshotDependencyTests-1696022310 None] /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-21c02779-4855-4574-9f0e-8c462065668f.9c09939e-ef10-4351-9202-b64aa588e558 is being set with open permissions: ugo+rw Aug 03 08:55:35 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-060ad9a1-d6a8-4c0f-bfc4-a170348ea395 tempest-SnapshotDependencyTests-1696022310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-21c02779-4855-4574-9f0e-8c462065668f.9c09939e-ef10-4351-9202-b64aa588e558 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:55:35 devstack sudo[114563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-21c02779-4855-4574-9f0e-8c462065668f.9c09939e-ef10-4351-9202-b64aa588e558 Aug 03 08:55:35 devstack sudo[114563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:55:35 devstack sudo[114560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-dba72a1e-01d5-4b00-a3d3-80b49986da7b Aug 03 08:55:35 devstack sudo[114560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:55:35 devstack sudo[114563]: pam_unix(sudo:session): session closed for user root Aug 03 08:55:35 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-060ad9a1-d6a8-4c0f-bfc4-a170348ea395 tempest-SnapshotDependencyTests-1696022310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-21c02779-4855-4574-9f0e-8c462065668f.9c09939e-ef10-4351-9202-b64aa588e558" returned: 0 in 0.272s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:55:35 devstack sudo[114560]: pam_unix(sudo:session): session closed for user root Aug 03 08:55:35 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-81f9954a-3920-4c32-8300-4440308e02af tempest-ProjectReaderTests-1353959271 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-dba72a1e-01d5-4b00-a3d3-80b49986da7b" returned: 0 in 0.388s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:55:35 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-81f9954a-3920-4c32-8300-4440308e02af tempest-ProjectReaderTests-1353959271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-dba72a1e-01d5-4b00-a3d3-80b49986da7b {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:55:35 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-060ad9a1-d6a8-4c0f-bfc4-a170348ea395 tempest-SnapshotDependencyTests-1696022310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-21c02779-4855-4574-9f0e-8c462065668f.info {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:55:35 devstack sudo[114570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-dba72a1e-01d5-4b00-a3d3-80b49986da7b Aug 03 08:55:35 devstack sudo[114570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:55:35 devstack sudo[114571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-21c02779-4855-4574-9f0e-8c462065668f.info Aug 03 08:55:35 devstack sudo[114571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:55:36 devstack sudo[114571]: pam_unix(sudo:session): session closed for user root Aug 03 08:55:36 devstack sudo[114570]: pam_unix(sudo:session): session closed for user root Aug 03 08:55:36 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-81f9954a-3920-4c32-8300-4440308e02af tempest-ProjectReaderTests-1353959271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-dba72a1e-01d5-4b00-a3d3-80b49986da7b" returned: 0 in 0.283s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:55:36 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-060ad9a1-d6a8-4c0f-bfc4-a170348ea395 tempest-SnapshotDependencyTests-1696022310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-21c02779-4855-4574-9f0e-8c462065668f.info" returned: 0 in 0.275s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:55:36 devstack cinder-volume[88899]: WARNING cinder.volume.drivers.remotefs [None req-060ad9a1-d6a8-4c0f-bfc4-a170348ea395 tempest-SnapshotDependencyTests-1696022310 None] /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-21c02779-4855-4574-9f0e-8c462065668f.info is being set with open permissions: ugo+rw Aug 03 08:55:36 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-060ad9a1-d6a8-4c0f-bfc4-a170348ea395 tempest-SnapshotDependencyTests-1696022310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-21c02779-4855-4574-9f0e-8c462065668f.info {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:55:36 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-81f9954a-3920-4c32-8300-4440308e02af tempest-ProjectReaderTests-1353959271 None] Lock "cinder-quobyte-dba72a1e-01d5-4b00-a3d3-80b49986da7b" released by "delete_volume" :: held 0.730s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:55:36 devstack sudo[114576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-21c02779-4855-4574-9f0e-8c462065668f.info Aug 03 08:55:36 devstack sudo[114576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:55:36 devstack cinder-volume[88899]: DEBUG cinder.quota [None req-81f9954a-3920-4c32-8300-4440308e02af tempest-ProjectReaderTests-1353959271 None] Created reservations ['c7ff773b-6aa3-4f83-97c5-c6a8883b95e2', '1ac5ccaa-b875-4f1c-a117-1237f05860c9', '5251a82d-7eaa-42af-93d4-b91b0dee6fd2', '3fb673d1-ae5a-4b66-ba2d-ac61e1afd025'] {{(pid=88899) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 08:55:36 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-81f9954a-3920-4c32-8300-4440308e02af tempest-ProjectReaderTests-1353959271 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:55:36 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-81f9954a-3920-4c32-8300-4440308e02af tempest-ProjectReaderTests-1353959271 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:55:36 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-81f9954a-3920-4c32-8300-4440308e02af tempest-ProjectReaderTests-1353959271 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:55:36 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-81f9954a-3920-4c32-8300-4440308e02af tempest-ProjectReaderTests-1353959271 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:55:36 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-81f9954a-3920-4c32-8300-4440308e02af tempest-ProjectReaderTests-1353959271 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:55:36 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-81f9954a-3920-4c32-8300-4440308e02af tempest-ProjectReaderTests-1353959271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:55:36 devstack sudo[114578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a Aug 03 08:55:36 devstack sudo[114578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:55:36 devstack sudo[114576]: pam_unix(sudo:session): session closed for user root Aug 03 08:55:36 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-060ad9a1-d6a8-4c0f-bfc4-a170348ea395 tempest-SnapshotDependencyTests-1696022310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-21c02779-4855-4574-9f0e-8c462065668f.info" returned: 0 in 0.414s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:55:36 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-060ad9a1-d6a8-4c0f-bfc4-a170348ea395 tempest-SnapshotDependencyTests-1696022310 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.338s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:55:36 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-0eedcaa6-51f1-4f35-bfe2-82932c83acb1 tempest-ProjectReaderTests-1134321651 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.622s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:55:36 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-0eedcaa6-51f1-4f35-bfe2-82932c83acb1 tempest-ProjectReaderTests-1134321651 None] Creating offline snapshot 0f86a174-e85f-46cf-b5e3-ecbf47a5ee46 of volume e4ba846e-c728-4d43-b736-220e611afb05 {{(pid=88899) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 03 08:55:36 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8c7f3ee-095c-4b48-8e5a-95b2c6ea90a2]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:55:36 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-0eedcaa6-51f1-4f35-bfe2-82932c83acb1 tempest-ProjectReaderTests-1134321651 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-e4ba846e-c728-4d43-b736-220e611afb05 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:55:36 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-060ad9a1-d6a8-4c0f-bfc4-a170348ea395 tempest-SnapshotDependencyTests-1696022310 None] Create snapshot completed successfully Aug 03 08:55:36 devstack sudo[114578]: pam_unix(sudo:session): session closed for user root Aug 03 08:55:36 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-81f9954a-3920-4c32-8300-4440308e02af tempest-ProjectReaderTests-1353959271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a" returned: 0 in 0.395s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:55:36 devstack cinder-volume[88899]: DEBUG cinder.manager [None req-81f9954a-3920-4c32-8300-4440308e02af tempest-ProjectReaderTests-1353959271 None] Notifying Schedulers of capabilities ... {{(pid=88899) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 08:55:36 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-81f9954a-3920-4c32-8300-4440308e02af tempest-ProjectReaderTests-1353959271 None] Deleted volume successfully. Aug 03 08:55:36 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-81f9954a-3920-4c32-8300-4440308e02af tempest-ProjectReaderTests-1353959271 None] Lock "cinder-dba72a1e-01d5-4b00-a3d3-80b49986da7b-delete_volume" released by "delete_volume" :: held 1.422s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:55:36 devstack sudo[114581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-e4ba846e-c728-4d43-b736-220e611afb05 Aug 03 08:55:36 devstack sudo[114581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:55:36 devstack sudo[114581]: pam_unix(sudo:session): session closed for user root Aug 03 08:55:37 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-0eedcaa6-51f1-4f35-bfe2-82932c83acb1 tempest-ProjectReaderTests-1134321651 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-e4ba846e-c728-4d43-b736-220e611afb05" returned: 0 in 0.473s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:55:37 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-0eedcaa6-51f1-4f35-bfe2-82932c83acb1 tempest-ProjectReaderTests-1134321651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-e4ba846e-c728-4d43-b736-220e611afb05,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-e4ba846e-c728-4d43-b736-220e611afb05.0f86a174-e85f-46cf-b5e3-ecbf47a5ee46 1G {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:55:37 devstack sudo[114587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-e4ba846e-c728-4d43-b736-220e611afb05,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-e4ba846e-c728-4d43-b736-220e611afb05.0f86a174-e85f-46cf-b5e3-ecbf47a5ee46 1G Aug 03 08:55:37 devstack sudo[114587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:55:37 devstack cinder-volume[88899]: DEBUG cinder.volume.flows.manager.create_volume [None req-db81162f-41a1-4746-a5fb-f9956ff152af tempest-ProjectReaderTests-1353959271 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88899) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 08:55:37 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-db81162f-41a1-4746-a5fb-f9956ff152af tempest-ProjectReaderTests-1353959271 None] Flow 'volume_create_manager' (d285e691-cf41-409b-9558-44e6f0d37b86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:55:37 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-db81162f-41a1-4746-a5fb-f9956ff152af tempest-ProjectReaderTests-1353959271 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2758f351-cde0-48f6-80eb-0fb1459f6f67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:55:37 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-db81162f-41a1-4746-a5fb-f9956ff152af tempest-ProjectReaderTests-1353959271 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2758f351-cde0-48f6-80eb-0fb1459f6f67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:55:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-867251191',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2c236464-d25d-462f-8626-466415750d16,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1de8a20793441b1a76775dea64e3d54',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:55:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:55:37Z,use_quota=True,user_id='b1063f9d56ce4710a40ae88274bca0ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8bde7129-1dc4-42ab-b852-ab32c61b4921),volume_type_id=8bde7129-1dc4-42ab-b852-ab32c61b4921)' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:55:37 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-db81162f-41a1-4746-a5fb-f9956ff152af tempest-ProjectReaderTests-1353959271 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea05c142-0f8d-4a51-90e1-7b5b767ceb96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:55:37 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-db81162f-41a1-4746-a5fb-f9956ff152af tempest-ProjectReaderTests-1353959271 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea05c142-0f8d-4a51-90e1-7b5b767ceb96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:55:37 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-db81162f-41a1-4746-a5fb-f9956ff152af tempest-ProjectReaderTests-1353959271 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ef66ae3-24f6-44c6-a4e6-0246cffab9e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:55:37 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-db81162f-41a1-4746-a5fb-f9956ff152af tempest-ProjectReaderTests-1353959271 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ef66ae3-24f6-44c6-a4e6-0246cffab9e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2c236464-d25d-462f-8626-466415750d16', 'volume_name': 'volume-2c236464-d25d-462f-8626-466415750d16', 'volume_size': 1}' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:55:37 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-db81162f-41a1-4746-a5fb-f9956ff152af tempest-ProjectReaderTests-1353959271 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (57ea66bb-6b97-4c68-ac64-c0c40a6a29e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:55:37 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-db81162f-41a1-4746-a5fb-f9956ff152af tempest-ProjectReaderTests-1353959271 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (57ea66bb-6b97-4c68-ac64-c0c40a6a29e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:55:37 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-db81162f-41a1-4746-a5fb-f9956ff152af tempest-ProjectReaderTests-1353959271 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b36f800-30df-4b0f-a39f-9f06b9816fb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:55:37 devstack cinder-volume[88899]: INFO cinder.volume.flows.manager.create_volume [None req-db81162f-41a1-4746-a5fb-f9956ff152af tempest-ProjectReaderTests-1353959271 None] Volume 2c236464-d25d-462f-8626-466415750d16: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2c236464-d25d-462f-8626-466415750d16', 'volume_size': 1} Aug 03 08:55:37 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-db81162f-41a1-4746-a5fb-f9956ff152af tempest-ProjectReaderTests-1353959271 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:55:37 devstack sudo[114587]: pam_unix(sudo:session): session closed for user root Aug 03 08:55:37 devstack cinder-volume[88899]: DEBUG cinder.volume.flows.manager.create_volume [None req-329fdbd2-3dfa-40c2-8f39-c4e37551e634 tempest-SnapshotDependencyTests-1696022310 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88899) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 08:55:37 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-0eedcaa6-51f1-4f35-bfe2-82932c83acb1 tempest-ProjectReaderTests-1134321651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-e4ba846e-c728-4d43-b736-220e611afb05,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-e4ba846e-c728-4d43-b736-220e611afb05.0f86a174-e85f-46cf-b5e3-ecbf47a5ee46 1G" returned: 0 in 0.684s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:55:37 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-0eedcaa6-51f1-4f35-bfe2-82932c83acb1 tempest-ProjectReaderTests-1134321651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e4ba846e-c728-4d43-b736-220e611afb05 -F qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-e4ba846e-c728-4d43-b736-220e611afb05.0f86a174-e85f-46cf-b5e3-ecbf47a5ee46 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:55:37 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-329fdbd2-3dfa-40c2-8f39-c4e37551e634 tempest-SnapshotDependencyTests-1696022310 None] Flow 'volume_create_manager' (f6eaa7a9-f2b5-4e78-bab9-bb5501dccec8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:55:37 devstack sudo[114593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e4ba846e-c728-4d43-b736-220e611afb05 -F qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-e4ba846e-c728-4d43-b736-220e611afb05.0f86a174-e85f-46cf-b5e3-ecbf47a5ee46 Aug 03 08:55:37 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-329fdbd2-3dfa-40c2-8f39-c4e37551e634 tempest-SnapshotDependencyTests-1696022310 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ef7ea7a-58a5-49a3-b180-300ecb2301fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:55:37 devstack sudo[114593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:55:37 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-329fdbd2-3dfa-40c2-8f39-c4e37551e634 tempest-SnapshotDependencyTests-1696022310 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ef7ea7a-58a5-49a3-b180-300ecb2301fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:55:37Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=61b3f940-c314-4cfd-b250-bfee499ad2ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f7ac40c7e309498ca4806de0ce2c354a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:55:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=9c09939e-ef10-4351-9202-b64aa588e558,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:55:38Z,use_quota=True,user_id='b7403ab998f24276a33f1147fee7f751',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8bde7129-1dc4-42ab-b852-ab32c61b4921),volume_type_id=8bde7129-1dc4-42ab-b852-ab32c61b4921)' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:55:37 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-329fdbd2-3dfa-40c2-8f39-c4e37551e634 tempest-SnapshotDependencyTests-1696022310 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (88581836-e27f-46ac-b200-ee69ddac14e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:55:37 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-329fdbd2-3dfa-40c2-8f39-c4e37551e634 tempest-SnapshotDependencyTests-1696022310 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (88581836-e27f-46ac-b200-ee69ddac14e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:55:37 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-329fdbd2-3dfa-40c2-8f39-c4e37551e634 tempest-SnapshotDependencyTests-1696022310 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af2375c8-8f17-444a-b484-7cefced40f65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:55:37 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-329fdbd2-3dfa-40c2-8f39-c4e37551e634 tempest-SnapshotDependencyTests-1696022310 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af2375c8-8f17-444a-b484-7cefced40f65) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '61b3f940-c314-4cfd-b250-bfee499ad2ed', 'volume_name': 'volume-61b3f940-c314-4cfd-b250-bfee499ad2ed', 'volume_size': 1, 'snapshot_id': '9c09939e-ef10-4351-9202-b64aa588e558'}' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:55:37 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-329fdbd2-3dfa-40c2-8f39-c4e37551e634 tempest-SnapshotDependencyTests-1696022310 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (364fb987-f156-4a08-8d90-a3f2750d778d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:55:37 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-329fdbd2-3dfa-40c2-8f39-c4e37551e634 tempest-SnapshotDependencyTests-1696022310 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (364fb987-f156-4a08-8d90-a3f2750d778d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:55:37 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-329fdbd2-3dfa-40c2-8f39-c4e37551e634 tempest-SnapshotDependencyTests-1696022310 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (860fb059-cc74-40a8-b141-3149d8c44959) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:55:37 devstack cinder-volume[88899]: INFO cinder.volume.flows.manager.create_volume [None req-329fdbd2-3dfa-40c2-8f39-c4e37551e634 tempest-SnapshotDependencyTests-1696022310 None] Volume 61b3f940-c314-4cfd-b250-bfee499ad2ed: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-61b3f940-c314-4cfd-b250-bfee499ad2ed', 'volume_size': 1, 'snapshot_id': '9c09939e-ef10-4351-9202-b64aa588e558'} Aug 03 08:55:37 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-329fdbd2-3dfa-40c2-8f39-c4e37551e634 tempest-SnapshotDependencyTests-1696022310 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:55:38 devstack sudo[114593]: pam_unix(sudo:session): session closed for user root Aug 03 08:55:38 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-0eedcaa6-51f1-4f35-bfe2-82932c83acb1 tempest-ProjectReaderTests-1134321651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e4ba846e-c728-4d43-b736-220e611afb05 -F qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-e4ba846e-c728-4d43-b736-220e611afb05.0f86a174-e85f-46cf-b5e3-ecbf47a5ee46" returned: 0 in 0.391s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:55:38 devstack cinder-volume[88899]: WARNING cinder.volume.drivers.remotefs [None req-0eedcaa6-51f1-4f35-bfe2-82932c83acb1 tempest-ProjectReaderTests-1134321651 None] /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-e4ba846e-c728-4d43-b736-220e611afb05.0f86a174-e85f-46cf-b5e3-ecbf47a5ee46 is being set with open permissions: ugo+rw Aug 03 08:55:38 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-0eedcaa6-51f1-4f35-bfe2-82932c83acb1 tempest-ProjectReaderTests-1134321651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-e4ba846e-c728-4d43-b736-220e611afb05.0f86a174-e85f-46cf-b5e3-ecbf47a5ee46 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:55:38 devstack sudo[114598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-e4ba846e-c728-4d43-b736-220e611afb05.0f86a174-e85f-46cf-b5e3-ecbf47a5ee46 Aug 03 08:55:38 devstack sudo[114598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:55:38 devstack sudo[114598]: pam_unix(sudo:session): session closed for user root Aug 03 08:55:38 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-0eedcaa6-51f1-4f35-bfe2-82932c83acb1 tempest-ProjectReaderTests-1134321651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-e4ba846e-c728-4d43-b736-220e611afb05.0f86a174-e85f-46cf-b5e3-ecbf47a5ee46" returned: 0 in 0.272s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:55:38 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-0eedcaa6-51f1-4f35-bfe2-82932c83acb1 tempest-ProjectReaderTests-1134321651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-e4ba846e-c728-4d43-b736-220e611afb05.info {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:55:38 devstack sudo[114601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-e4ba846e-c728-4d43-b736-220e611afb05.info Aug 03 08:55:38 devstack sudo[114601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:55:38 devstack sudo[114601]: pam_unix(sudo:session): session closed for user root Aug 03 08:55:38 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-0eedcaa6-51f1-4f35-bfe2-82932c83acb1 tempest-ProjectReaderTests-1134321651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-e4ba846e-c728-4d43-b736-220e611afb05.info" returned: 0 in 0.270s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:55:38 devstack cinder-volume[88899]: WARNING cinder.volume.drivers.remotefs [None req-0eedcaa6-51f1-4f35-bfe2-82932c83acb1 tempest-ProjectReaderTests-1134321651 None] /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-e4ba846e-c728-4d43-b736-220e611afb05.info is being set with open permissions: ugo+rw Aug 03 08:55:38 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-0eedcaa6-51f1-4f35-bfe2-82932c83acb1 tempest-ProjectReaderTests-1134321651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-e4ba846e-c728-4d43-b736-220e611afb05.info {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:55:38 devstack sudo[114604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-e4ba846e-c728-4d43-b736-220e611afb05.info Aug 03 08:55:38 devstack sudo[114604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:55:38 devstack sudo[114604]: pam_unix(sudo:session): session closed for user root Aug 03 08:55:38 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-0eedcaa6-51f1-4f35-bfe2-82932c83acb1 tempest-ProjectReaderTests-1134321651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-e4ba846e-c728-4d43-b736-220e611afb05.info" returned: 0 in 0.253s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:55:38 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-0eedcaa6-51f1-4f35-bfe2-82932c83acb1 tempest-ProjectReaderTests-1134321651 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.447s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:55:38 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-db81162f-41a1-4746-a5fb-f9956ff152af tempest-ProjectReaderTests-1353959271 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.641s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:55:38 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-db81162f-41a1-4746-a5fb-f9956ff152af tempest-ProjectReaderTests-1353959271 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:55:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-867251191',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2c236464-d25d-462f-8626-466415750d16,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1de8a20793441b1a76775dea64e3d54',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:55:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:55:37Z,use_quota=True,user_id='b1063f9d56ce4710a40ae88274bca0ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8bde7129-1dc4-42ab-b852-ab32c61b4921),volume_type_id=8bde7129-1dc4-42ab-b852-ab32c61b4921)}" {{(pid=88899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 08:55:38 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-db81162f-41a1-4746-a5fb-f9956ff152af tempest-ProjectReaderTests-1353959271 None] Creating volume 2c236464-d25d-462f-8626-466415750d16 {{(pid=88899) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 08:55:38 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-db81162f-41a1-4746-a5fb-f9956ff152af tempest-ProjectReaderTests-1353959271 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:55:38 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-db81162f-41a1-4746-a5fb-f9956ff152af tempest-ProjectReaderTests-1353959271 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:55:38 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-db81162f-41a1-4746-a5fb-f9956ff152af tempest-ProjectReaderTests-1353959271 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:55:38 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-db81162f-41a1-4746-a5fb-f9956ff152af tempest-ProjectReaderTests-1353959271 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:55:38 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-db81162f-41a1-4746-a5fb-f9956ff152af tempest-ProjectReaderTests-1353959271 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:55:38 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-db81162f-41a1-4746-a5fb-f9956ff152af tempest-ProjectReaderTests-1353959271 None] Selected osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385 as target Quobyte volume. {{(pid=88899) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 08:55:38 devstack cinder-volume[88899]: INFO cinder.volume.drivers.remotefs [None req-db81162f-41a1-4746-a5fb-f9956ff152af tempest-ProjectReaderTests-1353959271 None] casted to osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385 Aug 03 08:55:38 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-db81162f-41a1-4746-a5fb-f9956ff152af tempest-ProjectReaderTests-1353959271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-2c236464-d25d-462f-8626-466415750d16 1073741824 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:55:38 devstack sudo[114608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-2c236464-d25d-462f-8626-466415750d16 1073741824 Aug 03 08:55:38 devstack sudo[114608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:55:38 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-0eedcaa6-51f1-4f35-bfe2-82932c83acb1 tempest-ProjectReaderTests-1134321651 None] Create snapshot completed successfully Aug 03 08:55:39 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-a8ea91e0-963f-4c12-8c3c-ada693f903bb tempest-ProjectReaderTests-1134321651 None] Acquiring lock "cinder-0f86a174-e85f-46cf-b5e3-ecbf47a5ee46-delete_snapshot" by "delete_snapshot" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:55:39 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-a8ea91e0-963f-4c12-8c3c-ada693f903bb tempest-ProjectReaderTests-1134321651 None] Lock "cinder-0f86a174-e85f-46cf-b5e3-ecbf47a5ee46-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:55:39 devstack cinder-volume[88899]: INFO cinder.message.api [None req-a8ea91e0-963f-4c12-8c3c-ada693f903bb tempest-ProjectReaderTests-1134321651 None] Creating message record for request_id = req-a8ea91e0-963f-4c12-8c3c-ada693f903bb Aug 03 08:55:39 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-a8ea91e0-963f-4c12-8c3c-ada693f903bb tempest-ProjectReaderTests-1134321651 None] Lock "cinder-0f86a174-e85f-46cf-b5e3-ecbf47a5ee46-delete_snapshot" released by "delete_snapshot" :: held 0.050s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:55:39 devstack cinder-volume[88899]: ERROR oslo_messaging.rpc.server [None req-a8ea91e0-963f-4c12-8c3c-ada693f903bb tempest-ProjectReaderTests-1134321651 None] Exception during message handling: AttributeError: 'QuobyteDriver' object has no attribute 'unmanage_snapshot'. Did you mean: '_create_snapshot'? Aug 03 08:55:39 devstack cinder-volume[88899]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Aug 03 08:55:39 devstack cinder-volume[88899]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/server.py", line 174, in _process_incoming Aug 03 08:55:39 devstack cinder-volume[88899]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Aug 03 08:55:39 devstack cinder-volume[88899]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Aug 03 08:55:39 devstack cinder-volume[88899]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Aug 03 08:55:39 devstack cinder-volume[88899]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Aug 03 08:55:39 devstack cinder-volume[88899]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Aug 03 08:55:39 devstack cinder-volume[88899]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Aug 03 08:55:39 devstack cinder-volume[88899]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Aug 03 08:55:39 devstack cinder-volume[88899]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^ Aug 03 08:55:39 devstack cinder-volume[88899]: ERROR oslo_messaging.rpc.server File "/opt/stack/cinder/cinder/volume/manager.py", line 220, in wrapper Aug 03 08:55:39 devstack cinder-volume[88899]: ERROR oslo_messaging.rpc.server skip_clean = func(self, context, snapshot, *args, **kwargs) Aug 03 08:55:39 devstack cinder-volume[88899]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Aug 03 08:55:39 devstack cinder-volume[88899]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/decorator/__init__.py", line 247, in fun Aug 03 08:55:39 devstack cinder-volume[88899]: ERROR oslo_messaging.rpc.server return caller(func, *(extras + args), **kw) Aug 03 08:55:39 devstack cinder-volume[88899]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Aug 03 08:55:39 devstack cinder-volume[88899]: ERROR oslo_messaging.rpc.server File "/opt/stack/cinder/cinder/coordination.py", line 234, in _synchronized Aug 03 08:55:39 devstack cinder-volume[88899]: ERROR oslo_messaging.rpc.server return f(*a, **k) Aug 03 08:55:39 devstack cinder-volume[88899]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^ Aug 03 08:55:39 devstack cinder-volume[88899]: ERROR oslo_messaging.rpc.server File "/opt/stack/cinder/cinder/volume/manager.py", line 1351, in delete_snapshot Aug 03 08:55:39 devstack cinder-volume[88899]: ERROR oslo_messaging.rpc.server with excutils.save_and_reraise_exception(): Aug 03 08:55:39 devstack cinder-volume[88899]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/excutils.py", line 266, in __exit__ Aug 03 08:55:39 devstack cinder-volume[88899]: ERROR oslo_messaging.rpc.server self.force_reraise() Aug 03 08:55:39 devstack cinder-volume[88899]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/excutils.py", line 232, in force_reraise Aug 03 08:55:39 devstack cinder-volume[88899]: ERROR oslo_messaging.rpc.server raise self.value Aug 03 08:55:39 devstack cinder-volume[88899]: ERROR oslo_messaging.rpc.server File "/opt/stack/cinder/cinder/volume/manager.py", line 1335, in delete_snapshot Aug 03 08:55:39 devstack cinder-volume[88899]: ERROR oslo_messaging.rpc.server self.driver.unmanage_snapshot(snapshot) Aug 03 08:55:39 devstack cinder-volume[88899]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Aug 03 08:55:39 devstack cinder-volume[88899]: ERROR oslo_messaging.rpc.server AttributeError: 'QuobyteDriver' object has no attribute 'unmanage_snapshot'. Did you mean: '_create_snapshot'? Aug 03 08:55:39 devstack cinder-volume[88899]: ERROR oslo_messaging.rpc.server Aug 03 08:55:39 devstack sudo[114608]: pam_unix(sudo:session): session closed for user root Aug 03 08:55:39 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-db81162f-41a1-4746-a5fb-f9956ff152af tempest-ProjectReaderTests-1353959271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-2c236464-d25d-462f-8626-466415750d16 1073741824" returned: 0 in 0.575s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:55:39 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-db81162f-41a1-4746-a5fb-f9956ff152af tempest-ProjectReaderTests-1353959271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-2c236464-d25d-462f-8626-466415750d16 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:55:39 devstack sudo[114614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-2c236464-d25d-462f-8626-466415750d16 Aug 03 08:55:39 devstack sudo[114614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:55:39 devstack sudo[114614]: pam_unix(sudo:session): session closed for user root Aug 03 08:55:39 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-db81162f-41a1-4746-a5fb-f9956ff152af tempest-ProjectReaderTests-1353959271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-2c236464-d25d-462f-8626-466415750d16" returned: 0 in 0.319s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:55:39 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-db81162f-41a1-4746-a5fb-f9956ff152af tempest-ProjectReaderTests-1353959271 None] <== create_volume: return (939ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'} {{(pid=88899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 08:55:39 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-db81162f-41a1-4746-a5fb-f9956ff152af tempest-ProjectReaderTests-1353959271 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.943s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:55:39 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-329fdbd2-3dfa-40c2-8f39-c4e37551e634 tempest-SnapshotDependencyTests-1696022310 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 2.037s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:55:39 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-329fdbd2-3dfa-40c2-8f39-c4e37551e634 tempest-SnapshotDependencyTests-1696022310 None] Acquiring lock "cinder-quobyte-9c09939e-ef10-4351-9202-b64aa588e558-61b3f940-c314-4cfd-b250-bfee499ad2ed" by "_create_volume_from_snapshot" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:55:39 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-db81162f-41a1-4746-a5fb-f9956ff152af tempest-ProjectReaderTests-1353959271 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b36f800-30df-4b0f-a39f-9f06b9816fb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2c236464-d25d-462f-8626-466415750d16', 'volume_size': 1}' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:55:39 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-db81162f-41a1-4746-a5fb-f9956ff152af tempest-ProjectReaderTests-1353959271 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (72107d18-fa29-41bd-bfcc-7d11be39ea8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:55:39 devstack cinder-volume[88899]: INFO cinder.volume.flows.manager.create_volume [None req-db81162f-41a1-4746-a5fb-f9956ff152af tempest-ProjectReaderTests-1353959271 None] Volume volume-2c236464-d25d-462f-8626-466415750d16 (2c236464-d25d-462f-8626-466415750d16): created successfully Aug 03 08:55:39 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-db81162f-41a1-4746-a5fb-f9956ff152af tempest-ProjectReaderTests-1353959271 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (72107d18-fa29-41bd-bfcc-7d11be39ea8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:55:39 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-db81162f-41a1-4746-a5fb-f9956ff152af tempest-ProjectReaderTests-1353959271 None] Flow 'volume_create_manager' (d285e691-cf41-409b-9558-44e6f0d37b86) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:55:39 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-329fdbd2-3dfa-40c2-8f39-c4e37551e634 tempest-SnapshotDependencyTests-1696022310 None] Lock "cinder-quobyte-9c09939e-ef10-4351-9202-b64aa588e558-61b3f940-c314-4cfd-b250-bfee499ad2ed" acquired by "_create_volume_from_snapshot" :: waited 0.079s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:55:39 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-329fdbd2-3dfa-40c2-8f39-c4e37551e634 tempest-SnapshotDependencyTests-1696022310 None] Creating volume 61b3f940-c314-4cfd-b250-bfee499ad2ed from snapshot 9c09939e-ef10-4351-9202-b64aa588e558 {{(pid=88899) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Aug 03 08:55:39 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-329fdbd2-3dfa-40c2-8f39-c4e37551e634 tempest-SnapshotDependencyTests-1696022310 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:55:39 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-329fdbd2-3dfa-40c2-8f39-c4e37551e634 tempest-SnapshotDependencyTests-1696022310 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:55:39 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-329fdbd2-3dfa-40c2-8f39-c4e37551e634 tempest-SnapshotDependencyTests-1696022310 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:55:39 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-329fdbd2-3dfa-40c2-8f39-c4e37551e634 tempest-SnapshotDependencyTests-1696022310 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:55:39 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-329fdbd2-3dfa-40c2-8f39-c4e37551e634 tempest-SnapshotDependencyTests-1696022310 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:55:39 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-329fdbd2-3dfa-40c2-8f39-c4e37551e634 tempest-SnapshotDependencyTests-1696022310 None] Selected osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385 as target Quobyte volume. {{(pid=88899) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 08:55:39 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-329fdbd2-3dfa-40c2-8f39-c4e37551e634 tempest-SnapshotDependencyTests-1696022310 None] Acquiring lock "cinder-quobyte-61b3f940-c314-4cfd-b250-bfee499ad2ed" by "_copy_volume_from_snapshot" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:55:39 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-db81162f-41a1-4746-a5fb-f9956ff152af tempest-ProjectReaderTests-1353959271 None] Created volume successfully. Aug 03 08:55:39 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-329fdbd2-3dfa-40c2-8f39-c4e37551e634 tempest-SnapshotDependencyTests-1696022310 None] Lock "cinder-quobyte-61b3f940-c314-4cfd-b250-bfee499ad2ed" acquired by "_copy_volume_from_snapshot" :: waited 0.023s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:55:39 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-329fdbd2-3dfa-40c2-8f39-c4e37551e634 tempest-SnapshotDependencyTests-1696022310 None] snapshot: 9c09939e-ef10-4351-9202-b64aa588e558, volume: 61b3f940-c314-4cfd-b250-bfee499ad2ed, {{(pid=88899) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Aug 03 08:55:40 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-329fdbd2-3dfa-40c2-8f39-c4e37551e634 tempest-SnapshotDependencyTests-1696022310 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:55:40 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-329fdbd2-3dfa-40c2-8f39-c4e37551e634 tempest-SnapshotDependencyTests-1696022310 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:55:40 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-329fdbd2-3dfa-40c2-8f39-c4e37551e634 tempest-SnapshotDependencyTests-1696022310 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:55:40 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-329fdbd2-3dfa-40c2-8f39-c4e37551e634 tempest-SnapshotDependencyTests-1696022310 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:55:40 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-329fdbd2-3dfa-40c2-8f39-c4e37551e634 tempest-SnapshotDependencyTests-1696022310 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:55:40 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[29a637a7-c4ed-4b17-a5b9-c556837f4a2a]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:55:40 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-329fdbd2-3dfa-40c2-8f39-c4e37551e634 tempest-SnapshotDependencyTests-1696022310 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-21c02779-4855-4574-9f0e-8c462065668f.9c09939e-ef10-4351-9202-b64aa588e558 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:55:40 devstack sudo[114617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-21c02779-4855-4574-9f0e-8c462065668f.9c09939e-ef10-4351-9202-b64aa588e558 Aug 03 08:55:40 devstack sudo[114617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:55:40 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-46a4c64e-d38e-42bc-9bdd-78c321dfed83 tempest-ProjectReaderTests-1353959271 None] Acquiring lock "cinder-2c236464-d25d-462f-8626-466415750d16-delete_volume" by "delete_volume" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:55:40 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-46a4c64e-d38e-42bc-9bdd-78c321dfed83 tempest-ProjectReaderTests-1353959271 None] Lock "cinder-2c236464-d25d-462f-8626-466415750d16-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:55:40 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-46a4c64e-d38e-42bc-9bdd-78c321dfed83 tempest-ProjectReaderTests-1353959271 None] Acquiring lock "cinder-quobyte-2c236464-d25d-462f-8626-466415750d16" by "delete_volume" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:55:40 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-46a4c64e-d38e-42bc-9bdd-78c321dfed83 tempest-ProjectReaderTests-1353959271 None] Lock "cinder-quobyte-2c236464-d25d-462f-8626-466415750d16" acquired by "delete_volume" :: waited 0.027s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:55:40 devstack sudo[114617]: pam_unix(sudo:session): session closed for user root Aug 03 08:55:40 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-329fdbd2-3dfa-40c2-8f39-c4e37551e634 tempest-SnapshotDependencyTests-1696022310 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-21c02779-4855-4574-9f0e-8c462065668f.9c09939e-ef10-4351-9202-b64aa588e558" returned: 0 in 0.485s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:55:40 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-329fdbd2-3dfa-40c2-8f39-c4e37551e634 tempest-SnapshotDependencyTests-1696022310 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-21c02779-4855-4574-9f0e-8c462065668f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88899) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 03 08:55:40 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[026557e9-04fb-49ba-9115-406fd0400100]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:55:40 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[096aa206-fd59-4116-b12c-0b7158efe087]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:55:40 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-329fdbd2-3dfa-40c2-8f39-c4e37551e634 tempest-SnapshotDependencyTests-1696022310 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-21c02779-4855-4574-9f0e-8c462065668f {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:55:40 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-46a4c64e-d38e-42bc-9bdd-78c321dfed83 tempest-ProjectReaderTests-1353959271 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-2c236464-d25d-462f-8626-466415750d16 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:55:40 devstack sudo[114623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-21c02779-4855-4574-9f0e-8c462065668f Aug 03 08:55:40 devstack sudo[114623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:55:40 devstack sudo[114624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-2c236464-d25d-462f-8626-466415750d16 Aug 03 08:55:40 devstack sudo[114624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:55:40 devstack sudo[114623]: pam_unix(sudo:session): session closed for user root Aug 03 08:55:40 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-329fdbd2-3dfa-40c2-8f39-c4e37551e634 tempest-SnapshotDependencyTests-1696022310 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-21c02779-4855-4574-9f0e-8c462065668f" returned: 0 in 0.424s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:55:40 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-329fdbd2-3dfa-40c2-8f39-c4e37551e634 tempest-SnapshotDependencyTests-1696022310 None] will copy from snapshot at /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-21c02779-4855-4574-9f0e-8c462065668f {{(pid=88899) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Aug 03 08:55:40 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-329fdbd2-3dfa-40c2-8f39-c4e37551e634 tempest-SnapshotDependencyTests-1696022310 None] Creating direct copy from snapshot {{(pid=88899) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Aug 03 08:55:40 devstack cinder-volume[88899]: DEBUG cinder.utils [None req-329fdbd2-3dfa-40c2-8f39-c4e37551e634 tempest-SnapshotDependencyTests-1696022310 None] Path /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-61b3f940-c314-4cfd-b250-bfee499ad2ed not found in is_blk_device check {{(pid=88899) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Aug 03 08:55:40 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-329fdbd2-3dfa-40c2-8f39-c4e37551e634 tempest-SnapshotDependencyTests-1696022310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-21c02779-4855-4574-9f0e-8c462065668f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-61b3f940-c314-4cfd-b250-bfee499ad2ed {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:55:41 devstack sudo[114624]: pam_unix(sudo:session): session closed for user root Aug 03 08:55:41 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-46a4c64e-d38e-42bc-9bdd-78c321dfed83 tempest-ProjectReaderTests-1353959271 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-2c236464-d25d-462f-8626-466415750d16" returned: 0 in 0.443s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:55:41 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-46a4c64e-d38e-42bc-9bdd-78c321dfed83 tempest-ProjectReaderTests-1353959271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-2c236464-d25d-462f-8626-466415750d16 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:55:41 devstack sudo[114633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-21c02779-4855-4574-9f0e-8c462065668f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-61b3f940-c314-4cfd-b250-bfee499ad2ed Aug 03 08:55:41 devstack sudo[114633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:55:41 devstack sudo[114634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-2c236464-d25d-462f-8626-466415750d16 Aug 03 08:55:41 devstack sudo[114634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:55:41 devstack sudo[114634]: pam_unix(sudo:session): session closed for user root Aug 03 08:55:41 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-46a4c64e-d38e-42bc-9bdd-78c321dfed83 tempest-ProjectReaderTests-1353959271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-2c236464-d25d-462f-8626-466415750d16" returned: 0 in 0.319s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:55:41 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-46a4c64e-d38e-42bc-9bdd-78c321dfed83 tempest-ProjectReaderTests-1353959271 None] Lock "cinder-quobyte-2c236464-d25d-462f-8626-466415750d16" released by "delete_volume" :: held 0.836s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:55:41 devstack cinder-volume[88899]: DEBUG cinder.quota [None req-46a4c64e-d38e-42bc-9bdd-78c321dfed83 tempest-ProjectReaderTests-1353959271 None] Created reservations ['a522a9d2-70f7-45ee-9e5c-5bd28e16562a', '3076efba-8dd2-4a0a-81ed-1c802c063aa3', 'deb63eae-6dda-48ba-9be0-d6c5303cb546', 'fe89c516-62f8-4f93-a94f-b46e3c1f66c5'] {{(pid=88899) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 08:55:41 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-46a4c64e-d38e-42bc-9bdd-78c321dfed83 tempest-ProjectReaderTests-1353959271 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:55:41 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-46a4c64e-d38e-42bc-9bdd-78c321dfed83 tempest-ProjectReaderTests-1353959271 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:55:41 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-46a4c64e-d38e-42bc-9bdd-78c321dfed83 tempest-ProjectReaderTests-1353959271 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:55:41 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-46a4c64e-d38e-42bc-9bdd-78c321dfed83 tempest-ProjectReaderTests-1353959271 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:55:41 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-46a4c64e-d38e-42bc-9bdd-78c321dfed83 tempest-ProjectReaderTests-1353959271 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:55:41 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-46a4c64e-d38e-42bc-9bdd-78c321dfed83 tempest-ProjectReaderTests-1353959271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:55:41 devstack sudo[114641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a Aug 03 08:55:41 devstack sudo[114641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:55:42 devstack sudo[114641]: pam_unix(sudo:session): session closed for user root Aug 03 08:55:42 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-46a4c64e-d38e-42bc-9bdd-78c321dfed83 tempest-ProjectReaderTests-1353959271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a" returned: 0 in 0.824s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:55:42 devstack cinder-volume[88899]: DEBUG cinder.manager [None req-46a4c64e-d38e-42bc-9bdd-78c321dfed83 tempest-ProjectReaderTests-1353959271 None] Notifying Schedulers of capabilities ... {{(pid=88899) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 08:55:42 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-46a4c64e-d38e-42bc-9bdd-78c321dfed83 tempest-ProjectReaderTests-1353959271 None] Deleted volume successfully. Aug 03 08:55:42 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-46a4c64e-d38e-42bc-9bdd-78c321dfed83 tempest-ProjectReaderTests-1353959271 None] Lock "cinder-2c236464-d25d-462f-8626-466415750d16-delete_volume" released by "delete_volume" :: held 2.053s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:55:47 devstack sudo[114633]: pam_unix(sudo:session): session closed for user root Aug 03 08:55:47 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-329fdbd2-3dfa-40c2-8f39-c4e37551e634 tempest-SnapshotDependencyTests-1696022310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-21c02779-4855-4574-9f0e-8c462065668f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-61b3f940-c314-4cfd-b250-bfee499ad2ed" returned: 0 in 6.178s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:55:47 devstack cinder-volume[88899]: DEBUG cinder.image.image_utils [None req-329fdbd2-3dfa-40c2-8f39-c4e37551e634 tempest-SnapshotDependencyTests-1696022310 None] Image conversion details: src /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-21c02779-4855-4574-9f0e-8c462065668f, size 1024.00 MB, duration 6.18 sec, destination /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-61b3f940-c314-4cfd-b250-bfee499ad2ed {{(pid=88899) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 03 08:55:47 devstack cinder-volume[88899]: INFO cinder.image.image_utils [None req-329fdbd2-3dfa-40c2-8f39-c4e37551e634 tempest-SnapshotDependencyTests-1696022310 None] Converted 1024.00 MB image at 165.72 MB/s Aug 03 08:55:47 devstack cinder-volume[88899]: WARNING cinder.volume.drivers.remotefs [None req-329fdbd2-3dfa-40c2-8f39-c4e37551e634 tempest-SnapshotDependencyTests-1696022310 None] /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-61b3f940-c314-4cfd-b250-bfee499ad2ed is being set with open permissions: ugo+rw Aug 03 08:55:47 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-329fdbd2-3dfa-40c2-8f39-c4e37551e634 tempest-SnapshotDependencyTests-1696022310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-61b3f940-c314-4cfd-b250-bfee499ad2ed {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:55:47 devstack sudo[114652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-61b3f940-c314-4cfd-b250-bfee499ad2ed Aug 03 08:55:47 devstack sudo[114652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:55:47 devstack sudo[114652]: pam_unix(sudo:session): session closed for user root Aug 03 08:55:47 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-329fdbd2-3dfa-40c2-8f39-c4e37551e634 tempest-SnapshotDependencyTests-1696022310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-61b3f940-c314-4cfd-b250-bfee499ad2ed" returned: 0 in 0.269s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:55:47 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-329fdbd2-3dfa-40c2-8f39-c4e37551e634 tempest-SnapshotDependencyTests-1696022310 None] Lock "cinder-quobyte-61b3f940-c314-4cfd-b250-bfee499ad2ed" released by "_copy_volume_from_snapshot" :: held 7.472s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:55:47 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-329fdbd2-3dfa-40c2-8f39-c4e37551e634 tempest-SnapshotDependencyTests-1696022310 None] Lock "cinder-quobyte-9c09939e-ef10-4351-9202-b64aa588e558-61b3f940-c314-4cfd-b250-bfee499ad2ed" released by "_create_volume_from_snapshot" :: held 7.589s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:55:47 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-329fdbd2-3dfa-40c2-8f39-c4e37551e634 tempest-SnapshotDependencyTests-1696022310 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.670s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:55:47 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-329fdbd2-3dfa-40c2-8f39-c4e37551e634 tempest-SnapshotDependencyTests-1696022310 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (860fb059-cc74-40a8-b141-3149d8c44959) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-61b3f940-c314-4cfd-b250-bfee499ad2ed', 'volume_size': 1, 'snapshot_id': '9c09939e-ef10-4351-9202-b64aa588e558'}' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:55:47 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-329fdbd2-3dfa-40c2-8f39-c4e37551e634 tempest-SnapshotDependencyTests-1696022310 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3ea72b2-71a8-43b7-858a-af59cfda4699) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:55:47 devstack cinder-volume[88899]: INFO cinder.volume.flows.manager.create_volume [None req-329fdbd2-3dfa-40c2-8f39-c4e37551e634 tempest-SnapshotDependencyTests-1696022310 None] Volume volume-61b3f940-c314-4cfd-b250-bfee499ad2ed (61b3f940-c314-4cfd-b250-bfee499ad2ed): created successfully Aug 03 08:55:47 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-329fdbd2-3dfa-40c2-8f39-c4e37551e634 tempest-SnapshotDependencyTests-1696022310 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3ea72b2-71a8-43b7-858a-af59cfda4699) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:55:47 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-329fdbd2-3dfa-40c2-8f39-c4e37551e634 tempest-SnapshotDependencyTests-1696022310 None] Flow 'volume_create_manager' (f6eaa7a9-f2b5-4e78-bab9-bb5501dccec8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:55:47 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-329fdbd2-3dfa-40c2-8f39-c4e37551e634 tempest-SnapshotDependencyTests-1696022310 None] Created volume successfully. Aug 03 08:55:48 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-38613532-5fec-4d32-a236-34a46021463d tempest-SnapshotDependencyTests-1696022310 None] Acquiring lock "cinder-9c09939e-ef10-4351-9202-b64aa588e558-delete_snapshot" by "delete_snapshot" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:55:48 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-38613532-5fec-4d32-a236-34a46021463d tempest-SnapshotDependencyTests-1696022310 None] Lock "cinder-9c09939e-ef10-4351-9202-b64aa588e558-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:55:48 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-38613532-5fec-4d32-a236-34a46021463d tempest-SnapshotDependencyTests-1696022310 None] Acquiring lock "cinder-quobyte-21c02779-4855-4574-9f0e-8c462065668f" by "delete_snapshot" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:55:48 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-38613532-5fec-4d32-a236-34a46021463d tempest-SnapshotDependencyTests-1696022310 None] Lock "cinder-quobyte-21c02779-4855-4574-9f0e-8c462065668f" acquired by "delete_snapshot" :: waited 0.016s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:55:48 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-38613532-5fec-4d32-a236-34a46021463d tempest-SnapshotDependencyTests-1696022310 None] Acquiring lock "cinder-quobyte-9c09939e-ef10-4351-9202-b64aa588e558" by "_delete_snapshot" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:55:48 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-38613532-5fec-4d32-a236-34a46021463d tempest-SnapshotDependencyTests-1696022310 None] Lock "cinder-quobyte-9c09939e-ef10-4351-9202-b64aa588e558" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:55:48 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-38613532-5fec-4d32-a236-34a46021463d tempest-SnapshotDependencyTests-1696022310 None] Deleting offline snapshot 9c09939e-ef10-4351-9202-b64aa588e558 of volume 21c02779-4855-4574-9f0e-8c462065668f {{(pid=88899) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 03 08:55:48 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-38613532-5fec-4d32-a236-34a46021463d tempest-SnapshotDependencyTests-1696022310 None] snapshot_file for this snap is: volume-21c02779-4855-4574-9f0e-8c462065668f.9c09939e-ef10-4351-9202-b64aa588e558 {{(pid=88899) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 03 08:55:48 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6c706ea-76c1-418b-a653-b11fe02ea9bf]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:55:48 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-38613532-5fec-4d32-a236-34a46021463d tempest-SnapshotDependencyTests-1696022310 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-21c02779-4855-4574-9f0e-8c462065668f.9c09939e-ef10-4351-9202-b64aa588e558 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:55:49 devstack sudo[114656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-21c02779-4855-4574-9f0e-8c462065668f.9c09939e-ef10-4351-9202-b64aa588e558 Aug 03 08:55:49 devstack sudo[114656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:55:49 devstack sudo[114656]: pam_unix(sudo:session): session closed for user root Aug 03 08:55:49 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-38613532-5fec-4d32-a236-34a46021463d tempest-SnapshotDependencyTests-1696022310 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-21c02779-4855-4574-9f0e-8c462065668f.9c09939e-ef10-4351-9202-b64aa588e558" returned: 0 in 0.445s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:55:49 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-38613532-5fec-4d32-a236-34a46021463d tempest-SnapshotDependencyTests-1696022310 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-21c02779-4855-4574-9f0e-8c462065668f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88899) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 03 08:55:49 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc845823-68cc-4fb3-8d72-9a54b10a3667]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:55:49 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-38613532-5fec-4d32-a236-34a46021463d tempest-SnapshotDependencyTests-1696022310 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-21c02779-4855-4574-9f0e-8c462065668f {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:55:49 devstack sudo[114662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-21c02779-4855-4574-9f0e-8c462065668f Aug 03 08:55:49 devstack sudo[114662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:55:50 devstack sudo[114662]: pam_unix(sudo:session): session closed for user root Aug 03 08:55:50 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-38613532-5fec-4d32-a236-34a46021463d tempest-SnapshotDependencyTests-1696022310 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-21c02779-4855-4574-9f0e-8c462065668f" returned: 0 in 0.601s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:55:50 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-38613532-5fec-4d32-a236-34a46021463d tempest-SnapshotDependencyTests-1696022310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-21c02779-4855-4574-9f0e-8c462065668f.9c09939e-ef10-4351-9202-b64aa588e558 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:55:50 devstack sudo[114667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-21c02779-4855-4574-9f0e-8c462065668f.9c09939e-ef10-4351-9202-b64aa588e558 Aug 03 08:55:50 devstack sudo[114667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:55:50 devstack sudo[114667]: pam_unix(sudo:session): session closed for user root Aug 03 08:55:50 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-38613532-5fec-4d32-a236-34a46021463d tempest-SnapshotDependencyTests-1696022310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-21c02779-4855-4574-9f0e-8c462065668f.9c09939e-ef10-4351-9202-b64aa588e558" returned: 0 in 0.408s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:55:50 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-38613532-5fec-4d32-a236-34a46021463d tempest-SnapshotDependencyTests-1696022310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-21c02779-4855-4574-9f0e-8c462065668f.9c09939e-ef10-4351-9202-b64aa588e558 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:55:50 devstack sudo[114673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-21c02779-4855-4574-9f0e-8c462065668f.9c09939e-ef10-4351-9202-b64aa588e558 Aug 03 08:55:50 devstack sudo[114673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:55:50 devstack sudo[114673]: pam_unix(sudo:session): session closed for user root Aug 03 08:55:50 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-38613532-5fec-4d32-a236-34a46021463d tempest-SnapshotDependencyTests-1696022310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-21c02779-4855-4574-9f0e-8c462065668f.9c09939e-ef10-4351-9202-b64aa588e558" returned: 0 in 0.259s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:55:50 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-38613532-5fec-4d32-a236-34a46021463d tempest-SnapshotDependencyTests-1696022310 None] Lock "cinder-quobyte-9c09939e-ef10-4351-9202-b64aa588e558" released by "_delete_snapshot" :: held 1.839s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:55:50 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-38613532-5fec-4d32-a236-34a46021463d tempest-SnapshotDependencyTests-1696022310 None] Lock "cinder-quobyte-21c02779-4855-4574-9f0e-8c462065668f" released by "delete_snapshot" :: held 1.875s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:55:50 devstack cinder-volume[88899]: DEBUG cinder.quota [None req-38613532-5fec-4d32-a236-34a46021463d tempest-SnapshotDependencyTests-1696022310 None] Created reservations ['83cae69b-f805-42dd-a998-7091c2030389', '18cf3879-930e-4ce2-9c46-c1b0dbf9e592', '655e8c4a-2f21-42a6-b76c-2647f57637aa', '57888438-6b8d-4bb4-963c-a11de237f44b'] {{(pid=88899) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 08:55:50 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-38613532-5fec-4d32-a236-34a46021463d tempest-SnapshotDependencyTests-1696022310 None] Delete snapshot completed successfully. Aug 03 08:55:50 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-38613532-5fec-4d32-a236-34a46021463d tempest-SnapshotDependencyTests-1696022310 None] Lock "cinder-9c09939e-ef10-4351-9202-b64aa588e558-delete_snapshot" released by "delete_snapshot" :: held 2.089s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:55:51 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-e9b9de2e-7058-4ed9-9f77-d2928e805284 tempest-SnapshotDependencyTests-1696022310 None] Acquiring lock "cinder-21c02779-4855-4574-9f0e-8c462065668f-delete_volume" by "delete_volume" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:55:51 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-e9b9de2e-7058-4ed9-9f77-d2928e805284 tempest-SnapshotDependencyTests-1696022310 None] Lock "cinder-21c02779-4855-4574-9f0e-8c462065668f-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:55:51 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-e9b9de2e-7058-4ed9-9f77-d2928e805284 tempest-SnapshotDependencyTests-1696022310 None] Acquiring lock "cinder-quobyte-21c02779-4855-4574-9f0e-8c462065668f" by "delete_volume" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:55:51 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-e9b9de2e-7058-4ed9-9f77-d2928e805284 tempest-SnapshotDependencyTests-1696022310 None] Lock "cinder-quobyte-21c02779-4855-4574-9f0e-8c462065668f" acquired by "delete_volume" :: waited 0.026s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:55:51 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[15a543a7-ec3a-4cfc-8fa4-9664a64214ab]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:55:51 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-e9b9de2e-7058-4ed9-9f77-d2928e805284 tempest-SnapshotDependencyTests-1696022310 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-21c02779-4855-4574-9f0e-8c462065668f {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:55:51 devstack sudo[114676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-21c02779-4855-4574-9f0e-8c462065668f Aug 03 08:55:51 devstack sudo[114676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:55:51 devstack sudo[114676]: pam_unix(sudo:session): session closed for user root Aug 03 08:55:51 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-e9b9de2e-7058-4ed9-9f77-d2928e805284 tempest-SnapshotDependencyTests-1696022310 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-21c02779-4855-4574-9f0e-8c462065668f" returned: 0 in 0.430s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:55:51 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-e9b9de2e-7058-4ed9-9f77-d2928e805284 tempest-SnapshotDependencyTests-1696022310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-21c02779-4855-4574-9f0e-8c462065668f {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:55:51 devstack sudo[114681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-21c02779-4855-4574-9f0e-8c462065668f Aug 03 08:55:51 devstack sudo[114681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:55:51 devstack sudo[114681]: pam_unix(sudo:session): session closed for user root Aug 03 08:55:51 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-e9b9de2e-7058-4ed9-9f77-d2928e805284 tempest-SnapshotDependencyTests-1696022310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-21c02779-4855-4574-9f0e-8c462065668f" returned: 0 in 0.267s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:55:51 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-e9b9de2e-7058-4ed9-9f77-d2928e805284 tempest-SnapshotDependencyTests-1696022310 None] Lock "cinder-quobyte-21c02779-4855-4574-9f0e-8c462065668f" released by "delete_volume" :: held 0.775s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:55:51 devstack cinder-volume[88899]: DEBUG oslo_service.periodic_task [None req-f948fb4a-c4d7-499f-b1bd-8d6be3de0b53 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88899) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 03 08:55:51 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-f948fb4a-c4d7-499f-b1bd-8d6be3de0b53 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:55:51 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-f948fb4a-c4d7-499f-b1bd-8d6be3de0b53 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:55:51 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-f948fb4a-c4d7-499f-b1bd-8d6be3de0b53 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:55:51 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-f948fb4a-c4d7-499f-b1bd-8d6be3de0b53 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:55:51 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-f948fb4a-c4d7-499f-b1bd-8d6be3de0b53 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:55:51 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-f948fb4a-c4d7-499f-b1bd-8d6be3de0b53 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:55:51 devstack sudo[114684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a Aug 03 08:55:51 devstack sudo[114684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:55:52 devstack cinder-volume[88899]: DEBUG cinder.quota [None req-e9b9de2e-7058-4ed9-9f77-d2928e805284 tempest-SnapshotDependencyTests-1696022310 None] Created reservations ['c770ac2c-0f07-4fa1-9d16-3c9b0780721d', 'b97a26ae-e735-4baf-a572-919140f0813c', '40dfe6e5-0bc9-419b-9f6a-872c4e282a66', 'b746f850-f9f9-4191-a8f5-91274f4571ab'] {{(pid=88899) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 08:55:52 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-e9b9de2e-7058-4ed9-9f77-d2928e805284 tempest-SnapshotDependencyTests-1696022310 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:55:52 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-e9b9de2e-7058-4ed9-9f77-d2928e805284 tempest-SnapshotDependencyTests-1696022310 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:55:52 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-e9b9de2e-7058-4ed9-9f77-d2928e805284 tempest-SnapshotDependencyTests-1696022310 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:55:52 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-e9b9de2e-7058-4ed9-9f77-d2928e805284 tempest-SnapshotDependencyTests-1696022310 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:55:52 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-e9b9de2e-7058-4ed9-9f77-d2928e805284 tempest-SnapshotDependencyTests-1696022310 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:55:52 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-e9b9de2e-7058-4ed9-9f77-d2928e805284 tempest-SnapshotDependencyTests-1696022310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:55:52 devstack sudo[114686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a Aug 03 08:55:52 devstack sudo[114686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:55:52 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-0b0b33aa-d166-444f-8d76-31e2489a9009 tempest-SnapshotDependencyTests-1696022310 None] Acquiring lock "cinder-61b3f940-c314-4cfd-b250-bfee499ad2ed-delete_volume" by "delete_volume" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:55:52 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-0b0b33aa-d166-444f-8d76-31e2489a9009 tempest-SnapshotDependencyTests-1696022310 None] Lock "cinder-61b3f940-c314-4cfd-b250-bfee499ad2ed-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:55:52 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-0b0b33aa-d166-444f-8d76-31e2489a9009 tempest-SnapshotDependencyTests-1696022310 None] Acquiring lock "cinder-quobyte-61b3f940-c314-4cfd-b250-bfee499ad2ed" by "delete_volume" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:55:52 devstack sudo[114684]: pam_unix(sudo:session): session closed for user root Aug 03 08:55:52 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-f948fb4a-c4d7-499f-b1bd-8d6be3de0b53 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a" returned: 0 in 0.509s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:55:52 devstack cinder-volume[88899]: DEBUG cinder.manager [None req-f948fb4a-c4d7-499f-b1bd-8d6be3de0b53 None None] Notifying Schedulers of capabilities ... {{(pid=88899) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 08:55:52 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-0b0b33aa-d166-444f-8d76-31e2489a9009 tempest-SnapshotDependencyTests-1696022310 None] Lock "cinder-quobyte-61b3f940-c314-4cfd-b250-bfee499ad2ed" acquired by "delete_volume" :: waited 0.033s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:55:52 devstack cinder-volume[88899]: DEBUG oslo_service.periodic_task [None req-f948fb4a-c4d7-499f-b1bd-8d6be3de0b53 None None] Running periodic task VolumeManager._thread_info {{(pid=88899) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 03 08:55:52 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-f948fb4a-c4d7-499f-b1bd-8d6be3de0b53 None None] thread count: 29 {{(pid=88899) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 03 08:55:52 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-f948fb4a-c4d7-499f-b1bd-8d6be3de0b53 None None] thread info: [<_MainThread(MainThread, started 132234320248960)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88899) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 03 08:55:52 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[c27b0f2d-1a98-46b6-99b0-7092022f60af]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:55:52 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-0b0b33aa-d166-444f-8d76-31e2489a9009 tempest-SnapshotDependencyTests-1696022310 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-61b3f940-c314-4cfd-b250-bfee499ad2ed {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:55:52 devstack sudo[114686]: pam_unix(sudo:session): session closed for user root Aug 03 08:55:52 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-e9b9de2e-7058-4ed9-9f77-d2928e805284 tempest-SnapshotDependencyTests-1696022310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a" returned: 0 in 0.471s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:55:52 devstack cinder-volume[88899]: DEBUG cinder.manager [None req-e9b9de2e-7058-4ed9-9f77-d2928e805284 tempest-SnapshotDependencyTests-1696022310 None] Notifying Schedulers of capabilities ... {{(pid=88899) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 08:55:52 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-e9b9de2e-7058-4ed9-9f77-d2928e805284 tempest-SnapshotDependencyTests-1696022310 None] Deleted volume successfully. Aug 03 08:55:52 devstack sudo[114689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-61b3f940-c314-4cfd-b250-bfee499ad2ed Aug 03 08:55:52 devstack sudo[114689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:55:52 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-e9b9de2e-7058-4ed9-9f77-d2928e805284 tempest-SnapshotDependencyTests-1696022310 None] Lock "cinder-21c02779-4855-4574-9f0e-8c462065668f-delete_volume" released by "delete_volume" :: held 1.589s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:55:52 devstack sudo[114689]: pam_unix(sudo:session): session closed for user root Aug 03 08:55:52 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-0b0b33aa-d166-444f-8d76-31e2489a9009 tempest-SnapshotDependencyTests-1696022310 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-61b3f940-c314-4cfd-b250-bfee499ad2ed" returned: 0 in 0.381s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:55:52 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-0b0b33aa-d166-444f-8d76-31e2489a9009 tempest-SnapshotDependencyTests-1696022310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-61b3f940-c314-4cfd-b250-bfee499ad2ed {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:55:52 devstack sudo[114695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-61b3f940-c314-4cfd-b250-bfee499ad2ed Aug 03 08:55:52 devstack sudo[114695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:55:53 devstack sudo[114695]: pam_unix(sudo:session): session closed for user root Aug 03 08:55:53 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-0b0b33aa-d166-444f-8d76-31e2489a9009 tempest-SnapshotDependencyTests-1696022310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-61b3f940-c314-4cfd-b250-bfee499ad2ed" returned: 0 in 0.247s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:55:53 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-0b0b33aa-d166-444f-8d76-31e2489a9009 tempest-SnapshotDependencyTests-1696022310 None] Lock "cinder-quobyte-61b3f940-c314-4cfd-b250-bfee499ad2ed" released by "delete_volume" :: held 0.692s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:55:53 devstack cinder-volume[88899]: DEBUG cinder.quota [None req-0b0b33aa-d166-444f-8d76-31e2489a9009 tempest-SnapshotDependencyTests-1696022310 None] Created reservations ['f86cfbc5-37d2-4022-be6a-5631255a717a', '4fe7f38c-9283-4981-b810-d0aeee2b1578', '8c98d059-6ee9-40aa-a186-a7630f103080', '244a341b-89aa-42f6-8f60-49c75eb4e7f9'] {{(pid=88899) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 08:55:53 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-0b0b33aa-d166-444f-8d76-31e2489a9009 tempest-SnapshotDependencyTests-1696022310 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:55:53 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-0b0b33aa-d166-444f-8d76-31e2489a9009 tempest-SnapshotDependencyTests-1696022310 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:55:53 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-0b0b33aa-d166-444f-8d76-31e2489a9009 tempest-SnapshotDependencyTests-1696022310 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:55:53 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-0b0b33aa-d166-444f-8d76-31e2489a9009 tempest-SnapshotDependencyTests-1696022310 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:55:53 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-0b0b33aa-d166-444f-8d76-31e2489a9009 tempest-SnapshotDependencyTests-1696022310 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:55:53 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-0b0b33aa-d166-444f-8d76-31e2489a9009 tempest-SnapshotDependencyTests-1696022310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:55:53 devstack sudo[114698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a Aug 03 08:55:53 devstack sudo[114698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:55:53 devstack sudo[114698]: pam_unix(sudo:session): session closed for user root Aug 03 08:55:53 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-0b0b33aa-d166-444f-8d76-31e2489a9009 tempest-SnapshotDependencyTests-1696022310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a" returned: 0 in 0.262s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:55:53 devstack cinder-volume[88899]: DEBUG cinder.manager [None req-0b0b33aa-d166-444f-8d76-31e2489a9009 tempest-SnapshotDependencyTests-1696022310 None] Notifying Schedulers of capabilities ... {{(pid=88899) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 08:55:53 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-0b0b33aa-d166-444f-8d76-31e2489a9009 tempest-SnapshotDependencyTests-1696022310 None] Deleted volume successfully. Aug 03 08:55:53 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-0b0b33aa-d166-444f-8d76-31e2489a9009 tempest-SnapshotDependencyTests-1696022310 None] Lock "cinder-61b3f940-c314-4cfd-b250-bfee499ad2ed-delete_volume" released by "delete_volume" :: held 1.256s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:56:03 devstack cinder-volume[88899]: DEBUG dbcounter [-] [88899] Writing DB stats cinder:SELECT=105,cinder:INSERT=33,cinder:UPDATE=132,cinder:DELETE=14 {{(pid=88899) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 03 08:56:03 devstack cinder-volume[88899]: DEBUG dbcounter [-] [88899] Writing DB stats cinder:SELECT=95,cinder:INSERT=37,cinder:UPDATE=131,cinder:DELETE=8 {{(pid=88899) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 03 08:56:36 devstack cinder-volume[88899]: DEBUG cinder.volume.flows.manager.create_volume [None req-df9bdd3d-2776-424a-ac65-e01e8475c1d7 tempest-SnapshotDataIntegrityTests-1151129385 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88899) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 08:56:36 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-df9bdd3d-2776-424a-ac65-e01e8475c1d7 tempest-SnapshotDataIntegrityTests-1151129385 None] Flow 'volume_create_manager' (18315815-4748-4767-844c-e6a06fb5e23a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:56:36 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-df9bdd3d-2776-424a-ac65-e01e8475c1d7 tempest-SnapshotDataIntegrityTests-1151129385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (542cbef6-cfc6-4897-baa9-476476ca99be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:56:36 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-df9bdd3d-2776-424a-ac65-e01e8475c1d7 tempest-SnapshotDataIntegrityTests-1151129385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (542cbef6-cfc6-4897-baa9-476476ca99be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:56:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDataIntegrityTests-volume-414149359',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c512cee2-9ba7-4fbc-85e0-b9cff62418ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='edcd5572d27049ba9a002c778c2d4964',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:56:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:56:36Z,use_quota=True,user_id='a347373422e34c2089490fba111c8f5d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8bde7129-1dc4-42ab-b852-ab32c61b4921),volume_type_id=8bde7129-1dc4-42ab-b852-ab32c61b4921)' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:56:36 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-df9bdd3d-2776-424a-ac65-e01e8475c1d7 tempest-SnapshotDataIntegrityTests-1151129385 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a5998cb-2fc3-479c-9bb0-2693ff947a6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:56:36 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-df9bdd3d-2776-424a-ac65-e01e8475c1d7 tempest-SnapshotDataIntegrityTests-1151129385 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a5998cb-2fc3-479c-9bb0-2693ff947a6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:56:36 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-df9bdd3d-2776-424a-ac65-e01e8475c1d7 tempest-SnapshotDataIntegrityTests-1151129385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e1be2fc-d7f5-4f2d-abdd-ce86c7205069) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:56:36 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-df9bdd3d-2776-424a-ac65-e01e8475c1d7 tempest-SnapshotDataIntegrityTests-1151129385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e1be2fc-d7f5-4f2d-abdd-ce86c7205069) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c512cee2-9ba7-4fbc-85e0-b9cff62418ed', 'volume_name': 'volume-c512cee2-9ba7-4fbc-85e0-b9cff62418ed', 'volume_size': 1}' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:56:36 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-df9bdd3d-2776-424a-ac65-e01e8475c1d7 tempest-SnapshotDataIntegrityTests-1151129385 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae9854d4-d530-487f-ad6d-b3ad94dc99dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:56:36 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-df9bdd3d-2776-424a-ac65-e01e8475c1d7 tempest-SnapshotDataIntegrityTests-1151129385 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae9854d4-d530-487f-ad6d-b3ad94dc99dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:56:36 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-df9bdd3d-2776-424a-ac65-e01e8475c1d7 tempest-SnapshotDataIntegrityTests-1151129385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2d01647-81b2-42e5-9058-6469a4218023) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:56:36 devstack cinder-volume[88899]: INFO cinder.volume.flows.manager.create_volume [None req-df9bdd3d-2776-424a-ac65-e01e8475c1d7 tempest-SnapshotDataIntegrityTests-1151129385 None] Volume c512cee2-9ba7-4fbc-85e0-b9cff62418ed: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c512cee2-9ba7-4fbc-85e0-b9cff62418ed', 'volume_size': 1} Aug 03 08:56:36 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-df9bdd3d-2776-424a-ac65-e01e8475c1d7 tempest-SnapshotDataIntegrityTests-1151129385 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:56:36 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-df9bdd3d-2776-424a-ac65-e01e8475c1d7 tempest-SnapshotDataIntegrityTests-1151129385 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:56:36 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-df9bdd3d-2776-424a-ac65-e01e8475c1d7 tempest-SnapshotDataIntegrityTests-1151129385 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:56:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDataIntegrityTests-volume-414149359',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c512cee2-9ba7-4fbc-85e0-b9cff62418ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='edcd5572d27049ba9a002c778c2d4964',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:56:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:56:36Z,use_quota=True,user_id='a347373422e34c2089490fba111c8f5d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8bde7129-1dc4-42ab-b852-ab32c61b4921),volume_type_id=8bde7129-1dc4-42ab-b852-ab32c61b4921)}" {{(pid=88899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 08:56:36 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-df9bdd3d-2776-424a-ac65-e01e8475c1d7 tempest-SnapshotDataIntegrityTests-1151129385 None] Creating volume c512cee2-9ba7-4fbc-85e0-b9cff62418ed {{(pid=88899) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 08:56:36 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-df9bdd3d-2776-424a-ac65-e01e8475c1d7 tempest-SnapshotDataIntegrityTests-1151129385 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:56:36 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-df9bdd3d-2776-424a-ac65-e01e8475c1d7 tempest-SnapshotDataIntegrityTests-1151129385 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:56:36 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-df9bdd3d-2776-424a-ac65-e01e8475c1d7 tempest-SnapshotDataIntegrityTests-1151129385 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:56:36 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-df9bdd3d-2776-424a-ac65-e01e8475c1d7 tempest-SnapshotDataIntegrityTests-1151129385 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:56:36 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-df9bdd3d-2776-424a-ac65-e01e8475c1d7 tempest-SnapshotDataIntegrityTests-1151129385 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:56:36 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-df9bdd3d-2776-424a-ac65-e01e8475c1d7 tempest-SnapshotDataIntegrityTests-1151129385 None] Selected osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385 as target Quobyte volume. {{(pid=88899) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 08:56:36 devstack cinder-volume[88899]: INFO cinder.volume.drivers.remotefs [None req-df9bdd3d-2776-424a-ac65-e01e8475c1d7 tempest-SnapshotDataIntegrityTests-1151129385 None] casted to osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385 Aug 03 08:56:36 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-df9bdd3d-2776-424a-ac65-e01e8475c1d7 tempest-SnapshotDataIntegrityTests-1151129385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c512cee2-9ba7-4fbc-85e0-b9cff62418ed 1073741824 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:56:36 devstack sudo[114893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c512cee2-9ba7-4fbc-85e0-b9cff62418ed 1073741824 Aug 03 08:56:36 devstack sudo[114893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:56:36 devstack sudo[114893]: pam_unix(sudo:session): session closed for user root Aug 03 08:56:36 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-df9bdd3d-2776-424a-ac65-e01e8475c1d7 tempest-SnapshotDataIntegrityTests-1151129385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c512cee2-9ba7-4fbc-85e0-b9cff62418ed 1073741824" returned: 0 in 0.431s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:56:36 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-df9bdd3d-2776-424a-ac65-e01e8475c1d7 tempest-SnapshotDataIntegrityTests-1151129385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c512cee2-9ba7-4fbc-85e0-b9cff62418ed {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:56:36 devstack sudo[114899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c512cee2-9ba7-4fbc-85e0-b9cff62418ed Aug 03 08:56:36 devstack sudo[114899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:56:37 devstack sudo[114899]: pam_unix(sudo:session): session closed for user root Aug 03 08:56:37 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-df9bdd3d-2776-424a-ac65-e01e8475c1d7 tempest-SnapshotDataIntegrityTests-1151129385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c512cee2-9ba7-4fbc-85e0-b9cff62418ed" returned: 0 in 0.247s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:56:37 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-df9bdd3d-2776-424a-ac65-e01e8475c1d7 tempest-SnapshotDataIntegrityTests-1151129385 None] <== create_volume: return (719ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'} {{(pid=88899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 08:56:37 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-df9bdd3d-2776-424a-ac65-e01e8475c1d7 tempest-SnapshotDataIntegrityTests-1151129385 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.722s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:56:37 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-df9bdd3d-2776-424a-ac65-e01e8475c1d7 tempest-SnapshotDataIntegrityTests-1151129385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2d01647-81b2-42e5-9058-6469a4218023) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c512cee2-9ba7-4fbc-85e0-b9cff62418ed', 'volume_size': 1}' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:56:37 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-df9bdd3d-2776-424a-ac65-e01e8475c1d7 tempest-SnapshotDataIntegrityTests-1151129385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67c2f2d7-d71b-4a53-a787-bfb057243a7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:56:37 devstack cinder-volume[88899]: INFO cinder.volume.flows.manager.create_volume [None req-df9bdd3d-2776-424a-ac65-e01e8475c1d7 tempest-SnapshotDataIntegrityTests-1151129385 None] Volume volume-c512cee2-9ba7-4fbc-85e0-b9cff62418ed (c512cee2-9ba7-4fbc-85e0-b9cff62418ed): created successfully Aug 03 08:56:37 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-df9bdd3d-2776-424a-ac65-e01e8475c1d7 tempest-SnapshotDataIntegrityTests-1151129385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67c2f2d7-d71b-4a53-a787-bfb057243a7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:56:37 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-df9bdd3d-2776-424a-ac65-e01e8475c1d7 tempest-SnapshotDataIntegrityTests-1151129385 None] Flow 'volume_create_manager' (18315815-4748-4767-844c-e6a06fb5e23a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:56:37 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-df9bdd3d-2776-424a-ac65-e01e8475c1d7 tempest-SnapshotDataIntegrityTests-1151129385 None] Created volume successfully. Aug 03 08:56:38 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [req-96e62887-e5c4-45a1-8d59-005120a2f721 req-1d94668c-33d5-4826-bf69-9b0236a326a2 tempest-SnapshotDataIntegrityTests-1151129385 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:56:38 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [req-96e62887-e5c4-45a1-8d59-005120a2f721 req-1d94668c-33d5-4826-bf69-9b0236a326a2 tempest-SnapshotDataIntegrityTests-1151129385 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:56:38 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [req-96e62887-e5c4-45a1-8d59-005120a2f721 req-1d94668c-33d5-4826-bf69-9b0236a326a2 tempest-SnapshotDataIntegrityTests-1151129385 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.012s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:56:38 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [req-96e62887-e5c4-45a1-8d59-005120a2f721 req-1d94668c-33d5-4826-bf69-9b0236a326a2 tempest-SnapshotDataIntegrityTests-1151129385 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385', 'name': 'volume-c512cee2-9ba7-4fbc-85e0-b9cff62418ed', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b4ac2fb7-7415-47f4-b3b4-278e903c3909', 'enforce_multipath': True} {{(pid=88899) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 03 08:56:38 devstack cinder-volume[88899]: INFO cinder.volume.manager [req-96e62887-e5c4-45a1-8d59-005120a2f721 req-1d94668c-33d5-4826-bf69-9b0236a326a2 tempest-SnapshotDataIntegrityTests-1151129385 None] attachment_update completed successfully. Aug 03 08:56:41 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-188dc495-74e2-4f8f-a562-e90197e83f7f tempest-SnapshotDataIntegrityTests-1151129385 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:56:41 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-188dc495-74e2-4f8f-a562-e90197e83f7f tempest-SnapshotDataIntegrityTests-1151129385 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:56:41 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-188dc495-74e2-4f8f-a562-e90197e83f7f tempest-SnapshotDataIntegrityTests-1151129385 None] Creating online snapshot ebf3e7c1-e3dd-4712-b6c6-1e1951de8a97 of volume c512cee2-9ba7-4fbc-85e0-b9cff62418ed {{(pid=88899) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 03 08:56:41 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf15cd95-a71d-49e8-a88f-d05844cd2bd3]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:56:41 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-188dc495-74e2-4f8f-a562-e90197e83f7f tempest-SnapshotDataIntegrityTests-1151129385 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c512cee2-9ba7-4fbc-85e0-b9cff62418ed {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:56:42 devstack sudo[115330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c512cee2-9ba7-4fbc-85e0-b9cff62418ed Aug 03 08:56:42 devstack sudo[115330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:56:42 devstack sudo[115330]: pam_unix(sudo:session): session closed for user root Aug 03 08:56:42 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-188dc495-74e2-4f8f-a562-e90197e83f7f tempest-SnapshotDataIntegrityTests-1151129385 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c512cee2-9ba7-4fbc-85e0-b9cff62418ed" returned: 0 in 0.398s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:56:42 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-188dc495-74e2-4f8f-a562-e90197e83f7f tempest-SnapshotDataIntegrityTests-1151129385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c512cee2-9ba7-4fbc-85e0-b9cff62418ed,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c512cee2-9ba7-4fbc-85e0-b9cff62418ed.ebf3e7c1-e3dd-4712-b6c6-1e1951de8a97 1G {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:56:42 devstack sudo[115335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c512cee2-9ba7-4fbc-85e0-b9cff62418ed,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c512cee2-9ba7-4fbc-85e0-b9cff62418ed.ebf3e7c1-e3dd-4712-b6c6-1e1951de8a97 1G Aug 03 08:56:42 devstack sudo[115335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:56:42 devstack sudo[115335]: pam_unix(sudo:session): session closed for user root Aug 03 08:56:42 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-188dc495-74e2-4f8f-a562-e90197e83f7f tempest-SnapshotDataIntegrityTests-1151129385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c512cee2-9ba7-4fbc-85e0-b9cff62418ed,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c512cee2-9ba7-4fbc-85e0-b9cff62418ed.ebf3e7c1-e3dd-4712-b6c6-1e1951de8a97 1G" returned: 0 in 0.440s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:56:42 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-188dc495-74e2-4f8f-a562-e90197e83f7f tempest-SnapshotDataIntegrityTests-1151129385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c512cee2-9ba7-4fbc-85e0-b9cff62418ed -F qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c512cee2-9ba7-4fbc-85e0-b9cff62418ed.ebf3e7c1-e3dd-4712-b6c6-1e1951de8a97 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:56:42 devstack sudo[115341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c512cee2-9ba7-4fbc-85e0-b9cff62418ed -F qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c512cee2-9ba7-4fbc-85e0-b9cff62418ed.ebf3e7c1-e3dd-4712-b6c6-1e1951de8a97 Aug 03 08:56:42 devstack sudo[115341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:56:43 devstack sudo[115341]: pam_unix(sudo:session): session closed for user root Aug 03 08:56:43 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-188dc495-74e2-4f8f-a562-e90197e83f7f tempest-SnapshotDataIntegrityTests-1151129385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c512cee2-9ba7-4fbc-85e0-b9cff62418ed -F qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c512cee2-9ba7-4fbc-85e0-b9cff62418ed.ebf3e7c1-e3dd-4712-b6c6-1e1951de8a97" returned: 0 in 0.306s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:56:43 devstack cinder-volume[88899]: WARNING cinder.volume.drivers.remotefs [None req-188dc495-74e2-4f8f-a562-e90197e83f7f tempest-SnapshotDataIntegrityTests-1151129385 None] /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c512cee2-9ba7-4fbc-85e0-b9cff62418ed.ebf3e7c1-e3dd-4712-b6c6-1e1951de8a97 is being set with open permissions: ugo+rw Aug 03 08:56:43 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-188dc495-74e2-4f8f-a562-e90197e83f7f tempest-SnapshotDataIntegrityTests-1151129385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c512cee2-9ba7-4fbc-85e0-b9cff62418ed.ebf3e7c1-e3dd-4712-b6c6-1e1951de8a97 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:56:43 devstack sudo[115346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c512cee2-9ba7-4fbc-85e0-b9cff62418ed.ebf3e7c1-e3dd-4712-b6c6-1e1951de8a97 Aug 03 08:56:43 devstack sudo[115346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:56:43 devstack sudo[115346]: pam_unix(sudo:session): session closed for user root Aug 03 08:56:43 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-188dc495-74e2-4f8f-a562-e90197e83f7f tempest-SnapshotDataIntegrityTests-1151129385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c512cee2-9ba7-4fbc-85e0-b9cff62418ed.ebf3e7c1-e3dd-4712-b6c6-1e1951de8a97" returned: 0 in 0.261s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:56:43 devstack cinder-volume[88899]: DEBUG cinder.compute.nova [None req-188dc495-74e2-4f8f-a562-e90197e83f7f tempest-SnapshotDataIntegrityTests-1151129385 None] Creating Keystone auth plugin from conf {{(pid=88899) novaclient /opt/stack/cinder/cinder/compute/nova.py:99}} Aug 03 08:56:43 devstack cinder-volume[88899]: DEBUG novaclient.v2.client [None req-188dc495-74e2-4f8f-a562-e90197e83f7f tempest-SnapshotDataIntegrityTests-1151129385 None] REQ: curl -g -i -X POST http://192.168.122.55/compute/v2.1/os-assisted-volume-snapshots -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}0a8d44bd38e24b1f0fecdf3bd8383fc56a51aacc86e35f0193391f0ef2d53992" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-188dc495-74e2-4f8f-a562-e90197e83f7f" -H "X-Service-Token: {SHA256}c96e034f4f8a4d16079c50f41a6bc99d8f702fc5a9a0d1604994b54ce68306ce" -d '{"snapshot": {"volume_id": "c512cee2-9ba7-4fbc-85e0-b9cff62418ed", "create_info": {"type": "qcow2", "new_file": "volume-c512cee2-9ba7-4fbc-85e0-b9cff62418ed.ebf3e7c1-e3dd-4712-b6c6-1e1951de8a97", "snapshot_id": "ebf3e7c1-e3dd-4712-b6c6-1e1951de8a97"}}}' {{(pid=88899) _http_log_request /opt/stack/data/venv/lib/python3.12/site-packages/keystoneauth1/session.py:575}} Aug 03 08:56:43 devstack cinder-volume[88899]: DEBUG novaclient.v2.client [None req-188dc495-74e2-4f8f-a562-e90197e83f7f tempest-SnapshotDataIntegrityTests-1151129385 None] RESP: [200] Connection: close Content-Length: 78 Content-Type: application/json Date: Mon, 03 Aug 2026 06:56:43 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.58 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-6c502a26-22fe-4d94-bc1c-ea2e7b4b7939 x-openstack-request-id: req-6c502a26-22fe-4d94-bc1c-ea2e7b4b7939 {{(pid=88899) _http_log_response /opt/stack/data/venv/lib/python3.12/site-packages/keystoneauth1/session.py:616}} Aug 03 08:56:43 devstack cinder-volume[88899]: DEBUG novaclient.v2.client [None req-188dc495-74e2-4f8f-a562-e90197e83f7f tempest-SnapshotDataIntegrityTests-1151129385 None] RESP BODY: {"snapshot": {"id": null, "volumeId": "c512cee2-9ba7-4fbc-85e0-b9cff62418ed"}} {{(pid=88899) _http_log_response /opt/stack/data/venv/lib/python3.12/site-packages/keystoneauth1/session.py:651}} Aug 03 08:56:43 devstack cinder-volume[88899]: DEBUG novaclient.v2.client [None req-188dc495-74e2-4f8f-a562-e90197e83f7f tempest-SnapshotDataIntegrityTests-1151129385 None] POST call to compute for http://192.168.122.55/compute/v2.1/os-assisted-volume-snapshots used request id req-6c502a26-22fe-4d94-bc1c-ea2e7b4b7939 {{(pid=88899) request /opt/stack/data/venv/lib/python3.12/site-packages/keystoneauth1/session.py:1076}} Aug 03 08:56:43 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-188dc495-74e2-4f8f-a562-e90197e83f7f tempest-SnapshotDataIntegrityTests-1151129385 None] nova call result: None {{(pid=88899) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1910}} Aug 03 08:56:43 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-188dc495-74e2-4f8f-a562-e90197e83f7f tempest-SnapshotDataIntegrityTests-1151129385 None] Status of snapshot ebf3e7c1-e3dd-4712-b6c6-1e1951de8a97 is now creating {{(pid=88899) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Aug 03 08:56:44 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-188dc495-74e2-4f8f-a562-e90197e83f7f tempest-SnapshotDataIntegrityTests-1151129385 None] Status of snapshot ebf3e7c1-e3dd-4712-b6c6-1e1951de8a97 is now creating {{(pid=88899) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Aug 03 08:56:45 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-188dc495-74e2-4f8f-a562-e90197e83f7f tempest-SnapshotDataIntegrityTests-1151129385 None] Status of snapshot ebf3e7c1-e3dd-4712-b6c6-1e1951de8a97 is now creating {{(pid=88899) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Aug 03 08:56:46 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-188dc495-74e2-4f8f-a562-e90197e83f7f tempest-SnapshotDataIntegrityTests-1151129385 None] Status of snapshot ebf3e7c1-e3dd-4712-b6c6-1e1951de8a97 is now creating {{(pid=88899) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Aug 03 08:56:47 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-188dc495-74e2-4f8f-a562-e90197e83f7f tempest-SnapshotDataIntegrityTests-1151129385 None] Status of snapshot ebf3e7c1-e3dd-4712-b6c6-1e1951de8a97 is now creating {{(pid=88899) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Aug 03 08:56:48 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-188dc495-74e2-4f8f-a562-e90197e83f7f tempest-SnapshotDataIntegrityTests-1151129385 None] Status of snapshot ebf3e7c1-e3dd-4712-b6c6-1e1951de8a97 is now creating {{(pid=88899) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Aug 03 08:56:49 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-188dc495-74e2-4f8f-a562-e90197e83f7f tempest-SnapshotDataIntegrityTests-1151129385 None] Status of snapshot ebf3e7c1-e3dd-4712-b6c6-1e1951de8a97 is now creating {{(pid=88899) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Aug 03 08:56:50 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-188dc495-74e2-4f8f-a562-e90197e83f7f tempest-SnapshotDataIntegrityTests-1151129385 None] Status of snapshot ebf3e7c1-e3dd-4712-b6c6-1e1951de8a97 is now creating {{(pid=88899) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Aug 03 08:56:51 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-188dc495-74e2-4f8f-a562-e90197e83f7f tempest-SnapshotDataIntegrityTests-1151129385 None] Status of snapshot ebf3e7c1-e3dd-4712-b6c6-1e1951de8a97 is now creating {{(pid=88899) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Aug 03 08:56:51 devstack cinder-volume[88899]: DEBUG oslo_service.periodic_task [None req-f948fb4a-c4d7-499f-b1bd-8d6be3de0b53 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88899) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 03 08:56:51 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-f948fb4a-c4d7-499f-b1bd-8d6be3de0b53 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:56:51 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-f948fb4a-c4d7-499f-b1bd-8d6be3de0b53 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:56:51 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-f948fb4a-c4d7-499f-b1bd-8d6be3de0b53 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:56:51 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-f948fb4a-c4d7-499f-b1bd-8d6be3de0b53 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:56:51 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-f948fb4a-c4d7-499f-b1bd-8d6be3de0b53 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:56:51 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-f948fb4a-c4d7-499f-b1bd-8d6be3de0b53 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:56:51 devstack sudo[115355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a Aug 03 08:56:51 devstack sudo[115355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:56:52 devstack sudo[115355]: pam_unix(sudo:session): session closed for user root Aug 03 08:56:52 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-f948fb4a-c4d7-499f-b1bd-8d6be3de0b53 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a" returned: 0 in 0.264s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:56:52 devstack cinder-volume[88899]: DEBUG cinder.manager [None req-f948fb4a-c4d7-499f-b1bd-8d6be3de0b53 None None] Notifying Schedulers of capabilities ... {{(pid=88899) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 08:56:52 devstack cinder-volume[88899]: DEBUG oslo_service.periodic_task [None req-f948fb4a-c4d7-499f-b1bd-8d6be3de0b53 None None] Running periodic task VolumeManager._thread_info {{(pid=88899) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 03 08:56:52 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-f948fb4a-c4d7-499f-b1bd-8d6be3de0b53 None None] thread count: 29 {{(pid=88899) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 03 08:56:52 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-f948fb4a-c4d7-499f-b1bd-8d6be3de0b53 None None] thread info: [<_MainThread(MainThread, started 132234320248960)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88899) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 03 08:56:52 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-188dc495-74e2-4f8f-a562-e90197e83f7f tempest-SnapshotDataIntegrityTests-1151129385 None] Status of snapshot ebf3e7c1-e3dd-4712-b6c6-1e1951de8a97 is now creating {{(pid=88899) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Aug 03 08:56:53 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-188dc495-74e2-4f8f-a562-e90197e83f7f tempest-SnapshotDataIntegrityTests-1151129385 None] Status of snapshot ebf3e7c1-e3dd-4712-b6c6-1e1951de8a97 is now creating {{(pid=88899) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Aug 03 08:56:54 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-188dc495-74e2-4f8f-a562-e90197e83f7f tempest-SnapshotDataIntegrityTests-1151129385 None] Status of snapshot ebf3e7c1-e3dd-4712-b6c6-1e1951de8a97 is now creating {{(pid=88899) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Aug 03 08:56:56 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-188dc495-74e2-4f8f-a562-e90197e83f7f tempest-SnapshotDataIntegrityTests-1151129385 None] Status of snapshot ebf3e7c1-e3dd-4712-b6c6-1e1951de8a97 is now creating {{(pid=88899) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Aug 03 08:56:58 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-188dc495-74e2-4f8f-a562-e90197e83f7f tempest-SnapshotDataIntegrityTests-1151129385 None] Status of snapshot ebf3e7c1-e3dd-4712-b6c6-1e1951de8a97 is now creating {{(pid=88899) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Aug 03 08:57:00 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-188dc495-74e2-4f8f-a562-e90197e83f7f tempest-SnapshotDataIntegrityTests-1151129385 None] Status of snapshot ebf3e7c1-e3dd-4712-b6c6-1e1951de8a97 is now creating {{(pid=88899) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Aug 03 08:57:00 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-188dc495-74e2-4f8f-a562-e90197e83f7f tempest-SnapshotDataIntegrityTests-1151129385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c512cee2-9ba7-4fbc-85e0-b9cff62418ed.info {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:57:00 devstack sudo[115384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c512cee2-9ba7-4fbc-85e0-b9cff62418ed.info Aug 03 08:57:00 devstack sudo[115384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:57:01 devstack sudo[115384]: pam_unix(sudo:session): session closed for user root Aug 03 08:57:01 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-188dc495-74e2-4f8f-a562-e90197e83f7f tempest-SnapshotDataIntegrityTests-1151129385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c512cee2-9ba7-4fbc-85e0-b9cff62418ed.info" returned: 0 in 0.286s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:57:01 devstack cinder-volume[88899]: WARNING cinder.volume.drivers.remotefs [None req-188dc495-74e2-4f8f-a562-e90197e83f7f tempest-SnapshotDataIntegrityTests-1151129385 None] /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c512cee2-9ba7-4fbc-85e0-b9cff62418ed.info is being set with open permissions: ugo+rw Aug 03 08:57:01 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-188dc495-74e2-4f8f-a562-e90197e83f7f tempest-SnapshotDataIntegrityTests-1151129385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c512cee2-9ba7-4fbc-85e0-b9cff62418ed.info {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:57:01 devstack sudo[115387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c512cee2-9ba7-4fbc-85e0-b9cff62418ed.info Aug 03 08:57:01 devstack sudo[115387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:57:01 devstack sudo[115387]: pam_unix(sudo:session): session closed for user root Aug 03 08:57:01 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-188dc495-74e2-4f8f-a562-e90197e83f7f tempest-SnapshotDataIntegrityTests-1151129385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c512cee2-9ba7-4fbc-85e0-b9cff62418ed.info" returned: 0 in 0.273s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:57:01 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-188dc495-74e2-4f8f-a562-e90197e83f7f tempest-SnapshotDataIntegrityTests-1151129385 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 19.482s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:57:01 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-188dc495-74e2-4f8f-a562-e90197e83f7f tempest-SnapshotDataIntegrityTests-1151129385 None] Create snapshot completed successfully Aug 03 08:57:02 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-c282d8e3-443f-40ed-aa4e-a7b0731f5f52 tempest-SnapshotDataIntegrityTests-1151129385 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:57:02 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-c282d8e3-443f-40ed-aa4e-a7b0731f5f52 tempest-SnapshotDataIntegrityTests-1151129385 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:57:02 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-c282d8e3-443f-40ed-aa4e-a7b0731f5f52 tempest-SnapshotDataIntegrityTests-1151129385 None] Creating online snapshot 2c13d4e1-7236-492a-acfe-ed7ae7c837ef of volume c512cee2-9ba7-4fbc-85e0-b9cff62418ed {{(pid=88899) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 03 08:57:02 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[37fd411c-c8fc-491f-ab5d-b2b69a44dfda]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:57:02 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-c282d8e3-443f-40ed-aa4e-a7b0731f5f52 tempest-SnapshotDataIntegrityTests-1151129385 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c512cee2-9ba7-4fbc-85e0-b9cff62418ed.ebf3e7c1-e3dd-4712-b6c6-1e1951de8a97 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:57:02 devstack sudo[115406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c512cee2-9ba7-4fbc-85e0-b9cff62418ed.ebf3e7c1-e3dd-4712-b6c6-1e1951de8a97 Aug 03 08:57:02 devstack sudo[115406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:57:03 devstack sudo[115406]: pam_unix(sudo:session): session closed for user root Aug 03 08:57:03 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-c282d8e3-443f-40ed-aa4e-a7b0731f5f52 tempest-SnapshotDataIntegrityTests-1151129385 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c512cee2-9ba7-4fbc-85e0-b9cff62418ed.ebf3e7c1-e3dd-4712-b6c6-1e1951de8a97" returned: 0 in 0.433s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:57:03 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-c282d8e3-443f-40ed-aa4e-a7b0731f5f52 tempest-SnapshotDataIntegrityTests-1151129385 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c512cee2-9ba7-4fbc-85e0-b9cff62418ed(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88899) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 03 08:57:03 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-c282d8e3-443f-40ed-aa4e-a7b0731f5f52 tempest-SnapshotDataIntegrityTests-1151129385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c512cee2-9ba7-4fbc-85e0-b9cff62418ed.ebf3e7c1-e3dd-4712-b6c6-1e1951de8a97,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c512cee2-9ba7-4fbc-85e0-b9cff62418ed.2c13d4e1-7236-492a-acfe-ed7ae7c837ef 1G {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:57:03 devstack sudo[115415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c512cee2-9ba7-4fbc-85e0-b9cff62418ed.ebf3e7c1-e3dd-4712-b6c6-1e1951de8a97,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c512cee2-9ba7-4fbc-85e0-b9cff62418ed.2c13d4e1-7236-492a-acfe-ed7ae7c837ef 1G Aug 03 08:57:03 devstack sudo[115415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:57:03 devstack sudo[115415]: pam_unix(sudo:session): session closed for user root Aug 03 08:57:03 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-c282d8e3-443f-40ed-aa4e-a7b0731f5f52 tempest-SnapshotDataIntegrityTests-1151129385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c512cee2-9ba7-4fbc-85e0-b9cff62418ed.ebf3e7c1-e3dd-4712-b6c6-1e1951de8a97,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c512cee2-9ba7-4fbc-85e0-b9cff62418ed.2c13d4e1-7236-492a-acfe-ed7ae7c837ef 1G" returned: 0 in 0.467s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:57:03 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-c282d8e3-443f-40ed-aa4e-a7b0731f5f52 tempest-SnapshotDataIntegrityTests-1151129385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c512cee2-9ba7-4fbc-85e0-b9cff62418ed.ebf3e7c1-e3dd-4712-b6c6-1e1951de8a97 -F qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c512cee2-9ba7-4fbc-85e0-b9cff62418ed.2c13d4e1-7236-492a-acfe-ed7ae7c837ef {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:57:03 devstack sudo[115421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c512cee2-9ba7-4fbc-85e0-b9cff62418ed.ebf3e7c1-e3dd-4712-b6c6-1e1951de8a97 -F qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c512cee2-9ba7-4fbc-85e0-b9cff62418ed.2c13d4e1-7236-492a-acfe-ed7ae7c837ef Aug 03 08:57:03 devstack sudo[115421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:57:03 devstack sudo[115421]: pam_unix(sudo:session): session closed for user root Aug 03 08:57:03 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-c282d8e3-443f-40ed-aa4e-a7b0731f5f52 tempest-SnapshotDataIntegrityTests-1151129385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c512cee2-9ba7-4fbc-85e0-b9cff62418ed.ebf3e7c1-e3dd-4712-b6c6-1e1951de8a97 -F qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c512cee2-9ba7-4fbc-85e0-b9cff62418ed.2c13d4e1-7236-492a-acfe-ed7ae7c837ef" returned: 0 in 0.288s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:57:03 devstack cinder-volume[88899]: WARNING cinder.volume.drivers.remotefs [None req-c282d8e3-443f-40ed-aa4e-a7b0731f5f52 tempest-SnapshotDataIntegrityTests-1151129385 None] /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c512cee2-9ba7-4fbc-85e0-b9cff62418ed.2c13d4e1-7236-492a-acfe-ed7ae7c837ef is being set with open permissions: ugo+rw Aug 03 08:57:03 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-c282d8e3-443f-40ed-aa4e-a7b0731f5f52 tempest-SnapshotDataIntegrityTests-1151129385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c512cee2-9ba7-4fbc-85e0-b9cff62418ed.2c13d4e1-7236-492a-acfe-ed7ae7c837ef {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:57:04 devstack sudo[115426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c512cee2-9ba7-4fbc-85e0-b9cff62418ed.2c13d4e1-7236-492a-acfe-ed7ae7c837ef Aug 03 08:57:04 devstack sudo[115426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:57:04 devstack sudo[115426]: pam_unix(sudo:session): session closed for user root Aug 03 08:57:04 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-c282d8e3-443f-40ed-aa4e-a7b0731f5f52 tempest-SnapshotDataIntegrityTests-1151129385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c512cee2-9ba7-4fbc-85e0-b9cff62418ed.2c13d4e1-7236-492a-acfe-ed7ae7c837ef" returned: 0 in 0.258s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:57:04 devstack cinder-volume[88899]: DEBUG cinder.compute.nova [None req-c282d8e3-443f-40ed-aa4e-a7b0731f5f52 tempest-SnapshotDataIntegrityTests-1151129385 None] Creating Keystone auth plugin from conf {{(pid=88899) novaclient /opt/stack/cinder/cinder/compute/nova.py:99}} Aug 03 08:57:04 devstack cinder-volume[88899]: DEBUG novaclient.v2.client [None req-c282d8e3-443f-40ed-aa4e-a7b0731f5f52 tempest-SnapshotDataIntegrityTests-1151129385 None] REQ: curl -g -i -X POST http://192.168.122.55/compute/v2.1/os-assisted-volume-snapshots -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}7b7ef9273e0db4b7f60b6f738f7e4c48894577e88acb008b34e4c2fccd261f14" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-c282d8e3-443f-40ed-aa4e-a7b0731f5f52" -H "X-Service-Token: {SHA256}c96e034f4f8a4d16079c50f41a6bc99d8f702fc5a9a0d1604994b54ce68306ce" -d '{"snapshot": {"volume_id": "c512cee2-9ba7-4fbc-85e0-b9cff62418ed", "create_info": {"type": "qcow2", "new_file": "volume-c512cee2-9ba7-4fbc-85e0-b9cff62418ed.2c13d4e1-7236-492a-acfe-ed7ae7c837ef", "snapshot_id": "2c13d4e1-7236-492a-acfe-ed7ae7c837ef"}}}' {{(pid=88899) _http_log_request /opt/stack/data/venv/lib/python3.12/site-packages/keystoneauth1/session.py:575}} Aug 03 08:57:04 devstack cinder-volume[88899]: DEBUG novaclient.v2.client [None req-c282d8e3-443f-40ed-aa4e-a7b0731f5f52 tempest-SnapshotDataIntegrityTests-1151129385 None] RESP: [200] Connection: close Content-Length: 78 Content-Type: application/json Date: Mon, 03 Aug 2026 06:57:04 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.58 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-0db3eda1-4a10-4ec4-973e-e45bc9018090 x-openstack-request-id: req-0db3eda1-4a10-4ec4-973e-e45bc9018090 {{(pid=88899) _http_log_response /opt/stack/data/venv/lib/python3.12/site-packages/keystoneauth1/session.py:616}} Aug 03 08:57:04 devstack cinder-volume[88899]: DEBUG novaclient.v2.client [None req-c282d8e3-443f-40ed-aa4e-a7b0731f5f52 tempest-SnapshotDataIntegrityTests-1151129385 None] RESP BODY: {"snapshot": {"id": null, "volumeId": "c512cee2-9ba7-4fbc-85e0-b9cff62418ed"}} {{(pid=88899) _http_log_response /opt/stack/data/venv/lib/python3.12/site-packages/keystoneauth1/session.py:651}} Aug 03 08:57:04 devstack cinder-volume[88899]: DEBUG novaclient.v2.client [None req-c282d8e3-443f-40ed-aa4e-a7b0731f5f52 tempest-SnapshotDataIntegrityTests-1151129385 None] POST call to compute for http://192.168.122.55/compute/v2.1/os-assisted-volume-snapshots used request id req-0db3eda1-4a10-4ec4-973e-e45bc9018090 {{(pid=88899) request /opt/stack/data/venv/lib/python3.12/site-packages/keystoneauth1/session.py:1076}} Aug 03 08:57:04 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-c282d8e3-443f-40ed-aa4e-a7b0731f5f52 tempest-SnapshotDataIntegrityTests-1151129385 None] nova call result: None {{(pid=88899) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1910}} Aug 03 08:57:04 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-c282d8e3-443f-40ed-aa4e-a7b0731f5f52 tempest-SnapshotDataIntegrityTests-1151129385 None] Status of snapshot 2c13d4e1-7236-492a-acfe-ed7ae7c837ef is now creating {{(pid=88899) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Aug 03 08:57:05 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-c282d8e3-443f-40ed-aa4e-a7b0731f5f52 tempest-SnapshotDataIntegrityTests-1151129385 None] Status of snapshot 2c13d4e1-7236-492a-acfe-ed7ae7c837ef is now creating {{(pid=88899) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Aug 03 08:57:06 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-c282d8e3-443f-40ed-aa4e-a7b0731f5f52 tempest-SnapshotDataIntegrityTests-1151129385 None] Status of snapshot 2c13d4e1-7236-492a-acfe-ed7ae7c837ef is now creating {{(pid=88899) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Aug 03 08:57:07 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-c282d8e3-443f-40ed-aa4e-a7b0731f5f52 tempest-SnapshotDataIntegrityTests-1151129385 None] Status of snapshot 2c13d4e1-7236-492a-acfe-ed7ae7c837ef is now creating {{(pid=88899) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Aug 03 08:57:08 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-c282d8e3-443f-40ed-aa4e-a7b0731f5f52 tempest-SnapshotDataIntegrityTests-1151129385 None] Status of snapshot 2c13d4e1-7236-492a-acfe-ed7ae7c837ef is now creating {{(pid=88899) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Aug 03 08:57:09 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-c282d8e3-443f-40ed-aa4e-a7b0731f5f52 tempest-SnapshotDataIntegrityTests-1151129385 None] Status of snapshot 2c13d4e1-7236-492a-acfe-ed7ae7c837ef is now creating {{(pid=88899) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Aug 03 08:57:10 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-c282d8e3-443f-40ed-aa4e-a7b0731f5f52 tempest-SnapshotDataIntegrityTests-1151129385 None] Status of snapshot 2c13d4e1-7236-492a-acfe-ed7ae7c837ef is now creating {{(pid=88899) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Aug 03 08:57:11 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-c282d8e3-443f-40ed-aa4e-a7b0731f5f52 tempest-SnapshotDataIntegrityTests-1151129385 None] Status of snapshot 2c13d4e1-7236-492a-acfe-ed7ae7c837ef is now creating {{(pid=88899) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Aug 03 08:57:12 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-c282d8e3-443f-40ed-aa4e-a7b0731f5f52 tempest-SnapshotDataIntegrityTests-1151129385 None] Status of snapshot 2c13d4e1-7236-492a-acfe-ed7ae7c837ef is now creating {{(pid=88899) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Aug 03 08:57:13 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-c282d8e3-443f-40ed-aa4e-a7b0731f5f52 tempest-SnapshotDataIntegrityTests-1151129385 None] Status of snapshot 2c13d4e1-7236-492a-acfe-ed7ae7c837ef is now creating {{(pid=88899) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Aug 03 08:57:14 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-c282d8e3-443f-40ed-aa4e-a7b0731f5f52 tempest-SnapshotDataIntegrityTests-1151129385 None] Status of snapshot 2c13d4e1-7236-492a-acfe-ed7ae7c837ef is now creating {{(pid=88899) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Aug 03 08:57:15 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-c282d8e3-443f-40ed-aa4e-a7b0731f5f52 tempest-SnapshotDataIntegrityTests-1151129385 None] Status of snapshot 2c13d4e1-7236-492a-acfe-ed7ae7c837ef is now creating {{(pid=88899) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Aug 03 08:57:17 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-c282d8e3-443f-40ed-aa4e-a7b0731f5f52 tempest-SnapshotDataIntegrityTests-1151129385 None] Status of snapshot 2c13d4e1-7236-492a-acfe-ed7ae7c837ef is now creating {{(pid=88899) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Aug 03 08:57:19 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-c282d8e3-443f-40ed-aa4e-a7b0731f5f52 tempest-SnapshotDataIntegrityTests-1151129385 None] Status of snapshot 2c13d4e1-7236-492a-acfe-ed7ae7c837ef is now creating {{(pid=88899) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Aug 03 08:57:21 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-c282d8e3-443f-40ed-aa4e-a7b0731f5f52 tempest-SnapshotDataIntegrityTests-1151129385 None] Status of snapshot 2c13d4e1-7236-492a-acfe-ed7ae7c837ef is now creating {{(pid=88899) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Aug 03 08:57:21 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-c282d8e3-443f-40ed-aa4e-a7b0731f5f52 tempest-SnapshotDataIntegrityTests-1151129385 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 18.939s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:57:21 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-c282d8e3-443f-40ed-aa4e-a7b0731f5f52 tempest-SnapshotDataIntegrityTests-1151129385 None] Create snapshot completed successfully Aug 03 08:57:23 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-b2b3db4e-da96-4588-807e-c0fd9ec371e4 tempest-SnapshotDataIntegrityTests-1151129385 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:57:23 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-b2b3db4e-da96-4588-807e-c0fd9ec371e4 tempest-SnapshotDataIntegrityTests-1151129385 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:57:23 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-b2b3db4e-da96-4588-807e-c0fd9ec371e4 tempest-SnapshotDataIntegrityTests-1151129385 None] Creating online snapshot 2da3e47a-15e5-4b1d-b1af-ed66f9a58301 of volume c512cee2-9ba7-4fbc-85e0-b9cff62418ed {{(pid=88899) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 03 08:57:23 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d6927ed-4948-4aca-8dc0-3f77f36d5f91]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:57:23 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-b2b3db4e-da96-4588-807e-c0fd9ec371e4 tempest-SnapshotDataIntegrityTests-1151129385 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c512cee2-9ba7-4fbc-85e0-b9cff62418ed.2c13d4e1-7236-492a-acfe-ed7ae7c837ef {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:57:23 devstack sudo[115490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c512cee2-9ba7-4fbc-85e0-b9cff62418ed.2c13d4e1-7236-492a-acfe-ed7ae7c837ef Aug 03 08:57:23 devstack sudo[115490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:57:23 devstack sudo[115490]: pam_unix(sudo:session): session closed for user root Aug 03 08:57:23 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-b2b3db4e-da96-4588-807e-c0fd9ec371e4 tempest-SnapshotDataIntegrityTests-1151129385 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c512cee2-9ba7-4fbc-85e0-b9cff62418ed.2c13d4e1-7236-492a-acfe-ed7ae7c837ef" returned: 0 in 0.375s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:57:23 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-b2b3db4e-da96-4588-807e-c0fd9ec371e4 tempest-SnapshotDataIntegrityTests-1151129385 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c512cee2-9ba7-4fbc-85e0-b9cff62418ed(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88899) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 03 08:57:23 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-b2b3db4e-da96-4588-807e-c0fd9ec371e4 tempest-SnapshotDataIntegrityTests-1151129385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c512cee2-9ba7-4fbc-85e0-b9cff62418ed.2c13d4e1-7236-492a-acfe-ed7ae7c837ef,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c512cee2-9ba7-4fbc-85e0-b9cff62418ed.2da3e47a-15e5-4b1d-b1af-ed66f9a58301 1G {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:57:23 devstack sudo[115495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c512cee2-9ba7-4fbc-85e0-b9cff62418ed.2c13d4e1-7236-492a-acfe-ed7ae7c837ef,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c512cee2-9ba7-4fbc-85e0-b9cff62418ed.2da3e47a-15e5-4b1d-b1af-ed66f9a58301 1G Aug 03 08:57:23 devstack sudo[115495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:57:24 devstack sudo[115495]: pam_unix(sudo:session): session closed for user root Aug 03 08:57:24 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-b2b3db4e-da96-4588-807e-c0fd9ec371e4 tempest-SnapshotDataIntegrityTests-1151129385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c512cee2-9ba7-4fbc-85e0-b9cff62418ed.2c13d4e1-7236-492a-acfe-ed7ae7c837ef,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c512cee2-9ba7-4fbc-85e0-b9cff62418ed.2da3e47a-15e5-4b1d-b1af-ed66f9a58301 1G" returned: 0 in 0.500s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:57:24 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-b2b3db4e-da96-4588-807e-c0fd9ec371e4 tempest-SnapshotDataIntegrityTests-1151129385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c512cee2-9ba7-4fbc-85e0-b9cff62418ed.2c13d4e1-7236-492a-acfe-ed7ae7c837ef -F qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c512cee2-9ba7-4fbc-85e0-b9cff62418ed.2da3e47a-15e5-4b1d-b1af-ed66f9a58301 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:57:24 devstack sudo[115500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c512cee2-9ba7-4fbc-85e0-b9cff62418ed.2c13d4e1-7236-492a-acfe-ed7ae7c837ef -F qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c512cee2-9ba7-4fbc-85e0-b9cff62418ed.2da3e47a-15e5-4b1d-b1af-ed66f9a58301 Aug 03 08:57:24 devstack sudo[115500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:57:24 devstack sudo[115500]: pam_unix(sudo:session): session closed for user root Aug 03 08:57:24 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-b2b3db4e-da96-4588-807e-c0fd9ec371e4 tempest-SnapshotDataIntegrityTests-1151129385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c512cee2-9ba7-4fbc-85e0-b9cff62418ed.2c13d4e1-7236-492a-acfe-ed7ae7c837ef -F qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c512cee2-9ba7-4fbc-85e0-b9cff62418ed.2da3e47a-15e5-4b1d-b1af-ed66f9a58301" returned: 0 in 0.289s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:57:24 devstack cinder-volume[88899]: WARNING cinder.volume.drivers.remotefs [None req-b2b3db4e-da96-4588-807e-c0fd9ec371e4 tempest-SnapshotDataIntegrityTests-1151129385 None] /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c512cee2-9ba7-4fbc-85e0-b9cff62418ed.2da3e47a-15e5-4b1d-b1af-ed66f9a58301 is being set with open permissions: ugo+rw Aug 03 08:57:24 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-b2b3db4e-da96-4588-807e-c0fd9ec371e4 tempest-SnapshotDataIntegrityTests-1151129385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c512cee2-9ba7-4fbc-85e0-b9cff62418ed.2da3e47a-15e5-4b1d-b1af-ed66f9a58301 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:57:24 devstack sudo[115505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c512cee2-9ba7-4fbc-85e0-b9cff62418ed.2da3e47a-15e5-4b1d-b1af-ed66f9a58301 Aug 03 08:57:24 devstack sudo[115505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:57:24 devstack sudo[115505]: pam_unix(sudo:session): session closed for user root Aug 03 08:57:24 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-b2b3db4e-da96-4588-807e-c0fd9ec371e4 tempest-SnapshotDataIntegrityTests-1151129385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c512cee2-9ba7-4fbc-85e0-b9cff62418ed.2da3e47a-15e5-4b1d-b1af-ed66f9a58301" returned: 0 in 0.235s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:57:24 devstack cinder-volume[88899]: DEBUG cinder.compute.nova [None req-b2b3db4e-da96-4588-807e-c0fd9ec371e4 tempest-SnapshotDataIntegrityTests-1151129385 None] Creating Keystone auth plugin from conf {{(pid=88899) novaclient /opt/stack/cinder/cinder/compute/nova.py:99}} Aug 03 08:57:24 devstack cinder-volume[88899]: DEBUG novaclient.v2.client [None req-b2b3db4e-da96-4588-807e-c0fd9ec371e4 tempest-SnapshotDataIntegrityTests-1151129385 None] REQ: curl -g -i -X POST http://192.168.122.55/compute/v2.1/os-assisted-volume-snapshots -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}df4c7a44be489479250425bf1acb86c3ce91e3e86b153df6fb08064c5fe8eb21" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-b2b3db4e-da96-4588-807e-c0fd9ec371e4" -H "X-Service-Token: {SHA256}c96e034f4f8a4d16079c50f41a6bc99d8f702fc5a9a0d1604994b54ce68306ce" -d '{"snapshot": {"volume_id": "c512cee2-9ba7-4fbc-85e0-b9cff62418ed", "create_info": {"type": "qcow2", "new_file": "volume-c512cee2-9ba7-4fbc-85e0-b9cff62418ed.2da3e47a-15e5-4b1d-b1af-ed66f9a58301", "snapshot_id": "2da3e47a-15e5-4b1d-b1af-ed66f9a58301"}}}' {{(pid=88899) _http_log_request /opt/stack/data/venv/lib/python3.12/site-packages/keystoneauth1/session.py:575}} Aug 03 08:57:24 devstack cinder-volume[88899]: DEBUG novaclient.v2.client [None req-b2b3db4e-da96-4588-807e-c0fd9ec371e4 tempest-SnapshotDataIntegrityTests-1151129385 None] RESP: [200] Connection: close Content-Length: 78 Content-Type: application/json Date: Mon, 03 Aug 2026 06:57:24 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.58 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-6fe9de98-bdaf-4308-a8f4-5275e42c0877 x-openstack-request-id: req-6fe9de98-bdaf-4308-a8f4-5275e42c0877 {{(pid=88899) _http_log_response /opt/stack/data/venv/lib/python3.12/site-packages/keystoneauth1/session.py:616}} Aug 03 08:57:24 devstack cinder-volume[88899]: DEBUG novaclient.v2.client [None req-b2b3db4e-da96-4588-807e-c0fd9ec371e4 tempest-SnapshotDataIntegrityTests-1151129385 None] RESP BODY: {"snapshot": {"id": null, "volumeId": "c512cee2-9ba7-4fbc-85e0-b9cff62418ed"}} {{(pid=88899) _http_log_response /opt/stack/data/venv/lib/python3.12/site-packages/keystoneauth1/session.py:651}} Aug 03 08:57:24 devstack cinder-volume[88899]: DEBUG novaclient.v2.client [None req-b2b3db4e-da96-4588-807e-c0fd9ec371e4 tempest-SnapshotDataIntegrityTests-1151129385 None] POST call to compute for http://192.168.122.55/compute/v2.1/os-assisted-volume-snapshots used request id req-6fe9de98-bdaf-4308-a8f4-5275e42c0877 {{(pid=88899) request /opt/stack/data/venv/lib/python3.12/site-packages/keystoneauth1/session.py:1076}} Aug 03 08:57:24 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-b2b3db4e-da96-4588-807e-c0fd9ec371e4 tempest-SnapshotDataIntegrityTests-1151129385 None] nova call result: None {{(pid=88899) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1910}} Aug 03 08:57:24 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-b2b3db4e-da96-4588-807e-c0fd9ec371e4 tempest-SnapshotDataIntegrityTests-1151129385 None] Status of snapshot 2da3e47a-15e5-4b1d-b1af-ed66f9a58301 is now creating {{(pid=88899) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Aug 03 08:57:25 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-b2b3db4e-da96-4588-807e-c0fd9ec371e4 tempest-SnapshotDataIntegrityTests-1151129385 None] Status of snapshot 2da3e47a-15e5-4b1d-b1af-ed66f9a58301 is now creating {{(pid=88899) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Aug 03 08:57:26 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-b2b3db4e-da96-4588-807e-c0fd9ec371e4 tempest-SnapshotDataIntegrityTests-1151129385 None] Status of snapshot 2da3e47a-15e5-4b1d-b1af-ed66f9a58301 is now creating {{(pid=88899) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Aug 03 08:57:27 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-b2b3db4e-da96-4588-807e-c0fd9ec371e4 tempest-SnapshotDataIntegrityTests-1151129385 None] Status of snapshot 2da3e47a-15e5-4b1d-b1af-ed66f9a58301 is now creating {{(pid=88899) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Aug 03 08:57:28 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-b2b3db4e-da96-4588-807e-c0fd9ec371e4 tempest-SnapshotDataIntegrityTests-1151129385 None] Status of snapshot 2da3e47a-15e5-4b1d-b1af-ed66f9a58301 is now creating {{(pid=88899) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Aug 03 08:57:29 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-b2b3db4e-da96-4588-807e-c0fd9ec371e4 tempest-SnapshotDataIntegrityTests-1151129385 None] Status of snapshot 2da3e47a-15e5-4b1d-b1af-ed66f9a58301 is now creating {{(pid=88899) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Aug 03 08:57:30 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-b2b3db4e-da96-4588-807e-c0fd9ec371e4 tempest-SnapshotDataIntegrityTests-1151129385 None] Status of snapshot 2da3e47a-15e5-4b1d-b1af-ed66f9a58301 is now creating {{(pid=88899) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Aug 03 08:57:31 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-b2b3db4e-da96-4588-807e-c0fd9ec371e4 tempest-SnapshotDataIntegrityTests-1151129385 None] Status of snapshot 2da3e47a-15e5-4b1d-b1af-ed66f9a58301 is now creating {{(pid=88899) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Aug 03 08:57:33 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-b2b3db4e-da96-4588-807e-c0fd9ec371e4 tempest-SnapshotDataIntegrityTests-1151129385 None] Status of snapshot 2da3e47a-15e5-4b1d-b1af-ed66f9a58301 is now creating {{(pid=88899) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Aug 03 08:57:34 devstack cinder-volume[88899]: DEBUG dbcounter [-] [88899] Writing DB stats cinder:SELECT=40,cinder:UPDATE=5,cinder:DELETE=3,cinder:INSERT=1 {{(pid=88899) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 03 08:57:34 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-b2b3db4e-da96-4588-807e-c0fd9ec371e4 tempest-SnapshotDataIntegrityTests-1151129385 None] Status of snapshot 2da3e47a-15e5-4b1d-b1af-ed66f9a58301 is now creating {{(pid=88899) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Aug 03 08:57:35 devstack cinder-volume[88899]: DEBUG dbcounter [-] [88899] Writing DB stats cinder:UPDATE=12,cinder:SELECT=35,cinder:INSERT=1 {{(pid=88899) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 03 08:57:35 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-b2b3db4e-da96-4588-807e-c0fd9ec371e4 tempest-SnapshotDataIntegrityTests-1151129385 None] Status of snapshot 2da3e47a-15e5-4b1d-b1af-ed66f9a58301 is now creating {{(pid=88899) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Aug 03 08:57:36 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-b2b3db4e-da96-4588-807e-c0fd9ec371e4 tempest-SnapshotDataIntegrityTests-1151129385 None] Status of snapshot 2da3e47a-15e5-4b1d-b1af-ed66f9a58301 is now creating {{(pid=88899) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Aug 03 08:57:38 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-b2b3db4e-da96-4588-807e-c0fd9ec371e4 tempest-SnapshotDataIntegrityTests-1151129385 None] Status of snapshot 2da3e47a-15e5-4b1d-b1af-ed66f9a58301 is now creating {{(pid=88899) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Aug 03 08:57:40 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-b2b3db4e-da96-4588-807e-c0fd9ec371e4 tempest-SnapshotDataIntegrityTests-1151129385 None] Status of snapshot 2da3e47a-15e5-4b1d-b1af-ed66f9a58301 is now creating {{(pid=88899) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Aug 03 08:57:42 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-b2b3db4e-da96-4588-807e-c0fd9ec371e4 tempest-SnapshotDataIntegrityTests-1151129385 None] Status of snapshot 2da3e47a-15e5-4b1d-b1af-ed66f9a58301 is now creating {{(pid=88899) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Aug 03 08:57:42 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-b2b3db4e-da96-4588-807e-c0fd9ec371e4 tempest-SnapshotDataIntegrityTests-1151129385 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 18.842s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:57:42 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-b2b3db4e-da96-4588-807e-c0fd9ec371e4 tempest-SnapshotDataIntegrityTests-1151129385 None] Create snapshot completed successfully Aug 03 08:57:43 devstack cinder-volume[88899]: INFO cinder.volume.manager [req-567a217c-e912-4bd0-bd74-dec1c5874da4 req-e0c6c8fd-3c19-489b-96e2-ca5bebb8a283 tempest-SnapshotDataIntegrityTests-1151129385 None] Terminate volume connection completed successfully. Aug 03 08:57:43 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [req-567a217c-e912-4bd0-bd74-dec1c5874da4 req-e0c6c8fd-3c19-489b-96e2-ca5bebb8a283 tempest-SnapshotDataIntegrityTests-1151129385 None] Deleting attachment b4ac2fb7-7415-47f4-b3b4-278e903c3909. {{(pid=88899) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 03 08:57:44 devstack cinder-volume[88899]: DEBUG cinder.volume.flows.manager.create_volume [None req-2a1d6163-4b6c-4292-99ee-8ca400bd3576 tempest-SnapshotDataIntegrityTests-1151129385 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88899) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 08:57:44 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-2a1d6163-4b6c-4292-99ee-8ca400bd3576 tempest-SnapshotDataIntegrityTests-1151129385 None] Flow 'volume_create_manager' (2698e20a-d9d1-4edd-82bb-cf5138fe666e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:57:44 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-2a1d6163-4b6c-4292-99ee-8ca400bd3576 tempest-SnapshotDataIntegrityTests-1151129385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6cc6588d-40d0-4246-b368-23609a4a9fcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:57:44 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-2a1d6163-4b6c-4292-99ee-8ca400bd3576 tempest-SnapshotDataIntegrityTests-1151129385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6cc6588d-40d0-4246-b368-23609a4a9fcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:57:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDataIntegrityTests-volume-848221637',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ca95aeb-f6d4-4785-a0a1-f78a4154e8ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='edcd5572d27049ba9a002c778c2d4964',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:57:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=ebf3e7c1-e3dd-4712-b6c6-1e1951de8a97,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:57:45Z,use_quota=True,user_id='a347373422e34c2089490fba111c8f5d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8bde7129-1dc4-42ab-b852-ab32c61b4921),volume_type_id=8bde7129-1dc4-42ab-b852-ab32c61b4921)' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:57:44 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-2a1d6163-4b6c-4292-99ee-8ca400bd3576 tempest-SnapshotDataIntegrityTests-1151129385 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18482fad-4cd8-40a1-8447-f7cebbdd529c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:57:44 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-2a1d6163-4b6c-4292-99ee-8ca400bd3576 tempest-SnapshotDataIntegrityTests-1151129385 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18482fad-4cd8-40a1-8447-f7cebbdd529c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:57:44 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-2a1d6163-4b6c-4292-99ee-8ca400bd3576 tempest-SnapshotDataIntegrityTests-1151129385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8826f9c9-0877-4e8f-9b77-df38e30aaca4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:57:44 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-2a1d6163-4b6c-4292-99ee-8ca400bd3576 tempest-SnapshotDataIntegrityTests-1151129385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8826f9c9-0877-4e8f-9b77-df38e30aaca4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '9ca95aeb-f6d4-4785-a0a1-f78a4154e8ea', 'volume_name': 'volume-9ca95aeb-f6d4-4785-a0a1-f78a4154e8ea', 'volume_size': 1, 'snapshot_id': 'ebf3e7c1-e3dd-4712-b6c6-1e1951de8a97'}' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:57:44 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-2a1d6163-4b6c-4292-99ee-8ca400bd3576 tempest-SnapshotDataIntegrityTests-1151129385 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5902dbc9-f4c4-46df-ad7d-42450d395c2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:57:44 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-2a1d6163-4b6c-4292-99ee-8ca400bd3576 tempest-SnapshotDataIntegrityTests-1151129385 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5902dbc9-f4c4-46df-ad7d-42450d395c2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:57:44 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-2a1d6163-4b6c-4292-99ee-8ca400bd3576 tempest-SnapshotDataIntegrityTests-1151129385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee0a05b0-8f98-4bd9-b23c-fedb5cbc4aad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:57:44 devstack cinder-volume[88899]: INFO cinder.volume.flows.manager.create_volume [None req-2a1d6163-4b6c-4292-99ee-8ca400bd3576 tempest-SnapshotDataIntegrityTests-1151129385 None] Volume 9ca95aeb-f6d4-4785-a0a1-f78a4154e8ea: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-9ca95aeb-f6d4-4785-a0a1-f78a4154e8ea', 'volume_size': 1, 'snapshot_id': 'ebf3e7c1-e3dd-4712-b6c6-1e1951de8a97'} Aug 03 08:57:44 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-2a1d6163-4b6c-4292-99ee-8ca400bd3576 tempest-SnapshotDataIntegrityTests-1151129385 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:57:44 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-2a1d6163-4b6c-4292-99ee-8ca400bd3576 tempest-SnapshotDataIntegrityTests-1151129385 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:57:44 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-2a1d6163-4b6c-4292-99ee-8ca400bd3576 tempest-SnapshotDataIntegrityTests-1151129385 None] Acquiring lock "cinder-quobyte-ebf3e7c1-e3dd-4712-b6c6-1e1951de8a97-9ca95aeb-f6d4-4785-a0a1-f78a4154e8ea" by "_create_volume_from_snapshot" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:57:44 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-2a1d6163-4b6c-4292-99ee-8ca400bd3576 tempest-SnapshotDataIntegrityTests-1151129385 None] Lock "cinder-quobyte-ebf3e7c1-e3dd-4712-b6c6-1e1951de8a97-9ca95aeb-f6d4-4785-a0a1-f78a4154e8ea" acquired by "_create_volume_from_snapshot" :: waited 0.014s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:57:44 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-2a1d6163-4b6c-4292-99ee-8ca400bd3576 tempest-SnapshotDataIntegrityTests-1151129385 None] Creating volume 9ca95aeb-f6d4-4785-a0a1-f78a4154e8ea from snapshot ebf3e7c1-e3dd-4712-b6c6-1e1951de8a97 {{(pid=88899) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Aug 03 08:57:44 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-2a1d6163-4b6c-4292-99ee-8ca400bd3576 tempest-SnapshotDataIntegrityTests-1151129385 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:57:44 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-2a1d6163-4b6c-4292-99ee-8ca400bd3576 tempest-SnapshotDataIntegrityTests-1151129385 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:57:44 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-2a1d6163-4b6c-4292-99ee-8ca400bd3576 tempest-SnapshotDataIntegrityTests-1151129385 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:57:44 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-2a1d6163-4b6c-4292-99ee-8ca400bd3576 tempest-SnapshotDataIntegrityTests-1151129385 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:57:44 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-2a1d6163-4b6c-4292-99ee-8ca400bd3576 tempest-SnapshotDataIntegrityTests-1151129385 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:57:44 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-2a1d6163-4b6c-4292-99ee-8ca400bd3576 tempest-SnapshotDataIntegrityTests-1151129385 None] Selected osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385 as target Quobyte volume. {{(pid=88899) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 08:57:44 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-2a1d6163-4b6c-4292-99ee-8ca400bd3576 tempest-SnapshotDataIntegrityTests-1151129385 None] Acquiring lock "cinder-quobyte-9ca95aeb-f6d4-4785-a0a1-f78a4154e8ea" by "_copy_volume_from_snapshot" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:57:44 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-2a1d6163-4b6c-4292-99ee-8ca400bd3576 tempest-SnapshotDataIntegrityTests-1151129385 None] Lock "cinder-quobyte-9ca95aeb-f6d4-4785-a0a1-f78a4154e8ea" acquired by "_copy_volume_from_snapshot" :: waited 0.018s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:57:44 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-2a1d6163-4b6c-4292-99ee-8ca400bd3576 tempest-SnapshotDataIntegrityTests-1151129385 None] snapshot: ebf3e7c1-e3dd-4712-b6c6-1e1951de8a97, volume: 9ca95aeb-f6d4-4785-a0a1-f78a4154e8ea, {{(pid=88899) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Aug 03 08:57:44 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-2a1d6163-4b6c-4292-99ee-8ca400bd3576 tempest-SnapshotDataIntegrityTests-1151129385 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:57:44 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-2a1d6163-4b6c-4292-99ee-8ca400bd3576 tempest-SnapshotDataIntegrityTests-1151129385 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:57:44 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-2a1d6163-4b6c-4292-99ee-8ca400bd3576 tempest-SnapshotDataIntegrityTests-1151129385 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:57:44 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-2a1d6163-4b6c-4292-99ee-8ca400bd3576 tempest-SnapshotDataIntegrityTests-1151129385 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:57:44 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-2a1d6163-4b6c-4292-99ee-8ca400bd3576 tempest-SnapshotDataIntegrityTests-1151129385 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:57:44 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8709e6a-753c-400d-aa25-6415c3c72318]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:57:44 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-2a1d6163-4b6c-4292-99ee-8ca400bd3576 tempest-SnapshotDataIntegrityTests-1151129385 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c512cee2-9ba7-4fbc-85e0-b9cff62418ed.ebf3e7c1-e3dd-4712-b6c6-1e1951de8a97 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:57:45 devstack sudo[115527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c512cee2-9ba7-4fbc-85e0-b9cff62418ed.ebf3e7c1-e3dd-4712-b6c6-1e1951de8a97 Aug 03 08:57:45 devstack sudo[115527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:57:45 devstack sudo[115527]: pam_unix(sudo:session): session closed for user root Aug 03 08:57:45 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-2a1d6163-4b6c-4292-99ee-8ca400bd3576 tempest-SnapshotDataIntegrityTests-1151129385 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c512cee2-9ba7-4fbc-85e0-b9cff62418ed.ebf3e7c1-e3dd-4712-b6c6-1e1951de8a97" returned: 0 in 0.394s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:57:45 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-2a1d6163-4b6c-4292-99ee-8ca400bd3576 tempest-SnapshotDataIntegrityTests-1151129385 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c512cee2-9ba7-4fbc-85e0-b9cff62418ed(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88899) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 03 08:57:45 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fdedd71-d91c-4f06-996f-c84c6ea0bf95]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:57:45 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-2a1d6163-4b6c-4292-99ee-8ca400bd3576 tempest-SnapshotDataIntegrityTests-1151129385 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c512cee2-9ba7-4fbc-85e0-b9cff62418ed {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:57:45 devstack sudo[115532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c512cee2-9ba7-4fbc-85e0-b9cff62418ed Aug 03 08:57:45 devstack sudo[115532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:57:45 devstack sudo[115532]: pam_unix(sudo:session): session closed for user root Aug 03 08:57:45 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-2a1d6163-4b6c-4292-99ee-8ca400bd3576 tempest-SnapshotDataIntegrityTests-1151129385 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c512cee2-9ba7-4fbc-85e0-b9cff62418ed" returned: 0 in 0.365s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:57:45 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-2a1d6163-4b6c-4292-99ee-8ca400bd3576 tempest-SnapshotDataIntegrityTests-1151129385 None] will copy from snapshot at /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c512cee2-9ba7-4fbc-85e0-b9cff62418ed {{(pid=88899) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Aug 03 08:57:45 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-2a1d6163-4b6c-4292-99ee-8ca400bd3576 tempest-SnapshotDataIntegrityTests-1151129385 None] Creating direct copy from snapshot {{(pid=88899) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Aug 03 08:57:45 devstack cinder-volume[88899]: DEBUG cinder.utils [None req-2a1d6163-4b6c-4292-99ee-8ca400bd3576 tempest-SnapshotDataIntegrityTests-1151129385 None] Path /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-9ca95aeb-f6d4-4785-a0a1-f78a4154e8ea not found in is_blk_device check {{(pid=88899) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Aug 03 08:57:45 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-2a1d6163-4b6c-4292-99ee-8ca400bd3576 tempest-SnapshotDataIntegrityTests-1151129385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c512cee2-9ba7-4fbc-85e0-b9cff62418ed /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-9ca95aeb-f6d4-4785-a0a1-f78a4154e8ea {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:57:45 devstack sudo[115537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c512cee2-9ba7-4fbc-85e0-b9cff62418ed /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-9ca95aeb-f6d4-4785-a0a1-f78a4154e8ea Aug 03 08:57:45 devstack sudo[115537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:57:49 devstack sudo[115537]: pam_unix(sudo:session): session closed for user root Aug 03 08:57:49 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-2a1d6163-4b6c-4292-99ee-8ca400bd3576 tempest-SnapshotDataIntegrityTests-1151129385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c512cee2-9ba7-4fbc-85e0-b9cff62418ed /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-9ca95aeb-f6d4-4785-a0a1-f78a4154e8ea" returned: 0 in 4.116s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:57:49 devstack cinder-volume[88899]: DEBUG cinder.image.image_utils [None req-2a1d6163-4b6c-4292-99ee-8ca400bd3576 tempest-SnapshotDataIntegrityTests-1151129385 None] Image conversion details: src /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c512cee2-9ba7-4fbc-85e0-b9cff62418ed, size 1024.00 MB, duration 4.12 sec, destination /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-9ca95aeb-f6d4-4785-a0a1-f78a4154e8ea {{(pid=88899) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 03 08:57:49 devstack cinder-volume[88899]: INFO cinder.image.image_utils [None req-2a1d6163-4b6c-4292-99ee-8ca400bd3576 tempest-SnapshotDataIntegrityTests-1151129385 None] Converted 1024.00 MB image at 248.73 MB/s Aug 03 08:57:49 devstack cinder-volume[88899]: WARNING cinder.volume.drivers.remotefs [None req-2a1d6163-4b6c-4292-99ee-8ca400bd3576 tempest-SnapshotDataIntegrityTests-1151129385 None] /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-9ca95aeb-f6d4-4785-a0a1-f78a4154e8ea is being set with open permissions: ugo+rw Aug 03 08:57:49 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-2a1d6163-4b6c-4292-99ee-8ca400bd3576 tempest-SnapshotDataIntegrityTests-1151129385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-9ca95aeb-f6d4-4785-a0a1-f78a4154e8ea {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:57:49 devstack sudo[115553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-9ca95aeb-f6d4-4785-a0a1-f78a4154e8ea Aug 03 08:57:49 devstack sudo[115553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:57:50 devstack sudo[115553]: pam_unix(sudo:session): session closed for user root Aug 03 08:57:50 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-2a1d6163-4b6c-4292-99ee-8ca400bd3576 tempest-SnapshotDataIntegrityTests-1151129385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-9ca95aeb-f6d4-4785-a0a1-f78a4154e8ea" returned: 0 in 0.242s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:57:50 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-2a1d6163-4b6c-4292-99ee-8ca400bd3576 tempest-SnapshotDataIntegrityTests-1151129385 None] Lock "cinder-quobyte-9ca95aeb-f6d4-4785-a0a1-f78a4154e8ea" released by "_copy_volume_from_snapshot" :: held 5.194s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:57:50 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-2a1d6163-4b6c-4292-99ee-8ca400bd3576 tempest-SnapshotDataIntegrityTests-1151129385 None] Lock "cinder-quobyte-ebf3e7c1-e3dd-4712-b6c6-1e1951de8a97-9ca95aeb-f6d4-4785-a0a1-f78a4154e8ea" released by "_create_volume_from_snapshot" :: held 5.266s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:57:50 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-2a1d6163-4b6c-4292-99ee-8ca400bd3576 tempest-SnapshotDataIntegrityTests-1151129385 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.282s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:57:50 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-2a1d6163-4b6c-4292-99ee-8ca400bd3576 tempest-SnapshotDataIntegrityTests-1151129385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee0a05b0-8f98-4bd9-b23c-fedb5cbc4aad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9ca95aeb-f6d4-4785-a0a1-f78a4154e8ea', 'volume_size': 1, 'snapshot_id': 'ebf3e7c1-e3dd-4712-b6c6-1e1951de8a97'}' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:57:50 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-2a1d6163-4b6c-4292-99ee-8ca400bd3576 tempest-SnapshotDataIntegrityTests-1151129385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eceafe52-8c96-4be4-905e-dcfa8c2f1b25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:57:50 devstack cinder-volume[88899]: INFO cinder.volume.flows.manager.create_volume [None req-2a1d6163-4b6c-4292-99ee-8ca400bd3576 tempest-SnapshotDataIntegrityTests-1151129385 None] Volume volume-9ca95aeb-f6d4-4785-a0a1-f78a4154e8ea (9ca95aeb-f6d4-4785-a0a1-f78a4154e8ea): created successfully Aug 03 08:57:50 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-2a1d6163-4b6c-4292-99ee-8ca400bd3576 tempest-SnapshotDataIntegrityTests-1151129385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eceafe52-8c96-4be4-905e-dcfa8c2f1b25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:57:50 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-2a1d6163-4b6c-4292-99ee-8ca400bd3576 tempest-SnapshotDataIntegrityTests-1151129385 None] Flow 'volume_create_manager' (2698e20a-d9d1-4edd-82bb-cf5138fe666e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:57:50 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-2a1d6163-4b6c-4292-99ee-8ca400bd3576 tempest-SnapshotDataIntegrityTests-1151129385 None] Created volume successfully. Aug 03 08:57:51 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [req-3daa8854-fcf4-4135-9f20-dfb3c1e5a740 req-bdfab989-4ee2-4c47-a12b-2cc6f48c7da5 tempest-SnapshotDataIntegrityTests-1151129385 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:57:51 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [req-3daa8854-fcf4-4135-9f20-dfb3c1e5a740 req-bdfab989-4ee2-4c47-a12b-2cc6f48c7da5 tempest-SnapshotDataIntegrityTests-1151129385 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:57:51 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [req-3daa8854-fcf4-4135-9f20-dfb3c1e5a740 req-bdfab989-4ee2-4c47-a12b-2cc6f48c7da5 tempest-SnapshotDataIntegrityTests-1151129385 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.013s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:57:51 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [req-3daa8854-fcf4-4135-9f20-dfb3c1e5a740 req-bdfab989-4ee2-4c47-a12b-2cc6f48c7da5 tempest-SnapshotDataIntegrityTests-1151129385 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385', 'name': 'volume-9ca95aeb-f6d4-4785-a0a1-f78a4154e8ea', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '6969bf5e-e375-4a03-9751-3c3be02095db', 'enforce_multipath': True} {{(pid=88899) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 03 08:57:51 devstack cinder-volume[88899]: INFO cinder.volume.manager [req-3daa8854-fcf4-4135-9f20-dfb3c1e5a740 req-bdfab989-4ee2-4c47-a12b-2cc6f48c7da5 tempest-SnapshotDataIntegrityTests-1151129385 None] attachment_update completed successfully. Aug 03 08:57:51 devstack cinder-volume[88899]: DEBUG oslo_service.periodic_task [None req-f948fb4a-c4d7-499f-b1bd-8d6be3de0b53 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88899) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 03 08:57:51 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-f948fb4a-c4d7-499f-b1bd-8d6be3de0b53 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:57:51 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-f948fb4a-c4d7-499f-b1bd-8d6be3de0b53 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:57:51 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-f948fb4a-c4d7-499f-b1bd-8d6be3de0b53 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:57:51 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-f948fb4a-c4d7-499f-b1bd-8d6be3de0b53 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:57:51 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-f948fb4a-c4d7-499f-b1bd-8d6be3de0b53 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:57:51 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-f948fb4a-c4d7-499f-b1bd-8d6be3de0b53 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:57:51 devstack sudo[115956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a Aug 03 08:57:51 devstack sudo[115956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:57:52 devstack sudo[115956]: pam_unix(sudo:session): session closed for user root Aug 03 08:57:52 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-f948fb4a-c4d7-499f-b1bd-8d6be3de0b53 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a" returned: 0 in 0.279s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:57:52 devstack cinder-volume[88899]: DEBUG cinder.manager [None req-f948fb4a-c4d7-499f-b1bd-8d6be3de0b53 None None] Notifying Schedulers of capabilities ... {{(pid=88899) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 08:57:52 devstack cinder-volume[88899]: DEBUG oslo_service.periodic_task [None req-f948fb4a-c4d7-499f-b1bd-8d6be3de0b53 None None] Running periodic task VolumeManager._thread_info {{(pid=88899) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 03 08:57:52 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-f948fb4a-c4d7-499f-b1bd-8d6be3de0b53 None None] thread count: 29 {{(pid=88899) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 03 08:57:52 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-f948fb4a-c4d7-499f-b1bd-8d6be3de0b53 None None] thread info: [<_MainThread(MainThread, started 132234320248960)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88899) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 03 08:57:55 devstack cinder-volume[88899]: INFO cinder.volume.manager [req-e18aa9e0-dc47-4f72-a87d-27e09153b3c9 req-1b1402a7-31da-4af9-9ea8-6da634a52754 tempest-SnapshotDataIntegrityTests-1151129385 None] Terminate volume connection completed successfully. Aug 03 08:57:55 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [req-e18aa9e0-dc47-4f72-a87d-27e09153b3c9 req-1b1402a7-31da-4af9-9ea8-6da634a52754 tempest-SnapshotDataIntegrityTests-1151129385 None] Deleting attachment 6969bf5e-e375-4a03-9751-3c3be02095db. {{(pid=88899) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 03 08:57:56 devstack cinder-volume[88899]: DEBUG cinder.volume.flows.manager.create_volume [None req-2cdb3538-1957-4eeb-839c-5f1d002ff35a tempest-SnapshotDataIntegrityTests-1151129385 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88899) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 08:57:56 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-2cdb3538-1957-4eeb-839c-5f1d002ff35a tempest-SnapshotDataIntegrityTests-1151129385 None] Flow 'volume_create_manager' (56894bac-ce74-4502-91f5-85bbd2ab8a4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:57:56 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-2cdb3538-1957-4eeb-839c-5f1d002ff35a tempest-SnapshotDataIntegrityTests-1151129385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34847c56-c640-4ff0-94e2-b6c5eaed3f67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:57:56 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-2cdb3538-1957-4eeb-839c-5f1d002ff35a tempest-SnapshotDataIntegrityTests-1151129385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34847c56-c640-4ff0-94e2-b6c5eaed3f67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:57:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDataIntegrityTests-volume-910283307',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=14247fdf-a095-4f9a-83f7-162065424e3e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='edcd5572d27049ba9a002c778c2d4964',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:57:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=2c13d4e1-7236-492a-acfe-ed7ae7c837ef,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:57:56Z,use_quota=True,user_id='a347373422e34c2089490fba111c8f5d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8bde7129-1dc4-42ab-b852-ab32c61b4921),volume_type_id=8bde7129-1dc4-42ab-b852-ab32c61b4921)' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:57:56 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-2cdb3538-1957-4eeb-839c-5f1d002ff35a tempest-SnapshotDataIntegrityTests-1151129385 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4426edc-5ffd-445d-9b6f-97d8daafbd61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:57:56 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-2cdb3538-1957-4eeb-839c-5f1d002ff35a tempest-SnapshotDataIntegrityTests-1151129385 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4426edc-5ffd-445d-9b6f-97d8daafbd61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:57:56 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-2cdb3538-1957-4eeb-839c-5f1d002ff35a tempest-SnapshotDataIntegrityTests-1151129385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8448f6d-095d-4deb-ad75-013c3c2408c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:57:56 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-2cdb3538-1957-4eeb-839c-5f1d002ff35a tempest-SnapshotDataIntegrityTests-1151129385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8448f6d-095d-4deb-ad75-013c3c2408c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '14247fdf-a095-4f9a-83f7-162065424e3e', 'volume_name': 'volume-14247fdf-a095-4f9a-83f7-162065424e3e', 'volume_size': 1, 'snapshot_id': '2c13d4e1-7236-492a-acfe-ed7ae7c837ef'}' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:57:56 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-2cdb3538-1957-4eeb-839c-5f1d002ff35a tempest-SnapshotDataIntegrityTests-1151129385 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e141efc9-8652-452f-84cf-6b8bbfd8a290) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:57:56 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-2cdb3538-1957-4eeb-839c-5f1d002ff35a tempest-SnapshotDataIntegrityTests-1151129385 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e141efc9-8652-452f-84cf-6b8bbfd8a290) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:57:56 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-2cdb3538-1957-4eeb-839c-5f1d002ff35a tempest-SnapshotDataIntegrityTests-1151129385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b70c685-eaa3-4b62-8e30-3be6b553a080) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:57:56 devstack cinder-volume[88899]: INFO cinder.volume.flows.manager.create_volume [None req-2cdb3538-1957-4eeb-839c-5f1d002ff35a tempest-SnapshotDataIntegrityTests-1151129385 None] Volume 14247fdf-a095-4f9a-83f7-162065424e3e: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-14247fdf-a095-4f9a-83f7-162065424e3e', 'volume_size': 1, 'snapshot_id': '2c13d4e1-7236-492a-acfe-ed7ae7c837ef'} Aug 03 08:57:56 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-2cdb3538-1957-4eeb-839c-5f1d002ff35a tempest-SnapshotDataIntegrityTests-1151129385 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:57:56 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-2cdb3538-1957-4eeb-839c-5f1d002ff35a tempest-SnapshotDataIntegrityTests-1151129385 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:57:56 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-2cdb3538-1957-4eeb-839c-5f1d002ff35a tempest-SnapshotDataIntegrityTests-1151129385 None] Acquiring lock "cinder-quobyte-2c13d4e1-7236-492a-acfe-ed7ae7c837ef-14247fdf-a095-4f9a-83f7-162065424e3e" by "_create_volume_from_snapshot" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:57:56 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-2cdb3538-1957-4eeb-839c-5f1d002ff35a tempest-SnapshotDataIntegrityTests-1151129385 None] Lock "cinder-quobyte-2c13d4e1-7236-492a-acfe-ed7ae7c837ef-14247fdf-a095-4f9a-83f7-162065424e3e" acquired by "_create_volume_from_snapshot" :: waited 0.014s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:57:56 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-2cdb3538-1957-4eeb-839c-5f1d002ff35a tempest-SnapshotDataIntegrityTests-1151129385 None] Creating volume 14247fdf-a095-4f9a-83f7-162065424e3e from snapshot 2c13d4e1-7236-492a-acfe-ed7ae7c837ef {{(pid=88899) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Aug 03 08:57:56 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-2cdb3538-1957-4eeb-839c-5f1d002ff35a tempest-SnapshotDataIntegrityTests-1151129385 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:57:56 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-2cdb3538-1957-4eeb-839c-5f1d002ff35a tempest-SnapshotDataIntegrityTests-1151129385 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:57:56 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-2cdb3538-1957-4eeb-839c-5f1d002ff35a tempest-SnapshotDataIntegrityTests-1151129385 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:57:56 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-2cdb3538-1957-4eeb-839c-5f1d002ff35a tempest-SnapshotDataIntegrityTests-1151129385 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:57:56 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-2cdb3538-1957-4eeb-839c-5f1d002ff35a tempest-SnapshotDataIntegrityTests-1151129385 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:57:56 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-2cdb3538-1957-4eeb-839c-5f1d002ff35a tempest-SnapshotDataIntegrityTests-1151129385 None] Selected osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385 as target Quobyte volume. {{(pid=88899) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 08:57:56 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-2cdb3538-1957-4eeb-839c-5f1d002ff35a tempest-SnapshotDataIntegrityTests-1151129385 None] Acquiring lock "cinder-quobyte-14247fdf-a095-4f9a-83f7-162065424e3e" by "_copy_volume_from_snapshot" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:57:56 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-2cdb3538-1957-4eeb-839c-5f1d002ff35a tempest-SnapshotDataIntegrityTests-1151129385 None] Lock "cinder-quobyte-14247fdf-a095-4f9a-83f7-162065424e3e" acquired by "_copy_volume_from_snapshot" :: waited 0.014s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:57:56 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-2cdb3538-1957-4eeb-839c-5f1d002ff35a tempest-SnapshotDataIntegrityTests-1151129385 None] snapshot: 2c13d4e1-7236-492a-acfe-ed7ae7c837ef, volume: 14247fdf-a095-4f9a-83f7-162065424e3e, {{(pid=88899) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Aug 03 08:57:56 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-2cdb3538-1957-4eeb-839c-5f1d002ff35a tempest-SnapshotDataIntegrityTests-1151129385 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:57:56 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-2cdb3538-1957-4eeb-839c-5f1d002ff35a tempest-SnapshotDataIntegrityTests-1151129385 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:57:56 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-2cdb3538-1957-4eeb-839c-5f1d002ff35a tempest-SnapshotDataIntegrityTests-1151129385 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:57:56 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-2cdb3538-1957-4eeb-839c-5f1d002ff35a tempest-SnapshotDataIntegrityTests-1151129385 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:57:56 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-2cdb3538-1957-4eeb-839c-5f1d002ff35a tempest-SnapshotDataIntegrityTests-1151129385 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:57:56 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dedfc43-97f5-46b9-a4af-278330d666bd]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:57:56 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-2cdb3538-1957-4eeb-839c-5f1d002ff35a tempest-SnapshotDataIntegrityTests-1151129385 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c512cee2-9ba7-4fbc-85e0-b9cff62418ed.2c13d4e1-7236-492a-acfe-ed7ae7c837ef {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:57:56 devstack sudo[116013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c512cee2-9ba7-4fbc-85e0-b9cff62418ed.2c13d4e1-7236-492a-acfe-ed7ae7c837ef Aug 03 08:57:56 devstack sudo[116013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:57:57 devstack sudo[116013]: pam_unix(sudo:session): session closed for user root Aug 03 08:57:57 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-2cdb3538-1957-4eeb-839c-5f1d002ff35a tempest-SnapshotDataIntegrityTests-1151129385 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c512cee2-9ba7-4fbc-85e0-b9cff62418ed.2c13d4e1-7236-492a-acfe-ed7ae7c837ef" returned: 0 in 0.363s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:57:57 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-2cdb3538-1957-4eeb-839c-5f1d002ff35a tempest-SnapshotDataIntegrityTests-1151129385 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c512cee2-9ba7-4fbc-85e0-b9cff62418ed(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88899) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 03 08:57:57 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[24427ed1-8a38-48be-b5b9-358ffb73d7fb]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:57:57 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-2cdb3538-1957-4eeb-839c-5f1d002ff35a tempest-SnapshotDataIntegrityTests-1151129385 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c512cee2-9ba7-4fbc-85e0-b9cff62418ed.ebf3e7c1-e3dd-4712-b6c6-1e1951de8a97 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:57:57 devstack sudo[116018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c512cee2-9ba7-4fbc-85e0-b9cff62418ed.ebf3e7c1-e3dd-4712-b6c6-1e1951de8a97 Aug 03 08:57:57 devstack sudo[116018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:57:57 devstack sudo[116018]: pam_unix(sudo:session): session closed for user root Aug 03 08:57:57 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-2cdb3538-1957-4eeb-839c-5f1d002ff35a tempest-SnapshotDataIntegrityTests-1151129385 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c512cee2-9ba7-4fbc-85e0-b9cff62418ed.ebf3e7c1-e3dd-4712-b6c6-1e1951de8a97" returned: 0 in 0.375s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:57:57 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-2cdb3538-1957-4eeb-839c-5f1d002ff35a tempest-SnapshotDataIntegrityTests-1151129385 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c512cee2-9ba7-4fbc-85e0-b9cff62418ed(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88899) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 03 08:57:57 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-2cdb3538-1957-4eeb-839c-5f1d002ff35a tempest-SnapshotDataIntegrityTests-1151129385 None] will copy from snapshot at /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c512cee2-9ba7-4fbc-85e0-b9cff62418ed.ebf3e7c1-e3dd-4712-b6c6-1e1951de8a97 {{(pid=88899) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Aug 03 08:57:57 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-2cdb3538-1957-4eeb-839c-5f1d002ff35a tempest-SnapshotDataIntegrityTests-1151129385 None] Creating direct copy from snapshot {{(pid=88899) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Aug 03 08:57:57 devstack cinder-volume[88899]: DEBUG cinder.utils [None req-2cdb3538-1957-4eeb-839c-5f1d002ff35a tempest-SnapshotDataIntegrityTests-1151129385 None] Path /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-14247fdf-a095-4f9a-83f7-162065424e3e not found in is_blk_device check {{(pid=88899) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Aug 03 08:57:57 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-2cdb3538-1957-4eeb-839c-5f1d002ff35a tempest-SnapshotDataIntegrityTests-1151129385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c512cee2-9ba7-4fbc-85e0-b9cff62418ed.ebf3e7c1-e3dd-4712-b6c6-1e1951de8a97 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-14247fdf-a095-4f9a-83f7-162065424e3e {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:57:57 devstack sudo[116024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c512cee2-9ba7-4fbc-85e0-b9cff62418ed.ebf3e7c1-e3dd-4712-b6c6-1e1951de8a97 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-14247fdf-a095-4f9a-83f7-162065424e3e Aug 03 08:57:57 devstack sudo[116024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:58:01 devstack sudo[116024]: pam_unix(sudo:session): session closed for user root Aug 03 08:58:01 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-2cdb3538-1957-4eeb-839c-5f1d002ff35a tempest-SnapshotDataIntegrityTests-1151129385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c512cee2-9ba7-4fbc-85e0-b9cff62418ed.ebf3e7c1-e3dd-4712-b6c6-1e1951de8a97 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-14247fdf-a095-4f9a-83f7-162065424e3e" returned: 0 in 4.087s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:58:01 devstack cinder-volume[88899]: DEBUG cinder.image.image_utils [None req-2cdb3538-1957-4eeb-839c-5f1d002ff35a tempest-SnapshotDataIntegrityTests-1151129385 None] Image conversion details: src /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c512cee2-9ba7-4fbc-85e0-b9cff62418ed.ebf3e7c1-e3dd-4712-b6c6-1e1951de8a97, size 1024.00 MB, duration 4.09 sec, destination /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-14247fdf-a095-4f9a-83f7-162065424e3e {{(pid=88899) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 03 08:58:01 devstack cinder-volume[88899]: INFO cinder.image.image_utils [None req-2cdb3538-1957-4eeb-839c-5f1d002ff35a tempest-SnapshotDataIntegrityTests-1151129385 None] Converted 1024.00 MB image at 250.49 MB/s Aug 03 08:58:01 devstack cinder-volume[88899]: WARNING cinder.volume.drivers.remotefs [None req-2cdb3538-1957-4eeb-839c-5f1d002ff35a tempest-SnapshotDataIntegrityTests-1151129385 None] /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-14247fdf-a095-4f9a-83f7-162065424e3e is being set with open permissions: ugo+rw Aug 03 08:58:01 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-2cdb3538-1957-4eeb-839c-5f1d002ff35a tempest-SnapshotDataIntegrityTests-1151129385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-14247fdf-a095-4f9a-83f7-162065424e3e {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:58:01 devstack sudo[116038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-14247fdf-a095-4f9a-83f7-162065424e3e Aug 03 08:58:01 devstack sudo[116038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:58:01 devstack sudo[116038]: pam_unix(sudo:session): session closed for user root Aug 03 08:58:01 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-2cdb3538-1957-4eeb-839c-5f1d002ff35a tempest-SnapshotDataIntegrityTests-1151129385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-14247fdf-a095-4f9a-83f7-162065424e3e" returned: 0 in 0.235s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:58:01 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-2cdb3538-1957-4eeb-839c-5f1d002ff35a tempest-SnapshotDataIntegrityTests-1151129385 None] Lock "cinder-quobyte-14247fdf-a095-4f9a-83f7-162065424e3e" released by "_copy_volume_from_snapshot" :: held 5.135s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:58:01 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-2cdb3538-1957-4eeb-839c-5f1d002ff35a tempest-SnapshotDataIntegrityTests-1151129385 None] Lock "cinder-quobyte-2c13d4e1-7236-492a-acfe-ed7ae7c837ef-14247fdf-a095-4f9a-83f7-162065424e3e" released by "_create_volume_from_snapshot" :: held 5.197s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:58:01 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-2cdb3538-1957-4eeb-839c-5f1d002ff35a tempest-SnapshotDataIntegrityTests-1151129385 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.213s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:58:01 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-2cdb3538-1957-4eeb-839c-5f1d002ff35a tempest-SnapshotDataIntegrityTests-1151129385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b70c685-eaa3-4b62-8e30-3be6b553a080) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-14247fdf-a095-4f9a-83f7-162065424e3e', 'volume_size': 1, 'snapshot_id': '2c13d4e1-7236-492a-acfe-ed7ae7c837ef'}' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:58:01 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-2cdb3538-1957-4eeb-839c-5f1d002ff35a tempest-SnapshotDataIntegrityTests-1151129385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6790266c-788d-4dc3-9be0-a3a97b117c14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:58:01 devstack cinder-volume[88899]: INFO cinder.volume.flows.manager.create_volume [None req-2cdb3538-1957-4eeb-839c-5f1d002ff35a tempest-SnapshotDataIntegrityTests-1151129385 None] Volume volume-14247fdf-a095-4f9a-83f7-162065424e3e (14247fdf-a095-4f9a-83f7-162065424e3e): created successfully Aug 03 08:58:01 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-2cdb3538-1957-4eeb-839c-5f1d002ff35a tempest-SnapshotDataIntegrityTests-1151129385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6790266c-788d-4dc3-9be0-a3a97b117c14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:58:01 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-2cdb3538-1957-4eeb-839c-5f1d002ff35a tempest-SnapshotDataIntegrityTests-1151129385 None] Flow 'volume_create_manager' (56894bac-ce74-4502-91f5-85bbd2ab8a4e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:58:01 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-2cdb3538-1957-4eeb-839c-5f1d002ff35a tempest-SnapshotDataIntegrityTests-1151129385 None] Created volume successfully. Aug 03 08:58:03 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [req-36dcd2e7-0805-459d-b519-33b14c0be35f req-405f5cdb-62bf-41b6-8442-b30d0e303aad tempest-SnapshotDataIntegrityTests-1151129385 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:58:03 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [req-36dcd2e7-0805-459d-b519-33b14c0be35f req-405f5cdb-62bf-41b6-8442-b30d0e303aad tempest-SnapshotDataIntegrityTests-1151129385 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:58:03 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [req-36dcd2e7-0805-459d-b519-33b14c0be35f req-405f5cdb-62bf-41b6-8442-b30d0e303aad tempest-SnapshotDataIntegrityTests-1151129385 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.012s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:58:03 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [req-36dcd2e7-0805-459d-b519-33b14c0be35f req-405f5cdb-62bf-41b6-8442-b30d0e303aad tempest-SnapshotDataIntegrityTests-1151129385 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385', 'name': 'volume-14247fdf-a095-4f9a-83f7-162065424e3e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '185ecff1-eb3b-44ba-b39f-796c512d50df', 'enforce_multipath': True} {{(pid=88899) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 03 08:58:03 devstack cinder-volume[88899]: INFO cinder.volume.manager [req-36dcd2e7-0805-459d-b519-33b14c0be35f req-405f5cdb-62bf-41b6-8442-b30d0e303aad tempest-SnapshotDataIntegrityTests-1151129385 None] attachment_update completed successfully. Aug 03 08:58:07 devstack cinder-volume[88899]: INFO cinder.volume.manager [req-cb98cc65-3795-4d20-b4d4-243b4e2fa381 req-dd40481f-7662-4519-95c5-7416bdf24c50 tempest-SnapshotDataIntegrityTests-1151129385 None] Terminate volume connection completed successfully. Aug 03 08:58:07 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [req-cb98cc65-3795-4d20-b4d4-243b4e2fa381 req-dd40481f-7662-4519-95c5-7416bdf24c50 tempest-SnapshotDataIntegrityTests-1151129385 None] Deleting attachment 185ecff1-eb3b-44ba-b39f-796c512d50df. {{(pid=88899) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 03 08:58:08 devstack cinder-volume[88899]: DEBUG cinder.volume.flows.manager.create_volume [None req-9ff40d6b-898d-4d67-8ca2-d0575185f306 tempest-SnapshotDataIntegrityTests-1151129385 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88899) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 08:58:08 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-9ff40d6b-898d-4d67-8ca2-d0575185f306 tempest-SnapshotDataIntegrityTests-1151129385 None] Flow 'volume_create_manager' (113afb38-27df-4a15-800b-84739bf23f86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:58:08 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-9ff40d6b-898d-4d67-8ca2-d0575185f306 tempest-SnapshotDataIntegrityTests-1151129385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c8c875b-47c9-4612-b84e-3dcd0c966dca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:58:08 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-9ff40d6b-898d-4d67-8ca2-d0575185f306 tempest-SnapshotDataIntegrityTests-1151129385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c8c875b-47c9-4612-b84e-3dcd0c966dca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:58:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDataIntegrityTests-volume-1460412534',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=113b650b-530e-409c-82fb-b8c04fbe81c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='edcd5572d27049ba9a002c778c2d4964',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:58:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=2da3e47a-15e5-4b1d-b1af-ed66f9a58301,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:58:09Z,use_quota=True,user_id='a347373422e34c2089490fba111c8f5d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8bde7129-1dc4-42ab-b852-ab32c61b4921),volume_type_id=8bde7129-1dc4-42ab-b852-ab32c61b4921)' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:58:08 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-9ff40d6b-898d-4d67-8ca2-d0575185f306 tempest-SnapshotDataIntegrityTests-1151129385 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (454b79d0-7ae3-4cbc-a2ca-a63695b10df9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:58:08 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-9ff40d6b-898d-4d67-8ca2-d0575185f306 tempest-SnapshotDataIntegrityTests-1151129385 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (454b79d0-7ae3-4cbc-a2ca-a63695b10df9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:58:08 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-9ff40d6b-898d-4d67-8ca2-d0575185f306 tempest-SnapshotDataIntegrityTests-1151129385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (75804e92-318c-4fd1-b6a6-4091ace7552a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:58:08 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-9ff40d6b-898d-4d67-8ca2-d0575185f306 tempest-SnapshotDataIntegrityTests-1151129385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (75804e92-318c-4fd1-b6a6-4091ace7552a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '113b650b-530e-409c-82fb-b8c04fbe81c8', 'volume_name': 'volume-113b650b-530e-409c-82fb-b8c04fbe81c8', 'volume_size': 1, 'snapshot_id': '2da3e47a-15e5-4b1d-b1af-ed66f9a58301'}' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:58:08 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-9ff40d6b-898d-4d67-8ca2-d0575185f306 tempest-SnapshotDataIntegrityTests-1151129385 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6602d6fd-6737-42ee-b11b-9e446d2546a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:58:08 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-9ff40d6b-898d-4d67-8ca2-d0575185f306 tempest-SnapshotDataIntegrityTests-1151129385 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6602d6fd-6737-42ee-b11b-9e446d2546a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:58:08 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-9ff40d6b-898d-4d67-8ca2-d0575185f306 tempest-SnapshotDataIntegrityTests-1151129385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4b1b487-c574-445b-969f-4d4be72dd82e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:58:08 devstack cinder-volume[88899]: INFO cinder.volume.flows.manager.create_volume [None req-9ff40d6b-898d-4d67-8ca2-d0575185f306 tempest-SnapshotDataIntegrityTests-1151129385 None] Volume 113b650b-530e-409c-82fb-b8c04fbe81c8: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-113b650b-530e-409c-82fb-b8c04fbe81c8', 'volume_size': 1, 'snapshot_id': '2da3e47a-15e5-4b1d-b1af-ed66f9a58301'} Aug 03 08:58:08 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-9ff40d6b-898d-4d67-8ca2-d0575185f306 tempest-SnapshotDataIntegrityTests-1151129385 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:58:08 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-9ff40d6b-898d-4d67-8ca2-d0575185f306 tempest-SnapshotDataIntegrityTests-1151129385 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.000s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:58:08 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-9ff40d6b-898d-4d67-8ca2-d0575185f306 tempest-SnapshotDataIntegrityTests-1151129385 None] Acquiring lock "cinder-quobyte-2da3e47a-15e5-4b1d-b1af-ed66f9a58301-113b650b-530e-409c-82fb-b8c04fbe81c8" by "_create_volume_from_snapshot" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:58:08 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-9ff40d6b-898d-4d67-8ca2-d0575185f306 tempest-SnapshotDataIntegrityTests-1151129385 None] Lock "cinder-quobyte-2da3e47a-15e5-4b1d-b1af-ed66f9a58301-113b650b-530e-409c-82fb-b8c04fbe81c8" acquired by "_create_volume_from_snapshot" :: waited 0.013s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:58:08 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-9ff40d6b-898d-4d67-8ca2-d0575185f306 tempest-SnapshotDataIntegrityTests-1151129385 None] Creating volume 113b650b-530e-409c-82fb-b8c04fbe81c8 from snapshot 2da3e47a-15e5-4b1d-b1af-ed66f9a58301 {{(pid=88899) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Aug 03 08:58:08 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-9ff40d6b-898d-4d67-8ca2-d0575185f306 tempest-SnapshotDataIntegrityTests-1151129385 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:58:08 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-9ff40d6b-898d-4d67-8ca2-d0575185f306 tempest-SnapshotDataIntegrityTests-1151129385 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:58:08 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-9ff40d6b-898d-4d67-8ca2-d0575185f306 tempest-SnapshotDataIntegrityTests-1151129385 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:58:08 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-9ff40d6b-898d-4d67-8ca2-d0575185f306 tempest-SnapshotDataIntegrityTests-1151129385 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:58:08 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-9ff40d6b-898d-4d67-8ca2-d0575185f306 tempest-SnapshotDataIntegrityTests-1151129385 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:58:08 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-9ff40d6b-898d-4d67-8ca2-d0575185f306 tempest-SnapshotDataIntegrityTests-1151129385 None] Selected osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385 as target Quobyte volume. {{(pid=88899) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 08:58:08 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-9ff40d6b-898d-4d67-8ca2-d0575185f306 tempest-SnapshotDataIntegrityTests-1151129385 None] Acquiring lock "cinder-quobyte-113b650b-530e-409c-82fb-b8c04fbe81c8" by "_copy_volume_from_snapshot" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:58:08 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-9ff40d6b-898d-4d67-8ca2-d0575185f306 tempest-SnapshotDataIntegrityTests-1151129385 None] Lock "cinder-quobyte-113b650b-530e-409c-82fb-b8c04fbe81c8" acquired by "_copy_volume_from_snapshot" :: waited 0.012s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:58:08 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-9ff40d6b-898d-4d67-8ca2-d0575185f306 tempest-SnapshotDataIntegrityTests-1151129385 None] snapshot: 2da3e47a-15e5-4b1d-b1af-ed66f9a58301, volume: 113b650b-530e-409c-82fb-b8c04fbe81c8, {{(pid=88899) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Aug 03 08:58:08 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-9ff40d6b-898d-4d67-8ca2-d0575185f306 tempest-SnapshotDataIntegrityTests-1151129385 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:58:08 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-9ff40d6b-898d-4d67-8ca2-d0575185f306 tempest-SnapshotDataIntegrityTests-1151129385 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:58:08 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-9ff40d6b-898d-4d67-8ca2-d0575185f306 tempest-SnapshotDataIntegrityTests-1151129385 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:58:08 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-9ff40d6b-898d-4d67-8ca2-d0575185f306 tempest-SnapshotDataIntegrityTests-1151129385 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:58:08 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-9ff40d6b-898d-4d67-8ca2-d0575185f306 tempest-SnapshotDataIntegrityTests-1151129385 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:58:08 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[709d6d73-157f-4b3c-a298-39778dda89e4]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:58:08 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-9ff40d6b-898d-4d67-8ca2-d0575185f306 tempest-SnapshotDataIntegrityTests-1151129385 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c512cee2-9ba7-4fbc-85e0-b9cff62418ed.2da3e47a-15e5-4b1d-b1af-ed66f9a58301 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:58:09 devstack sudo[116501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c512cee2-9ba7-4fbc-85e0-b9cff62418ed.2da3e47a-15e5-4b1d-b1af-ed66f9a58301 Aug 03 08:58:09 devstack sudo[116501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:58:09 devstack sudo[116501]: pam_unix(sudo:session): session closed for user root Aug 03 08:58:09 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-9ff40d6b-898d-4d67-8ca2-d0575185f306 tempest-SnapshotDataIntegrityTests-1151129385 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c512cee2-9ba7-4fbc-85e0-b9cff62418ed.2da3e47a-15e5-4b1d-b1af-ed66f9a58301" returned: 0 in 0.348s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:58:09 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-9ff40d6b-898d-4d67-8ca2-d0575185f306 tempest-SnapshotDataIntegrityTests-1151129385 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c512cee2-9ba7-4fbc-85e0-b9cff62418ed(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88899) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 03 08:58:09 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c301d0d-f8a0-4057-a42d-3d0ad4c3019c]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:58:09 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-9ff40d6b-898d-4d67-8ca2-d0575185f306 tempest-SnapshotDataIntegrityTests-1151129385 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c512cee2-9ba7-4fbc-85e0-b9cff62418ed.2c13d4e1-7236-492a-acfe-ed7ae7c837ef {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:58:09 devstack sudo[116506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c512cee2-9ba7-4fbc-85e0-b9cff62418ed.2c13d4e1-7236-492a-acfe-ed7ae7c837ef Aug 03 08:58:09 devstack sudo[116506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:58:09 devstack sudo[116506]: pam_unix(sudo:session): session closed for user root Aug 03 08:58:09 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-9ff40d6b-898d-4d67-8ca2-d0575185f306 tempest-SnapshotDataIntegrityTests-1151129385 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c512cee2-9ba7-4fbc-85e0-b9cff62418ed.2c13d4e1-7236-492a-acfe-ed7ae7c837ef" returned: 0 in 0.375s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:58:09 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-9ff40d6b-898d-4d67-8ca2-d0575185f306 tempest-SnapshotDataIntegrityTests-1151129385 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c512cee2-9ba7-4fbc-85e0-b9cff62418ed(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88899) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 03 08:58:09 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-9ff40d6b-898d-4d67-8ca2-d0575185f306 tempest-SnapshotDataIntegrityTests-1151129385 None] will copy from snapshot at /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c512cee2-9ba7-4fbc-85e0-b9cff62418ed.2c13d4e1-7236-492a-acfe-ed7ae7c837ef {{(pid=88899) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Aug 03 08:58:09 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-9ff40d6b-898d-4d67-8ca2-d0575185f306 tempest-SnapshotDataIntegrityTests-1151129385 None] Creating direct copy from snapshot {{(pid=88899) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Aug 03 08:58:09 devstack cinder-volume[88899]: DEBUG cinder.utils [None req-9ff40d6b-898d-4d67-8ca2-d0575185f306 tempest-SnapshotDataIntegrityTests-1151129385 None] Path /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-113b650b-530e-409c-82fb-b8c04fbe81c8 not found in is_blk_device check {{(pid=88899) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Aug 03 08:58:09 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-9ff40d6b-898d-4d67-8ca2-d0575185f306 tempest-SnapshotDataIntegrityTests-1151129385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c512cee2-9ba7-4fbc-85e0-b9cff62418ed.2c13d4e1-7236-492a-acfe-ed7ae7c837ef /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-113b650b-530e-409c-82fb-b8c04fbe81c8 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:58:09 devstack sudo[116547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c512cee2-9ba7-4fbc-85e0-b9cff62418ed.2c13d4e1-7236-492a-acfe-ed7ae7c837ef /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-113b650b-530e-409c-82fb-b8c04fbe81c8 Aug 03 08:58:09 devstack sudo[116547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:58:10 devstack sudo[116547]: pam_unix(sudo:session): session closed for user root Aug 03 08:58:10 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-9ff40d6b-898d-4d67-8ca2-d0575185f306 tempest-SnapshotDataIntegrityTests-1151129385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c512cee2-9ba7-4fbc-85e0-b9cff62418ed.2c13d4e1-7236-492a-acfe-ed7ae7c837ef /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-113b650b-530e-409c-82fb-b8c04fbe81c8" returned: 0 in 0.876s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:58:10 devstack cinder-volume[88899]: DEBUG cinder.image.image_utils [None req-9ff40d6b-898d-4d67-8ca2-d0575185f306 tempest-SnapshotDataIntegrityTests-1151129385 None] Image conversion details: src /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c512cee2-9ba7-4fbc-85e0-b9cff62418ed.2c13d4e1-7236-492a-acfe-ed7ae7c837ef, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-113b650b-530e-409c-82fb-b8c04fbe81c8 {{(pid=88899) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 03 08:58:10 devstack cinder-volume[88899]: INFO cinder.image.image_utils [None req-9ff40d6b-898d-4d67-8ca2-d0575185f306 tempest-SnapshotDataIntegrityTests-1151129385 None] Converted 1024.00 MB image at 1024.00 MB/s Aug 03 08:58:10 devstack cinder-volume[88899]: WARNING cinder.volume.drivers.remotefs [None req-9ff40d6b-898d-4d67-8ca2-d0575185f306 tempest-SnapshotDataIntegrityTests-1151129385 None] /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-113b650b-530e-409c-82fb-b8c04fbe81c8 is being set with open permissions: ugo+rw Aug 03 08:58:10 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-9ff40d6b-898d-4d67-8ca2-d0575185f306 tempest-SnapshotDataIntegrityTests-1151129385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-113b650b-530e-409c-82fb-b8c04fbe81c8 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:58:10 devstack sudo[116556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-113b650b-530e-409c-82fb-b8c04fbe81c8 Aug 03 08:58:10 devstack sudo[116556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:58:10 devstack sudo[116556]: pam_unix(sudo:session): session closed for user root Aug 03 08:58:10 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-9ff40d6b-898d-4d67-8ca2-d0575185f306 tempest-SnapshotDataIntegrityTests-1151129385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-113b650b-530e-409c-82fb-b8c04fbe81c8" returned: 0 in 0.235s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:58:10 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-9ff40d6b-898d-4d67-8ca2-d0575185f306 tempest-SnapshotDataIntegrityTests-1151129385 None] Lock "cinder-quobyte-113b650b-530e-409c-82fb-b8c04fbe81c8" released by "_copy_volume_from_snapshot" :: held 1.900s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:58:10 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-9ff40d6b-898d-4d67-8ca2-d0575185f306 tempest-SnapshotDataIntegrityTests-1151129385 None] Lock "cinder-quobyte-2da3e47a-15e5-4b1d-b1af-ed66f9a58301-113b650b-530e-409c-82fb-b8c04fbe81c8" released by "_create_volume_from_snapshot" :: held 1.952s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:58:10 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-9ff40d6b-898d-4d67-8ca2-d0575185f306 tempest-SnapshotDataIntegrityTests-1151129385 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 1.967s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:58:10 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-9ff40d6b-898d-4d67-8ca2-d0575185f306 tempest-SnapshotDataIntegrityTests-1151129385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4b1b487-c574-445b-969f-4d4be72dd82e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-113b650b-530e-409c-82fb-b8c04fbe81c8', 'volume_size': 1, 'snapshot_id': '2da3e47a-15e5-4b1d-b1af-ed66f9a58301'}' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:58:10 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-9ff40d6b-898d-4d67-8ca2-d0575185f306 tempest-SnapshotDataIntegrityTests-1151129385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2166cb11-a383-4686-a0cb-cc141fbb94af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:58:10 devstack cinder-volume[88899]: INFO cinder.volume.flows.manager.create_volume [None req-9ff40d6b-898d-4d67-8ca2-d0575185f306 tempest-SnapshotDataIntegrityTests-1151129385 None] Volume volume-113b650b-530e-409c-82fb-b8c04fbe81c8 (113b650b-530e-409c-82fb-b8c04fbe81c8): created successfully Aug 03 08:58:10 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-9ff40d6b-898d-4d67-8ca2-d0575185f306 tempest-SnapshotDataIntegrityTests-1151129385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2166cb11-a383-4686-a0cb-cc141fbb94af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:58:10 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-9ff40d6b-898d-4d67-8ca2-d0575185f306 tempest-SnapshotDataIntegrityTests-1151129385 None] Flow 'volume_create_manager' (113afb38-27df-4a15-800b-84739bf23f86) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:58:10 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-9ff40d6b-898d-4d67-8ca2-d0575185f306 tempest-SnapshotDataIntegrityTests-1151129385 None] Created volume successfully. Aug 03 08:58:12 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [req-a084bec3-f393-4d42-becc-11f13f7646be req-24065b79-55e7-4ac3-8f81-89cc7036f72e tempest-SnapshotDataIntegrityTests-1151129385 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:58:12 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [req-a084bec3-f393-4d42-becc-11f13f7646be req-24065b79-55e7-4ac3-8f81-89cc7036f72e tempest-SnapshotDataIntegrityTests-1151129385 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:58:12 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [req-a084bec3-f393-4d42-becc-11f13f7646be req-24065b79-55e7-4ac3-8f81-89cc7036f72e tempest-SnapshotDataIntegrityTests-1151129385 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.012s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:58:12 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [req-a084bec3-f393-4d42-becc-11f13f7646be req-24065b79-55e7-4ac3-8f81-89cc7036f72e tempest-SnapshotDataIntegrityTests-1151129385 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385', 'name': 'volume-113b650b-530e-409c-82fb-b8c04fbe81c8', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '7b62c4e3-11d0-4d28-af81-ac37dcee621f', 'enforce_multipath': True} {{(pid=88899) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 03 08:58:12 devstack cinder-volume[88899]: INFO cinder.volume.manager [req-a084bec3-f393-4d42-becc-11f13f7646be req-24065b79-55e7-4ac3-8f81-89cc7036f72e tempest-SnapshotDataIntegrityTests-1151129385 None] attachment_update completed successfully. Aug 03 08:58:16 devstack cinder-volume[88899]: INFO cinder.volume.manager [req-b3896745-b1e6-4de7-bf8f-bc249a3369d8 req-eacbf1c6-3466-497b-94eb-1ec5dd045c8d tempest-SnapshotDataIntegrityTests-1151129385 None] Terminate volume connection completed successfully. Aug 03 08:58:16 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [req-b3896745-b1e6-4de7-bf8f-bc249a3369d8 req-eacbf1c6-3466-497b-94eb-1ec5dd045c8d tempest-SnapshotDataIntegrityTests-1151129385 None] Deleting attachment 7b62c4e3-11d0-4d28-af81-ac37dcee621f. {{(pid=88899) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 03 08:58:17 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-8eef5852-ed70-409e-83fa-f9bd8da52e99 tempest-SnapshotDataIntegrityTests-1151129385 None] Acquiring lock "cinder-113b650b-530e-409c-82fb-b8c04fbe81c8-delete_volume" by "delete_volume" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:58:17 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-8eef5852-ed70-409e-83fa-f9bd8da52e99 tempest-SnapshotDataIntegrityTests-1151129385 None] Lock "cinder-113b650b-530e-409c-82fb-b8c04fbe81c8-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:58:17 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-8eef5852-ed70-409e-83fa-f9bd8da52e99 tempest-SnapshotDataIntegrityTests-1151129385 None] Acquiring lock "cinder-quobyte-113b650b-530e-409c-82fb-b8c04fbe81c8" by "delete_volume" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:58:17 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-8eef5852-ed70-409e-83fa-f9bd8da52e99 tempest-SnapshotDataIntegrityTests-1151129385 None] Lock "cinder-quobyte-113b650b-530e-409c-82fb-b8c04fbe81c8" acquired by "delete_volume" :: waited 0.013s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:58:17 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd3e2b2a-987a-441c-94cf-3e5b02c780e2]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:58:17 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-8eef5852-ed70-409e-83fa-f9bd8da52e99 tempest-SnapshotDataIntegrityTests-1151129385 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-113b650b-530e-409c-82fb-b8c04fbe81c8 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:58:17 devstack sudo[117017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-113b650b-530e-409c-82fb-b8c04fbe81c8 Aug 03 08:58:17 devstack sudo[117017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:58:17 devstack sudo[117017]: pam_unix(sudo:session): session closed for user root Aug 03 08:58:17 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-8eef5852-ed70-409e-83fa-f9bd8da52e99 tempest-SnapshotDataIntegrityTests-1151129385 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-113b650b-530e-409c-82fb-b8c04fbe81c8" returned: 0 in 0.336s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:58:17 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-8eef5852-ed70-409e-83fa-f9bd8da52e99 tempest-SnapshotDataIntegrityTests-1151129385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-113b650b-530e-409c-82fb-b8c04fbe81c8 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:58:17 devstack sudo[117022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-113b650b-530e-409c-82fb-b8c04fbe81c8 Aug 03 08:58:17 devstack sudo[117022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:58:18 devstack sudo[117022]: pam_unix(sudo:session): session closed for user root Aug 03 08:58:18 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-8eef5852-ed70-409e-83fa-f9bd8da52e99 tempest-SnapshotDataIntegrityTests-1151129385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-113b650b-530e-409c-82fb-b8c04fbe81c8" returned: 0 in 0.237s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:58:18 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-8eef5852-ed70-409e-83fa-f9bd8da52e99 tempest-SnapshotDataIntegrityTests-1151129385 None] Lock "cinder-quobyte-113b650b-530e-409c-82fb-b8c04fbe81c8" released by "delete_volume" :: held 0.609s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:58:18 devstack cinder-volume[88899]: DEBUG cinder.quota [None req-8eef5852-ed70-409e-83fa-f9bd8da52e99 tempest-SnapshotDataIntegrityTests-1151129385 None] Created reservations ['7c70bc44-2e26-4da9-84f0-417a568f50bf', '6ba57527-af8f-4a73-b832-f74fd27c5419', 'b0fc1198-05d4-4cc2-935e-44f42b946851', '175fad64-047b-4169-9dd3-e5799e9ef3ea'] {{(pid=88899) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 08:58:18 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-8eef5852-ed70-409e-83fa-f9bd8da52e99 tempest-SnapshotDataIntegrityTests-1151129385 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:58:18 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-8eef5852-ed70-409e-83fa-f9bd8da52e99 tempest-SnapshotDataIntegrityTests-1151129385 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:58:18 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-8eef5852-ed70-409e-83fa-f9bd8da52e99 tempest-SnapshotDataIntegrityTests-1151129385 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:58:18 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-8eef5852-ed70-409e-83fa-f9bd8da52e99 tempest-SnapshotDataIntegrityTests-1151129385 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:58:18 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-8eef5852-ed70-409e-83fa-f9bd8da52e99 tempest-SnapshotDataIntegrityTests-1151129385 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:58:18 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-8eef5852-ed70-409e-83fa-f9bd8da52e99 tempest-SnapshotDataIntegrityTests-1151129385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:58:18 devstack sudo[117025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a Aug 03 08:58:18 devstack sudo[117025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:58:18 devstack sudo[117025]: pam_unix(sudo:session): session closed for user root Aug 03 08:58:18 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-8eef5852-ed70-409e-83fa-f9bd8da52e99 tempest-SnapshotDataIntegrityTests-1151129385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a" returned: 0 in 0.240s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:58:18 devstack cinder-volume[88899]: DEBUG cinder.manager [None req-8eef5852-ed70-409e-83fa-f9bd8da52e99 tempest-SnapshotDataIntegrityTests-1151129385 None] Notifying Schedulers of capabilities ... {{(pid=88899) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 08:58:18 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-8eef5852-ed70-409e-83fa-f9bd8da52e99 tempest-SnapshotDataIntegrityTests-1151129385 None] Deleted volume successfully. Aug 03 08:58:18 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-8eef5852-ed70-409e-83fa-f9bd8da52e99 tempest-SnapshotDataIntegrityTests-1151129385 None] Lock "cinder-113b650b-530e-409c-82fb-b8c04fbe81c8-delete_volume" released by "delete_volume" :: held 1.035s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:58:18 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-5419ea69-399f-417f-9708-13d12147ac4b tempest-SnapshotDataIntegrityTests-1151129385 None] Acquiring lock "cinder-14247fdf-a095-4f9a-83f7-162065424e3e-delete_volume" by "delete_volume" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:58:18 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-5419ea69-399f-417f-9708-13d12147ac4b tempest-SnapshotDataIntegrityTests-1151129385 None] Lock "cinder-14247fdf-a095-4f9a-83f7-162065424e3e-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:58:18 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-5419ea69-399f-417f-9708-13d12147ac4b tempest-SnapshotDataIntegrityTests-1151129385 None] Acquiring lock "cinder-quobyte-14247fdf-a095-4f9a-83f7-162065424e3e" by "delete_volume" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:58:18 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-5419ea69-399f-417f-9708-13d12147ac4b tempest-SnapshotDataIntegrityTests-1151129385 None] Lock "cinder-quobyte-14247fdf-a095-4f9a-83f7-162065424e3e" acquired by "delete_volume" :: waited 0.017s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:58:18 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[c40f2e1c-f2bd-4d3b-af68-692303a2c821]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:58:18 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-5419ea69-399f-417f-9708-13d12147ac4b tempest-SnapshotDataIntegrityTests-1151129385 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-14247fdf-a095-4f9a-83f7-162065424e3e {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:58:18 devstack sudo[117028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-14247fdf-a095-4f9a-83f7-162065424e3e Aug 03 08:58:18 devstack sudo[117028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:58:19 devstack sudo[117028]: pam_unix(sudo:session): session closed for user root Aug 03 08:58:19 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-5419ea69-399f-417f-9708-13d12147ac4b tempest-SnapshotDataIntegrityTests-1151129385 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-14247fdf-a095-4f9a-83f7-162065424e3e" returned: 0 in 0.347s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:58:19 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-5419ea69-399f-417f-9708-13d12147ac4b tempest-SnapshotDataIntegrityTests-1151129385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-14247fdf-a095-4f9a-83f7-162065424e3e {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:58:19 devstack sudo[117034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-14247fdf-a095-4f9a-83f7-162065424e3e Aug 03 08:58:19 devstack sudo[117034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:58:19 devstack sudo[117034]: pam_unix(sudo:session): session closed for user root Aug 03 08:58:19 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-5419ea69-399f-417f-9708-13d12147ac4b tempest-SnapshotDataIntegrityTests-1151129385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-14247fdf-a095-4f9a-83f7-162065424e3e" returned: 0 in 0.238s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:58:19 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-5419ea69-399f-417f-9708-13d12147ac4b tempest-SnapshotDataIntegrityTests-1151129385 None] Lock "cinder-quobyte-14247fdf-a095-4f9a-83f7-162065424e3e" released by "delete_volume" :: held 0.624s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:58:19 devstack cinder-volume[88899]: DEBUG cinder.quota [None req-5419ea69-399f-417f-9708-13d12147ac4b tempest-SnapshotDataIntegrityTests-1151129385 None] Created reservations ['6ff3ae18-7922-4187-9ce2-49db78ca984f', 'cea93161-680e-4a43-9d2d-cc520fe6e404', '714f038a-ca14-4207-b29c-ffa31220b398', '9b8f821f-875a-4dca-b7aa-760454544aa3'] {{(pid=88899) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 08:58:19 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-5419ea69-399f-417f-9708-13d12147ac4b tempest-SnapshotDataIntegrityTests-1151129385 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:58:19 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-5419ea69-399f-417f-9708-13d12147ac4b tempest-SnapshotDataIntegrityTests-1151129385 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:58:19 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-5419ea69-399f-417f-9708-13d12147ac4b tempest-SnapshotDataIntegrityTests-1151129385 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:58:19 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-5419ea69-399f-417f-9708-13d12147ac4b tempest-SnapshotDataIntegrityTests-1151129385 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:58:19 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-5419ea69-399f-417f-9708-13d12147ac4b tempest-SnapshotDataIntegrityTests-1151129385 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:58:19 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-5419ea69-399f-417f-9708-13d12147ac4b tempest-SnapshotDataIntegrityTests-1151129385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:58:19 devstack sudo[117037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a Aug 03 08:58:19 devstack sudo[117037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:58:19 devstack sudo[117037]: pam_unix(sudo:session): session closed for user root Aug 03 08:58:19 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-5419ea69-399f-417f-9708-13d12147ac4b tempest-SnapshotDataIntegrityTests-1151129385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a" returned: 0 in 0.234s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:58:19 devstack cinder-volume[88899]: DEBUG cinder.manager [None req-5419ea69-399f-417f-9708-13d12147ac4b tempest-SnapshotDataIntegrityTests-1151129385 None] Notifying Schedulers of capabilities ... {{(pid=88899) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 08:58:19 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-5419ea69-399f-417f-9708-13d12147ac4b tempest-SnapshotDataIntegrityTests-1151129385 None] Deleted volume successfully. Aug 03 08:58:19 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-5419ea69-399f-417f-9708-13d12147ac4b tempest-SnapshotDataIntegrityTests-1151129385 None] Lock "cinder-14247fdf-a095-4f9a-83f7-162065424e3e-delete_volume" released by "delete_volume" :: held 1.043s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:58:19 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-548c9414-efaa-4597-aefd-1c90553fc9f3 tempest-SnapshotDataIntegrityTests-1151129385 None] Acquiring lock "cinder-9ca95aeb-f6d4-4785-a0a1-f78a4154e8ea-delete_volume" by "delete_volume" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:58:19 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-548c9414-efaa-4597-aefd-1c90553fc9f3 tempest-SnapshotDataIntegrityTests-1151129385 None] Lock "cinder-9ca95aeb-f6d4-4785-a0a1-f78a4154e8ea-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:58:20 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-548c9414-efaa-4597-aefd-1c90553fc9f3 tempest-SnapshotDataIntegrityTests-1151129385 None] Acquiring lock "cinder-quobyte-9ca95aeb-f6d4-4785-a0a1-f78a4154e8ea" by "delete_volume" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:58:20 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-548c9414-efaa-4597-aefd-1c90553fc9f3 tempest-SnapshotDataIntegrityTests-1151129385 None] Lock "cinder-quobyte-9ca95aeb-f6d4-4785-a0a1-f78a4154e8ea" acquired by "delete_volume" :: waited 0.014s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:58:20 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1065d5b-8974-4a63-b4b7-64d73720c985]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:58:20 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-548c9414-efaa-4597-aefd-1c90553fc9f3 tempest-SnapshotDataIntegrityTests-1151129385 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-9ca95aeb-f6d4-4785-a0a1-f78a4154e8ea {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:58:20 devstack sudo[117040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-9ca95aeb-f6d4-4785-a0a1-f78a4154e8ea Aug 03 08:58:20 devstack sudo[117040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:58:20 devstack sudo[117040]: pam_unix(sudo:session): session closed for user root Aug 03 08:58:20 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-548c9414-efaa-4597-aefd-1c90553fc9f3 tempest-SnapshotDataIntegrityTests-1151129385 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-9ca95aeb-f6d4-4785-a0a1-f78a4154e8ea" returned: 0 in 0.347s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:58:20 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-548c9414-efaa-4597-aefd-1c90553fc9f3 tempest-SnapshotDataIntegrityTests-1151129385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-9ca95aeb-f6d4-4785-a0a1-f78a4154e8ea {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:58:20 devstack sudo[117045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-9ca95aeb-f6d4-4785-a0a1-f78a4154e8ea Aug 03 08:58:20 devstack sudo[117045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:58:20 devstack sudo[117045]: pam_unix(sudo:session): session closed for user root Aug 03 08:58:20 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-548c9414-efaa-4597-aefd-1c90553fc9f3 tempest-SnapshotDataIntegrityTests-1151129385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-9ca95aeb-f6d4-4785-a0a1-f78a4154e8ea" returned: 0 in 0.235s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:58:20 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-548c9414-efaa-4597-aefd-1c90553fc9f3 tempest-SnapshotDataIntegrityTests-1151129385 None] Lock "cinder-quobyte-9ca95aeb-f6d4-4785-a0a1-f78a4154e8ea" released by "delete_volume" :: held 0.618s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:58:20 devstack cinder-volume[88899]: DEBUG cinder.quota [None req-548c9414-efaa-4597-aefd-1c90553fc9f3 tempest-SnapshotDataIntegrityTests-1151129385 None] Created reservations ['3f5bdd50-8c9d-4e9e-b5b9-81ea44ecfa99', '879e42ec-81ad-463f-9481-5156eb32f139', '1e49ddd3-7fa5-4ecd-b9b7-5d852c4e121b', '5a6c3bd2-eb09-4d38-a3a7-39af4d9a6420'] {{(pid=88899) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 08:58:20 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-548c9414-efaa-4597-aefd-1c90553fc9f3 tempest-SnapshotDataIntegrityTests-1151129385 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:58:20 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-548c9414-efaa-4597-aefd-1c90553fc9f3 tempest-SnapshotDataIntegrityTests-1151129385 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:58:20 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-548c9414-efaa-4597-aefd-1c90553fc9f3 tempest-SnapshotDataIntegrityTests-1151129385 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:58:20 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-548c9414-efaa-4597-aefd-1c90553fc9f3 tempest-SnapshotDataIntegrityTests-1151129385 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:58:20 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-548c9414-efaa-4597-aefd-1c90553fc9f3 tempest-SnapshotDataIntegrityTests-1151129385 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:58:20 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-548c9414-efaa-4597-aefd-1c90553fc9f3 tempest-SnapshotDataIntegrityTests-1151129385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:58:20 devstack sudo[117048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a Aug 03 08:58:20 devstack sudo[117048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:58:20 devstack sudo[117048]: pam_unix(sudo:session): session closed for user root Aug 03 08:58:20 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-548c9414-efaa-4597-aefd-1c90553fc9f3 tempest-SnapshotDataIntegrityTests-1151129385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a" returned: 0 in 0.237s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:58:20 devstack cinder-volume[88899]: DEBUG cinder.manager [None req-548c9414-efaa-4597-aefd-1c90553fc9f3 tempest-SnapshotDataIntegrityTests-1151129385 None] Notifying Schedulers of capabilities ... {{(pid=88899) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 08:58:21 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-548c9414-efaa-4597-aefd-1c90553fc9f3 tempest-SnapshotDataIntegrityTests-1151129385 None] Deleted volume successfully. Aug 03 08:58:21 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-548c9414-efaa-4597-aefd-1c90553fc9f3 tempest-SnapshotDataIntegrityTests-1151129385 None] Lock "cinder-9ca95aeb-f6d4-4785-a0a1-f78a4154e8ea-delete_volume" released by "delete_volume" :: held 1.053s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:58:21 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-5e8d02ce-8b24-4b89-bcd9-0d408874c0f9 tempest-SnapshotDataIntegrityTests-1151129385 None] Acquiring lock "cinder-2da3e47a-15e5-4b1d-b1af-ed66f9a58301-delete_snapshot" by "delete_snapshot" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:58:21 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-5e8d02ce-8b24-4b89-bcd9-0d408874c0f9 tempest-SnapshotDataIntegrityTests-1151129385 None] Lock "cinder-2da3e47a-15e5-4b1d-b1af-ed66f9a58301-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:58:21 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-5e8d02ce-8b24-4b89-bcd9-0d408874c0f9 tempest-SnapshotDataIntegrityTests-1151129385 None] Acquiring lock "cinder-quobyte-c512cee2-9ba7-4fbc-85e0-b9cff62418ed" by "delete_snapshot" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:58:21 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-5e8d02ce-8b24-4b89-bcd9-0d408874c0f9 tempest-SnapshotDataIntegrityTests-1151129385 None] Lock "cinder-quobyte-c512cee2-9ba7-4fbc-85e0-b9cff62418ed" acquired by "delete_snapshot" :: waited 0.015s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:58:21 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-5e8d02ce-8b24-4b89-bcd9-0d408874c0f9 tempest-SnapshotDataIntegrityTests-1151129385 None] Acquiring lock "cinder-quobyte-2da3e47a-15e5-4b1d-b1af-ed66f9a58301" by "_delete_snapshot" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:58:21 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-5e8d02ce-8b24-4b89-bcd9-0d408874c0f9 tempest-SnapshotDataIntegrityTests-1151129385 None] Lock "cinder-quobyte-2da3e47a-15e5-4b1d-b1af-ed66f9a58301" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:58:21 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-5e8d02ce-8b24-4b89-bcd9-0d408874c0f9 tempest-SnapshotDataIntegrityTests-1151129385 None] Deleting offline snapshot 2da3e47a-15e5-4b1d-b1af-ed66f9a58301 of volume c512cee2-9ba7-4fbc-85e0-b9cff62418ed {{(pid=88899) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 03 08:58:21 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-5e8d02ce-8b24-4b89-bcd9-0d408874c0f9 tempest-SnapshotDataIntegrityTests-1151129385 None] snapshot_file for this snap is: volume-c512cee2-9ba7-4fbc-85e0-b9cff62418ed.2da3e47a-15e5-4b1d-b1af-ed66f9a58301 {{(pid=88899) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 03 08:58:21 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6795f27-0d1c-4001-96e6-43640d1af3b8]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:58:21 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-5e8d02ce-8b24-4b89-bcd9-0d408874c0f9 tempest-SnapshotDataIntegrityTests-1151129385 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c512cee2-9ba7-4fbc-85e0-b9cff62418ed.2da3e47a-15e5-4b1d-b1af-ed66f9a58301 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:58:21 devstack sudo[117051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c512cee2-9ba7-4fbc-85e0-b9cff62418ed.2da3e47a-15e5-4b1d-b1af-ed66f9a58301 Aug 03 08:58:21 devstack sudo[117051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:58:21 devstack sudo[117051]: pam_unix(sudo:session): session closed for user root Aug 03 08:58:21 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-5e8d02ce-8b24-4b89-bcd9-0d408874c0f9 tempest-SnapshotDataIntegrityTests-1151129385 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c512cee2-9ba7-4fbc-85e0-b9cff62418ed.2da3e47a-15e5-4b1d-b1af-ed66f9a58301" returned: 0 in 0.339s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:58:21 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-5e8d02ce-8b24-4b89-bcd9-0d408874c0f9 tempest-SnapshotDataIntegrityTests-1151129385 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c512cee2-9ba7-4fbc-85e0-b9cff62418ed(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88899) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 03 08:58:21 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[2309efad-343b-4346-ae0d-7c8b8a7b0ce7]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:58:21 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-5e8d02ce-8b24-4b89-bcd9-0d408874c0f9 tempest-SnapshotDataIntegrityTests-1151129385 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c512cee2-9ba7-4fbc-85e0-b9cff62418ed.2c13d4e1-7236-492a-acfe-ed7ae7c837ef {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:58:21 devstack sudo[117056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c512cee2-9ba7-4fbc-85e0-b9cff62418ed.2c13d4e1-7236-492a-acfe-ed7ae7c837ef Aug 03 08:58:21 devstack sudo[117056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:58:21 devstack sudo[117056]: pam_unix(sudo:session): session closed for user root Aug 03 08:58:21 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-5e8d02ce-8b24-4b89-bcd9-0d408874c0f9 tempest-SnapshotDataIntegrityTests-1151129385 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c512cee2-9ba7-4fbc-85e0-b9cff62418ed.2c13d4e1-7236-492a-acfe-ed7ae7c837ef" returned: 0 in 0.327s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:58:21 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-5e8d02ce-8b24-4b89-bcd9-0d408874c0f9 tempest-SnapshotDataIntegrityTests-1151129385 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c512cee2-9ba7-4fbc-85e0-b9cff62418ed(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88899) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 03 08:58:21 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-5e8d02ce-8b24-4b89-bcd9-0d408874c0f9 tempest-SnapshotDataIntegrityTests-1151129385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c512cee2-9ba7-4fbc-85e0-b9cff62418ed.2da3e47a-15e5-4b1d-b1af-ed66f9a58301 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:58:21 devstack sudo[117061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c512cee2-9ba7-4fbc-85e0-b9cff62418ed.2da3e47a-15e5-4b1d-b1af-ed66f9a58301 Aug 03 08:58:21 devstack sudo[117061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:58:22 devstack sudo[117061]: pam_unix(sudo:session): session closed for user root Aug 03 08:58:22 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-5e8d02ce-8b24-4b89-bcd9-0d408874c0f9 tempest-SnapshotDataIntegrityTests-1151129385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c512cee2-9ba7-4fbc-85e0-b9cff62418ed.2da3e47a-15e5-4b1d-b1af-ed66f9a58301" returned: 0 in 0.574s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:58:22 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-5e8d02ce-8b24-4b89-bcd9-0d408874c0f9 tempest-SnapshotDataIntegrityTests-1151129385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c512cee2-9ba7-4fbc-85e0-b9cff62418ed.2da3e47a-15e5-4b1d-b1af-ed66f9a58301 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:58:22 devstack sudo[117067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c512cee2-9ba7-4fbc-85e0-b9cff62418ed.2da3e47a-15e5-4b1d-b1af-ed66f9a58301 Aug 03 08:58:22 devstack sudo[117067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:58:22 devstack sudo[117067]: pam_unix(sudo:session): session closed for user root Aug 03 08:58:22 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-5e8d02ce-8b24-4b89-bcd9-0d408874c0f9 tempest-SnapshotDataIntegrityTests-1151129385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c512cee2-9ba7-4fbc-85e0-b9cff62418ed.2da3e47a-15e5-4b1d-b1af-ed66f9a58301" returned: 0 in 0.228s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:58:22 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-5e8d02ce-8b24-4b89-bcd9-0d408874c0f9 tempest-SnapshotDataIntegrityTests-1151129385 None] Lock "cinder-quobyte-2da3e47a-15e5-4b1d-b1af-ed66f9a58301" released by "_delete_snapshot" :: held 1.546s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:58:22 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-5e8d02ce-8b24-4b89-bcd9-0d408874c0f9 tempest-SnapshotDataIntegrityTests-1151129385 None] Lock "cinder-quobyte-c512cee2-9ba7-4fbc-85e0-b9cff62418ed" released by "delete_snapshot" :: held 1.571s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:58:22 devstack cinder-volume[88899]: DEBUG cinder.quota [None req-5e8d02ce-8b24-4b89-bcd9-0d408874c0f9 tempest-SnapshotDataIntegrityTests-1151129385 None] Created reservations ['4177a40e-3535-44c2-b0dc-7777ef11fa1d', '86bc410e-3dfe-49d9-bd88-9bc1432dc997', 'fca669c5-8a07-40c6-bc84-d0629f28ce65', '9c50fe9a-f4ab-4774-b739-03110806404a'] {{(pid=88899) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 08:58:22 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-5e8d02ce-8b24-4b89-bcd9-0d408874c0f9 tempest-SnapshotDataIntegrityTests-1151129385 None] Delete snapshot completed successfully. Aug 03 08:58:22 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-5e8d02ce-8b24-4b89-bcd9-0d408874c0f9 tempest-SnapshotDataIntegrityTests-1151129385 None] Lock "cinder-2da3e47a-15e5-4b1d-b1af-ed66f9a58301-delete_snapshot" released by "delete_snapshot" :: held 1.692s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:58:23 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-6022ffa6-1a44-4b8d-947b-3eb4d55b8f84 tempest-SnapshotDataIntegrityTests-1151129385 None] Acquiring lock "cinder-2c13d4e1-7236-492a-acfe-ed7ae7c837ef-delete_snapshot" by "delete_snapshot" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:58:23 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-6022ffa6-1a44-4b8d-947b-3eb4d55b8f84 tempest-SnapshotDataIntegrityTests-1151129385 None] Lock "cinder-2c13d4e1-7236-492a-acfe-ed7ae7c837ef-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:58:23 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-6022ffa6-1a44-4b8d-947b-3eb4d55b8f84 tempest-SnapshotDataIntegrityTests-1151129385 None] Acquiring lock "cinder-quobyte-c512cee2-9ba7-4fbc-85e0-b9cff62418ed" by "delete_snapshot" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:58:23 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-6022ffa6-1a44-4b8d-947b-3eb4d55b8f84 tempest-SnapshotDataIntegrityTests-1151129385 None] Lock "cinder-quobyte-c512cee2-9ba7-4fbc-85e0-b9cff62418ed" acquired by "delete_snapshot" :: waited 0.017s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:58:23 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-6022ffa6-1a44-4b8d-947b-3eb4d55b8f84 tempest-SnapshotDataIntegrityTests-1151129385 None] Acquiring lock "cinder-quobyte-2c13d4e1-7236-492a-acfe-ed7ae7c837ef" by "_delete_snapshot" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:58:23 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-6022ffa6-1a44-4b8d-947b-3eb4d55b8f84 tempest-SnapshotDataIntegrityTests-1151129385 None] Lock "cinder-quobyte-2c13d4e1-7236-492a-acfe-ed7ae7c837ef" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:58:23 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-6022ffa6-1a44-4b8d-947b-3eb4d55b8f84 tempest-SnapshotDataIntegrityTests-1151129385 None] Deleting offline snapshot 2c13d4e1-7236-492a-acfe-ed7ae7c837ef of volume c512cee2-9ba7-4fbc-85e0-b9cff62418ed {{(pid=88899) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 03 08:58:23 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-6022ffa6-1a44-4b8d-947b-3eb4d55b8f84 tempest-SnapshotDataIntegrityTests-1151129385 None] snapshot_file for this snap is: volume-c512cee2-9ba7-4fbc-85e0-b9cff62418ed.2c13d4e1-7236-492a-acfe-ed7ae7c837ef {{(pid=88899) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 03 08:58:23 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b98303a-5863-48f8-a9a7-9d7dafc0cd5e]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:58:23 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-6022ffa6-1a44-4b8d-947b-3eb4d55b8f84 tempest-SnapshotDataIntegrityTests-1151129385 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c512cee2-9ba7-4fbc-85e0-b9cff62418ed.2c13d4e1-7236-492a-acfe-ed7ae7c837ef {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:58:23 devstack sudo[117070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c512cee2-9ba7-4fbc-85e0-b9cff62418ed.2c13d4e1-7236-492a-acfe-ed7ae7c837ef Aug 03 08:58:23 devstack sudo[117070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:58:23 devstack sudo[117070]: pam_unix(sudo:session): session closed for user root Aug 03 08:58:23 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-6022ffa6-1a44-4b8d-947b-3eb4d55b8f84 tempest-SnapshotDataIntegrityTests-1151129385 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c512cee2-9ba7-4fbc-85e0-b9cff62418ed.2c13d4e1-7236-492a-acfe-ed7ae7c837ef" returned: 0 in 0.368s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:58:23 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-6022ffa6-1a44-4b8d-947b-3eb4d55b8f84 tempest-SnapshotDataIntegrityTests-1151129385 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c512cee2-9ba7-4fbc-85e0-b9cff62418ed(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88899) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 03 08:58:23 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[aecf13b6-179c-41ca-b508-89768dbd0439]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:58:23 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-6022ffa6-1a44-4b8d-947b-3eb4d55b8f84 tempest-SnapshotDataIntegrityTests-1151129385 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c512cee2-9ba7-4fbc-85e0-b9cff62418ed.ebf3e7c1-e3dd-4712-b6c6-1e1951de8a97 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:58:23 devstack sudo[117075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c512cee2-9ba7-4fbc-85e0-b9cff62418ed.ebf3e7c1-e3dd-4712-b6c6-1e1951de8a97 Aug 03 08:58:23 devstack sudo[117075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:58:24 devstack sudo[117075]: pam_unix(sudo:session): session closed for user root Aug 03 08:58:24 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-6022ffa6-1a44-4b8d-947b-3eb4d55b8f84 tempest-SnapshotDataIntegrityTests-1151129385 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c512cee2-9ba7-4fbc-85e0-b9cff62418ed.ebf3e7c1-e3dd-4712-b6c6-1e1951de8a97" returned: 0 in 0.332s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:58:24 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-6022ffa6-1a44-4b8d-947b-3eb4d55b8f84 tempest-SnapshotDataIntegrityTests-1151129385 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c512cee2-9ba7-4fbc-85e0-b9cff62418ed(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88899) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 03 08:58:24 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-6022ffa6-1a44-4b8d-947b-3eb4d55b8f84 tempest-SnapshotDataIntegrityTests-1151129385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c512cee2-9ba7-4fbc-85e0-b9cff62418ed.2c13d4e1-7236-492a-acfe-ed7ae7c837ef {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:58:24 devstack sudo[117080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c512cee2-9ba7-4fbc-85e0-b9cff62418ed.2c13d4e1-7236-492a-acfe-ed7ae7c837ef Aug 03 08:58:24 devstack sudo[117080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:58:24 devstack sudo[117080]: pam_unix(sudo:session): session closed for user root Aug 03 08:58:24 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-6022ffa6-1a44-4b8d-947b-3eb4d55b8f84 tempest-SnapshotDataIntegrityTests-1151129385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c512cee2-9ba7-4fbc-85e0-b9cff62418ed.2c13d4e1-7236-492a-acfe-ed7ae7c837ef" returned: 0 in 0.419s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:58:24 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-6022ffa6-1a44-4b8d-947b-3eb4d55b8f84 tempest-SnapshotDataIntegrityTests-1151129385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c512cee2-9ba7-4fbc-85e0-b9cff62418ed.2c13d4e1-7236-492a-acfe-ed7ae7c837ef {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:58:24 devstack sudo[117093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c512cee2-9ba7-4fbc-85e0-b9cff62418ed.2c13d4e1-7236-492a-acfe-ed7ae7c837ef Aug 03 08:58:24 devstack sudo[117093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:58:24 devstack sudo[117093]: pam_unix(sudo:session): session closed for user root Aug 03 08:58:24 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-6022ffa6-1a44-4b8d-947b-3eb4d55b8f84 tempest-SnapshotDataIntegrityTests-1151129385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c512cee2-9ba7-4fbc-85e0-b9cff62418ed.2c13d4e1-7236-492a-acfe-ed7ae7c837ef" returned: 0 in 0.235s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:58:24 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-6022ffa6-1a44-4b8d-947b-3eb4d55b8f84 tempest-SnapshotDataIntegrityTests-1151129385 None] Lock "cinder-quobyte-2c13d4e1-7236-492a-acfe-ed7ae7c837ef" released by "_delete_snapshot" :: held 1.441s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:58:24 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-6022ffa6-1a44-4b8d-947b-3eb4d55b8f84 tempest-SnapshotDataIntegrityTests-1151129385 None] Lock "cinder-quobyte-c512cee2-9ba7-4fbc-85e0-b9cff62418ed" released by "delete_snapshot" :: held 1.461s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:58:24 devstack cinder-volume[88899]: DEBUG cinder.quota [None req-6022ffa6-1a44-4b8d-947b-3eb4d55b8f84 tempest-SnapshotDataIntegrityTests-1151129385 None] Created reservations ['7dc7ed6f-f316-42b8-a7b4-133b133df22a', 'ecf62d9f-cf00-41a0-b469-d2843cdaae44', 'ac93d0bb-ff73-4281-b7c9-e6479e50b501', '806b71d9-e0e1-4bc7-b548-def64f78a471'] {{(pid=88899) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 08:58:24 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-6022ffa6-1a44-4b8d-947b-3eb4d55b8f84 tempest-SnapshotDataIntegrityTests-1151129385 None] Delete snapshot completed successfully. Aug 03 08:58:24 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-6022ffa6-1a44-4b8d-947b-3eb4d55b8f84 tempest-SnapshotDataIntegrityTests-1151129385 None] Lock "cinder-2c13d4e1-7236-492a-acfe-ed7ae7c837ef-delete_snapshot" released by "delete_snapshot" :: held 1.583s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:58:25 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-2cc1f6b0-1e5a-470c-9b76-65d060d4e531 tempest-SnapshotDataIntegrityTests-1151129385 None] Acquiring lock "cinder-ebf3e7c1-e3dd-4712-b6c6-1e1951de8a97-delete_snapshot" by "delete_snapshot" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:58:25 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-2cc1f6b0-1e5a-470c-9b76-65d060d4e531 tempest-SnapshotDataIntegrityTests-1151129385 None] Lock "cinder-ebf3e7c1-e3dd-4712-b6c6-1e1951de8a97-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:58:25 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-2cc1f6b0-1e5a-470c-9b76-65d060d4e531 tempest-SnapshotDataIntegrityTests-1151129385 None] Acquiring lock "cinder-quobyte-c512cee2-9ba7-4fbc-85e0-b9cff62418ed" by "delete_snapshot" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:58:25 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-2cc1f6b0-1e5a-470c-9b76-65d060d4e531 tempest-SnapshotDataIntegrityTests-1151129385 None] Lock "cinder-quobyte-c512cee2-9ba7-4fbc-85e0-b9cff62418ed" acquired by "delete_snapshot" :: waited 0.014s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:58:25 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-2cc1f6b0-1e5a-470c-9b76-65d060d4e531 tempest-SnapshotDataIntegrityTests-1151129385 None] Acquiring lock "cinder-quobyte-ebf3e7c1-e3dd-4712-b6c6-1e1951de8a97" by "_delete_snapshot" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:58:25 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-2cc1f6b0-1e5a-470c-9b76-65d060d4e531 tempest-SnapshotDataIntegrityTests-1151129385 None] Lock "cinder-quobyte-ebf3e7c1-e3dd-4712-b6c6-1e1951de8a97" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:58:25 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-2cc1f6b0-1e5a-470c-9b76-65d060d4e531 tempest-SnapshotDataIntegrityTests-1151129385 None] Deleting offline snapshot ebf3e7c1-e3dd-4712-b6c6-1e1951de8a97 of volume c512cee2-9ba7-4fbc-85e0-b9cff62418ed {{(pid=88899) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 03 08:58:25 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-2cc1f6b0-1e5a-470c-9b76-65d060d4e531 tempest-SnapshotDataIntegrityTests-1151129385 None] snapshot_file for this snap is: volume-c512cee2-9ba7-4fbc-85e0-b9cff62418ed.ebf3e7c1-e3dd-4712-b6c6-1e1951de8a97 {{(pid=88899) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 03 08:58:25 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[736a812b-5c84-482f-ac8d-0cb10e391fd6]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:58:25 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-2cc1f6b0-1e5a-470c-9b76-65d060d4e531 tempest-SnapshotDataIntegrityTests-1151129385 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c512cee2-9ba7-4fbc-85e0-b9cff62418ed.ebf3e7c1-e3dd-4712-b6c6-1e1951de8a97 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:58:25 devstack sudo[117096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c512cee2-9ba7-4fbc-85e0-b9cff62418ed.ebf3e7c1-e3dd-4712-b6c6-1e1951de8a97 Aug 03 08:58:25 devstack sudo[117096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:58:25 devstack sudo[117096]: pam_unix(sudo:session): session closed for user root Aug 03 08:58:25 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-2cc1f6b0-1e5a-470c-9b76-65d060d4e531 tempest-SnapshotDataIntegrityTests-1151129385 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c512cee2-9ba7-4fbc-85e0-b9cff62418ed.ebf3e7c1-e3dd-4712-b6c6-1e1951de8a97" returned: 0 in 0.347s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:58:25 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-2cc1f6b0-1e5a-470c-9b76-65d060d4e531 tempest-SnapshotDataIntegrityTests-1151129385 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c512cee2-9ba7-4fbc-85e0-b9cff62418ed(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88899) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 03 08:58:25 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c2018db-fdaa-465f-ae8f-35e5e4e5337d]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:58:25 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-2cc1f6b0-1e5a-470c-9b76-65d060d4e531 tempest-SnapshotDataIntegrityTests-1151129385 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c512cee2-9ba7-4fbc-85e0-b9cff62418ed {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:58:25 devstack sudo[117101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c512cee2-9ba7-4fbc-85e0-b9cff62418ed Aug 03 08:58:25 devstack sudo[117101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:58:26 devstack sudo[117101]: pam_unix(sudo:session): session closed for user root Aug 03 08:58:26 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-2cc1f6b0-1e5a-470c-9b76-65d060d4e531 tempest-SnapshotDataIntegrityTests-1151129385 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c512cee2-9ba7-4fbc-85e0-b9cff62418ed" returned: 0 in 0.363s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:58:26 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-2cc1f6b0-1e5a-470c-9b76-65d060d4e531 tempest-SnapshotDataIntegrityTests-1151129385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c512cee2-9ba7-4fbc-85e0-b9cff62418ed.ebf3e7c1-e3dd-4712-b6c6-1e1951de8a97 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:58:26 devstack sudo[117106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c512cee2-9ba7-4fbc-85e0-b9cff62418ed.ebf3e7c1-e3dd-4712-b6c6-1e1951de8a97 Aug 03 08:58:26 devstack sudo[117106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:58:26 devstack sudo[117106]: pam_unix(sudo:session): session closed for user root Aug 03 08:58:26 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-2cc1f6b0-1e5a-470c-9b76-65d060d4e531 tempest-SnapshotDataIntegrityTests-1151129385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c512cee2-9ba7-4fbc-85e0-b9cff62418ed.ebf3e7c1-e3dd-4712-b6c6-1e1951de8a97" returned: 0 in 0.400s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:58:26 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-2cc1f6b0-1e5a-470c-9b76-65d060d4e531 tempest-SnapshotDataIntegrityTests-1151129385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c512cee2-9ba7-4fbc-85e0-b9cff62418ed.ebf3e7c1-e3dd-4712-b6c6-1e1951de8a97 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:58:26 devstack sudo[117117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c512cee2-9ba7-4fbc-85e0-b9cff62418ed.ebf3e7c1-e3dd-4712-b6c6-1e1951de8a97 Aug 03 08:58:26 devstack sudo[117117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:58:26 devstack sudo[117117]: pam_unix(sudo:session): session closed for user root Aug 03 08:58:26 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-2cc1f6b0-1e5a-470c-9b76-65d060d4e531 tempest-SnapshotDataIntegrityTests-1151129385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c512cee2-9ba7-4fbc-85e0-b9cff62418ed.ebf3e7c1-e3dd-4712-b6c6-1e1951de8a97" returned: 0 in 0.243s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:58:26 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-2cc1f6b0-1e5a-470c-9b76-65d060d4e531 tempest-SnapshotDataIntegrityTests-1151129385 None] Lock "cinder-quobyte-ebf3e7c1-e3dd-4712-b6c6-1e1951de8a97" released by "_delete_snapshot" :: held 1.452s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:58:26 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-2cc1f6b0-1e5a-470c-9b76-65d060d4e531 tempest-SnapshotDataIntegrityTests-1151129385 None] Lock "cinder-quobyte-c512cee2-9ba7-4fbc-85e0-b9cff62418ed" released by "delete_snapshot" :: held 1.474s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:58:26 devstack cinder-volume[88899]: DEBUG cinder.quota [None req-2cc1f6b0-1e5a-470c-9b76-65d060d4e531 tempest-SnapshotDataIntegrityTests-1151129385 None] Created reservations ['f5492606-8017-4513-9783-06caeb60cbdd', '908dec8c-8791-46e5-8f76-ddbfd9f5ac4b', '15e9427c-ca0d-4cc9-ad67-85f584db1efb', 'c472d6a3-e373-4d0e-afba-f31216edcce1'] {{(pid=88899) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 08:58:27 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-2cc1f6b0-1e5a-470c-9b76-65d060d4e531 tempest-SnapshotDataIntegrityTests-1151129385 None] Delete snapshot completed successfully. Aug 03 08:58:27 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-2cc1f6b0-1e5a-470c-9b76-65d060d4e531 tempest-SnapshotDataIntegrityTests-1151129385 None] Lock "cinder-ebf3e7c1-e3dd-4712-b6c6-1e1951de8a97-delete_snapshot" released by "delete_snapshot" :: held 1.633s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:58:27 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-abcc8573-e58d-42e6-83d5-8108edf4c3b5 tempest-SnapshotDataIntegrityTests-1151129385 None] Acquiring lock "cinder-c512cee2-9ba7-4fbc-85e0-b9cff62418ed-delete_volume" by "delete_volume" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:58:27 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-abcc8573-e58d-42e6-83d5-8108edf4c3b5 tempest-SnapshotDataIntegrityTests-1151129385 None] Lock "cinder-c512cee2-9ba7-4fbc-85e0-b9cff62418ed-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:58:27 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-abcc8573-e58d-42e6-83d5-8108edf4c3b5 tempest-SnapshotDataIntegrityTests-1151129385 None] Acquiring lock "cinder-quobyte-c512cee2-9ba7-4fbc-85e0-b9cff62418ed" by "delete_volume" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:58:27 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-abcc8573-e58d-42e6-83d5-8108edf4c3b5 tempest-SnapshotDataIntegrityTests-1151129385 None] Lock "cinder-quobyte-c512cee2-9ba7-4fbc-85e0-b9cff62418ed" acquired by "delete_volume" :: waited 0.015s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:58:27 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[12cab8d7-82c8-4bb0-aa92-07dfa3027243]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:58:27 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-abcc8573-e58d-42e6-83d5-8108edf4c3b5 tempest-SnapshotDataIntegrityTests-1151129385 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c512cee2-9ba7-4fbc-85e0-b9cff62418ed {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:58:27 devstack sudo[117120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c512cee2-9ba7-4fbc-85e0-b9cff62418ed Aug 03 08:58:27 devstack sudo[117120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:58:28 devstack sudo[117120]: pam_unix(sudo:session): session closed for user root Aug 03 08:58:28 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-abcc8573-e58d-42e6-83d5-8108edf4c3b5 tempest-SnapshotDataIntegrityTests-1151129385 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c512cee2-9ba7-4fbc-85e0-b9cff62418ed" returned: 0 in 0.342s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:58:28 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-abcc8573-e58d-42e6-83d5-8108edf4c3b5 tempest-SnapshotDataIntegrityTests-1151129385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c512cee2-9ba7-4fbc-85e0-b9cff62418ed {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:58:28 devstack sudo[117125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c512cee2-9ba7-4fbc-85e0-b9cff62418ed Aug 03 08:58:28 devstack sudo[117125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:58:28 devstack sudo[117125]: pam_unix(sudo:session): session closed for user root Aug 03 08:58:28 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-abcc8573-e58d-42e6-83d5-8108edf4c3b5 tempest-SnapshotDataIntegrityTests-1151129385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-c512cee2-9ba7-4fbc-85e0-b9cff62418ed" returned: 0 in 0.241s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:58:28 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-abcc8573-e58d-42e6-83d5-8108edf4c3b5 tempest-SnapshotDataIntegrityTests-1151129385 None] Lock "cinder-quobyte-c512cee2-9ba7-4fbc-85e0-b9cff62418ed" released by "delete_volume" :: held 0.637s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:58:28 devstack cinder-volume[88899]: DEBUG cinder.quota [None req-abcc8573-e58d-42e6-83d5-8108edf4c3b5 tempest-SnapshotDataIntegrityTests-1151129385 None] Created reservations ['bb83d46e-787f-48d9-9837-737393981ef0', '26fa347d-05e4-493f-9077-f240a021a891', '4b6b74c5-0eae-4f10-aa01-adfd7fc447d7', '13053253-0c31-47a0-89ff-206330b5a0c3'] {{(pid=88899) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 08:58:28 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-abcc8573-e58d-42e6-83d5-8108edf4c3b5 tempest-SnapshotDataIntegrityTests-1151129385 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:58:28 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-abcc8573-e58d-42e6-83d5-8108edf4c3b5 tempest-SnapshotDataIntegrityTests-1151129385 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:58:28 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-abcc8573-e58d-42e6-83d5-8108edf4c3b5 tempest-SnapshotDataIntegrityTests-1151129385 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:58:28 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-abcc8573-e58d-42e6-83d5-8108edf4c3b5 tempest-SnapshotDataIntegrityTests-1151129385 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:58:28 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-abcc8573-e58d-42e6-83d5-8108edf4c3b5 tempest-SnapshotDataIntegrityTests-1151129385 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:58:28 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-abcc8573-e58d-42e6-83d5-8108edf4c3b5 tempest-SnapshotDataIntegrityTests-1151129385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:58:28 devstack sudo[117128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a Aug 03 08:58:28 devstack sudo[117128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:58:28 devstack sudo[117128]: pam_unix(sudo:session): session closed for user root Aug 03 08:58:28 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-abcc8573-e58d-42e6-83d5-8108edf4c3b5 tempest-SnapshotDataIntegrityTests-1151129385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a" returned: 0 in 0.247s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:58:28 devstack cinder-volume[88899]: DEBUG cinder.manager [None req-abcc8573-e58d-42e6-83d5-8108edf4c3b5 tempest-SnapshotDataIntegrityTests-1151129385 None] Notifying Schedulers of capabilities ... {{(pid=88899) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 08:58:28 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-abcc8573-e58d-42e6-83d5-8108edf4c3b5 tempest-SnapshotDataIntegrityTests-1151129385 None] Deleted volume successfully. Aug 03 08:58:28 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-abcc8573-e58d-42e6-83d5-8108edf4c3b5 tempest-SnapshotDataIntegrityTests-1151129385 None] Lock "cinder-c512cee2-9ba7-4fbc-85e0-b9cff62418ed-delete_volume" released by "delete_volume" :: held 1.078s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:58:38 devstack cinder-volume[88899]: DEBUG dbcounter [-] [88899] Writing DB stats cinder:SELECT=75,cinder:UPDATE=66,cinder:INSERT=12,cinder:DELETE=2 {{(pid=88899) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 03 08:58:38 devstack cinder-volume[88899]: DEBUG dbcounter [-] [88899] Writing DB stats cinder:SELECT=70,cinder:DELETE=6,cinder:UPDATE=61,cinder:INSERT=19 {{(pid=88899) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 03 08:58:51 devstack cinder-volume[88899]: DEBUG oslo_service.periodic_task [None req-f948fb4a-c4d7-499f-b1bd-8d6be3de0b53 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88899) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 03 08:58:51 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-f948fb4a-c4d7-499f-b1bd-8d6be3de0b53 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:58:51 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-f948fb4a-c4d7-499f-b1bd-8d6be3de0b53 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:58:51 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-f948fb4a-c4d7-499f-b1bd-8d6be3de0b53 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:58:51 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-f948fb4a-c4d7-499f-b1bd-8d6be3de0b53 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:58:51 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-f948fb4a-c4d7-499f-b1bd-8d6be3de0b53 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:58:51 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-f948fb4a-c4d7-499f-b1bd-8d6be3de0b53 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:58:51 devstack sudo[117172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a Aug 03 08:58:51 devstack sudo[117172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:58:52 devstack sudo[117172]: pam_unix(sudo:session): session closed for user root Aug 03 08:58:52 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-f948fb4a-c4d7-499f-b1bd-8d6be3de0b53 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a" returned: 0 in 0.234s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:58:52 devstack cinder-volume[88899]: DEBUG cinder.manager [None req-f948fb4a-c4d7-499f-b1bd-8d6be3de0b53 None None] Notifying Schedulers of capabilities ... {{(pid=88899) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 08:58:52 devstack cinder-volume[88899]: DEBUG oslo_service.periodic_task [None req-f948fb4a-c4d7-499f-b1bd-8d6be3de0b53 None None] Running periodic task VolumeManager._thread_info {{(pid=88899) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 03 08:58:52 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-f948fb4a-c4d7-499f-b1bd-8d6be3de0b53 None None] thread count: 29 {{(pid=88899) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 03 08:58:52 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-f948fb4a-c4d7-499f-b1bd-8d6be3de0b53 None None] thread info: [<_MainThread(MainThread, started 132234320248960)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88899) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 03 08:58:55 devstack cinder-volume[88899]: DEBUG cinder.volume.flows.manager.create_volume [None req-8332d8d9-91d5-4229-a596-1e95734f2157 tempest-ProjectReaderTests-1134321651 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88899) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 08:58:55 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-8332d8d9-91d5-4229-a596-1e95734f2157 tempest-ProjectReaderTests-1134321651 None] Flow 'volume_create_manager' (265fd1ad-9019-44b8-a37d-33a1dba265e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:58:55 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-8332d8d9-91d5-4229-a596-1e95734f2157 tempest-ProjectReaderTests-1134321651 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce99d2d4-c192-4a67-af29-c611958698db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:58:55 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-8332d8d9-91d5-4229-a596-1e95734f2157 tempest-ProjectReaderTests-1134321651 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce99d2d4-c192-4a67-af29-c611958698db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:58:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1872898737',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=31dae76e-81f9-4cc8-97f5-6d470cab507f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d1960effcf84b1d80da45b8e57d70f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:58:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:58:56Z,use_quota=True,user_id='552bc37e3b5740afaa307554a5a6c75f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8bde7129-1dc4-42ab-b852-ab32c61b4921),volume_type_id=8bde7129-1dc4-42ab-b852-ab32c61b4921)' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:58:55 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-8332d8d9-91d5-4229-a596-1e95734f2157 tempest-ProjectReaderTests-1134321651 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3acb9799-3021-4b79-8301-421191d07b60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:58:55 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-8332d8d9-91d5-4229-a596-1e95734f2157 tempest-ProjectReaderTests-1134321651 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3acb9799-3021-4b79-8301-421191d07b60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:58:55 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-8332d8d9-91d5-4229-a596-1e95734f2157 tempest-ProjectReaderTests-1134321651 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ccb9106-363b-40db-b393-4e43f0700f83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:58:55 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-8332d8d9-91d5-4229-a596-1e95734f2157 tempest-ProjectReaderTests-1134321651 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ccb9106-363b-40db-b393-4e43f0700f83) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '31dae76e-81f9-4cc8-97f5-6d470cab507f', 'volume_name': 'volume-31dae76e-81f9-4cc8-97f5-6d470cab507f', 'volume_size': 1}' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:58:55 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-8332d8d9-91d5-4229-a596-1e95734f2157 tempest-ProjectReaderTests-1134321651 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f5a4dbbb-6dbe-442f-9cf3-313c6eaaa09c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:58:55 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-8332d8d9-91d5-4229-a596-1e95734f2157 tempest-ProjectReaderTests-1134321651 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f5a4dbbb-6dbe-442f-9cf3-313c6eaaa09c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:58:55 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-8332d8d9-91d5-4229-a596-1e95734f2157 tempest-ProjectReaderTests-1134321651 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2ad43b5-9a94-4a69-a33e-796c66c230fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:58:55 devstack cinder-volume[88899]: INFO cinder.volume.flows.manager.create_volume [None req-8332d8d9-91d5-4229-a596-1e95734f2157 tempest-ProjectReaderTests-1134321651 None] Volume 31dae76e-81f9-4cc8-97f5-6d470cab507f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-31dae76e-81f9-4cc8-97f5-6d470cab507f', 'volume_size': 1} Aug 03 08:58:55 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-8332d8d9-91d5-4229-a596-1e95734f2157 tempest-ProjectReaderTests-1134321651 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:58:55 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-8332d8d9-91d5-4229-a596-1e95734f2157 tempest-ProjectReaderTests-1134321651 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:58:55 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-8332d8d9-91d5-4229-a596-1e95734f2157 tempest-ProjectReaderTests-1134321651 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:58:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1872898737',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=31dae76e-81f9-4cc8-97f5-6d470cab507f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d1960effcf84b1d80da45b8e57d70f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:58:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:58:56Z,use_quota=True,user_id='552bc37e3b5740afaa307554a5a6c75f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8bde7129-1dc4-42ab-b852-ab32c61b4921),volume_type_id=8bde7129-1dc4-42ab-b852-ab32c61b4921)}" {{(pid=88899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 08:58:55 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-8332d8d9-91d5-4229-a596-1e95734f2157 tempest-ProjectReaderTests-1134321651 None] Creating volume 31dae76e-81f9-4cc8-97f5-6d470cab507f {{(pid=88899) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 08:58:55 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-8332d8d9-91d5-4229-a596-1e95734f2157 tempest-ProjectReaderTests-1134321651 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:58:55 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-8332d8d9-91d5-4229-a596-1e95734f2157 tempest-ProjectReaderTests-1134321651 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:58:55 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-8332d8d9-91d5-4229-a596-1e95734f2157 tempest-ProjectReaderTests-1134321651 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:58:55 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-8332d8d9-91d5-4229-a596-1e95734f2157 tempest-ProjectReaderTests-1134321651 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:58:55 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-8332d8d9-91d5-4229-a596-1e95734f2157 tempest-ProjectReaderTests-1134321651 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:58:55 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-8332d8d9-91d5-4229-a596-1e95734f2157 tempest-ProjectReaderTests-1134321651 None] Selected osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385 as target Quobyte volume. {{(pid=88899) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 08:58:55 devstack cinder-volume[88899]: INFO cinder.volume.drivers.remotefs [None req-8332d8d9-91d5-4229-a596-1e95734f2157 tempest-ProjectReaderTests-1134321651 None] casted to osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385 Aug 03 08:58:55 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-8332d8d9-91d5-4229-a596-1e95734f2157 tempest-ProjectReaderTests-1134321651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-31dae76e-81f9-4cc8-97f5-6d470cab507f 1073741824 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:58:55 devstack sudo[117175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-31dae76e-81f9-4cc8-97f5-6d470cab507f 1073741824 Aug 03 08:58:55 devstack sudo[117175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:58:56 devstack sudo[117175]: pam_unix(sudo:session): session closed for user root Aug 03 08:58:56 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-8332d8d9-91d5-4229-a596-1e95734f2157 tempest-ProjectReaderTests-1134321651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-31dae76e-81f9-4cc8-97f5-6d470cab507f 1073741824" returned: 0 in 0.412s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:58:56 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-8332d8d9-91d5-4229-a596-1e95734f2157 tempest-ProjectReaderTests-1134321651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-31dae76e-81f9-4cc8-97f5-6d470cab507f {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:58:56 devstack sudo[117181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-31dae76e-81f9-4cc8-97f5-6d470cab507f Aug 03 08:58:56 devstack sudo[117181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:58:56 devstack sudo[117181]: pam_unix(sudo:session): session closed for user root Aug 03 08:58:56 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-8332d8d9-91d5-4229-a596-1e95734f2157 tempest-ProjectReaderTests-1134321651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-31dae76e-81f9-4cc8-97f5-6d470cab507f" returned: 0 in 0.246s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:58:56 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-8332d8d9-91d5-4229-a596-1e95734f2157 tempest-ProjectReaderTests-1134321651 None] <== create_volume: return (703ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'} {{(pid=88899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 08:58:56 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-8332d8d9-91d5-4229-a596-1e95734f2157 tempest-ProjectReaderTests-1134321651 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.705s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:58:56 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-8332d8d9-91d5-4229-a596-1e95734f2157 tempest-ProjectReaderTests-1134321651 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2ad43b5-9a94-4a69-a33e-796c66c230fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-31dae76e-81f9-4cc8-97f5-6d470cab507f', 'volume_size': 1}' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:58:56 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-8332d8d9-91d5-4229-a596-1e95734f2157 tempest-ProjectReaderTests-1134321651 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ecb7a5e6-caa6-4468-a4a8-7710eb2f665d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:58:56 devstack cinder-volume[88899]: INFO cinder.volume.flows.manager.create_volume [None req-8332d8d9-91d5-4229-a596-1e95734f2157 tempest-ProjectReaderTests-1134321651 None] Volume volume-31dae76e-81f9-4cc8-97f5-6d470cab507f (31dae76e-81f9-4cc8-97f5-6d470cab507f): created successfully Aug 03 08:58:56 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-8332d8d9-91d5-4229-a596-1e95734f2157 tempest-ProjectReaderTests-1134321651 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ecb7a5e6-caa6-4468-a4a8-7710eb2f665d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:58:56 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-8332d8d9-91d5-4229-a596-1e95734f2157 tempest-ProjectReaderTests-1134321651 None] Flow 'volume_create_manager' (265fd1ad-9019-44b8-a37d-33a1dba265e5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:58:56 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-8332d8d9-91d5-4229-a596-1e95734f2157 tempest-ProjectReaderTests-1134321651 None] Created volume successfully. Aug 03 08:58:56 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-2dea79d5-390e-42a1-b0aa-365b65712b7f tempest-ProjectReaderTests-1134321651 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:58:56 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-2dea79d5-390e-42a1-b0aa-365b65712b7f tempest-ProjectReaderTests-1134321651 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:58:56 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-2dea79d5-390e-42a1-b0aa-365b65712b7f tempest-ProjectReaderTests-1134321651 None] Creating offline snapshot dfab1868-c81d-4be0-9194-bbf12f114f9c of volume 31dae76e-81f9-4cc8-97f5-6d470cab507f {{(pid=88899) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 03 08:58:56 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[d42dbd43-2596-4c6f-b497-43e45cdc43dc]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:58:56 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-2dea79d5-390e-42a1-b0aa-365b65712b7f tempest-ProjectReaderTests-1134321651 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-31dae76e-81f9-4cc8-97f5-6d470cab507f {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:58:56 devstack sudo[117184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-31dae76e-81f9-4cc8-97f5-6d470cab507f Aug 03 08:58:56 devstack sudo[117184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:58:57 devstack sudo[117184]: pam_unix(sudo:session): session closed for user root Aug 03 08:58:57 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-2dea79d5-390e-42a1-b0aa-365b65712b7f tempest-ProjectReaderTests-1134321651 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-31dae76e-81f9-4cc8-97f5-6d470cab507f" returned: 0 in 0.350s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:58:57 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-2dea79d5-390e-42a1-b0aa-365b65712b7f tempest-ProjectReaderTests-1134321651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-31dae76e-81f9-4cc8-97f5-6d470cab507f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-31dae76e-81f9-4cc8-97f5-6d470cab507f.dfab1868-c81d-4be0-9194-bbf12f114f9c 1G {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:58:57 devstack sudo[117189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-31dae76e-81f9-4cc8-97f5-6d470cab507f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-31dae76e-81f9-4cc8-97f5-6d470cab507f.dfab1868-c81d-4be0-9194-bbf12f114f9c 1G Aug 03 08:58:57 devstack sudo[117189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:58:57 devstack sudo[117189]: pam_unix(sudo:session): session closed for user root Aug 03 08:58:57 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-2dea79d5-390e-42a1-b0aa-365b65712b7f tempest-ProjectReaderTests-1134321651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-31dae76e-81f9-4cc8-97f5-6d470cab507f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-31dae76e-81f9-4cc8-97f5-6d470cab507f.dfab1868-c81d-4be0-9194-bbf12f114f9c 1G" returned: 0 in 0.375s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:58:57 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-2dea79d5-390e-42a1-b0aa-365b65712b7f tempest-ProjectReaderTests-1134321651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-31dae76e-81f9-4cc8-97f5-6d470cab507f -F qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-31dae76e-81f9-4cc8-97f5-6d470cab507f.dfab1868-c81d-4be0-9194-bbf12f114f9c {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:58:57 devstack sudo[117195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-31dae76e-81f9-4cc8-97f5-6d470cab507f -F qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-31dae76e-81f9-4cc8-97f5-6d470cab507f.dfab1868-c81d-4be0-9194-bbf12f114f9c Aug 03 08:58:57 devstack sudo[117195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:58:57 devstack sudo[117195]: pam_unix(sudo:session): session closed for user root Aug 03 08:58:57 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-2dea79d5-390e-42a1-b0aa-365b65712b7f tempest-ProjectReaderTests-1134321651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-31dae76e-81f9-4cc8-97f5-6d470cab507f -F qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-31dae76e-81f9-4cc8-97f5-6d470cab507f.dfab1868-c81d-4be0-9194-bbf12f114f9c" returned: 0 in 0.305s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:58:57 devstack cinder-volume[88899]: WARNING cinder.volume.drivers.remotefs [None req-2dea79d5-390e-42a1-b0aa-365b65712b7f tempest-ProjectReaderTests-1134321651 None] /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-31dae76e-81f9-4cc8-97f5-6d470cab507f.dfab1868-c81d-4be0-9194-bbf12f114f9c is being set with open permissions: ugo+rw Aug 03 08:58:57 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-2dea79d5-390e-42a1-b0aa-365b65712b7f tempest-ProjectReaderTests-1134321651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-31dae76e-81f9-4cc8-97f5-6d470cab507f.dfab1868-c81d-4be0-9194-bbf12f114f9c {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:58:57 devstack sudo[117200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-31dae76e-81f9-4cc8-97f5-6d470cab507f.dfab1868-c81d-4be0-9194-bbf12f114f9c Aug 03 08:58:57 devstack sudo[117200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:58:58 devstack sudo[117200]: pam_unix(sudo:session): session closed for user root Aug 03 08:58:58 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-2dea79d5-390e-42a1-b0aa-365b65712b7f tempest-ProjectReaderTests-1134321651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-31dae76e-81f9-4cc8-97f5-6d470cab507f.dfab1868-c81d-4be0-9194-bbf12f114f9c" returned: 0 in 0.233s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:58:58 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-2dea79d5-390e-42a1-b0aa-365b65712b7f tempest-ProjectReaderTests-1134321651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-31dae76e-81f9-4cc8-97f5-6d470cab507f.info {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:58:58 devstack sudo[117203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-31dae76e-81f9-4cc8-97f5-6d470cab507f.info Aug 03 08:58:58 devstack sudo[117203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:58:58 devstack sudo[117203]: pam_unix(sudo:session): session closed for user root Aug 03 08:58:58 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-2dea79d5-390e-42a1-b0aa-365b65712b7f tempest-ProjectReaderTests-1134321651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-31dae76e-81f9-4cc8-97f5-6d470cab507f.info" returned: 0 in 0.241s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:58:58 devstack cinder-volume[88899]: WARNING cinder.volume.drivers.remotefs [None req-2dea79d5-390e-42a1-b0aa-365b65712b7f tempest-ProjectReaderTests-1134321651 None] /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-31dae76e-81f9-4cc8-97f5-6d470cab507f.info is being set with open permissions: ugo+rw Aug 03 08:58:58 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-2dea79d5-390e-42a1-b0aa-365b65712b7f tempest-ProjectReaderTests-1134321651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-31dae76e-81f9-4cc8-97f5-6d470cab507f.info {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:58:58 devstack sudo[117206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-31dae76e-81f9-4cc8-97f5-6d470cab507f.info Aug 03 08:58:58 devstack sudo[117206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:58:58 devstack sudo[117206]: pam_unix(sudo:session): session closed for user root Aug 03 08:58:58 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-2dea79d5-390e-42a1-b0aa-365b65712b7f tempest-ProjectReaderTests-1134321651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-31dae76e-81f9-4cc8-97f5-6d470cab507f.info" returned: 0 in 0.229s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:58:58 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-2dea79d5-390e-42a1-b0aa-365b65712b7f tempest-ProjectReaderTests-1134321651 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.805s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:58:58 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-2dea79d5-390e-42a1-b0aa-365b65712b7f tempest-ProjectReaderTests-1134321651 None] Create snapshot completed successfully Aug 03 08:58:58 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-920f0d8e-b79f-4625-8ccc-94021e2941ca tempest-ProjectReaderTests-1134321651 None] Acquiring lock "cinder-dfab1868-c81d-4be0-9194-bbf12f114f9c-delete_snapshot" by "delete_snapshot" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:58:58 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-920f0d8e-b79f-4625-8ccc-94021e2941ca tempest-ProjectReaderTests-1134321651 None] Lock "cinder-dfab1868-c81d-4be0-9194-bbf12f114f9c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:58:58 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-920f0d8e-b79f-4625-8ccc-94021e2941ca tempest-ProjectReaderTests-1134321651 None] Acquiring lock "cinder-quobyte-31dae76e-81f9-4cc8-97f5-6d470cab507f" by "delete_snapshot" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:58:58 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-920f0d8e-b79f-4625-8ccc-94021e2941ca tempest-ProjectReaderTests-1134321651 None] Lock "cinder-quobyte-31dae76e-81f9-4cc8-97f5-6d470cab507f" acquired by "delete_snapshot" :: waited 0.014s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:58:58 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-920f0d8e-b79f-4625-8ccc-94021e2941ca tempest-ProjectReaderTests-1134321651 None] Acquiring lock "cinder-quobyte-dfab1868-c81d-4be0-9194-bbf12f114f9c" by "_delete_snapshot" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:58:58 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-920f0d8e-b79f-4625-8ccc-94021e2941ca tempest-ProjectReaderTests-1134321651 None] Lock "cinder-quobyte-dfab1868-c81d-4be0-9194-bbf12f114f9c" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:58:58 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-920f0d8e-b79f-4625-8ccc-94021e2941ca tempest-ProjectReaderTests-1134321651 None] Deleting offline snapshot dfab1868-c81d-4be0-9194-bbf12f114f9c of volume 31dae76e-81f9-4cc8-97f5-6d470cab507f {{(pid=88899) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 03 08:58:58 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-920f0d8e-b79f-4625-8ccc-94021e2941ca tempest-ProjectReaderTests-1134321651 None] snapshot_file for this snap is: volume-31dae76e-81f9-4cc8-97f5-6d470cab507f.dfab1868-c81d-4be0-9194-bbf12f114f9c {{(pid=88899) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 03 08:58:58 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9a469f0-49d7-4079-bc52-544d2fe6e0a6]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:58:58 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-920f0d8e-b79f-4625-8ccc-94021e2941ca tempest-ProjectReaderTests-1134321651 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-31dae76e-81f9-4cc8-97f5-6d470cab507f.dfab1868-c81d-4be0-9194-bbf12f114f9c {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:58:59 devstack sudo[117210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-31dae76e-81f9-4cc8-97f5-6d470cab507f.dfab1868-c81d-4be0-9194-bbf12f114f9c Aug 03 08:58:59 devstack sudo[117210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:58:59 devstack sudo[117210]: pam_unix(sudo:session): session closed for user root Aug 03 08:58:59 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-920f0d8e-b79f-4625-8ccc-94021e2941ca tempest-ProjectReaderTests-1134321651 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-31dae76e-81f9-4cc8-97f5-6d470cab507f.dfab1868-c81d-4be0-9194-bbf12f114f9c" returned: 0 in 0.350s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:58:59 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-920f0d8e-b79f-4625-8ccc-94021e2941ca tempest-ProjectReaderTests-1134321651 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-31dae76e-81f9-4cc8-97f5-6d470cab507f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88899) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 03 08:58:59 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[36dacd8d-cdf2-4b76-9703-3012448c77b7]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:58:59 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-920f0d8e-b79f-4625-8ccc-94021e2941ca tempest-ProjectReaderTests-1134321651 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-31dae76e-81f9-4cc8-97f5-6d470cab507f {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:58:59 devstack sudo[117215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-31dae76e-81f9-4cc8-97f5-6d470cab507f Aug 03 08:58:59 devstack sudo[117215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:58:59 devstack sudo[117215]: pam_unix(sudo:session): session closed for user root Aug 03 08:58:59 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-920f0d8e-b79f-4625-8ccc-94021e2941ca tempest-ProjectReaderTests-1134321651 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-31dae76e-81f9-4cc8-97f5-6d470cab507f" returned: 0 in 0.349s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:58:59 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-920f0d8e-b79f-4625-8ccc-94021e2941ca tempest-ProjectReaderTests-1134321651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-31dae76e-81f9-4cc8-97f5-6d470cab507f.dfab1868-c81d-4be0-9194-bbf12f114f9c {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:58:59 devstack sudo[117220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-31dae76e-81f9-4cc8-97f5-6d470cab507f.dfab1868-c81d-4be0-9194-bbf12f114f9c Aug 03 08:58:59 devstack sudo[117220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:59:00 devstack sudo[117220]: pam_unix(sudo:session): session closed for user root Aug 03 08:59:00 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-920f0d8e-b79f-4625-8ccc-94021e2941ca tempest-ProjectReaderTests-1134321651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-31dae76e-81f9-4cc8-97f5-6d470cab507f.dfab1868-c81d-4be0-9194-bbf12f114f9c" returned: 0 in 0.335s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:59:00 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-920f0d8e-b79f-4625-8ccc-94021e2941ca tempest-ProjectReaderTests-1134321651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-31dae76e-81f9-4cc8-97f5-6d470cab507f.dfab1868-c81d-4be0-9194-bbf12f114f9c {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:59:00 devstack sudo[117225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-31dae76e-81f9-4cc8-97f5-6d470cab507f.dfab1868-c81d-4be0-9194-bbf12f114f9c Aug 03 08:59:00 devstack sudo[117225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:59:00 devstack sudo[117225]: pam_unix(sudo:session): session closed for user root Aug 03 08:59:00 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-920f0d8e-b79f-4625-8ccc-94021e2941ca tempest-ProjectReaderTests-1134321651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-31dae76e-81f9-4cc8-97f5-6d470cab507f.dfab1868-c81d-4be0-9194-bbf12f114f9c" returned: 0 in 0.245s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:59:00 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-920f0d8e-b79f-4625-8ccc-94021e2941ca tempest-ProjectReaderTests-1134321651 None] Lock "cinder-quobyte-dfab1868-c81d-4be0-9194-bbf12f114f9c" released by "_delete_snapshot" :: held 1.364s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:59:00 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-920f0d8e-b79f-4625-8ccc-94021e2941ca tempest-ProjectReaderTests-1134321651 None] Lock "cinder-quobyte-31dae76e-81f9-4cc8-97f5-6d470cab507f" released by "delete_snapshot" :: held 1.386s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:59:00 devstack cinder-volume[88899]: DEBUG cinder.quota [None req-920f0d8e-b79f-4625-8ccc-94021e2941ca tempest-ProjectReaderTests-1134321651 None] Created reservations ['2bfb76cb-4c36-4ccc-92ee-746e1529c1e7', 'aba68d33-a77b-4100-beae-bf88750f7122', '39eaf54f-35cd-4ec9-8b75-a0e5f076491c', 'f6107fe1-3077-4e32-95bc-f93568d7f4a9'] {{(pid=88899) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 08:59:00 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-920f0d8e-b79f-4625-8ccc-94021e2941ca tempest-ProjectReaderTests-1134321651 None] Delete snapshot completed successfully. Aug 03 08:59:00 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-920f0d8e-b79f-4625-8ccc-94021e2941ca tempest-ProjectReaderTests-1134321651 None] Lock "cinder-dfab1868-c81d-4be0-9194-bbf12f114f9c-delete_snapshot" released by "delete_snapshot" :: held 1.524s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:59:01 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-92af726e-5fec-44fc-97ca-c4b421ba3667 tempest-ProjectReaderTests-1134321651 None] Acquiring lock "cinder-31dae76e-81f9-4cc8-97f5-6d470cab507f-delete_volume" by "delete_volume" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:59:01 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-92af726e-5fec-44fc-97ca-c4b421ba3667 tempest-ProjectReaderTests-1134321651 None] Lock "cinder-31dae76e-81f9-4cc8-97f5-6d470cab507f-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:59:01 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-92af726e-5fec-44fc-97ca-c4b421ba3667 tempest-ProjectReaderTests-1134321651 None] Acquiring lock "cinder-quobyte-31dae76e-81f9-4cc8-97f5-6d470cab507f" by "delete_volume" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:59:01 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-92af726e-5fec-44fc-97ca-c4b421ba3667 tempest-ProjectReaderTests-1134321651 None] Lock "cinder-quobyte-31dae76e-81f9-4cc8-97f5-6d470cab507f" acquired by "delete_volume" :: waited 0.014s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:59:01 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dd99e86-95b1-4663-8ed2-33ab0f897d30]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:59:01 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-92af726e-5fec-44fc-97ca-c4b421ba3667 tempest-ProjectReaderTests-1134321651 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-31dae76e-81f9-4cc8-97f5-6d470cab507f {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:59:01 devstack sudo[117228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-31dae76e-81f9-4cc8-97f5-6d470cab507f Aug 03 08:59:01 devstack sudo[117228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:59:01 devstack sudo[117228]: pam_unix(sudo:session): session closed for user root Aug 03 08:59:01 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-92af726e-5fec-44fc-97ca-c4b421ba3667 tempest-ProjectReaderTests-1134321651 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-31dae76e-81f9-4cc8-97f5-6d470cab507f" returned: 0 in 0.353s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:59:01 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-92af726e-5fec-44fc-97ca-c4b421ba3667 tempest-ProjectReaderTests-1134321651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-31dae76e-81f9-4cc8-97f5-6d470cab507f {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:59:01 devstack sudo[117233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-31dae76e-81f9-4cc8-97f5-6d470cab507f Aug 03 08:59:01 devstack sudo[117233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:59:01 devstack sudo[117233]: pam_unix(sudo:session): session closed for user root Aug 03 08:59:01 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-92af726e-5fec-44fc-97ca-c4b421ba3667 tempest-ProjectReaderTests-1134321651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-31dae76e-81f9-4cc8-97f5-6d470cab507f" returned: 0 in 0.230s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:59:01 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-92af726e-5fec-44fc-97ca-c4b421ba3667 tempest-ProjectReaderTests-1134321651 None] Lock "cinder-quobyte-31dae76e-81f9-4cc8-97f5-6d470cab507f" released by "delete_volume" :: held 0.656s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:59:01 devstack cinder-volume[88899]: DEBUG cinder.quota [None req-92af726e-5fec-44fc-97ca-c4b421ba3667 tempest-ProjectReaderTests-1134321651 None] Created reservations ['41dc6b2c-97cc-412d-8678-d4f2107bd159', 'bb985811-0101-49d0-8611-261254d123b9', 'a50eea31-f435-47e6-ba6c-5704d33cb9e6', 'd549094e-d087-4a2a-9cf3-e0dcf558e6f6'] {{(pid=88899) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 08:59:01 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-92af726e-5fec-44fc-97ca-c4b421ba3667 tempest-ProjectReaderTests-1134321651 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:59:01 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-92af726e-5fec-44fc-97ca-c4b421ba3667 tempest-ProjectReaderTests-1134321651 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:59:01 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-92af726e-5fec-44fc-97ca-c4b421ba3667 tempest-ProjectReaderTests-1134321651 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:59:01 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-92af726e-5fec-44fc-97ca-c4b421ba3667 tempest-ProjectReaderTests-1134321651 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:59:01 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-92af726e-5fec-44fc-97ca-c4b421ba3667 tempest-ProjectReaderTests-1134321651 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:59:01 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-92af726e-5fec-44fc-97ca-c4b421ba3667 tempest-ProjectReaderTests-1134321651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:59:01 devstack sudo[117236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a Aug 03 08:59:01 devstack sudo[117236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:59:02 devstack sudo[117236]: pam_unix(sudo:session): session closed for user root Aug 03 08:59:02 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-92af726e-5fec-44fc-97ca-c4b421ba3667 tempest-ProjectReaderTests-1134321651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a" returned: 0 in 0.236s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:59:02 devstack cinder-volume[88899]: DEBUG cinder.manager [None req-92af726e-5fec-44fc-97ca-c4b421ba3667 tempest-ProjectReaderTests-1134321651 None] Notifying Schedulers of capabilities ... {{(pid=88899) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 08:59:02 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-92af726e-5fec-44fc-97ca-c4b421ba3667 tempest-ProjectReaderTests-1134321651 None] Deleted volume successfully. Aug 03 08:59:02 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-92af726e-5fec-44fc-97ca-c4b421ba3667 tempest-ProjectReaderTests-1134321651 None] Lock "cinder-31dae76e-81f9-4cc8-97f5-6d470cab507f-delete_volume" released by "delete_volume" :: held 1.082s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:59:02 devstack cinder-volume[88899]: DEBUG cinder.volume.flows.manager.create_volume [None req-063f63cf-ced5-4904-b733-60959f7ab9c1 tempest-ProjectReaderTests-1134321651 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88899) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 08:59:02 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-063f63cf-ced5-4904-b733-60959f7ab9c1 tempest-ProjectReaderTests-1134321651 None] Flow 'volume_create_manager' (23bb8275-5221-4395-a9b9-423bb9eb2529) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:59:02 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-063f63cf-ced5-4904-b733-60959f7ab9c1 tempest-ProjectReaderTests-1134321651 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9be3420c-d82f-4c47-9dcd-603fa905a97f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:59:02 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-063f63cf-ced5-4904-b733-60959f7ab9c1 tempest-ProjectReaderTests-1134321651 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9be3420c-d82f-4c47-9dcd-603fa905a97f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:59:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1376042361',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=768d108c-83c1-4bd3-960b-238367cc765a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d1960effcf84b1d80da45b8e57d70f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:59:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:59:03Z,use_quota=True,user_id='552bc37e3b5740afaa307554a5a6c75f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8bde7129-1dc4-42ab-b852-ab32c61b4921),volume_type_id=8bde7129-1dc4-42ab-b852-ab32c61b4921)' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:59:02 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-063f63cf-ced5-4904-b733-60959f7ab9c1 tempest-ProjectReaderTests-1134321651 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db738aa5-8a88-4e84-81b6-6429882c7110) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:59:02 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-063f63cf-ced5-4904-b733-60959f7ab9c1 tempest-ProjectReaderTests-1134321651 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db738aa5-8a88-4e84-81b6-6429882c7110) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:59:02 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-063f63cf-ced5-4904-b733-60959f7ab9c1 tempest-ProjectReaderTests-1134321651 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b2f97db9-2804-4849-9c7b-aa28206b8e6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:59:02 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-063f63cf-ced5-4904-b733-60959f7ab9c1 tempest-ProjectReaderTests-1134321651 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b2f97db9-2804-4849-9c7b-aa28206b8e6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '768d108c-83c1-4bd3-960b-238367cc765a', 'volume_name': 'volume-768d108c-83c1-4bd3-960b-238367cc765a', 'volume_size': 1}' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:59:02 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-063f63cf-ced5-4904-b733-60959f7ab9c1 tempest-ProjectReaderTests-1134321651 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6bb6c49-5e3b-4888-9c19-09a88c26ad7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:59:02 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-063f63cf-ced5-4904-b733-60959f7ab9c1 tempest-ProjectReaderTests-1134321651 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6bb6c49-5e3b-4888-9c19-09a88c26ad7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:59:02 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-063f63cf-ced5-4904-b733-60959f7ab9c1 tempest-ProjectReaderTests-1134321651 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f85abf92-a7b4-4149-b846-5842a284be60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:59:02 devstack cinder-volume[88899]: INFO cinder.volume.flows.manager.create_volume [None req-063f63cf-ced5-4904-b733-60959f7ab9c1 tempest-ProjectReaderTests-1134321651 None] Volume 768d108c-83c1-4bd3-960b-238367cc765a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-768d108c-83c1-4bd3-960b-238367cc765a', 'volume_size': 1} Aug 03 08:59:02 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-063f63cf-ced5-4904-b733-60959f7ab9c1 tempest-ProjectReaderTests-1134321651 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:59:02 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-063f63cf-ced5-4904-b733-60959f7ab9c1 tempest-ProjectReaderTests-1134321651 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:59:02 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-063f63cf-ced5-4904-b733-60959f7ab9c1 tempest-ProjectReaderTests-1134321651 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:59:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1376042361',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=768d108c-83c1-4bd3-960b-238367cc765a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d1960effcf84b1d80da45b8e57d70f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:59:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:59:03Z,use_quota=True,user_id='552bc37e3b5740afaa307554a5a6c75f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8bde7129-1dc4-42ab-b852-ab32c61b4921),volume_type_id=8bde7129-1dc4-42ab-b852-ab32c61b4921)}" {{(pid=88899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 08:59:02 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-063f63cf-ced5-4904-b733-60959f7ab9c1 tempest-ProjectReaderTests-1134321651 None] Creating volume 768d108c-83c1-4bd3-960b-238367cc765a {{(pid=88899) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 08:59:02 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-063f63cf-ced5-4904-b733-60959f7ab9c1 tempest-ProjectReaderTests-1134321651 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:59:02 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-063f63cf-ced5-4904-b733-60959f7ab9c1 tempest-ProjectReaderTests-1134321651 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:59:02 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-063f63cf-ced5-4904-b733-60959f7ab9c1 tempest-ProjectReaderTests-1134321651 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:59:02 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-063f63cf-ced5-4904-b733-60959f7ab9c1 tempest-ProjectReaderTests-1134321651 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:59:02 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-063f63cf-ced5-4904-b733-60959f7ab9c1 tempest-ProjectReaderTests-1134321651 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:59:02 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-063f63cf-ced5-4904-b733-60959f7ab9c1 tempest-ProjectReaderTests-1134321651 None] Selected osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385 as target Quobyte volume. {{(pid=88899) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 08:59:02 devstack cinder-volume[88899]: INFO cinder.volume.drivers.remotefs [None req-063f63cf-ced5-4904-b733-60959f7ab9c1 tempest-ProjectReaderTests-1134321651 None] casted to osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385 Aug 03 08:59:02 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-063f63cf-ced5-4904-b733-60959f7ab9c1 tempest-ProjectReaderTests-1134321651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-768d108c-83c1-4bd3-960b-238367cc765a 1073741824 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:59:02 devstack sudo[117239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-768d108c-83c1-4bd3-960b-238367cc765a 1073741824 Aug 03 08:59:02 devstack sudo[117239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:59:03 devstack sudo[117239]: pam_unix(sudo:session): session closed for user root Aug 03 08:59:03 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-063f63cf-ced5-4904-b733-60959f7ab9c1 tempest-ProjectReaderTests-1134321651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-768d108c-83c1-4bd3-960b-238367cc765a 1073741824" returned: 0 in 0.461s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:59:03 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-063f63cf-ced5-4904-b733-60959f7ab9c1 tempest-ProjectReaderTests-1134321651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-768d108c-83c1-4bd3-960b-238367cc765a {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:59:03 devstack sudo[117244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-768d108c-83c1-4bd3-960b-238367cc765a Aug 03 08:59:03 devstack sudo[117244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:59:03 devstack sudo[117244]: pam_unix(sudo:session): session closed for user root Aug 03 08:59:03 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-063f63cf-ced5-4904-b733-60959f7ab9c1 tempest-ProjectReaderTests-1134321651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-768d108c-83c1-4bd3-960b-238367cc765a" returned: 0 in 0.258s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:59:03 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-063f63cf-ced5-4904-b733-60959f7ab9c1 tempest-ProjectReaderTests-1134321651 None] <== create_volume: return (768ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'} {{(pid=88899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 08:59:03 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-063f63cf-ced5-4904-b733-60959f7ab9c1 tempest-ProjectReaderTests-1134321651 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.771s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:59:03 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-063f63cf-ced5-4904-b733-60959f7ab9c1 tempest-ProjectReaderTests-1134321651 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f85abf92-a7b4-4149-b846-5842a284be60) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-768d108c-83c1-4bd3-960b-238367cc765a', 'volume_size': 1}' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:59:03 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-063f63cf-ced5-4904-b733-60959f7ab9c1 tempest-ProjectReaderTests-1134321651 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13c1e087-f48e-4402-b9f8-9b54be0adb07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:59:03 devstack cinder-volume[88899]: INFO cinder.volume.flows.manager.create_volume [None req-063f63cf-ced5-4904-b733-60959f7ab9c1 tempest-ProjectReaderTests-1134321651 None] Volume volume-768d108c-83c1-4bd3-960b-238367cc765a (768d108c-83c1-4bd3-960b-238367cc765a): created successfully Aug 03 08:59:03 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-063f63cf-ced5-4904-b733-60959f7ab9c1 tempest-ProjectReaderTests-1134321651 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13c1e087-f48e-4402-b9f8-9b54be0adb07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:59:03 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-063f63cf-ced5-4904-b733-60959f7ab9c1 tempest-ProjectReaderTests-1134321651 None] Flow 'volume_create_manager' (23bb8275-5221-4395-a9b9-423bb9eb2529) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:59:03 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-063f63cf-ced5-4904-b733-60959f7ab9c1 tempest-ProjectReaderTests-1134321651 None] Created volume successfully. Aug 03 08:59:03 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-dc1c101f-02ad-4792-b188-276733b2cc60 tempest-ProjectReaderTests-1134321651 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:59:03 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-dc1c101f-02ad-4792-b188-276733b2cc60 tempest-ProjectReaderTests-1134321651 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:59:03 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-dc1c101f-02ad-4792-b188-276733b2cc60 tempest-ProjectReaderTests-1134321651 None] Creating offline snapshot 2c8d4877-a2c3-4f37-ae17-100f9a53a2c6 of volume 768d108c-83c1-4bd3-960b-238367cc765a {{(pid=88899) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 03 08:59:03 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ea8288d-7d53-4a3f-96ad-4c4a6c08eb35]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:59:03 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-dc1c101f-02ad-4792-b188-276733b2cc60 tempest-ProjectReaderTests-1134321651 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-768d108c-83c1-4bd3-960b-238367cc765a {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:59:03 devstack sudo[117247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-768d108c-83c1-4bd3-960b-238367cc765a Aug 03 08:59:03 devstack sudo[117247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:59:04 devstack sudo[117247]: pam_unix(sudo:session): session closed for user root Aug 03 08:59:04 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-dc1c101f-02ad-4792-b188-276733b2cc60 tempest-ProjectReaderTests-1134321651 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-768d108c-83c1-4bd3-960b-238367cc765a" returned: 0 in 0.356s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:59:04 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-dc1c101f-02ad-4792-b188-276733b2cc60 tempest-ProjectReaderTests-1134321651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-768d108c-83c1-4bd3-960b-238367cc765a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-768d108c-83c1-4bd3-960b-238367cc765a.2c8d4877-a2c3-4f37-ae17-100f9a53a2c6 1G {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:59:04 devstack sudo[117252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-768d108c-83c1-4bd3-960b-238367cc765a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-768d108c-83c1-4bd3-960b-238367cc765a.2c8d4877-a2c3-4f37-ae17-100f9a53a2c6 1G Aug 03 08:59:04 devstack sudo[117252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:59:04 devstack sudo[117252]: pam_unix(sudo:session): session closed for user root Aug 03 08:59:04 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-dc1c101f-02ad-4792-b188-276733b2cc60 tempest-ProjectReaderTests-1134321651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-768d108c-83c1-4bd3-960b-238367cc765a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-768d108c-83c1-4bd3-960b-238367cc765a.2c8d4877-a2c3-4f37-ae17-100f9a53a2c6 1G" returned: 0 in 0.480s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:59:04 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-dc1c101f-02ad-4792-b188-276733b2cc60 tempest-ProjectReaderTests-1134321651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-768d108c-83c1-4bd3-960b-238367cc765a -F qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-768d108c-83c1-4bd3-960b-238367cc765a.2c8d4877-a2c3-4f37-ae17-100f9a53a2c6 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:59:04 devstack sudo[117260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-768d108c-83c1-4bd3-960b-238367cc765a -F qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-768d108c-83c1-4bd3-960b-238367cc765a.2c8d4877-a2c3-4f37-ae17-100f9a53a2c6 Aug 03 08:59:04 devstack sudo[117260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:59:04 devstack sudo[117260]: pam_unix(sudo:session): session closed for user root Aug 03 08:59:04 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-dc1c101f-02ad-4792-b188-276733b2cc60 tempest-ProjectReaderTests-1134321651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-768d108c-83c1-4bd3-960b-238367cc765a -F qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-768d108c-83c1-4bd3-960b-238367cc765a.2c8d4877-a2c3-4f37-ae17-100f9a53a2c6" returned: 0 in 0.286s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:59:04 devstack cinder-volume[88899]: WARNING cinder.volume.drivers.remotefs [None req-dc1c101f-02ad-4792-b188-276733b2cc60 tempest-ProjectReaderTests-1134321651 None] /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-768d108c-83c1-4bd3-960b-238367cc765a.2c8d4877-a2c3-4f37-ae17-100f9a53a2c6 is being set with open permissions: ugo+rw Aug 03 08:59:04 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-dc1c101f-02ad-4792-b188-276733b2cc60 tempest-ProjectReaderTests-1134321651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-768d108c-83c1-4bd3-960b-238367cc765a.2c8d4877-a2c3-4f37-ae17-100f9a53a2c6 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:59:04 devstack sudo[117266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-768d108c-83c1-4bd3-960b-238367cc765a.2c8d4877-a2c3-4f37-ae17-100f9a53a2c6 Aug 03 08:59:04 devstack sudo[117266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:59:05 devstack sudo[117266]: pam_unix(sudo:session): session closed for user root Aug 03 08:59:05 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-dc1c101f-02ad-4792-b188-276733b2cc60 tempest-ProjectReaderTests-1134321651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-768d108c-83c1-4bd3-960b-238367cc765a.2c8d4877-a2c3-4f37-ae17-100f9a53a2c6" returned: 0 in 0.238s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:59:05 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-dc1c101f-02ad-4792-b188-276733b2cc60 tempest-ProjectReaderTests-1134321651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-768d108c-83c1-4bd3-960b-238367cc765a.info {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:59:05 devstack sudo[117269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-768d108c-83c1-4bd3-960b-238367cc765a.info Aug 03 08:59:05 devstack sudo[117269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:59:05 devstack sudo[117269]: pam_unix(sudo:session): session closed for user root Aug 03 08:59:05 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-dc1c101f-02ad-4792-b188-276733b2cc60 tempest-ProjectReaderTests-1134321651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-768d108c-83c1-4bd3-960b-238367cc765a.info" returned: 0 in 0.250s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:59:05 devstack cinder-volume[88899]: WARNING cinder.volume.drivers.remotefs [None req-dc1c101f-02ad-4792-b188-276733b2cc60 tempest-ProjectReaderTests-1134321651 None] /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-768d108c-83c1-4bd3-960b-238367cc765a.info is being set with open permissions: ugo+rw Aug 03 08:59:05 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-dc1c101f-02ad-4792-b188-276733b2cc60 tempest-ProjectReaderTests-1134321651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-768d108c-83c1-4bd3-960b-238367cc765a.info {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:59:05 devstack sudo[117272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-768d108c-83c1-4bd3-960b-238367cc765a.info Aug 03 08:59:05 devstack sudo[117272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:59:05 devstack sudo[117272]: pam_unix(sudo:session): session closed for user root Aug 03 08:59:05 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-dc1c101f-02ad-4792-b188-276733b2cc60 tempest-ProjectReaderTests-1134321651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-768d108c-83c1-4bd3-960b-238367cc765a.info" returned: 0 in 0.230s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:59:05 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-dc1c101f-02ad-4792-b188-276733b2cc60 tempest-ProjectReaderTests-1134321651 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.923s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:59:05 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-dc1c101f-02ad-4792-b188-276733b2cc60 tempest-ProjectReaderTests-1134321651 None] Create snapshot completed successfully Aug 03 08:59:05 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-4f7ef724-8f9d-44a8-9778-8c9f41aa4702 tempest-ProjectReaderTests-1134321651 None] Acquiring lock "cinder-2c8d4877-a2c3-4f37-ae17-100f9a53a2c6-delete_snapshot" by "delete_snapshot" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:59:05 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-4f7ef724-8f9d-44a8-9778-8c9f41aa4702 tempest-ProjectReaderTests-1134321651 None] Lock "cinder-2c8d4877-a2c3-4f37-ae17-100f9a53a2c6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:59:05 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-4f7ef724-8f9d-44a8-9778-8c9f41aa4702 tempest-ProjectReaderTests-1134321651 None] Acquiring lock "cinder-quobyte-768d108c-83c1-4bd3-960b-238367cc765a" by "delete_snapshot" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:59:05 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-4f7ef724-8f9d-44a8-9778-8c9f41aa4702 tempest-ProjectReaderTests-1134321651 None] Lock "cinder-quobyte-768d108c-83c1-4bd3-960b-238367cc765a" acquired by "delete_snapshot" :: waited 0.016s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:59:05 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-4f7ef724-8f9d-44a8-9778-8c9f41aa4702 tempest-ProjectReaderTests-1134321651 None] Acquiring lock "cinder-quobyte-2c8d4877-a2c3-4f37-ae17-100f9a53a2c6" by "_delete_snapshot" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:59:05 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-4f7ef724-8f9d-44a8-9778-8c9f41aa4702 tempest-ProjectReaderTests-1134321651 None] Lock "cinder-quobyte-2c8d4877-a2c3-4f37-ae17-100f9a53a2c6" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:59:05 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-4f7ef724-8f9d-44a8-9778-8c9f41aa4702 tempest-ProjectReaderTests-1134321651 None] Deleting offline snapshot 2c8d4877-a2c3-4f37-ae17-100f9a53a2c6 of volume 768d108c-83c1-4bd3-960b-238367cc765a {{(pid=88899) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 03 08:59:06 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-4f7ef724-8f9d-44a8-9778-8c9f41aa4702 tempest-ProjectReaderTests-1134321651 None] snapshot_file for this snap is: volume-768d108c-83c1-4bd3-960b-238367cc765a.2c8d4877-a2c3-4f37-ae17-100f9a53a2c6 {{(pid=88899) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 03 08:59:06 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[5caf6d59-df08-42ca-80a4-03887665e7ab]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:59:06 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-4f7ef724-8f9d-44a8-9778-8c9f41aa4702 tempest-ProjectReaderTests-1134321651 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-768d108c-83c1-4bd3-960b-238367cc765a.2c8d4877-a2c3-4f37-ae17-100f9a53a2c6 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:59:06 devstack sudo[117275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-768d108c-83c1-4bd3-960b-238367cc765a.2c8d4877-a2c3-4f37-ae17-100f9a53a2c6 Aug 03 08:59:06 devstack sudo[117275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:59:06 devstack sudo[117275]: pam_unix(sudo:session): session closed for user root Aug 03 08:59:06 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-4f7ef724-8f9d-44a8-9778-8c9f41aa4702 tempest-ProjectReaderTests-1134321651 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-768d108c-83c1-4bd3-960b-238367cc765a.2c8d4877-a2c3-4f37-ae17-100f9a53a2c6" returned: 0 in 0.365s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:59:06 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-4f7ef724-8f9d-44a8-9778-8c9f41aa4702 tempest-ProjectReaderTests-1134321651 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-768d108c-83c1-4bd3-960b-238367cc765a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88899) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 03 08:59:06 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[3878afdb-b46e-496e-8b89-b819d0a9ee6e]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:59:06 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-4f7ef724-8f9d-44a8-9778-8c9f41aa4702 tempest-ProjectReaderTests-1134321651 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-768d108c-83c1-4bd3-960b-238367cc765a {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:59:06 devstack sudo[117280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-768d108c-83c1-4bd3-960b-238367cc765a Aug 03 08:59:06 devstack sudo[117280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:59:06 devstack sudo[117280]: pam_unix(sudo:session): session closed for user root Aug 03 08:59:06 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-4f7ef724-8f9d-44a8-9778-8c9f41aa4702 tempest-ProjectReaderTests-1134321651 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-768d108c-83c1-4bd3-960b-238367cc765a" returned: 0 in 0.361s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:59:06 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-4f7ef724-8f9d-44a8-9778-8c9f41aa4702 tempest-ProjectReaderTests-1134321651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-768d108c-83c1-4bd3-960b-238367cc765a.2c8d4877-a2c3-4f37-ae17-100f9a53a2c6 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:59:06 devstack sudo[117285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-768d108c-83c1-4bd3-960b-238367cc765a.2c8d4877-a2c3-4f37-ae17-100f9a53a2c6 Aug 03 08:59:06 devstack sudo[117285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:59:07 devstack sudo[117285]: pam_unix(sudo:session): session closed for user root Aug 03 08:59:07 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-4f7ef724-8f9d-44a8-9778-8c9f41aa4702 tempest-ProjectReaderTests-1134321651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-768d108c-83c1-4bd3-960b-238367cc765a.2c8d4877-a2c3-4f37-ae17-100f9a53a2c6" returned: 0 in 0.326s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:59:07 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-4f7ef724-8f9d-44a8-9778-8c9f41aa4702 tempest-ProjectReaderTests-1134321651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-768d108c-83c1-4bd3-960b-238367cc765a.2c8d4877-a2c3-4f37-ae17-100f9a53a2c6 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:59:07 devstack sudo[117290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-768d108c-83c1-4bd3-960b-238367cc765a.2c8d4877-a2c3-4f37-ae17-100f9a53a2c6 Aug 03 08:59:07 devstack sudo[117290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:59:07 devstack sudo[117290]: pam_unix(sudo:session): session closed for user root Aug 03 08:59:07 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-4f7ef724-8f9d-44a8-9778-8c9f41aa4702 tempest-ProjectReaderTests-1134321651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-768d108c-83c1-4bd3-960b-238367cc765a.2c8d4877-a2c3-4f37-ae17-100f9a53a2c6" returned: 0 in 0.233s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:59:07 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-4f7ef724-8f9d-44a8-9778-8c9f41aa4702 tempest-ProjectReaderTests-1134321651 None] Lock "cinder-quobyte-2c8d4877-a2c3-4f37-ae17-100f9a53a2c6" released by "_delete_snapshot" :: held 1.376s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:59:07 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-4f7ef724-8f9d-44a8-9778-8c9f41aa4702 tempest-ProjectReaderTests-1134321651 None] Lock "cinder-quobyte-768d108c-83c1-4bd3-960b-238367cc765a" released by "delete_snapshot" :: held 1.402s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:59:07 devstack cinder-volume[88899]: DEBUG cinder.quota [None req-4f7ef724-8f9d-44a8-9778-8c9f41aa4702 tempest-ProjectReaderTests-1134321651 None] Created reservations ['942b819c-6d6f-42c4-80da-6b066deed242', '7304683d-b148-4be1-aa4c-042ca20f30d7', '286fa43d-8485-4775-8684-b886ac56940b', '8b878881-7bac-43e5-bc7f-3eb9c4fccb6a'] {{(pid=88899) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 08:59:07 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-4f7ef724-8f9d-44a8-9778-8c9f41aa4702 tempest-ProjectReaderTests-1134321651 None] Delete snapshot completed successfully. Aug 03 08:59:07 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-4f7ef724-8f9d-44a8-9778-8c9f41aa4702 tempest-ProjectReaderTests-1134321651 None] Lock "cinder-2c8d4877-a2c3-4f37-ae17-100f9a53a2c6-delete_snapshot" released by "delete_snapshot" :: held 1.539s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:59:08 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-9f2f69f6-787c-465e-b368-20a8e185a1a8 tempest-ProjectReaderTests-1134321651 None] Acquiring lock "cinder-768d108c-83c1-4bd3-960b-238367cc765a-delete_volume" by "delete_volume" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:59:08 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-9f2f69f6-787c-465e-b368-20a8e185a1a8 tempest-ProjectReaderTests-1134321651 None] Lock "cinder-768d108c-83c1-4bd3-960b-238367cc765a-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:59:08 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-9f2f69f6-787c-465e-b368-20a8e185a1a8 tempest-ProjectReaderTests-1134321651 None] Acquiring lock "cinder-quobyte-768d108c-83c1-4bd3-960b-238367cc765a" by "delete_volume" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:59:08 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-9f2f69f6-787c-465e-b368-20a8e185a1a8 tempest-ProjectReaderTests-1134321651 None] Lock "cinder-quobyte-768d108c-83c1-4bd3-960b-238367cc765a" acquired by "delete_volume" :: waited 0.017s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:59:08 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[693a60d7-a831-4144-83c1-bddf6664ab06]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:59:08 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-9f2f69f6-787c-465e-b368-20a8e185a1a8 tempest-ProjectReaderTests-1134321651 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-768d108c-83c1-4bd3-960b-238367cc765a {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:59:08 devstack sudo[117293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-768d108c-83c1-4bd3-960b-238367cc765a Aug 03 08:59:08 devstack sudo[117293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:59:08 devstack sudo[117293]: pam_unix(sudo:session): session closed for user root Aug 03 08:59:08 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-9f2f69f6-787c-465e-b368-20a8e185a1a8 tempest-ProjectReaderTests-1134321651 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-768d108c-83c1-4bd3-960b-238367cc765a" returned: 0 in 0.353s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:59:08 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-9f2f69f6-787c-465e-b368-20a8e185a1a8 tempest-ProjectReaderTests-1134321651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-768d108c-83c1-4bd3-960b-238367cc765a {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:59:08 devstack sudo[117298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-768d108c-83c1-4bd3-960b-238367cc765a Aug 03 08:59:08 devstack sudo[117298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:59:08 devstack sudo[117298]: pam_unix(sudo:session): session closed for user root Aug 03 08:59:08 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-9f2f69f6-787c-465e-b368-20a8e185a1a8 tempest-ProjectReaderTests-1134321651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-768d108c-83c1-4bd3-960b-238367cc765a" returned: 0 in 0.231s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:59:08 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-9f2f69f6-787c-465e-b368-20a8e185a1a8 tempest-ProjectReaderTests-1134321651 None] Lock "cinder-quobyte-768d108c-83c1-4bd3-960b-238367cc765a" released by "delete_volume" :: held 0.643s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:59:08 devstack cinder-volume[88899]: DEBUG cinder.quota [None req-9f2f69f6-787c-465e-b368-20a8e185a1a8 tempest-ProjectReaderTests-1134321651 None] Created reservations ['c10ad28a-dcef-4800-b176-15dc1d6a0906', '005d8b84-813c-4e1b-9fae-3c962d988a9c', '2c10d8c0-500b-4989-b45e-3b8cc636eeba', '0dd6315d-3cd6-4edd-8f00-653dfb36ea77'] {{(pid=88899) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 08:59:08 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-9f2f69f6-787c-465e-b368-20a8e185a1a8 tempest-ProjectReaderTests-1134321651 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:59:08 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-9f2f69f6-787c-465e-b368-20a8e185a1a8 tempest-ProjectReaderTests-1134321651 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:59:08 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-9f2f69f6-787c-465e-b368-20a8e185a1a8 tempest-ProjectReaderTests-1134321651 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:59:08 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-9f2f69f6-787c-465e-b368-20a8e185a1a8 tempest-ProjectReaderTests-1134321651 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:59:08 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-9f2f69f6-787c-465e-b368-20a8e185a1a8 tempest-ProjectReaderTests-1134321651 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:59:08 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-9f2f69f6-787c-465e-b368-20a8e185a1a8 tempest-ProjectReaderTests-1134321651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:59:08 devstack sudo[117302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a Aug 03 08:59:08 devstack sudo[117302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:59:09 devstack sudo[117302]: pam_unix(sudo:session): session closed for user root Aug 03 08:59:09 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-9f2f69f6-787c-465e-b368-20a8e185a1a8 tempest-ProjectReaderTests-1134321651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a" returned: 0 in 0.242s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:59:09 devstack cinder-volume[88899]: DEBUG cinder.manager [None req-9f2f69f6-787c-465e-b368-20a8e185a1a8 tempest-ProjectReaderTests-1134321651 None] Notifying Schedulers of capabilities ... {{(pid=88899) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 08:59:09 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-9f2f69f6-787c-465e-b368-20a8e185a1a8 tempest-ProjectReaderTests-1134321651 None] Deleted volume successfully. Aug 03 08:59:09 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-9f2f69f6-787c-465e-b368-20a8e185a1a8 tempest-ProjectReaderTests-1134321651 None] Lock "cinder-768d108c-83c1-4bd3-960b-238367cc765a-delete_volume" released by "delete_volume" :: held 1.091s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:59:09 devstack cinder-volume[88899]: DEBUG cinder.volume.flows.manager.create_volume [None req-33dca63b-7b78-4762-b185-4ba0a50fc11d tempest-ProjectReaderTests-1134321651 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88899) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 08:59:09 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-33dca63b-7b78-4762-b185-4ba0a50fc11d tempest-ProjectReaderTests-1134321651 None] Flow 'volume_create_manager' (c60d3ed6-33c4-44ec-84f1-dd2fca48b78d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:59:09 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-33dca63b-7b78-4762-b185-4ba0a50fc11d tempest-ProjectReaderTests-1134321651 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (39e9f568-20a5-4e35-8579-8feae46669c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:59:09 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-33dca63b-7b78-4762-b185-4ba0a50fc11d tempest-ProjectReaderTests-1134321651 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (39e9f568-20a5-4e35-8579-8feae46669c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:59:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2026401814',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d4a29ceb-c874-4828-b48c-1781fcd28852,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d1960effcf84b1d80da45b8e57d70f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:59:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:59:10Z,use_quota=True,user_id='552bc37e3b5740afaa307554a5a6c75f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8bde7129-1dc4-42ab-b852-ab32c61b4921),volume_type_id=8bde7129-1dc4-42ab-b852-ab32c61b4921)' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:59:09 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-33dca63b-7b78-4762-b185-4ba0a50fc11d tempest-ProjectReaderTests-1134321651 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (60013ab6-2f4a-4cce-8d40-b59a689d4381) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:59:09 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-33dca63b-7b78-4762-b185-4ba0a50fc11d tempest-ProjectReaderTests-1134321651 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (60013ab6-2f4a-4cce-8d40-b59a689d4381) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:59:09 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-33dca63b-7b78-4762-b185-4ba0a50fc11d tempest-ProjectReaderTests-1134321651 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fed8c84b-72b8-4a8d-90ef-93620d46037c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:59:09 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-33dca63b-7b78-4762-b185-4ba0a50fc11d tempest-ProjectReaderTests-1134321651 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fed8c84b-72b8-4a8d-90ef-93620d46037c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd4a29ceb-c874-4828-b48c-1781fcd28852', 'volume_name': 'volume-d4a29ceb-c874-4828-b48c-1781fcd28852', 'volume_size': 1}' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:59:09 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-33dca63b-7b78-4762-b185-4ba0a50fc11d tempest-ProjectReaderTests-1134321651 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (659469b3-aaa3-4d70-9302-eeb20b2f817e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:59:09 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-33dca63b-7b78-4762-b185-4ba0a50fc11d tempest-ProjectReaderTests-1134321651 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (659469b3-aaa3-4d70-9302-eeb20b2f817e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:59:09 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-33dca63b-7b78-4762-b185-4ba0a50fc11d tempest-ProjectReaderTests-1134321651 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4de0adfa-6bc1-4c1f-84cb-e329e1393767) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:59:09 devstack cinder-volume[88899]: INFO cinder.volume.flows.manager.create_volume [None req-33dca63b-7b78-4762-b185-4ba0a50fc11d tempest-ProjectReaderTests-1134321651 None] Volume d4a29ceb-c874-4828-b48c-1781fcd28852: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d4a29ceb-c874-4828-b48c-1781fcd28852', 'volume_size': 1} Aug 03 08:59:09 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-33dca63b-7b78-4762-b185-4ba0a50fc11d tempest-ProjectReaderTests-1134321651 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:59:09 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-33dca63b-7b78-4762-b185-4ba0a50fc11d tempest-ProjectReaderTests-1134321651 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:59:09 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-33dca63b-7b78-4762-b185-4ba0a50fc11d tempest-ProjectReaderTests-1134321651 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:59:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2026401814',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d4a29ceb-c874-4828-b48c-1781fcd28852,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d1960effcf84b1d80da45b8e57d70f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:59:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:59:10Z,use_quota=True,user_id='552bc37e3b5740afaa307554a5a6c75f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8bde7129-1dc4-42ab-b852-ab32c61b4921),volume_type_id=8bde7129-1dc4-42ab-b852-ab32c61b4921)}" {{(pid=88899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 08:59:09 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-33dca63b-7b78-4762-b185-4ba0a50fc11d tempest-ProjectReaderTests-1134321651 None] Creating volume d4a29ceb-c874-4828-b48c-1781fcd28852 {{(pid=88899) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 08:59:09 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-33dca63b-7b78-4762-b185-4ba0a50fc11d tempest-ProjectReaderTests-1134321651 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:59:09 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-33dca63b-7b78-4762-b185-4ba0a50fc11d tempest-ProjectReaderTests-1134321651 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:59:09 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-33dca63b-7b78-4762-b185-4ba0a50fc11d tempest-ProjectReaderTests-1134321651 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:59:09 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-33dca63b-7b78-4762-b185-4ba0a50fc11d tempest-ProjectReaderTests-1134321651 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:59:09 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-33dca63b-7b78-4762-b185-4ba0a50fc11d tempest-ProjectReaderTests-1134321651 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:59:09 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-33dca63b-7b78-4762-b185-4ba0a50fc11d tempest-ProjectReaderTests-1134321651 None] Selected osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385 as target Quobyte volume. {{(pid=88899) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 08:59:09 devstack cinder-volume[88899]: INFO cinder.volume.drivers.remotefs [None req-33dca63b-7b78-4762-b185-4ba0a50fc11d tempest-ProjectReaderTests-1134321651 None] casted to osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385 Aug 03 08:59:09 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-33dca63b-7b78-4762-b185-4ba0a50fc11d tempest-ProjectReaderTests-1134321651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-d4a29ceb-c874-4828-b48c-1781fcd28852 1073741824 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:59:09 devstack sudo[117305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-d4a29ceb-c874-4828-b48c-1781fcd28852 1073741824 Aug 03 08:59:09 devstack sudo[117305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:59:10 devstack sudo[117305]: pam_unix(sudo:session): session closed for user root Aug 03 08:59:10 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-33dca63b-7b78-4762-b185-4ba0a50fc11d tempest-ProjectReaderTests-1134321651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-d4a29ceb-c874-4828-b48c-1781fcd28852 1073741824" returned: 0 in 0.397s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:59:10 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-33dca63b-7b78-4762-b185-4ba0a50fc11d tempest-ProjectReaderTests-1134321651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-d4a29ceb-c874-4828-b48c-1781fcd28852 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:59:10 devstack sudo[117347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-d4a29ceb-c874-4828-b48c-1781fcd28852 Aug 03 08:59:10 devstack sudo[117347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:59:10 devstack sudo[117347]: pam_unix(sudo:session): session closed for user root Aug 03 08:59:10 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-33dca63b-7b78-4762-b185-4ba0a50fc11d tempest-ProjectReaderTests-1134321651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-d4a29ceb-c874-4828-b48c-1781fcd28852" returned: 0 in 0.248s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:59:10 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-33dca63b-7b78-4762-b185-4ba0a50fc11d tempest-ProjectReaderTests-1134321651 None] <== create_volume: return (688ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'} {{(pid=88899) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 08:59:10 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-33dca63b-7b78-4762-b185-4ba0a50fc11d tempest-ProjectReaderTests-1134321651 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.692s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:59:10 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-33dca63b-7b78-4762-b185-4ba0a50fc11d tempest-ProjectReaderTests-1134321651 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4de0adfa-6bc1-4c1f-84cb-e329e1393767) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d4a29ceb-c874-4828-b48c-1781fcd28852', 'volume_size': 1}' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:59:10 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-33dca63b-7b78-4762-b185-4ba0a50fc11d tempest-ProjectReaderTests-1134321651 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60b7cd98-97db-44c8-bcd8-2632df709fb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:59:10 devstack cinder-volume[88899]: INFO cinder.volume.flows.manager.create_volume [None req-33dca63b-7b78-4762-b185-4ba0a50fc11d tempest-ProjectReaderTests-1134321651 None] Volume volume-d4a29ceb-c874-4828-b48c-1781fcd28852 (d4a29ceb-c874-4828-b48c-1781fcd28852): created successfully Aug 03 08:59:10 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-33dca63b-7b78-4762-b185-4ba0a50fc11d tempest-ProjectReaderTests-1134321651 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60b7cd98-97db-44c8-bcd8-2632df709fb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88899) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:59:10 devstack cinder-volume[88899]: DEBUG cinder.volume.manager [None req-33dca63b-7b78-4762-b185-4ba0a50fc11d tempest-ProjectReaderTests-1134321651 None] Flow 'volume_create_manager' (c60d3ed6-33c4-44ec-84f1-dd2fca48b78d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88899) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:59:10 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-33dca63b-7b78-4762-b185-4ba0a50fc11d tempest-ProjectReaderTests-1134321651 None] Created volume successfully. Aug 03 08:59:10 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-7a920d25-0080-43e3-865d-c1bf801c523d tempest-ProjectReaderTests-1134321651 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:59:10 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-7a920d25-0080-43e3-865d-c1bf801c523d tempest-ProjectReaderTests-1134321651 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:59:10 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-7a920d25-0080-43e3-865d-c1bf801c523d tempest-ProjectReaderTests-1134321651 None] Creating offline snapshot 457a95bd-62da-437c-9be8-8a4ab354e329 of volume d4a29ceb-c874-4828-b48c-1781fcd28852 {{(pid=88899) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 03 08:59:10 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[05b947fa-2bee-4deb-a305-628d10f0ed1e]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:59:10 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-7a920d25-0080-43e3-865d-c1bf801c523d tempest-ProjectReaderTests-1134321651 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-d4a29ceb-c874-4828-b48c-1781fcd28852 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:59:10 devstack sudo[117350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-d4a29ceb-c874-4828-b48c-1781fcd28852 Aug 03 08:59:10 devstack sudo[117350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:59:11 devstack sudo[117350]: pam_unix(sudo:session): session closed for user root Aug 03 08:59:11 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-7a920d25-0080-43e3-865d-c1bf801c523d tempest-ProjectReaderTests-1134321651 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-d4a29ceb-c874-4828-b48c-1781fcd28852" returned: 0 in 0.339s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:59:11 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-7a920d25-0080-43e3-865d-c1bf801c523d tempest-ProjectReaderTests-1134321651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-d4a29ceb-c874-4828-b48c-1781fcd28852,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-d4a29ceb-c874-4828-b48c-1781fcd28852.457a95bd-62da-437c-9be8-8a4ab354e329 1G {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:59:11 devstack sudo[117355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-d4a29ceb-c874-4828-b48c-1781fcd28852,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-d4a29ceb-c874-4828-b48c-1781fcd28852.457a95bd-62da-437c-9be8-8a4ab354e329 1G Aug 03 08:59:11 devstack sudo[117355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:59:11 devstack sudo[117355]: pam_unix(sudo:session): session closed for user root Aug 03 08:59:11 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-7a920d25-0080-43e3-865d-c1bf801c523d tempest-ProjectReaderTests-1134321651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-d4a29ceb-c874-4828-b48c-1781fcd28852,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-d4a29ceb-c874-4828-b48c-1781fcd28852.457a95bd-62da-437c-9be8-8a4ab354e329 1G" returned: 0 in 0.404s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:59:11 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-7a920d25-0080-43e3-865d-c1bf801c523d tempest-ProjectReaderTests-1134321651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d4a29ceb-c874-4828-b48c-1781fcd28852 -F qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-d4a29ceb-c874-4828-b48c-1781fcd28852.457a95bd-62da-437c-9be8-8a4ab354e329 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:59:11 devstack sudo[117360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d4a29ceb-c874-4828-b48c-1781fcd28852 -F qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-d4a29ceb-c874-4828-b48c-1781fcd28852.457a95bd-62da-437c-9be8-8a4ab354e329 Aug 03 08:59:11 devstack sudo[117360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:59:11 devstack sudo[117360]: pam_unix(sudo:session): session closed for user root Aug 03 08:59:11 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-7a920d25-0080-43e3-865d-c1bf801c523d tempest-ProjectReaderTests-1134321651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d4a29ceb-c874-4828-b48c-1781fcd28852 -F qcow2 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-d4a29ceb-c874-4828-b48c-1781fcd28852.457a95bd-62da-437c-9be8-8a4ab354e329" returned: 0 in 0.272s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:59:11 devstack cinder-volume[88899]: WARNING cinder.volume.drivers.remotefs [None req-7a920d25-0080-43e3-865d-c1bf801c523d tempest-ProjectReaderTests-1134321651 None] /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-d4a29ceb-c874-4828-b48c-1781fcd28852.457a95bd-62da-437c-9be8-8a4ab354e329 is being set with open permissions: ugo+rw Aug 03 08:59:11 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-7a920d25-0080-43e3-865d-c1bf801c523d tempest-ProjectReaderTests-1134321651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-d4a29ceb-c874-4828-b48c-1781fcd28852.457a95bd-62da-437c-9be8-8a4ab354e329 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:59:11 devstack sudo[117365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-d4a29ceb-c874-4828-b48c-1781fcd28852.457a95bd-62da-437c-9be8-8a4ab354e329 Aug 03 08:59:11 devstack sudo[117365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:59:12 devstack sudo[117365]: pam_unix(sudo:session): session closed for user root Aug 03 08:59:12 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-7a920d25-0080-43e3-865d-c1bf801c523d tempest-ProjectReaderTests-1134321651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-d4a29ceb-c874-4828-b48c-1781fcd28852.457a95bd-62da-437c-9be8-8a4ab354e329" returned: 0 in 0.224s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:59:12 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-7a920d25-0080-43e3-865d-c1bf801c523d tempest-ProjectReaderTests-1134321651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-d4a29ceb-c874-4828-b48c-1781fcd28852.info {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:59:12 devstack sudo[117368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-d4a29ceb-c874-4828-b48c-1781fcd28852.info Aug 03 08:59:12 devstack sudo[117368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:59:12 devstack sudo[117368]: pam_unix(sudo:session): session closed for user root Aug 03 08:59:12 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-7a920d25-0080-43e3-865d-c1bf801c523d tempest-ProjectReaderTests-1134321651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-d4a29ceb-c874-4828-b48c-1781fcd28852.info" returned: 0 in 0.252s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:59:12 devstack cinder-volume[88899]: WARNING cinder.volume.drivers.remotefs [None req-7a920d25-0080-43e3-865d-c1bf801c523d tempest-ProjectReaderTests-1134321651 None] /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-d4a29ceb-c874-4828-b48c-1781fcd28852.info is being set with open permissions: ugo+rw Aug 03 08:59:12 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-7a920d25-0080-43e3-865d-c1bf801c523d tempest-ProjectReaderTests-1134321651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-d4a29ceb-c874-4828-b48c-1781fcd28852.info {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:59:12 devstack sudo[117371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-d4a29ceb-c874-4828-b48c-1781fcd28852.info Aug 03 08:59:12 devstack sudo[117371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:59:12 devstack sudo[117371]: pam_unix(sudo:session): session closed for user root Aug 03 08:59:12 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-7a920d25-0080-43e3-865d-c1bf801c523d tempest-ProjectReaderTests-1134321651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-d4a29ceb-c874-4828-b48c-1781fcd28852.info" returned: 0 in 0.253s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:59:12 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-7a920d25-0080-43e3-865d-c1bf801c523d tempest-ProjectReaderTests-1134321651 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.829s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:59:12 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-7a920d25-0080-43e3-865d-c1bf801c523d tempest-ProjectReaderTests-1134321651 None] Create snapshot completed successfully Aug 03 08:59:12 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-c51943c6-f759-4372-bc9e-3d28f86b3b2b tempest-ProjectReaderTests-1134321651 None] Acquiring lock "cinder-457a95bd-62da-437c-9be8-8a4ab354e329-delete_snapshot" by "delete_snapshot" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:59:12 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-c51943c6-f759-4372-bc9e-3d28f86b3b2b tempest-ProjectReaderTests-1134321651 None] Lock "cinder-457a95bd-62da-437c-9be8-8a4ab354e329-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:59:12 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-c51943c6-f759-4372-bc9e-3d28f86b3b2b tempest-ProjectReaderTests-1134321651 None] Acquiring lock "cinder-quobyte-d4a29ceb-c874-4828-b48c-1781fcd28852" by "delete_snapshot" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:59:12 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-c51943c6-f759-4372-bc9e-3d28f86b3b2b tempest-ProjectReaderTests-1134321651 None] Lock "cinder-quobyte-d4a29ceb-c874-4828-b48c-1781fcd28852" acquired by "delete_snapshot" :: waited 0.015s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:59:12 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-c51943c6-f759-4372-bc9e-3d28f86b3b2b tempest-ProjectReaderTests-1134321651 None] Acquiring lock "cinder-quobyte-457a95bd-62da-437c-9be8-8a4ab354e329" by "_delete_snapshot" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:59:12 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-c51943c6-f759-4372-bc9e-3d28f86b3b2b tempest-ProjectReaderTests-1134321651 None] Lock "cinder-quobyte-457a95bd-62da-437c-9be8-8a4ab354e329" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:59:12 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-c51943c6-f759-4372-bc9e-3d28f86b3b2b tempest-ProjectReaderTests-1134321651 None] Deleting offline snapshot 457a95bd-62da-437c-9be8-8a4ab354e329 of volume d4a29ceb-c874-4828-b48c-1781fcd28852 {{(pid=88899) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 03 08:59:12 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-c51943c6-f759-4372-bc9e-3d28f86b3b2b tempest-ProjectReaderTests-1134321651 None] snapshot_file for this snap is: volume-d4a29ceb-c874-4828-b48c-1781fcd28852.457a95bd-62da-437c-9be8-8a4ab354e329 {{(pid=88899) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 03 08:59:13 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[26293d84-ecb0-429d-b807-0db90c62665e]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:59:13 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-c51943c6-f759-4372-bc9e-3d28f86b3b2b tempest-ProjectReaderTests-1134321651 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-d4a29ceb-c874-4828-b48c-1781fcd28852.457a95bd-62da-437c-9be8-8a4ab354e329 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:59:13 devstack sudo[117380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-d4a29ceb-c874-4828-b48c-1781fcd28852.457a95bd-62da-437c-9be8-8a4ab354e329 Aug 03 08:59:13 devstack sudo[117380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:59:13 devstack sudo[117380]: pam_unix(sudo:session): session closed for user root Aug 03 08:59:13 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-c51943c6-f759-4372-bc9e-3d28f86b3b2b tempest-ProjectReaderTests-1134321651 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-d4a29ceb-c874-4828-b48c-1781fcd28852.457a95bd-62da-437c-9be8-8a4ab354e329" returned: 0 in 0.337s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:59:13 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.remotefs [None req-c51943c6-f759-4372-bc9e-3d28f86b3b2b tempest-ProjectReaderTests-1134321651 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d4a29ceb-c874-4828-b48c-1781fcd28852(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88899) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 03 08:59:13 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9789e53-2102-4350-be7f-57e2b95b6200]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:59:13 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-c51943c6-f759-4372-bc9e-3d28f86b3b2b tempest-ProjectReaderTests-1134321651 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-d4a29ceb-c874-4828-b48c-1781fcd28852 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:59:13 devstack sudo[117385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-d4a29ceb-c874-4828-b48c-1781fcd28852 Aug 03 08:59:13 devstack sudo[117385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:59:13 devstack sudo[117385]: pam_unix(sudo:session): session closed for user root Aug 03 08:59:13 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-c51943c6-f759-4372-bc9e-3d28f86b3b2b tempest-ProjectReaderTests-1134321651 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-d4a29ceb-c874-4828-b48c-1781fcd28852" returned: 0 in 0.343s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:59:13 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-c51943c6-f759-4372-bc9e-3d28f86b3b2b tempest-ProjectReaderTests-1134321651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-d4a29ceb-c874-4828-b48c-1781fcd28852.457a95bd-62da-437c-9be8-8a4ab354e329 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:59:13 devstack sudo[117390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-d4a29ceb-c874-4828-b48c-1781fcd28852.457a95bd-62da-437c-9be8-8a4ab354e329 Aug 03 08:59:13 devstack sudo[117390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:59:14 devstack sudo[117390]: pam_unix(sudo:session): session closed for user root Aug 03 08:59:14 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-c51943c6-f759-4372-bc9e-3d28f86b3b2b tempest-ProjectReaderTests-1134321651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-d4a29ceb-c874-4828-b48c-1781fcd28852.457a95bd-62da-437c-9be8-8a4ab354e329" returned: 0 in 0.330s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:59:14 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-c51943c6-f759-4372-bc9e-3d28f86b3b2b tempest-ProjectReaderTests-1134321651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-d4a29ceb-c874-4828-b48c-1781fcd28852.457a95bd-62da-437c-9be8-8a4ab354e329 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:59:14 devstack sudo[117396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-d4a29ceb-c874-4828-b48c-1781fcd28852.457a95bd-62da-437c-9be8-8a4ab354e329 Aug 03 08:59:14 devstack sudo[117396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:59:14 devstack sudo[117396]: pam_unix(sudo:session): session closed for user root Aug 03 08:59:14 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-c51943c6-f759-4372-bc9e-3d28f86b3b2b tempest-ProjectReaderTests-1134321651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-d4a29ceb-c874-4828-b48c-1781fcd28852.457a95bd-62da-437c-9be8-8a4ab354e329" returned: 0 in 0.241s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:59:14 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-c51943c6-f759-4372-bc9e-3d28f86b3b2b tempest-ProjectReaderTests-1134321651 None] Lock "cinder-quobyte-457a95bd-62da-437c-9be8-8a4ab354e329" released by "_delete_snapshot" :: held 1.340s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:59:14 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-c51943c6-f759-4372-bc9e-3d28f86b3b2b tempest-ProjectReaderTests-1134321651 None] Lock "cinder-quobyte-d4a29ceb-c874-4828-b48c-1781fcd28852" released by "delete_snapshot" :: held 1.361s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:59:14 devstack cinder-volume[88899]: DEBUG cinder.quota [None req-c51943c6-f759-4372-bc9e-3d28f86b3b2b tempest-ProjectReaderTests-1134321651 None] Created reservations ['08c98a70-af32-4ccf-b3bd-2bc67a0310f8', 'd7c5b9da-e9f3-4c21-9de9-e3ff4638304d', '51bc4962-cadc-4b6a-8d9f-8f45ee900eb5', '045ab40d-9465-4d81-8f1b-100ef585ff5a'] {{(pid=88899) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 08:59:14 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-c51943c6-f759-4372-bc9e-3d28f86b3b2b tempest-ProjectReaderTests-1134321651 None] Delete snapshot completed successfully. Aug 03 08:59:14 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-c51943c6-f759-4372-bc9e-3d28f86b3b2b tempest-ProjectReaderTests-1134321651 None] Lock "cinder-457a95bd-62da-437c-9be8-8a4ab354e329-delete_snapshot" released by "delete_snapshot" :: held 1.492s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:59:15 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-1f8511a6-c7b4-467d-a60d-2c298d38186f tempest-ProjectReaderTests-1134321651 None] Acquiring lock "cinder-d4a29ceb-c874-4828-b48c-1781fcd28852-delete_volume" by "delete_volume" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:59:15 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-1f8511a6-c7b4-467d-a60d-2c298d38186f tempest-ProjectReaderTests-1134321651 None] Lock "cinder-d4a29ceb-c874-4828-b48c-1781fcd28852-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:59:15 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-1f8511a6-c7b4-467d-a60d-2c298d38186f tempest-ProjectReaderTests-1134321651 None] Acquiring lock "cinder-quobyte-d4a29ceb-c874-4828-b48c-1781fcd28852" by "delete_volume" {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:59:15 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-1f8511a6-c7b4-467d-a60d-2c298d38186f tempest-ProjectReaderTests-1134321651 None] Lock "cinder-quobyte-d4a29ceb-c874-4828-b48c-1781fcd28852" acquired by "delete_volume" :: waited 0.017s {{(pid=88899) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:59:15 devstack cinder-volume[88899]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae958e3c-e828-4bb1-a0c0-39ad26a0044e]: (4, 'qcow2') {{(pid=90633) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:59:15 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-1f8511a6-c7b4-467d-a60d-2c298d38186f tempest-ProjectReaderTests-1134321651 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-d4a29ceb-c874-4828-b48c-1781fcd28852 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:59:15 devstack sudo[117399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-d4a29ceb-c874-4828-b48c-1781fcd28852 Aug 03 08:59:15 devstack sudo[117399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:59:15 devstack sudo[117399]: pam_unix(sudo:session): session closed for user root Aug 03 08:59:15 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-1f8511a6-c7b4-467d-a60d-2c298d38186f tempest-ProjectReaderTests-1134321651 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-d4a29ceb-c874-4828-b48c-1781fcd28852" returned: 0 in 0.336s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:59:15 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-1f8511a6-c7b4-467d-a60d-2c298d38186f tempest-ProjectReaderTests-1134321651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-d4a29ceb-c874-4828-b48c-1781fcd28852 {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:59:15 devstack sudo[117404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-d4a29ceb-c874-4828-b48c-1781fcd28852 Aug 03 08:59:15 devstack sudo[117404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:59:15 devstack sudo[117404]: pam_unix(sudo:session): session closed for user root Aug 03 08:59:15 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-1f8511a6-c7b4-467d-a60d-2c298d38186f tempest-ProjectReaderTests-1134321651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a/volume-d4a29ceb-c874-4828-b48c-1781fcd28852" returned: 0 in 0.229s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:59:15 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-1f8511a6-c7b4-467d-a60d-2c298d38186f tempest-ProjectReaderTests-1134321651 None] Lock "cinder-quobyte-d4a29ceb-c874-4828-b48c-1781fcd28852" released by "delete_volume" :: held 0.623s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:59:15 devstack cinder-volume[88899]: DEBUG cinder.quota [None req-1f8511a6-c7b4-467d-a60d-2c298d38186f tempest-ProjectReaderTests-1134321651 None] Created reservations ['3cae20a1-ac3e-4774-b509-1d30b0e26471', '41d8c6ca-8e0b-4e40-b0a9-7eb3fd79fc05', 'a4c26ea6-7c36-485d-8e8c-16974c402f00', '867e02a9-921c-49b5-8546-e4366240eee2'] {{(pid=88899) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 08:59:15 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-1f8511a6-c7b4-467d-a60d-2c298d38186f tempest-ProjectReaderTests-1134321651 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:59:15 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-1f8511a6-c7b4-467d-a60d-2c298d38186f tempest-ProjectReaderTests-1134321651 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:59:15 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-1f8511a6-c7b4-467d-a60d-2c298d38186f tempest-ProjectReaderTests-1134321651 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385': None} {{(pid=88899) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:59:15 devstack cinder-volume[88899]: DEBUG cinder.volume.drivers.quobyte [None req-1f8511a6-c7b4-467d-a60d-2c298d38186f tempest-ProjectReaderTests-1134321651 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0c2b256f-5995-45cd-bd86-aa9e4f2e1385'] {{(pid=88899) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:59:15 devstack cinder-volume[88899]: DEBUG oslo_concurrency.lockutils [None req-1f8511a6-c7b4-467d-a60d-2c298d38186f tempest-ProjectReaderTests-1134321651 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88899) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:59:15 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-1f8511a6-c7b4-467d-a60d-2c298d38186f tempest-ProjectReaderTests-1134321651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:59:15 devstack sudo[117407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a Aug 03 08:59:15 devstack sudo[117407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:59:16 devstack sudo[117407]: pam_unix(sudo:session): session closed for user root Aug 03 08:59:16 devstack cinder-volume[88899]: DEBUG oslo_concurrency.processutils [None req-1f8511a6-c7b4-467d-a60d-2c298d38186f tempest-ProjectReaderTests-1134321651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5bb56c5ed6c284470faf15e48a17a9a" returned: 0 in 0.229s {{(pid=88899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:59:16 devstack cinder-volume[88899]: DEBUG cinder.manager [None req-1f8511a6-c7b4-467d-a60d-2c298d38186f tempest-ProjectReaderTests-1134321651 None] Notifying Schedulers of capabilities ... {{(pid=88899) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 08:59:16 devstack cinder-volume[88899]: INFO cinder.volume.manager [None req-1f8511a6-c7b4-467d-a60d-2c298d38186f tempest-ProjectReaderTests-1134321651 None] Deleted volume successfully. Aug 03 08:59:16 devstack cinder-volume[88899]: DEBUG cinder.coordination [None req-1f8511a6-c7b4-467d-a60d-2c298d38186f tempest-ProjectReaderTests-1134321651 None] Lock "cinder-d4a29ceb-c874-4828-b48c-1781fcd28852-delete_volume" released by "delete_volume" :: held 1.047s {{(pid=88899) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:59:25 devstack cinder-volume[88899]: DEBUG dbcounter [-] [88899] Writing DB stats cinder:UPDATE=52,cinder:SELECT=45,cinder:DELETE=3,cinder:INSERT=12 {{(pid=88899) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 03 08:59:26 devstack cinder-volume[88899]: DEBUG dbcounter [-] [88899] Writing DB stats cinder:SELECT=39,cinder:UPDATE=56,cinder:INSERT=18,cinder:DELETE=6 {{(pid=88899) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}